Lump in near nipple?

Has anyone had a lump in the just under the nipple area? I had one a couple of years ago, but the specialist said it was just a hardening milk duct and would go away. It never went away, but got softer to the point where it was hardly noticeable. Now it's back. I just had a partial hysterectomy so I'm wondering if it's hormonal. Its the same lump, same spot, only bigger and more evenly round than before. I don't know if I should worry. I can't get in to see the doctor for another five weeks!