I totally understand the fear and being uncomfortable with confiding in a doctor. I believe it's what I would do. You could tell the doctor you deal with a lot of stress, but you don't know if the forgetfulness is more than that. There is a good chance the doctor could quickly put this anxiety to rest. They may just say your forgetfulness is completely normal. Either way, I believe it would help to talk to a doctor.