Is this normal behaviour from authority figures?

The freedom of information act ( I am uming you are in Canada) gives you the right to see the notes the doctor has written about you. You do not need a court order or anything just ask for them.These notes might give you a clue to the perception people have of you. If they are inaccurate you can then discuss his conclusions and see if you can correct them.