Is he asking you to wait for medical reasons or because he's busy? If he's just busy, I personally would change.
I'm seeing Dr Tang Oi Shan. She was direct and honest which I liked. I have only seen her once though so it's hard to say how she will be once we get really started.