Do you guys think my doctor is being unethical?

He's being unethical, You need to change your doctor before something does happen. If you can't change your doctor request a nurse in the office for now on. But it sounds like he's interested in you and he's just trying to grab you attention but he's doing it all wrong. Or he's just trying to be friendly, depends I guess, if you see other female patients you should ask them how he acts around them. Buuut if you're that uncomfortable just switch doctors,