My character starts to left click/r attack whenever I close a menu

[TJXX]

On any of my characters that can attack without a target 9 out of 10 times when I close a menu they start attacking automatically until I click the button again.  It's really annoying since it puts me in combat or makes me hit things after I change skills, it also cancels my wind walking.  Has anyone else had this issue and figured out how to stop it?