DO what ya gotta do. I am in a family that looks different, and we get stares (sometimes) and both positive and negative reactions. But if you know God has set you on a path, and you plan on following it just know you have the support of those who understand your predicament. I cant imagine that you get worse stares than women who are wearing hijabs (sp?). I would (while wearing the bonnet) ask one about her experiences and how she deals socially. Just a thought.
Some people are sincere in their curiosity and others ( yes, I know ) are inappropriate. Is it embarrassing for your spouse?