I have some of the same issues, but usually say, “I’ll be glad to refer you to someone.” If it is an easy question to answer I might use the opportunity to educate briefly. If a guy in a bar asks what I do, and I tell him, he invariably asks, “Are you analyzing me right now?” I say, “Not if you aren’t paying me.”