I think the problem is that people see it as a challenge. If you're aloof enough, they come running. It's what happened to my coworkers.

[ they're mean and distant and people keep bothering them for it. ]