History - witches have been hunted a couple of times in my world, and if it weren't a really widespread thing, we might have gone extinct. Then the pendulum swings back, and we're revered instead of reviled... and it seems there's people who don't listen to explanations, and just want you to fix everything.

It's a lot easier to protect people when they aren't underfoot.