Too much soy?

Mom_of_X

So, I'm a vegetarian - although, since I started lifting, I've had to incorporate fish/seafood into my diet, both to feel good and to hit my macros. I do soy protein powder, and I personally can't stand the taste of whey/casein. I've recently started having intolerance issues with the crazy amount of dairy I'm ingesting (crazy in that I previously didn't eat these things with any sort of regularity).
My question to you: is switching from cow's milk to soy milk adding TOO MUCH soy to my diet? I've heard of headaches and dizziness occurring in people who consume too much soy, but is this an 'individual consumption' thing, or a general daily allotment thing?

Thanks in advance!

Mom_of_X

BUMP