why can’t the game stay NEUTRAL on refugees?

It’s perfectly okay to not want to take in people that don’t belong in your society, can cause unrest, drain resources, and change your population. It’s perfectly reasonable to see them as invaders.