Help please?

Why is it that if I speak out about illegal immigration I am immediatly branded as a racist? Does no one acknowledge that crossing someone else's country's border without authorization is illegal? And please don't even try to call me a racist, my wife is from across the southern border and she came in legally. She even took the oath of allegiance and it caused me a missed heartbeat when she did it. But then I still get goosebumps when I hear the national anthem or 'To The Colors'. Golly fifty percent of my own family came through Ellis Island with no hope of any sort of...welfare(?)...Am I really zenophobic?