I am brown. I have never felt like I was treated in a prejudiced manner by a white person that I know. My grandfather was. Some brown people still are. If I discriminate against a white person, that's not a response to racism, it's racism and calling it anything else is utter bullshit.
For what it's worth, if I am treated in a prejudiced manner by person A, and I treat person B in a prejudiced manner, and the only thing connecting A to B is race, that too is racism.
Or in simpler terms, two wrongs don't make a right.