Black fellow says to a white fellow: "You're my nigger."

If the white fellow responds: "Word, you're my nigger."

Is that racist or is the black fellow at fault for using the word?

I saw this happen in real life, the white fellow played it cool and only said: "Word." though.