Size is a factor, but no where near as important as raw fighting technique. Bruce Lee would wipe the floor with pretty much anyone in the world. Ali is smaller than Tyson, yet would cane his ass.

Unless Ja is some kind of martial artist, 50 would win. However, Murda Inc would beat G unit cos Suge would just eat everyone.