This is true. People were prejudiced, of course, but the concept of racism specifically, as opposed to ethnic tribalism, is comparatively modern. Don’t forget there were white slaves and black emperors of Rome, etc. Skin color is a modern obsession.