People who are more familiar with the culture would pick up the clues pretty quickly (from the way people talk and how they interact, e.g. the whites and the blacks almost never interact unless absolutely necessary and their difference in classes would be clearly shown), but it really took me a while.