Well, but see, the conquistadors were Spanish, therefore Not Us.

(For particular viewpoints of "us.")

Thanks for tossing in the acknowledgment that this is a dominant group thing, rather than specifically an Anglo-American one. I'm pretty sure the Han served (or maybe still serve?) that role in the context of Chinese imperialism.