I can think of more privileged Jewish people who did not suffer any danger because of the Nazis. But they are few in number. Yes, the fundamental underlying privilege is wealth/class.