Isn't the problem just that people make assumptions about a person's culture from their appearance? I don't understand how "cultural appropriation" is a problem, it's just something that has gone on for all history.

The close link between ethnicity and culture that often causes people to assume Asian-looking Australians speak a language other than English, or know about "eastern" things is just a historical artefact that I assume will go away at some point?