I don't think of white as a skin color. White people come in colors from almost actual white to tan. I think of them as native Europeans with European ancestry and their diaspora with little to no measurable nonwhite admixture (someone going around saying they're 1/16 Cherokee really doesn't count as nonwhite if they have white culture and appearance, someone like Obama obviously isn't white).
But what about Non-European whites? The Middle East (Southwest Asia and North Africa) and other parts of Asia are also white. Jews are Non-European whites. Israel is in Asia.
I agree with you that white isn't really a skin color. It just means the name of the race. It's called white because Europeans made up the names for races and most Europeans are light skinned.