As a convert to Judaism is eligible, it cannot be a racial thing - also a Jew who converts to another religion is not allowed to make aliyah.
I wonder whether they think Greece, Ireland, Finland, Japan, Turkey, Italy, Germany, Chile and Spain are racists too? They have a similar immigration policy.