The name Ivory means White As Elephant Tusks and is of English origin. Ivory is name that's been used by parents who are considering unisex or non-gendered baby names--baby names that can be used for any gender.