You can come as long as you avoid the female students.

"You can enroll in my school but you must promise me one thing." Professor Xavier stressed.
"You must avoid all contact with female students. I can't have you be a constant distraction in my school. You must go to class and return to your dorm and only spend time with male students."