Why is it wrong to want to be gender neutral?

Is there a problem with wanting to be free of the burden of sexual desire. I think it would be great, when looking at an attractive woman to not get an erection, nor have dirty thoughts about her later, not having to adjust myself to avoid discomfort, and be able to not get sweet talked into doing things for a hot woman. Getting castrated to me seems to be a gate to freedom that will end unwanted temptation and free up lots of time, why is it considered insane to do it. I know having a sexual identity is great for most people, and needed for society, but what is wrong with someone who wants to have no gender going ahead and doing it. Why would the person be labeled as insane? It is no less sane than having to find a partner to fulfill urges for you.