What would happen if half the men in society became gay, had no sex drive or not born at all...?

There are still - at the moment anyway - more males than females in the world, due to countries where females are less valued. I don't expect what you say to have -that- much of an affect on gender levels, even in extreme cases it could only level the gender/population out.