Swimming

Question

Can one swim in a pool in which there are women? What about a case in which he takes of his glasses and he can't see that clearly? And if the answer is no, then how are we allowed to work in Manhattan during the summer where there are plenty of scantily-clad women?