I think this is an issue mainly, because we as a society seem to care about sporting achievements of others and celebrate skills that men have an advantage in. We see being tall, having a high vertical leap, the ability to move quickly, and being physically strong as good things. So to avoid looking sexist society, but recognizing physical differences we created these segregated sports leagues for women. However, men generally don't care/look up to these women or their skillsets. Women rarely care about women in sports either. The main physical talent that women have over men is flexibility. This is why women's gymnastics gets more attention than men's gymnastics, contrary to basically every other sport. I think we have to ask, why do we as a society put so much money/thought/care into something so meaningless? Look at college sports. Other than football and basketball, they all lose money, and yet we give these kids free scholarships and travel to these events. Why? What is the actual return for us via their hard work and physical gifts?
Remember that adults playing high level sports exist for one reason, entertainment. It's nothing, but a dopamine increase for society. Of course trans people are biologically different from women. However, I just can't get morally outraged over it, because I ask why should I care at all about these sports that much in the first place? There's other ways to get a dopamine fix.