Harassment, discrimination, and violence are major concerns for women and sexual and gender minorities (SGMs) who ride public transit. However, these experiences often go underreported, and agencies may not be aware of the extent of harassment within their services. Over 7,500 public transit users in New Jersey, U.S., were surveyed to gather feedback on their public transit experiences and safety concerns. We analyzed concerns for safety, experiences of harassment and assault, and perceptions of safety with regard to police, security cameras, and public transit employees. We explored public transit experiences among the following five groups: straight cisgender men, straight cisgender women, LGBQ+ cisgender women, LGBQ+ cisgender men, and trans/gender non-conforming (GNC) persons. The last three groups comprise the SGM population. We found that SGMs, and particularly transgender/GNC persons were disproportionately more likely to reveal safety concerns, harassment, and repeated harassment on public transit, and less likely to feel safer in the presence of police. A total of 84% of all harassment incidents had not been reported. SGMs were less likely to trust authorities when reporting a harassment incident than other populations. Current policies may not be sufficient in ensuring SGMs experience safe public transit travel.