I think if the church could still be the church without the sexist gender roles and incredibly unhealthy attitudes toward sexuality, I might stick around even though I don't believe. I don't really care about not believing any of the other stuff—it would be just like attending any other church, where I don't expect to internalize everything that's taught. I don't think I'd have a problem going just for the experience of going to church (assuming that I end up deciding that's an experience I feel I need in my life).
But I know firsthand how damaging the church's attitude toward sexuality is. I know how destructive the gender roles are to people who grow up being taught that they are God's Intended Way. There's no way I feel okay about exposing children to that kind of garbage, and I don't care to expose myself to it either, because it makes me angry and sick to hear.