There's nothing wrong with that. Nobody should have a problem with you wanting to be a part of a church community, even if you aren't a "real" believer.
There are perhaps exceptions, e.g. if you are intentionally trying to harm the church or members of it, but otherwise the church should accept you as you are -- "true" believer or not.
In practice you will probably find a lot of "bad" churches, so you'll probably have to shop around a little bit.
I really appreciate this view, but certainly some people do have a problem with it. I think it would be especially awkward if you spend a significant amount of your life there, raise kids, etc, but never claim the religion is true. It almost sounds like a cringe-comedy movie
If your values and actions don't align with the religious community, then you should still be accepted, but if you don't have belief, then it's unlikely you'll stay for long.
^ note: by "should" I mean that, at least in my view, a "real" Christian should be accepting and not judge others. In practice nobody lives up to this, but it can at least inform how you should feel, e.g. if you feel judged it's saying more about others than it says about you.
^ double note: "real" Christian is incredibly hard to define. The Bible can be interpreted any way you want. Ultimately what guides me is trying to do what I think is right, using the Bible as one source of information.
Church Crashers