I haven't contributed to the Patreon but have been following from the side lines. From my perspective, this isn't a failure at all. You've created high quality updates as you've progressed in your project and you're leaving the project open source for the community. I know that if I were to have given you money, I would feel entirely satisfied since you're giving your work back to the community. I can't wait to poke around the source.
Thanks for hard work. Good luck at OpenAI!