The procedures to open a startup in Germany are complex. This is the cheapest way: Go to the notary and create a "UG" after "Musterprotokoll". Create a company bank account, transfer the minimum amount of 1€ (plus the costs for founding, so you better transfer ~500€). This the fastest way and costs you together with an entry the commercial register (150€) around 500€ (300€ for the notary, depending on how many founders). This is followed up by stuff like "Körperschafts Anmeldung @Finanzamt", "Gewerbeamtanmeldung" (25€) and "IHK Gebühren" (80€/yr) and "VBG Anmeldung" (costs vary by the amount of employed persons). Don't forget the contract for the CEO as employed person.
As already told by others: You need to have a native speaker on your side to deal with the bureaucracy. Is this a startup friendly environment? Does it sound like? Hell no.
On the other hand: You can live in Berlin really cheap if you want to. Infrastructure is great and you don't need a car. There are a lot of meetups and startup events to get around people like yourself. Programmers aren't payed that well. Fundraising is a matter of network and traction like, i'd say, everywhere else.