Get a better text editor and file browser, and probably terminal.
I use Sublime as my text editor, but there are other options.
I use PathFinder for a dual-pane file explorer.
I use iTerm2 for my terminal.
Otherwise, I don't recommend customizing too much out of the gate. If you are continuously hitting a pain point, then it could be worth it, but you'll learn the Mac way soon enough.