What you described is basically slackware. If you install the whole image (roughly 6 gb) you get a working desktop machine that's easy to keep up to date (just run slackpkg update once in a while). Yet when it comes to tweaking, it's easy, because everything is a shell script or text file, no binary blobs of weird file formats. It actually reminds me a lot of FreeBSD.