What you describe sounds similar to Statamic. The config and even the content is yaml files, and the admin UI is also quite extensible. But I always wish it was easier to change stuff with code in Statamic, so maybe that's where Payload shines.
Payload's config is straight up TypeScript. Import a React component, pass it to your config, and boom — it shows up in your admin UI.
Everything is written like that and this is certainly where we shine!