Oh wow, and 7+ Taskbar Tweaker can't fix the grouping either[^1]. I use it in Win 10 to ungroup without labels as that's not a configurable option.
Looks like the dev has moved to Windhawk, and that at least has partial support for ungrouping[^2].
[1]: https://ramensoftware.com/7-taskbar-tweaker-and-a-first-look...
[2]: https://ramensoftware.com/windhawk-mods-for-the-windows-11-t...