The M1 chips have two types of cores: high-performance "Firestorm" cores and energy-efficient "Icestorm" cores, which are much slower.
It is indeed possible to constrain a process to the Icestorm cores using taskpolicy:
> taskpolicy -b -p 567
where 567 needs to be replaced by the process id.
Reference: https://eclecticlight.co/2022/10/20/making-the-most-of-apple...