I checked the fine print on the product website: by “up to 4x faster LLM prompt processing,” they’re specifically referring to time to first token. So it’s not about token generation rate (tokens per second).
The prompt processing sped up.
Not the output generation.
M4 was notoriously slow at this compared to DGX etc.