Hacker News Reader

Is there anything that affects inference compute time besides the number of parameters? Assuming same hardware, etc.

Yes - for example adding memory to the attention mechanism (similar to RETRO or Memorizing Transformers paper)