Detailed post of Apple M-series chips with LLM performance.
The M5 is listed in one of the comments as 153Gb/s. I don’t think this takes into account the improvement in time-to-first-token from the improved matmul that they added to the A19.
The M5 is listed in one of the comments as 153Gb/s. I don’t think this takes into account the improvement in time-to-first-token from the improved matmul that they added to the A19.