Groq mistral-7B delivers 860T/s | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		Groq mistral-7B delivers 860T/s (groq.com)
		7 points by attentive on Jan 27, 2024 \| hide \| past \| favorite \| 1 comment

attentive on Jan 27, 2024 [–]

Groq absolutely crushes on performance.

You can try yourself on public chat https://chat.groq.com/

mixtral-8x7B - 490T/s

mistral-7B - 860T/s

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact