Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
Google's Gemma to run locally on Nvidia GPUs
(
nvidia.com
)
20 points
by
jug
on Feb 21, 2024
|
hide
|
past
|
favorite
|
6 comments
iAkashPaul
on Feb 22, 2024
|
next
[–]
I've quantised 2B & 7B Instruct models here
https://huggingface.co/iAkashPaul/gemma-2b-it-gguf
&
https://huggingface.co/iAkashPaul/gemma-7b-it-gguf
yogorenapan
on Feb 22, 2024
|
prev
|
next
[–]
How does this compare to Mixtral (especially the Dolphin and Orca fine tunes)?
not_really
on Feb 22, 2024
|
parent
|
next
[–]
Not great, even when compared to Mistral 7b
ecmascript
on Feb 22, 2024
|
prev
[–]
I'm assuming it won't run on my GPU though since I am a white man
shapefrog
on Feb 22, 2024
|
parent
|
next
[–]
I'm ok, I self identify as a black woman.
badrabbit
on Feb 22, 2024
|
parent
|
prev
[–]
No, it is because you are too smart.
Consider applying for YC's Summer 2025 batch! Applications are open till May 13
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: