Hacker News new | past | comments | ask | show | jobs | submit login

NICE ! Very Nice ! Congrats on the project and the naming !

If I may add a few thoughts : You may be very well placed for being a more suitable replacement to Minio in Data science / AI projects. Why ? Because a hard requirement for any serious MLOps construction needs 2 things : An append-only storage and a way to stream large content to a single place. First one is very hard to get right, second is relatively easy.

Being CRDT-based it should be _very easy_ for you to provide an append-only storage that can store partitioned, ordered logs of immutable objects (think dataframes, and think kafka). Once you have that, it's really easy to build the remaining missing pieces (UI, API, ...) for creating a _much better_ (and distributed) version of MLFlow.

Finally, S3 protocol is an "okay" version for file storage, but as you are probably aware, it's clearly a huge limiter. So, trash it. Provide a read-only S3 gateway for compatibility, but writes should use a different API.

PS: Galette-Saucisse <3




Thanks for your enthusiastic feedback, fellow breton!

It's an interesting take you make about ML workloads. We haven't investigated that yet (next in line is e-mail: you see we target ubiquitous, low-tech needs that are horrendous to host). But we will definitely consider it for future works: small breton food trucks do need their ML solutions for better galettes.


If you ever need further insights into the ML/AI use case, don't hesitate to ping me at {my-username}-at-gmail. I'll forward it to my work address :)


And you are cordially invited to our chatroom on Matrix, if you want to hack around Garage: https://matrix.to/#/#garage:deuxfleurs.fr

We used to mostly talk French there - until yesterday!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: