Hacker News new | past | comments | ask | show | jobs | submit | from login
High-Speed Large Language Model Serving on PCs with Consumer-Grade GPUs (github.com/sjtu-ipads)
417 points by dataminer on Dec 20, 2023 | past | 83 comments
PowerInfer: High-Speed Large Language Model Serving on Consumer-Grade GPUs (github.com/sjtu-ipads)
4 points by limoce on Dec 19, 2023 | past | 1 comment
Encrypted Databases Made Secure yet Maintainable (github.com/sjtu-ipads)
2 points by mrigger on Sept 12, 2023 | past | 2 comments

Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: