Hacker News new | past | comments | ask | show | jobs | submit login

I built a similar pipeline using Kafka and ClickHouse - it's amazing how easy it is nowadays to ingest and analyze billions of events a day using standard tools.

ClickHouse can even ingest directly from Kafka (courtesy of Cloudflare - http://github.com/vavrusa contributed it).




Do you learn anything useful about humanity tho?


Fair comment. The title would imply there's a 'so what?' in the article, not just a 'how'.


Can you elaborate a bit about the servers you used (hardware, cluster size, etc.)?




Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: