Excellent. The job feature has been a godsend. We had a hacky version for one-off jobs but k8-job feature removed some of those complexities. cron-jobs will be one step closer to an ideal solution.

Great postmortem report. I am very surprised to see that the DB ops simply deleted the index without even considering the consequences. More importantly, why isn't the 2 changes part of a single migration file? For e.g. in Django, south migrations can have both remove, create indexes in one file and executed together. Also, like some of the guys mentioned, why is the update performed to your entire global cluster. Shouldn't it be incremental like for e.g. one availability zone at a time?

Love what you guys doing there. We are building our data stack very much like yours (spark, kafka, redshift and python) at tradewave.net

It would be a fascinating to see what insights you get from analyzing your data. Hopefully you can publish them at some point.

Great writeup. It is so close to what we built at tradewave.net (except for Locust). I am glad I am not the only one that saw load testing using scalable containers. At some point, we will be going towards HFT and having a true load testing suite is handy.

awesome write up. I thought i was the only crazy guy to use lua to route subdomains to internal servers. Little surprised on the MySql part instead of redis like fast look up key.

You're assuming that searching restaurants on yelp and then booking is a hassle. It isn't for me and for most part people I know who eat out regularly. It's almost always you go there with your friends or significant other and wait at the bar (get drinks etc) and then get the table.

To be honest, I might have booked like 3 times via Opentable in a year.

I am sure there will be a small section of people wanting to do this but I doubt you will be able to scale to make it a operational business. In addition, it is very expensive.

I love this library and like others, was a god send. one thing I want to try is use the lib with the python mock lib to mock services that can return randomized data of some kind.

This!

I mean, I don't what to say other than punch that person.

I have had the first hand experience with this.

Is this for k12 only or are you planning this for higher ed? @kipinhall, we are pivoting towards professor centric app, so having the access to student info would be great. we can talk more if you're interested, ping me @agileseeker

Its funny you say this but I noticed it first hand. Also, it depends on where you network and who you network with.

Last month or so I was compelled to network aggressively being the CTO & all. Most folks I met at meetups or other networking events were flat out pointless. This also applies to so called "investor forums/pitches" etc, which to me was the worst kind.

But then I started targeting specific people using linkedin, personal references and my ROI has been great.

Also, you should never network for sake of networking. In fact most people I admire, want others to contact them only if they can help others than just exchange pleasantries. This to me was the biggest surprise but it does make sense [after the fact :)]