1) Many of the projects I do usually have some sort of crawling aspect to it. So therefore I found myself duplicating crawling code every time and so I decided to turn it into a hosted service that all my projects could benefit from. It stores responses, handles proxyification, and has all sorts of optimizations implemented that's useful and essential to crawling. It passes data via evented webhooks and is built in Rails, PostgreSQL, and Redis. As of now, it's not open to the public but if there's interest, that could change :) For more information, please see:
Very simplified I know :) Your formula is much better and I plan on implementing that soon! Thanks for checking out PledgeSociety as well as the lovely feedback.
1) Awesome! I've signed up. Hope to hear more.
2) Absolutely, thanks again for making the site. For what it's worth, the same author recently went into much more detail on how to make an optimal 'hot' algorithm, looking at Reddit as an example. I thought it was pretty interesting, even if it's a bit more complicated. http://www.evanmiller.org/deriving-the-reddit-formula.html
1) Many of the projects I do usually have some sort of crawling aspect to it. So therefore I found myself duplicating crawling code every time and so I decided to turn it into a hosted service that all my projects could benefit from. It stores responses, handles proxyification, and has all sorts of optimizations implemented that's useful and essential to crawling. It passes data via evented webhooks and is built in Rails, PostgreSQL, and Redis. As of now, it's not open to the public but if there's interest, that could change :) For more information, please see:
http://bit.ly/1KiUmlS
2) Right now the "trending score" is calculating based on the current and previous Snapshot. The formula is as follows:
current_snapshot_earnings - previous_snapshot_earnings ------------------------------------------------------------------ previous_snapshot_earnings
Very simplified I know :) Your formula is much better and I plan on implementing that soon! Thanks for checking out PledgeSociety as well as the lovely feedback.