Check out the cloudscraper library if are having speed/cpu issues with sites that require js/have cloudfare defending them. That plus a proxy list plus threading allows me to make 300 requests a minute across 32 different proxies. Recently implemented it for a project: https://github.com/rezaisrad/discogs/tree/main/src/managers
I've found myself writing the same session/proxy/rate limiting/header faking management code over and over for my scrapers. I've extracted it into it's own service that runs in docker and acts as a MITM proxy between you and target. It is client language agnostic, so you can write scrapers in python, node or whatever and still have great performance.
Highly recommend this approach, it allows you to separate infrastructure code, that gets highly complex as you need more requests, from actual spider/parser code that is usually pretty straightforward and project specific.
appreciate that! as a few mentioned here, there’s a lot of useful scraping tools/libraries to leverage these days. headless selenium no longer seems to make sense to me for most use cases
Looks pretty well done but confused why they used art from the Safavids as the cover art. Entirely different cuisine and time period of the contents of the book. Surely they could’ve celebrated art from the region?
What I found "odd" was that an Iraqi author was the first to translate the manuscript and publish the English version - https://www.amazon.com/Delectable-Foods-Dishes-al-Andalus-al... - and yet, while they make a one line mention of this, the whole article is about a British cook and author, and his book.
They don't really hide that fact. There's a limit to how in depth the knowledge of any history journalist can be on their own, and experts on an issue are going to want payment for their time.
Actual payment costs money, it's much easier to pay them in publicity by discussing a topic they released a book on or area they work at.
I've heard that publishers don't give authors much say in cover art. Maybe someone at the publishing company looked up "Sultan art high res" and found this.
The mental gymnastics one must go through to accept that “a military response” that’s murdered more innocent folks is justified has become so prevalent these past few weeks.
In war there is a lot of propoganda on all sides and it's not shocking that western platforms are acting to block this type of thing.
The reality on the ground is that the Gaza Strip is not a free country with a free news media and like we have in the west, and the terrorist government there is focused on producing sympathetic nonsense.
Could you imagine if Germany in WWII was publishing propoganda about how the British were just murdering innocent civilians? The Allies didn't wake up and decide to murder a bunch of people. They did it to counter the german's attacks.
That being said there should be a global solution to refugees and they should be allowed to have lead a full and free life everywhere they exist and not live in camps, but that needs to be settled in such a way that it doesn't leave a terrorist government in power or destroy other country's right to exist.
Some people are so trapped in poverty mentalities that they can’t even imagine buying a house when it’s cheap, they’ll just imagine they’ll be even poorer.
https://en.m.wikipedia.org/wiki/Thought-terminating_cliché
reply