As I understand it, this is largely inaccurate. People just read "days off" as "more time", even though peasant farmers would need to engage in a lot of labor around the farm or household even on "days off" (your cows and chickens don't care that you're on vacation).

Of course people still do some chores today even on days off, but it's a lot less than you need to do on a farm, ask basically any farmer.