From my understanding, the main punishment for not working as prison labor is losing the small wages you do get (i.e, normally one of the punishments for misbehavior is prohibiting you from working).