Especially when individual liberty is in contention with collective liberty. This is the "hard problem" for organizing a free society.
Eliminating traffic laws would make individuals more free in a literal sense, but those rules also make it so people can get from place to place quickly and safely. The liberty interpretation is that what people actually want is to travel, not to drive however they like. So you trade a freedom most people don't miss to enable another.
Vaccine mandates are a great example of this contention where under normal circumstances nobody cares about having to get vaccinated but they do care about not getting polio. Covid was strange in that the number of people opposed was significantly larger than I think anyone expected.
You seem to be confused between principally defending everyone having the same rights vs defending everything anyone can do.
The ACLU defends Nazi’s rights because they believe Nazis should have the same rights as everyone else irrespective of who they are.
That doesn’t mean they defend every possible action that can be considered a civil liberty.