Is it re-solving for dependencies every time? Have you checked where the bottleneck is? (Don't CI pipeline tools hold onto Pip's download cache? Maybe this is part of why Setuptools gets so many downloads...)