If you upgrade, we do go fetch all the link content. We have users with 70k+ archived bookmarks, so you'd really be just a drop in the bucket.
It comes down to this - storage is cheap and development time is expensive. It would take considerable work to retrofit the crawler to only fetch dependencies for certain users, manage the case where they upgraded/downgraded between levels, and so on.
It comes down to this - storage is cheap and development time is expensive. It would take considerable work to retrofit the crawler to only fetch dependencies for certain users, manage the case where they upgraded/downgraded between levels, and so on.