I've used Vega as part of a complex dashboard builder (think Looker/Tableau) and it is quite powerful and flexible, but like all of these libraries once you stray from the well worn tracks things get tricky.

For example, it was difficult to build charts from pre-aggregated data, like a box plot given p5, p25, p50, mean, p75 p95 and a list of outliers.