Can this be set up on an existing Webflow site, not just new builds?

Yes. Heavy assets can be moved to a CDN and served back into a live site after launch too. It's smoothest when planned up front, but it isn't limited to new projects — if your Webflow bandwidth costs are climbing, or you're expecting a spike, the same approach applies to a site that's already running.