I can’t recall which right now, but there are ones that manage to scrape the entire content by spoofing the Google crawler.
Since websites want to maximise their SEO, they must provide the raw content to be indexed better

Their stance on open source is really questionable, I just can’t buy their excuses when there’s so many counterexamples out there of both keeping their software actually open/libre and with a revenue stream