Meta Removes Controversial Web Scraping Clause from Business Terms

Image: TechCrunch · Source

Meta has removed a contentious clause from its commercial terms that appeared to allow broad web scraping for AI training, clarifying it doesn’t change its web crawling practices.

Meta recently updated its commercial terms of use to include language stating the company could “use any content from [a business account’s] domains, web pages, or URLs to provide, develop, improve, research, train, and maintain the integrity of” its products and services. This provision, highlighted by legal experts as notable, raised concerns that Meta might be authorized to scrape websites of any publisher holding a Meta business account and use such content to train its artificial intelligence (AI) models. These concerns come against a backdrop of ongoing litigation involving AI companies, including Meta, over alleged copyright infringements related to the use of online content.

However, Meta clarified through a spokesperson that this update did not represent a change in how the company crawls or collects web data. Following feedback and media coverage, Meta has now removed this contentious clause from its terms. The company emphasized that the crawling terms only applied to its advertising and business products, a point now explicitly clarified in the revised terms.

By retracting the provision, Meta appears to be addressing publisher concerns about the extent to which their publicly accessible content could be used for AI training without specific consent. While Meta defeated a notable lawsuit disputing copyright infringement last year, the legal landscape around AI training data remains unsettled, and companies like Meta are under scrutiny regarding their data collection practices.

This development highlights the tension technology companies face in balancing product development using vast amounts of web data with respecting content creators' rights and legal boundaries. Meta’s clarification and removal of the clause suggests an intent to maintain a degree of transparency and avoid the perception of overreach in data usage policies.

At this time, Meta’s fundamental approach to web crawling and data collection for AI training remains consistent, according to the company’s statements. However, ongoing legal challenges and public scrutiny might continue to influence how large tech firms publicly communicate and manage their data and AI training operations in the future.