Fabrice Canel from Microsoft said that each day Bing discovers 12s of billions of normalized URLs never seen before. That is a lot of new URLs for BingBot to find in a single day, don’t you think?
But the web is big and content is constantly being produced, not just quality content but a lot of junk, gibberish, machine-generated content, and so forth.
Fabrice explained on Twitter that most of the content is “mostly useless content,” he listed examples such as duplicate content, scraped content, automatically generated content, spam content, junk content, and more.
So while Bing may discover billions and billions of new URLs per day, I doubt it indexes much of it.
Here are those tweets:
Site of the internet = ♾. We discover at #bing daily 12s of billions of normalized URLs never seen before. Mostly useless content (duplicate/scraped/automatically generated content, spam, junk, etc.). See our guidelines https://t.co/IKdDkLNs6W including the “Things to avoid”
— Fabrice Canel (@facan) August 17, 2022
Forum discussion at Twitter.
Here is a recap of what happened in the search forums today, through the eyes…
Google has provided details about the capabilities and limitations of its AI image generation tools…
On March 5, 2024, Google announced the launch of the March 2024 Core Update. The…
Google’s bold new vision for the future of online search, powered by AI technology, is…
A lot is happening in the world of search right now, and for many, keeping…
Google's John Mueller was asked when can a site expect to recover from the September…
This website uses cookies.
Leave a Comment