Home bing Bing says it has been applying BERT since April

Bing says it has been applying BERT since April

Bing has been using BERT to improve the quality of search results since April, Microsoft has stated. The transformer models are now applied to every Bing query globally.

Click to enlarge. Source: Microsoft.

In the example above, Bing’s improved natural language processing capabilities enable it to understand that the user wants to learn about what to avoid after suffering from a concussion. Prior to the addition of these transformer models, results pertained to the symptoms of a concussion.

Why we should care

Better natural language understanding should lead to more relevant search results for users. We now know that both Bing and Google are using these advanced algorithms to inform search results, particularly those that trigger for longer queries. In fact, Bing’s implementation of BERT to improve its search results pre-dates Google’s BERT announcement by six months. Bing says this has led to the biggest improvements in search quality in the last year.

“Unlike previous deep neural network (DNN) architectures that processed words individually in order, transformers understand the context and relationship between each word and all the words around it in a sentence,” explained Jeffrey Zhu, Bing Platform program manager. “Starting from April of this year, we used large transformer models to deliver the largest quality improvements to our Bing customers in the past year.”

BERT builds on the deep learning capabilities used in Bing’s Intelligent Search features, such as Intelligent Answers that draw upon multiple sources, Intelligent Image Search with object recognition and hover-over definitions for uncommon words. These improvements can help Bing preserve or grow its share of the search market, which will continue to make it a viable platform for both organic and paid campaigns.

More on the announcement

  • Microsoft implemented transformer models by using Azure N-series Virtual Machines with GPU accelerators and then performed further optimizations to execute the parallel computing at web-search scale.

Learn more about BERT

Here are some additional resources to expand your understanding of the latest breakthrough in natural language processing.

Must Read

SEOs must focus on intent research practices in 2020

SMX speaker, Frédéric Dubut of Bing, explains why 2020 is the year SEOs need to evaluate their intent research practices to keep up with...

Businesses need to think differently about customer feedback data in 2020

Contributor and SMX speaker, Adam Dorfman, thinks the customer feedback ecosystem is going to play an even more important role in the coming year...

How verticalization and zero-click will impact local search in 2020

In a recent post on the SparkToro blog, Moz founder and search guru Rand Fishkin predicted that 2020 will be the year Google is...

Make it easy for search engines to rank your website in 2020

Contributor and SMX speaker, Fili Wiese, explains why it’s important to audit your website in 2020 to help search engine algorithms better understand your...

Microsoft Advertising launches sweepstakes for advertisers

To kick off a new year, Microsoft Advertising has launched an incentive sweepstakes for advertisers. How to enter. To enter the Microsoft Advertising Sweepstakes,...