Google’s Gary Illyes On AI, Site Migrations, & “SEO Is Dead” Claims via @sejournal, @MattGSouthern

Following the recent SERPConf event, Google Search Analyst Gary Illyes shared insights that provided a glimpse into the latest trends and challenges in the SEO world.

His LinkedIn post touches on a range of topics, from technical issues to the role of AI, providing a thorough overview of the industry’s current state.

Addressing hreflang Frustrations

One key discussion area was the ongoing struggle with hreflang, a markup that indicates a website’s language and regional variations.

Illyes acknowledged the difficulties, stating, “hreflang is annoying. I don’t disagree.”

However, he was open to finding a better solution, adding:

“I’m still very open to coming up with something less annoying, but it needs to work for small sites and mammoths as well, while delivering at least the same amount of information.”

The AI Conundrum: Fear vs Innovation

The rise of AI, particularly generative AI, was a hot topic at the conference.

While some attendees expressed concerns, Illyes offered a balanced perspective.

“AI is a tool that you can use and, just like with any tool, misuse. It’s not in any way different from any other feature accessible to you.”

He encouraged SEOs to “use it as you like, liberally and innovatively” but cautioned against contributing to the abundance of low-quality content already present online.

Site Migrations: A Persistent Challenge

Another area of concern highlighted by Illyes was the ongoing issue of site migrations gone wrong.

“This shouldn’t happen,” he stated, urging webmasters who have experienced prolonged issues with site migrations to contact Google for assistance.

The Persistent “SEO is Dead” Myth

Addressing the recurring claim that SEO is becoming obsolete, Illyes dismissed it as a cyclical phenomenon.

“Every single time something changes on search engines there’s a plethora of posts published about how SEO is dead now,” he remarked.

Drawing from the history of search engines, he added:

“Looking at the history of search engines and according to these posts, SEO has been dying since cca 2003. Hell of a slow death.”

Why SEJ Cares

As SEO evolves, with AI and other emerging technologies playing a prominent role, Illyes’ insights show there are both challenges and opportunities.

His willingness to address concerns head-on and acknowledge areas for improvement may foster a more open dialogue between Google and SEO professionals.

How This Can Help You

There are several key takeaways for SEO professionals:

  • Stay tuned for potential hreflang improvements. Illyes suggested that changes could be on the horizon.
  • Embrace AI responsibly. Illyes encourages SEO professionals to explore these technologies innovatively while emphasizing the importance of maintaining high standards and producing quality content.
  • Reach out to Google regarding site migration issues. With site migrations being a pain point, Illyes’ recommendation to escalate prolonged issues highlights the need for proactive communication with Google.
  • Tune out the “SEO is dead” noise. Illyes offered a reality check for those overwhelmed by doomsday narratives. Understanding that the industry has weathered similar claims can help you maintain focus.

Featured Image: fran_kie/Shutterstock

The Best SEO Conferences For 2024-2025 (Virtual And In-Person) via @sejournal, @lorenbaker

The rapid advancements in artificial intelligence and machine learning have dramatically reshaped the SEO and digital marketing landscape, and attending a conference is arguably one of the best ways to benefit from the latest industry insights while expanding your professional network.

Spending hours researching articles, forum discussions, and other online resources is always valuable, but attending conferences can significantly enhance your learning experience.

By directly interacting with industry professionals and experts, having the opportunity to ask them questions offers a depth of knowledge that complements and goes beyond what self-guided online research can provide.

In short, attending conferences, whether in-person or virtual, offers a wide range of benefits:

  • Networking opportunities.
  • Learning from experts.
  • Interactive workshops.
  • Staying updated with trends.
  • Exposure to new tools and discovering the marketplace.
  • Direct Q&A sessions.
  • Receiving feedback from experts on your work.
  • Building your company or personal brand.
  • Competitive insights.
  • Inspiration and creativity.
  • Unique case studies available only to conference attendees.

To help you decide which ones you should attend, we’ve compiled a list of the best SEO conferences in 2024.

Whether you’re a road warrior who wants to attend as many events as possible or an introvert who only wants to attend digitally, there are sure to be several conferences that fit your needs.

So, without further ado, here is our list of the best online and in-person SEO conferences this year.

SEO & Digital Marketing Events For 2024

Here are some SEO and digital marketing conferences and events coming up this year. Mark your calendar now so you don’t miss them.

Friends Of Search Fest

  • Website
  • Date: March 21, 2024.
  • Format: In-person.
  • Location: Amsterdam, Netherlands.
  • Speakers: Kevin Indig, Aleyda Solís, Purna Virji, and Barry Adams, among others.
  • Cost: Starting from €477,95-€568,95.
  • About: One of Europe’s largest search conferences. The event brings together consultants, marketers, and business owners to share their insights on SEO, PPC, and digital marketing. This three-day event will feature sessions designed to provide attendees with actionable insights and the latest information from industry experts.

In the video below, you can see what a real-life conference looks and feels like.

Adobe Summit

  • Website
  • Date: March 26-28, 2024.
  • Format: In-person, on-demand sessions available.
  • Location: Las Vegas, NV.
  • Speakers: Shantanu Narayen, Karen Hopkins, Greg Cobb, Trevor Paulsen, Bob Conklin, Badsah Mukherji, and many others.
  • Cost: $1895-$2095 with various discounts available; on-demand sessions after the event are free.
  • About: The Adobe Summit features a massive variety of guests and keynotes, including actors, producers, CEOs, and Olympians. The in-person conference includes sessions, hands-on labs, meals, and evening events. You can register for the virtual summit for free to access keynotes and speaking sessions after the event.

Preview of the conference from Adobe.

Brighton SEO

  • Website
  • Date: April 25-26 and October 3-4, 2024 (UK) and November 19-20, 2024 (US).
  • Format: In-person and online.
  • Location: Brighton, U.K. and San Diego, US.
  • Speakers: Adriana Stein, Dan Taylor, and Amanda Walls, among others.
  • Cost: In-person starts at £350; virtual video bundle at £110. You can also join a waitlist for free tickets.
  • About: This twice-yearly conference is attended by thousands of digital marketers worldwide. It features training workshops, sessions on niche topics, social networking events, and talks from experts. There is also a US-based version of the conference; brightonSEO San Diego takes place in November 2024.

Below is video feedback from attendees.

MnSearch Summit

  • Website
  • Date: June 14, 2024
  • Format: In-person.
  • Location: Saint Paul RiverCentre in St. Paul, Minnesota.
  • Speakers: Mike King, Greg Gifford, Susan Wenogra, Ian Lurie, and many others.
  • Cost: $347-547.
  • About: MnSearch Summit is two days of learning and networking with thought leaders from the digital marketing industry. It includes workshops, sessions, and events focused on SEO, PPC, social media, and analytics, among other topics.

MozCon 2024

  • Website
  • Date: June 3-4, 2024.
  • Format: In-person or live streaming.
  • Location: Seattle, WA.
  • Speakers: Amanda Jordan, Andy Crestodina, and Azeem Ahmad, among others.
  • Cost: Early bird in-person tickets start at $899; livestream only for $299-$499.
  • About: The annual digital marketing conference hosted by Moz, this conference features networking and expert sessions from SEO industry leaders, as well as experts in mobile search, conversion optimization, and search marketing.

Below is a sample talk from past MozCon.

WTSFest

  • Website
  • Dates: June 7, 2024, September, 19 2024.
  • Format: In-person & Recording tickets available.
  • Locations: London, Berlin, Philadelphia, PA.
  • Speakers: Grace Frohlich, Joyann Boyce, Lily Ray, Navah Hopkins, Purna Virji, Chima Mmeje and more.
  • Cost: From $199 to $399 in Philadelphia, £99 or £299 in London, sold out in Berlin (waiting list available).
  • About: The Women in Tech SEO Festival is a full-day conference coming back to London for the fifth time on International Women’s Day, expanding this year to 2 more locations in Germany and the USA. A community-led one-track conference featuring a line of 10 brilliant speakers on analytics, search, technical SEO and empowerment talks.

Below is a snapshot from the conference venue sidelines, where you can get a real-life overview of the conference.

Growth Marketing Summit 2024

  • Website
  • Date: June 19, 2024.
  • Format: In-person.
  • Location: Frankfurt am Main, Germany
  • Speakers: Michael Aagaard, Lukas Vermeer, and Erin Weigel, among others.
  • Cost: Early bird rate from €699.
  • About: Assembling growth marketers and digital professionals worldwide, this single-day event features world-class speakers sharing their expertise on flexible and data-driven marketing solutions.

Here is what the venue looks like and some video feedback from attendees.

INBOUND 2024

  • Website
  • Date: September 18-20, 2024.
  • Format: In-person or online.
  • Location: Boston, MA.
  • Speakers: TBA.
  • Cost: In-person from $899 for September 18-20; from $1,699 for the September 17-20 VIP pass.
  • About: This annual event is powered by HubSpot, bringing together global thought leaders for a hybrid conference discussing marketing, sales, and customer success operations. It covers a wide range of topics and gives attendees the opportunity to network and learn from some of the best in the business.

Below is a comprehensive review from attendees.

B2B Marketing Expo 2024

  • Website
  • Date: October 9-10, 2024.
  • Format: In-person.
  • Locations: Miami, FL, and Los Angeles, CA.
  • Speakers: Ryan Ross, Winston T Marshall, David Jarvis, and many others.
  • Cost: Free.
  • About: Featuring education masterclasses for marketing professionals, this annual conference covers a variety of tracks, including advertising and promotion, content and experience, and commerce and sales. Hundreds of suppliers and speakers will be on hand to discuss the state of the industry and recent happenings.

Below is the video from the real-life experiences of attendees.

Engage (Formerly SearchFest)

  • Website
  • Date: October 17-18, 2024.
  • Format: In-person.
  • Location: Portland, OR.
  • Speakers: Ryan Jones, Martha van Berkel, Jesse McDonald, and many others.
  • Cost: $299-$900.
  • About: Engage Marketing Conference is a one-day digital marketing conference featuring informative learning tracks and panel sessions designed to provide expert insight into the latest strategies and technological advancements in digital marketing, social media, content, UX/design, creative, advertising, SEO, paid media, and more!

Below is a picture from the conference venue by one of the attendees.

Content Marketing World

  • Website
  • Date: October 21-23, 2024.
  • Format: In-person or online.
  • Location: San Diego, CA.
  • Speakers: Ann Handley, Robert Rose, Cassie Kozyrkov, and many others.
  • Cost: Super Early bird in-person tickets start at $1199; livestream only for $899.
  • About: Over four days, attendees will learn strategies for building winning SEO teams, systems, and processes. With more than 100 sessions, workshops, and industry forums, you can choose the topics and sessions that are relevant to you. Thousands of marketers and representatives from numerous global brands will be in attendance.

Here is an example video from last year’s conference.

ADworld Experience

  • Website
  • Date: October 17-18, 2024.
  • Format: In-person and online.
  • Location: Bologna, Italy.
  • Speakers: Fiona Bradley, Tom Breeze, Valerio Celetti, and many others.
  • Cost: Early bird in-person tickets start at €529; livestream only for €199.
  • About: Bringing together PPC experts from across the globe for the largest paid ad and conversion rate optimization event in Europe – and the largest real PPC-based conference in the world.

State Of Search 2024

  • Website 
  • Date: October 28-29, 2024.
  • Format: In-person and online.
  • Location: Grapevine, TX.
  • Speakers: TBD.
  • Cost: TBA.
  • About: The State of Search brings together top speakers from the digital marketing field to cover various topics, from search engine optimization to emerging technology, lead generation, and display advertising.

Below is one of the talks from past conferences by Eric Enge.

DMO Advanced 2024

  • Website 
  • Date: TBA.
  • Format: In-person.
  • Location: Napa Valley, CA.
  • Speakers: TBA.
  • Cost: TBA.
  • About: Digital Marketers Organization will again host their advanced digital marketing event, blending interactive and educational sessions with networking opportunities. There will be numerous sessions specifically designed for SEO, including information on technical debt, localization, and internationalization.

DigiMarCon

  • Website
  • Date: On-going throughout 2024.
  • Format: In-person and online.
  • Location: Various global locations.
  • About: DigiMarCon offers a range of events throughout the year, both virtual and in-person conferences in various global locations. Digital Marketing Conferences is a global series of events bringing together thought leaders from the digital marketing, media, and advertising industries. These conferences focus on emerging strategies, the latest technology, recent best practices, networking, and collaboration.

International Search Summit (IIS) Barcelona

  • Website 
  • Date: November 14, 2024.
  • Format: In-person.
  • Location: World Trade Center, Barcelona, Spain.
  • Speakers: TBA. Past speakers include Gary Illyes, Mordy Oberstein, Olga Andrienko, Navah Hopkins, among others.
  • Cost: Tickets from €750, including access to ISS and International SEO Workshop.
  • About: The International Search Summit is dedicated entirely to global digital marketing and learning the strategies to drive sales and growth around the world. With a focus on people, as well as learning, networking sessions are integrated into the whole event to ensure attendees leave with new knowledge and new connections. In the past, there have been 3 tracks with 30 sessions, all focused on international SEO and PPC. There will also be a deep dive International SEO Workshop running on November 14.

Below is a review from attendees.

The eCommerce & Omnichannel Retail Conference (eTail)

  • Website
  • Date: February 24 -February 27, 2025.
  • Format: In-person with on-demand available for a limited time following events.
  • Location: Palm Springs, CA.
  • Speakers: Kristin Shane, Drew Green, Dave Spector, and Anngelica Newland, among many others.
  • Cost: In-person starting at $2,099.
  • About: With a focus on digital commerce, this event is a four-day retreat designed to help ecommerce and omnichannel stores uncover new ways to maximize profits from some of America’s most successful retailers. Check out the full series of conferences throughout the year in Boston, Toronto, Canada, and London, England.

Preview of the conference from past attendees.

Pubcon 2025

  • Website
  • Date: TBA.
  • Format: In-person.
  • Location: Las Vegas, NV.
  • Speakers: Gary Illyes, Brett Tabke, Fabrice Canel, and many others.
  • Cost: $599-$1699.
  • About: Pubcon, a “fullstack marketing conference,” is in its 21st year. This two-day, in-person event features keynotes from Google and Bing and a packed schedule of conference sessions. Based on your interest, choose between different topic tracks such as organic SEO, marketing potpourri, site reviews, and ChatGPT and AI content.

Here is a snapshot of what it looked like during past conferences.

Search Marketing Expo (SMX Munich)

  • Website
  • Date: March 18-19, 2025.
  • Format: In-person.
  • Location: Munich.
  • Speakers: Bastian Grimm, Andrey Lipattsev and Jes Scholz, among others.
  • Cost: Starting from €550-€2,295.
  • About: SMX Munich is large event with +1000 attendees focused on search marketing, attracting a diverse range of industry professionals. It offers a valuable opportunity for networking, learning, and discovering new tools and practices in the field of SEO, Social Media and PPC.

Below is a presentation from the past that can help you grasp what the event’s content looks like.

Social Media Marketing World

  • Website
  • Date: March 30- April 1, 2025.
  • Format: In-person and on-demand.
  • Location: San Diego, CA.
  • Speakers: Michael Stelzner, Ann Handley, Dr. Mindy Weinstein, Joe Pulizzi, and many others.
  • Cost: In-person starting at $1497-$1997; streaming for $697; on-demand for $997.
  • About: Bringing together top social media marketing pros, this conference is not directly focused on SEO but features sessions on organic social marketing, paid social marketing, social strategy, content marketing, and several workshops.

It strives to immediately provide attendees with ideas they can implement for their clients or businesses.

Below is a real-life experience of what it looks like by Latasha James.

Great SEO Pros Never Stop Learning

For an SEO professional, experience is important – but not nearly as vital as staying up to date.

While you can keep an eye on what’s going on in the world of search engines, paid advertising, and digital marketing by reading expert publications (like this one, for example), it’s also great to meet with other people who are performing the same job.

This gives you a chance not just to interact with them but to ask questions and develop relationships that could reap rewards far down the line. And SEO conferences are a great place to do this.

So, whether you’re trying to brush up on the basics, identify the latest techniques, or just take a trip on the company dime, the above events are a great place to start.

Include Your SEO Conference

This article is updated whenever possible to reflect frequent changes to event schedules and details.

If you’re hosting an upcoming SEO event and want it listed, please submit it via the form below:

More resources: 


Featured Image: l i g h t p o e t/Shutterstock

5 Things To Consider Before A Site Migration via @sejournal, @martinibuster

One of the scariest SEO tasks is a site migration because the stakes are so high and the pitfalls at every step . Here are five tips that will help keep a site migration on track to a successful outcome.

Site Migrations Are Not One Thing

Site Migrations are not one thing, they are actually different scenarios and the only thing they have in common is that there is always something that can go wrong.

Here are examples of some of the different kinds of site migrations:

  • Migration to a new template
  • Migrating to a new web host
  • Merging two different websites
  • Migrating to a new domain name
  • Migrating to a new site architecture
  • Migrating to a new content management system (CMS)
  • Migrating to a new WordPress site builder

There are many ways a site can change and more ways for those changes to result in a negative outcome.

The following is not a site migration checklist. It’s five suggestions for things to consider.

1. Prepare For Migration: Download Everything

Rule number one is to prepare for the site migration. One of my big concerns is that the old version of the website is properly documented.

These are some of the ways to document a website:

  • Download the database and save it in at least two places. I like to have a backup of the backup stored on a second device.
  • Download all the website files. Again, I prefer to save a backup of the backup stored on a second device.
  • Crawl the site, save the crawl and export it as a CSV or an XML site map. I prefer to have redundant backups just in case something goes wrong.

An important thing to remember about downloading files by FTP is that there are two formats for downloading files: ASCII and Binary.

  1. Use ASCII for downloading files that contain code, like CSS, JS, PHP and HTML.
  2. Use Binary for media like images, videos and zip files.

Fortunately, most modern FTP software have an automatic setting that should be able to distinguish between the two kinds of files. A sad thing that can happen is to download image files using the ASCII format which results in corrupted images.

So always check that your files are all properly downloaded and not in a corrupted state. Always consider downloading a copy for yourself if you have hired a third party to handle the migration or a client is doing it and they’re downloading files. That way if they fail with their download you’ll have an uncorrupted copy backed up.

The most important rule about backups: You can never have too many backups!

2. Crawl The Website

Do a complete crawl of the website. Create a backup of the crawl. Then create a backup of the backup and store it on a separate hard drive.

After the site migration, this crawl data can be used to generate a new list for crawling the old URLs to identify any URLs that are missing (404), are failing to redirect, or are redirecting to the wrong webpage. Screaming Frog also has a list mode that can crawl a list of URLs saved in different formats, including as an XML sitemap, and directly input into a text field.  This is a way to crawl a specific batch of URLs as opposed to crawling a site from link to to link.

3. Tips For Migrating To A New Template

Website redesigns can be can be a major source of anguish when they go wrong. On paper, migrating a site to a new template should be a one-to-one change with minimal issues. In practice that’s not always the case.  For one, no template can be used off the shelf, it has to be modified to conform to what’s needed, which can mean removing and/or altering the code.

Search marketing expert Nigel Mordaunt (LinkedIn), who recently sold his search marketing agency, has experience migrating over a hundred sites and has important considerations for migrating to a new WordPress template.

This is Nigel’s advice:

“Check that all images have the same URL, alt text and image titles, especially if you’re using new images.

Templates sometimes have hard-coded heading elements, especially in the footer and sidebars. Those should be styled with CSS, not with H tags. I had this problem with a template once where the ranks had moved unexpectedly, then found that the Contact Us and other navigation links were all marked up to H2. I think that was more of a problem a few years ago. But still, some themes have H tags hard coded in places that aren’t ideal.

Make sure that all URLs are the exact same, a common mistake. Also, if planning to change content then check that the staging environment has been noindexed then after the site goes live make sure that the newly uploaded live site no longer contains the noindex robots meta tag.

If changing content then be prepared the site to perhaps be re-evaluated by Google. Depending on the size of the site, even if the changes are positive it may take several weeks to be rewarded, and in some cases several months. The client needs to be informed of this before the migration.

Also, check that analytics and tracking codes have been inserted into the new site, review all image sizes to make sure there are no new images that are huge and haven’t been scaled down. You can easily check the image sizes and heading tags with a post-migration Screaming Frog crawl. I can’t imagine doing any kind of site migration without Screaming Frog.”

4. Advice For Migrating To A New Web Host

Mark Barrera (LinkedIn), VP SEO, Newfold Digital (parent company of Bluehost), had this to say about crawling before a site migration in preparation for a migration to a new web host:

“Thoroughly crawl your existing site to identify any indexing or technical SEO issues prior to the move.

Maintain URL Structure (If Possible): Changing URL structures can confuse search engines and damage your link equity. If possible, keep your URLs the same.

301 Redirects: 301 Redirects are your friend. Search engines need to be informed that your old content now lives at a new address. Implementing 301 redirects from any old URLs to their new counterparts preserves link equity and avoids 404 errors for both users and search engine crawlers.

Performance Optimization: Ensure your new host provides a fast and reliable experience. Site speed is important for user experience.

Be sure to do a final walkthrough of your new site before doing your actual cutover. Visually double-check your homepage, any landing pages, and your most popular search hits. Review any checkout/cart flows, comment/review chains, images, and any outbound links to your other sites or your partners.

SSL Certificate: A critical but sometimes neglected aspect of hosting migrations is the SSL certificate setup. Ensuring that your new host supports and correctly implements your existing SSL certificate—or provides a new one without causing errors is vital. SSL/TLS not only secures your site but also impacts SEO. Any misconfiguration during migration can lead to warnings in browsers, which deter visitors and can temporarily impact rankings.

Post migration, it’s crucial to benchmark server response times not just from one location, but regionally or globally, especially if your audience is international. Sometimes, a new hosting platform might show great performance in one area but lag in other parts of the world. Such discrepancies can affect page load times, influencing bounce rates and search rankings. “

5. Accept Limitations

Ethan Lazuk, SEO Strategist & Consultant, Ethan Lazuk Consulting, LLC, (LinkedIn, Twitter) offers an interesting perspective on site migrations on the point about anticipating client limitations imposed upon what you are able to do. It can be frustrating when a client pushes back on advice and it’s important to listen to their reasons for doing it.

I have consulted over Zoom with companies whose SEO departments had concerns about what an external SEO wanted to do. Seeking a third party confirmation about a site migration plan is a reasonable thing to do. So if the internal SEO department has concerns about the plan, it’s not a bad idea to have a trustworthy third party take a look at it.

Ethan shared his experience:

“The most memorable and challenging site migrations I’ve been a part of involved business decisions that I had no control over.

As SEOs, we can create a smart migration plan. We can follow pre- and post-launch checklists, but sometimes, there are legal restrictions or other business realities behind the scenes that we have to work around.

Not having access to a DNS, being restricted from using a brand’s name or certain content, having to use an intermediate domain, and having to work days, weeks, or months afterward to resolve any issues once the internal business situations have changed are just a few of the tricky migration issues I’ve encountered.

The best way to handle these situations require working around client restrictions is to button up the SEO tasks you can control, set honest expectations for how the business issues could impact performance after the migration, and stay vigilant with monitoring post-launch data and using it to advocate for resources you need to finish the job.”

Different Ways To Migrate A Website

Site migrations are a pain and should be approached with caution. I’ve done many different kinds of migrations for myself and have assisted them with clients. I’m currently moving thousands of webpages from a folder to the root and it’s complicated by multiple redirects that have to be reconfigured, not looking forward to it. But migrations are sometimes unavoidable so it’s best to step up to it after careful consideration.

Featured Image by Shutterstock/Krakenimages.com

IndexNow: When To Update Search Engines With Your Content Changes via @sejournal, @facan

Crawlers. In the ever-evolving landscape of SEO, they’re a necessary evil.

A critical component in ensuring that your content is discovered, indexed, and ranked by search engines.

However, the traditional approach to SEO often involves a passive stance – waiting for search engines like Google to crawl your site on their own schedule.

This can lead to delays in your content being found and ranked, affecting your site’s visibility, and ultimately, its success.

IndexNow: The Universal Protocol For Content Updates

One powerful tool ecommerce sites, news outlets, weather services, blogs and other digital entities are using to communicate their content changes to search engines is IndexNow.

This free, open-source protocol helps maintain your relevancy and position in search engines by allowing you to proactively notify them of the new, updated, or removed content on your website.

However, the effectiveness of IndexNow relies on the ability to identify what qualifies as a significant update to your content. It’s crucial to understand that not every change on your website is important enough to necessitate a notification to search engines.

Instead, focus on substantial content changes that genuinely enhance your website’s value as these updates won’t improve search engines’ ability to index your pages or the ranking of your content.

According to Fabrice Canel, Principal Product Manager for Microsoft, Bing, “To reduce server load and conserve resources, IndexNow should only be updated for meaningful changes.”

For example, a minor tweak in a blog’s footer or a slight adjustment in a stock price might not necessitate an IndexNow notification.

However, substantial updates like new product pages, updated pricing, a breaking news story, or a product becoming out of stock are prime candidates for IndexNow notifications.

Some examples of meaningful changes for several different industries would include:

1. Digital Retail

In a domain where timing can make or break a sale, IndexNow is a valuable tool to help ensure customers always have access to your most current and accurate product information.

  • Product Availability: Immediate notification of stock status changes helps avoid customer disappointment and bolster reliability and consumer confidence. For instance, if a hot-selling item runs out of stock, notifying IndexNow ensures that this information is swiftly reflected in search results, preventing customer frustration over unavailable items.
  • New Arrivals: Launching a new product? With IndexNow, the moment a new item hits your website, it can be indexed, helping capture the initial surge of interest and convert it into sales.
  • Dynamic Pricing: In a fast-paced online retail environment, prices fluctuate. Whether it’s a flash sale or a regular price update, IndexNow ensures that the latest pricing is immediately available to consumers, maintaining transparency and trust.
  • Reviews: While reviews lend great credibility to your products and customer service, it’s not necessary to notify IndexNow each time you receive one unless you have just listed a particular product or just started taking reviews. Consider reporting reviews incrementally from 1 to 10, then every two reviews from 11 to 20, and continue exponentially after that. This approach provides meaningful information without overwhelming IndexNow with excessive notifications.

Note: To avoid overloading servers with unnecessary updates, do not update constantly fluctuating inventory levels. A good rule of thumb is to monitor when inventory levels are low and promptly submit a deletion to IndexNow of the product once levels have diminished.

2. The Speed Of News

In the fast-paced world of news, where every second counts, IndexNow empowers news platforms to disseminate breaking stories with remarkable speed.

  • Stories and content updates: Whether breaking news, follow-up stories, or investigative reports – IndexNow should be notified of all of your new and updated news and article content on your website.
  • Corrections and Clarifications: If initial reports contain inaccuracies or require clarification, it’s vital to update search engines immediately. IndexNow’s quick indexing ensures audiences are informed with the most current information.
  • Outdated information, errors, and clutter: It’s important to remove content from indexing that is inaccurate or negatively affects your website’s SEO. This could include duplicate content, low-quality or thin content, or articles with outdated information.

3. Dynamic Websites

For sites with moderate to extreme fluctuations, it can be especially difficult to know when to notify IndexNow to strategically ensure content remains current in search engine results. While each site is different, here are some tips on when to consider updating IndexNow:

  • Financial Market Websites: Update at critical intervals, (such as the end of trading hours), the release of significant financial news, stock updates, or market analysis.
  • Sports Scores and Statistics: Update scores and significant event information based on the importance and action of the game, especially during and immediately after games. However, leave out time left and other momentarily important information.
  • Auction Trading Sites: Notify whenever new items are listed, sold, or when auction statuses change, or any information that ensures users have access to the most current information.
  • Travel Sites: For sites with price fluctuations per day of the year, notify IndexNow if the default price change when customers visit your site from search engines.
A graphic with three types of website content updatesImage from author, April 2024

Best Practices For When Not To Notify

  • It’s crucial not to flood IndexNow with notifications for the same URL in a short timeframe. Even if a piece of content becomes exceptionally popular and garners numerous views quickly, avoid notifying it too frequently. This can cause search engines to mistrust your content, resulting in lower rankings.
  • Timing is crucial when notifying IndexNow. However, some CMS platforms may have a lag between the time you make your changes, and when they are reflected on the web server. If you are experiencing this issue, it is best to notify IndexNow only after your content is live to avoid search engines from indexing dead links or outdated content prematurely.
  • It’s equally crucial to notify IndexNow when content is updated or removed. Neglecting to notify IndexNow when you add, update, or remove content can result in search engines serving outdated information to users, leading to poor user experiences, and potentially negatively impacting your site’s ranking.
  • If your CMS has seamless integration with IndexNow, you’re in good hands. However, if you’re coding and handling APIs yourself, follow these best practices to make the most of this powerful tool.

Note: Keep in mind that not all websites are created equal, and the way you interact with IndexNow can vary depending on your Content Management System (CMS) or coding approach. Some CMSes like Wix or Duda have direct integration with IndexNow, while others like WordPress have a free Open Source IndexNow plugin that handles IndexNow notifications for you. If your CMS has seamless integration with IndexNow, you’re in good hands, as we work with them to ensure the highest quality and accuracy of submitted URLs.

Changing Content Intelligently

Having better online visibility isn’t just about having a website.

It’s about your latest content being found. With these guidelines, you’ll ensure that your content is not just changing but changing intelligently for better search engine visibility.

Visit IndexNow/bing to learn more.

Co-authored by: Valerie Wells, Product Marketing Manager, IndexNow

More resources:


Featured Image: BestForBest/Shutterstock

Big Update To Google’s Ranking Drop Documentation via @sejournal, @martinibuster

Google updated their guidance with five changes on how to debug ranking drops. The new version contains over 400 more words that address small and large ranking drops. There’s room to quibble about some of the changes but overall the revised version is a step up from what it replaced.

Change# 1: Downplays Fixing Traffic Drops

The opening sentence was changed so that it offers less hope for bouncing back from an algorithmic traffic drop. Google also joined two sentences into one sentence in the revised version of the documentation.

The documentation previously said that most traffic drops can be reversed and that identifying the reasons for a drop aren’t straightforward. The part about most of them can be reversed was completely removed.

Here is the original two sentences:

“A drop in organic Search traffic can happen for several reasons, and most of them can be reversed. It may not be straightforward to understand what exactly happened to your site”

Now there’s no hope offered for “most of them can be reversed” and more emphasis on understanding what happened is not straightforward.

This is the new guidance

“A drop in organic Search traffic can happen for several reasons, and it may not be straightforward to understand what exactly happened to your site.”

Change #2 Security Or Spam Issues

Google updated the traffic graph illustrations so that they precisely align with the causes for each kind of traffic decline.

The previous version of the graph was labeled:

“Site-level technical issue (Manual Action, strong algorithmic changes)”

The problem with the previous label is that manual actions and strong algorithmic changes are not technical issues and the new version fixes that issue.

The updated version now reads:

“Large drop from an algorithmic update, site-wide security or spam issue”

A line graph labeled

Change #3 Technical Issues

There’s one more change to a graph label, also to make it more accurate.

This is how the previous graph was labeled:

“Page-level technical issue (algorithmic changes, market disruption)”

The updated graph is now labeled:

“Technical issue across your site, changing interests”

Now the graph and label are more specific as a sitewide change and “changing interests” is more general and covers a wider range of changes than market disruption. Changing interests includes market disruption (where a new product makes a previous one obsolete or less desirable) but it also includes products that go out of style or loses their trendiness.

Graph titled

Change #4 Google Adds New Guidance For Algorithmic Changes

The biggest change by far is their brand new section for algorithmic changes which replaces two smaller sections, one about policy violations and manual actions and a second one about algorithm changes.

The old version of this one section had 108 words. The updated version contains 443 words.

A section that’s particularly helpful is where the guidance splits algorithmic update damage into two categories.

Two New Categories:

  • Small drop in position? For example, dropping from position 2 to 4.
  • Large drop in position? For example, dropping from position 4 to 29.

The two new categories are perfect and align with what I’ve seen in the search results for sites that have lost rankings. The reasons for dropping up and down within the top ten are different from the reasons why a site drops completely out of the top ten.

I don’t agree with the guidance for large drops. They recommend reviewing your site for large drops, which is good advice for some sites that have lost rankings. But in other cases there’s nothing wrong with the site and this is where less experienced SEOs tend to be unable to fix the problems because there’s nothing wrong with the site. Recommendations for improving EEAT, adding author bios or filing link disavows do not solve what’s going on because there’s nothing wrong with the site. The problem is something else in some of the cases.

Here is the new guidance for debugging search position drops:

Algorithmic update
Google is always improving how it assesses content and updating its search ranking and serving algorithms accordingly; core updates and other smaller updates may change how some pages perform in Google Search results. We post about notable improvements to our systems on our list of ranking updates page; check it to see if there’s anything that’s applicable to your site.

If you suspect a drop in traffic is due to an algorithmic update, it’s important to understand that there might not be anything fundamentally wrong with your content. To determine whether you need to make a change, review your top pages in Search Console and assess how they were ranking:

Small drop in position? For example, dropping from position 2 to 4.
Large drop in position? For example, dropping from position 4 to 29.

Keep in mind that positions aren’t static or fixed in place. Google’s search results are dynamic in nature because the open web itself is constantly changing with new and updated content. This constant change can cause both gains and drops in organic Search traffic.

Small drop in position
A small drop in position is when there’s a small shift in position in the top results (for example, dropping from position 2 to 4 for a search query). In Search Console, you might see a noticeable drop in traffic without a big change in impressions.

Small fluctuations in position can happen at any time (including moving back up in position, without you needing to do anything). In fact, we recommend avoiding making radical changes if your page is already performing well.

Large drop in position
A large drop in position is when you see a notable drop out of the top results for a wide range of terms (for example, dropping from the top 10 results to position 29).

In cases like this, self-assess your whole website overall (not just individual pages) to make sure it’s helpful, reliable and people-first. If you’ve made changes to your site, it may take time to see an effect: some changes can take effect in a few days, while others could take several months. For example, it may take months before our systems determine that a site is now producing helpful content in the long term. In general, you’ll likely want to wait a few weeks to analyze your site in Search Console again to see if your efforts had a beneficial effect on ranking position.

Keep in mind that there’s no guarantee that changes you make to your website will result in noticeable impact in search results. If there’s more deserving content, it will continue to rank well with our systems.”

Change #5 Trivial Changes

The rest of the changes are relatively trivial but nonetheless makes the documentation more precise.

For example, one of the headings was changed from this:

You recently moved your site

To this new heading:

Site moves and migrations

Google’s Updated Ranking Drops Documentation

Google’s updated documentation is a well thought out but I think that the recommendations for large algorithmic drops are helpful for some cases and not helpful for other cases. I have 25 years of SEO experience and have experienced every single Google algorithm update. There are certain updates where the problem is not solved by trying to fix things and Google’s guidance used to be that sometimes there’s nothing to fix. The documentation is better but in my opinion it can be improved even further.

Read the new documentation here:

Debugging drops in Google Search traffic

Review the previous documentation:

Internet Archive Wayback Machine: Debugging drops in Google Search traffic

Featured Image by Shutterstock/Tomacco

Google March 2024 Core Update Officially Completed A Week Ago via @sejournal, @MattGSouthern

Google has officially completed its March 2024 Core Update, ending over a month of ranking volatility across the web.

However, Google didn’t confirm the rollout’s conclusion on its data anomaly page until April 26—a whole week after the update was completed on April 19.

Many in the SEO community had been speculating for days about whether the turbulent update had wrapped up.

The delayed transparency exemplifies Google’s communication issues with publishers and the need for clarity during core updates

Google March 2024 Core Update Timeline & Status

First announced on March 5, the core algorithm update is complete as of April 19. It took 45 days to complete.

Unlike more routine core refreshes, Google warned this one was more complex.

Google’s documentation reads:

“As this is a complex update, the rollout may take up to a month. It’s likely there will be more fluctuations in rankings than with a regular core update, as different systems get fully updated and reinforce each other.”

The aftershocks were tangible, with some websites reporting losses of over 60% of their organic search traffic, according to data from industry observers.

The ripple effects also led to the deindexing of hundreds of sites that were allegedly violating Google’s guidelines.

Addressing Manipulation Attempts

In its official guidance, Google highlighted the criteria it looks for when targeting link spam and manipulation attempts:

  • Creating “low-value content” purely to garner manipulative links and inflate rankings.
  • Links intended to boost sites’ rankings artificially, including manipulative outgoing links.
  • The “repurposing” of expired domains with radically different content to game search visibility.

The updated guidelines warn:

“Any links that are intended to manipulate rankings in Google Search results may be considered link spam. This includes any behavior that manipulates links to your site or outgoing links from your site.”

John Mueller, a Search Advocate at Google, responded to the turbulence by advising publishers not to make rash changes while the core update was ongoing.

However, he suggested sites could proactively fix issues like unnatural paid links.

Mueller stated on Reddit:

“If you have noticed things that are worth improving on your site, I’d go ahead and get things done. The idea is not to make changes just for search engines, right? Your users will be happy if you can make things better even if search engines haven’t updated their view of your site yet.”

Emphasizing Quality Over Links

The core update made notable changes to how Google ranks websites.

Most significantly, Google reduced the importance of links in determining a website’s ranking.

In contrast to the description of links as “an important factor in determining relevancy,” Google’s updated spam policies stripped away the “important” designation, simply calling links “a factor.”

This change aligns with Google’s Gary Illyes’ statements that links aren’t among the top three most influential ranking signals.

Instead, Google is giving more weight to quality, credibility, and substantive content.

Consequently, long-running campaigns favoring low-quality link acquisition and keyword optimizations have been demoted.

With the update complete, SEOs and publishers are left to audit their strategies and websites to ensure alignment with Google’s new perspective on ranking.


Featured Image: Rohit-Tripathi/Shutterstock

FAQ

After the update, what steps should websites take to align with Google’s new ranking criteria?

After Google’s March 2024 Core Update, websites should:

  • Improve the quality, trustworthiness, and depth of their website content.
  • Stop heavily focusing on getting as many links as possible and prioritize relevant, high-quality links instead.
  • Fix any shady or spam-like SEO tactics on their sites.
  • Carefully review their SEO strategies to ensure they follow Google’s new guidelines.

What Is Personal Branding? Here’s Why It’s So Important via @sejournal, @AdamHeitzman

Personal branding lets you take charge of your digital footprint, ensuring that what people find when they search for you online is accurate, positive, and aligned with your professional goals.

Examples Of Personal Branding That Work

Now that you understand the advantages of developing a personal brand, let’s look at a couple of real-life examples of professionals who have nailed their branding and reaped the rewards from it.

David Perell

Known as “The Writing Guy,” David Perell has built a strong personal brand around his expertise in online writing.

He has harnessed the power of the internet to inspire and coach thousands of people to improve their writing, build an online audience, and leverage that audience to propel their careers.

Thanks to his popular course “Write of Passage,” his prolific social media output, and his frequent podcast appearances, David has successfully positioned himself as one of the world’s leading proponents of the power of online writing.

Example 2 of personal brandingImage from perell.com, April 2024

Marie Forleo

Marie Forleo is an entrepreneur, author, and the creator of MarieTV, an award-winning web show that helps viewers realize their potential in business and in their personal lives.

Her personal brand revolves around the philosophy that anyone can lead a dream life if they’re willing to put in the effort. The title of her book, “Everything Is Figureoutable,” has become a mantra for personal growth and resilience, emphasizing that all problems can be solved with enough determination.

Marie has successfully used her platform to inspire millions with her practical advice, engaging personality, and unwavering belief in the potential of her viewers.

Example 3 of personal brandingImage from YouTube, April 2024

6 Steps To Build Your Own Personal Brand

So, what should you do to develop a personal brand?

Here are the six key steps to successful personal branding.

1. Define Your Brand Identity

The first step is all about self-reflection and clarity.

Your goal here is to figure out what you stand for and how you want to be perceived.

Identify what makes you unique – this could be a combination of your distinctive talents, perspectives, values, and passions. Consider your career achievements, distinguishing personality traits, and any notable challenges you’ve overcome that shape who you are today.

Remember to stay true to your authentic self, not just what you think others want to see. Being genuine will help you connect more deeply with your audience, shaping a brand identity that is both relatable and trustworthy.

Plus, being yourself is much less work than pretending to be someone else!

2. Determine Your Target Audience

Next, you need to clarify who your personal brand is speaking to.

Your target audience could be potential employers, clients in a specific industry, a professional community, or peers who share similar interests to you.

You should understand what they care about and their challenges so you can tailor your content and messaging to align with their specific needs.

3. Develop A Personal Brand Statement

A personal brand statement is a succinct description of who you are, what you do, who you serve, and why it matters.

Think of it as your professional tagline.

It should be compelling and memorable, encapsulating your unique value proposition.

For example, if you’re a software developer with a focus on educational technology, your personal brand statement might be something like: “Designing edtech to empower learners everywhere.”

A solid brand statement not only helps focus your communication across different platforms but is also a powerful tool that can differentiate you from your peers and competitors.

4. Optimize Your Online Presence

Once you’ve laid the groundwork for your personal brand, it’s time to update your digital footprint accordingly.

Make sure your social media profiles on platforms like LinkedIn and your personal website are polished, professional, and aligned with your brand identity. Consider removing any old posts or content pieces that don’t reflect the image you want to project.

It’s also worth investing in new professional headshots, a logo for your brand, and a consistent color scheme and design elements across your platforms. Visual consistency helps reinforce your brand identity and makes you easily recognizable to your audience.

5. Create And Share Valuable Content

Posting high-quality content is essential for establishing your authority and amplifying your message.

You can bolster your reputation and expand your reach by creating and sharing insightful blog posts, social media content, and videos, as well as appearing on other creators’ podcasts and YouTube channels.

Your content should not only reflect your professional insights but also your unique personality and perspectives.

Also, to build your email list, it’s a good idea to offer audience members a free, valuable resource on your website (like an ebook, webinar, or online course) in exchange for their email address.

6. Network And Engage With Your Community

Finally, building and nurturing a professional network is critical.

In addition to connecting with people online, you should actively engage with their content, contribute to relevant industry conversations, and participate in both virtual and in-person events related to your field.

Offering your expertise by answering questions, sharing insights, and providing valuable feedback solidifies your reputation as an approachable and knowledgeable thought leader.

By investing time in building relationships and promoting the work and efforts of your peers, you’ll foster more goodwill around your brand, which could open up new doors for you down the line.

Personal Branding Should Be Important For Everyone

Google Declares It The “Gemini Era” As Revenue Grows 15% via @sejournal, @MattGSouthern

Alphabet Inc., Google’s parent company, announced its first quarter 2024 financial results today.

While Google reported double-digit growth in key revenue areas, the focus was on its AI developments, dubbed the “Gemini era” by CEO Sundar Pichai.

The Numbers: 15% Revenue Growth, Operating Margins Expand

Alphabet reported Q1 revenues of $80.5 billion, a 15% increase year-over-year, exceeding Wall Street’s projections.

Net income was $23.7 billion, with diluted earnings per share of $1.89. Operating margins expanded to 32%, up from 25% in the prior year.

Ruth Porat, Alphabet’s President and CFO, stated:

“Our strong financial results reflect revenue strength across the company and ongoing efforts to durably reengineer our cost base.”

Google’s core advertising units, such as Search and YouTube, drove growth. Google advertising revenues hit $61.7 billion for the quarter.

The Cloud division also maintained momentum, with revenues of $9.6 billion, up 28% year-over-year.

Pichai highlighted that YouTube and Cloud are expected to exit 2024 at a combined $100 billion annual revenue run rate.

Generative AI Integration in Search

Google experimented with AI-powered features in Search Labs before recently introducing AI overviews into the main search results page.

Regarding the gradual rollout, Pichai states:

“We are being measured in how we do this, focusing on areas where gen AI can improve the Search experience, while also prioritizing traffic to websites and merchants.”

Pichai reports that Google’s generative AI features have answered over a billion queries already:

“We’ve already served billions of queries with our generative AI features. It’s enabling people to access new information, to ask questions in new ways, and to ask more complex questions.”

Google reports increased Search usage and user satisfaction among those interacting with the new AI overview results.

The company also highlighted its “Circle to Search” feature on Android, which allows users to circle objects on their screen or in videos to get instant AI-powered answers via Google Lens.

Reorganizing For The “Gemini Era”

As part of the AI roadmap, Alphabet is consolidating all teams building AI models under the Google DeepMind umbrella.

Pichai revealed that, through hardware and software improvements, the company has reduced machine costs associated with its generative AI search results by 80% over the past year.

He states:

“Our data centers are some of the most high-performing, secure, reliable and efficient in the world. We’ve developed new AI models and algorithms that are more than one hundred times more efficient than they were 18 months ago.

How Will Google Make Money With AI?

Alphabet sees opportunities to monetize AI through its advertising products, Cloud offerings, and subscription services.

Google is integrating Gemini into ad products like Performance Max. The company’s Cloud division is bringing “the best of Google AI” to enterprise customers worldwide.

Google One, the company’s subscription service, surpassed 100 million paid subscribers in Q1 and introduced a new premium plan featuring advanced generative AI capabilities powered by Gemini models.

Future Outlook

Pichai outlined six key advantages positioning Alphabet to lead the “next wave of AI innovation”:

  1. Research leadership in AI breakthroughs like the multimodal Gemini model
  2. Robust AI infrastructure and custom TPU chips
  3. Integrating generative AI into Search to enhance the user experience
  4. A global product footprint reaching billions
  5. Streamlined teams and improved execution velocity
  6. Multiple revenue streams to monetize AI through advertising and cloud

With upcoming events like Google I/O and Google Marketing Live, the company is expected to share further updates on its AI initiatives and product roadmap.


Featured Image: Sergei Elagin/Shutterstock

Google Stresses The Need To Fact Check AI-Generated Content via @sejournal, @MattGSouthern

In a recent episode of Google’s Search Off The Record podcast, team members got hands-on with Gemini to explore creating SEO-related content.

However, their experiment raised concerns over factual inaccuracies when relying on AI tools without proper vetting.

The discussion involved Lizzi Harvey, Gary Illyes, and John Mueller taking turns utilizing Gemini to write sample social media posts on technical SEO concepts.

As they analyzed Gemini’s output, Illyes highlighted a limitation shared by all AI tools:

“My bigger problem with pretty much all generative AI is the factuality – you always have to fact check whatever they are spitting out. That kind of scares me that now we are just going to read it live, and maybe we are going to say stuff that is not even true.”

Outdated SEO Advice Exposed

The concerns stemmed from an AI-generated tweet suggesting using rel=”prev/next” for pagination – a technique that Google has deprecated.

Gemini suggested publishing the following tweet:

“Pagination causing duplicate content headaches? Use rel=prev, rel=next to guide Google through your content sequences. #technicalSEO, #GoogleSearch.”

Harvey immediately identified the advice as outdated. Mueller confirms rel=prev and rel=next is still unsupported:

“It’s gone. It’s gone. Well, I mean, you can still use it. You don’t have to make it gone. It’s just ignored.”

Earlier in the podcast, Harvey warned inaccuracies could result from outdated training data information.

Harvey stated:

“If there’s enough myth circulating or a certain thought about something or even outdated information
that has been blogged about a lot, it might come up in our exercise today, potentially.”

Sure enough, it took only a short time for outdated information to come up.

Human Oversight Still Critical

While the Google Search Relations team saw the potential for AI-generated content, their discussion stressed the need for human fact-checking.

Illyes’ concerns reflect the broader discourse around responsible AI adoption. Human oversight is necessary to prevent the spread of misinformation.

As generative AI use increases, remember that its output can’t be blindly trusted without verification from subject matter experts.

Why SEJ Cares

While AI-powered tools can potentially aid in content creation and analysis, as Google’s own team illustrated, a healthy degree of skepticism is warranted.

Blindly deploying generative AI to create content can result in publishing outdated or harmful information that could negatively impact your SEO and reputation.

Hear the full podcast episode below:


FAQ

How can inaccurate AI-generated content affect my SEO efforts?

Using AI-generated content for your website can be risky for SEO because the AI might include outdated or incorrect information.

Search engines like Google favor high-quality, accurate content, so publishing unverified AI-produced material can hurt your website’s search rankings. For example, if the AI promotes outdated practices like using the rel=”prev/next” tag for pagination, it can mislead your audience and search engines, damaging your site’s credibility and authority.

It’s essential to carefully fact-check and validate AI-generated content with experts to ensure it follows current best practices.

How can SEO and content marketers ensure the accuracy of AI-generated output?

To ensure the accuracy of AI-generated content, companies should:

  • Have a thorough review process involving subject matter experts
  • Have specialists check that the content follows current guidelines and industry best practices
  • Fact-check any data or recommendations from the AI against reliable sources
  • Stay updated on the latest developments to identify outdated information produced by AI


Featured Image: Screenshot from YouTube.com/GoogleSearchCentral, April 2024. 

Google’s New Infini-Attention And SEO via @sejournal, @martinibuster

Google has published a research paper on a new technology called Infini-attention that allows it to process massively large amounts of data with “infinitely long contexts” while also being capable of being easily inserted into other models to vastly improve their capabilities

That last part should be of interest to those who are interested in Google’s algorithm. Infini-Attention is plug-and-play, which means it’s relatively easy to insert into other models, including those in use b Google’s core algorithm. The part about “infinitely long contexts” may have implications for how some of Google’s search systems may work.

The name of the research paper is: Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Memory Is Computationally Expensive For LLMs

Large Language Models (LLM) have limitations on how much data they can process at one time because the computational complexity and memory usage can spiral upward significantly. Infini-Attention gives the LLM the ability to handle longer contexts while keeping the down memory and processing power needed.

The research paper explains:

“Memory serves as a cornerstone of intelligence, as it enables efficient computations tailored to specific contexts. However, Transformers …and Transformer-based LLMs …have a constrained context-dependent memory, due to the nature of the attention mechanism.

Indeed, scaling LLMs to longer sequences (i.e. 1M tokens) is challenging with the standard Transformer architectures and serving longer and longer context models becomes costly financially.”

And elsewhere the research paper explains:

“Current transformer models are limited in their ability to process long sequences due to quadratic increases in computational and memory costs. Infini-attention aims to address this scalability issue.”

The researchers hypothesized that Infini-attention can scale to handle extremely long sequences with Transformers without the usual increases in computational and memory resources.

Three Important Features

Google’s Infini-Attention solves the shortcomings of transformer models by incorporating three features that enable transformer-based LLMs to handle longer sequences without memory issues and use context from earlier data in the sequence, not just data near the current point being processed.

The features of Infini-Attention

  • Compressive Memory System
  • Long-term Linear Attention
  • Local Masked Attention

Compressive Memory System

Infini-Attention uses what’s called a compressive memory system. As more data is input (as part of a long sequence of data), the compressive memory system compresses some of the older information in order to reduce the amount of space needed to store the data.

Long-term Linear Attention

Infini-attention also uses what’s called, “long-term linear attention mechanisms” which enable the LLM to process data that exists earlier in the sequence of data that’s being processed which enables to retain the context. That’s a departure from standard transformer-based LLMs.

This is important for tasks where the context exists on a larger plane of data. It’s like being able to discuss and entire book and all of the chapters and explain how the first chapter relates to another chapter closer to the end of the book.

Local Masked Attention

In addition to the long-term attention, Infini-attention also uses what’s called local masked attention. This kind of attention processes nearby (localized) parts of the input data, which is useful for responses that depend on the closer parts of the data.

Combining the long-term and local attention together helps solve the problem of transformers being limited to how much input data it can remember and use for context.

The researchers explain:

“The Infini-attention incorporates a compressive memory into the vanilla attention mechanism and builds in both masked local attention and long-term linear attention mechanisms in a single Transformer block.”

Results Of Experiments And Testing

Infini-attention was tested with other models for comparison across multiple benchmarks involving long input sequences, such as long-context language modeling, passkey retrieval, and book summarization tasks. Passkey retrieval is a test where the language model has to retrieve specific data from within a extremely long text sequence.

List of the three tests:

  1. Long-context Language Modeling
  2. Passkey Test
  3. Book Summary

Long-Context Language Modeling And The Perplexity Score

The researchers write that the Infini-attention outperformed the baseline models and that increasing the training sequence length brought even further improvements in the Perplexity score. The Perplexity score is a metric that measures language model performance with lower scores indicating better performance.

The researchers shared their findings:

“Infini-Transformer outperforms both Transformer-XL …and Memorizing Transformers baselines while maintaining 114x less memory parameters than the Memorizing Transformer model with a vector retrieval-based KV memory with length of 65K at its 9th layer. Infini-Transformer outperforms memorizing transformers with memory length of 65K and achieves 114x compression ratio.

We further increased the training sequence length to 100K from 32K and trained the models on Arxiv-math dataset. 100K training further decreased the perplexity score to 2.21 and 2.20 for Linear and Linear + Delta models.”

Passkey Test

The passkey test is wherea random number is hidden within a long text sequence with the task being that the model must fetch the hidden text. The passkey is hidden either near the beginning, middle or the end of the long text. The model was able to solve the passkey test up to a length of 1 million.

“A 1B LLM naturally scales to 1M sequence length and solves the passkey retrieval task when injected with Infini-attention. Infini-Transformers solved the passkey task with up to 1M context length when fine-tuned on 5K length inputs. We report token-level retrieval accuracy for passkeys hidden in a different part (start/middle/end) of long inputs with lengths 32K to 1M.”

Book Summary Test

Infini-attention also excelled at the book summary test by outperforming top benchmarks achieving new state of the art (SOTA) performance levels.

The results are described:

“Finally, we show that a 8B model with Infini-attention reaches a new SOTA result on a 500K length book summarization task after continual pre-training and task fine-tuning.

…We further scaled our approach by continuously pre-training a 8B LLM model with 8K input length for 30K steps. We then fine-tuned on a book summarization task, BookSum (Kry´sci´nski et al., 2021) where the goal is to generate a summary of an entire book text.

Our model outperforms the previous best results and achieves a new SOTA on BookSum by processing the entire text from book. …There is a clear trend showing that with more text provided as input from books, our Infini-Transformers improves its summarization performance metric.”

Implications Of Infini-Attention For SEO

Infini-attention is a breakthrough in modeling long and short range attention with greater efficiency than previous models without Infini-attention. It also supports “plug-and-play continual pre-training and long-context adaptation
by design” which means that it can easily be integrated into existing models.

Lastly, the “continual pre-training and long-context adaptation” makes it exceptionally useful for scenarios where it’s necessary to constantly train the model on new data. This last part is super interesting because it may make it useful for applications on the back end of Google’s search systems, particularly where it is necessary to be able to analyze long sequences of information and understand the relevance from one part near the beginning of the sequence and another part that’s closer to the end.

Other articles focused on the “infinitely long inputs” that this model is capable of but where it’s relevant to SEO is how that ability to handle huge input and “Leave No Context Behind” is what’s relevant to search marketing and how some of Google’s systems might work if Google adapted Infini-attention to their core algorithm.

Read the research paper:

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Featured Image by Shutterstock/JHVEPhoto