GoogleOther-Google's New Crawler: What Site Owners & SEOs Need to Know

What is GoogleOther?

[{"selector":"#anim-eec35307-2d7e-4918-ab37-92c90310c6ea","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":1450,"easing":"ease-in-out","fill":"both","iterations":1}] [{"selector":"#anim-7134b773-9be9-4b32-89f7-24a91466ff1f","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-37d742bb-29c2-45ca-8eb9-5c4eb60362eb","keyframes":{"transform":["translate3d(-121.63121%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Arrow

[{"selector":"#anim-cdd86a78-6d13-473e-8942-8d57760d57b0","keyframes":{"transform":["translate3d(-125.45454%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ef1fb195-fa78-4088-add5-bd6f1fec3f34","keyframes":{"opacity":[0,1]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7f7c80d7-6d93-4bc9-afe5-af012a018900","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] Google just announced "GoogleOther," a new web crawler intended to relieve Googlebot, the company's primary search index crawler, of some of the load.

[{"selector":"#anim-d681ffb0-05e8-4aa7-989b-df7be0b57872","keyframes":{"transform":["translate3d(-125.45454%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7a09f5ff-1645-40fb-ae35-c21eedee8728","keyframes":{"opacity":[0,1]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-940dc230-0189-41f6-960f-672f539908f3","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] Several Google product teams will utilize a general web crawler called GoogleOther to collect publicly accessible content from websites.

Tasks of GoogleOther

[{"selector":"#anim-22f066c8-c62a-49c1-82fb-3646d2cbbbe0","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":1450,"easing":"ease-in-out","fill":"both","iterations":1}] [{"selector":"#anim-0627d71c-9931-42d7-ab31-f8b0ac86d258","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-29926d67-7079-4591-acf6-e2929226ed44","keyframes":{"transform":["translate3d(-121.63121%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Arrow

Want to Discuss your SEO Strategies for Your Business? Talk to Our Uvisible Experts NOW! Click here!

[{"selector":"#anim-3d347ac7-a1e6-4450-b4b0-a7a40ddc063c","keyframes":{"transform":["translate3d(-129.72973%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-59775e7f-64ad-4f60-a35c-e51d4aa97210","keyframes":{"opacity":[0,1]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-04126af4-24ea-405c-83ce-17954037f7c5","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] The new GoogleOther crawler's main goal is to replace Googlebot's present non-essential functions.

[{"selector":"#anim-09e945e5-2c09-4719-b5f9-5f799682533a","keyframes":{"transform":["translate3d(-130.11583%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-eb0dbc5c-9482-4440-8146-52bb65ba5672","keyframes":{"opacity":[0,1]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7af22b57-062d-4939-917e-fa020b1a175d","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1450,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] Research and development (R&D) crawl and other tasks that are not directly linked to search indexing will be handled by GoogleOther in the meantime.

Updates and Implications for Site Owners and SEOs

[{"selector":"#anim-b919b631-a299-4ff5-aeba-b7a4b30721e2","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":1450,"easing":"ease-in-out","fill":"both","iterations":1}] [{"selector":"#anim-93dae77c-96c6-4fb9-986d-0f5452cafffd","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4cabd092-9e8e-44e2-bff6-54010720c287","keyframes":{"transform":["translate3d(-122.69504%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Arrow

Update Robot.txt

[{"selector":"#anim-c9133f8b-ba41-4de2-9ee4-4724e14a5a28","keyframes":{"opacity":[0,1]},"delay":100,"duration":1700,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-de1f065e-d2f6-4d66-97ea-934ead3948a5","keyframes":{"opacity":[0,1]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-1406037f-dd4e-4b43-812b-001e7d834289","keyframes":{"transform":["translate3d(0px, 142.61795%, 0)","translate3d(0px, 0px, 0)"]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] To control GoogleOther's access and crawling behaviour on your website, update your robots.txt file to include specific rules for GoogleOther as needed.

Analyze server logs

[{"selector":"#anim-e6c796d3-a5ae-4084-a613-8d55498a7602","keyframes":{"opacity":[0,1]},"delay":100,"duration":1700,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-11911346-8b2b-4983-bc19-a4d7d750288c","keyframes":{"opacity":[0,1]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7e3cb3d4-8fbb-4087-902a-46d4402b0b0d","keyframes":{"transform":["translate3d(0px, 148.42913%, 0)","translate3d(0px, 0px, 0)"]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] To understand how often GoogleOther crawls your website and which pages it visits, regularly review your server logs and analyze the requests made by GoogleOther.

Keep an eye on Crawlability and Indexing

[{"selector":"#anim-525e7cc2-8205-4dd5-a907-b33b0fa9d46b","keyframes":{"opacity":[0,1]},"delay":100,"duration":1700,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8600b434-4c11-43c2-ae2d-ceffebfeb468","keyframes":{"opacity":[0,1]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4fc3c4ed-c31a-46ef-9d2b-a4f4c8625b04","keyframes":{"transform":["translate3d(0px, 149.80846%, 0)","translate3d(0px, 0px, 0)"]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Observe any changes in crawl frequency, crawl budget, or the number of indexed pages by monitoring crawl stats in Google Search Console since the introduction of GoogleOther.

Monitor your website

[{"selector":"#anim-4d594539-9408-4b6c-86b4-3b7f4b5d6780","keyframes":{"opacity":[0,1]},"delay":100,"duration":1700,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a48a5486-3ded-4fd7-a3b4-6eb2a277d067","keyframes":{"opacity":[0,1]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-fb6f4956-0ad2-44a1-8696-684207971931","keyframes":{"transform":["translate3d(0px, 133.85930%, 0)","translate3d(0px, 0px, 0)"]},"delay":200,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] To identify any potential issues caused by GoogleOther's crawling activities, regularly monitor your website's performance metrics, such as load times, bounce rates, and user engagement, and look for any correlations.