TrawlerEvent

TrawlerCrawling

GoogleApi.ContentWarehouse.V1.Model.TrawlerEvent

5
out of 10
Medium
SEO Impact
Event is for logging interesting events that happen during a url fetch. Interesting events include "fetch start", "url rejected", etc. The events are written to binary logs together with the request and reply messages. If the same event occurs multiple times consecutively, We record the time of the first three instances in EarliestTimeStamp but omit the rest. We keep track the total number of occurrences in NumOccurrences and the timestamp of the last occurrence is kept in TimeStamp field.

SEO Analysis

AI Generated

Part of Google's web crawling infrastructure (Trawler is Google's internal name for their web crawler). This model governs how Googlebot fetches and processes web pages, affecting crawl efficiency and frequency. Crawl management directly impacts how quickly new content is discovered and how often existing content is refreshed in the index.

Actionable Insights for SEOs

  • Optimize crawl budget by fixing broken links and reducing redirect chains
  • Use robots.txt and sitemap.xml effectively to guide crawling
  • Monitor Google Search Console for crawl errors and indexing issues

Attributes

5
Sort:|Filter:
IDstring
Default: nilFull type: String.t
Msgstring
Default: nilFull type: String.t
NumOccurrencesinteger(
Default: nil
OldestTimeStampInUSstring
Default: nilFull type: list(String.t

Limited to 3.

TimeStampInUSstring
Default: nilFull type: String.t