TrawlerFetchStatus

TrawlerCrawling

GoogleApi.ContentWarehouse.V1.Model.TrawlerFetchStatus

out of 10

High

SEO Impact

Unwrap a decoded JSON object into its complex fields.

SEO Analysis

AI Generated

Part of Google's web crawling infrastructure (Trawler is Google's internal name for their web crawler). This model governs how Googlebot fetches and processes web pages, affecting crawl efficiency and frequency. Crawl management directly impacts how quickly new content is discovered and how often existing content is refreshed in the index.

Actionable Insights for SEOs

Monitor for changes in rankings that may correlate with updates to this system
Consider how your content strategy aligns with what this signal evaluates
Optimize crawl budget by fixing broken links and reducing redirect chains
Use robots.txt and sitemap.xml effectively to guide crawling
Monitor Google Search Console for crawl errors and indexing issues

Attributes

Sort:|Filter:

Reasoninteger(

Default: nil

The Reason field gives further clarifying details about why or how the fetch had the given outcome. For instance, if State is URL_ERROR - was it a 404/NotFound or a DNS error? The Reason field is present iff State != URL_CRAWLED. For a given crawl status of URL_FOO, the Reason value will be one of the various FetchFooReason enum values from crawler/trawler/trawler_enums.proto

Statestring

Default: nilFull type: String.t

The State field describes the basic outcome of a fetch (URL_CRAWLED, URL_ROBOTED, URL_ERROR, etc). The value is one of the UrlStatusType enum values from crawler/trawler/trawler_enums.proto Note, there are several combinations of this Status/Reason tuple that could mean that your content is crawled or can be bucketed in a particular type of error. So instead of comparing the enumeration values manually, we suggest to use the predicate functions such as IsContentCrawled() provided in crawler/trawler/public/basictypes.h (see details there).