TrawlerFetchReplyDataProtocolResponse

TrawlerCrawling

GoogleApi.ContentWarehouse.V1.Model.TrawlerFetchReplyDataProtocolResponse

6
out of 10
Medium
SEO Impact
Group with protocol specific response (determined by the protocol of the url that generated the content we return).

SEO Analysis

AI Generated

Part of Google's web crawling infrastructure (Trawler is Google's internal name for their web crawler). This model governs how Googlebot fetches and processes web pages, affecting crawl efficiency and frequency. Crawl management directly impacts how quickly new content is discovered and how often existing content is refreshed in the index.

Actionable Insights for SEOs

  • Optimize crawl budget by fixing broken links and reducing redirect chains
  • Use robots.txt and sitemap.xml effectively to guide crawling
  • Monitor Google Search Console for crawl errors and indexing issues

Attributes

6
Sort:|Filter:
Codeinteger(
Default: nil

Response code. We emulate the HTTP response codes for all protocols that we know. -- HTTP: response code for the downloaded page. -- FTP: similar with HTTP: 200 - OK, 40X - errors (not found, etc), 500 - server unavailable

ContentTypestring
Default: nilFull type: String.t

Content type as inferred by the fetcher (webutil/http/content-type.proto)

CutoffSizestring
Default: nilFull type: String.t

Where did we cut off? Includes headers plus truncated but uncompressed content. Present if and only if we truncated the document.

HttpVersionstring
Default: nilFull type: String.t

DEPRECATED, see field 113. Stores the HTTP version we used in the final hop.

ProtocolVersionFallbackboolean(
Default: nil

DEPRECATED, see field 114. Whether we fallback from HTTP/2 to HTTP/1.1 during fetch. The fallback could happen in any hops and there can be at most one fallback because once fallback happens, we will not try HTTP/2 anymore.

UnTruncatedSizestring
Default: nilFull type: String.t

The amount of data we got from the webserver before any truncation, but after undoing any HTTP gzip/deflate encoding. For HTTP, this includes headers and uncompressed content. Content size is excluded if content was not successfully fetched. See description above TotalFetchedSize for comparison.