TrawlerFetchReplyDataPartialResponse

TrawlerCrawling

GoogleApi.ContentWarehouse.V1.Model.TrawlerFetchReplyDataPartialResponse

6
out of 10
Medium
SEO Impact
---------------------------------------------------------------------- PartialResponse is used with streaming responses in LargeFileFetchAdapter. Rather than fitting entirely in a single FetchReply, there is a series of FetchReplies until IsFinalResponse. Each group of responses will have a unique FetchID to link them.

SEO Analysis

AI Generated

Part of Google's web crawling infrastructure (Trawler is Google's internal name for their web crawler). This model governs how Googlebot fetches and processes web pages, affecting crawl efficiency and frequency. Crawl management directly impacts how quickly new content is discovered and how often existing content is refreshed in the index.

Actionable Insights for SEOs

  • Optimize crawl budget by fixing broken links and reducing redirect chains
  • Use robots.txt and sitemap.xml effectively to guide crawling
  • Monitor Google Search Console for crawl errors and indexing issues

Attributes

6
Sort:|Filter:
BodyLocationstring
Default: nilFull type: String.t

If set, indicates where the fetched body is, e.g. a CNS file path. FetchReply.Body should be empty in this case. In the case where client does not support streaming but the content is too large to be accumulated in memory, we keep writing the streaming chunks to some storage unit and notify client when it is done.

ChunkNumberinteger(
Default: nil

Fetch number in this series of fetches

ContentRangeTrawlerContentRangeInfo →
Default: nilFull type: GoogleApi.ContentWarehouse.V1.Model.TrawlerContentRangeInfo.t

If there is a Content-Range header, the ranges in it

ETagstring
Default: nilFull type: String.t

Any ETag seen in the headers

FetchIDstring
Default: nilFull type: String.t

ID which links all partial fetches for this url

IsFinalResponseboolean(
Default: nil

Is this the final response for this fetch?