ImageMoosedogCrawlState

Image MooseCrawling

GoogleApi.ContentWarehouse.V1.Model.ImageMoosedogCrawlState

7
out of 10
High
SEO Impact
Unwrap a decoded JSON object into its complex fields.

SEO Analysis

AI Generated

Part of Google's web crawling infrastructure (Trawler is Google's internal name for their web crawler). This model governs how Googlebot fetches and processes web pages, affecting crawl efficiency and frequency. Crawl management directly impacts how quickly new content is discovered and how often existing content is refreshed in the index.

Actionable Insights for SEOs

  • Monitor for changes in rankings that may correlate with updates to this system
  • Consider how your content strategy aligns with what this signal evaluates
  • Optimize crawl budget by fixing broken links and reducing redirect chains
  • Use robots.txt and sitemap.xml effectively to guide crawling
  • Monitor Google Search Console for crawl errors and indexing issues

Attributes

11
Sort:|Filter:
codestring
Default: nilFull type: String.t
detailedReasoninteger(
Default: nil

Each of the above not_crawled_reason will have a set of detailed reason defined in crawler/trawler/trawler_enums.proto.

internalStatusUtilStatusProto →
Default: nilFull type: GoogleApi.ContentWarehouse.V1.Model.UtilStatusProto.t

The status returned when RPCs are used to internally fetch the image (eg. from FIFE).

isTerminalboolean(
Default: nil

Specifies if the current crawl state is terminal.

noIndexAfterTimestampstring
Default: nilFull type: String.t

Time in seconds since epoch after which this image should be considered unavailable.

notCrawledReasonstring
Default: nilFull type: String.t
overrodeTerminalStateboolean(
Default: nil

When true, it means that a non-terminal state has overwrote a terminal one.

repidstring
Default: nilFull type: String.t

The repid for the urls. This repid is the id given to the dupe cluster this url belongs to.

robotedAgentsstring
Default: nilFull type: String.t

A comma separated list of user agents for which this image should be considered roboted. All images are crawled using googlebot-images and this exists here purely for informative reasons.

urlstring
Default: nilFull type: String.t

The url at which we crawled this content. With us starting to use repids the crawl table key no longer is suggestive of the url. In addition this is used in Amarna to detect race conditions between a reference changing its crawl directive and the original crawl job finishing.

urlDeletedboolean(
Default: nil

Set to true if the url is taken down by clients. This indicates that this crawl state is used to fast remove the crawl result of the url instead of waiting for Multiverse crawl results. For more information, please refer to go/amarna-url-deletion.