CrawlerChangerateUrlChangerate

Crawler ChangerateCrawling

GoogleApi.ContentWarehouse.V1.Model.CrawlerChangerateUrlChangerate

9
out of 10
Critical
SEO Impact
The next available field number is 22. To access the best estimate of change period, please use GetChangePeriod in predict-change-rate.h to select between this and other change period estimates below.

SEO Analysis

AI Generated

Part of Google's web crawling infrastructure (Trawler is Google's internal name for their web crawler). This model governs how Googlebot fetches and processes web pages, affecting crawl efficiency and frequency. Crawl management directly impacts how quickly new content is discovered and how often existing content is refreshed in the index.

Actionable Insights for SEOs

  • Monitor for changes in rankings that may correlate with updates to this system
  • Consider how your content strategy aligns with what this signal evaluates
  • Optimize crawl budget by fixing broken links and reducing redirect chains
  • Use robots.txt and sitemap.xml effectively to guide crawling
  • Monitor Google Search Console for crawl errors and indexing issues

Attributes

21
Sort:|Filter:
Default: nilFull type: GoogleApi.ContentWarehouse.V1.Model.CrawlerChangerateMultipleComponentDistribution.t

The approximated posterior distribution.

averageChangeSignificancefloat(
Default: nil

The "significance" of the average change we saw of this document (from 0 to 1). Influenced by content changes. This can be used for prioritizing the crawl (higher significance first).

changeperiodinteger(
Default: nil

//////////////////////////////////////////////////////////////////////////// The classic changerate estimation. //////////////////////////////////////////////////////////////////////////// The classic estimate of change period (in seconds). It is computed by inserted a "fake" change and no-change interval as a prior distribution. This field is generally not used and should NOT be accessed directly. See above for correct method for determining the change period estimate.

confidencefloat(
Default: nil

The confidence (between 0 and 1) in the changeperiod guess.

globalBasedChangePeriodinteger(
Default: nil

//////////////////////////////////////////////////////////////////////////// The changerate estimation based on the global prior. //////////////////////////////////////////////////////////////////////////// The global-based changeperiod. This is our estimate (in seconds) for the average time between changes. It is computed using the new prior method based on global_based_prior_period and the global_based_prior_strength specified below. This is used for computing pattern priors. Use pattern_based_change_period or changeperiod fields for all other purposes.

globalBasedChangePeriodConfidencefloat(
Default: nil

The 'confidence' of the global-based changeperiod. This is the n-th root of the posterior evaluated at MAP point, where n is the number of history intervals. For now, it is hard to interpret the meaning of the absolute values of 'average' posterior cross different sets of data.

globalBasedPriorPeriodfloat(
Default: nil

The 2 parameters below specify the prior employed in calculating the global_based_change_period. These values are precomputed through an offline analysis and specified via flags.

globalBasedPriorStrengthfloat(
Default: nil
lastChangeSignificancefloat(
Default: nil

The "significance" of the last change we saw of this document (from 0 to 1). Influenced by content changes, etc. This can be used for prioritizing the crawl (higher significance first).

lastChangedinteger(
Default: nil

The last time (unix timestamp) we saw a changed copy of the document. Provided iff we have seen the page change.

lastFetchedinteger(
Default: nil

The last time (unix timestamp) we saw a fetched copy of the document.

numIntervalsinteger(
Default: nil

The number of intervals we've seen for this document (where an interval is two different versions).

patternBasedChangePeriodinteger(
Default: nil

//////////////////////////////////////////////////////////////////////////// The changerate estimation based on the pattern prior. //////////////////////////////////////////////////////////////////////////// The pattern-based changeperiod. This is our estimate (in seconds) for the average time between changes. It is calculated based on the pattern_based_prior_period and pattern_based_prior_strength below. This quantity will eventually replace the old changeperiod calculation.

patternBasedChangePeriodConfidencefloat(
Default: nil

The same as global_based_change_period_confidence, except it is computed using pattern based priors.

patternBasedLowerChangePeriodinteger(
Default: nil

The lower edge of a confidence interval for the pattern-based change period.

patternBasedPriorPeriodfloat(
Default: nil

The 2 parameters below specify the prior employed in calculating the pattern_based_change_period. These values are calculated in a separate process and looked up based on the URL pattern.

patternBasedPriorStrengthfloat(
Default: nil
patternChangePeriodVersioninteger(
Default: nil

The version number of the algorithm, refer to ChangePeriodVersion for more information.

typeinteger(
Default: nil

//////////////////////////////////////////////////////////////////////////// Basic information of a document. //////////////////////////////////////////////////////////////////////////// The type of the document determined by crawl histories, refer to TYPE for more information.

ugcChangePeriodinteger(
Default: nil

//////////////////////////////////////////////////////////////////////////// The UGC changerate estimation. //////////////////////////////////////////////////////////////////////////// Information on change period generated from user generated content (UGC) change history.

ugcChangePeriodConfidencefloat(
Default: nil