CompositeDoc

Localized alternate names are similar to alternate names, except that it is associated with a language different from its canonical. This is the subset of webmaster-provided localized alternate names being in the dup cluster of this document. Used during serving for swapping in the URL based on regional and language preferences of the user.

Contains necessary information to enforce row level Docjoin access control.

This field is present iff the page has a bad SSL certificate itself or in its redirect chain.

Contains information necessary to perform policy decision on the usage of the data assosiated with this cdoc.

If present, indicates that some content was inserted, deleted, or replaced in the document's content (in CompositeDoc::doc::Content::Representation), and stores information about what was inserted, deleted, or replaced.

to copy to per-doc

Serialized indexing intermediate data.

Info about videos embedded in the document.

Row timestamp in CDoc storage.

Only present in partial cdocs.

Mark as non-personal since no personal fields will be populated in anchors.link_additional_info and anchors.additional_info. For more details of Search personal data, see go/dma52-search-cdoc-fields.

Information about the most recent creation and expiration of this domain. It's extracted from domainedge signal.

A generic container to hold document annotations and signals. For a full list of extensions live today, see go/wde.

This message set is used for data pushed into the index using the signals framework that is never to be used in Mustang or TG Continuum scoring/snippeting code. Any protocol buffer stored in this message set is automatically returned in a docinfo response - it ends up in the "info" message set in the WWWSnippetResponse, so it can be used in post-doc twiddlers and for display in GWS with no code changes in Mustang or Teragoogle.

Info about "selected" images associated with the document for which we (already) have ImageData. For each image URL, some fixed number of documents are selected as web referrers for the image URL, and within those selected documents, we say the image is "selected". Within the remaining documents, we say the image is "rejected". Note that this distinction is slightly different from selected for indexing. Only images within doc_images where is_indexed_by_imagesearch is true will be selected for indexing. You can find the rejected images at composite_doc.doc_attachments().get(). You can find images that are selected, but for which we have no ImageData (yet) at composite_doc.image_indexing_info().selected_not_indexed_image_link()

Porn related data used for image and web search porn classification as well as for diagnostics purposes.

Date in the url extracted by quality/snippets/urldate/date-in-url.cc This is given as midnight GMT on the date in question.

Data produced by the embedded-content system. This is a thin message, containing only embedded_links_info data for the embedder and JavaScript/CSS embedded links (the embedded-content bigtable also contains snapshots, compressed document trees and all embedded link types). Provided using the index signal API.

rich snippet extracted from the content of a document.

Mark as non-personal since it's an aggregation of anchors. For more details of Search personal data, see go/dma52-search-cdoc-fields.

Contains the tracking version of various data fields in CompositeDoc.

WARNING!!! "url" field in CompositeDoc is optional, and is usually missing: e.g., Docjoin CompositeDoc's don't have CompositeDoc::url. has_url() checking is often useful. So don't rely on CompositeDoc::url unless you're sure otherwise. Usually you want to use CompositeDoc::doc::url instead.

The commit timestamp of a CDoc update to Docjoins on Spanner.

Visible content checksum as computed by repository::parsehandler::checksum::Checksum96bitsParseHandler. The value is a Fprint96 in "key format" (i.e., by Fprint96::AsKey()).

This field associates a document to particular labels and assigns confidence values to them.

Sitelinks: a collection of interesting links a user might be interested in, given they are interested in this document. WARNING: this is different from the crawler Sitemaps (see SitemapsSignals in the attachments).

URL should only be selected for CSE Index if it's pagerank is higher than cse_pagerank_cutoff.