TrawlerTCPIPInfo

TrawlerCrawling

GoogleApi.ContentWarehouse.V1.Model.TrawlerTCPIPInfo

6
out of 10
Medium
SEO Impact
To keep track of fetch connection endpoints. Note: You can use trawler::SourceIP(info) or trawler::DestinationIP(info) (as well as HasSourceIP/HasDestinationIP) in basictypes.h instead of accessing the packed strings directly. This will return a proper IPAddress. Never use the fixed32 based Source/Destination-IP in new code as they will go away (only IPv4).

SEO Analysis

AI Generated

Part of Google's web crawling infrastructure (Trawler is Google's internal name for their web crawler). This model governs how Googlebot fetches and processes web pages, affecting crawl efficiency and frequency. Crawl management directly impacts how quickly new content is discovered and how often existing content is refreshed in the index.

Actionable Insights for SEOs

  • Optimize crawl budget by fixing broken links and reducing redirect chains
  • Use robots.txt and sitemap.xml effectively to guide crawling
  • Monitor Google Search Console for crawl errors and indexing issues

Attributes

4
Sort:|Filter:
DestinationIPAddressPackedstring
Default: nilFull type: String.t

Address of the destination host. Extract with trawler::DestinationIP() or decode with PackedStringToIPAddress().

DestinationPortinteger(
Default: nil
SourceIPAddressPackedstring
Default: nilFull type: String.t

Source address of the crawl machine we originated the fetch from. Extract with trawler::SourceIP() or decode with PackedStringToIPAddress().

SourcePortinteger(
Default: nil