.Google.com's Gary Illyes reveals Googlebot collects hyperlinks rather than "complying with" all of them, negating official paperwork.Googlebot picks up hyperlinks as opposed to observing them in real-time.Gary Illyes discussed this details in Google.com's 'Browse Off The File' podcast.Google's documentation contradicts the genuine spider actions.