.Google's Gary Illyes shows Googlebot gathers links rather than "complying with" them, negating formal documentation.Googlebot picks up web links instead of following all of them in real-time.Gary Illyes shared this information in Google's 'Explore Off The File' podcast.Google.com's documentation opposes the actual spider behavior.