.Google.com's Gary Illyes uncovers Googlebot picks up links as opposed to "adhering to" all of them, negating official paperwork.Googlebot gathers hyperlinks instead of following all of them in real-time.Gary Illyes discussed this information in Google's 'Browse Off The Document' podcast.Google's paperwork opposes the actual crawler actions.