Google updated its Googlebot documentation to clarify file size limits, separating default limits that apply to all crawlers ...

Google updated two of its help documents to clarify how much Googlebot can crawl.