During a regular call with one of my clients, who’s site is in redesign process, asked how large can page size really be. Well, it has been my experience that more than 50K in size, is probably too much and most likely won’t get crawled. Actually, I have seen pages much larger than this get crawled and heard this from many other SEOs, but I wanted to see real actual data to support the max 50K rule.
I came across a great experiment in sitepoint, where 25 pages pages of different sizes (from 45 KB to 4151 KB) and inserted unique, non-existent keywords into each page at 10 KB intervals. These pages were clearly generated specifically for this experiment and not for human use.
I was pretty surprised to learn that the experiment established the fact that the leading search engines differ considerably in terms of the the amount of page text they’re able to crawl. For Yahoo!, the limit is 210KB; for Google, 520KB; and for MSN, it’s 1030KB.
Recent Comments