Extracting Google-Indexed Web Site Pages Using MS Excel
(Page 1 of 4 )
In the field of Internet marketing research or search engine optimization, it is very important to know which pages of your web site have been indexed in Google. Currently, by default there is no way to export indexed pages in Google to a convenient spreadsheet for further analysis. If you want to learn how to do this fairly easily, however, keep reading.
Popular spreadsheet software such as MS Excel is readily available to accomplish this task. However, the problem is a bit challenging: "How can you extract indexed pages of our website to MS Excel?"
First, before we can proceed with this tutorial, we will illustrate the importance of extracting indexed pages:
- Duplicate content analysis in search engine optimization (for example, finding similar pages in your website) is only possible if you can compare one page to another by having a list of URLs in your website.
- Spotting the important and low value URLs in your website are key factors in optimizing traffic. Without a list of these indexed URLs, it will be very hard to improve.
- Lastly, if you are concerned with your website security, by extracting all pages of your website which have been indexed in Google, you can easily know which URLs affect your web site's security. Examples of such URLs are admin pages, download pages and customer information pages. By nature, Google indexes URLs if your server does not restrict them and if there are links pointing to them.
Currently, Google is the most powerful search engine on the planet, yet it does not offer tools to let any webmaster extract or easily download indexed pages. Compare this to Yahoo, with its Yahoo Site Explorer that offers tools for downloading indexed pages. However, note that this data is only good in Yahoo, and is NOT applicable for Google.
These tutorials apply only to MS Excel 2002- 2007; note that Google can only give up to 1000 URLs.
Next: Understanding the Google Search Result >>
More BrainDump Articles
More By Codex-M
/ 3 
