WP Web Scrapper

By Akshay Raje (http://webdlabs.com/)

WP Web Scrapper
  • Manual Install URL:
  • Automatic Install search term: WP Web Scrapper
  • Geek level: WordPress Ninja
  • Configuration location: Settings | WP Web Scrapper
  • Used in: Pages, posts

WP Web Scrapper is definitely not for the weak of heart, but it is for those of you who know what a "JQuery Selector" is. If you know what a "JQuery Selector" is, then you are in for one awesome coding treat. WP WebScrapper makes grabbing parts of ANY website and including it in a post or page on your blog, a snap!

WP Web Scrapper uses CURL and phpQuery to grab and manipulate data from any public website. Because WP Web Scrapper uses phpQuery, you have the luxury to select which elements you want from the external website using jQuery Selectors. Plus you do not need to be afraid if the external website changes, as WP Web Scrapper degrades gracefully if any changes occur.

Copyright warning

It's important to note that while WP Web Scrapper makes ripping content from a website super simple, it doesn't mean that it's legal. There are many big websites out there that will not take kindly to someone stealing their content. Make sure that you have permission before you take another website's content, or you might find a nice letter from some law firm in your mailbox.

Adding a scrapping

To create a new Web Scrapping, you edit a post or a page. Once installed, WP Web Scrapper will include a new button in your Toolbar that looks like a Gear.

Adding a scrapping

All that is needed for WP Web Scrapper to work is a valid website URL (Source URL) and a valid CSS Selector. Once you have added the external website's URL (don't forget the http://) and added your selector, click Insert. This plugin will create a short code that is inserted into the body of your post. Once you get familiar with the WP WebScrapper syntax, you will be able to add them without ever clicking the "Gear". For example:

[wpws url="" selector=".product" ]

Learn more about CSS Selectors by visiting http://code.google.com/p/phpquery/wiki/Selectors