So this is the 7th presentation of the conference and the 2nd set of Lab. Titled “Implementing the New Hotness” By Matthew Ferree and “Whats a Webscraper and how do they work” by Kameron Swinton.
First implementing the new Hotness. Matthew talks about souring in Source Code repositories such as; Krugle, Ohloh, Searchcode, Codeade, and Symbolhound, as well as Github, Stackoverflow and Bitbucket. All can be searched via the site or xraying.
Then he goes into automation specifically scrapers. He mentions “Data Scraper” and “import.io”. Both are free and easy to use. He also mentions outwit.
Then he mentions APIs and tools that you can use to utilize these APIs. Such as BLockspring and API sites like APIHOUND.com, APIGEE etc.
Next is “Whats a Webscraper and how do they work” by Kameron Swinton. Kameron first mentions what he would scrape:
He then talks about Import.io, Table Capture, Data Miner/Scraper and how to use them. He also mentions several other scrapers to include capture, mozenda, egrabber and others