Looking for a Web Scraper

Application Period: May 16, 2016 - May 29, 2016

Contact: Robert David - robert.david@mcgill.ca


We are a team of researchers from the Desautels Faculty of Management of McGill University interested in the evolution of the Quebec wine industry. Specifically, we are analyzing website text from the web to get a better understanding of the actors and issues involved. In order to extract this data from the web, we are looking for a programmer who can build us a web scraper to extract historical data (based on Web Archive) from corporate websites. A second phase would include scraping text from social media (e.g., Facebook, Twitter etc.), blogs, and newspapers.

Qualifications: Familiarity with web scraping as well as JSON-based APIs. Strong knowledge of Java, PhP, Perl, Python, or other programming language that allows for efficient web scraping. Preference will be given to candidates with previous web scraping experience.

Salary: $25 to $40 per hour, depending on experience.  We are also prepared to pay on a project basis, for experienced candidates.

Duration: Open, but we estimate about 40 hours for the first phase of work over the next 4-6 weeks, with the possibility of continuing with subsequent projects into the Fall.

If interested, please send your CV to Robert David via email robert.david@mcgill.ca and/or call 514 398 7463 for more details