Tag: web scraping

Inside a Pioneering Italian Data Journalism Collaboration

Editor’s Note: Confiscati Bene, released in mid-December in Europe, is a pioneering data journalism collaboration that digs into the $4 billion of goods in the EU confiscated from criminals by European authorities. An international team of journalists and their allies

Posted in Benefits of open data, Data Journalism, Journalism, Posts from feeds, Visualising data Tagged with: , , , , , , , , , ,

Scraping Data From A Reluctant PDF

PDFs and civic hackers are not good friends. The post “My First Hackathon: Learning to Extract” explains the civic hackers’ animosity toward PDFs (portable document format computer files) this way: “Over the weekend of January 16-18 [2014] the Sunlight Foundation

Posted in Benefits of open data, Data, Data Journalism, Innovation, Posts from feeds, Smart communities, Visualising data Tagged with: , , , ,

On the Ethics of Web Scraping and Data Journalism

Photo by Caresse Ley. Web scraping is a way to extract information presented on websites. As I explained it in the first instalment of this article, web scraping is used by many companies. It’s also a great tool for reporters

Posted in Data Journalism, Journalism, Posts from feeds Tagged with: , , , , , , , , , ,

Web Scraping: A Journalist’s Guide

Do you remember when Twitter lost $8 billion in just a few hours earlier this year? It was because of a web scraper, a tool companies use—as do many data reporters. A web scraper is simply a computer program that

Posted in Data Journalism, Journalism, Posts from feeds, Smart communities, Transparency Tagged with: , , , , ,

Introduction to Web Scraping Workshop in Sydney

Web scraping is a flexible and powerful technique to collect data for your projects. You can use a scraper to quickly grab all kinds of information for analysis and processing. Scrapers are the backbone of our projects such as They

Posted in Data, Posts from feeds, Smart communities, Transparency, Visualising data Tagged with: , , , ,

Kimono + MonkeyLearn: sentiment analysis with machine learning and web scraped data

New tools have enabled businesses of all sizes to understand how their customers are reacting to them – do customers like the location, hate the menu, would they come back? This increased volume of data is incredibly valuable but larger

Posted in Data, Posts from feeds, Smart communities, Visualising data Tagged with: , , , ,