Accessibility Settings

color options

monochrome muted color dark

reading tools

isolation ruler

Stories

2785 posts

Data Journalism Methodology Reporting Tools & Tips

On the Ethics of Web Scraping and Data Journalism

Web scraping is a way to extract information presented on websites. As I explained it in the first installment of this article, web scraping is used by many companies. It’s also a great tool for reporters who know how to code, since more and more public institutions publish their data on their websites.
With web scrapers, which are also called “bots,” it’s possible to gather large amounts of data for stories. But what are the ethical rules that reporters have to follow while web scraping?

Data Journalism Methodology Reporting Tools & Tips

Web Scraping: A Journalist’s Guide

$8 billion in just a few hours earlier this year? It was because of a web scraper, a tool companies use—as do many data reporters. A web scraper is simply a computer program that reads the HTML code from webpages, and analyze it. With such a program, or “bot,” it’s possible to extract data and information from websites.

Election of GIJN Board — 2015

This October, the membership of the Global Investigative Journalism Network will vote to elect members of the GIJN Board of Directors. The board consists of 15 members. Of these, seven seats are now up for election — all for a period of two years. To be eligible to run, candidates must belong to a GIJN member organization and their candidacy must have the support of that organization.

After Norway: Help Us Choose the Next Global Conference

The local host of the 10th Global Investigative Journalism Conference, to be held in 2017, will be chosen by GIJN member representatives during the Global Investigative Journalism Conference in Lillehammer, Norway. GIJN is pleased to present GIJC17 proposals for three cities: Amman, Jordan, from Arab Reporters for Investigative Journalism; Johannesburg, South Africa, from the Investigative Journalism Workshop, Wits University; and Vancouver, Canada, from the Global Reporting Centre.

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the top ten links for July 23 to 30: mapping money and doctors in Germany (@ZEITONLINE); maps at the Berliner Morgenpost (@moklick); #ddj for francophone African journalists (@Afronline); carsharing in Berlin (@tagesspiegel); and more.

Reporting Tools & Tips

Sustainability: Tips on Holding Live Events That Support Journalism

Just as an article or a gallery of photos can shine a light on an issue for the public, so can these in-person gatherings. Some media organizations are putting on full-fledged festivals in the same vein as South by Southwest and TED. These gatherings include panels of experts, one-on-one conversations with major newsmakers and presentations that explore ground-breaking topics. In other words, they’re an entirely new way of informing and providing information — undoubtedly journalistic functions.

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the top ten links for July 16 to 23: 2490 D3 Visualizations (@d3visualization); corrupt techniques on evidence presentation (@edwardtufte); examples of fiscal data visualization (@OKFN); Australia’s mining footprint (@ICIJorg); and more.

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the top ten links for July 9 to 16: +300 sites with free geographic datasets (@sciremotesense ); graphing German YouTube (@SPIEGELOLINE); Australia’s mining footprint (@ICIJorg); democratizing data (OKFN); and more.

News & Analysis

Database Launched with +300 Latin American Investigations

A unique database of more than 300 investigative journalism reports from across Latin America was launched this week by The Institute for Press and Society (Instituto Prensa y Sociedad, or IPYS). Called BIPYS (Banco de Investigaciones Periodisticas, or Bank of Investigative Journalism) the UNESCO-backed initiative was announced July 6 at the annual conference of Abraji, Brazil’s investigative journalism association.

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the Top Ten links for Jul 2 – 9: San Fermin’s Running of the Bulls (@elmundodata); democratizing the data revolution (@OKFN); #ddj at Netzwerk Recheche’s Conference (@berndoswald); prison phone calls (@IBTimes); 12 tips for #ddj; and more.

News & Analysis

Can Crowdfunding Support Media Business Models?

Monday July 6 saw the launch of The Ferret, a new Scottish investigative journalism platform, which joins an expanding list of media business models benefitting from crowdfunding. Given the seemingly increased popularity of this funding route many media players will understandably be asking if this source of income is for them. In this article we explore some of the benefits – and potential pitfalls – anyone exploring these channels needs to consider.

Case Studies

How China’s Top Investigative Newsroom Digs for Data

China’s leading investigative news company, Caixin.com, is pushing the boundaries of data journalism in that country. In this exclusive look, Caixin Data Editor Huang Chen writes on how its journalists are using data in one of the toughest countries in the world to report on. Caixin’s challenges will sound strikingly familiar to Western data journalists: messy formats, unreliable data, and problems with access. Despite this, the team at Caixin is pushing forward in ways that should bring a cheer from its colleagues around the world.

Methodology Reporting Tools & Tips Teaching & Training

Environmental Investigative Reporting: Resources & Methods

In this just-released video, investigative reporter Mark Schapiro goes in-depth on how to use investigative techniques in probing often complex environmental issues. Schapiro, a veteran of the original Center for Investigative Reporting, gave this talk in Hamburg at NR15, the July 2015 annual conference of Netzwerk Recherche, Germany’s investigative journalism association.

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the Top Ten links for June 26- July 2: Lobbyists in Brussels (@POLITICOEurope); +200 data visualizations on fiscal data (@OKFN); European population growth (@morgenpost); election costs in Mexico (@Univ_Data); and more.

News & Analysis

Investigative Journalists Share Ideas in Brazil, Germany, UK

This is a busy weekend for muckrakers: investigative journalists are meeting in Brazil, Germany, and the UK for seminars, training sessions, and networking. The events, sponsored by GIJN members Abraji, Centre for Investigative Journalism, and Netzwerk Recherche, have brought together more than 1200 journalists from around the world. All three events include a range of practical sessions on investigative techniques, data journalism, and new models of muckraking.

Data Journalism

Twelve Tips for Getting Started With Data Journalism

Nils Mulvad, co-founder and board member of GIJN, ‏and Helena Bengtsson, editor for the Data Projects Team at the Guardian, share twelve tips on how to use data for stories. These were presented at the 2015 Netzwerk Recherche Conference in Hamburg.

New Members: GIJN Adds Eight Nonprofits from Five Countries

We’re proud to announce that eight organizations have joined the Global Investigative Journalism Network. This brings GIJN’s membership to 118 organizations in 54 countries. Our new members include groups that support investigative reporting based in Eastern Europe (Hungary’s Direkt36, Montenegro’s Center for Investigative Journalism, and Ukraine’s Slidstvo and Svidomo), the United States (Internews, ProPublica, and Public Herald), and Italy (DataNinja).

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the Top Ten links for June 18-26: The Migrant Files’ Money Trail; global access to medicine (@civio); the German arms trade (@welt); Swiss Election Data (@DataLeTemps); Mapping Rents in Munich (@SZ); and more.

Making the Nonprofit Media Model Work Around the World

Krautreporter proved it: donation-financed journalism is possible. Not only in the United States, but also in Germany – and possibly everywhere. It started a campaign for its own online magazine for in-depth journalism with experienced writers. Within one month it raised around 1 million Euros (about US$1.1 million). But 19% of this money was gone the moment it was raised. Devoured by sales tax.

Reporting Tools & Tips

Eight Practices of Successful Entrepreneurial Journalists

For the last seven years I have been interviewing and profiling successful entrepreneurial journalists in various countries of various socioconomic classes. I’ve talked to publishers and editors with staffs of as many as a hundred as well as some one-man/one-woman bands. The ones that survive and thrive after several years share some common practices.

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the Top Ten links for Jun 11-18: mapping global tax evasion (@grandjeanmartin), vote for best data journalism site (@GENinnovate); data viz examples (@visualoop, @OKFN), data retention (@Frontal21) and more.

Data Journalism

African Open Data: A Call for People-Driven Information

What I see in Africa open data today is a very immature movement/industry totally dependent on international aid funding, local heroic leadership against almost impossible odds, and absolutely no governmental institutional commitments. Governments are not funding programs and deploying talented resources on their own and there is no public demand. Without international funding there would be no open data programs in Africa today and a movement without indigenous will and commitment cannot stand on its own. Why?

Guess Who’s Coming to Lillehammer?

From Seoul to Bogotá. From Tromsø to Johannesburg. The list of speakers and participants for GIJC15 at Lillehammer is filling up. There are just over 100 days before the opening of the ninth Global Investigative Journalism Conference in Lillehammer, Norway. So far we’ve confirmed 61 sessions at the conference, with dozens more to come over the next few weeks.

News & Analysis

What If We Disclose Everything?

From my experience of more than eight years managing transactions and capacity building programs in Latin America and Africa, a radical approach to transparency is the key to enable public-private partnerships to deliver more and better infrastructure services. The crude truth is that opaque policies serve a lot of interests, but almost none of them benefit service users or taxpayers.

Data Journalism

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

What’s the data-driven journalism crowd tweeting? Here are the Top Ten links for Jun 4-11: 60 Years of European World Cup Data (@elmundoes); 4 cheap ways to put ddj in newsrooms (@IJNet); ICIJ’s data team (@ICIJorg); events in Argentina (@HacksHackersBA) & Italy @Glocalnews); @knightfdn grants.

Methodology Reporting Tools & Tips

Drones in Media Bring New Perspectives, Ethical Issues

We’re already seeing the use of drones proliferate across a whole variety of stories — from incredible imagery of the vastness of the natural world to investigations that couldn’t be told with conventional cameras, to views of the inaccessible right under our noses. So how are the drone journalists of the future being trained for their work?