The latest tools and resources from the Research Desk: mining Twitter to predict unrest, centralizing access to disaster loss databases, archiving disease outbreaks, and declassifying international relations docs.
Open Data is spreading across the globe and transforming the way data is collected, published, and used. But all of this is happening without well-documented standards, leading to inconsistent metadata, no or little corroboration of sources, and conflicting terms of use. The Data on the Web Best Practices Working Group is working to change this.
Telling us that traffic accidents happen on streets over time is nice, but it’s just the beginning of an Open Data Odyssey that governments, civil society, and other organizations must begin together to document and describe the tertiary impacts of these events, and many other events, on our collective experiences and lives in large urban ecosystems like New York.
Open Knowledge, the UK-based nonprofit that focuses on unlocking data around the world, has released the latest version of its Global Open Data Index. The index attempts to make sense of the explosion in open government data portals, which have grown from just a handful three years ago to nearly 400 worldwide. The good news: the number of entries and data sets is growing. The bad: only 11% of the datasets surveyed are deemed open by the index.
Governments may have begun Open Data, but the next wave is People Data. Any group in any part of the world can self-organize to collect data about their community and publish it on the cloud to effect change. This is an incredibly powerful development.
I was on a call recently with some CIO’s and CTO’s from different American cities who were lamenting about the lack of political interest in open data. They complained that hackathons and data jams are succeeding in building vibrant communities of developers in their cities but that politicians just aren’t into this. They don’t see the value and they rarely show up to participate. I’ve seen the same trend in Europe, Asia, and Africa.
Open Data should be Open, right? When I read “Open Data” I think it means the data can be used openly by anyone for any purpose. But it ain’t so. Read the fine print in the terms and conditions and you’ll quickly realize that Open Data really means wide open liability. How on earth can Open Data restore trust in government if the governments publishing their own Open Data won’t even accept responsibility for the quality of what they publish?
Hacks and hackers meetups. Open government initiatives. Hackathons and datafests. The media development world has discovered big data, and it is embracing it big time. Donors like the Knight and Omidyar foundations are focused almost exclusively on tech fixes to what ails the media. As one prominent donor told a nonprofit newsroom executive, “We no longer fund content.”
