In the era of Google Instant, internet real estate has become increasingly valuable, partially because it is so ephemeral. A single key stroke can instantly dispatch a page of results. In order to remain relevant within the “blink and you miss it” parameter of popular information research, the need for concise yet informative displays of complex topics such as poverty and climate change is vital.
The World Bank’s open data portal is a marvel of efficiency and intelligence. Officially launched April 20th, 2010, the site is exceptionally easy to navigate, and provides in-depth information in a format that is easy to comprehend visually. I spoke with Livia Barton, Jeff McCoy, and Neil Fantom, who each played a role in developing the World Bank open data portal. We discussed their favorite open data portal, the Google one-box, and the upcoming ‘Apps for Development’ competition.
I began by asking for a brief overview of the development process.
Livia: The bank has always had a set of 54 indicators freely available to the public. These 54 indicators have been on our website on our for years, but also have been sold in a publication called the “Little Data Book.” It’s a very popular publication among the academic and statistician audience. We started to talk to Google about two years ago. I have to give the credit to Jeff, who saw that the U.S. Census was putting their unemployment rates into the Google search ‘one-box.’ We thought it would be really cool if we had our population, G.D.P., CO2 emissions, and other similar statistics in the same Google one-box.
Jeff: A couple of years ago we put out a first version of an API with the 54 free indicators. That sort of caught Google’s eye, that we were reaching out in that way. It was a much smaller set than we’re providing right now.
JI: How difficult it is to maintain the portal on a daily basis, in terms of making sure that everything’s accurate and updating information?
Neil: Having the portal is not difficult to maintain because it draws data directly from the database, through the API.
Jeff: All of the country, topic and indicator pages that you see on the World Bank site are all driven directly from the API. As long as those databases are updated, our pages are okay.
Neil: This leverages the business model that we in the data group have had for many years. We had these 54 indicators that were free, but we also had about another thousand indicators that were available to use through subscription. That data set was developed to support a publication. Over time, of course, it’s interesting that the paper publications become less important than the electronic media. In fact, the data set has become more important than the product that it was created to support. We’ve always put a great deal of effort into maintaining that data set. We don’t change it on the fly; we do it twice a year, once on April, and once in September. If there are things that are wrong that we see, of course we update them immediately.
JI: In terms of visitors to the website, the stats said you had 132,000 unique visitors in the first month. Has interest remained high since the website launched? Has it increased?
Livia: The traffic we are getting from the Google one-box, particularly on the population indicator, is the number one performer. Since launching data.worldbank.org, it’s maintained about a 90% increase over the previous site that was there instead. It’s steadily increasing, and we’re seeing more interest with the upcoming Apps for Development. We’re launching some great new features which will allow people to build a chart and use an embed code and put it into a blog post or story and write a good story behind it.
JI: How long have each of you been working for the World Bank?
Livia: I came from the marketing/ad agency world. Moving to the world bank was more of a strategic move. I wanted to sell fewer Dunkin Donuts and reduce poverty instead.
Jeff: I’ve been here about a dozen years, lots of different roles over the years, including web development.
Neil: I’ve been at the bank 8 years. Before I joined the bank, I worked at various countries in statistical offices overseas. I was in Africa for almost 10 years, and I worked for a European office, and the U.K. statistical office. I wanted to come here because a lot of the data that statistical offices produce winds up here; it seems like the Google ‘one-box.’ For me, it was a natural progression.
JI: How have governments reacted to having information so widely available? Have they had any reaction to that?
Neil: We haven’t had any negative reaction. People who have seen it are very excited by it. We’ve been encouraging governments to go down a similar route. We obviously learned when did this from other organizations like the U.S. and U.K. You don’t see quite as much of this in the developing world. But it’s something we’ve been working with other countries to promote.
JI: As web developers, do you have contact with other web developers for other large government open data portals?
Neil: I’ve had a lot of contact with the U.S. government on this, specifically on their open data portal. We listen to what they’ve told us. Andrew McLaughin made a post about our data portal. He was excited about the way we’ve done it.
Jeff: Locally here in D.C. there are some active data open initiatives with the D.C. government. We’ve had some contact with them to see how they’re using it, sort of in a local context. It’s interesting to see the applications that they’re using.
Livia: We’ve seen such great things come from the Canadian government. We have high hopes.
Neil: The one really nice open data site which we used a lot, in fact we were very impressed with their terms of use, is Edmonton City Council. They use an open standard for all their data sets. It’s a really great site.
JI: Livia, you were talking about the Apps for Developers?
Livia: We have the FAQ out there which informs the public that the competition is coming up. We’ll do the official announcement on October 7th that will announce all the rules and prizes, the deadlines and the categories. Our goal here is really for the people to take a piece of the World Bank data and combine it with other data sets to produce a tool, application or software app, or anything of the like that helps the world to learn more about the state of the economy and the state of development. And even improve it.
Neil: We had a get together with some developers last week, and it was interesting to hear the sorts of things they’d like to do with our data. I think we’ll see applications that take the data and visualize it on a global scale. I think we’ll also see a lot of people very interested to do things at a national scale. They’ll try to discover new data sets that are available nationally, and try to merge those with the data sets we have in order to make an impact on people’s lives day to day. I think we’ll see a lot of mobile apps, particularly because they’re becoming more relevant for Africa. I think there will be a lot of incentive for people to find new data sets at a national level around the world. I think that will be one of the exciting things that comes out of this challenge.
Livia: Part of our open agenda will be more publicly announced on October 7th. We’re hosting an open forum which is a live web cast. We’re doing a series of announcements about open data and apps for development and a whole series of things. We’re actually opening up quite a few of our research tools. It will be an opportunity for people all across the world to interact with each other.