Making Education Information Available to All in Kibera

How can all the information about Kenyan schools, including data released by the Kenyan government, and citizen mapping, have a greater impact on education? We’ve been working for the past few months on a project to make information about schools much more available and useful in Kenya. It’s a joint operation between GroundTruth Initiative, Map Kibera, Development Gateway, Feedback Labs, and the Gates Foundation among others.

Douglas Namale collects information at Emuhaya Rescue Center school

Many people collect information about education – and they sometimes make it open and free to use. So, why isn’t it easy to find information about a particular school – for a parent, or for an education researcher? Much of the information that’s out there isn’t connected to the other data – and especially when it comes to informal schools, which provide a great deal of the education services in places like informal settlements.

Citizen data – like mapping schools using OpenStreetMap – should also be easy to combine and compare with official education data. And finally, all this info could be accessible and useful to everyone from parents to policymakers.

So, we’ve started with Kibera as a test location for the Open Schools Kenya project (tentative name – what do you think?).

Early Beta Version of Schools Site

Over the past few months, the Map Kibera team has engaged parents, school leaders, and education officials in Kibera to find out how the informal school sector can be more visible, and to assess the demand for information on education. Now, a widespread effort is underway by Map Kibera to make sure that the schools data that the team collected a few years ago is still accurate, and to add new info as well. We’re also collecting photos of each school, no matter how small. Every one will have a page on the website, really bringing the informal school sector to light. Formal schools in Kibera will be there too.

Much of the work so far has been around engaging important leaders in the community, who care about local kids getting the best education. Mikel Maron of GroundTruth was recently in Nairobi working on the project and will be updating in a separate post about this busy trip. Ultimately, the community wants to know more about its schools, and to improve them. So do education supporters throughout Kenya.

Saviour King School in Kibera

But beyond this important mission of organizing and making interoperable many data sets across the vast education sector in Kenya, we’re also working on an ambitious hypothesis: that parents and community leaders in education will want to provide feedback on schools, which in turn will inform policy and improve individual schools. Ultimately, our platform will be a place where people can not only be consumers of information, but will provide their own opinions and suggestions on schools, and, importantly, submit corrections and updates to the data on the site. Given the early positive response to these ideas, we’re optimistic that this will be possible in Kibera and also Kenya-wide.

The project is not just about education, either. It has far-reaching potential in other sectors as well. We hope to demonstrate that citizen data, official data, academic research and more can come together and be part of a conversation with those on the ground who feel the impact most of government policy in every sector – ordinary citizens. And, that this kind of conversation means that people “own” their own information, and we can see the beginnings of a true “feedback loop” or dialogue between citizens and government, through the medium of shared data.

This article was originally posted on the Map Kibera blog, July 3, 2014.

 


Challenges of OpenStreetMap in Institutions

This Thursday, the World Bank will hold an event on how large organizations can better engage with projects that involve OpenStreetMap. That’s my take anyway! I’ll be part of a panel with good folks like Nithya Raman from Transparent Chennai and Rob Baker from, um, everything. I’m hoping this is a good chance to get some strong ideas percolating through the bureaucratic membranes. My slides are here. You should come and maximize with us! (storify stream of the event here)

Screenshot from 2014-03-03 15:56:42

Ahead of the event, I’m reflecting (rambling?) on what’s been challenging for me to bring OpenStreetMap, citizen journalism, and participatory technologies into the institutional context of large development organizations. This interests me because bringing together “community” and “authoritative” data and approaches will produce better results. I’m coming from the assumption that the methodologies of these tools in community development are pretty sound on their own, and we have good ways to continually improve what we do. The struggle I want to examine is the associated organizational change in large institutions. That’s where the gap in impact lies, not in anything fundamental in the methodologies.

The event came to be after I successfully bugged Stephen Davenport (who’s now at the World Bank) to publish a somewhat forgotten, but proven very useful, Draft HowTo Note on Community Mapping. I regularly included this document in a package to introduce our work to others (as well as the Case Study on Map Kibera and LearnOSM). And I soon learned the HowTo would be an independently published chapter. (It’s published, read it.) And we’d hold an event with smart and influential people (that means you).

So we are “maximizing” at the event. Or, let’s make it bigger. I’ve often been asked about scaling up community mapping. Like, it’s great that you mapped one neighborhood, now let’s do the entire city, the entire district, the country, 12 countries. It doesn’t work like that. Communities can’t be “industrialized”, but always take intensive engagement. That doesn’t mean that things can’t “grow” … they can very fast as evidenced by the OpenStreetMap community as a whole. But that networked growth occurs by building relationships at all scales, not simply multiplication. Still, if you want to map the 100 largest slums in the world, I do have a plan, it just won’t be a cookie cutter model.

There’s a big mismatch in time scale. Organizations work on project timelines and annual budget timelines. Notice the substantial increase in projects initiated late in the fiscal year. Projects end when they end. Communities don’t end. A thriving community of mappers takes way more time to develop than a project timeline, and especially with a real physical community, there are relationships and expectations that extend beyond the institutional structure. I don’t have a good answer for this, and I expect to see this completed solved on Thursday ;) .

World Bank projects approved by month. From http://www.chezvoila.com/blog/datadive2

World Bank projects approved by month. Is it just because it’s better to start projects in June? From http://www.chezvoila.com/blog/datadive2

Publications also must deal with time scale mismatch. The original research for the Interactive Community Mapping chapter started about 3 years ago. And the research was excellent, but the conclusions were drawn at that point in the past. Choose another arbitrary point in time, and you get another conclusion. In Kibera, the gap between “need for information” and “government engagement” has closed substantially, and there’s a different story in the balance of “results” and “process oriented” methodologies. Map Kibera Trust has successfully undertaken both modes repeatedly, in many places, engaging community and delivering specific results for a number of partners, including government, most excellently in the 2013 election work. This years-long timeline was actually by design! While there wasn’t a solid results-driver to start, the whole approach was pretty new at that point, and the political climate in Kenya very different. Learning was desired and required, and this needed to play out over the years to be effective.

On the other hand, Ramani Tandale has had a lot of promise and interest, but hasn’t reached that potential yet. Specifically, the original “need for information” was driven by the urban sector of the World Bank, to integrate this work into slum upgrading programs (which were excellent actually). But then the Tech Team Lead in that Tanzania office left, and a number of other schemes didn’t materialize. In other words, the convening role of the World Bank did not have real long term consequence for the community. At least not yet. Despite that, we’ve worked to continue the Tandale project and the people of Tandale have shown incredible interest, such as paying for internet out of their own savings group funds! But they have not received the organizational support, despite the starring role Tandale takes in many World Bank presentations, nor yet the continued solid connection to government to respond to needs. Organizational support and this final connection may be the most difficult piece of the puzzle.

Mapping in Tandale

Mapping in Tandale

Incentives are super complicated. All of us need to survive, many of us want to contribute something more. It’s a hard balance, and harder still for someone strugggling economically. Ground Truth has had so many different structures in this way. In Tandale, the university students did actually get a stipend for the “industrial training module”, which was paid out of project funds. That’s standard arrangement apparently. True, it didn’t have much correlation with long term interest … the 2 or 3 strongest folks have stuck with it out of their enthusiasm (though they’ve benefited financially too from their continued engagement). That’s natural. It is worth considering that financial incentive operates at all levels; even government officials in many places expect to receive a “per diem” for taking part in a training, or travelling to a conference (especially from the World Bank!). I don’t think you can simply equate presence or absence of financial reward with motivational success.

But clearly there are other benefits. One of the key benefits, and key distinctions of “Interactive Community Mapping” from participatory mapping of the past, is the connection to a global technical commons like OpenStreetMap. Just like OSM has fundamentally changed GIS into a global network, the same goes for participatory GIS. What this means is that data contributed for one purpose, like community engagement, still exists for special purpose mapping, and vice versa. The commons has its own sustainability, and allows for unintended use … the honest reckoning that we don’t know all the potential applications for these maps, but the option is there. It connects community members directly to a global network of mappers, who can share not only data, but share a data community. What “ICM” and “PGIS” do have in common is an acknowledgement that some places are not even accessible to professionals, or that professionals would do a comparatively worse job then people who know a place.

Mappers in Nepal, Mapping for the Philippines. From http://kathmandulivinglabs.org/blog/crisis-in-the-philippineswe-are-with-you/

Mappers in Nepal, Mapping for the Philippines. From http://kathmandulivinglabs.org/blog/crisis-in-the-philippineswe-are-with-you/

With a global network structure, new organizational roles are emerging. Some call these infomediaries. There are “local organizations” whose specific mission is to support use of ICT practices in civil society and communities … they work between global technical networks and the needs of local communities. That is what Map Kibera Trust has become. It’s a gap in Tanzania so far. For HOT in Indonesia, there is for all real purposes a “HOT Indonesia” organization, which runs itself and serves this purpose. The groups taking part in GFDRR’s OpenCities fit this role. Many of the groups GroundTruth has worked with (as international ICM “experts”) fit this mold, such as Grassroots Jerusalem and Transparent Chennai. Kenya has a number of these kinds of groups, including Open Data Institute, Mzalendo, Map Kibera, to some extent Ushahidi/iHub, etc.

Some other quick final thoughts, but I think potent ideas for large organizations looking to do community mapping.

With a global network structure, people in large organizations can be directly involved in communities. OpenStreetMap is meant to be easy for anyone to contribute to, and gets easier all the time. Yet, it’s a rare person developing the space for a project inside large organizations that learns to map before designing a project. It’s takes about 30 minutes, and it will make everything a lot more real and easier to talk about.

While we’re at it, can we just stop hedging with “Interactive Community Mapping”, and just talk about OpenStreetMap?! Aside from balloon and kite mapping, which is a different awesome technology, no one is using Google Map Maker seriously for this kind of work. Let’s get on with it and acknowledge, OpenStreetMap is winning, the world needs OpenStreetMap.

And last, asking a favor. Update contracts to reflect open source and open data. The projects I work on are specifically about production for the commons. Yet most contracts still hold intellectual property rights of the work of the contract. This requires further discussion and annexes to standard contracts, every time. I’m sure we can solve this just once.

See you on Thursday!


The Amazing OSM Community, and the Tasking Server, Maps Swaziland

One month ago, I asked what to do with 10 million GPS points, and it turns out one awesome answer is map an entire country.

I wanted to experiment with the new HOT Tasking Server, so I set up a task using the Swaziland GPS tiles, but I didn’t bother to promote the effort at all. One month later, and the task is 100% complete, and about 25% verified. Amazing work by the community, and a quickly proven, easy to use, compelling tool.

Here’s Mbabane, the capital of Swaziland, before the editing.

And here are the GPS traces of Mbabane, today.

And finally, the map today.

New roads have been filled in throughout the country. It would be interesting to calculate the growth in road features over this month.

There are still lots to do. There are gaps in the GPS coverage, and Bing might help. This was only roads, and unnamed, unclassified roads at that. It’s really now up to the small and growing community of mappers in Swaziland to bring the map alive.

I asked some of the incredible top contributors about why they took part in the mapping, and how the tasking server helped out.

David & Christine Schmitt:

The tasking tool is really nice to keep the motivation up and to keep track of what’s already done. You see the progress and the small chunks are mostly manageable.

It is good for my inner self. It is rewarding on both a greater scale (creating a needed map) as well as a smaller scale. Also, I find tracing a very relaxing activity that leaves my analytical programmer’s mind open for podcasting, talking or just recuperating from the day.

Mark_S:

It was a chance to contribute to a very underdeveloped part of the map and make a real difference to what was available in that country. This is also a country that would take a long time to reach a critical mass of roads without outside work. Hopefully this will give a base for people when they look at a rendered map, which in turn might encourage other people in/near Swaziland to fill in the gaps.

I like mapping because you get to look at somewhere in more detail than you normally would. I now have a real feeling for the geography of Swaziland.

sethoscope:

I’ve been interested in HOT for a while and participate when I can, but it’s not always clear how to contribute. The task manager made that easy. To the larger question of why do this at all: it’s like knitting a sweater for millions of people at once.

I think it’s important to get the tile size right. For the Swaziland tracing, it was perfect. I peeked at another task (tracing buildings in Indonesia) and a single tile was too overwhelming.

stethoscope’s insight on the right tile size was among many great points of feedback. We’re learning lots about how to improve the experience of the tasking server even more, that’s getting captured in issue requests, and Pierre continues to push development.

It was after Haiti that this idea began brewing, with identified need for “Mechanical turk style process for working through and importing individual features from large imports” and “Tools for ongoing coordination and identifying needs, addressing the problem of what to map now?”. And really, it goes back to the search for Jim Gray. At my talk at Microsoft last weekend, I was fortunate enough to meet some of the team who worked on the first mechanical turk process for collaborative imagery interpretation … the inspiration has results!


What to do with 10 million GPS points?

10876681 to be exact. Recording once per second over 4+ months, eight GPS units were taken over every road in Swaziland (background on this survey). If not for some mishaps with batteries and missing SD cards, etc, the count would likely be double that.

Under the project description, the guidance had a lot of freedom for working with the GPS data: “Develop simple software demo interface, incl. analytical tools and manual for monitoring fuel consumption in household surveys.”. (In other words, do cool stuff). After some experimentation, we decided to go with three demonstrations: animation of the traces, tiles for use in OpenStreetMap data collection, and fuel consumption estimate plugin in JOSM. All the code is up on GitHub.

Visualization has always been an inspirational tool for data collection and holistic comprehension, especially in OpenStreetMap. Tom’s animation of London GPS tracks in 2005 is still inspirational, and more recently, ITO’s visualization of edits following the Haiti quake. I’ve used party render many times to animate traces during a mapping party, like this one in Mumbai, and experimented with different styles, like at Yuri’s Night.

The challenge here was to make a visualization on such a large number of points. Split up the task into processing and loading the GPX files into a PostGIS database, and then producing frames of an animation from the db. Having the database would also allow production of other products, like tiles. This set of scripts processes directories full of GPX; change the paths depending on your layout.

Thought about experimenting with SpatiaLite or ElasticSearch too, but that will wait for another time. libcinder would be an amazing platform to try, once geo support is in place.

The animation scripts generate a series of images using Mapnik, time slices from the db, and then the frames are assembled using a series of ImageMagick compositions and effects, and then the frames are combined into a movie using ffmpeg.

The result pretty clearly show the progress of each survey team over the months, with Swaziland as a whole emerging by the end. If there had been more time, would have experimented with more dramatic effects, movement of the camera view, music.

Tiles allow for careful exploration of this large data set. This map has shows all 10 million points rendered together. You can notice that a large number of the GPS traces cover new ground for OSM, so can be used as a tracing source for OSM. Typically in OSM, GPS traces are uploaded/downloaded for tracing, but with the high volume of points, it’s just not practical. The number of points over a particular segment of road gives some sense of its “importance” and “classification” (more used, more likely a major road).The tiles can be configured for use in tracing in Potlatch (http://rockburger.com/mics/tiles/!/!/!.png) and in JOSM (http://rockburger.com/mics/tiles/{zoom}/{x}/{y}.png).

Tiles were again generated using a modified Mapnik script. I experimented with the style and colors using TileMill, by converting a sample of the GPS data into a Shapefile (as of last week, TileMill now has PostGIS support), and converting the carto style sheet into a mapnik config file (carto can just be run on the command line). TileMill doesn’t yet have direct tile output, and I just needed a directory of tile files.

For the gas monitoring application, decided to build it into a JOSM plugin, as it will run on all platforms and should already be part of the MICS GPS toolkit. Started from the ElevationProfile plugin which already generates some stats on GPX files. The modifications add a calculation of fuel usage, based on city and highway fuel consumption rates. The compiled plugin can be downloaded, and then installed in the plugins directory of your JOSM profile; in the Plugins panel of JOSM, simply activate the plugin.

There are lots of ways this can be improved in future applications. ElevationProfile only works on a single GPX file, while this should be adjusted to work on groupings. Additional statistics would be interesting: distance per day, distance average by hour of day, distance average by day of week, distance speed minute by minute; and aligning those stats to points on the map would give some metrics for classification of OSM roads. GPX tracks should have some preprocessing, to simplify and filter out bad readings. Other software to experiment with is Viking an open source, cross platform personal GPS data management tool, and TopCube, which builds desktop apps on node.js apps.

In all this was a lot of fun, opened up some fresh programming avenues for me for dealing with large volume geodata, and should inform further development for MICS.


Household Surveys and OpenStreetMap

Time to introduce our work last year in Swaziland with Unicef, integrating OpenStreetMap techniques into nationwide household surveys.

Way back in 2008, I met Bo Robert Pedersen on the beautiful UN Nairobi compound, to drink coffee and talk maps (without any inkling of what would be happening for in Kenya a year later). Andrew Turner and I were on our way to South Africa for FOSS4G, had scrambled to buy some GPS units a couple days before in NYC (yea 17th St Photo!), and were talking to nearly everyone we could find about maps. We were riding the success of Mapufacture’s acquisition, having a great time mapping in beautiful places, and had found Bo by looking at the most active OSM editors in Nairobi.

Bo just happened to be the regional coordinator for MICS4 (or Multi-Indicator Cluster Survey), an international household survey program coordinated by Unicef, and one of the world’s largest statistical data sources on household demographics and living conditions, and women’s and children’s health and threats to their well-being. These surveys employed GPS units in a fairly simple way, for each survey team to record the central location of survey clusters, and Bo saw an opportunity to make much greater use of GPS. These surveys traverse literally every single road in the country, and simply collecting GPS tracks would unleash a treasure of track points for tracing in OpenStreetMap. And that was simply the tip of the iceberg.

Over the next year and a half, the ideas bubbled, and while in the midst of Map Kibera, we were given an opportunity to pilot these ideas in Swaziland. We designed a pilot project to develop a GPS training program for the MICS survey teams, collect and analyse and trace GPS traces, and explore innovative applications of the tools. Primoz Kovacic and I travelled to Swaziland, developed manuals, and did our best to get the crew psyched for mapping. Traditional household surveys and OpenStreetMap share a lot in common in technique and activity, but differ widely in approach. Surveys are highly controlled, top-down, and jobs, while OSM is self motivated, bottom up, and voluntary, and the interaction between the two was fascinating, especially in comparison to the ongoing work of Map Kibera. One of the first key things was a set of manuals for the MICS program, which are shared here CC-by-SA. The GPS Coordinator Manual may particularly be of wider use, at it describes precisely how to configure Garmin GPS units for surveying with OpenStreetMap.

In the next few blog posts, I’ll present the results, explore the technical experiments with the resulting data, speculate on other applications and approaches, and make available to the OSM community this treasure of data for tracing in the map.