Typhoon Crisis Mapping ODI talk

At the Open Data Institute, the office where I’m working at transportAPI these days, they have “Friday Lunchtime Lectures“. Presentations on all sorts of open data topics. It was my honour to kick off the 2014 series with a talk on “Typhoon Crisis Mapping with OpenStreetMap”.

This was an introduction to OpenStreetMap and to the Humanitarian OpenStreetMap Team, and look back our (more…)

An OpenStreetMap training course intro

A week ago I got together with Steve Chilton and Steven Feldman and gave an OpenStreetMap training course to a handful of enthusiastic young people who were about to head out to Ghana as volunteers with a charity called tzedek.

Steve Chilton & Harry Wood teaching OSM
Photo by Steven Feldman CC-BY NonCommercial

I’ve done similar things before but nothing exactly termed a “training course” actually. It was pretty similar to the UCL Masters Student mapping party Sept 2010. Back then I was asked to kick things off with an introduction, and had to stand up make something up on the spot. This time I had some slides prepared.

Which slides? Well maybe I should’ve just used learnosm.org teaching resources for this. I took a look at them, but I decided I wanted to say a bit more in the intro sessions (perhaps wrongly actually). The learnosm.org slides are (more…)

Interview about VGI and OpenStreetMap

The following is a set of questions which Bhaveen Dattani put to me, as part of his studies of VGI and OpenStreetMap for his course at Aston university. The basic questions are the always the big questions, and I had to take a step back and think a bit about all the broad issues around OpenStreetMap (my big hobby). In the spirit of openness I’m sharing these answers here:


What is Volunteered Geographic Information (VGI)? / Have you seen VGI?
I have noticed the term VGI used extensively in academia. There are several terms used for the same concept. Technologists will refer to the same (or similar) concept as “Crowd-sourced” geographic information.

But in fact, when describing the project I am involved in, OpenStreetMap, I prefer the term “mass collaboration”. Some VGI initiatives are mostly about “sourcing” data on the cheap from a crowd of low-skilled contributors. You can think of OpenStreetMap in those terms, but OpenStreetMap has volunteers who bring a wide range of skillsets and levels of dedication, many of whom have specific use cases of their own in mind. Users are typically also contributors. People collaborate en masse, coming together to build a wonderful free geodata resource, and crucially it is open licensed and co-owned by everyone.

What is ‘authoritative/official’ data? Have you seen this data?
Maps created by mapping agencies. This is the traditional way of creating maps. A map making organisation, with map making professionals conducts the surveys and creates the maps. Often these are government, or government backed organisations. The data comes with a mark of authority because it is created by this organisation.

People often present “authoritative/official” geodata as the antithesis of VGI, but in fact it is produced in very similar ways, by humans who make judgements and also make mistakes, and at some stage there has been a decision to work towards a certain detail and accuracy level in representing the real world. There’s no such thing as a “completely accurate” map

Although not always the case, it’s worth noting that authoritative map data is very often not free. The standard old market driven approach is to license map data at great expense, and protect this business model through copyright enforcement. Exceptions to this include some open datasets from Ordnance Survey, and TIGER data in the U.S. In both cases “authoritative” data being released for free, but at a lower quality than other more expensive datasets. So “authoritative” does not necessarily mean non-free but also does not necessarily mean high quality.

Do you believe that there are more people using VGI maps in comparison to authoritative maps or do you believe that more people are using authoritative maps over VGI maps? Why do you believe this?
It is still the case that most maps that ordinary people encounter in everyday life are based on traditional authoritative data. VGI is very new, but large projects which release the data openly (I’m pretty much exclusively talking about OpenStreetMap here) are starting to have an impact and reach an increasingly mainstream user-base. We are seeing a shift towards end users seeing and using OpenStreetMap more and more.

If we think at the level of developers working with geo-data or just experimenting with geo-data in their bedrooms, there is a class of web developers and mobile app developers who make basic embedding use of raster maps. These are more numerous, and these are mostly still using Google Maps. But if we look at developers who are working with raw geo-data (not just basic embedding of raster), it’s quite likely we’ve already passed the point a long time ago where the majority of such developers are using OpenStreetMap data by virtue of its free and open availability.

If you had to choose between two different sources of data, would you choose a VGI dataset or an authoritative dataset? Why would you choose this option
I always try to use OpenStreetMap, because by using it you are supporting it. I use it when viewing maps on my phone, when printing maps, when emailing a link to a map, when embedding maps on websites I create.

OpenStreetMap exists to be used. That’s the goal. It creates a virtuous circle. Using it results in new people seeing and talking about it, and then some new people contributing to it. As an OpenStreetMap contributor, by using it myself I can help to spot areas of map data which can be improved. As an OpenStreetMap developer I can help to spot areas of the software tools and user experience which can be improved.

I choose to support OpenStreetMap because it is a wonderful open-licensed geodata resource which can benefit all of mankind. It is a not-for-profit good cause (This is not true of many other VGI projects I might contribute to)

Can you highlight any weaknesses of using VGI over authoritative data?
I think the weaknesses many people try to highlight are misplaced criticisms, or points which are outright incorrect. Let me give a few of these.

It is commonly held that VGI cannot be trusted compared to authoritative geodata. This issue of “trust” seems highly nebulous and subjective. I would argue that it actually boils down to a very indirect way of talking about data quality. No geodata is perfect, but if data quality is higher, more people will trust it, and OpenStreetMap data quality is ever-increasing.

People commonly criticise OpenStreetMap data shortcomings with a particular location in mind, but they should really fix it! (or at least point mappers to the location so we can tackle it, e.g. using osmbugs.org) With an open wiki-like process inviting anyone to improve the data, to criticise OpenStreetMap is to criticise yourself.

It is very common to hear people criticise aspects of the cartographic style presented on the ‘standard’ OpenStreetMap.org home page. This is a very visual thing which people are quick to notice, but it’s actually largely irrelevant. With open access to the underlying geodata (which OpenStreetMap offers for free) anyone can customise the cartographic style.

If I were to highlight a weakness, I would say one of the only fair criticisms of OpenStreetMap is the inability to achieve consistency across the dataset. OpenStreetMap currently has no upper limit on the level of detail volunteers can add, and this means that tremendous detail is added in one area, while another area is lacking. This weakness might mean that for some data use cases, a technically challenging process of smoothing over these imbalances can be necessary. For many use cases this is not a major shortcoming (and this is true of other issues of data quality)

What interests you about VGI?
I am excited by people coming together to collaborate on creating something great. I feel passionate about OpenStreetMap for this reason. The process and progress of map data being added is glorious and fascinating thing to behold.

VGI initiatives in general? I find many of them less worthwhile and subtractive from our global efforts. In particular many initiatives fail to open license and release the raw data which volunteers contribute. I would question the ethics of this exploitative practice. Hopefully potential contributors will see this and stay away, but this doesn’t always seem to work. I find it interesting that anyone would contribute to Google Map Maker.

What is required to produce high quality VGI within the UK?
There is no special requirement in the UK. OpenStreetMap’s approach to VGI was invented in the UK, but works worldwide, including creating the very first maps in the developing world for example. There are some differing considerations on a country by country basis. A key one is the availability of existing map data.

In the UK the Ordnance Survey still dominates provision of geo data. Many people in the UK are fiercely proud of our national mapping agency, but there is also a tremendous desire for open geodata. This gave rise to OpenStreetMap and continues to motivate volunteers to contribute in the UK. Partly in response to the “threat” of OpenStreetMap, the O.S. decided to release some of their lower quality datasets under a free open license. Nowadays we attract volunteers to OpenStreetMap showing that it can be better (mostly it is!) and more free compared to O.S.

What challenges do you feel would arise in the future of VGI?
I’ve already mentioned imbalances in level detail as a weakness we are struggling to tackle. This will become more of a challenge. Likewise other data issues such as vandalism and rogue importing will likely increase as the project grows, and we face challenges in structuring our project governance, but I think we will overcome these challenges within our community.

A big question is whether OpenStreetMap will remain relevant at all in the long run when faced with the challenge from other competing map providers. OpenStreetMap provides map data. It doesn’t attempt to compete on other features. There’s no OpenStreetMap aerial imagery and certainly no OpenStreetMap version of any 3D lidar photo synth features. It’s not something we are even *trying* to do, but If those things turn out to be the future, then OpenStreetMap might fade into irrelevance. This seems unlikely. Google streetview has been around for years, and hasn’t stopped people using normal maps for most use cases. Other forays into 3D have so far proved to have good gimmick value, but no long lasting effect on the way we use maps.

Another challenge might be if our form of vector map data can be auto-generated by some yet-to-be-invented machine learning OCR techniques. Of course competing crowd-sourcing initiatives might also be a challenge.

But there’s a certain glorious inevitability about the success of OpenStreetMap. It keeps getting bigger and better because people want open licensed map data. Even if OpenStreetMap somehow dies out, the data will live on with the same open license.

Do you feel that VGI is currently growing?
Yes. Massively so. In terms of quantity of data, and number of people taking part. See http://wiki.osm.org/Stats for some exponentially increasing curves.

How long do you feel VGI would be used for? Why do you believe this?
The data will be around, and will form the basis of interesting geo-experiments long into the future I’m sure. As a snapshot of the world as we see it today, OpenStreetMap is fascinating, because of the way it has be built by real people with local interests. But OpenStreetMap’s data is not being used to its full potential yet. The interesting question really is how long will it take for OpenStreetMap to really go mainstream?

How long do you feel authoritative data would be used for? Why do you believe this?
As mentioned, authoritative data currently forms basis of most maps in use today. I think this will continue until OpenStreetMap not only goes mainstream, but starts to push all other map data providers out of the market. I’m not sure if this will ever happen (I think in ten years time we’ll know either way) but in any case OpenStreetMap is adding value, and can add much more value, alongside authoritative map data.

Where do you see VGI in five years from now?
Impossible to say. We’re at an exciting juncture right now. In five years OpenStreetMap could be massive, or it could be coasting along still yapping at the heals of other map providers.

What do you believe the future trends are for VGI?
We’ll see more commercial propositions built on top of OpenStreetMap, and I think this will help to drive things forwards. We may see the emergence of a new kind of “authoritative” data, built on top of VGI. Map data authorities could take a snapshot version and “bless” it as trustworthy, or perform some elaborate branching of the dataset to arrive at an authoritative version.

Is there anything else you would like to add about VGI and its future trends?
VGI / crowd-sourcing initiatives should open-license the data they gather, to provide it back to those who contribute. In fact it should be regarded as unethical not to do so, and we must campaign strongly against instances of closed data crowd-sourcing (such as Google Map Maker) to ensure that this exploitative practice does not become a trend.

Open licensing is about giving the data back to your contributors (which should help you attract them in the first place) but it’s also about data sharing *between* different initiatives, and ensure your data gets used as widely as possible. New VGI initiatives should also consider the compatibility of their open license with that of OpenStreetMap. How might we share data? Or could OpenStreetMap be a good platform for directly publishing the data? By doing this you can be taking part in the largest VGI initiative of them all!

HOT at PICNIC

I was invited to speak at the PICNIC festival in Amsterdam. I was presenting OpenStreetMap and the Humanitarian OpenStreetMap Team again, a slimmed down version of this presentation. I followed after Helena Puig Larrauri presenting the “Standby Taskforce”, and then we sat together and took questions. You can watch that whole thing here:

I had the impression I was bringing OpenStreetMap to a very new audience which is always worthwhile. In this case the session had a journalism theme to it. It was organised by European Journalism Centre. Big thanks to them for inviting and organising for me to speak. It was an interesting session overall, and the EJC folks even took me and my fellow panelists for dinner on boat ride around Amsterdam! Here’s another video with me on the boat:

The connection between Humanitarian OpenStreetMap and journalism is one I haven’t given a lot of thought to before, and I probably should’ve given more thought to it before trying to answer those questions! Clearly OpenStreetMap has great potential for unrestrictive (free!) use in presenting maps for newspaper & TV news. Perhaps I should also have mentioned that journalists can of course help our cause simply by talking about us. OpenStreetMap has made the mainstream news in Germany more than anywhere else, and we can see the benefits this has brought in increased contributions (Or maybe the contributor interest came first. Who can say?) More people viewing and taking an interest in opensteetmap.org is all good news. hot.openstreetmap.org also offers an interesting window into the project. I think the more obvious “good cause” nature of that may appeal to more people, and things like tasks.hotosm.org might present a more obvious starting point for people looking for places to contribute.

I hung around for the second day at PICNIC which was also fun. I’m not quite sure how to categorise this conference. It’s sort of about technology, or just new ideas I suppose. Apparently there were ~3000 attendees. Lots of creativity and buzz and picnic boxes for lunch, all set on the opposite side of the river from the Amsterdam city centre in an amazing new building which looks like a crashed alien spaceship.

Amsterdam Amsterdam Amsterdam

Workshop on Using OpenStreetMap Data

 

I presented a workshop (or at least a live demo session) at the Society Of Cartographers conference with the rather vague open ended title of “Using OpenStreetMap Data”   -  “A tour of the various options for downloading and otherwise accessing OpenStreetMap data from a geo-data user’s perspective. Harry Wood will explain how to delve into the raw data structures using tools on the website and elsewhere, how to explore the wiki-style editing history, how OpenStreetMap’s unique ‘tags’ approach works, and some ways of manipulating the map data.”   At least that’s what I wanted it to be. It didn’t go entirely to plan (see apologies below)

I started by presenting some slides from my OpenTech OpenStreetMap developer ecosystem presentation which highlights the central role of raw geodata, and gradually builds up a picture culminating in this diagram (see above link for the full build-up and explanation)

Also a re-use of the slide explaining different levels of OpenStreetMap use which developers and data user organisations might consider.

Then it was on to the live demos touring around various different topics and tools. I don’t think I actually timed it well enough to get through all these things in either of the two hour-long sessions, but the following were (more…)

Old sofa. Anyone want it?

Does anyone (who is able to collect it from London N19) want our crappy old sofa?

Update: Due to the power of freecycle, the sofa is no longer available! Someone came round and collected it off me.

old sofa in bits

The good news: Free sofa!

The bad news:

  • We dismantled it. But all the bits are there. It can probably be put back together, and this way it will easily be transported
  • It’s a not a good sofa. It’s a very low-end cheap IKEA sofa.
  • It’s old. The cushions aren’t horribly stained, but they’re not exactly white anymore either.

(more…)

Strasbourg

I used to post to my blog about various holiday travels. I wont try to catch up on the past two years, but here’s a little post about Strasbourg where my girlfriend and I spent a pleasant long weekend (avoiding jubilee). Some photos mainly. Photos of food mainly. Strasbourg is in the Alsace region of France on the border with germany, which has some great specialities.

Flambee

I had this in a restaurant in London once where it was described as “Alsacian pizza”, but it’s not a pizza, it’s a “tarte flambée”. Thinner than a pizza with no tomato, but with white creamy sauce.

Choucroute

“Choucroute” is the french word for sauerkraut, but you can also order a full dish named choucroute, which is the pickled cabbage with assorted meats swimming around in it.

Baekoffe

This one’s called “Baeckeoffe”, which I hadn’t heard of before, but wikitravel told me to try it, so I did. It’s a hot-pot of pork, spuds and other veg.

In case you thought Strasbourg was all about food…

View from Strasbourg cathedral

This is the view from the top of the cathedral. Lots of steps to climb. A good way to work up an appetite.

Strasbourg Petit France

This is the “petit France” and on the right there is a very nice restaurant with friendly waiters. I’m still talking about food aren’t I?

Tell you what. Here’s a skeleton:

Archealogy museum skeleton

Can’t remember if this one is stone age or bronze aged or iron aged… but it’s old. The archeology museum in Strasbourg talks about how human settlers were in the region going back at least 600,000 years, since before they’d sussed out how to make fire!

#geomob presentation on HOT

Last week I gave a talk at #geomob, London’s second most important geo meet-up group (after OSMLondon of course). It was good to be able to get up and present something after watching so many others over the past couple of years.

My talk was about the Humanitarian OpenStreetMap Team (hot.openstreetmap.org) I’ve been doing a fair bit of HOT stuff lately, so it came at a good time. I’ve just got back from a week long trip to Washington D.C. for a board strategy meeting, followed by various events there. The talk is a refresh and update of previous talks I’ve given on the topic, plus some new info inspired by this recent trip (newer stuff from slide 18 onwards)

Download slides for OpenOffice (28Mb!)

…or just see them below with notes (kind of a transcript) alongside:



Slide 1

I’m going to talk about the Humanitarian OpenStreetMap Team. How OpenStreetMap offers a great platform for humanitarian mapping, and a look at some of the (more…)

Some new repton3 maps

Peter McElwee emailed me saying “Thanks for releasing Repton 3, have lots of fun but the wife isn’t so pleased. Anyway have made two levels of my own, would be great to have your comments”

So you can now download his ‘names.rls’ levelset file.

<sarcasm> Repton3 is a fast moving sector of the games industry. The game was released in 1985 for the BBC micro and electron. I made my repton3 version for windows in 1998, just 14 years later. Gamers the world over set to work proving their puzzle solving prowess by conquering my two levelsets as quickly as they could, and sure enough in 2000 my mate Will succeeded, followed by two more people in 2006 (hot on his heels!) I also made a level editor, knowing that this would send gamers into a frenzy as they they start designing levels and emailing me with files to share. Sure enough in January 2011 Peter sent me this names.rls file, and so I didn’t waste a second to publish this on my website 14 months later.

but seriously </sarcasm> it is actually quite exciting for me to receive some repton3 puzzles from somebody else. Thank you Peter, and massive apologies for failing to do anything with your email for the past 14 months! I sort of forgot about it because repton3 is languishing on my under-used windows machine these days. But actually the real reason was, I wanted to play through your maps myself, and then reply saying they were too easy…  but then I got a bit stuck! I have now played them though. Good fun playing other people’s repton puzzles!

Giving up twitter for lent

I’ve decided to give up Twitter and IRC for 40 days and 40 nights. This is quite a big deal for me. It remains to be seen how well it works, but I’ve survived the first couple of days. @harry_wood has gone quiet!

Somehow twitter has become very entwined in how I operate. I use it to keep up to date with news and interact with a “professional network” and “friend” type people within various spheres: OpenStreetMap, open data particularly transport data, general IT tech & mobile/web. Reading, interacting, announcing and microblogging on these topics. And it’s great. I’m hooked on it and I’m happy with it, but…

I’m anticipating some possible positive effects of giving it up for the next 40 days and 40 nights.

Maybe I’ll blog more. Somehow twitter uses up a lot of the creative energy that previously would have gone into writing blog posts. I know I’m not the only one to more or less stop blogging as I embraced twitter. There’s a few things I really should have blogged about but lately I’ve just been using my blog for publishing presentation slides. So more to come here hopefully.

These days twitter replaces RSS for many people. It’s normal to tweet with a link to your blog every time you post. Should I allow myself this? I think not. I’m going cold-turkey on this one! Who knows, maybe somebody else might tweet a link to here. Or maybe nobody will read this :-(   As usual, if you say “hi” in the comments it will make me happy. If you don’t, then I’ll just brood about whether or not I have a signficant number of lurkers.

The other positive effect will be eliminating the time sink that twitter represents. Although twitter is a neat way to distil things and the signal to noise ratio isn’t too bad (otherwise I wouldn’t use it) I can’t deny that it is often just a tempting distraction. One click of that juicey looking tweetdeck icon and I can marvel with a dizzying feeling as technology and society and all manner of fun seredipidous nonsense spins before my eyes, and… oh yes I was supposed to be doing some work.

I’ll be quitting IRC too (Chatrooms for those who don’t know) The mac Adium IRC client lets me auto-join all my favourite OpenStreetMap channels, and then the cute little green duck flaps its wings when someone wants to chat to me. How can I not click on a cute flapping green duck?? I won’t go completely cold turkey on this, because I have some meetings I need to attend, but over lent the duck will die.

I imagine I may move onto facebook and google+ to get my fix of realtime updates. I’ll allow myself this because I see it as another positive. I feel I should try to understand google+ better. After the failure ot orkut, buzz, and wave, it seems google are going to shove this one down our throats via their search results, so perhaps there will be no escaping how important it will be for promoting things. Meanwhile facebook is where all my non-techy friends hang out. I should stay in touch with them better. Also it’s easy to forget that facebook is much more mainstream than twitter, so promoting on facebook has more potential reach, if you can get your message right (and non-techy enough). It can well be argued that twitter is a terrible echo-chambre. A community of people all re-tweeting eachother, stroking eachother’s egos, whilst forgetting that there’s a big world out there beyond. I don’t really think that, twitter friends, but I sometimes wonder.

Well for 40 days and nights I am severing my connection to the hive. Wish me luck!

Oh and if you’re wondering how to reach me, drop me an email. Yeah one of those old things. If you limit it to 140 characters I’ll probably find that comforting in some way.