LINZ mainland import status

All-at-once uploads

• Do tag matching and download .osm files from the LINZ-2-OSM web app (for access ask Rob C.)
• Check for pre-existing features at TagWatch
• Download any existing OSM data for comparison using Xapi:

URL="http://www.informationfreeway.org/api/0.6"
BBOX="157.5,-59.0,179.9,-25.5"
wget -O existing_data.osm "$URL/*[natural|waterway=waterfall][bbox=$BBOX]"

HB July 2012: if info freeway server fails try:

URL=http://jxapi.openstreetmap.org/xapi/api/0.6
wget --progress=dot:mega -O data.osm "$URL/*[bbox=$BBOX]"
#  but does it support "a|b" multiple tag queries?

Or download the latest NZ planet.osm file from Cloudmade. (20mb as of Dec 2010; 150mb as of Dec 2011)

• Use the following python script to find existing.osm vs. linz2osm.osm features within 100m of each other:

Script for finding nearby nodes

• Open .osm file in JOSM, check for problems with the Validator plugin
• Notify the NZOpenGIS mailing list of your intentions, leave comments open for a few days before proceeding.
• Upload it as the "LINZ Data Upload" user (for access ask Glen B.)

See the LINZ/Howto page for cleaning and upload tips.

If uploading polygons take care to also upload the associated multipolygon relations.

• Mark its status in the table below as "Imported"
• note "uploaded by $YOU for the mainland $DATE in changeset $CHANGESET" in the LINZ-2-OSM web app

• Revisit duplicates found by the python script. It will give you a list of URLs to visit, maybe tick the "[ ] Data" box in the OpenLayers top-right (+) menu. If the list is long you might post to the NZOpenGIS mailing list asking for help.

• To help add light to the paper-trail, make any merging edits using your personal OSM user account.
  • Add the tag LINZ:merged=V16 for features in the LINZ upload which are melded with existing OSM data (merge any tags/try not to lose any information).
    • Without a source=GPS tag on the existing features don't assume that either one or the other is the correct one. If you are not local with a GPS, viewing with satellite backdrop imagery in Merkaartor or JOSM can help. Toolserver has another good comparator resource.
  • Add the tag LINZ:corrected=V16 for features where the LINZ data was just plain wrong, and correct them in OSM. (probably don't bother if you've just moved an object by a few metres, or used cartographer's license in a minor cleanup, maybe add a LINZ:modified=V16 tag if it has moved more than a few meters but less than a glaring error)
  • If the feature no longer exists (e.g. a boatramp which has been washed away due to river bank erosion), write down it's OSM feature ID then delete it from OSM. The history log will keep a record of the deletion. Then just to make things easy please add the feature ID and a description of the problem to the LINZ upstream notification list wiki page with the idea that it will get reported back to them there.
  • If you still aren't sure, add a fixme=verify_position or some other fixme= tag to flag to others that this item is a bit dubious.

• Change its status in the table below to "Imported and merged" if adjustments were needed, or "Imported and checked" if no adjustments were needed.
• Notify the NZOpenGIS mailing list with what you've done, what you learned, and what problems you encountered.
• Do not proceed to the next layer until the previous one is complete.

By-region uploads

• the methods and tools for this are a work in progress, but we are making very good headway with the new LINZ2OSM web app.
  • The collaborative checkout & scoreboard site is now online at http://linz2osm.openstreetmap.org.nz/

You'll need a user account there to perform checkouts of workslices for your area of interest. See the site for details.

The issue tracker and source code for the web app can be found on github. It's been written to be non-NZ specific, good for managing any bulk upload!

• Some layers will have to wait for others to be done first. For example the lakes and offshore islands really need the coastline to be done first to avoid overlapping water, and the bridges, fords, and gates really want the roads to be in place first, to help with sane feature merging.