Historical Sandbox

This is a page to describe the setup of the sandbox at http://hosm.gwhat.org

System account requests

• mailto:jeff@gwhat.org

Hosting Information

• Provider: www.linode.com
• Service: Linode 4GB
  • Details: 4GB RAM, 4 CPU (8x priority), 192GB storage, 400GB xfer
• Install image: 32 bit Ubuntu Server 12.04 LTS

Note: Started with Linode 1GB, but it only had 48GB storage, so I wanted to upgrade the HD capacity to support the ~130hGB worldwide file. Not sure what will happen once we get going with the editing database and then the tile serving database, as well.

DNS Entries

• hosm.gwhat.org
• api.hosm.gwhat.org
• tile.hosm.gwhat.org

App repository

• https://github.com/GWHAThistory/hosm

Configuration Information

• Rails app running in production
• Rails Port installed
• Deployed on Passenger
• CGI map installed

Base Planet Setup

Based off of 2012 12 26 planet.osm

This clearly needs to be streamlined, but these steps show the trial and error to derive the desired planet file.

THIS IS OLD AND NEEDS TO BE CHANGED - IT'S ONLY HERE FOR OLD REFERENCE

     # convert to .o5m for read speed
$ osmconvert planet-121226.osm.pbf -o=planet.o5m
     # 19GB .pbf -> 34GB .o5m

     # Now, ditch stuff:
$ ./osmfilter planet.o5m --drop-tags="created_by= nhd:*= yf:*= canvec:*= gnis:*= NHD:*= KSJ2:*= massgis:*=" --drop-author --drop="natural=wood waterway=drain or waterway=ditch or waterway=stream or leisure=park" -o=planet-natural-temp1.o5m
     # 34GB .o5m -> 26GB .o5m

     # Now, keep stuff:
$ ./osmfilter planet-natural-temp1.o5m --keep= --keep-ways="natural= or waterway=" --keep-relations="natural= or waterway=" -o=planet-natural-temp2.o5m
     # 26GB .o5m -> 3.4GB .o5m

     # Now, back to .pbf so osmosis can do its thing
$ ./osmconvert planet-natural-temp2.o5m -o=planet-natural.pbf
     # 3.4 .o5m -> 1.9GB .pbf

     # and... osmosis
$ osmosis --rb file="/home/historic/data/planet-natural.pbf" --wd user="openstreetmap" password="openstreetmap" database="osm" validateSchemaVersion=no
     # 1.9GB .pbf -> 130+GB apidb