data.rst

Prepare Data

To be able to use pgRouting, data has to be imported into a database.

Chapter Contents

• Prepare the database
  • Create a pgRouting compatible database
• Get the Workshop Data
  • Getting the data
    • Option 1) When using OSGeoLive
    • Option 2) Download data form OSGeoLive website
    • Option 3) Download using Overpass XAPI
• Upload data to the database
  • Run the osm2pgrouting converter
  • Tables on the database
• Chapter: Appendix

Prepare the database

pgRouting is installed as extension. This requires:

• PostgreSQL
• PostGIS

These requirements are met on OSGeoLive. When the required software is installed, open a terminal window by pressing ctrl-alt-t and follow the instructions.

Information about installing OSGeoLive can be found on :doc:`../general-intro/osgeolive`.

Note

If OSGeoLive is not being used, please refer to the chapter's appendix to set up the user user.

Create a pgRouting compatible database

Note

Depending on the Postgres configuration -U <user> is needed on psql commands

.. literalinclude:: ../scripts/get_data/process_osgeolive_data.sh
   :start-after: 4.1.1 from-here
   :end-before:  4.1.1 to-here
   :language: bash

Note

To exit the database use \q

Get the Workshop Data

The pgRouting workshop will make use of OpenStreetMap data, which is already available on OSGeoLive. This workshop will use the @PGR_WORKSHOP_CITY@ city data and is a snapshot of @DATE_OF_DATA@.

Getting the data

Option 1) When using OSGeoLive

OSGeoLive comes with OSM data from the city of @PGR_WORKSHOP_CITY@.

CITY="@PGR_WORKSHOP_CITY_FILE@"
bzcat ~/data/osm/$CITY.osm.bz2 > $CITY.osm

Option 2) Download data form OSGeoLive website

The exact same data can be found on the OSGeoLive download page.

.. literalinclude:: ../scripts/get_data/get_all_data.sh
   :start-after: 4.2.2 from-here
   :end-before:  4.2.2 to-here
   :language: bash

Option 3) Download using Overpass XAPI

The following downloads the latest OSM data on using the same area. Using this data in the workshop can generate variations in the results, due to changes since @DATE_OF_DATA@.

CITY="@PGR_WORKSHOP_CITY_FILE@"
BBOX="@PGR_WORKSHOP_CITY_BBOX@"
wget --progress=dot:mega -O "$CITY.osm" "http://www.overpass-api.de/api/xapi?*[bbox=\$\{BBOX\}][@meta]"

More information about how to download OpenStreetMap data can be found here.

An alternative for very large areas is to use the download services of Geofabrik.

Upload data to the database

The next step is to run osm2pgrouting converter, which is a command line tool that inserts the data in the database, "ready" to be used with pgRouting. Additional information about osm2pgrouting can be found at the :doc:`../appendix/appendix-3`

For this step:

• the osm2pgrouting default mapconfig.xml configuration file is used
• and the ~/Desktop/workshop/@PGR_WORKSHOP_CITY_FILE@.osm data
• with the city_routing database

From a terminal window ctrl-alt-t.

Run the osm2pgrouting converter

.. literalinclude:: ../scripts/get_data/process_osgeolive_data.sh
   :start-after: 4.3.1 from-here
   :end-before:  4.3.1 to-here
   :language: bash

Note

Depending on the osm2pgrouting version -W password is needed

Output:

.. literalinclude:: ../scripts/get_data/process_osgeolive_data.txt
   :start-after: 4.3.1 from-here
   :end-before:  4.3.1 to-here

.. literalinclude:: ../scripts/get_data/process_osgeolive_data.sh
   :start-after: remove_faulty_ways_start
   :end-before:  remove_faulty_ways_end

.. literalinclude:: ../scripts/get_data/process_osgeolive_data.txt
   :start-after: remove_faulty_ways_start
   :end-before:  remove_faulty_ways_end

Tables on the database

.. literalinclude:: ../scripts/basic/data/data.sh
   :start-after: 4.3.2 from-here
   :end-before:  4.3.2 to-here

If everything went well the result should look like this:

.. literalinclude:: ../scripts/basic/data/data.txt

Chapter: Appendix

OSGeoLive's account name on the database is user. To easily use the workshop when not using OSGeoLive this extra steps are needed:

# work on the home folder
cd

# login to postgres
psql -U postgres

-- Create "user"
CREATE ROLE "user" SUPERUSER CREATEDB CREATEROLE INHERIT LOGIN PASSWORD 'user';

-- exit psql
\q

# Add the user to .pgpass
echo :5432:*:user:user >> .pgpass