minus34/gnaf-loader

raw_admin_bdys_201702.XYZ does not exist

Closed this issue · 4 comments

Hi Minus34,

Are you able to nudge me in the right direction? I keep getting errors like this -

relation "raw_admin_bdys_201702.aus_state" does not exist
relation "raw_admin_bdys_201702.aus_lga" does not exist
relation "raw_admin_bdys_201702.aus_ward" does not exist

The script keeps running but eventually dies completely with

Traceback (most recent call last):
File "load-gnaf.py", line 953, in
if main():
File "load-gnaf.py", line 99, in main
create_reference_tables(pg_cur, settings)
File "load-gnaf.py", line 650, in create_reference_tables
pg_cur.execute(psma.open_sql_file("03-10-reference-split-melbourne.sql", settings))
psycopg2.ProgrammingError: relation "admin_bdys_201702.locality_bdys" does not exist
LINE 14: FROM admin_bdys_201702.locality_bdys AS bdy

After it dies the DB looks like this -
capture

Im running the script like this:
python load-gnaf.py --gnaf-tables-path="C:\GNAF\FEB17 GNAF PipeSeperatedValue\GNAF\G-NAF FEBRUARY 2017" --admin-bdys-path="C:\GNAF\feb17adminboundsesrishapefileordbffile\FEB17_AdminBounds_ESRIShapefileorDBFfile" --pgdb="GNAF" --pguser="postgres" --pgpassword="postgres"
f1
f2

I have added the postgre bin folder to PATH variable. I've confirmed that both shp2pgsql and psql run in command line.

My machine -

Windows 10
Postgres 9.5.0 and PostGIS 2.2.1
Python 3.6.1

Full log file attached.
load-gnaf.log.txt

Much appreciated.

There was an issue on Windows importing Shapefiles. That process has been hardened. Can you grab the latest code and try again.

I ran into the same error at the end, but I'm fairly sure it's due to a different issue based on comparing your log file to mine.

My issue was on ubuntu I had the postgresql-9.6 and postgresql-9.6-postgis-2.3 packages but I didn't have the postgis package to provide shp2pgsql.

I haven't been able to replicate on macOS since the fix. Also, I haven't tried Ubuntu.

FYI - this is my PostGIS install script for Ubuntu (for census-loader):

install Postgres

sudo add-apt-repository -y "deb http://apt.postgresql.org/pub/repos/apt/ xenial-pgdg main"
wget --quiet -O - https://www.postgresql.org/media/keys/ACCC4CF8.asc | sudo apt-key add -
sudo DEBIAN_FRONTEND=noninteractive apt-get -q -y update
sudo DEBIAN_FRONTEND=noninteractive apt-get -q -y install postgresql-9.6
sudo DEBIAN_FRONTEND=noninteractive apt-get -q -y install postgresql-9.6-postgis-2.3 postgresql-contrib-9.6
sudo DEBIAN_FRONTEND=noninteractive apt-get -q -y install postgis

In case you hadn't come across the issue before - the last line, which seems unnecessary, installs shp2pgsql.

Closing as original issue fixed