firefart/network_info

Error upon importing RIPE database: index row size 4120 exceeds btree version 4 maximum 2704 for index "ix_block_description"

Closed this issue · 2 comments

Got this with the fresh RIPE data and latest git master. The message repeats several times.

2023-08-18 10:18:37,545 - create_db - INFO     - MainProcess - ripe.db.inetnum.gz - parsing blocks
Process Process-21:
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2108, in _exec_insertmany_context
    dialect.do_execute(
  File "/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 921, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/local/lib/python3.11/site-packages/psycopg/cursor.py", line 737, in execute
    raise ex.with_traceback(None)
psycopg.errors.ProgramLimitExceeded: index row size 4120 exceeds btree version 4 maximum 2704 for index "ix_block_description"
DETAIL:  Index row references tuple (72907,28) in relation "block".
HINT:  Values larger than 1/3 of a buffer page cannot be indexed.
Consider a function index of an MD5 hash of the value, or use full text indexing.

Thanks this should be fixed now. Switched the column to a full text search index

@firefart, a bit of offtopic: what do you think on adding route information to the DB? Route information, at least RIPE's, quite frequently contain unique ranges or usage comments which are not present in inetnum.