datamade/nyc-council-councilmatic

Solr updates an awful lot of bills when running `update_index`

Closed this issue · 1 comments

reginafcompton commented

The Solr log indicates that Solr updates thousands of Bills, even with an age argument. This is a problem, because it delays data imports (i.e., data imports do not execute every 15 minutes as desired, because Flock politely waits for Solr to finish indexing and for the RTF conversion script to run).

Command run in cron:
python manage.py update_index --batch-size=100 --age=1

Output in log (i.e., /var/log/councilmatic/nyc-updateindex.log):

Indexing 25967 nyc bills
INFO 2018-04-06 13:00:04,480 Starting new HTTP connection (1): 127.0.0.1
...

Does the age argument not work as we expect in Solr 7?