lareferencia/dspace-stats-collector

ERROR: A fatal exception ocurred processing events !!!! 'ip'

Closed this issue · 4 comments

arieljlira commented

Al parecer cuando se recuperan eventos de solr sin el campo ip, la aplicación falla y se cierra. Como retoma desde el mismo punto en el que dejó, queda trabada y no procesa más ítems.

En los logs:

INFO: Finished 'http://my_solr_url:8080/solr/statistics/select/?q=%2A+%2Btime%3A%7B%222020-11-16T11%3A57%3A16.387Z%22+TO+%2A%5D&sort=time+asc&start=0&wt=json&fq=%2Bstatistics_type%3A%22view%22+%2Btype%3A%280+OR+2%29&fl=id%2Cip%2CowningItem%2Creferrer%2Ctime%2Ctype%2CuserAgent&rows=1000' (get) with body '' in 53.403 seconds, with status 200
ERROR: A fatal exception ocurred processing events !!!! 'ip'
termina la ejecución (mar oct  5 08:46:27 -03 2021)
INFO: Finished 'http://my_solr_url:8080/solr/statistics/select/?q=%2A+%2Btime%3A%7B%222020-11-16T11%3A57%3A16.387Z%22+TO+%2A%5D&sort=time+asc&start=0&wt=json&fq=%2Bstatistics_type%3A%22view%22+%2Btype%3A%280+OR+2%29&fl=id%2Cip%2CowningItem%2Creferrer%2Ctime%2Ctype%2CuserAgent&rows=1000' (get) with body '' in 54.192 seconds, with status 200
ERROR: A fatal exception ocurred processing events !!!! 'ip'
termina la ejecución (mar oct  5 09:01:22 -03 2021)
INFO: Finished 'http://my_solr_url:8080/solr/statistics/select/?q=%2A+%2Btime%3A%7B%222020-11-16T11%3A57%3A16.387Z%22+TO+%2A%5D&sort=time+asc&start=0&wt=json&fq=%2Bstatistics_type%3A%22view%22+%2Btype%3A%280+OR+2%29&fl=id%2Cip%2CowningItem%2Creferrer%2Ctime%2Ctype%2CuserAgent&rows=1000' (get) with body '' in 54.719 seconds, with status 200
ERROR: A fatal exception ocurred processing events !!!! 'ip'
termina la ejecución (mar oct  5 09:46:32 -03 2021)
INFO: Finished 'http://my_solr_url:8080/solr/statistics/select/?q=%2A+%2Btime%3A%7B%222020-11-16T11%3A57%3A16.387Z%22+TO+%2A%5D&sort=time+asc&start=0&wt=json&fq=%2Bstatistics_type%3A%22view%22+%2Btype%3A%280+OR+2%29&fl=id%2Cip%2CowningItem%2Creferrer%2Ctime%2Ctype%2CuserAgent&rows=1000' (get) with body '' in 60.873 seconds, with status 200
ERROR: A fatal exception ocurred processing events !!!! 'ip'
termina la ejecución (mar oct  5 10:01:13 -03 2021)

En los datos recuperados de solr hay casos normales, como por ejemplo:
{"ip":"78.234.228.111","referrer":"https://scholar.google.com/","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.198 Safari/537.36","id":69532,"type":2,"time":"2020-11-16T12:28:13.003Z"},
y algunos (150) sin campo "ip":

{"id":103030,"type":0,"owningItem":[55360],"time":"2020-11-16T12:11:33.838Z"},
{"id":103030,"type":0,"owningItem":[55360],"time":"2020-11-16T12:11:33.927Z"},
{"id":104830,"type":0,"owningItem":[55966],"time":"2020-11-16T12:11:34.124Z"},
{"id":10532,"type":0,"owningItem":[4178],"time":"2020-11-16T12:11:34.211Z"},
{"id":108970,"type":0,"owningItem":[57869],"time":"2020-11-16T12:11:34.13Z"},
{"id":1095,"type":0,"owningItem":[1186],"time":"2020-11-16T12:11:34.216Z"},
lmatas commented
lareferencia commented

@arieljlira esto está arreglado estimo, sin embargo no tengo tu caso de test, te agradezco si podes hacer un update con el pip para que traiga la última versión, que también tiene otros fix de memo, sería la 0.5.5.
con eso debiera ser más eficiente, gracias a tu sugerencia del solr y no quedarse ciclando en este tema de la ip. Muchas gracias de antemano por todo

arieljlira commented

Buen día, confirmo que en 0.5.5 ya no falla por ip faltante. Ahora siguie esta procesando sin problemas.
Muchas gracias!

lmatas commented