dxc-technology/OSSRank

stackexchange data collection job in visualization module does not work

theroys opened this issue · 1 comments

Code fails with stacktrace...
[Errno 22] Invalid argument Traceback (most recent call last): File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1535, in call rv = self.handle_exception(request, response, e) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1529, in call rv = self.router.dispatch(request, response) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1278, in default_dispatcher return route.handler_adapter(request, response) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1102, in call return handler.dispatch() File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 572, in dispatch return self.handle_exception(e, self.app.debug) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 570, in dispatch return method(_args, *_kwargs) File "/base/data/home/apps/sossrank/1.384660104271797214/stackexchange_load.py", line 15, in get self.runStackExchangeLoad() File "/base/data/home/apps/sossrank/1.384660104271797214/stackexchange_load.py", line 49, in runStackExchangeLoad self.searchStackExchange(stack_exchange,config,projects) File "/base/data/home/apps/sossrank/1.384660104271797214/stackexchange_load.py", line 74, in searchStackExchange searched_questions = self.search_in_title (keyword_in_title, stack_exchange, fromDate, toDate) File "/base/data/home/apps/sossrank/1.384660104271797214/stackexchange_load.py", line 98, in search_in_title questions=stack_exchange.search(intitle=keyword_in_title,fromdate=fromDate,todate=toDate,filter='total') File "/base/data/home/apps/sossrank/1.384660104271797214/lib/stackexchange/init.py", line 896, in search return self.build('search', Question, 'questions', kw) File "/base/data/home/apps/sossrank/1.384660104271797214/lib/stackexchange/init.py", line 734, in build json = self._request(url, kw) File "/base/data/home/apps/sossrank/1.384660104271797214/lib/stackexchange/init.py", line 705, in _request json, info = request_mgr.json_request(url, new_params) File "/base/data/home/apps/sossrank/1.384660104271797214/lib/stackexchange/web.py", line 158, in json_request req = self.request(to, params) File "/base/data/home/apps/sossrank/1.384660104271797214/lib/stackexchange/web.py", line 106, in request halt(5 - (WebRequestManager.window - now).seconds) File "/base/data/home/apps/sossrank/1.384660104271797214/lib/stackexchange/web.py", line 91, in halt time.sleep(wait_time + 0.1) IOError: [Errno 22] Invalid argument

Cron Job ran fine with all 368 project data uploaded.