iKy stops after submitting email to gatherer

Question

iKy stops after submitting email to gatherer

Closed this issue 2 years ago · 1 comments

Feedback
First, thanks for actually taking the time and writing a documentation on how to install and use your project. Seems quite uncommon these days!

Config
MacOS 10.15.7 Catalina
Tried on browsers:
Firefox 100.0.1 (64-bit) (Adblockers off)
Brave [Version 1.38.119 Chromium: 101.0.4951.67 (Official Build) (x86_64)] (no ad on active)
Safari Version 15.4 (15613.1.17.1.13, 15613) (no mods)

Steps undertaken

Created a virtualenv venv (doing it without a venv results in flask not being found, so not sure why we should do it without a venv?)
Followed steps in "easy install" section BUT skipped the Redis part, since Redis appears to be included in your package. Not sure what I would need it for? Running the package as mentioned in part 2 also starts a redis and seems to work... I tried it with part one of the easy install but there was no visible difference in the outcome, as mentioned below.

Issue
After submitting an email address (test@test.com) in the gatherer, I can see that apparently queries are run on twitch etc. The notifications appear as can be seen in the demo videos, on the right hand side of the screen.
The notifications disappear, the green bar on top of the screen reaches the right side and then nothing happens anymore.

In the Firefox console (developer tools) I can see:
Uncaught ReferenceError: exports is not defined
http://127.0.0.1:4200/scripts.js:143
Angular is running in the development mode. Call enableProdMode() to enable the production mode.

Source map error: Error: request failed with status 404
Resource URL: http://127.0.0.1:4200/scripts.js
Source Map URL: jspdf.node.min.js.map

Use of drawWindow method from CanvasRenderingContext2D is deprecated. Use tabs.captureTab extensions API instead https://developer.mozilla.org/docs/Mozilla/Add-ons/WebExtensions/API/tabs/captureTab pagedata-script.js:1:12465
Header Component header.component.ts:25:14
Error in parsing value for ‘max-height’. Declaration dropped. 127.0.0.1:4200:168:42
Error in parsing value for ‘margin-top’. Declaration dropped. 127.0.0.1:4200:197:23
Error in parsing value for ‘margin-bottom’. Declaration dropped. 127.0.0.1:4200:198:26
Error in parsing value for ‘max-height’. Declaration dropped. 127.0.0.1:4200:373:42
Error in parsing value for ‘margin-top’. Declaration dropped. 127.0.0.1:4200:402:23
Error in parsing value for ‘margin-bottom’. Declaration dropped. 127.0.0.1:4200:403:26
Error in parsing value for ‘max-height’. Declaration dropped. 127.0.0.1:4200:578:42
Error in parsing value for ‘margin-top’. Declaration dropped. 127.0.0.1:4200:607:23
Error in parsing value for ‘margin-bottom’. Declaration dropped. 127.0.0.1:4200:608:26
Error in parsing value for ‘max-height’. Declaration dropped. 127.0.0.1:4200:783:42
Error in parsing value for ‘margin-top’. Declaration dropped. 127.0.0.1:4200:812:23
Error in parsing value for ‘margin-bottom’. Declaration dropped. 127.0.0.1:4200:813:26
Error in parsing value for ‘max-height’. Declaration dropped. 127.0.0.1:4200:988:42
Error in parsing value for ‘margin-top’. Declaration dropped. 127.0.0.1:4200:1017:23
Error in parsing value for ‘margin-bottom’. Declaration dropped. 127.0.0.1:4200:1018:26
GathererComponent ngOnInit gatherer.component.ts:94:16
dataService Pull globalGather :
Object { }
data-gather-info.service.ts:50:16
GathererComponent ngOnInit
Object { }
gatherer.component.ts:97:16
GathererComponent ngOnInit length 0 gatherer.component.ts:98:16
dataService Initialize globalGather :
Object { }
data-gather-info.service.ts:40:16
Global data initialize
Object { }
gatherer.component.ts:88:20
Search
Object { term: "test@test.com", tag: undefined }
gatherer.component.ts:90:20
validateEmail func test@test.com data-gather-info.service.ts:118:16
dataService Push globalGather :
Object { email: "test@test.com" }
data-gather-info.service.ts:46:16
Username : test data-gather-info.service.ts:151:16
XHRGEThttp://127.0.0.1:5000/tasklist
XHROPTIONShttp://127.0.0.1:5000/emailrep
XHROPTIONShttp://127.0.0.1:5000/leaklookup
XHROPTIONShttp://127.0.0.1:5000/dorks
XHROPTIONShttp://127.0.0.1:5000/search
XHROPTIONShttp://127.0.0.1:5000/sherlock
XHROPTIONShttp://127.0.0.1:5000/fullcontact
XHROPTIONShttp://127.0.0.1:5000/holehe
XHROPTIONShttp://127.0.0.1:5000/github
XHROPTIONShttp://127.0.0.1:5000/peopledatalabs
XHROPTIONShttp://127.0.0.1:5000/keybase
XHROPTIONShttp://127.0.0.1:5000/darkpass
XHROPTIONShttp://127.0.0.1:5000/leaks
XHROPTIONShttp://127.0.0.1:5000/socialscan
XHROPTIONShttp://127.0.0.1:5000/tiktok
XHROPTIONShttp://127.0.0.1:5000/reddit
XHROPTIONShttp://127.0.0.1:5000/tinder
XHROPTIONShttp://127.0.0.1:5000/venmo
XHROPTIONShttp://127.0.0.1:5000/twitch
XHROPTIONShttp://127.0.0.1:5000/spotify

Expected outcome
After submitting the email address in the gatherer, according to the demo videos we should see a result in the main screen (social graph and such or an error message if nothing is found at all).

Outputs while running

Installation

(venv) MAC:iKy-pack User$ pip install -r requirements.txt
Collecting yagooglesearch
Cloning https://github.com/KennBro/yagooglesearch.git (to revision origin/add-output-param) to /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/yagooglesearch_45a0d150014d46da8f059e390668a4ca
Running command git clone --filter=blob:none --quiet https://github.com/KennBro/yagooglesearch.git /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/yagooglesearch_45a0d150014d46da8f059e390668a4ca
WARNING: Did not find branch or tag 'origin/add-output-param', assuming revision or ref.
Running command git checkout -q origin/add-output-param
Resolved https://github.com/KennBro/yagooglesearch.git to commit origin/add-output-param
Preparing metadata (setup.py) ... done
Collecting search-engine-parser
Cloning https://github.com/KennBro/search-engine-parser.git (to revision origin/master) to /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/search-engine-parser_e2b5ad81c8ab45678253d35eca362c91
Running command git clone --filter=blob:none --quiet https://github.com/KennBro/search-engine-parser.git /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/search-engine-parser_e2b5ad81c8ab45678253d35eca362c91
WARNING: Did not find branch or tag 'origin/master', assuming revision or ref.
Running command git checkout -q origin/master
Resolved https://github.com/KennBro/search-engine-parser.git to commit origin/master
Preparing metadata (setup.py) ... done
Collecting chardet==3.0.4
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting aiohttp==3.7.4
Using cached aiohttp-3.7.4-cp39-cp39-macosx_10_14_x86_64.whl (649 kB)
Collecting beautifulsoup4==4.9.3
Using cached beautifulsoup4-4.9.3-py3-none-any.whl (115 kB)
Collecting httpx==0.13.3
Using cached httpx-0.13.3-py3-none-any.whl (55 kB)
Collecting Flask==2.1.2
Using cached Flask-2.1.2-py3-none-any.whl (95 kB)
Collecting celery==4.4.5
Using cached celery-4.4.5-py2.py3-none-any.whl (426 kB)
Collecting Flask-Cors==3.0.9
Using cached Flask_Cors-3.0.9-py2.py3-none-any.whl (14 kB)
Collecting requests==2.27.0
Using cached requests-2.27.0-py2.py3-none-any.whl (63 kB)
Collecting bs4==0.0.1
Using cached bs4-0.0.1-py3-none-any.whl
Collecting cfscrape==2.1.1
Using cached cfscrape-2.1.1-py3-none-any.whl (12 kB)
Collecting tweepy==4.5.0
Using cached tweepy-4.5.0-py2.py3-none-any.whl (66 kB)
Collecting geopy==1.22.0
Using cached geopy-1.22.0-py2.py3-none-any.whl (113 kB)
Collecting socialscan==1.4.2
Using cached socialscan-1.4.2-py3-none-any.whl (21 kB)
Collecting instaloader==4.8.1
Using cached instaloader-4.8.1-py3-none-any.whl
Collecting requests-futures==1.0.0
Using cached requests_futures-1.0.0-py2.py3-none-any.whl (7.4 kB)
Collecting torrequest
Using cached torrequest-0.1.0-py3-none-any.whl
Collecting holehe==1.60.2
Using cached holehe-1.60.2-py3-none-any.whl (138 kB)
Collecting fuzzywuzzy==0.18.0
Using cached fuzzywuzzy-0.18.0-py2.py3-none-any.whl (18 kB)
Collecting redis==3.5.3
Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB)
Collecting langdetect==1.0.8
Using cached langdetect-1.0.8-py3-none-any.whl
Collecting googletrans==3.0.0
Using cached googletrans-3.0.0-py3-none-any.whl
Collecting vaderSentiment==3.3.2
Using cached vaderSentiment-3.3.2-py2.py3-none-any.whl (125 kB)
Collecting emailrep==0.0.4
Using cached emailrep-0.0.4-py3-none-any.whl (6.3 kB)
Collecting stop_words
Using cached stop_words-2018.7.23-py3-none-any.whl
Collecting spotipy==2.16.1
Using cached spotipy-2.16.1-py3-none-any.whl (24 kB)
Collecting twitch-python
Using cached twitch_python-0.0.20-py3-none-any.whl (30 kB)
Collecting parse
Using cached parse-1.19.0-py3-none-any.whl
Collecting browser-cookie3
Using cached browser_cookie3-0.14.1-py3-none-any.whl (10 kB)
Collecting google-api-python-client==2.33.0
Using cached google_api_python_client-2.33.0-py2.py3-none-any.whl (7.9 MB)
Collecting multidict<7.0,>=4.5
Using cached multidict-6.0.2-cp39-cp39-macosx_10_9_x86_64.whl (28 kB)
Collecting yarl<2.0,>=1.0
Using cached yarl-1.7.2-cp39-cp39-macosx_10_9_x86_64.whl (121 kB)
Collecting attrs>=17.3.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting typing-extensions>=3.6.5
Using cached typing_extensions-4.2.0-py3-none-any.whl (24 kB)
Collecting async-timeout<4.0,>=3.0
Using cached async_timeout-3.0.1-py3-none-any.whl (8.2 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting certifi
Using cached certifi-2022.5.18-py3-none-any.whl (155 kB)
Collecting hstspreload
Using cached hstspreload-2021.12.1-py3-none-any.whl (1.3 MB)
Collecting httpcore==0.9.*
Using cached httpcore-0.9.1-py3-none-any.whl (42 kB)
Collecting sniffio
Using cached sniffio-1.2.0-py3-none-any.whl (10 kB)
Collecting rfc3986<2,>=1.3
Using cached rfc3986-1.5.0-py2.py3-none-any.whl (31 kB)
Collecting idna==2.*
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting importlib-metadata>=3.6.0
Using cached importlib_metadata-4.11.3-py3-none-any.whl (18 kB)
Collecting Werkzeug>=2.0
Using cached Werkzeug-2.1.2-py3-none-any.whl (224 kB)
Collecting Jinja2>=3.0
Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting itsdangerous>=2.0
Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting click>=8.0
Using cached click-8.1.3-py3-none-any.whl (96 kB)
Collecting pytz>dev
Using cached pytz-2022.1-py2.py3-none-any.whl (503 kB)
Collecting future>=0.18.0
Using cached future-0.18.2-py3-none-any.whl
Collecting billiard<4.0,>=3.6.3.0
Using cached billiard-3.6.4.0-py3-none-any.whl (89 kB)
Collecting kombu<4.7,>=4.6.10
Using cached kombu-4.6.11-py2.py3-none-any.whl (184 kB)
Collecting vine==1.3.0
Using cached vine-1.3.0-py2.py3-none-any.whl (14 kB)
Collecting Six
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
Collecting requests-oauthlib<2,>=1.0.0
Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting geographiclib<2,>=1.49
Using cached geographiclib-1.52-py3-none-any.whl (38 kB)
Collecting colorama
Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting tqdm>=4.31.0
Using cached tqdm-4.64.0-py2.py3-none-any.whl (78 kB)
Collecting termcolor
Using cached termcolor-1.1.0-py3-none-any.whl
Collecting trio
Using cached trio-0.20.0-py3-none-any.whl (359 kB)
Collecting argparse
Using cached argparse-1.4.0-py2.py3-none-any.whl (23 kB)
Collecting python-dateutil
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting PySocks
Using cached PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting google-api-core<3.0.0dev,>=1.21.0
Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB)
Collecting httplib2<1dev,>=0.15.0
Using cached httplib2-0.20.4-py3-none-any.whl (96 kB)
Collecting google-auth-httplib2>=0.1.0
Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-auth<3.0.0dev,>=1.16.0
Using cached google_auth-2.6.6-py2.py3-none-any.whl (156 kB)
Collecting uritemplate<5,>=3.0.0
Using cached uritemplate-4.1.1-py2.py3-none-any.whl (10 kB)
Collecting h2==3.*
Using cached h2-3.2.0-py2.py3-none-any.whl (65 kB)
Collecting h11<0.10,>=0.8
Using cached h11-0.9.0-py2.py3-none-any.whl (53 kB)
Collecting hpack<4,>=3.0
Using cached hpack-3.0.0-py2.py3-none-any.whl (38 kB)
Collecting hyperframe<6,>=5.2.0
Using cached hyperframe-5.2.0-py2.py3-none-any.whl (12 kB)
Collecting requests[socks]
Using cached requests-2.27.1-py2.py3-none-any.whl (63 kB)
Collecting stem>=1.4.0
Using cached stem-1.8.0-py3-none-any.whl
Collecting lxml==4.6.3
Using cached lxml-4.6.3-cp39-cp39-macosx_10_9_x86_64.whl (4.6 MB)
Collecting fake-useragent==0.1.11
Using cached fake_useragent-0.1.11-py3-none-any.whl
Collecting rx>=3.0.0
Using cached Rx-3.2.0-py3-none-any.whl (199 kB)
Collecting pyaes
Using cached pyaes-1.6.1-py3-none-any.whl
Collecting lz4
Using cached lz4-4.0.0-cp39-cp39-macosx_10_9_x86_64.whl (90 kB)
Collecting SecretStorage
Using cached SecretStorage-3.3.2-py3-none-any.whl (15 kB)
Collecting keyring
Using cached keyring-23.5.0-py3-none-any.whl (33 kB)
Collecting pycryptodome
Using cached pycryptodome-3.14.1-cp35-abi3-macosx_10_9_x86_64.whl (1.5 MB)
Collecting pbkdf2
Using cached pbkdf2-1.3-py3-none-any.whl
Collecting googleapis-common-protos<2.0dev,>=1.52.0
Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.20.1-cp39-cp39-macosx_10_9_x86_64.whl (962 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.8-py3-none-any.whl (39 kB)
Collecting cachetools<6.0,>=2.0.0
Using cached cachetools-5.1.0-py3-none-any.whl (9.2 kB)
Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting zipp>=0.5
Using cached zipp-3.8.0-py3-none-any.whl (5.4 kB)
Collecting MarkupSafe>=2.0
Using cached MarkupSafe-2.1.1-cp39-cp39-macosx_10_9_x86_64.whl (13 kB)
Collecting amqp<2.7,>=2.6.0
Using cached amqp-2.6.1-py2.py3-none-any.whl (48 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB)
Collecting jeepney>=0.6
Using cached jeepney-0.8.0-py3-none-any.whl (48 kB)
Collecting cryptography>=2.0
Using cached cryptography-37.0.2-cp36-abi3-macosx_10_10_x86_64.whl (2.8 MB)
Collecting outcome
Using cached outcome-1.1.0-py2.py3-none-any.whl (9.7 kB)
Collecting async-generator>=1.9
Using cached async_generator-1.10-py3-none-any.whl (18 kB)
Collecting sortedcontainers
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp39-cp39-macosx_10_9_x86_64.whl (178 kB)
Collecting pyasn1<0.5.0,>=0.4.6
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Building wheels for collected packages: yagooglesearch, search-engine-parser
Building wheel for yagooglesearch (setup.py) ... done
Created wheel for yagooglesearch: filename=yagooglesearch-1.6.0-py3-none-any.whl size=21156 sha256=c50dd87da90c342318b76880e3ddfc248304fb9fb8bd986034e8d3a9514de885
Stored in directory: /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-ephem-wheel-cache-dgxrop_6/wheels/a4/37/83/ae019cec936bec826575dbac8ac111df1481d3c45d2583dbbe
Building wheel for search-engine-parser (setup.py) ... done
Created wheel for search-engine-parser: filename=search_engine_parser-0.6.3-py3-none-any.whl size=37791 sha256=6a873e6307f8de3befe5392d34dc2e63f935e2d7012cdd83a20c271bd3747efc
Stored in directory: /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-ephem-wheel-cache-dgxrop_6/wheels/86/18/9c/ba539308ab34dcf6f3e7b171a9403bbf0cbd04cdc13fd71df2
Successfully built yagooglesearch search-engine-parser
Installing collected packages: termcolor, stop_words, stem, sortedcontainers, rfc3986, pytz, pyasn1, pyaes, pbkdf2, parse, hyperframe, hpack, h11, geographiclib, fuzzywuzzy, fake-useragent, chardet, billiard, argparse, zipp, Werkzeug, vine, urllib3, uritemplate, typing-extensions, tqdm, soupsieve, sniffio, Six, rx, rsa, redis, PySocks, pyparsing, pycryptodome, pycparser, pyasn1-modules, protobuf, oauthlib, multidict, MarkupSafe, lz4, lxml, jeepney, itsdangerous, idna, hstspreload, h2, geopy, future, colorama, click, charset-normalizer, certifi, cachetools, attrs, async-timeout, async-generator, yarl, requests, python-dateutil, outcome, langdetect, Jinja2, importlib-metadata, httplib2, httpcore, googleapis-common-protos, google-auth, cffi, beautifulsoup4, amqp, vaderSentiment, twitch-python, trio, torrequest, spotipy, requests-oauthlib, requests-futures, kombu, keyring, instaloader, httpx, google-auth-httplib2, google-api-core, Flask, emailrep, cryptography, cfscrape, bs4, aiohttp, yagooglesearch, tweepy, socialscan, SecretStorage, search-engine-parser, holehe, googletrans, google-api-python-client, Flask-Cors, celery, browser-cookie3
Successfully installed Flask-2.1.2 Flask-Cors-3.0.9 Jinja2-3.1.2 MarkupSafe-2.1.1 PySocks-1.7.1 SecretStorage-3.3.2 Six-1.16.0 Werkzeug-2.1.2 aiohttp-3.7.4 amqp-2.6.1 argparse-1.4.0 async-generator-1.10 async-timeout-3.0.1 attrs-21.4.0 beautifulsoup4-4.9.3 billiard-3.6.4.0 browser-cookie3-0.14.1 bs4-0.0.1 cachetools-5.1.0 celery-4.4.5 certifi-2022.5.18 cffi-1.15.0 cfscrape-2.1.1 chardet-3.0.4 charset-normalizer-2.0.12 click-8.1.3 colorama-0.4.4 cryptography-37.0.2 emailrep-0.0.4 fake-useragent-0.1.11 future-0.18.2 fuzzywuzzy-0.18.0 geographiclib-1.52 geopy-1.22.0 google-api-core-2.8.0 google-api-python-client-2.33.0 google-auth-2.6.6 google-auth-httplib2-0.1.0 googleapis-common-protos-1.56.1 googletrans-3.0.0 h11-0.9.0 h2-3.2.0 holehe-1.60.2 hpack-3.0.0 hstspreload-2021.12.1 httpcore-0.9.1 httplib2-0.20.4 httpx-0.13.3 hyperframe-5.2.0 idna-2.10 importlib-metadata-4.11.3 instaloader-4.8.1 itsdangerous-2.1.2 jeepney-0.8.0 keyring-23.5.0 kombu-4.6.11 langdetect-1.0.8 lxml-4.6.3 lz4-4.0.0 multidict-6.0.2 oauthlib-3.2.0 outcome-1.1.0 parse-1.19.0 pbkdf2-1.3 protobuf-3.20.1 pyaes-1.6.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pycryptodome-3.14.1 pyparsing-3.0.9 python-dateutil-2.8.2 pytz-2022.1 redis-3.5.3 requests-2.27.0 requests-futures-1.0.0 requests-oauthlib-1.3.1 rfc3986-1.5.0 rsa-4.8 rx-3.2.0 search-engine-parser-0.6.3 sniffio-1.2.0 socialscan-1.4.2 sortedcontainers-2.4.0 soupsieve-2.3.2.post1 spotipy-2.16.1 stem-1.8.0 stop_words-2018.7.23 termcolor-1.1.0 torrequest-0.1.0 tqdm-4.64.0 trio-0.20.0 tweepy-4.5.0 twitch-python-0.0.20 typing-extensions-4.2.0 uritemplate-4.1.1 urllib3-1.26.9 vaderSentiment-3.3.2 vine-1.3.0 yagooglesearch-1.6.0 yarl-1.7.2 zipp-3.8.0

Execution of "python app.py -e prod"

(venv) MAC:backend User$ python app.py -e prod
Starting PROD servers
REDIS serving...
CELERY serving...
Falsk serving...
HTTPD serving...
HTTPD serving...INSIDE
8416:C 19 May 2022 10:24:41.538 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
8416:C 19 May 2022 10:24:41.538 # Redis version=7.0.0, bits=64, commit=00000000, modified=0, pid=8416, just started
8416:C 19 May 2022 10:24:41.538 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
8416:M 19 May 2022 10:24:41.539 * Increased maximum number of open files to 10032 (it was originally set to 256).
8416:M 19 May 2022 10:24:41.539 * monotonic clock: POSIX clock_gettime
.
.-__ ''-._ _.- . . ''-._ Redis 7.0.0 (00000000/0) 64 bit
.- .-```. ```\/ _.,_ ''-._ ( ' , .-` | `, ) Running in standalone mode |`-._`-...-` __...-.-.|'_.-'| Port: 6379 | -. ._ / _.-' | PID: 8416 -._ -._ -./ .-' .-'
|-._-. -.__.-' _.-'_.-'| | -.-._ _.-'_.-' | https://redis.io -._ -._-..-'.-' .-'
|-._-. -.__.-' _.-'_.-'| | -.-._ _.-'_.-' | -._ -._-..-'_.-' _.-'
-._ -..-' _.-'
-._ _.-' -..-'

8416:M 19 May 2022 10:24:41.540 # WARNING: The TCP backlog setting of 511 cannot be enforced because kern.ipc.somaxconn is set to the lower value of 128.
8416:M 19 May 2022 10:24:41.540 # Server initialized
8416:M 19 May 2022 10:24:41.540 * The AOF directory appendonlydir doesn't exist
8416:M 19 May 2022 10:24:41.540 * Loading RDB produced by version 7.0.0
8416:M 19 May 2022 10:24:41.540 * RDB age 79 seconds
8416:M 19 May 2022 10:24:41.540 * RDB memory usage when created 1.47 Mb
8416:M 19 May 2022 10:24:41.540 * Done loading RDB, keys loaded: 1, keys expired: 0.
8416:M 19 May 2022 10:24:41.540 * DB loaded from disk: 0.000 seconds
8416:M 19 May 2022 10:24:41.540 * Ready to accept connections

Serving Flask app 'factories.application' (lazy loading)
Environment: production
WARNING: This is a development server. Do not use it in a production deployment.
Use a production WSGI server instead.
Debug mode: on
Running on http://127.0.0.1:5000 (Press CTRL+C to quit)
Restarting with stat
Starting PROD servers
REDIS serving...
CELERY serving...
Falsk serving...
HTTPD serving...
8424:C 19 May 2022 10:24:42.099 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
8424:C 19 May 2022 10:24:42.099 # Redis version=7.0.0, bits=64, commit=00000000, modified=0, pid=8424, just started
8424:C 19 May 2022 10:24:42.099 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
8424:M 19 May 2022 10:24:42.100 * Increased maximum number of open files to 10032 (it was originally set to 256).
8424:M 19 May 2022 10:24:42.100 * monotonic clock: POSIX clock_gettime
8424:M 19 May 2022 10:24:42.101 # Warning: Could not create server TCP listening socket *:6379: bind: Address already in use
8424:M 19 May 2022 10:24:42.101 # Failed listening on port 6379 (TCP), aborting.
Process httpd:
Traceback (most recent call last):
File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
self.run()
File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/Users/User/Projects/SEC/iky/iKy-pack/backend/app.py", line 44, in httpServer
with socketserver.TCPServer(("", PORT), Handler) as httpd_server:
File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/socketserver.py", line 452, in init
self.server_bind()
File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/socketserver.py", line 466, in server_bind
self.socket.bind(self.server_address)
OSError: [Errno 48] Address already in use
Debugger is active!
Debugger PIN: 113-929-301
/Users/User/Projects/SEC/iky/venv/lib/python3.9/site-packages/fuzzywuzzy/fuzz.py:11: UserWarning: Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning
warnings.warn('Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning')
[2022-05-19 10:24:42,997: DEBUG/MainProcess] | Worker: Preparing bootsteps.
[2022-05-19 10:24:42,999: DEBUG/MainProcess] | Worker: Building graph...
[2022-05-19 10:24:42,999: DEBUG/MainProcess] | Worker: New boot order: {Timer, Hub, Pool, Autoscaler, StateDB, Beat, Consumer}
[2022-05-19 10:24:43,008: DEBUG/MainProcess] | Consumer: Preparing bootsteps.
[2022-05-19 10:24:43,009: DEBUG/MainProcess] | Consumer: Building graph...
[2022-05-19 10:24:43,027: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Agent, Events, Mingle, Gossip, Heart, Tasks, Control, event loop}

-------------- celery@MAC.local v4.4.5 (cliffs)
--- ***** -----
-- ******* ---- macOS-10.15.7-x86_64-i386-64bit 2022-05-19 10:24:43

*** --- * ---
** ---------- [config]
** ---------- .> app: factories.application:0x1035e77f0
** ---------- .> transport: redis://localhost:6379/0
** ---------- .> results: redis://localhost:6379/0
*** --- * --- .> concurrency: 8 (prefork)
-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
--- ***** -----
-------------- [queues]
.> celery exchange=celery(direct) key=celery

[tasks]
. celery.accumulate
. celery.backend_cleanup
. celery.chain
. celery.chord
. celery.chord_unlock
. celery.chunks
. celery.group
. celery.map
. celery.starmap
. modules.darkpass.darkpass_tasks.t_darkpass
. modules.dorks.dorks_tasks.t_dorks
. modules.emailrep.emailrep_tasks.t_emailrep
. modules.fullcontact.fullcontact_tasks.t_fullcontact
. modules.ghostproject.ghostproject_tasks.t_ghostproject
. modules.github.github_tasks.t_github
. modules.gitlab.gitlab_tasks.t_gitlab
. modules.holehe.holehe_tasks.t_holehe
. modules.instagram.instagram_tasks.t_instagram
. modules.keybase.keybase_tasks.t_keybase
. modules.leaklookup.leaklookup_tasks.t_leaklookup
. modules.leaks.leaks_tasks.t_leaks
. modules.linkedin.linkedin_tasks.t_linkedin
. modules.peopledatalabs.peopledatalabs_tasks.t_peopledatalabs
. modules.reddit.reddit_tasks.t_reddit
. modules.search.search_tasks.t_search
. modules.sherlock.sherlock_tasks.t_sherlock
. modules.skype.skype_tasks.t_skype
. modules.socialscan.socialscan_tasks.t_socialscan
. modules.spotify.spotify_tasks.t_spotify
. modules.tiktok.tiktok_tasks.t_tiktok
. modules.tinder.tinder_tasks.t_tinder
. modules.tweetiment.tweetiment_tasks.t_tweetiment
. modules.twitch.twitch_tasks.t_twitch
. modules.twitter.twitter_tasks.t_twitter
. modules.twitter_comparison.twitter_comp_tasks.t_twitter_comp
. modules.twitter_comparison.twitter_info_tasks.t_twitter_info
. modules.usersearch.usersearch_tasks.t_usersearch
. modules.venmo.venmo_tasks.t_venmo

[2022-05-19 10:24:43,046: DEBUG/MainProcess] | Worker: Starting Hub
[2022-05-19 10:24:43,046: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:43,046: DEBUG/MainProcess] | Worker: Starting Pool
/Users/User/Projects/SEC/iky/venv/lib/python3.9/site-packages/fuzzywuzzy/fuzz.py:11: UserWarning: Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning
warnings.warn('Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning')
[2022-05-19 10:24:43,551: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:43,552: DEBUG/MainProcess] | Worker: Starting Consumer
[2022-05-19 10:24:43,552: DEBUG/MainProcess] | Consumer: Starting Connection
[2022-05-19 10:24:43,562: DEBUG/MainProcess] | Worker: Preparing bootsteps.
[2022-05-19 10:24:43,563: DEBUG/MainProcess] | Worker: Building graph...
[2022-05-19 10:24:43,563: DEBUG/MainProcess] | Worker: New boot order: {Timer, Hub, Pool, Autoscaler, Beat, StateDB, Consumer}
[2022-05-19 10:24:43,566: INFO/MainProcess] Connected to redis://localhost:6379/0
[2022-05-19 10:24:43,566: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:43,566: DEBUG/MainProcess] | Consumer: Starting Events
[2022-05-19 10:24:43,573: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:43,573: DEBUG/MainProcess] | Consumer: Starting Mingle
[2022-05-19 10:24:43,573: INFO/MainProcess] mingle: searching for neighbors
[2022-05-19 10:24:43,573: DEBUG/MainProcess] | Consumer: Preparing bootsteps.
[2022-05-19 10:24:43,574: DEBUG/MainProcess] | Consumer: Building graph...
[2022-05-19 10:24:43,596: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Agent, Events, Mingle, Tasks, Control, Heart, Gossip, event loop}

-------------- celery@MAC.local v4.4.5 (cliffs)
--- ***** -----
-- ******* ---- macOS-10.15.7-x86_64-i386-64bit 2022-05-19 10:24:43

*** --- * ---
** ---------- [config]
** ---------- .> app: factories.application:0x10c072820
** ---------- .> transport: redis://localhost:6379/0
** ---------- .> results: redis://localhost:6379/0
*** --- * --- .> concurrency: 8 (prefork)
-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
--- ***** -----
-------------- [queues]
.> celery exchange=celery(direct) key=celery

[tasks]
. celery.accumulate
. celery.backend_cleanup
. celery.chain
. celery.chord
. celery.chord_unlock
. celery.chunks
. celery.group
. celery.map
. celery.starmap
. modules.darkpass.darkpass_tasks.t_darkpass
. modules.dorks.dorks_tasks.t_dorks
. modules.emailrep.emailrep_tasks.t_emailrep
. modules.fullcontact.fullcontact_tasks.t_fullcontact
. modules.ghostproject.ghostproject_tasks.t_ghostproject
. modules.github.github_tasks.t_github
. modules.gitlab.gitlab_tasks.t_gitlab
. modules.holehe.holehe_tasks.t_holehe
. modules.instagram.instagram_tasks.t_instagram
. modules.keybase.keybase_tasks.t_keybase
. modules.leaklookup.leaklookup_tasks.t_leaklookup
. modules.leaks.leaks_tasks.t_leaks
. modules.linkedin.linkedin_tasks.t_linkedin
. modules.peopledatalabs.peopledatalabs_tasks.t_peopledatalabs
. modules.reddit.reddit_tasks.t_reddit
. modules.search.search_tasks.t_search
. modules.sherlock.sherlock_tasks.t_sherlock
. modules.skype.skype_tasks.t_skype
. modules.socialscan.socialscan_tasks.t_socialscan
. modules.spotify.spotify_tasks.t_spotify
. modules.tiktok.tiktok_tasks.t_tiktok
. modules.tinder.tinder_tasks.t_tinder
. modules.tweetiment.tweetiment_tasks.t_tweetiment
. modules.twitch.twitch_tasks.t_twitch
. modules.twitter.twitter_tasks.t_twitter
. modules.twitter_comparison.twitter_comp_tasks.t_twitter_comp
. modules.twitter_comparison.twitter_info_tasks.t_twitter_info
. modules.usersearch.usersearch_tasks.t_usersearch
. modules.venmo.venmo_tasks.t_venmo

[2022-05-19 10:24:43,616: DEBUG/MainProcess] | Worker: Starting Hub
[2022-05-19 10:24:43,616: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:43,616: DEBUG/MainProcess] | Worker: Starting Pool
[2022-05-19 10:24:44,157: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,158: DEBUG/MainProcess] | Worker: Starting Consumer
[2022-05-19 10:24:44,158: DEBUG/MainProcess] | Consumer: Starting Connection
[2022-05-19 10:24:44,171: INFO/MainProcess] Connected to redis://localhost:6379/0
[2022-05-19 10:24:44,171: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,171: DEBUG/MainProcess] | Consumer: Starting Events
[2022-05-19 10:24:44,177: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,177: DEBUG/MainProcess] | Consumer: Starting Mingle
[2022-05-19 10:24:44,177: INFO/MainProcess] mingle: searching for neighbors
[2022-05-19 10:24:44,594: INFO/MainProcess] mingle: all alone
[2022-05-19 10:24:44,594: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,594: DEBUG/MainProcess] | Consumer: Starting Gossip
[2022-05-19 10:24:44,702: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,702: DEBUG/MainProcess] | Consumer: Starting Heart
[2022-05-19 10:24:44,704: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,704: DEBUG/MainProcess] | Consumer: Starting Tasks
[2022-05-19 10:24:44,710: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,710: DEBUG/MainProcess] | Consumer: Starting Control
[2022-05-19 10:24:44,713: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:44,714: DEBUG/MainProcess] | Consumer: Starting event loop
[2022-05-19 10:24:44,714: DEBUG/MainProcess] | Worker: Hub.register Pool...
[2022-05-19 10:24:44,714: INFO/MainProcess] celery@MAC.local ready.
[2022-05-19 10:24:44,714: DEBUG/MainProcess] basic.qos: prefetch_count->32
[2022-05-19 10:24:45,199: INFO/MainProcess] mingle: all alone
[2022-05-19 10:24:45,199: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:45,199: DEBUG/MainProcess] | Consumer: Starting Tasks
[2022-05-19 10:24:45,206: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:45,206: DEBUG/MainProcess] | Consumer: Starting Control
[2022-05-19 10:24:45,209: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:45,209: DEBUG/MainProcess] | Consumer: Starting Heart
[2022-05-19 10:24:45,211: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:45,211: DEBUG/MainProcess] | Consumer: Starting Gossip
[2022-05-19 10:24:45,214: DEBUG/MainProcess] ^-- substep ok
[2022-05-19 10:24:45,214: DEBUG/MainProcess] | Consumer: Starting event loop
[2022-05-19 10:24:45,214: DEBUG/MainProcess] | Worker: Hub.register Pool...
[2022-05-19 10:24:45,215: INFO/MainProcess] celery@MAC.local ready.
[2022-05-19 10:24:45,215: DEBUG/MainProcess] basic.qos: prefetch_count->32
^[[1;2D127.0.0.1 - - [19/May/2022 10:50:56] "GET /styles-es2015.js.map HTTP/1.1" 200 -
127.0.0.1 - - [19/May/2022 10:50:56] code 404, message File not found
127.0.0.1 - - [19/May/2022 10:50:56] "GET /jspdf.node.min.js.map HTTP/1.1" 404 -
127.0.0.1 - - [19/May/2022 10:50:56] "GET /vendor-es2015.js.map HTTP/1.1" 200 -
127.0.0.1 - - [19/May/2022 10:50:56] "GET /main-es2015.js.map HTTP/1.1" 200 -
127.0.0.1 - - [19/May/2022 10:50:56] "GET /app-pages-pages-module-es2015.js.map HTTP/1.1" 200 -
127.0.0.1 - - [19/May/2022 10:51:08] "GET / HTTP/1.1" 200 -
127.0.0.1 - - [19/May/2022 10:51:09] "GET /styles-es2015.js.map HTTP/1.1" 304 -
127.0.0.1 - - [19/May/2022 10:51:09] code 404, message File not found
127.0.0.1 - - [19/May/2022 10:51:09] "GET /jspdf.node.min.js.map HTTP/1.1" 404 -
127.0.0.1 - - [19/May/2022 10:51:09] "GET /vendor-es2015.js.map HTTP/1.1" 304 -
127.0.0.1 - - [19/May/2022 10:51:13] "GET /main-es2015.js.map HTTP/1.1" 304 -
127.0.0.1 - - [19/May/2022 10:51:41] "GET /app-pages-pages-module-es2015.js.map HTTP/1.1" 304 -
8416:M 19 May 2022 11:02:54.256 * 100 changes in 300 seconds. Saving...
8416:M 19 May 2022 11:02:54.256 * Background saving started by pid 9559
9559:C 19 May 2022 11:02:54.259 * DB saved on disk
9559:C 19 May 2022 11:02:54.259 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
8416:M 19 May 2022 11:02:54.357 * Background saving terminated with success

Notes
I saw in the output above: "8424:M 19 May 2022 10:24:42.101 # Failed listening on port 6379 (TCP), aborting."
Therefore checked whether there was a rogue redis still roaming on my machine:
sudo lsof -i:6379
Yielded no results. Redis appears to be started exclusively by the iKY package.

Answer 1 · 2022-08-30T15:39:56.000Z

After execute

python3 app.y -e prod

Try this command

curl -d ‘{“username”:”jpdborgna", "from":"Initial"}' -H "Content-Type: application/json" -X POST http://127.0.0.1:5000/github

The output should be

{
  "from_m": "Initial", 
  "module": "github", 
  "param": "xxx", 
  "task": "8d59905d-ae1f-434d-bde1-2414cbb3e94f"
}

And then run

curl http://127.0.0.1:5000/result/<task_id>

Where task_id is the task variable of the output

Explained in wiki (https://github.com/kennbroorg/iKy/wiki/Backend-through-url)

Send me the output. See you