jarun/googler

No results from googler when google.com has results

kobuki opened this issue · 1 comments

Running the command below produces no results. Starting the query at google.com does show results.

googler -d -n 1 --json --site animenewsnetwork.com ranmaru

googler version: master (40668c0)

~$ googler -d -n 1 --json --site animenewsnetwork.com ranmaru
[DEBUG] googler version 4.3.2
[DEBUG] Python version 3.7.3
[DEBUG] Platform: Linux-5.4.44-2-pve-x86_64-with-debian-10.9
[DEBUG] Connecting to new host www.google.com
[DEBUG] Opened socket to 216.58.214.228:443
[DEBUG] new_connection completed in 0.028s
[DEBUG] Fetching URL /search?ie=UTF-8&num=1&oe=UTF-8&q=ranmaru+site:animenewsnetwork.com&sei=0RJrK8QFREqw7Cs8VNQPqQ
[DEBUG] Cookie: CONSENT=PENDING+356
[DEBUG] fetch_page completed in 0.632s
[DEBUG] Response body written to '/tmp/googler-response-735b4l8b.html'.
[DEBUG] parse completed in 0.044s
[]

~$ cat /etc/debian_version
10.9

~$ uname -a
Linux xxx 5.4.44-2-pve #1 SMP PVE 5.4.44-2 (Wed, 01 Jul 2020 16:37:57 +0200) x86_64 GNU/Linux

~$ python3 -V
Python 3.7.3

~$ locale
LANG=en_US.UTF-8
LANGUAGE=
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME=C.UTF-8
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

Output gist: https://gist.github.com/kobuki/066d1ea0f4395a656273cbe0625c6547

jarun commented

Please see troubleshooting section 1st point: https://github.com/jarun/googler#troubleshooting

Trying with -n 2 works:

$ googler -d -n 2 --json --site animenewsnetwork.com ranmaru
[DEBUG] googler version 4.3.2
[DEBUG] Python version 3.8.5
[DEBUG] Platform: Linux-5.4.0-70-generic-x86_64-with-glibc2.29
[DEBUG] Connecting to new host www.google.com
[DEBUG] Opened socket to 172.217.163.196:443
[DEBUG] new_connection completed in 0.054s
[DEBUG] Fetching URL /search?ie=UTF-8&num=2&oe=UTF-8&q=ranmaru+site:animenewsnetwork.com&sei=eUWlPZZeT9Sc4_fqB6f4Jw
[DEBUG] Cookie: 1P_JAR=2021-04-09-18
[DEBUG] fetch_page completed in 0.531s
[DEBUG] Response body written to '/tmp/googler-response-e0ov81v5.html'.
[DEBUG] parse completed in 0.018s
[
  {
    "abstract": "The Spring 2021 Preview Guide. Fairy Ranmaru. by The Anime News Network Editorial Team, Apr 8th 2021. How would you rate episode 1 of. Fairy Ranmaru ?",
    "matches": [
      {
        "offset": 37,
        "phrase": "Ranmaru"
      },
      {
        "offset": 141,
        "phrase": "Ranmaru"
      }
    ],
    "title": "Fairy Ranmaru - The Spring 2021 Preview Guide - Anime ...",
    "url": "https://www.animenewsnetwork.com/preview-guide/2021/spring/fairy-ranmaru/.171008"
  }
]