goagentfindip: A Python repository from dusthand

#Introduction

A tiny tool to find google ip for goagent

#License

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/.

#Features:

Scan all possible google's IPs.
Auto sort IP with connection speed, fast ahead.
Print output in your terminal and write to out.txt file.
Add random mechanism to scan.
Analyze webpage content and use SSL to improve IPs' quality.
Show scanning progress!
Fastly lookup.
Python and Python3 support.

#How to run?

    Linux and MAC OS:
        python findip.py or python3 findip.py
        
    Windows:
        Please download python, recommand python3, from the official: 
            https://www.python.org/downloads/
        after install python, double click findip.py. 
        
    (You may need Ctrl+C to stop when you feel IPs enough.)

#Notice:

If you don't want to scan all IPs, please delete some unwanted files in ippool folder, it will scan remain IPs.
You may need modify "thread_number" value, depending on your hardware, to control the ip number parallelly scanning, default: 50.
You may need to modify "ip_max_need" value to get numbers of IPs as you want, default: 250.
If you can get IPs, you can ignore errors when you press Ctrl+C.
This program will sort IPs by elapsed time, fast ahead. Due to random scanning mechanism, those first found IPs are not the fastest. Please don't set ip_max_need to a very small value. To my experience, leave ip_max_need as default or modify it to a greater one, but finally choosing first about 100 IPs to proxy.ini will be nice.
Enjoy!

#Test:

Linux, RAM: 512MB, Single Core, IPs: 250, 50 Parallelly Scanning, Python3.4.

Tested 19 times, elapse time(seconds): 1823, 1513, 1581, 1015, 1010, 833, 782, 844, 484, 961, 1330, 860, 1391, 1157, 515 , 1238, 848, 1703, 1969.

  Linux, RAM: 512MB, Single Core, IPs: 250, 50 Parallelly Scanning, Python3.4
       
time(s) 
  2000 ++------+------+-------+------+-------+------+-------+------+------+A
       +       +      +       +      +       +      +       +      +       +
  1800 A+.................................................................++
       |       :      :       :      :       :      :       :      :   A   |
  1600 ++......A..........................................................++
       |   A   :      :       :      :       :      :       :      :       |
  1400 ++...........................................A.....................++
       |       :      :       :      :       A      :       :      :       |
  1200 ++.......................................................A.........++
       |       :      :       :      :       :      :   A   :      :       |
       |       :  A   :       :      :       :      :       :      :       |
  1000 ++.............A..................A................................++
       |       :      :   A   :  A   :       :   A  :       :      A       |
   800 ++.....................A...........................................++
       |       :      :       :      :       :      :       :      :       |
   600 ++.................................................................++
       +       +      +       +      A       +      +       A      +       +
   400 ++------+------+-------+------+-------+------+-------+------+------++
       0       2      4       6      8       10     12      14     16      18
                                     Count(n)

#FAQ

Many IPs good, but slow speed?

First,

 Free Google App Engine, has it's own limits:

     1. Outgoing/Incoming Bandwidth：1GB/day、56MB/minute

     2. UrlFetch Data Sent/Received：22MB/minute

         Please see: https://cloud.google.com/appengine/docs/quotas
 
 Goagent canceled pagespeed due to Google withdrew pagespeed servers from China.

Second,

 Too many IPs in proxy.ini, will slow down your average speed. I personally thank 
     about 100 IPs will be nice.

However you also can try to find faster IPs by modifying findip.py file:

 begin with 40 line:

     # python3 will use http.client.HTTPSConnection
     if sys.version_info >= (3, 0):
         conn=http.client.HTTPSConnection(ip,timeout=2)
     else:
         conn=httplib.HTTPSConnection(ip,timeout=2)
 
 to smaller timeout value, example here is: 1.5

     # python3 will use http.client.HTTPSConnection
     if sys.version_info >= (3, 0):
         conn=http.client.HTTPSConnection(ip,timeout=1.5)
     else:
         conn=httplib.HTTPSConnection(ip,timeout=1.5)


 and modify join time(about 1.5s greater than timeout above) at line 151, 
 example here is 3.1:

     p.join(4)
 to 
     p.join(3.1)


 This will filter slow IPs, but may need more time.

Enjoy!

Windows hangs or freezes when run this program?

I am sorry, neither do I have solutions, but you can modify thread_number(at line 32) to a smaller value, for example, 25 or 15, and try again.
How to get IPs like files stored in ippool folder?

Those IPs come from below linux command, and extract them to ippool folder.
```
nslookup -q=TXT _netblocks.google.com 8.8.8.8
```
If Google's DNS 8.8.8.8 is blocked by your ISP, please replace 8.8.8.8 to your ISP's DNS.
Why not encrypt ippool's IPs?

It's all most Google's IPs, not GCC IPs, There is no need to encrypt them.
Can you develop an exe for this?

Sorry, I am not a windows program developer, I am just a Linux amateur. Yes, I want to do that, but failed when try to convert py to exe, followed this tutorial http://www.py2exe.org/index.cgi/Tutorial.

dusthand/goagentfindip