stevejenkins/postwhite

Yahoo! IP address page no longer available

jwodder opened this issue · 4 comments

Yahoo!'s list of outbound mailer IP addresses at https://help.yahoo.com/kb/SLN23997.html seems to be no longer available; the URL now redirects to https://help.yahoo.com/kb/account?redirect=true with the message "You have been redirected to this page because the page you requested was not found." The list does not seem to be available anywhere else on Yahoo's site. This problem is likely the cause of #54.

Edit /usr/scr/postwhite/scrape_yahoo

Change line 14: from this yahoo_url="https://help.yahoo.com/kb/SLN23997.html"
to this: yahoo_url="https://postmaster.verizonmedia.com/mail-servers"

Then Change line 44: from this content=content= $(wget $yahoo_url -q -O -)
to this: content=$(wget --user-agent="Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:83.0) Gecko/20100101 Firefox/83.0" $yahoo_url -q -O -)

Works perfect for me :)

Verizon media own AOL and Yahoo and have merged the server resources now :)

For completeness also change:
Line 47 from : content=$(curl -s -L $yahoo_url)
to: content=$(curl -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:83.0) Gecko/20100101 Firefox/83.0" -s -L $yahoo_url)

Nice find, @AdamM-AU

Looks like here is new url with yahoo IPs https://senders.yahooinc.com/outbound-mail-servers/