Page Event Crawler seems to be working no longer
Opened this issue · 9 comments
It seems Facebook changed their page's upcoming events structure severely if my observations are representative.
Example:
https://www.facebook.com/changa.dance/events/?ref=page_internal
If you are not logged in, you only see past events now + even if you are logged in - the data is no longer delivered via html if my analysis is correct so far.
Wow FB is improving their privacy, wooow. And this is very sad at the same time. Aaaaa
Should I archive this repo, or is it worth to fix it?
In my research, it seems that you can't see anything about public events if you are not logged in :( And using your user to crawl (authenticated) is quite dangerous as they can detect it and end up dinging it. Does anybody have a solution? (I wish they had their API in good shape and open to folks ...)
@albionx Thank why we recommend everyone to use a separate Facebook account for crawling. You can create new accounts anytime they ban.
If You want to see future events without log in - You have to use address for mobile browser instead for desktop - m.facebook.com/FANPAGENAME/events
If You want to see future events without log in - You have to use address for mobile browser instead for desktop - m.facebook.com/FANPAGENAME/events
this works when i am using the crawler on my local windows machine, but it does not when i use it on a linux (Ubuntu 20.04) server. I am always prompted to log in first to see information. Is there a setting i am missing?
maybe set or change user-agent, do You use some of Your crawler with cURL?
I could curl m.facebook.com/FANPAGENAME/events but only nearest 5events :(
tried with the user-agent in this code and also with an edge user agent. but on linux i am always promted to log in. cURL doesnt return anything for me for facebook, doesn't matter what facebook url i am using.
I'm sorry guys, I don't really have any ideas what is the problem (have you tried to log in in your normal browser? Does it work?). I'm not actively working on this project, but feel free to submit any PRs.