no more crawling without authentication

Question

no more crawling without authentication

Closed this issue a year ago · 9 comments

I think netamto changed something so it is currently not possible to crawl stations or the map without authentication.
Please confirm if you are affected too.

Answer 1 · 2023-12-04T20:48:18.000Z

confirmed - no more crawls
netatmo-crawler.0 | 2023-12-04 21:45:18.135 | warn | Could not work with station 2 - Message: Did not get any values for station xx:xx:xx:2a:d3:ec

netatmo-crawler.0 | 2023-12-04 21:45:16.655 | warn | Could not work with station 1 - Message: Did not get any values for station xx:xx:xx:65:32:32

Answer 2 · 2023-12-04T20:55:20.000Z

Will have a look at it tomorrow

Answer 3 · 2023-12-05T05:54:15.000Z

Either it is a general problem, as the official map doesn't show any stations and gets 403 too, or they disabled the public stations.

Does anyone of you (@passuff, @rtwl21) owns a netatmo station and can check, if the map (with other stations than yours) is available if logged in?

Answer 4 · 2023-12-05T06:12:04.000Z

I've just created an account even though I don't own a station. map is showing stations and links are working. When I use links without prior authentication, I get forwarded to the login page. Case seems clear. Just the question if it stays like this forever... Tobi ***@***.***> schrieb am Di., 5. Dez. 2023, 06:54:

…

Either it is a general problem, as the official map doesn't show any stations and gets 403 too, or they disabled the public stations. Does anyone of you ***@***.*** <https://github.com/passuff>, @rtwl21 <https://github.com/rtwl21>) owns a netatmo station and can check, if the map (with other stations than yours) is available if logged in? — Reply to this email directly, view it on GitHub <#48 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJNPPUNRRFKILRJ5CE4BZILYH2ZJDAVCNFSM6AAAAABAGSQLKWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBQGA3DAMJXGY> . You are receiving this because you were mentioned.Message ID: ***@***.***>

Answer 5 · 2023-12-05T06:53:14.000Z

Ah correct, created an account too and with this, it is working fine.
So it should work without owning a station.

I will wait a little bit if it stays and then will try to find a way to do the login precedure in the adapter.

Answer 6 · 2023-12-05T06:57:33.000Z

Take over the login/ auth/token functionality from Netatmo (non crawler) adapter. It's maybe easier to do the copy cat than trying to reinvent the wheel. Tobi ***@***.***> schrieb am Di., 5. Dez. 2023, 07:53:

…

Ah correct, created an account too and with this, it is working fine. So it should work without owning a station. I will wait a little bit if it stays and then will try to find a way to do the login precedure in the adapter. — Reply to this email directly, view it on GitHub <#48 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJNPPUKVCMR7IF6STS7254DYH3AGJAVCNFSM6AAAAABAGSQLKWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBQGEYTGNBZGM> . You are receiving this because you were mentioned.Message ID: ***@***.***>

Answer 7 · 2023-12-06T12:56:23.000Z

Seems to work again on my side. Can you confirm?

Answer 8 · 2023-12-07T18:30:02.000Z

I can confirm - everything is working again! Tobi ***@***.***> schrieb am Mi., 6. Dez. 2023, 13:56:

…

Seems to work again on my side. Can you confirm? — Reply to this email directly, view it on GitHub <#48 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJNPPUORQZ3JZ7GF6Q4XQJ3YIBTQFAVCNFSM6AAAAABAGSQLKWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBSHAZDOMRZHE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

Answer 9 · 2023-12-07T18:40:39.000Z

Fine! So just a hick up :)