b0o/apple-autofill-domains

Suggestion: Add these other Apple/iOS resource URLs to this

varenc opened this issue · 1 comments

Hello! I posted the original URL onto hackernews. It was so cool waking up and seeing this project! I had a similar thought but hadn't thought of using github workflow actions as a free and easy way to track this.

Suggestion: While discovering this I also found a bunch other URLs that also have configuration data. It might be interesting to track their changes as well. Here's all the ones that don't require auth:

[
  "correction_dict_url": "https://cdn.smoot.apple.com/static/static_corrections_dict/20200930/static_corrections_dict.json?version=20200930",
  "crowdsourcing_blacklist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_url",
  "crowdsourcing_whitelist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_url",
  "spotlight_model_resources": "https://cdn.smoot.apple.com/static/spotlight_model_resources/2/spotlight_ml.mpak?version=2",
  "spotlight_stopword.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_stopwords/4/stopwords-en.map?version=4",
  "spotlight_phrase_dictionary.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_phrase_dictionary/4/phrase-dictionary-en-US.map?version=4",
  "silhouette_topic_mapping": "https://cdn.smoot.apple.com/static/silhouette_topic_mapping/5/silhouette_topic_mapping?version=5",
  "silhouette_whitelisted_topics": "https://cdn.smoot.apple.com/static/silhouette_whitelisted_topics/5/silhouette_whitelisted_topics?version=5",
  "silhouette_config": "https://cdn.smoot.apple.com/static/silhouette_config/5/silhouette_config?version=5",
  "dictionary_resources_url": "https://cdn.smoot.apple.com/static/dictionary_resources_url",
]

The .map files are some spotlight models I haven't figured out how to make sense of them. Most of the others are just JSON blobs though.

Also a big caveat: I'm unsure which of these are in current use. Some of them look to be updated more recently, but some are clearly older. Newer versions of iOS might no longer use these.

Cheers!

b0o commented

Oh hey, thank you for posting about this to HN, it’s definitely the kind of thing that piques my interest! I love this idea, I will be improving the way I update the badges in the README and then I’ll start tracking these files.

Out of curiosity, how did you come across these URLs? By inspecting your network traffic?