bladelin/crawler

python is best crawler langage

crawler

python is best crawler tool Those code is from a workshop to learn python cralwer.

TWS_THS_Timetable.py

• 一起查詢台鐵高鐵班次
• lxml
• endpoint :
  • http://www.thsrc.com.tw/tw/TimeTable/SearchResult
  • http://twtraffic.tra.gov.tw/twrail/SearchResult.aspx
• author: Jun

Ptt.py

• ptt 練習
• cookie, lxml
• endpoint : http://www.ptt.cc/bbs/Job/index.html
• author: Jun

auto_snes.py

• 爬rom並突破規則下載
• lxml, download, hack
• endpoint: http://romhustler.net get all roms
• author: Jun

TravelAdvisor.py

• 爬 TravelAdvisor景點
• deep and multiple in lxml
• endpont: http://tripadvisorPath+"/Tourism-g297907-Hualien-Vacations.html
• author:Byron

rate.py

• 爬台銀匯率
• endpont: http://rate.bot.com.tw
• author: Willy