GeneralDailyDownload
Summary: A Web-Crawling tool with automated report generation and runlog database.
Built in Phantomjs, Casperjs, C# and XSLT-FO.
Functionality: HTML data fetched by casperjs would be sent back to C# command line program,
in which task settings would be loaded from a config
file, and data would be filtered (invalid xml syntax),
transformed into xml, validated and extracted based on XSLT-FO into a csv file.
The csv file would be emailed to target email list.
The automation is achieved through windows task scheduler running on a server.