This act creates a timeline spreadsheet from crawler results. Main usecase is to create a spreadsheet containing changes of some web page in time.
Crawler has to satisfy:
- Returns exactly one page
- Page function result for that page is simple object
For example if output of your crawler is ...
{
"someString": "something",
"someNumber": 123.456
}... and you set this act as finish webhook of that crawler then it creates a key-value store with the name of your crawler and generates following table there in json and csv formats:
| Date | someString | someNumber |
|---|---|---|
| 5.6.2017 22:00:00 | some value at that date | 123.456 |
| 5.6.2017 23:00:00 | some other value | 42 |
| 6.6.2017 00:00:00 | some other value | 2 |
On each run of your crawler the table gets updated.
Webhook to execute this act from crawler is following url: https://api.apify.com/v2/acts/mtrunkat~crawler-timeline/runs?token=[YOUR_API_TOKEN]
As webhook data you can pass json containing 2 properties:
| Name | Type | Description |
|---|---|---|
dontAddNewKeys |
boolean |
If true then new keys found after the first execution are not added into the spreadsheet. |
maxRowsPerPage |
integer |
If set then if max number of rows is exceeded then new spreadsheet gets created. |
Example webhook data:
{
"dontAddNewKeys": true,
"maxRowsPerPage": 10000
}