Make principal web archive capture optional?

Question

Make principal web archive capture optional?

matteocargnelutti opened this issue 2 years ago · 5 comments

Should it be possible to skip the web capture step?

Potential use case: only capturing provenance summary, screenshot, pdf snapshot and video extraction on a given web page?

Answer 1 · 2024-01-25T14:10:13.000Z

Is the idea that it would cut down on the amount of storage?

Answer 2 · 2024-01-25T14:27:52.000Z

I can't address your question, but wanted to say: Nice to see you here, @edsu!

Answer 3 · 2024-01-25T14:54:06.000Z

Hi @edsu!

Is the idea that it would cut down on the amount of storage?

It is more to account for use cases that do not revolve around capturing HTTP exchanges in a WARC.
For example, some users might just want to make a PDF capture or screenshot of a web page using Scoop, and only care about that artifact.

Answer 4 · 2024-01-25T22:19:02.000Z

But don't you need to do the HTTP exchanges to generate the screenshot?

Answer 5 · 2024-01-28T21:17:32.000Z

@edsu Yes and no.

Yes: the HTTP exchanges will pass through the proxy as Scoop navigates to the page to take the screenshot
No: If I am only interested in the screenshot, I don't need to record these HTTP exchanges, and can also skip some intermediate steps, for example some of the browser behaviors.