Limit page depth of searches
zackkrida opened this issue · 0 comments
zackkrida commented
Problem
As a temporary fix for some performance issues with the Openverse API, we should cap the max page depth to 20. This means that if a search had 40 pages of results users would still be limited to accessing pages 1-20.
Description
This prevents the scenario described here cc-archive/cccatalog-api#565, which has become an increasing problem with the number of users scraping Openverse's dataset, while we make improvements to pagination and dead link elimination.
Alternatives
Additional context
Implementation
- 🙋 I would be interested in implementing this feature.