WI refactor and housecleaning
zstumgoren opened this issue · 0 comments
zstumgoren commented
Related to #64
Needed to update original evictions story
Original source code: https://github.com/Howard-Center-Investigations/evictions/tree/master/scrapers_data/wi_milwaukee
Refactor (or delete?) Wiscourts Site module and class to mirror OdysseySite interface:
- Remove unused imports
- Remove the leading
_
on import ofbase._selenium_site_search_mixin
- Rename class from
WiscourtSite
->WiscourtsSite
to match the module name - Create a wicourts.captcha.CaptchaHelpers class and inherit in
pages.search.SearchPage
- Refactor base selenium code to create
base.selenium_helpers.SeleniumHelpers
and inherit inpages.search.SearchPage
- Update refactored WicourtsSite class:
- Accept
placed_id
in__init__
- Set
self.url
tohttps://wcca.wicourts.gov/advanced.html
in__init__
- Accept
- Create
WicourtsSite.search
method that:- Performs a search by date when dates provided (and case numbers are not provided). Test single day and multiple days)
- Configures selenium (e.g.
headless
anddownload_dir
) - Returns CaseInfo instances containing JSON from caseDetails endpoint
- Performs case number search when
case_numbers
provided (this meets minimal CLI requirements)
- Create
wicourts.runner.Runner
class and integrate with cli.py:- Writes case detail JSON to cache directory
- Add basic test coverage in a
platforms/test_wiscourts_site.py
- Change
wiscourts
towiscourts_site
insites_meta.csv
- Create
WicourtsSite.search_by_date
method that:- Accepts start/end dates (test single day and multiple days)
- Uses only requests when case_details=False
- Uses selenium + requests when case_details=True
- Basic test coverage