turn comments into json
Opened this issue · 2 comments
fgregg commented
The comments field in the events table looks highly structure. Please turn into a json object.
antidipyramid commented
@fgregg Not all rows in the events table are in key: value
form. For example, some rows have comments with values like Alias
, Proof of service
, or Citation To Discover Assets To POE
.
For each row, we could create a JSON object and stuff any unstructured data into its own field, e.g. Proof of Service
becomes {text: Proof of Service}
. Would that work?
Also, should we make this transformation in the Python scrapers or as part of the SQL import process?
fgregg commented
let's hold off on this for now.