tomlincr/simSDE

A simulacrum of the NHS Secure Data Environment, to facilitate external code development & testing

simSDE

A simulacrum of the NHS Secure Data Environment, to facilitate education, exploration, external code development and testing.

NB this is unofficial, and not endorsed by NHS England or HDR UK / BHF Data Science Centre.

MVP

1. 🧑‍💻 Environment - Google Colab based for ease of use.
2. 💿 Synthetic data
   1. 🏥 Hospital Episode Statistics Admitted Patient Care: See NHS Digital: Artificial data pilot.

Platform options

• Databricks Community Edition ❌.
  • Doesn't support Git.
• Google Colab. ✅
  • Supports Spark
  • Poor Github integration - can open/save, but can't easily sync.
  • Doesn't persist?
• Github codespaces ❌
  • Flexible but too complex for beginners
  • https://aka.ms/configure-codespace.
  • https://github.com/education/codespaces-project-template-py.
• Local ❌
  • Way too complex for beginners!
  • Environment: pip, conda, ? poetry.
  • Containers: docker, devcontainer.
    • https://github.com/jplane/pyspark-devcontainer.
    • Should be able to manage exactly the same as codespaces?

Roadmap

1. Other HES datasets:
   1. HES OP
   2. HES A&E
   3. HES CC (NB not part of Artificial Data Pilot)
   4. HES MAT (NB not part of Artificial Data Pilot)
2. Synthetic ONS Deaths.
3. Synthetic GDPPR.