NASA-PDS/nucleus

Issues

• Deploy Nucleus in Test env

  #89 opened 7 months ago by viviant100
  10

• Support processing data coming from multiple staging buckets with one Airflow environment

  #99 opened 4 months ago by ramesh-maddegoda
  0

• CSS MVP: Deploy Baseline Nucleus for Catalina Sky Survey in Test and Production Environments

  #93 opened 7 months ago by jordanpadams
  6

• Minimize EFS use of Nucleus to reduce the cost and to avoid DataSync related complications

  #96 opened 5 months ago by ramesh-maddegoda
  4

• Nucleus Airflow ECEOperator failed to launch ECS task with error "capacity is unavailable at this time"

  #86 opened 5 months ago by ramesh-maddegoda
  1

• Validate and Load all PDS4 MESSENGER data products with Nucleus

  #54 opened a year ago by jordanpadams
  17

• Deploy Nucleus in Production env

  #90 opened 7 months ago by viviant100
  0

• As a user, I want to store a copy of my archive data in AWS Deep Archive / Glacier

  #73 opened a year ago by jordanpadams
  1

• Implement Warm Backup Storage Solution (Data Backup Plan)

  #91 opened 7 months ago by jordanpadams
  0

• MCP Pilot: Pilot Nucleus Deployment for CSS and MESSENGER MDIS Data

  #66 opened 6 months ago by jordanpadams
  14

• Deploy and Test Nucleus DAG for MESSENGER processing

  #53 opened 6 months ago by jordanpadams
  1

• Remove data from staging S3 bucket at the end of PDS basic use case

  #94 opened 7 months ago by ramesh-maddegoda
  0

• Remove data from EFS at the end of PDS basic use case

  #95 opened 7 months ago by ramesh-maddegoda
  0

• Nucleus Airflow Validate task fails with error while reading data file: For input string: "Infinity"

  #87 opened 7 months ago by ramesh-maddegoda
  1

• Pilot project with IMG processing using Nucleus

  #92 opened 7 months ago by jordanpadams
  0

• Nucleus: Track the DAG processing status of each PDS product for monitoring and troubleshooting

  #88 opened 7 months ago by ramesh-maddegoda
  0

• Nucleus lambda function pds-nucleus-datasync-completion sometimes fails to write copied data file names to Nucleus database

  #83 opened 7 months ago by ramesh-maddegoda
  3

• Use PDS Validate tool with manifest support in Nucleus DAGs for referential integrity validation

  #81 opened 8 months ago by ramesh-maddegoda
  1

• Nucleus documentation is broken

  #76 opened 8 months ago by jordanpadams
  4

• Develop Support For Off-Nominal Data Loads

  #62 opened 9 months ago by jordanpadams
  2

• Support processing of PDS products with fz file format in Nucleus

  #74 opened 9 months ago by ramesh-maddegoda
  9

• Prepare product labels as batches to be processed by Nucleus

  #75 opened 10 months ago by ramesh-maddegoda
  3

• Display the logs of ECS Tasks in Airflow UI

  #77 opened 10 months ago by ramesh-maddegoda
  2

• Support CSS demo

  #71 opened a year ago by tloubrieu-jpl
  3

• Avoid stale data due to race conditions in Nucleus DynamoDb tables used by product completion checker lambda

  #65 opened a year ago by ramesh-maddegoda
  10

• Setting-up MWAA Environment on MCP

  #68 opened a year ago by ramesh-maddegoda
  2

• Implement queuing service for streaming data into Nucleus

  #63 opened a year ago by ramesh-maddegoda
  1

• Work with IMG to connect to S3 Bucket with MESSENGER data

  #52 opened a year ago by jordanpadams
  8

• Manually validate and load MESSENGER MSGRMDS_4001 and MESSDEM_1001 data

  #61 opened a year ago by jordanpadams
  2

• Design queuing service for streaming data into Nucleus

  #60 opened a year ago by jordanpadams
  6

• As a user, I want to notified when actual/projected cost is reaching estimated budget

  #59 opened a year ago by jordanpadams
  0

• Evaluate the ability to create Nucleus workflow using CWL (Common Workflow Language)

  #51 opened a year ago by ramesh-maddegoda
  3

• Develop Logging and Monitoring Strategy

  #38 opened a year ago by jordanpadams
  1

• Determine DAG definition standard

  #41 opened a year ago by jordanpadams
  2

• Operationalize Nucleus for Initial CSS Prototype

  #39 opened a year ago by jordanpadams
  3

• As a user, I want to monitor the pipeline cost

  #26 opened 2 years ago by jordanpadams
  1

• As a user, I want to add a new component to the baseline nucleus workflow

  #25 opened 2 years ago by jordanpadams
  0

• Analyze best way for DAG steps to share data

  #45 opened a year ago by tloubrieu-jpl
  4

• Create a user guide to create new DAGs

  #43 opened a year ago by tloubrieu-jpl
  6

• As a data provider, I want to deliver cloud-native data to Nucleus

  #46 opened a year ago by jordanpadams
  0

• Workflow Manager Utility

  #44 opened a year ago by jordanpadams
  0

• As a user, I want to configure a nucleus pipeline

  #24 opened a year ago by jordanpadams
  3

• As a user, I want to estimate the cost for a new deployment

  #27 opened a year ago by jordanpadams
  3

• Prepare cost model for Nucleus - Considering Amazon Managed Airflow (Amazon MWAA)

  #37 opened 2 years ago by ramesh-maddegoda
  6

• Evaluate the self-managed airflow on AWS EC2

  #35 opened 2 years ago by ramesh-maddegoda
  2

• Evaluate self-managed airflow with ECS and Fargate for Nucleus

  #33 opened 2 years ago by ramesh-maddegoda
  2

• Evaluate options to backup and restore the metadata database and logs of MWAA

  #36 opened 2 years ago by ramesh-maddegoda
  3

• Evaluate the self-managed airflow on AWS EKS

  #34 opened 2 years ago by ramesh-maddegoda
  3

• As a user, I want to know the baseline architecture and deployment

  #29 opened 2 years ago by jordanpadams
  4

• As a user, I want to estimate the cost for a custom/adapted workflow

  #28 opened 2 years ago by jordanpadams
  0