datopian/aircan

[Infra] Deploy CKAN + Aircan-connector to DX

hannelita opened this issue · 8 comments

hannelita commented

Acceptance

Tasks

Note The docs for DX are still under development and the steps here may need adjustments/clarification

Following https://gitlab.com/datopian/tech/devops/-/blob/master/dx-rfc-dx-approach.md and https://gitlab.com/datopian/tech/devops/-/issues/163, @Irio helped us to come up with the following list:

  • List the services you want to deploy -- DONE -- using this repo without datapusher
    • CKAN
    • Solr
    • PostgreSQL
  • Fork dx-helm-national-grid -- DONE -- dx-helm-ckan-aircan
  • Delete unused files in /templates
  • Get access to the Google Cloud project datopian-dx (ask Irio or Irakli) -- DONE -- got the access to datopian-dx
  • Connect kubectl with your Google Cloud credentials
gcloud auth login
gcloud container clusters get-credentials
  • Create Argo CD project
    • Install argocd cli locally -- cli_installation
    • Run argocd proj create [project name] pointing to remote argo cd -- created project aircan
  • Push dx-helm-national-grid fork to Gitlab/GitHub -- dx-helm-ckan-aircan
  • Create Argo CD application inside this new project (pointing to the Git repo) -- created app aircan-dev

Before deploying, use Terraform (repo dx-terraform) to create a new PSQL instance -- @Irio we need to add documentation about this step.

mbeilin commented

Currently, we have 2 new repos:

  1. dx-helm-ckan-aircan

  2. cloud-ckan-aircan

We have aircan-dev app deployed in ArgoCD and the portal up and running ckan-aircan-dev. -- not relevant (deployed to old cluster), will be deleted.
There were some blockers, like adding secrets to helm registry, that's fixed now.
The last thing, that I'm currently working on is to seal (encrypt) the secret keys that we are using.

mbeilin commented

Quick update - to get your app deployed to new cluster take a look at last task here about Cloudflare

mbeilin commented

Update - you have to create a PostgresQL instance for your app in GC under datopian-dx project,
there are 2 possible ways for doing that:

  1. Create PostgresQl instance in GC GUI - my choice.

  2. Via dx-terraform

hannelita commented

@mbeilin Shall we give it a try with the newest versions of aircan / aircan-connector? I think if we do that, we'll be able to successfully close this issue

  • 👍1
mbeilin commented

@mbeilin Shall we give it a try with the newest versions of aircan / aircan-connector? I think if we do that, we'll be able to successfully close this issue

@hannelita yes, we can close this issue. There is still the problem with the certificate we created for this site.
I opened a new issue in DevOps.

hannelita commented

Reopening the issue; we'll be able to close it when #66 is completed. We still need to have a summary of how to use DX with Aircan

leomrocha commented

@hannelita

Reopening the issue; we'll be able to close it when #66 is completed. We still need to have a summary of how to use DX with Aircan

#66 is now closed, shall we close this one too then?

hannelita commented

Yes, we can close this issue. Note that several integration tests are broken on Cypress @leomrocha