cybertec_migrator: A Shell repository from sachajw

Streamlined Oracle to PostgreSQL migration

Getting Started • Running the Migrator • Contact

CYBERTEC Migrator is a streamlined and user-friendly tool that helps you to organize and efficiently migrate multiple Oracle databases to PostgreSQL. In addition to migrating your data professionally and securely with minimum effort, CYBERTEC Migrator allows you to visually monitor and track the whole process at any time.

Do you want to know if the Migrator can migrate your Oracle database to PostgreSQL? Then get the Migrator Standard Edition, a free version of the CYBERTEC Migrator, follow the offline instructions provided in Getting Started section, and try it out.

The blog article Meet the CYBERTEC Migrator provides a good introduction on how to migrate Oracle's HR demo schema to PostgreSQL. Alternatively, you may want to watch the complementary CYBERTEC Migrator YouTube playlist.

Product Demo

For detailed information see the list of supported migration features for Oracle.

What's New
Getting Started
Running the Migrator
Getting Help
Contact
License

What's New

For older releases see Release Notes.

v3.16.4 - 2023-05-22

Resolved Bugs

Error during data transfer: Failed to connect to database: could not translate host name "@localhost" to address: Name or service not known
Data stage fails if the PostgreSQL username, password or database contain special characters such as @

v3.16.3 - 2023-05-11

Resolved Bugs

Creating a migration for Oracle 23 fails during the Analyze step

v3.16.2 - 2023-05-03

Changes

Drop Docker Compose V1 support (EOL June 2023) in favour of Compose V2

v3.16.1 - 2023-05-02

Resolved Bugs

Creating and cloning a migration may become unresponsive during schema selection

v3.16.0 - 2023-03-29

Features

Migration overview: View the assessed migration effort for each migration alongside performance improvements

Bulk migration creation: Rapidly create a multitude of migrations

Example JSON:

{
  "migrations": [
    {
      "name": "Migration",
      "description": "An optional description",
      "source": {
        "connection_string": "oracle://localhost:1521/pdb1",
        "username": "system",
        "password": "oracle"
      },
      "target": {
        "connection_string": "postgresql://localhost:5432/postgres",
        "username": "postgres",
        "password": "postgres"
      },
      "schema_selection": [
        "TOOLS", "ONLINE_STORE"
      ]
    }
  ]
}

Data transfer prioritization: Customize the order in which tables are transferred
Custom SCN: Force the migrator to use a fixed SCN for the data stage

Other

Removed upper limit when generating table chunks
Removed deprecated C data migrator (and the correlating CORE_DATA_MIGRATOR_USE_RUST environment variable).

Getting Started

Requirements

CYBERTEC Migrator is distributed as a set of container images that are managed with the help of Docker Compose.

docker
docker compose (>= 2.0.0)
git (>= 2.20.1)
bash (>= 4.0)

Migrator Installation

The CYBERTEC Migrator images can be obtained via two channels

Online installation via container registry
From an offline installation package for environments in which networking restrictions are imposed

💡	The Migrator Standard Edition is only available as an offline installation package

Online installation

You need an account on the Docker Hub container image registry.

Please get in touch with us if your account has not been granted access to the respective images. Make sure you are logged in the Docker Hub registry with the correct user.

cat ~/password.txt | docker login --username <username> --password-stdin

Clone this git repository
Change working directory to the previously cloned repository
Generate default configuration
Download and load container images
Generate a self-signed TLS/SSL certificate or install a certificate (see FAQ for more details)
Start the Migrator

➜ git clone https://github.com/cybertec-postgresql/cybertec_migrator
➜ cd cybertec_migrator
➜ ./migrator configure
[OK] Generated environment file
[INFO] Run './migrator install' to complete setup
➜ ./migrator install
[INFO] Pulling v3.16.0
Pulling core_db ... done
Pulling core    ... done
Pulling web_gui ... done
[OK] Pulled v3.16.0
[INFO] Upgraded to v3.16.0
[WARN] Could not find TLS/SSL certificate
[INFO] Run './migrator configure --tls self-signed-cert' to generate a self-signed TLS/SSL certificate
➜ ./migrator configure --tls self-signed-cert
[INFO] Generating self-signed TLS/SSL certificate
Creating cybertec_migrator_web_gui_run ... done
Generating a RSA private key
.+++++
........................+++++
writing new private key to '/etc/nginx/certs/nginx.key'
-----
You are about to be asked to enter information that will be incorporated
into your certificate request.
What you are about to enter is what is called a Distinguished Name or a DN.
There are quite a few fields but you can leave some blank
For some fields there will be a default value,
If you enter '.', the field will be left blank.
-----
Country Name (2 letter code) [AU]:AT
State or Province Name (full name) [Some-State]:Lower Austria
Locality Name (eg, city) []:Wöllersdorf
Organization Name (eg, company) [Internet Widgits Pty Ltd]:CYBERTEC PostgreSQL International GmbH
Organizational Unit Name (eg, section) []:CYBERTEC Solutions
Common Name (e.g. server FQDN or YOUR name) []:
Email Address []:invalid@cybertec.at
Creating cybertec_migrator_web_gui_run ... done
[OK] Generated self-signed TLS/SSL certificate
[INFO] Run './migrator up' to switch to new version
[WARN] Switching will abort running migrations
➜ ./migrator up
Recreating cybertec_migrator_core_db_1 ... done
Recreating cybertec_migrator_core_1    ... done
Recreating cybertec_migrator_web_gui_1 ... done
[OK] Started on 'https://localhost'

Offline installation

Get your Migrator offline installation package. You can get the Migrator Standard Edition here for free.
For the Professional or Enterprise Edition get in touch with us to request download credentials.

Extract the provided archive file
Change working directory to newly created directory
Generate default configuration
Import container images from archive
Generate a self-signed TLS/SSL certificate or install a certificate (see FAQ for more details)
Start the Migrator

➜ tar xf cybertec_migrator-v3.16.0-standard.tar.gz
➜ cd cybertec_migrator
➜ ./migrator configure
[OK] Generated environment file
[INFO] Run './migrator install' to complete setup
➜ ./migrator install --archive ../cybertec_migrator-v3.16.0-standard.tar.gz
[INFO] Extracting upgrade information
Loaded image: cybertecpostgresql/cybertec_migrator-core:v3.16.0-standard
Loaded image: cybertecpostgresql/cybertec_migrator-web_gui:v3.16.0-standard
Loaded image: postgres:13-alpine
[INFO] Extracted upgrade information
[INFO] Upgraded to v3.16.0-standard
[WARN] Could not find TLS/SSL certificate
[INFO] Run './migrator configure --tls self-signed-cert' to generate a self-signed TLS/SSL certificate
➜ ./migrator configure --tls self-signed-cert
[INFO] Generating self-signed TLS/SSL certificate
Creating cybertec_migrator_web_gui_run ... done
Generating a RSA private key
.+++++
........................+++++
writing new private key to '/etc/nginx/certs/nginx.key'
-----
You are about to be asked to enter information that will be incorporated
into your certificate request.
What you are about to enter is what is called a Distinguished Name or a DN.
There are quite a few fields but you can leave some blank
For some fields there will be a default value,
If you enter '.', the field will be left blank.
-----
Country Name (2 letter code) [AU]:AT
State or Province Name (full name) [Some-State]:Lower Austria
Locality Name (eg, city) []:Wöllersdorf
Organization Name (eg, company) [Internet Widgits Pty Ltd]:CYBERTEC PostgreSQL International GmbH
Organizational Unit Name (eg, section) []:CYBERTEC Solutions
Common Name (e.g. server FQDN or YOUR name) []:
Email Address []:invalid@cybertec.at
Creating cybertec_migrator_web_gui_run ... done
[OK] Generated self-signed TLS/SSL certificate
[INFO] Run './migrator up' to switch to new version
[WARN] Switching will abort running migrations
➜ ./migrator up
Recreating cybertec_migrator_core_db_1 ... done
Recreating cybertec_migrator_core_1    ... done
Recreating cybertec_migrator_web_gui_1 ... done
[OK] Started on 'https://localhost'

Running the Migrator

Use your web browser to access the Migrator on the URL shown in the terminal with migrator up. In our example it would be https://localhost.

The configuration provided with this repository starts the CYBERTEC Migrator on the standard HTTPS port. The EXTERNAL_HTTP_PORT variable in the .env file (generated by ./migrator configure) controls the choice of port on which the Migrator is served.

If you don't have access to an Oracle or PostgreSQL database to test the Migrator, use our Migrator demo database environment.

Upgrades

⚠️	Running migrations will be interrupted by applying upgrades

Attention
If you upgrade from a Migrator version previous of 3.11.0 you have to create the TLS/SSL certificate after upgrading to the new version, before restarting the new Migrator.
./migrator update
./migrator upgrade
# Don't forget the create or install a TLS/SSL certificate
./migrator configure --tls self-signed-cert
./migrator up

Online upgrade
1. Update release information
2. Upgrade to newest version
3. Apply upgrade
```
./migrator update
./migrator upgrade
./migrator up
```
Offline upgrade

💡 Installation archives also serve for upgrading the Migrator
1. Update release information
2. Upgrade to version bundled in archive
3. Apply upgrade
```
./migrator update --archive cybertec_migrator-vX.Y.Z.tar.gz
./migrator upgrade --archive cybertec_migrator-vX.Y.Z.tar.gz
./migrator up
```

Getting Help

If you have a questions maybe you want to check the Migrator FAQ. If you can't find the answer there you may have more luck in one of the existing questions.

Raising an issue is encouraged. We have templates to report bugs, requesting a new feature or for general questions.

Customers of the paid Migrator license may use the Migrator Service Desk.

Contact

Sales

License

The content of this repository is under the MIT License in case you have to adapt the deployment to your needs. The CYBERTEC Migrator delivered in the container images uses a proprietary license with an EULA.

sachajw/cybertec_migrator

Table of Contents

What's New

v3.16.4 - 2023-05-22

Resolved Bugs

v3.16.3 - 2023-05-11

Resolved Bugs

v3.16.2 - 2023-05-03

Changes

v3.16.1 - 2023-05-02

Resolved Bugs

v3.16.0 - 2023-03-29

Features

Other

Getting Started

Requirements

Migrator Installation

Online installation

Offline installation

Running the Migrator

Upgrades

Getting Help

Contact

License