data-migration

There are 167 repositories under data-migration topic.

  • goodreads_etl_pipeline

    san089/goodreads_etl_pipeline

    An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

    Language:Python1.4k251224

  • backube/volsync

    Asynchronous data replication for Kubernetes volumes

    Language:Go8301225979

  • kstone-io/kstone

    Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd data, and intelligent diagnosis.

    Language:Go6881945105

  • CrunchyData/pg_parquet

    Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL

    Language:Rust58855530

  • actiontech/dtle

    Distributed Data Transfer Service for MySQL

    Language:Go55833797135

  • apecloud/ape-dts

    ApeCloud's Data Transfer Suite, written in Rust. Provides ultra-fast data replication between MySQL, PostgreSQL, Redis, MongoDB, Kafka and ClickHouse, ideal for disaster recovery (DR) and migration scenarios.

    Language:Rust497616081

  • forcedotcom/SFDX-Data-Move-Utility

    SFDMU is a cutting-edge Salesforce data migration tool for seamless org population from other orgs or CSV files. It handles all CRUD operations on multiple related objects in one go.

    Language:TypeScript4951755582

  • ka8725/migration_data

    Migrate data along with schema migrations in Rails and keep them up to date.

    Language:Ruby36552221

  • prescottprue/fireadmin

    Application for Managing Firebase Applications. Includes support for multiple environments and data migrations

    Language:JavaScript23962039

  • sodafoundation/strato

    SODA Strato (Multi-cloud) project provides a cloud vendor agnostic data management for hybrid cloud, intercloud or intracloud. This project is renamed as 'Strato'

    Language:HTML23322927332

  • statebox/cql

    CQL: Categorical Query Language implementation in Haskell

    Language:Haskell178258715

  • DivineOmega/uxdm

    🔀 UXDM helps developers migrate data from one system or format to another.

    Language:PHP1657209

  • microsoft/DataMigrationTeam

    Repository for the Data Migration Team

    1103211162

  • caosiyang/py-mongo-sync

    Oplog-based data sync tool that synchronizes data from a replica set to another deployment, e.g.: standalone, replica set, and sharded cluster.

    Language:Python10993046

  • benbalter/github_records_archiver

    Backs up a GitHub organization's repositories and all their associated information for archival purposes.

    Language:Ruby1087722

  • forcedotcom/SFDX-Data-Move-Utility-Desktop-App

    The SFDMU GUI Desktop Application is a comprehensive tool for Salesforce data migration between SF environments or importing/exporting CSV data into SF environments. It builds upon the capabilities of the SFDX Data Move Utility Plugin (SFDMU), offering a user-friendly interface for seamless data management tasks.

    Language:JavaScript10117031

  • IBM/mac-ibm-migration-tool

    macOS Utility to facilitate the mass migration of files/apps/preferences between devices.

    Language:Swift1003225

  • TroodInc/trood

    AI-powered CLI for software troubleshooting—detecting and resolving code, dependency, and configuration issues.

    Language:Go567

  • schemamap/schemamap

    Instant batch data import for Postgres

    Language:Rust54131

  • jsphpl/enpass-to-keepass

    Convert an Enpass csv export so it can be imported to a KeePass database using KeePassXC

    Language:Python52446

  • polardb/polardbx-tools

    Tools for PolarDB-X, such as data migration, CSV files import, benchmark, etc.

    Language:Java4241020

  • gagoyal01/mongodb-rdbms-sync

    Bi-directional data sync between Relational Databases (Oracle, MySql) & MongoDB.

    Language:Java4011226

  • jlorente/laravel-data-migrations

    An extension to allow you to separate data migrations from structure migrations

    Language:PHP322411

  • kurt213/mongodb-to-postgresql

    Migrate and replicate data from MongoDB to PostgreSQL in Node.js

    Language:JavaScript30038

  • SAP-samples/commerce-migration-toolkit

    SAP Commerce extensions to support data migrations to SAP Commerce Cloud.

    Language:Java257124

  • mcgizzle/oh-migrations

    Data migrations through implicit function composition at the type-level

    Language:Scala22530

  • skcc321/deploy_pin

    Automate routines before/after deployment

    Language:Ruby194108

  • davidag/tiddlywiki-migrator

    Export tiddlers from a single-file html TiddlyWiki, "classic" or "modern", to Markdown.

    Language:Makefile18225

  • ei-grad/sqlacrossover

    SQLAlchemy-based cross-database migration tool

    Language:Python17312

  • cloudberry-contrib/cbcopy

    Help you migrate from Greenplum(GPDB) to Cloudberry(CBDB)

    Language:Go125105

  • brayandm/backup-manager

    Backup Manager is a self-hosted tool for centralized backup management across various data types and storage servers. It features scheduling, retention policies, encryption, and notifications, offering a robust solution for backups, migrations, and data integrity.

    Language:PHP11100

  • ser94mor/CloudTieringFS

    Policy-Driven Multi-Tier File System

    Language:C101110
  • unlock-mainframe-data-files-on-aws

    aws-samples/unlock-mainframe-data-files-on-aws

    This solution is designed to help you unlock legacy mainframe data by migrating data files from mainframe systems to AWS. By migrating the data, you can make use of the powerful analytics, machine learning, and other services available in AWS to gain insights and make better decisions based on the data.

    Language:Python9511

  • beyondstorage/beyond-tp

    Neutral data migration service

    Language:Dart83464

  • nathadriele/AWS-DMS-task-restart-and-status-checker

    The AWS DMS Task Restart and Status Checker is a Python script designed to restart various AWS Database Migration Service (DMS) tasks and check their status. This script leverages AWS SDK (Boto3) and Mage.ai for DMS task integration and management, ensuring efficient and reliable task handling.

    Language:Python8100

  • nathadriele/redshift-to-s3-unload-dag

    This Airflow DAG automates the process of extracting data from an Amazon Redshift database and unloading it to Amazon S3 in Parquet format. It runs daily, exporting data from the previous day based on a specified query.

    Language:Python710