🚀 AWS Data Pipeline Manager

AWS DataPipeline Manager is an open-source web application that allows you to view, edit, and manage your AWS DataPipeline jobs. With the built-in DataPipeline console being turned off on May 1st, 2023, this project aims to provide a user-friendly alternative for managing your DataPipeline jobs. 📅

Features

List all AWS DataPipeline jobs 📋
View individual pipeline definitions 👀
Edit pipeline definitions ✏️
Create new DataPipeline jobs 🆕

Prerequisites

Node.js >= 14.x 🚀
NPM >= 6.x 📦
An AWS account with DataPipeline access 🔑

Screenshots

Installation

Clone the repository:

git clone https://github.com/HairyDuck/aws-datapipeline-manager.git

Change to the project directory:
```
cd aws-datapipeline-manager
```
Install the required dependencies:
```
npm install
```
Set up your AWS credentials and region in the app.js file:
```
AWS.config.update({
  region: 'your_region',
  accessKeyId: 'your_access_key',
  secretAccessKey: 'your_secret_access_key',
});
```
Replace 'your_region', 'your_access_key', and 'your_secret_access_key' with your AWS credentials.

Usage

Start the application:
```
node app.js
```
By default, the application will run on port 3000. 🚀
Open a web browser and navigate to http://localhost:3000. You can now view, edit, and manage your AWS DataPipeline jobs. 🎉

To Do

Create test coverage 🧪
Implement a CI/CD pipeline for automated testing and deployment 🔁
Migrate to AWS SDK for JavaScript (v3) 🔄
Improve error handling ❌
Display schedule infomation (e.g.Start 2023-04-05 07:16:20 (UTC) End 2024-04-04 07:16:20 (UTC) Period- Runs every 1 day) 📆
Display the current health status 💊
Add buttons to clone, activate, and deactivate a pipeline ⏯️
Improve UI for editing a job ✏️

Contributing

Contributions are welcome! Please feel free to submit a pull request or open an issue for bug reports, feature requests, or any other improvements. 💪

Before contributing, please review our Code of Conduct and Contributing Guidelines.

License

This project is open-source and available under the MIT License. 📝

darx/aws-datapipeline-manager