seoker/s3-transload

GET file from link and upload to AWS S3

s3-transload

A module that pipe network file into AWS S3.

What this module do?

• GET a file from the provide url and stream to S3

Example

var AWS = require('aws-sdk');
var s3 = new AWS.S3({
  accessKeyId: process.env.AWS_S3_ACCESS_KEY_ID,
  secretAccessKey: process.env.AWS_S3_SECRET_ACCESS_KEY,
  region: process.env.AWS_S3_REGION,
  apiVersion: '2006-03-01'
});
var s3Transload = require('s3-transload')(s3);

// url to get the resource
var getUrl = 'http://path/to/the/resource';

var params = {
  Bucket: 'your-bucket-name',
  Key: 'your-item-key',
  ACL: 'public-read'
};

s3Transload.urlToS3(getUrl, params, function(error, data) {
  if (error) {
    return console.log(error);
  }

  console.log('The resource URL on S3 is:', data);
});

Under the hood

• It use request to create stream, and pipe it into s3 upload.
• It will stop and return error if HTTP status code not equal to 200.
• This module is inspire by this SO and this SO