Production Readiness for Airavata
Closed this issue · 6 comments
Dear @DImuthuUpe thanks for your support so far. I have done a POC with Airavata and we are happy with it. I will need your support to go live
@ushaheu this is great to hear. Yes please keep posting issues as you encounter, them so we all can collectively work on them. If you know of your anticipated load and service level expectations, we have access to infrastructure to do scalability and reliability testing. Some basic profiling ensuring there are no resource leaks will go a long way.
Dear @smarru thanks for your support too. We have about 6000 report files to move, ranging from a few KB to 3GB max. These files will be generated in different directories on the same server and moved to s3 bucket.
@ushaheu Is there a possibility to install a java service (MFT Service) in the server? That is the fastest way to move local data in the server to s3.
Yes can install the MFT Service on the server. However, I was thinking of having a dedicated server for my file mover and then use scp to connect to the server where the files are generated and then move them to s3. Something like an enterprise wide file mover
That's fine. In that case, you need to have following components to be installed on the dedicated server
Java 11 or later
Consul (I'll add configurations for consul server)
MFT Standalone server - This contains both the agent and server API of MFT. You can download it from https://github.com/apache/airavata-mft/releases/download/v0.0.1/Standalone-Service-0.01-bin.zip or build latest from the source
@ushaheu I am closing this ticket as you already have a production set up. Please reopen if you need any other help