Concurrent file reads

[hiddusk]

Hi,

I am planing to use Streaming Inbound Channel Adapter to read and process files from remote S3 bucket directory
But what I am trying to achieve here is when poller polling and reading same file by two different instances 2nd instance
should ignore file if it is already being used by 1st instance so that 2nd instance ignore in use file and goes to next file.

In this way i am trying to achieve distributed processing here.

Could you please update is there any way to achieve using this library ?

Thanks,

[artembilan]

You need to take a look into an S3PersistentAcceptOnceFileListFilter with a shared MetadataStore implementation.
See docs here: https://docs.spring.io/spring-integration/docs/current/reference/html/system-management.html#metadata-store.
And see DynamoDbMetadataStore implementation to get a shared store on AWS.

Consider to ask questions in the future on StackOverfow.

Thanks