cobbzilla/s3s3mirror

logging is filled with exceptions

Closed this issue · 3 comments

ethangui commented

since there are so many of these stacktrace messages, it is very hard to find the actual status message.

pool-1-thread-40 ERROR: org.cobbzilla.s3s3mirror.KeyCopyJob - unexpected exception copying (try #0) u/b33d6fa7-3564-42d8-9daf-d86e2e9ac6df.png to: u/b33d6fa7-3564-42d8-9daf-d86e2e9ac6df.png: com.amazonaws.AmazonClientException: Unable to execute HTTP request: Connect to media-dev2.trusper.net.s3.amazonaws.com/media-dev2.trusper.net.s3.amazonaws.com/54.240.252.9 timed out
pool-1-thread-15 INFO : com.amazonaws.http.AmazonHttpClient - Unable to execute HTTP request: Connect to media.trusper.net.s3.amazonaws.com/media.trusper.net.s3.amazonaws.com/54.240.252.9 timed out
org.apache.http.conn.ConnectTimeoutException: Connect to media.trusper.net.s3.amazonaws.com/media.trusper.net.s3.amazonaws.com/54.240.252.9 timed out
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:122)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:149)
at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:562)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:415)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:285)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:167)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:2829)
at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:766)
at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:746)
at org.cobbzilla.s3s3mirror.KeyJob.getObjectMetadata(KeyJob.java:33)
at org.cobbzilla.s3s3mirror.KeyCopyJob.run(KeyCopyJob.java:37)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
pool-1-thread-199 INFO : com.amazonaws.http.AmazonHttpClient - Unable to execute HTTP request: Connect to media.trusper.net.s3.amazonaws.com/media.trusper.net.s3.amazonaws.com/54.240.252.9 timed out
org.apache.http.conn.ConnectTimeoutException: Connect to media.trusper.net.s3.amazonaws.com/media.trusper.net.s3.amazonaws.com/54.240.252.9 timed out
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:122)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:149)
at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:562)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:415)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:285)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:167)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:2829)
at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:766)
at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:746)
at org.cobbzilla.s3s3mirror.KeyJob.getObjectMetadata(KeyJob.java:33)
at org.cobbzilla.s3s3mirror.KeyCopyJob.run(KeyCopyJob.java:37)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)

cobbzilla commented

This looks like a connection timeout. Is your network connection is spotty? or that server is spotty? If you can provide more context I'd be happy to investigate further.

ethangui commented

I'm not sure whether this was caused by the network or not.

I've experienced the same exception at two different location with
non-spotty internet.

Also, FWIW, it seems the command was completed at last without no sign of
problems.

So far, this situation can be reproduced repeatedly. I'm happy to provide
any additional information to help track this down.

On Wed, Feb 12, 2014 at 11:32 PM, Jonathan Cobb notifications@github.comwrote:

This looks like a connection timeout. Is your network connection is
spotty? or that server is spotty? If you can provide more context I'd be
happy to investigate further.

Reply to this email directly or view it on GitHubhttps://github.com//issues/22#issuecomment-34954555
.

cobbzilla commented

It's probably working without problems because s3s3mirror supports "retry" on every call to S3. So you're seeing these errors when the connection fails, but whatever command it's trying does eventually succeed. Note that you can use the -r (or --max-retries) argument to set how many times s3s3mirror will retry an operation before giving up. The default is 5.