Aiven-Open/gcs-connector-for-apache-kafka

integrationTest Failed

Closed this issue · 6 comments

Deleted user commented

Hello there,
I'm now trying to build gcs-connector-for-apache-kafka.jar and register connector-plugin to kafka.
But I got some issues.

I tried following command:
$ ./gradlew clean integrationTest -PtestGcsBucket=<my-bucket-name>

and I got this error message:

Task :compileIntegrationTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

Task :integrationTest

AvroIntegrationTest > initializationError FAILED
    java.io.IOException at DefaultCredentialsProvider.java:132

AvroParquetIntegrationTest > initializationError FAILED
    java.io.IOException at DefaultCredentialsProvider.java:132

GoogleCredentialsBuilderTest > testDefaultCredentials() FAILED
    java.io.IOException at GoogleCredentialsBuilderTest.java:51

IntegrationTest > initializationError FAILED
    java.io.IOException at DefaultCredentialsProvider.java:132

ParquetIntegrationTest > initializationError FAILED
    java.io.IOException at DefaultCredentialsProvider.java:132

8 tests completed, 5 failed

 Task :integrationTest FAILED

FAILURE: Build failed with an exception.

How can I solve this problem ?

snuyanzin commented

Hi @kimsouce

besides the output you provided below in your gradle output should be something like that

* What went wrong:
Execution failed for task ':integrationTest'.
> There were failing tests. See the report at:  file:///path/to/integration/report/index.html

Could you please to have a look at this file to see what is the issue mentioned there.

One of the possible reasons is absence of GOOGLE_APPLICATION_CREDENTIALS variable, however need to check with actual file report

Deleted user commented

Thanks for reply.

Firstly, I set my bucket that 'allUsers' to be able to create and delete(cause it's just test environment), but do I still need additional credential ?

And here's what the report said :

<h2>Failed tests</h2>
<ul class="linkList">
<li>
<a href="classes/io.aiven.kafka.connect.gcs.AvroIntegrationTest.html">AvroIntegrationTest</a>.
<a href="classes/io.aiven.kafka.connect.gcs.AvroIntegrationTest.html#initializationError">initializationError</a>
</li>
<li>
<a href="classes/io.aiven.kafka.connect.gcs.AvroParquetIntegrationTest.html">AvroParquetIntegrationTest</a>.
<a href="classes/io.aiven.kafka.connect.gcs.AvroParquetIntegrationTest.html#initializationError">initializationError</a>
</li>
<li>
<a href="classes/io.aiven.kafka.connect.gcs.GoogleCredentialsBuilderTest.html">GoogleCredentialsBuilderTest</a>.
<a href="classes/io.aiven.kafka.connect.gcs.GoogleCredentialsBuilderTest.html#testDefaultCredentials()">testDefaultCredentials()</a>
</li>
<li>
<a href="classes/io.aiven.kafka.connect.gcs.IntegrationTest.html">IntegrationTest</a>.
<a href="classes/io.aiven.kafka.connect.gcs.IntegrationTest.html#initializationError">initializationError</a>
</li>
<li>
<a href="classes/io.aiven.kafka.connect.gcs.ParquetIntegrationTest.html">ParquetIntegrationTest</a>.
<a href="classes/io.aiven.kafka.connect.gcs.ParquetIntegrationTest.html#initializationError">initializationError</a>

<td class="failures">
<a href="packages/io.aiven.kafka.connect.gcs.html">io.aiven.kafka.connect.gcs</a>
</td>

<td class="failures">
<a href="classes/io.aiven.kafka.connect.gcs.AvroIntegrationTest.html">io.aiven.kafka.connect.gcs.AvroIntegrationTest</a>
</td>
...
<td class="failures">
<a href="classes/io.aiven.kafka.connect.gcs.AvroParquetIntegrationTest.html">io.aiven.kafka.connect.gcs.AvroParquetIntegrationTest</a>
</td>
...
<td class="failures">
<a href="classes/io.aiven.kafka.connect.gcs.GoogleCredentialsBuilderTest.html">io.aiven.kafka.connect.gcs.GoogleCredentialsBuilderTest</a>
</td>
...
<td class="failures">
<a href="classes/io.aiven.kafka.connect.gcs.IntegrationTest.html">io.aiven.kafka.connect.gcs.IntegrationTest</a>
</td>
...
<td class="failures">
<a href="classes/io.aiven.kafka.connect.gcs.ParquetIntegrationTest.html">io.aiven.kafka.connect.gcs.ParquetIntegrationTest</a>
</td>

I think report said just same as log.

snuyanzin commented

in the report file there are links to stacktraces for different fail tests as you mentioned
e.g.

<a href="classes/io.aiven.kafka.connect.gcs.AvroIntegrationTest.html#initializationError">initializationError</a>

you just need to go (mouse click if you open it with a browser) to see the corresponding stacktrace for the failed test

Deleted user commented

Thanks !!

Deleted user commented

Hello there,

I am trying to install gcs connector in my local ubuntu environment.
However, even if the jar file of the maven repository was installed in the connector plugin path, as a result of checking whether the plugin was installed through the curl command, it was not installed .

Is it possible that the connector cannot be run locally ?

ivanyu commented

@kimsouce could you please open a new ticket for this? I would also ask you to provide some info like the plugin directory structure and the worker configuration