jenkinsci/docker

every update failes from downloading `plugins/ssh-slaves`

ccppoo opened this issue · 3 comments

Jenkins and plugins versions report

Jenkins: 2.394
OS: Linux - 5.10.16.3-microsoft-standard-WSL2
Java: 11.0.18 - Eclipse Adoptium (OpenJDK 64-Bit Server VM)

ant:481.v7b_09e538fcca
antisamy-markup-formatter:155.v795fb_8702324
apache-httpcomponents-client-4-api:4.5.14-150.v7a_b_9d17134a_5
authentication-tokens:1.4
bootstrap5-api:5.2.1-3
bouncycastle-api:2.27
branch-api:2.1071.v1a_188a_562481
build-timeout:1.28
caffeine-api:2.9.3-65.v6a_47d0f4d1fe
checks-api:1.8.1
cloud-stats:267.v577e3742c282
cloudbees-folder:6.815.v0dd5a_cb_40e0e
command-launcher:90.v669d7ccb_7c31
commons-lang3-api:3.12.0-36.vd97de6465d5b_
commons-text-api:1.10.0-36.vc008c8fcda_7b_
config-file-provider:3.11.1
credentials:1214.v1de940103927
credentials-binding:523.vd859a_4b_122e6
display-url-api:2.3.7
docker-build-step:2.9
docker-commons:1.21
docker-compose-build-step:1.0
docker-java-api:3.2.13-68.va_875df25a_b_45
docker-plugin:1.3.0
docker-swarm:1.11
docker-workflow:563.vd5d2e5c4007f
durable-task:504.vb10d1ae5ba2f
echarts-api:5.4.0-1
email-ext:2.94
font-awesome-api:6.2.1-1
git:5.0.0
git-client:4.1.0
github:1.37.0
github-api:1.303-400.v35c2d8258028
github-branch-source:1701.v00cc8184df93
gradle:2.3
h2-api:1.4.199
icon-shim:3.0.0
instance-identity:142.v04572ca_5b_265
ionicons-api:31.v4757b_6987003
jackson2-api:2.14.2-319.v37853346a_229
jakarta-activation-api:2.0.1-3
jakarta-mail-api:2.0.1-3
javadoc:226.v71211feb_e7e9
javax-activation-api:1.2.0-6
javax-mail-api:1.6.2-9
jaxb:2.3.8-1
jdk-tool:63.v62d2fd4b_4793
jersey2-api:2.39-1
jira:3.9
jjwt-api:0.11.5-77.v646c772fddb_0
jquery3-api:3.6.1-2
jsch:0.1.55.61.va_e9ee26616e7
junit:1177.v90374a_ef4d09
ldap:659.v8ca_b_a_fe79fa_d
m2release:0.16.3
mailer:448.v5b_97805e3767
matrix-auth:3.1.6
matrix-project:785.v06b_7f47b_c631
maven-plugin:3.21
mina-sshd-api-common:2.9.2-50.va_0e1f42659a_a
mina-sshd-api-core:2.9.2-50.va_0e1f42659a_a
okhttp-api:4.10.0-125.v3593b_a_f8c97b_
pam-auth:1.10
pipeline-build-step:486.vd08f550cceee
pipeline-github-lib:38.v445716ea_edda_
pipeline-graph-analysis:202.va_d268e64deb_3
pipeline-groovy-lib:629.vb_5627b_ee2104
pipeline-input-step:466.v6d0a_5df34f81
pipeline-maven:1257.v89e586d3c58c
pipeline-milestone-step:111.v449306f708b_7
pipeline-model-api:2.2118.v31fd5b_9944b_5
pipeline-model-definition:2.2118.v31fd5b_9944b_5
pipeline-model-extensions:2.2118.v31fd5b_9944b_5
pipeline-rest-api:2.31
pipeline-stage-step:305.ve96d0205c1c6
pipeline-stage-tags-metadata:2.2118.v31fd5b_9944b_5
pipeline-stage-view:2.31
plain-credentials:143.v1b_df8b_d3b_e48
plugin-util-api:2.20.0
popper2-api:2.11.6-2
resource-disposer:0.21
scm-api:631.v9143df5b_e4a_a
script-security:1229.v4880b_b_e905a_6
snakeyaml-api:1.33-95.va_b_a_e3e47b_fa_4
ssh-credentials:305.v8f4381501156
ssh-slaves:2.854.v7fd446b_337c9
sshd:3.275.v9e17c10f2571
structs:324.va_f5d6774f3a_d
timestamper:1.22
token-macro:321.vd7cc1f2a_52c8
trilead-api:2.84.v72119de229b_7
variant:59.vf075fe829ccb
workflow-aggregator:590.v6a_d052e5a_a_b_5
workflow-api:1208.v0cc7c6e0da_9e
workflow-basic-steps:1010.vf7a_b_98e847c1
workflow-cps:3624.v43b_a_38b_62b_b_7
workflow-durable-task-step:1234.v019404b_3832a
workflow-job:1282.ve6d865025906
workflow-multibranch:733.v109046189126
workflow-scm-step:400.v6b_89a_1317c9a_
workflow-step-api:639.v6eca_cd8c04a_a_
workflow-support:839.v35e2736cfd5c
ws-cleanup:0.44
yet-another-docker-plugin:0.2.0

What Operating System are you using (both controller, and any agents involved in the problem)?

Windows 10 pro

Windows Docker 20.10.23

WSL : windows store's ubuntu 22.04 LTS

running jenkins as build and deploy server (doing everything at single node)

Reproduction steps

plugin failes to download ssh-slave

Caused: java.io.IOException: Failed to load https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi to /var/jenkins_home/plugins/ssh-slaves.jpi.tmp
	at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:1285)
Caused: java.io.IOException: Failed to download from https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi
	at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:1319)
	at hudson.model.UpdateCenter$DownloadJob._run(UpdateCenter.java:1876)
	at hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:2188)
	at hudson.model.UpdateCenter$DownloadJob.run(UpdateCenter.java:1850)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:121)
	at java.base/java.lang.Thread.run(Thread.java:829)

every update that failed ended up with

Caused: java.io.IOException: Failed to download from https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi

I tried to install SSH Agent 327.v230ecd01f86f plugin but it seems to fail because of ssh-slave plugin.

Internet was fine and checked firewall if there was rules that stops from downloading.

container APT package manager was working fine too.

Expected Results

download plugins and update

Actual Results

socket timeout

Anything else?

Logs from docker contianer

Caused: java.io.IOException: Failed to load https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi to /var/jenkins_home/plugins/ssh-slaves.jpi.tmp
	at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:1285)
Caused: java.io.IOException: Failed to download from https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi
	at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:1319)
	at hudson.model.UpdateCenter$DownloadJob._run(UpdateCenter.java:1876)
	at hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:2188)
	at hudson.model.UpdateCenter$DownloadJob.run(UpdateCenter.java:1850)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:121)
	at java.base/java.lang.Thread.run(Thread.java:829)
2023-03-13 03:08:54.133+0000 [id=131]	INFO	h.m.UpdateCenter$PluginDowngradeJob#run: Starting the downgrade of docker-plugin on behalf of ccppoo
2023-03-13 03:08:54.134+0000 [id=131]	INFO	h.m.UpdateCenter$PluginDowngradeJob#run: Downgrade successful: docker-plugin
2023-03-13 03:09:40.036+0000 [id=22]	INFO	hudson.PluginManager#install: Starting installation of a batch of 1 plugins plus their dependencies
2023-03-13 03:09:40.038+0000 [id=136]	INFO	h.model.UpdateCenter$DownloadJob#run: Starting the installation of ssh-slaves on behalf of ccppoo
2023-03-13 03:09:40.038+0000 [id=136]	INFO	h.m.UpdateCenter$UpdateCenterConfiguration#download: Downloading ssh-slaves
2023-03-13 03:09:46.088+0000 [id=129]	INFO	hudson.model.UpdateCenter#doSafeRestart: Scheduling Jenkins reboot
2023-03-13 03:10:00.122+0000 [id=136]	SEVERE	h.model.UpdateCenter$DownloadJob#run: Failed to install ssh-slaves
java.net.SocketTimeoutException: connect timed out
	at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:412)
	at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:255)
	at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:237)
	at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.base/java.net.Socket.connect(Socket.java:609)
	at java.base/sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:305)
	at java.base/sun.net.NetworkClient.doConnect(NetworkClient.java:177)
	at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:507)
	at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:602)
	at java.base/sun.net.www.protocol.https.HttpsClient.<init>(HttpsClient.java:266)
	at java.base/sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:373)
	at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:207)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1187)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1081)
	at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:193)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1592)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
	at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250)
	at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:1274)
Caused: java.io.IOException: Failed to load https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi to /var/jenkins_home/plugins/ssh-slaves.jpi.tmp
	at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:1285)
Caused: java.io.IOException: Failed to download from https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi
	at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:1319)
	at hudson.model.UpdateCenter$DownloadJob._run(UpdateCenter.java:1876)
	at hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:2188)
	at hudson.model.UpdateCenter$DownloadJob.run(UpdateCenter.java:1850)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:121)
	at java.base/java.lang.Thread.run(Thread.java:829)
2023-03-13 03:10:00.130+0000 [id=137]	INFO	hudson.lifecycle.Lifecycle#onStatusUpdate: Restart in 10 seconds
2023-03-13 03:10:10.130+0000 [id=137]	INFO	hudson.lifecycle.Lifecycle#onStop: Stopping Jenkins as requested by ccppoo
2023-03-13 03:10:10.132+0000 [id=137]	INFO	hudson.lifecycle.Lifecycle#onStatusUpdate: Stopping Jenkins
2023-03-13 03:10:10.144+0000 [id=137]	INFO	jenkins.model.Jenkins$16#onAttained: Started termination
2023-03-13 03:10:10.155+0000 [id=137]	INFO	h.p.b.global.Lifecycle#shutdown: Shutdown complete - Global TimeOut ScheduledExecutorService had 0 tasks pending
2023-03-13 03:10:10.168+0000 [id=137]	INFO	jenkins.model.Jenkins$16#onAttained: Completed termination
2023-03-13 03:10:10.168+0000 [id=137]	INFO	jenkins.model.Jenkins#_cleanUpDisconnectComputers: Starting node disconnection
2023-03-13 03:10:10.212+0000 [id=137]	INFO	jenkins.model.Jenkins#_cleanUpShutdownPluginManager: Stopping plugin manager
2023-03-13 03:10:10.242+0000 [id=137]	INFO	jenkins.model.Jenkins#_cleanUpPersistQueue: Persisting build queue
2023-03-13 03:10:10.254+0000 [id=137]	INFO	jenkins.model.Jenkins#_cleanUpAwaitDisconnects: Waiting for node disconnection completion
2023-03-13 03:10:10.255+0000 [id=137]	INFO	hudson.lifecycle.Lifecycle#onStatusUpdate: Jenkins stopped
Running from: /usr/share/jenkins/jenkins.war
webroot: /var/jenkins_home/war
2023-03-13 03:10:13.826+0000 [id=1]	INFO	winstone.Logger#logInternal: Beginning extraction from war file
2023-03-13 03:10:13.934+0000 [id=1]	WARNING	o.e.j.s.handler.ContextHandler#setContextPath: Empty contextPath
2023-03-13 03:10:14.033+0000 [id=1]	INFO	org.eclipse.jetty.server.Server#doStart: jetty-10.0.13; built: 2022-12-07T20:13:20.134Z; git: 1c2636ea05c0ca8de1ffd6ca7f3a98ac084c766d; jvm 11.0.18+10
2023-03-13 03:10:14.512+0000 [id=1]	INFO	o.e.j.w.StandardDescriptorProcessor#visitServlet: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
2023-03-13 03:10:14.600+0000 [id=1]	INFO	o.e.j.s.s.DefaultSessionIdManager#doStart: Session workerName=node0
2023-03-13 03:10:15.330+0000 [id=1]	INFO	hudson.WebAppMain#contextInitialized: Jenkins home directory: /var/jenkins_home found at: EnvVars.masterEnvVars.get("JENKINS_HOME")
2023-03-13 03:10:15.669+0000 [id=1]	INFO	o.e.j.s.handler.ContextHandler#doStart: Started w.@7ed9ae94{Jenkins v2.387.1,/,file:///var/jenkins_home/war/,AVAILABLE}{/var/jenkins_home/war}
2023-03-13 03:10:15.718+0000 [id=1]	INFO	o.e.j.server.AbstractConnector#doStart: Started ServerConnector@1f59a598{HTTP/1.1, (http/1.1)}{0.0.0.0:8080}
2023-03-13 03:10:15.752+0000 [id=1]	INFO	org.eclipse.jetty.server.Server#doStart: Started Server@3943a2be{STARTING}[10.0.13,sto=0] @2749ms
2023-03-13 03:10:15.760+0000 [id=40]	INFO	winstone.Logger#logInternal: Winstone Servlet Engine running: controlPort=disabled
2023-03-13 03:10:16.085+0000 [id=46]	INFO	jenkins.InitReactorRunner$1#onAttained: Started initialization
2023-03-13 03:10:16.523+0000 [id=83]	INFO	hudson.ClassicPluginStrategy#createPluginWrapper: Plugin yet-another-docker-plugin.jpi is disabled
2023-03-13 03:10:16.549+0000 [id=75]	INFO	hudson.ClassicPluginStrategy#createPluginWrapper: Plugin docker-swarm.jpi is disabled
2023-03-13 03:10:16.585+0000 [id=82]	INFO	jenkins.InitReactorRunner$1#onAttained: Listed all plugins
2023-03-13 03:10:22.732+0000 [id=50]	INFO	jenkins.InitReactorRunner$1#onAttained: Prepared all plugins
2023-03-13 03:10:22.753+0000 [id=92]	INFO	jenkins.InitReactorRunner$1#onAttained: Started all plugins
2023-03-13 03:10:22.758+0000 [id=59]	INFO	jenkins.InitReactorRunner$1#onAttained: Augmented all extensions
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.codehaus.groovy.vmplugin.v7.Java7$1 (file:/var/jenkins_home/war/WEB-INF/lib/groovy-all-2.4.21.jar) to constructor java.lang.invoke.MethodHandles$Lookup(java.lang.Class,int)
WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.vmplugin.v7.Java7$1
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2023-03-13 03:10:23.375+0000 [id=56]	WARNING	o.j.p.d.DockerBuilder$DescriptorImpl#<init>: Docker URL is not set, docker client won't be initialized
2023-03-13 03:10:23.571+0000 [id=56]	INFO	h.p.b.g.GlobalTimeOutConfiguration#load: global timeout not set
2023-03-13 03:10:24.092+0000 [id=73]	INFO	jenkins.InitReactorRunner$1#onAttained: System config loaded
2023-03-13 03:10:24.094+0000 [id=83]	INFO	jenkins.InitReactorRunner$1#onAttained: System config adapted
2023-03-13 03:10:24.137+0000 [id=54]	INFO	jenkins.InitReactorRunner$1#onAttained: Loaded all jobs
2023-03-13 03:10:24.141+0000 [id=79]	INFO	jenkins.InitReactorRunner$1#onAttained: Configuration for all jobs updated
2023-03-13 03:10:24.205+0000 [id=70]	INFO	jenkins.InitReactorRunner$1#onAttained: Completed initialization
2023-03-13 03:10:24.344+0000 [id=32]	INFO	hudson.lifecycle.Lifecycle#onReady: Jenkins is fully up and running

Hi @ccppoo , a Socket Timeout Exception means there had been a network issue.

It's hard to diagnose : at first sight it might be outside your machine (since the APT package manager was working for you in the container) but the causes are multiple and without a TCP Dump it's hard to tell were is the issue coming from.

  • First of all, can you tell us if the error still happens ? (could be a temporary error with the updates.jenkins.io webserver or the underlying mirror where your requests are redirected)
  • If the issue keeps happening, can you share the content of the https://get.jenkins.io/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi?mirrorlist link from your machine? Ideally, captured from a curl request inside the container (curl --silent --show-error --location --output result.html https://get.jenkins.io/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi?mirrorlist => and share result.html)
  • Also, what is the result of curl --verbose --output /dev/null https://updates.jenkins.io/download/plugins/ssh-slaves/2.877.v365f5eb_a_b_eec/ssh-slaves.hpi ?

Hello @ccppoo, do you still have this issue?

@lemeurherve solved! it was due to fIrewall rules that I didn't manage

thanks