Unable to discover members to form a cluster in kubernetes
kunal-bhatia opened this issue · 5 comments
kunal-bhatia commented
This is in reference of using ehcache jgroups replication with jgroups library for kubernetes, with which it is unable to find the members with specific namespace to form a cluster, not sure if the match interface is correct or missing some variable to be used in the configuration
Dependencies version
<dependency>
<groupId>org.jgroups</groupId>
<artifactId>jgroups</artifactId>
<version>3.6.17.Final</version>
</dependency>
<dependency>
<groupId>org.jgroups.kubernetes</groupId>
<artifactId>kubernetes</artifactId>
<version>0.9.3</version>
</dependency>
<dependency>
<groupId>io.undertow</groupId>
<artifactId>undertow-servlet</artifactId>
<version>1.3.15.Final</version>
</dependency>
tcp.xml
<config xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns="urn:org:jgroups"
xsi:schemaLocation="urn:org:jgroups http://www.jgroups.org/schema/jgroups.xsd">
<TCP
bind_addr="${jgroups.tcp.address:match-interface:en.*}"
bind_port="7800"
recv_buf_size="5M"
send_buf_size="1M"
max_bundle_size="64K"
enable_diagnostics="true"
thread_naming_pattern="cl"
thread_pool.min_threads="0"
thread_pool.max_threads="500"
thread_pool.keep_alive_time="30000" />
<org.jgroups.protocols.kubernetes.KUBE_PING
namespace="${KUBE_NAMESPACE:ehcache-demo}"/>
<MERGE3 max_interval="30000"
min_interval="10000"/>
<VERIFY_SUSPECT timeout="1500"/>
<BARRIER />
<pbcast.NAKACK2 xmit_interval="500"
xmit_table_num_rows="100"
xmit_table_msgs_per_row="2000"
xmit_table_max_compaction_time="30000"
use_mcast_xmit="false"
discard_delivered_msgs="true" />
<UNICAST3
xmit_table_num_rows="100"
xmit_table_msgs_per_row="1000"
xmit_table_max_compaction_time="30000"/>
<pbcast.STABLE stability_delay="1000" desired_avg_gossip="50000"
max_bytes="8m"/>
<pbcast.GMS print_local_addr="true" join_timeout="3000"
view_bundling="true"/>
<MFC max_credits="2M"
min_threshold="0.4"/>
<FRAG2 frag_size="60K" />
<pbcast.STATE_TRANSFER />
<CENTRAL_LOCK />
<COUNTER/>
</config>
K8s Manifests
apiVersion: v1
kind: Namespace
metadata:
name: ehcache-demo
spec: {}
---
apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
name: ehcache-demo
namespace: ehcache-demo
rules:
- apiGroups:
- ""
resources:
- pods
verbs:
- get
- list
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: ehcache-demo
namespace: ehcache-demo
---
apiVersion: rbac.authorization.k8s.io/v1
kind: RoleBinding
metadata:
name: ehcache-demo
namespace: ehcache-demo
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: Role
name: ehcache-demo
subjects:
- kind: ServiceAccount
name: ehcache-demo
namespace: ehcache-demo
---
apiVersion: apps/v1
kind: Deployment
metadata:
labels:
app: ehcache-demo
name: ehcache-demo
namespace: ehcache-demo
spec:
replicas: 2
selector:
matchLabels:
app: ehcache-demo
strategy: {}
template:
metadata:
labels:
app: ehcache-demo
spec:
serviceAccountName: ehcache-demo
containers:
- image: <some_repo>/ehcache-demo:1.0.10
name: ehcache-demo
---
apiVersion: v1
kind: Service
metadata:
labels:
app: ehcache-demo
name: ehcache-demo
namespace: ehcache-demo
spec:
ports:
- name: 5678-8080
port: 5678
protocol: TCP
targetPort: 8080
selector:
app: ehcache-demo
type: NodePort
Logs from the pods (refer to my_view)
07:02:50.012 [main] DEBUG n.s.e.d.j.JGroupsBootstrapCacheLoaderFactory - Creating JGroups BootstrapCacheLoader with configuration:
ehcache-demo-cb44bbf88-nvg4w ehcache-demo {bootstrapAsynchronously=false}
ehcache-demo-cb44bbf88-nvg4w ehcache-demo
ehcache-demo-cb44bbf88-nvg4w ehcache-demo -------------------------------------------------------------------
ehcache-demo-cb44bbf88-nvg4w ehcache-demo GMS: address=ehcache-demo-cb44bbf88-nvg4w-32543, cluster=EH_CACHE, physical address=fe80:0:0:0:b8e9:70ff:fedb:9c30%eth0:7800
ehcache-demo-cb44bbf88-nvg4w ehcache-demo -------------------------------------------------------------------
ehcache-demo-cb44bbf88-nvg4w ehcache-demo 07:02:51.485 [main] DEBUG org.jgroups.ping.kube.Client - getPods(ehcache-demo, null) = [Pod[podIP=100.96.16.64, containers=[]], Pod[podIP=100.96.6.51, containers=[]]]
ehcache-demo-cb44bbf88-nvg4w ehcache-demo 07:02:54.507 [main] INFO n.s.e.d.j.JGroupsCacheManagerPeerProvider - JGroups Replication started for 'EH_CACHE'. JChannel: local_addr=ehcache-demo-cb44bbf88-nvg4w-32543
ehcache-demo-cb44bbf88-nvg4w ehcache-demo cluster_name=EH_CACHE
ehcache-demo-cb44bbf88-nvg4w ehcache-demo my_view=[ehcache-demo-cb44bbf88-nvg4w-32543|0] (1) [ehcache-demo-cb44bbf88-nvg4w-32543]
ehcache-demo-cb44bbf88-nvg4w ehcache-demo state=CONNECTED
ehcache-demo-cb44bbf88-nvg4w ehcache-demo discard_own_messages=true
ehcache-demo-cb44bbf88-nvg4w ehcache-demo state_transfer_supported=true
ehcache-demo-cb44bbf88-nvg4w ehcache-demo props=TCP(discard_incompatible_packets=true;internal_thread_pool_min_threads=2;internal_thread_pool_keep_alive_time=30000;time_service_interval=500;thread_pool_max_threads=500;internal_thread_pool_queue_enabled=true;ergonomics=true;enable_unicast_bundling=true;port_range=50;conn_expire_time=0;recv_buf_size=5000000;loopback_copy=false;thread_naming_pattern=cl;internal_thread_pool_rejection_policy=abort;internal_thread_pool_enabled=true;send_buf_size=1000000;tcp_nodelay=true;stats=true;oob_thread_pool_enabled=true;oob_thread_pool_rejection_policy=abort;suppress_time_different_version_warnings=60000;id=75;thread_pool_rejection_policy=abort;logical_addr_cache_max_size=2000;suppress_time_different_cluster_warnings=60000;use_send_queues=false;loopback=true;timer_rejection_policy=abort;sock_conn_timeout=2000;oob_thread_pool_min_threads=2;client_bind_port=0;bundler_num_spins=40;send_queue_size=2000;max_bundle_timeout=20;enable_diagnostics=true;internal_thread_pool_max_threads=4;external_port=0;oob_thread_pool_max_threads=10;no_bundler_pool_size=10;log_discard_msgs=true;name=TCP;oob_thread_pool_keep_alive_time=30000;bind_addr=fe80:0:0:0:b8e9:70ff:fedb:9c30%eth0;wheel_size=200;bundler_capacity=16384;log_discard_msgs_version=true;defer_client_bind_addr=false;enable_batching=true;tick_time=50;timer_max_threads=4;thread_pool_queue_enabled=true;enable_bundling=true;oob_thread_pool_queue_enabled=false;thread_pool_keep_alive_time=30000;bind_port=7800;thread_pool_min_threads=0;ignore_dont_bundle=true;reaper_interval=0;bind_interface_str=;diagnostics_ttl=8;loopback_separate_thread=true;logical_addr_cache_expiration=120000;peer_addr_read_timeout=1000;oob_thread_pool_queue_max_size=500;linger=-1;diagnostics_addr=ff0e:0:0:0:0:0:75:75;receive_on_all_interfaces=false;internal_thread_pool_queue_max_size=500;timer_queue_max_size=500;thread_pool_queue_max_size=10000;no_bundler_initial_buf_size=512;max_bundle_size=64000;physical_addr_max_fetch_attempts=1;timer_min_threads=2;thread_pool_enabled=true;bundler_type=transfer-queue;timer_keep_alive_time=5000;logical_addr_cache_reaper_interval=60000;timer_type=new3;diagnostics_port=7500;who_has_cache_timeout=2000)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :kubernetes.KUBE_PING(async_discovery_use_separate_thread_per_request=false;ergonomics=true;serverPort=8888;saTokenFile=/var/run/secrets/kubernetes.io/serviceaccount/token;timeout=3000;send_cache_on_join=false;apiVersion=v1;num_initial_srv_members=0;break_on_coord_rsp=true;stats=true;use_disk_cache=false;connectTimeout=5000;num_initial_members=10;operationSleep=1000;caCertFile=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt;discovery_rsp_expiry_time=60000;id=2011;stagger_timeout=0;force_sending_discovery_rsps=true;async_discovery=false;clientKeyAlgo=RSA;masterPort=0;always_send_physical_addr_with_discovery_request=true;max_members_in_discovery_request=500;readTimeout=30000;namespace=ehcache-demo;name=KUBE_PING;return_entire_cache=false;operationAttempts=3)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :MERGE3(check_interval=48000;stats=true;min_interval=10000;ergonomics=true;name=MERGE3;id=54;max_participants_in_merge=100;max_interval=30000;only_coords_run_consistency_checker=false)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :VERIFY_SUSPECT(num_msgs=1;use_mcast_rsps=false;bind_interface_str=;stats=true;ergonomics=true;name=VERIFY_SUSPECT;bind_addr=fe80:0:0:0:b8e9:70ff:fedb:9c30%eth0;id=13;timeout=1500;use_icmp=false)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :BARRIER(flush_timeout=5000;stats=true;ergonomics=true;max_close_time=60000;name=BARRIER;id=0)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :pbcast.NAKACK2(resend_last_seqno_max_times=1;use_mcast_xmit=false;ergonomics=true;xmit_table_msgs_per_row=2000;xmit_table_max_compaction_time=30000;become_server_queue_size=50;xmit_interval=500;print_stability_history_on_failed_xmit=false;resend_last_seqno=true;max_xmit_req_size=511600;discard_delivered_msgs=true;suppress_time_non_member_warnings=60000;max_msg_batch_size=100;xmit_table_num_rows=100;stats=true;xmit_from_random_member=false;log_discard_msgs=true;log_not_found_msgs=true;xmit_table_resize_factor=1.2;name=NAKACK2;id=57;max_rebroadcast_timeout=2000;use_mcast_xmit_req=false)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :UNICAST3(ergonomics=true;xmit_table_msgs_per_row=1000;xmit_table_max_compaction_time=30000;ack_threshold=5;sync_min_interval=2000;max_retransmit_time=60000;xmit_interval=500;max_xmit_req_size=511600;conn_close_timeout=10000;max_msg_batch_size=500;conn_expiry_timeout=120000;ack_batches_immediately=true;xmit_table_num_rows=100;stats=true;xmit_table_resize_factor=1.2;log_not_found_msgs=true;name=UNICAST3;id=64)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :pbcast.STABLE(cap=0.1;stability_delay=0;stats=true;ergonomics=true;name=STABLE;desired_avg_gossip=50000;max_bytes=8000000;id=16;send_stable_msgs_to_coord_only=true)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :pbcast.GMS(max_join_attempts=10;print_local_addr=true;handle_concurrent_startup=true;view_bundling=true;leave_timeout=1000;log_view_warnings=true;install_view_locally_first=true;ergonomics=true;use_delta_views=true;resume_task_timeout=20000;use_flush_if_present=true;print_physical_addrs=true;join_timeout=3000;view_ack_collection_timeout=2000;stats=true;num_prev_views=10;merge_timeout=5000;max_bundling_time=50;name=GMS;num_prev_mbrs=50;id=14;log_collect_msgs=false;membership_change_policy=org.jgroups.protocols.pbcast.GMS$DefaultMembershipPolicy@23ee2ccf)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :MFC(min_threshold=0.4;stats=true;ergonomics=true;max_credits=2000000;name=MFC;min_credits=800000;id=44;max_block_time=500;ignore_synchronous_response=false)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :FRAG2(frag_size=60000;stats=true;ergonomics=true;name=FRAG2;id=5)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :pbcast.STATE_TRANSFER(stats=true;ergonomics=true;name=STATE_TRANSFER;id=17)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :CENTRAL_LOCK(stats=true;ergonomics=true;use_thread_id_for_lock_owner=true;name=CENTRAL_LOCK;id=50;num_backups=1;bypass_bundling=true;lock_striping_size=10)
ehcache-demo-cb44bbf88-nvg4w ehcache-demo :COUNTER(stats=true;ergonomics=true;name=COUNTER;id=53;reconciliation_timeout=10000;timeout=60000;num_backups=1;bypass_bundling=true)
belaban commented
It's likely you don't have a network interface starting with en. Running ifconfig will show you the available interfaces.
If you provide me a fully working YAML file (without <some repo>), I'll take a look.
Also, you're picking an IPv6 address, which is probably incorrect.
belaban commented
One thing to try out is to see if you have permissions, see https://github.com/jgroups-extras/jgroups-kubernetes#Demo for details
kunal-bhatia commented
Thanks for a quick response, I changed to use the eth0 interface as per the ifconfig command result, and also explicitly specified to use the ipv4 stack using the java tooling options, but still looks the my_view does not show the other member in the cluster. Do i need to use the clusterrole instead of role.?
logs from the console
stern -n ehcache-demo ehcache-demo
+ ehcache-demo-c5c5dbcc7-jr2c2 › ehcache-demo
+ ehcache-demo-c5c5dbcc7-88p75 › ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo Picked up JAVA_TOOL_OPTIONS: -Xmx512m -Xms512m -Djava.net.preferIPv4Stack=true
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,597 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,598 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,599 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/app/logback.xml]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,716 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,717 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,724 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [CONSOLE]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,792 |-WARN in ch.qos.logback.core.ConsoleAppender[CONSOLE] - This appender no longer admits a layout as a sub-component, set an encoder instead.
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,792 |-WARN in ch.qos.logback.core.ConsoleAppender[CONSOLE] - To ensure compatibility, wrapping your layout in LayoutWrappingEncoder.
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,792 |-WARN in ch.qos.logback.core.ConsoleAppender[CONSOLE] - See also http://logback.qos.ch/codes.html#layoutInsteadOfEncoder for details
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.tutorial] to DEBUG
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.tutorial] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[com.tutorial]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [io.undertow] to TRACE
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [io.undertow] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[io.undertow]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.jgroups] to TRACE
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,793 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.jgroups] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[org.jgroups]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [net.sf.ehcache] to INFO
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [net.sf.ehcache] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[net.sf.ehcache]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [net.sf.ehcache.distribution.jgroups] to TRACE
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [net.sf.ehcache.distribution.jgroups] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[net.sf.ehcache.distribution.jgroups]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.jgroups.ping] to DEBUG
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.jgroups.ping] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[org.jgroups.ping]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.jgroups.ping.common] to INFO
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.jgroups.ping.common] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[org.jgroups.ping.common]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to ERROR
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[ROOT]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,794 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,796 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1a04f701 - Registering current configuration as safe fallback point
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo Picked up JAVA_TOOL_OPTIONS: -Xmx512m -Xms512m -Djava.net.preferIPv4Stack=true
ehcache-demo 08:54:03.801 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Running boot with SPRING_PROFILES_ACTIVE=null
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03.816 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Some environment data: jvm=11.0.3+1-Debian-1bpo91, processors=1, max-memory=0.48 GB, JAVA_TOOL_OPTIONS=-Xmx512m -Xms512m -Djava.net.preferIPv4Stack=true, SPRING_CONFIG_LOCATION=null, pid=1.
ehcache-demo 08:54:02,950 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:02,951 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:02,953 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/app/logback.xml]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,100 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demoehcache-demo-c5c5dbcc7-jr2c2 . ____ _ __ _ _
ehcache-demo 08:54:03,100 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
ehcache-demo 08:54:03,106 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [CONSOLE]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,171 |-WARN in ch.qos.logback.core.ConsoleAppender[CONSOLE] - This appender no longer admits a layout as a sub-component, set an encoder instead.
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo-c5c5dbcc7-88p75 ehcache-demo ehcache-demo 08:54:03,171 |-WARN in ch.qos.logback.core.ConsoleAppender[CONSOLE] - To ensure compatibility, wrapping your layout in LayoutWrappingEncoder.
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo ' |____| .__|_| |_|_| |_\__, | / / / /
ehcache-demo-c5c5dbcc7-jr2c2ehcache-demo-c5c5dbcc7-88p75 ehcache-demo =========|_|==============|___/=/_/_/_/
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,171 |-WARN in ch.qos.logback.core.ConsoleAppender[CONSOLE] - See also http://logback.qos.ch/codes.html#layoutInsteadOfEncoder for details
ehcache-demo :: Spring Boot :: (v2.1.5.RELEASE)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:04.254 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Starting EhcacheJgroupsDemoApplication on ehcache-demo-c5c5dbcc7-88p75 with PID 1 (/app started by root in /)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,172 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.tutorial] to DEBUG
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:04.254 [main] DEBUG c.t.k.e.d.EhcacheJgroupsDemoApplication - Running with Spring Boot v2.1.5.RELEASE, Spring v5.1.7.RELEASE
ehcache-demo 08:54:03,172 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.tutorial] to false
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:04.254 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - No active profile set, falling back to default profiles: default
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:05.883 [main] DEBUG c.t.k.e.d.j.JGroupsCacheManagerPeerProviderFactory - Creating JGroups CacheManagerPeerProvider for __DEFAULT__ with configuration file: file:/app/jgroups/tcp.xml
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo ehcache-demo 08:54:03,172 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[com.tutorial]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,172 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [io.undertow] to TRACE
08:54:05.913 [main] DEBUG n.s.e.d.j.JGroupsCacheReplicatorFactory - Creating JGroups CacheEventListener with configuration: {replicateAsynchronously=false, replicateUpdatesViaCopy=false, replicateRemovals=true, replicatePuts=true, replicateUpdates=true}
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:05.914 [main] DEBUG n.s.e.d.j.JGroupsBootstrapCacheLoaderFactory - Creating JGroups BootstrapCacheLoader with configuration:
ehcache-demo ehcache-demo-c5c5dbcc7-88p75 ehcache-demo {bootstrapAsynchronously=false}
08:54:03,172 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [io.undertow] to false
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:03,172 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[io.undertow]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:06.107 [main] DEBUG io.undertow - starting undertow server io.undertow.Undertow@bb3ecfe
ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.jgroups] to TRACE
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo WARNING: An illegal reflective access operation has occurred
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo-c5c5dbcc7-88p75 ehcache-demo WARNING: Illegal reflective access by org.xnio.nio.NioXnio$2 (file:/app/lib/xnio-nio-3.3.8.Final.jar) to constructor sun.nio.ch.EPollSelectorProvider()
ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.jgroups] to false
ehcache-demo-c5c5dbcc7-88p75ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[org.jgroups]
ehcache-demo WARNING: Please consider reporting this to the maintainers of org.xnio.nio.NioXnio$2
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [net.sf.ehcache] to INFO
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [net.sf.ehcache] to false
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[net.sf.ehcache]
ehcache-demo WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo WARNING: All illegal access operations will be denied in a future release
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:06.149 [main] DEBUG io.undertow - Configuring listener with protocol HTTP for interface 0.0.0.0 and port 8888
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo -------------------------------------------------------------------
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo GMS: address=ehcache-demo-c5c5dbcc7-88p75-8758, cluster=EH_CACHE, physical address=100.96.9.38:7800
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo -------------------------------------------------------------------
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:07.472 [main] DEBUG org.jgroups.ping.kube.Client - getPods(ehcache-demo, null) = [Pod[podIP=100.96.9.38, containers=[]], Pod[podIP=100.96.6.64, containers=[]], Pod[podIP=100.96.16.74, containers=[]]]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:10.492 [main] INFO n.s.e.d.j.JGroupsCacheManagerPeerProvider - JGroups Replication started for 'EH_CACHE'. JChannel: local_addr=ehcache-demo-c5c5dbcc7-88p75-8758
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo cluster_name=EH_CACHE
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo my_view=[ehcache-demo-c5c5dbcc7-88p75-8758|0] (1) [ehcache-demo-c5c5dbcc7-88p75-8758]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo state=CONNECTED
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo discard_own_messages=true
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo state_transfer_supported=true
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo props=TCP(discard_incompatible_packets=true;internal_thread_pool_min_threads=2;internal_thread_pool_keep_alive_time=30000;time_service_interval=500;thread_pool_max_threads=500;internal_thread_pool_queue_enabled=true;ergonomics=true;enable_unicast_bundling=true;port_range=50;conn_expire_time=0;recv_buf_size=5000000;loopback_copy=false;thread_naming_pattern=cl;internal_thread_pool_rejection_policy=abort;internal_thread_pool_enabled=true;send_buf_size=1000000;tcp_nodelay=true;stats=true;oob_thread_pool_enabled=true;oob_thread_pool_rejection_policy=abort;suppress_time_different_version_warnings=60000;id=75;thread_pool_rejection_policy=abort;logical_addr_cache_max_size=2000;suppress_time_different_cluster_warnings=60000;use_send_queues=false;loopback=true;timer_rejection_policy=abort;sock_conn_timeout=2000;oob_thread_pool_min_threads=2;client_bind_port=0;bundler_num_spins=40;send_queue_size=2000;max_bundle_timeout=20;enable_diagnostics=true;internal_thread_pool_max_threads=4;external_port=0;oob_thread_pool_max_threads=10;no_bundler_pool_size=10;log_discard_msgs=true;name=TCP;oob_thread_pool_keep_alive_time=30000;bind_addr=100.96.9.38;wheel_size=200;bundler_capacity=16384;log_discard_msgs_version=true;defer_client_bind_addr=false;enable_batching=true;tick_time=50;timer_max_threads=4;thread_pool_queue_enabled=true;enable_bundling=true;oob_thread_pool_queue_enabled=false;thread_pool_keep_alive_time=30000;bind_port=7800;thread_pool_min_threads=0;ignore_dont_bundle=true;reaper_interval=0;bind_interface_str=;diagnostics_ttl=8;loopback_separate_thread=true;logical_addr_cache_expiration=120000;peer_addr_read_timeout=1000;oob_thread_pool_queue_max_size=500;linger=-1;diagnostics_addr=224.0.75.75;receive_on_all_interfaces=false;internal_thread_pool_queue_max_size=500;timer_queue_max_size=500;thread_pool_queue_max_size=10000;no_bundler_initial_buf_size=512;max_bundle_size=64000;physical_addr_max_fetch_attempts=1;timer_min_threads=2;thread_pool_enabled=true;bundler_type=transfer-queue;timer_keep_alive_time=5000;logical_addr_cache_reaper_interval=60000;timer_type=new3;diagnostics_port=7500;who_has_cache_timeout=2000)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :kubernetes.KUBE_PING(async_discovery_use_separate_thread_per_request=false;ergonomics=true;serverPort=8888;saTokenFile=/var/run/secrets/kubernetes.io/serviceaccount/token;timeout=3000;send_cache_on_join=false;apiVersion=v1;num_initial_srv_members=0;break_on_coord_rsp=true;stats=true;use_disk_cache=false;connectTimeout=5000;num_initial_members=10;operationSleep=1000;caCertFile=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt;discovery_rsp_expiry_time=60000;id=2011;stagger_timeout=0;force_sending_discovery_rsps=true;async_discovery=false;clientKeyAlgo=RSA;masterPort=0;always_send_physical_addr_with_discovery_request=true;max_members_in_discovery_request=500;readTimeout=30000;namespace=ehcache-demo;name=KUBE_PING;return_entire_cache=false;operationAttempts=3)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :MERGE3(check_interval=48000;stats=true;min_interval=10000;ergonomics=true;name=MERGE3;id=54;max_participants_in_merge=100;max_interval=30000;only_coords_run_consistency_checker=false)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :VERIFY_SUSPECT(num_msgs=1;use_mcast_rsps=false;bind_interface_str=;stats=true;ergonomics=true;name=VERIFY_SUSPECT;bind_addr=100.96.9.38;id=13;timeout=1500;use_icmp=false)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :BARRIER(flush_timeout=5000;stats=true;ergonomics=true;max_close_time=60000;name=BARRIER;id=0)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :pbcast.NAKACK2(resend_last_seqno_max_times=1;use_mcast_xmit=false;ergonomics=true;xmit_table_msgs_per_row=2000;xmit_table_max_compaction_time=30000;become_server_queue_size=50;xmit_interval=500;print_stability_history_on_failed_xmit=false;resend_last_seqno=true;max_xmit_req_size=511600;discard_delivered_msgs=true;suppress_time_non_member_warnings=60000;max_msg_batch_size=100;xmit_table_num_rows=100;stats=true;xmit_from_random_member=false;log_discard_msgs=true;log_not_found_msgs=true;xmit_table_resize_factor=1.2;name=NAKACK2;id=57;max_rebroadcast_timeout=2000;use_mcast_xmit_req=false)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :UNICAST3(ergonomics=true;xmit_table_msgs_per_row=1000;xmit_table_max_compaction_time=30000;ack_threshold=5;sync_min_interval=2000;max_retransmit_time=60000;xmit_interval=500;max_xmit_req_size=511600;conn_close_timeout=10000;max_msg_batch_size=500;conn_expiry_timeout=120000;ack_batches_immediately=true;xmit_table_num_rows=100;stats=true;xmit_table_resize_factor=1.2;log_not_found_msgs=true;name=UNICAST3;id=64)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :pbcast.STABLE(cap=0.1;stability_delay=0;stats=true;ergonomics=true;name=STABLE;desired_avg_gossip=50000;max_bytes=8000000;id=16;send_stable_msgs_to_coord_only=true)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :pbcast.GMS(max_join_attempts=10;print_local_addr=true;handle_concurrent_startup=true;view_bundling=true;leave_timeout=1000;log_view_warnings=true;install_view_locally_first=true;ergonomics=true;use_delta_views=true;resume_task_timeout=20000;use_flush_if_present=true;print_physical_addrs=true;join_timeout=3000;view_ack_collection_timeout=2000;stats=true;num_prev_views=10;merge_timeout=5000;max_bundling_time=50;name=GMS;num_prev_mbrs=50;id=14;log_collect_msgs=false;membership_change_policy=org.jgroups.protocols.pbcast.GMS$DefaultMembershipPolicy@51fe7f15)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :MFC(min_threshold=0.4;stats=true;ergonomics=true;max_credits=2000000;name=MFC;min_credits=800000;id=44;max_block_time=500;ignore_synchronous_response=false)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :FRAG2(frag_size=60000;stats=true;ergonomics=true;name=FRAG2;id=5)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :pbcast.STATE_TRANSFER(stats=true;ergonomics=true;name=STATE_TRANSFER;id=17)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :CENTRAL_LOCK(stats=true;ergonomics=true;use_thread_id_for_lock_owner=true;name=CENTRAL_LOCK;id=50;num_backups=1;bypass_bundling=true;lock_striping_size=10)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo :COUNTER(stats=true;ergonomics=true;name=COUNTER;id=53;reconciliation_timeout=10000;timeout=60000;num_backups=1;bypass_bundling=true)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:10.495 [main] DEBUG n.s.e.d.j.JGroupsCacheReplicatorFactory - Creating JGroups CacheEventListener with configuration: {replicateAsynchronously=false, replicateUpdatesViaCopy=false, replicateRemovals=true, replicatePuts=true, replicateUpdates=true}
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:10.495 [main] DEBUG n.s.e.d.j.JGroupsBootstrapCacheLoaderFactory - Creating JGroups BootstrapCacheLoader with configuration:
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo {bootstrapAsynchronously=false}
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:10.558 [main] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Scheduled BootstrapRequest Reference cleanup timer with 60000ms period
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:10.558 [main] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Registered BootstrapRequest [cache=countries, bootstrapStatus=UNSENT, boostrapCompleteLatch=1, replicated=0, asynchronous=false, chunkSize=5000000]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:10.560 [main] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Waiting up to 300000ms for BootstrapRequest of countries to complete
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:10.560 [EH_CACHE Bootstrap thread-1 - Request for countries] INFO n.s.e.d.j.JGroupsBootstrapManager - There are no other nodes in the cluster to bootstrap countries from
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [net.sf.ehcache.distribution.jgroups] to TRACE
ehcache-demo-c5c5dbcc7-88p75ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo ehcache-demo 08:54:10.561 [EH_CACHE Bootstrap thread-1 - Request for countries] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Removed BootstrapRequest [cache=countries, bootstrapStatus=UNSENT, boostrapCompleteLatch=1, replicated=0, asynchronous=false, chunkSize=5000000]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:11.254 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Started EhcacheJgroupsDemoApplication in 7.35 seconds (JVM running for 7.888)
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:11.269 [main] INFO c.t.k.ehcache.demo.CacheManagerCheck -
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo =========================================================
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo Using cache manager: org.springframework.cache.ehcache.EhCacheCacheManager
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo =========================================================
08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [net.sf.ehcache.distribution.jgroups] to false
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[net.sf.ehcache.distribution.jgroups]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.jgroups.ping] to DEBUG
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.jgroups.ping] to false
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[org.jgroups.ping]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.jgroups.ping.common] to INFO
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.jgroups.ping.common] to false
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[org.jgroups.ping.common]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to ERROR
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [CONSOLE] to Logger[ROOT]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03,173 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo
ehcache-demo 08:54:03,174 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1a04f701 - Registering current configuration as safe fallback point
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03.178 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Running boot with SPRING_PROFILES_ACTIVE=null
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03.193 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Some environment data: jvm=11.0.3+1-Debian-1bpo91, processors=1, max-memory=0.48 GB, JAVA_TOOL_OPTIONS=-Xmx512m -Xms512m -Djava.net.preferIPv4Stack=true, SPRING_CONFIG_LOCATION=null, pid=1.
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo . ____ _ __ _ _
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo \\/ ___)| |_)| | | | | || (_| | ) ) ) )
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo ' |____| .__|_| |_|_| |_\__, | / / / /
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo =========|_|==============|___/=/_/_/_/
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :: Spring Boot :: (v2.1.5.RELEASE)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03.664 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Starting EhcacheJgroupsDemoApplication on ehcache-demo-c5c5dbcc7-jr2c2 with PID 1 (/app started by root in /)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03.664 [main] DEBUG c.t.k.e.d.EhcacheJgroupsDemoApplication - Running with Spring Boot v2.1.5.RELEASE, Spring v5.1.7.RELEASE
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:03.665 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - No active profile set, falling back to default profiles: default
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:05.227 [main] DEBUG c.t.k.e.d.j.JGroupsCacheManagerPeerProviderFactory - Creating JGroups CacheManagerPeerProvider for __DEFAULT__ with configuration file: file:/app/jgroups/tcp.xml
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:05.257 [main] DEBUG n.s.e.d.j.JGroupsCacheReplicatorFactory - Creating JGroups CacheEventListener with configuration: {replicateAsynchronously=false, replicateUpdatesViaCopy=false, replicateRemovals=true, replicatePuts=true, replicateUpdates=true}
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:05.259 [main] DEBUG n.s.e.d.j.JGroupsBootstrapCacheLoaderFactory - Creating JGroups BootstrapCacheLoader with configuration:
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo {bootstrapAsynchronously=false}
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:05.447 [main] DEBUG io.undertow - starting undertow server io.undertow.Undertow@8c0a23f
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo WARNING: An illegal reflective access operation has occurred
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo WARNING: Illegal reflective access by org.xnio.nio.NioXnio$2 (file:/app/lib/xnio-nio-3.3.8.Final.jar) to constructor sun.nio.ch.EPollSelectorProvider()
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo WARNING: Please consider reporting this to the maintainers of org.xnio.nio.NioXnio$2
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo WARNING: All illegal access operations will be denied in a future release
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:05.488 [main] DEBUG io.undertow - Configuring listener with protocol HTTP for interface 0.0.0.0 and port 8888
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo -------------------------------------------------------------------
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo GMS: address=ehcache-demo-c5c5dbcc7-jr2c2-12976, cluster=EH_CACHE, physical address=100.96.16.74:7800
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo -------------------------------------------------------------------
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:06.809 [main] DEBUG org.jgroups.ping.kube.Client - getPods(ehcache-demo, null) = [Pod[podIP=100.96.9.38, containers=[]], Pod[podIP=100.96.6.64, containers=[]], Pod[podIP=100.96.16.74, containers=[]]]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.828 [main] INFO n.s.e.d.j.JGroupsCacheManagerPeerProvider - JGroups Replication started for 'EH_CACHE'. JChannel: local_addr=ehcache-demo-c5c5dbcc7-jr2c2-12976
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo cluster_name=EH_CACHE
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo my_view=[ehcache-demo-c5c5dbcc7-jr2c2-12976|0] (1) [ehcache-demo-c5c5dbcc7-jr2c2-12976]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo state=CONNECTED
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo discard_own_messages=true
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo state_transfer_supported=true
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo props=TCP(discard_incompatible_packets=true;internal_thread_pool_min_threads=2;internal_thread_pool_keep_alive_time=30000;time_service_interval=500;thread_pool_max_threads=500;internal_thread_pool_queue_enabled=true;ergonomics=true;enable_unicast_bundling=true;port_range=50;conn_expire_time=0;recv_buf_size=5000000;loopback_copy=false;thread_naming_pattern=cl;internal_thread_pool_rejection_policy=abort;internal_thread_pool_enabled=true;send_buf_size=1000000;tcp_nodelay=true;stats=true;oob_thread_pool_enabled=true;oob_thread_pool_rejection_policy=abort;suppress_time_different_version_warnings=60000;id=75;thread_pool_rejection_policy=abort;logical_addr_cache_max_size=2000;suppress_time_different_cluster_warnings=60000;use_send_queues=false;loopback=true;timer_rejection_policy=abort;sock_conn_timeout=2000;oob_thread_pool_min_threads=2;client_bind_port=0;bundler_num_spins=40;send_queue_size=2000;max_bundle_timeout=20;enable_diagnostics=true;internal_thread_pool_max_threads=4;external_port=0;oob_thread_pool_max_threads=10;no_bundler_pool_size=10;log_discard_msgs=true;name=TCP;oob_thread_pool_keep_alive_time=30000;bind_addr=100.96.16.74;wheel_size=200;bundler_capacity=16384;log_discard_msgs_version=true;defer_client_bind_addr=false;enable_batching=true;tick_time=50;timer_max_threads=4;thread_pool_queue_enabled=true;enable_bundling=true;oob_thread_pool_queue_enabled=false;thread_pool_keep_alive_time=30000;bind_port=7800;thread_pool_min_threads=0;ignore_dont_bundle=true;reaper_interval=0;bind_interface_str=;diagnostics_ttl=8;loopback_separate_thread=true;logical_addr_cache_expiration=120000;peer_addr_read_timeout=1000;oob_thread_pool_queue_max_size=500;linger=-1;diagnostics_addr=224.0.75.75;receive_on_all_interfaces=false;internal_thread_pool_queue_max_size=500;timer_queue_max_size=500;thread_pool_queue_max_size=10000;no_bundler_initial_buf_size=512;max_bundle_size=64000;physical_addr_max_fetch_attempts=1;timer_min_threads=2;thread_pool_enabled=true;bundler_type=transfer-queue;timer_keep_alive_time=5000;logical_addr_cache_reaper_interval=60000;timer_type=new3;diagnostics_port=7500;who_has_cache_timeout=2000)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :kubernetes.KUBE_PING(async_discovery_use_separate_thread_per_request=false;ergonomics=true;serverPort=8888;saTokenFile=/var/run/secrets/kubernetes.io/serviceaccount/token;timeout=3000;send_cache_on_join=false;apiVersion=v1;num_initial_srv_members=0;break_on_coord_rsp=true;stats=true;use_disk_cache=false;connectTimeout=5000;num_initial_members=10;operationSleep=1000;caCertFile=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt;discovery_rsp_expiry_time=60000;id=2011;stagger_timeout=0;force_sending_discovery_rsps=true;async_discovery=false;clientKeyAlgo=RSA;masterPort=0;always_send_physical_addr_with_discovery_request=true;max_members_in_discovery_request=500;readTimeout=30000;namespace=ehcache-demo;name=KUBE_PING;return_entire_cache=false;operationAttempts=3)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :MERGE3(check_interval=48000;stats=true;min_interval=10000;ergonomics=true;name=MERGE3;id=54;max_participants_in_merge=100;max_interval=30000;only_coords_run_consistency_checker=false)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :VERIFY_SUSPECT(num_msgs=1;use_mcast_rsps=false;bind_interface_str=;stats=true;ergonomics=true;name=VERIFY_SUSPECT;bind_addr=100.96.16.74;id=13;timeout=1500;use_icmp=false)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :BARRIER(flush_timeout=5000;stats=true;ergonomics=true;max_close_time=60000;name=BARRIER;id=0)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :pbcast.NAKACK2(resend_last_seqno_max_times=1;use_mcast_xmit=false;ergonomics=true;xmit_table_msgs_per_row=2000;xmit_table_max_compaction_time=30000;become_server_queue_size=50;xmit_interval=500;print_stability_history_on_failed_xmit=false;resend_last_seqno=true;max_xmit_req_size=511600;discard_delivered_msgs=true;suppress_time_non_member_warnings=60000;max_msg_batch_size=100;xmit_table_num_rows=100;stats=true;xmit_from_random_member=false;log_discard_msgs=true;log_not_found_msgs=true;xmit_table_resize_factor=1.2;name=NAKACK2;id=57;max_rebroadcast_timeout=2000;use_mcast_xmit_req=false)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :UNICAST3(ergonomics=true;xmit_table_msgs_per_row=1000;xmit_table_max_compaction_time=30000;ack_threshold=5;sync_min_interval=2000;max_retransmit_time=60000;xmit_interval=500;max_xmit_req_size=511600;conn_close_timeout=10000;max_msg_batch_size=500;conn_expiry_timeout=120000;ack_batches_immediately=true;xmit_table_num_rows=100;stats=true;xmit_table_resize_factor=1.2;log_not_found_msgs=true;name=UNICAST3;id=64)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :pbcast.STABLE(cap=0.1;stability_delay=0;stats=true;ergonomics=true;name=STABLE;desired_avg_gossip=50000;max_bytes=8000000;id=16;send_stable_msgs_to_coord_only=true)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :pbcast.GMS(max_join_attempts=10;print_local_addr=true;handle_concurrent_startup=true;view_bundling=true;leave_timeout=1000;log_view_warnings=true;install_view_locally_first=true;ergonomics=true;use_delta_views=true;resume_task_timeout=20000;use_flush_if_present=true;print_physical_addrs=true;join_timeout=3000;view_ack_collection_timeout=2000;stats=true;num_prev_views=10;merge_timeout=5000;max_bundling_time=50;name=GMS;num_prev_mbrs=50;id=14;log_collect_msgs=false;membership_change_policy=org.jgroups.protocols.pbcast.GMS$DefaultMembershipPolicy@77fc19cf)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :MFC(min_threshold=0.4;stats=true;ergonomics=true;max_credits=2000000;name=MFC;min_credits=800000;id=44;max_block_time=500;ignore_synchronous_response=false)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :FRAG2(frag_size=60000;stats=true;ergonomics=true;name=FRAG2;id=5)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :pbcast.STATE_TRANSFER(stats=true;ergonomics=true;name=STATE_TRANSFER;id=17)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :CENTRAL_LOCK(stats=true;ergonomics=true;use_thread_id_for_lock_owner=true;name=CENTRAL_LOCK;id=50;num_backups=1;bypass_bundling=true;lock_striping_size=10)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo :COUNTER(stats=true;ergonomics=true;name=COUNTER;id=53;reconciliation_timeout=10000;timeout=60000;num_backups=1;bypass_bundling=true)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.831 [main] DEBUG n.s.e.d.j.JGroupsCacheReplicatorFactory - Creating JGroups CacheEventListener with configuration: {replicateAsynchronously=false, replicateUpdatesViaCopy=false, replicateRemovals=true, replicatePuts=true, replicateUpdates=true}
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.832 [main] DEBUG n.s.e.d.j.JGroupsBootstrapCacheLoaderFactory - Creating JGroups BootstrapCacheLoader with configuration:
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo {bootstrapAsynchronously=false}
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.896 [main] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Scheduled BootstrapRequest Reference cleanup timer with 60000ms period
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.896 [main] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Registered BootstrapRequest [cache=countries, bootstrapStatus=UNSENT, boostrapCompleteLatch=1, replicated=0, asynchronous=false, chunkSize=5000000]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.897 [main] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Waiting up to 300000ms for BootstrapRequest of countries to complete
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.898 [EH_CACHE Bootstrap thread-1 - Request for countries] INFO n.s.e.d.j.JGroupsBootstrapManager - There are no other nodes in the cluster to bootstrap countries from
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:09.899 [EH_CACHE Bootstrap thread-1 - Request for countries] DEBUG n.s.e.d.j.JGroupsBootstrapManager - Removed BootstrapRequest [cache=countries, bootstrapStatus=UNSENT, boostrapCompleteLatch=1, replicated=0, asynchronous=false, chunkSize=5000000]
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:10.592 [main] INFO c.t.k.e.d.EhcacheJgroupsDemoApplication - Started EhcacheJgroupsDemoApplication in 7.313 seconds (JVM running for 7.869)
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:10.603 [main] INFO c.t.k.ehcache.demo.CacheManagerCheck -
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo =========================================================
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo Using cache manager: org.springframework.cache.ehcache.EhCacheCacheManager
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo =========================================================
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo
ehcache-demo-c5c5dbcc7-jr2c2 ehcache-demo 08:54:38.697 [Timer-2,EH_CACHE,ehcache-demo-c5c5dbcc7-jr2c2-12976] DEBUG org.jgroups.ping.kube.Client - getPods(ehcache-demo, null) = [Pod[podIP=100.96.9.38, containers=[]], Pod[podIP=100.96.16.74, containers=[]]]
ehcache-demo-c5c5dbcc7-88p75 ehcache-demo 08:54:48.170 [Timer-3,EH_CACHE,ehcache-demo-c5c5dbcc7-88p75-8758] DEBUG org.jgroups.ping.kube.Client - getPods(ehcache-demo, null) = [Pod[podIP=100.96.9.38, containers=[]], Pod[podIP=100.96.16.74, containers=[]]]
Ref to github repository - https://github.com/kunal-bhatia/ehcache-jgroups-demo
kunal-bhatia commented
It works now, it was issue with exposing the 8888 port from the container. Thanks a lot for your support and cooperation. Really appreciate.
belaban commented
Happy to be of assistence!