[RELEASE] Release version 2.12.0

Question

[RELEASE] Release version 2.12.0

github-actions opened this issue a year ago · 107 comments

Release OpenSearch and OpenSearch Dashboards 2.12.0

I noticed that a manifest was automatically created in manifests/2.12.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria	Status	Description
Documentation draft PRs are up and in tech review for all component changes	🟢	#4115 (comment)
Sanity testing is done for all components	🟢
Release notes are ready and available for all components	🟢	OS Components, OSD Components
Roadmap is up-to-date (information is available to create release highlights)	🟢
Release ticket is cut	🟢
Any necessary security reviews are complete	🟢

OpenSearch 2.12.0 exit criteria status:

Criteria	Status	Description	Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions	🟢		#4115 (comment)
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🟢
Documentation has been fully reviewed and signed off by the documentation community.	🟢	#4115 (comment)
All integration tests are passing	🟢		Manual sign off from comment.
Release blog is ready	🟢	#4115 (comment)

OpenSearch-Dashboards 2.12.0 exit criteria status:

Criteria	Status	Description	Comments
Documentation has been fully reviewed and signed off by the documentation community	🟢	#4115 (comment)
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🟢
All integration tests are passing	🟢		Manual sign off from comment
Release blog is ready	🟢	#4115 (comment)

Preparation

Release manager assigned.
Existence of label in each component repo. For more information check the release-label section.
Increase the build frequency.
Release Issue.

Campaigns

Release Branch and Version Increment - End of February 4th, 2024

Feature Freeze - End of February 5th, 2024

OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - End of February 5th, 2024

Mark this as done once the Code Complete is reviewed.
Create/Verify pull requests to add each component to relase input manifests/2.12.0/opensearch-2.12.0.yml and manifests/2.12.0/opensearch-dashboards-2.12.0.yml.

Release Candidate Creation and Testing - First RC Generated (release window opens) on February 6th, 2024

Generate Release Candidate.
- 1st RC generation details started on 02/06/2024: #4115 (comment).
- 2nd RC generation details started on 02/07/2024: #4115 (comment).
- RC Paused on 02/08/2024 #4115 (comment).
- 3rd RC generation details started on 02/09/2024 #4115 (comment).
- 4th RC generation details started on 02/12/2024 #4115 (comment).
- 5th RC generation details started on 02/12/2024 #4115 (comment).
- 6th RC generation details started on 02/13/2024 #4115 (comment).
- 7th RC generation details started on 02/14/2024 #4115 (comment).
- 8th RC generation details started on 02/15/2024 #4115 (comment)
- 9th RC generation details started on 02/16/2024 #4115 (comment)
- 10th RC generation details started on 02/19/2024 #4115 (comment) 🟢
Integ Test TAR.
Integ Test RPM.
Docker Build and Scan.
Backwards Compatibility Tests.
Windows Integration Test.
Broadcast and Communication.
Release Candidate Lock #4460.

Performance testing validation - End of February 17th, 2024

Post the benchmark-tests
Longevity tests do not show any issues.

Pre Release - End of February 20th, 2024

Release - February 20th, 2024

Release Checklist.

Release Checklist

Pre-Release activities

Release activities

Post-Release activities

Release Tags.
https://build.ci.opensearch.org/job/distribution-release-tag-creation/98/console
https://build.ci.opensearch.org/job/distribution-release-tag-creation/99/console
https://build.ci.opensearch.org/job/distribution-release-tag-creation/100/
Input Manifest Update: https://github.com/opensearch-project/opensearch-build/pull/4467/files
Decrease the Build Frequency.
OpenSearch Build Release notes: https://github.com/opensearch-project/opensearch-build/releases/tag/2.12.0
Retrospective Issue: #4454
Helm and Ansible Playbook release.
opensearch-project/helm-charts#518
opensearch-project/ansible-playbook#153
Upcoming Release Preparation: This process is automated as the version increment PR's, release issues are created by automated workflows.

Post Release

Components

OpenSearch

Component	Issues tagged with 2.12.0
opensearch-project/OpenSearch#10517
opensearch-project/common-utils#548
opensearch-project/k-NN#1224
opensearch-project/geospatial#543
opensearch-project/security#3513
opensearch-project/cross-cluster-replication#1242
opensearch-project/ml-commons#1471
opensearch-project/neural-search#424
opensearch-project/notifications#782
opensearch-project/observability#1725
opensearch-project/reporting#884
opensearch-project/sql#2269
opensearch-project/asynchronous-search#478
opensearch-project/anomaly-detection#1079
opensearch-project/alerting#1243
opensearch-project/security-analytics#653
opensearch-project/index-management#997
opensearch-project/performance-analyzer#580
opensearch-project/flow-framework#414

OpenSearch Dashboards

Component	Issues tagged with 2.12.0
opensearch-project/OpenSearch-Dashboards#5257
opensearch-project/opensearch-dashboards-functional-test#914
opensearch-project/dashboards-observability#1104
opensearch-project/dashboards-reporting#207
opensearch-project/dashboards-visualizations#265
opensearch-project/dashboards-query-workbench#152
opensearch-project/dashboards-maps#521
opensearch-project/anomaly-detection-dashboards-plugin#619
opensearch-project/ml-commons-dashboards#275
opensearch-project/index-management-dashboards-plugin#894
opensearch-project/dashboards-notifications#128
opensearch-project/alerting-dashboards-plugin#758
opensearch-project/security-analytics-dashboards-plugin#751
opensearch-project/security-dashboards-plugin#1606
opensearch-project/dashboards-search-relevance#321
opensearch-project/dashboards-assistant#100

Documentation

Component	Issues tagged with 2.12.0
https://github.com/opensearch-project/documentation-website/

Legend

Symbol	Meaning
🟢	On track with overall release
🟡	Missed last milestone
🔴	Missed multiple milestones

Answer 1 · 2023-12-21T20:48:48.000Z

This should also be added to exit criteria for 2.12.0 release: opensearch-project/security#3624

Answer 2 · 2024-01-03T01:00:46.000Z

2.12.0 release dates will be finalized based on the discussion part of the issue #4290.
Thank you

Answer 3 · 2024-01-05T16:19:27.000Z

The release calendar is updated and 2.12.0 is scheduled to February 20th, 2024, I have updated the issue details with all the release timelines. The First RC will be Generated on February 6th, 2024.
Thanks

Answer 4 · 2024-01-17T01:39:41.000Z

Noticed a build issue with flow-framework plugin for 2.12.0.
opensearch-project/flow-framework#410
cc: @prudhvigodithi

Answer 5 · 2024-02-06T19:04:29.000Z

All IntegTest issues and PRs here:

Answer 6 · 2024-02-06T22:38:20.000Z

Documentation update: We are RED for the RC with 2 PRs outstanding:

Reranking feature- opensearch-project/documentation-website#6359
Metric framework - opensearch-project/documentation-website#6338 (PR targeting 2/7)

Update 2/14: Documentation is GREEN. We have PRs up for all 2.12 features: 44 PRs completed and merged; 4 PRs in final review stages.

Answer 7 · 2024-02-07T18:37:14.000Z

1st RC build and results - 02/06/2024

🔴 OpenSearch: https://build.ci.opensearch.org/job/distribution-build-opensearch/9353/console

OpenSearch Failed components: performance-analyzer, skills

🟢 OpenSearch Dashboard: https://build.ci.opensearch.org/job/distribution-build-opensearch-dashboards/7242/console

Components Integ test failures: https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av2.12.0+label%3Aautocut+%5BAUTOCUT%5D+integration+in%3Atitle+

Answer 8 · 2024-02-07T19:22:34.000Z

Backport 2 PRs into 2.12
opensearch-project/OpenSearch#11505
opensearch-project/OpenSearch#12073
their commits on 2.12 branch
eafa41651ffc1610a0de267d5915e0bec4db9064
a9c03c2d08051dc3f8e5f8c7920473e53d0d2752

Answer 9 · 2024-02-08T00:15:58.000Z

2nd RC build and results - 02/07/2024

OpenSearch: https://build.ci.opensearch.org/blue/organizations/jenkins/distribution-build-opensearch/detail/distribution-build-opensearch/9358/pipeline

🟢 OpenSearch Dashboards: https://build.ci.opensearch.org/blue/organizations/jenkins/distribution-build-opensearch[…]il/distribution-build-opensearch-dashboards/7246/pipeline

OS Distribution build Failed components
OpenSearch: opensearch-project/OpenSearch#12242
PA: opensearch-project/performance-analyzer#611

Integ test failures:
https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av2.12.0+label%3Aautocut+%5BAUTOCUT%5D+Integration+in%3Atitle+

Answer 10 · 2024-02-08T00:27:08.000Z

OpenSearch CommitID(after 2023-11-30) & Release Notes info

Repo	Branch	CommitID	Commit Date	Release Notes Exists
alerting	[2.12]	d4f1675	2024-02-08	True
anomaly-detection	[2.12]	24c7000	2024-02-09	True
asynchronous-search	[2.12]	169fc30	2024-02-14	True
common-utils	[2.12]	b10a9dd	2024-02-06	True
cross-cluster-replication	[2.12]	72c504f	2024-02-12	True
custom-codecs	[2.12]	36ad850	2024-02-08	True
flow-framework	[2.12]	987b96f	2024-02-09	True
geospatial	[2.12]	c9ea964	2024-02-08	True
index-management	[2.12]	f252d63	2024-02-09	True
job-scheduler	[2.12]	e5e9673	2024-02-09	True
k-NN	[2.12]	e7a9192	2024-02-08	True
ml-commons	[2.12]	cbd16d3	2024-02-13	True
neural-search	[2.12]	a521f78	2024-02-07	True
notifications	[2.12]	f72ce4a	2024-02-07	True
opensearch-observability	[2.12]	7848617	2024-02-10	True
opensearch-reports	[2.12]	b9d9d99	2024-02-13	True
performance-analyzer	[2.12]	f2d6b0b	2024-02-12	True
security	[2.12]	a5c3191	2024-02-09	True
security-analytics	[2.12]	fca29cf	2024-02-06	True
skills	[2.12]	5f3f8ac	2024-02-09	True
sql	[2.12]	1848d86	2024-02-06	True

Answer 11 · 2024-02-08T00:27:41.000Z

OpenSearch Dashboards CommitID(after 2023-11-30) & Release Notes info

Repo	Branch	CommitID	Commit Date	Release Notes Exists
alertingDashboards	[2.12]	9e94502	2024-02-12	True
anomalyDetectionDashboards	[2.12]	99ed917	2024-02-13	True
assistantDashboards	[2.12]	bfe6fb9	2024-02-14	True
customImportMapDashboards	[2.12]	c3331e1	2024-02-07	True
functionalTestDashboards	[2.12]	87ae255	2024-02-07	False
ganttChartDashboards	[2.12]	8693f72	2024-02-09	True
indexManagementDashboards	[2.12]	28530a0	2024-02-14	True
mlCommonsDashboards	[2.12]	d28607d	2024-02-04	True
notificationsDashboards	[2.12]	ac4b533	2024-02-13	True
observabilityDashboards	[2.12]	2f19852	2024-02-13	True
queryWorkbenchDashboards	[2.12]	ac68ded	2024-02-09	True
reportsDashboards	[2.12]	0bf4a26	2024-02-13	True
searchRelevanceDashboards	[2.12]	8838be9	2024-02-08	True
securityAnalyticsDashboards	[2.12]	1eb6894	2024-02-14	True
securityDashboards	[2.12]	d36297f	2024-02-09	True

Answer 12 · 2024-02-08T22:04:48.000Z

Documentation update: RED

One PR to be created for Metrics Framework: opensearch-project/documentation-website#6338
Several PRs in tech or doc review: https://github.com/opensearch-project/documentation-website/pulls?q=is%3Aopen+is%3Apr+label%3Av2.12.0

Answer 13 · 2024-02-09T01:10:53.000Z

Release update 02/08/2024

Hey everyone, we cant move forward with the RC generation as multiple components missing the release notes (which does not meet the entrance criteria) and performance-analyzer and skills are still failing to build, repo owners please fix them soon without them fixed we cant move forward with the RC generation and might cause in delaying the 2.12.0 release.

OpenSearch components missing release notes

#4115 (comment)

OpenSearch Dashboards components missing release notes

#4115 (comment)

Thanks

Answer 14 · 2024-02-09T01:24:12.000Z

Release update 02/08/2024

Hey everyone, we cant move forward with the RC generation as multiple components missing the release notes (which does not meet the entrance criteria) and performance-analyzer and skills are still failing to build, repo owners please fix them soon without them fixed we cant move forward with the RC generation and might cause in delaying the 2.12.0 release.

OpenSearch components missing release notes

#4115 (comment)

OpenSearch Dashboards components missing release notes

#4115 (comment)

Thanks

@psychbot @zane-neo @khushbr Take action to resolve the build issues with PA and Skills repo as soon as possible.

Answer 15 · 2024-02-09T19:41:38.000Z

The below items are still open for Documentation.

One PR to be created for Metrics Framework:
[DOC] Metrics Framework documentation-website#6338

Several PRs in tech or doc are still in review: https://github.com/opensearch-project/documentation-website/pulls?q=is%3Aopen+is%3Apr+label%3Av2.12.0

CC: @prudhvigodithi @hdhalter

Answer 16 · 2024-02-09T22:44:24.000Z

3rd RC build blockers - 02/09/2024

performance-analyzer build failure's
opensearch-project/performance-analyzer#611

Pending PR's to merge that will fix the performance-analyzer build failure's
opensearch-project/performance-analyzer#627, opensearch-project/performance-analyzer#628

Pending PR's to merge performance-analyzer-rca (performance-analyzer clones RCA during build):
opensearch-project/performance-analyzer-rca#533

Missing release notes:
#4115 (comment)
#4115 (comment)

3rd RC build blockers - 02/09/2024 (4PM PT)

Hey everyone, we cant move forward with the RC generation as multiple components missing the release notes which does not meet the entrance criteria.

OpenSearch components missing release notes
#4115 (comment)
asynchronous-search
opensearch-observability
opensearch-reports
performance-analyzer

OpenSearch Dashboards components missing release notes
#4115 (comment)
alertingDashboards
ganttChartDashboards
notificationsDashboards
observabilityDashboards
reportsDashboards
securityAnalyticsDashboards

Thanks

Answer 17 · 2024-02-12T19:55:10.000Z

4th RC OpenSearch 9396 / OpenSearch Dashboards 7278 - 02/12/2024.

We cant finalize this RC build due to missing release notes which does not meet the release notes readiness.

OpenSearch - Build 9396
OpenSearch Dashboards - Build 7278

Use the following Docker-Compose to setup a cluster

docker-compose.yml

version: '3' services: opensearch-node1: image: opensearchstaging/opensearch:2.12.0.9396 container_name: opensearch-node1 environment: - cluster.name=opensearch-cluster - node.name=opensearch-node1 - discovery.seed_hosts=opensearch-node1,opensearch-node2 - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2 - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM ulimits: memlock: soft: -1 hard: -1 nofile: soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems hard: 65536 volumes: - opensearch-data1:/usr/share/opensearch/data ports: - 9200:9200 - 9600:9600 # required for Performance Analyzer networks: - opensearch-net opensearch-node2: image: opensearchstaging/opensearch:2.12.0.9396 container_name: opensearch-node2 environment: - cluster.name=opensearch-cluster - node.name=opensearch-node2 - discovery.seed_hosts=opensearch-node1,opensearch-node2 - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2 - bootstrap.memory_lock=true - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" ulimits: memlock: soft: -1 hard: -1 nofile: soft: 65536 hard: 65536 volumes: - opensearch-data2:/usr/share/opensearch/data networks: - opensearch-net opensearch-dashboards: image: opensearchstaging/opensearch-dashboards:2.12.0.7278 container_name: opensearch-dashboards ports: - 5601:5601 expose: - "5601" environment: OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]' networks: - opensearch-net volumes: opensearch-data1: opensearch-data2:

networks: opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.12.0.9396
- Start without security
  - Docker command docker pull opensearchstaging/opensearch:2.12.0.9396 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9396
  - Connect command curl https://localhost:9200/
- Start with security
  - Docker command docker pull opensearchstaging/opensearch:2.12.0.9396 && docker run -it -p 9200:9200 -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!" -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9396
  - Connect command curl --insecure https://admin:myStrongPassword123!@localhost:9200/
OpenSearch-Dashboards docker 2.12.0.7278
- Start without security
  - Docker command docker pull opensearchstaging/opensearch-dashboards:2.12.0.7278 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.12.0.7278
  - URL https://localhost:5601/
- Start with security
  - Docker command docker pull opensearchstaging/opensearch-dashboards:2.12.0.7278 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.12.0.7278
  - URL https://localhost:5601/
Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9396 (Note: Windows version does not have performance analyzer plugin)
  - arm64 [manifest] [tar] [rpm][deb]
  - x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7278
  - arm64 [manifest] [tar][rpm][deb]
  - x64 [manifest] [tar][rpm] [deb] [windows]

Check how to install opensearch and dashboards on different platforms

Please note the following components release notes are still missing.

OpenSearch components missing release notes

#4115 (comment)
asynchronous-search
opensearch-reports

OpenSearch Dashboards components missing release notes

#4115 (comment)
alertingDashboards
reportsDashboards
notificationsDashboards
securityAnalyticsDashboards

Answer 18 · 2024-02-13T00:07:45.000Z

5th RC OpenSearch 9399 / OpenSearch Dashboards 7280 - 02/12/2024.

We cant finalize this RC build due to missing release notes which does not meet the release notes readiness.

Triggered the RC builds

OpenSearch - Build 9399
OpenSearch Dashboards - Build 7280

Use the following Docker-Compose to setup a cluster

docker-compose.yml

version: '3' services: opensearch-node1: image: opensearchstaging/opensearch:2.12.0.9399 container_name: opensearch-node1 environment: - cluster.name=opensearch-cluster - node.name=opensearch-node1 - discovery.seed_hosts=opensearch-node1,opensearch-node2 - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2 - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM ulimits: memlock: soft: -1 hard: -1 nofile: soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems hard: 65536 volumes: - opensearch-data1:/usr/share/opensearch/data ports: - 9200:9200 - 9600:9600 # required for Performance Analyzer networks: - opensearch-net opensearch-node2: image: opensearchstaging/opensearch:2.12.0.9399 container_name: opensearch-node2 environment: - cluster.name=opensearch-cluster - node.name=opensearch-node2 - discovery.seed_hosts=opensearch-node1,opensearch-node2 - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2 - bootstrap.memory_lock=true - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" ulimits: memlock: soft: -1 hard: -1 nofile: soft: 65536 hard: 65536 volumes: - opensearch-data2:/usr/share/opensearch/data networks: - opensearch-net opensearch-dashboards: image: opensearchstaging/opensearch-dashboards:2.12.0.7280 container_name: opensearch-dashboards ports: - 5601:5601 expose: - "5601" environment: OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]' networks: - opensearch-net volumes: opensearch-data1: opensearch-data2:

networks: opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.12.0.9399

Start without security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9399 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e DISABLE_INSTALL_DEMO_CONFIG=true -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9399

Connect command curl https://localhost:9200/

Start with security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9399 && docker run -it -p 9200:9200 -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9399

Connect command curl --insecure https://localhost:9200/ -u 'admin:myStrongPassword123!'

OpenSearch-Dashboards docker 2.12.0.7280

Start without security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7280 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.12.0.7280

URL https://localhost:5601/

Start with security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7280 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.12.0.7280

URL https://localhost:5601/

Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9399 (Note: Windows version does not have performance analyzer plugin)
  - arm64 [manifest] [tar] [rpm][deb]
  - x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7280
  - arm64 [manifest] [tar][rpm][deb]
  - x64 [manifest] [tar][rpm] [deb] [windows]

Check how to install opensearch and dashboards on different platforms

OpenSearch components missing release notes

#4115 (comment)
asynchronous-search
opensearch-reports

OpenSearch Dashboards components missing release notes

#4115 (comment)
alertingDashboards
reportsDashboards
notificationsDashboards

Answer 19 · 2024-02-13T16:57:35.000Z

@prudhvigodithi The docker testing steps should include the change about admin credentials for Start with security step:

Start with security

Docker command:

docker pull opensearchstaging/opensearch:2.12.0.9396 && docker run -it -p 9200:9200 -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123\!" -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9396

Connect command:

curl --insecure https://admin:myStrongPassword123!@localhost:9200/

Note: I've supplied a known strong password to facilitate testing. However, this should not be considered as default password.
cc: @derek-ho

Answer 20 · 2024-02-13T17:05:28.000Z

Thanks @DarshitChanpura I have updated the 3rd and 4th RC information, please check.

Answer 21 · 2024-02-13T17:11:44.000Z

@prudhvigodithi one small update: -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123\!" add backslash before ! to escape it.

Answer 22 · 2024-02-13T17:13:37.000Z

I have just updated to use single quotes which fixes entering into cmdand dquote>, can you test again @DarshitChanpura ?

Answer 23 · 2024-02-13T17:16:35.000Z

also the run command with env variable "DISABLE_SECURITY_PLUGIN=true" fails due to this logic :

➜  ~ docker pull opensearchstaging/opensearch:2.12.0.9399 && docker run -it -p 9200:9200 -e "DISABLE_SECURITY_PLUGIN=true" -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9399
2.12.0.9399: Pulling from opensearchstaging/opensearch
Digest: sha256:87b2c2bed78237714aea05572b71757470b9b0622867615dde14c1ac3e2eeb27
Status: Image is up to date for opensearchstaging/opensearch:2.12.0.9399
docker.io/opensearchstaging/opensearch:2.12.0.9399

What's Next?
  1. Sign in to your Docker account → docker login
  2. View a summary of image vulnerabilities and recommendations → docker scout quickview opensearchstaging/opensearch:2.12.0.9399
Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
OpenSearch 2.12.0 onwards, the OpenSearch Security Plugin a change that requires an initial password for 'admin' user.
Please define an environment variable 'OPENSEARCH_INITIAL_ADMIN_PASSWORD' with a strong password string.
If a password is not provided, the setup will quit.
 For more details, please visit: https://opensearch.org/docs/latest/install-and-configure/install-opensearch/docker/
### OpenSearch Security Demo Installer
### ** Warning: Do not use on production or public reachable systems **
OpenSearch install type: rpm/deb on Linux 6.6.12-linuxkit aarch64
OpenSearch config dir: /usr/share/opensearch/config/
OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
OpenSearch bin dir: /usr/share/opensearch/bin/
OpenSearch plugins dir: /usr/share/opensearch/plugins/
OpenSearch lib dir: /usr/share/opensearch/lib/
Detected OpenSearch Version: 2.12.0
Detected OpenSearch Security Version: 2.12.0.0
No custom admin password found. Please provide a password via the environment variable OPENSEARCH_INITIAL_ADMIN_PASSWORD.
➜  ~

This installs demo config first and then checks whether security plugin is disabled. This is wrong. It should not install demo config if it is not going to enable security plugin. I'll raise a PR to fix this.

PR: #4446

Answer 24 · 2024-02-13T17:27:31.000Z

@DarshitChanpura I assume the logic targets installing all the demo config and then access the cluster without security, but adding -e DISABLE_INSTALL_DEMO_CONFIG=true -e "DISABLE_SECURITY_PLUGIN=true" disables running install_demo_configuration.sh and security plugin and starts the cluster, but right just adding -e "DISABLE_SECURITY_PLUGIN=true" would fail with error No custom admin password found with the latest security plugin change.
Adding @peterzhuamazon @bbarani

Answer 25 · 2024-02-13T17:39:07.000Z

@prudhvigodithi I'm confused as to why we are installing demo config (certificates and such) if it is not going to be utilized. Yes, this was brought forward because of admin credentials requirement starting 2.12 and can be resolved by passing an additional flag: DISABLE_INSTALL_DEMO_CONFIG=true however shouldn't it be implied that when security plugin is disabled, the demo config script should not execute? IMO it should.

Answer 26 · 2024-02-13T18:03:44.000Z

Need to add this PR to 2.12 opensearch-project/ml-commons#2093, somehow missed backporting to 2.x

Answer 27 · 2024-02-13T18:46:28.000Z

The OpenSearch Dashboards validation test fail on the latest generated RC (4th)

Error:

requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5601): Max retries exceeded with url: /api/status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f833739e490>: Failed to establish a new connection: [Errno 111] Connection refused'))

The integ tests fail for the same as well: https://build.ci.opensearch.org/blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5573/pipeline/113

Adding @kavilla @AMoo-Miki to please check.

Answer 28 · 2024-02-13T18:49:15.000Z

When test with tarball x64, see OpenSearch Dashboard failed to start bin/opensearch-dashboards , error

  log   [18:47:29.259] [fatal][root] /home/ylwu/Downloads/os2.12/rc4/opensearch-dashboards-2.12.0/plugins/assistantDashboards/node_modules/jsdom/lib/jsdom/living/nodes/HTMLInputElement-impl.js:583
      this[filesSymbol] ||= FileList.createImpl(this._globalObject);
                        ^^^

SyntaxError: Unexpected token '||='
    at compileFunction (<anonymous>)
    at wrapSafe (internal/modules/cjs/loader.js:1029:16)
    at Module._compile (internal/modules/cjs/loader.js:1078:27)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1143:10)
    at Module.load (internal/modules/cjs/loader.js:979:32)
    at Function.Module._load (internal/modules/cjs/loader.js:819:12)
    at Module.require (internal/modules/cjs/loader.js:1003:19)
    at Module.Hook._require.Module.require (/home/ylwu/Downloads/os2.12/rc4/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/home/ylwu/Downloads/os2.12/rc4/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/home/ylwu/Downloads/os2.12/rc4/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/home/ylwu/Downloads/os2.12/rc4/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/home/ylwu/Downloads/os2.12/rc4/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at require (internal/modules/cjs/helpers.js:107:18)
    at Object.<anonymous> (/home/ylwu/Downloads/os2.12/rc4/opensearch-dashboards-2.12.0/plugins/assistantDashboards/node_modules/jsdom/lib/jsdom/living/generated/HTMLInputElement.js:1875:14)
    at Module._compile (internal/modules/cjs/loader.js:1114:14)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1143:10)

 FATAL  SyntaxError: Unexpected token '||='

Answer 29 · 2024-02-13T18:53:39.000Z

AD-Dashboard just had a change merged in 2.12 branch for fixing this CVE

Answer 30 · 2024-02-13T19:16:58.000Z

@anirudha @joshuali925 Can you check this issue?

Answer 31 · 2024-02-13T19:56:59.000Z

Seeing errors on securityAnalyticsDashboards . CC: @praveensameneni @kavilla @AMoo-Miki @ashwin-pc

opensearch-dashboards | {"type":"log","@timestamp":"2024-02-13T19:54:26Z","tags":["fatal","root"],"pid":1,"message":"Error: Cannot find module '../config'\nRequire stack:\n- /usr/share/opensearch-dashboards/plugins/securityAnalyticsDashboards/server/index.js\n- /usr/share/opensearch-dashboards/src/core/server/plugins/plugin.js\n- /usr/share/opensearch-dashboards/src/core/server/plugins/discovery/plugins_discovery.js\n- /usr/share/opensearch-dashboards/src/core/server/plugins/discovery/index.js\n- /usr/share/opensearch-dashboards/src/core/server/plugins/plugins_service.js\n- /usr/share/opensearch-dashboards/src/core/server/plugins/index.js\n- /usr/share/opensearch-dashboards/src/core/server/index.js\n- /usr/share/opensearch-dashboards/src/cli/serve/serve.js\n- /usr/share/opensearch-dashboards/src/cli/cli.js\n- /usr/share/opensearch-dashboards/src/cli/dist.js\n at Function.Module._resolveFilename (node:internal/modules/cjs/loader:1134:15)\n at Module.Hook._require.Module.require (/usr/share/opensearch-dashboards/node_modules/require-in-the-middle/index.js:61:29)\n at require (node:internal/modules/helpers:177:18)\n at Object.<anonymous> (/usr/share/opensearch-dashboards/plugins/securityAnalyticsDashboards/server/index.ts:9:1)\n at Module._compile (node:internal/modules/cjs/loader:1356:14)\n at Object.Module._extensions..js (node:internal/modules/cjs/loader:1414:10)\n at Module.load (node:internal/modules/cjs/loader:1197:32)\n at Function.Module._load (node:internal/modules/cjs/loader:1013:12)\n at Module.require (node:internal/modules/cjs/loader:1225:19)\n at Module.Hook._require.Module.require (/usr/share/opensearch-dashboards/node_modules/require-in-the-middle/index.js:80:39) {\n code: 'MODULE_NOT_FOUND',\n requireStack: [\n '/usr/share/opensearch-dashboards/plugins/securityAnalyticsDashboards/server/index.js',\n '/usr/share/opensearch-dashboards/src/core/server/plugins/plugin.js',\n '/usr/share/opensearch-dashboards/src/core/server/plugins/discovery/plugins_discovery.js',\n '/usr/share/opensearch-dashboards/src/core/server/plugins/discovery/index.js',\n '/usr/share/opensearch-dashboards/src/core/server/plugins/plugins_service.js',\n '/usr/share/opensearch-dashboards/src/core/server/plugins/index.js',\n '/usr/share/opensearch-dashboards/src/core/server/index.js',\n '/usr/share/opensearch-dashboards/src/cli/serve/serve.js',\n '/usr/share/opensearch-dashboards/src/cli/cli.js',\n '/usr/share/opensearch-dashboards/src/cli/dist.js'\n ]\n}"}

Answer 32 · 2024-02-13T22:11:39.000Z

@prudhvigodithi Fix for a critical bug in dashboards observability, merged in the 2.12 branch: opensearch-project/dashboards-observability#1435

Answer 33 · 2024-02-13T22:45:20.000Z

@prudhvigodithi Bug fix for Discover Saved Query. Will update when merged

Fix save query management render bug on discover

Answer 34 · 2024-02-13T23:00:09.000Z

@DarshitChanpura @derek-ho @peterzhuamazon tested all the following scenarios based on this comment and works as expected on the latest build (opensearchstaging/opensearch:2.12.0.9407) after this PR is merged, can you please confirm as well?

docker run -it -p 9200:9200 -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node"  opensearchstaging/opensearch:2.12.0.9407

docker run -it -p 9200:9200 -e "discovery.type=single-node"  opensearchstaging/opensearch:2.12.0.9407

docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9407

docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9407

docker run -it -p 9200:9200 -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node"  opensearchstaging/opensearch:2.12.0.9407

Thank you

Answer 35 · 2024-02-13T23:03:09.000Z

docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9407

This can be shortened to :

docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9407

docker run -it -p 9200:9200 -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9407

this can be shortened to:

docker run -it -p 9200:9200 -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e "discovery.type=single-node"  opensearchstaging/opensearch:2.12.0.9407

Post #4446 , DISABLE_SECURITY_PLUGIN inherently disables DISABLE_INSTALL_DEMO_CONFIG

Answer 36 · 2024-02-13T23:05:00.000Z

opensearch-project/ml-commons#2101, opensearch-project/ml-commons#2099. The last minute bug fixes in ml-commons.

Answer 37 · 2024-02-13T23:06:24.000Z

docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9407

This can be shortened to :
docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9407
docker run -it -p 9200:9200 -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9407

this can be shortened to:
docker run -it -p 9200:9200 -e "DISABLE_INSTALL_DEMO_CONFIG=true" -e "discovery.type=single-node"  opensearchstaging/opensearch:2.12.0.9407

Thanks @DarshitChanpura, right I wanted to test without the shortened one as previously users use to pass this way and want to make sure its not breaking.

Answer 38 · 2024-02-13T23:08:56.000Z

@prudhvigodithi @DarshitChanpura and I have also tested on most distributions (except Debian which I will pick up tomorrow) and changes are working as expected except for a windows bug which password can't end in ! But I think that's partly due to the way we were running the command so I think we are mostly good

Answer 39 · 2024-02-13T23:10:59.000Z

Thanks @DarshitChanpura, right I wanted to test without the shortened one as previously users use to pass this way and want to make sure its not breaking.

For pre <2.12 OPENSEARCH_INITIAL_ADMIN_PASSWORD is not required to be passed, and with the new change post 2.12 only addition would be OPENSEARCH_INITIAL_ADMIN_PASSWORD. In addition to make it easier, we have re-organized the usage of demo config install script flag via #4446 so that both DISABLE_INSTALL_DEMO_CONFIG and DISABLE_SECURITY_PLUGIN are not required. Hope this answers your question.

Answer 40 · 2024-02-13T23:17:04.000Z

I still get this error when running the opensearch-dashboards from tarball 2.12.

dev-dsk-xunzh-2c-b57bd588 % bin/opensearch-dashboards
log [23:16:38.409] [fatal][root] /local/home/xunzh/projects/OS2.12/opensearch-dashboards-2.12.0/plugins/assistantDashboards/node_modules/jsdom/lib/jsdom/living/nodes/HTMLInputElement-impl.js:583
this[filesSymbol] ||= FileList.createImpl(this._globalObject);
^^^

SyntaxError: Unexpected token '||='
at compileFunction ()
at wrapSafe (internal/modules/cjs/loader.js:1029:16)
at Module._compile (internal/modules/cjs/loader.js:1078:27)
at Object.Module._extensions..js (internal/modules/cjs/loader.js:1143:10)
at Module.load (internal/modules/cjs/loader.js:979:32)
at Function.Module._load (internal/modules/cjs/loader.js:819:12)
at Module.require (internal/modules/cjs/loader.js:1003:19)
at Module.Hook._require.Module.require (/local/home/xunzh/projects/OS2.12/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
at Module.Hook._require.Module.require (/local/home/xunzh/projects/OS2.12/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
at Module.Hook._require.Module.require (/local/home/xunzh/projects/OS2.12/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
at Module.Hook._require.Module.require (/local/home/xunzh/projects/OS2.12/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
at Module.Hook._require.Module.require (/local/home/xunzh/projects/OS2.12/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
at require (internal/modules/cjs/helpers.js:107:18)
at Object. (/local/home/xunzh/projects/OS2.12/opensearch-dashboards-2.12.0/plugins/assistantDashboards/node_modules/jsdom/lib/jsdom/living/generated/HTMLInputElement.js:1875:14)
at Module._compile (internal/modules/cjs/loader.js:1114:14)
at Object.Module._extensions..js (internal/modules/cjs/loader.js:1143:10)

FATAL SyntaxError: Unexpected token '||='

Answer 41 · 2024-02-13T23:39:01.000Z

Looking into the jsdom issue currently, seems like the tarball for x86 is using the 18.9.0 version as found in the tarball's node directory, which supports jsdom versions ^22.1.0. My thinking is the node_modules folder was built using a different version of node, which causes the unexpected token error. I'm unable to reproduce the issue when starting OSD using yarn, currently trying different versions to be able to get the same error.

Answer 42 · 2024-02-14T00:12:22.000Z

6th RC OpenSearch 9408 / OpenSearch Dashboards 7286 - 02/13/2024.

OpenSearch - Build 9408
OpenSearch Dashboards - Build 7286

Use the following Docker-Compose to setup a cluster

docker-compose.yml

  
version: '3'
services:
  opensearch-node1:
    image: opensearchstaging/opensearch:2.12.0.9408
    container_name: opensearch-node1
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node1
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
        hard: 65536
    volumes:
      - opensearch-data1:/usr/share/opensearch/data
    ports:
      - 9200:9200
      - 9600:9600 # required for Performance Analyzer
    networks:
      - opensearch-net
  opensearch-node2:
    image: opensearchstaging/opensearch:2.12.0.9408
    container_name: opensearch-node2
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node2
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536
        hard: 65536
    volumes:
      - opensearch-data2:/usr/share/opensearch/data
    networks:
      - opensearch-net
  opensearch-dashboards:
    image: opensearchstaging/opensearch-dashboards:2.12.0.7286
    container_name: opensearch-dashboards
    ports:
      - 5601:5601
    expose:
      - "5601"
    environment:
      OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
    networks:
      - opensearch-net
volumes:
  opensearch-data1:
  opensearch-data2:
networks:
  opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.12.0.9408

Start without security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9408 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e DISABLE_INSTALL_DEMO_CONFIG=true -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9408

Connect command curl https://localhost:9200/

Start with security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9408 && docker run -it -p 9200:9200 -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9408

Connect command curl --insecure https://localhost:9200/ -u 'admin:myStrongPassword123!'

OpenSearch-Dashboards docker 2.12.0.7286

Start without security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7286 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.12.0.7286

URL https://localhost:5601/

Start with security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7286 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.12.0.7286

URL https://localhost:5601/

Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9408 (Note: Windows version does not have performance analyzer plugin)
  - arm64 [manifest] [tar] [rpm][deb]
  - x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7286
  - arm64 [manifest] [tar][rpm][deb]
  - x64 [manifest] [tar][rpm] [deb] [windows]

Components missing the Release notes

asynchronous-search

Answer 43 · 2024-02-14T00:23:53.000Z

Validated the docker and tarball (arm/x86) for 4th RC and running nyc_taxis test against the installed OpenSearch candidate with security plugin. Don't see any error with nyc_taxis workload.

Answer 44 · 2024-02-14T00:46:40.000Z

Update on this issue

I was able to spin up a cluster by doing the following:

Download the OSD tarball from here and extract it.
Manually export a new node version or remove the node folder such that it uses my local environment's node 18.16.0.
Run ./bin/opensearch-dashboards. On my local, I then run into this issue that @bbarani mentioned.
After removing the securityAnalyticsDashboards plugin from the plugins/ directory, I'm able to start OSD with ./bin/opensearch-dashboards. I'm able to get an end-to-end working when OpenSearch backend is started without the security plugin.

I noticed that the issue @ylwu-amzn mentioned only occurred when I tested with Amazon Linux 2. When run on Ubuntu, I don't run into the Unexpected token issue, only this issue. This may be (not 100% sure) because AL2 does not support Node version 18.19.0, since GLIBC_2.27 and GLIBC_2.28 doesn't exist on AL2.

Answer 45 · 2024-02-14T01:16:01.000Z

Update on this issue

I was able to spin up a cluster by doing the following:
1. Download the OSD tarball from [here](https://github.com/opensearch-project/opensearch-build/issues/4115#issuecomment-1939823474) and extract it.

2. Manually export a new node version or remove the `node` folder such that it uses my local environment's node `18.16.0`.

3. Run `./bin/opensearch-dashboards`. On my local, I then run into [this issue](https://github.com/opensearch-project/opensearch-build/issues/4115#issuecomment-1942321347) that @bbarani mentioned.

4. After removing the `securityAnalyticsDashboards` plugin from the `plugins/` directory, I'm able to start OSD with `./bin/opensearch-dashboards`. I'm able to get an end-to-end working when OpenSearch backend is started without the security plugin.
I noticed that the issue @ylwu-amzn mentioned only occurred when I tested with Amazon Linux 2023. When run on Ubuntu, I don't run into the Unexpected token issue, only this issue. This may be (not 100% sure) because AL2023 does not support Node version 18.19.0, since GLIBC_2.27 and GLIBC_2.28 doesn't exist on AL2023.

Al2023 support up to 2.34 glibc , which is the reason we have the upgrade project from CentOS7 / AL2 to RockyLinux8 / AL2023 for Node16/18.

#1563

ldd (GNU libc) 2.34

Installing nvm and running it without any issues:

nvm list
->     v18.19.0
default -> 18.19.0 (-> v18.19.0)
iojs -> N/A (default)
unstable -> N/A (default)
node -> stable (-> v18.19.0) (default)
stable -> 18.19 (-> v18.19.0) (default)
lts/* -> lts/iron (-> N/A)
lts/argon -> v4.9.1 (-> N/A)
lts/boron -> v6.17.1 (-> N/A)
lts/carbon -> v8.17.0 (-> N/A)
lts/dubnium -> v10.24.1 (-> N/A)
lts/erbium -> v12.22.12 (-> N/A)
lts/fermium -> v14.21.3 (-> N/A)
lts/gallium -> v16.20.2 (-> N/A)
lts/hydrogen -> v18.19.0
lts/iron -> v20.11.0 (-> N/A)
bash-5.2# node --version
v18.19.0

bash-5.2# cat /etc/*release
Amazon Linux release 2023 (Amazon Linux)
NAME="Amazon Linux"
VERSION="2023"
ID="amzn"
ID_LIKE="fedora"
VERSION_ID="2023"
PLATFORM_ID="platform:al2023"
PRETTY_NAME="Amazon Linux 2023"
ANSI_COLOR="0;33"
CPE_NAME="cpe:2.3:o:amazon:amazon_linux:2023"
HOME_URL="https://aws.amazon.com/linux/"
BUG_REPORT_URL="https://github.com/amazonlinux/amazon-linux-2023"
SUPPORT_END="2028-03-15"
Amazon Linux release 2023 (Amazon Linux)

Answer 46 · 2024-02-14T01:20:22.000Z

New issue spot on DEB having discussion with @DarshitChanpura .

DEB is not able to pass the initial check in preinstall due to dpkg-query -W will treat 2.12 itself as a already installed version. dpkg-query -s is able to avoid that but will remove entry during upgrade, treating every installation as raw instead of upgrade. dpkg -l has the same issue as dpkg-query -W but resolve the issue with dpkg-query -s.

Awaiting @DarshitChanpura to give a final decision on this.

#4453

Answer 47 · 2024-02-14T01:55:11.000Z

Properly Resolve #4445:

#4452

Answer 48 · 2024-02-14T02:25:49.000Z

Talked to @sejli in a debug meeting and here is the discovery:

securityAnalyticsDashboards needs fixes: @praveensameneni @getsaurabh02 @kavilla @AMoo-Miki @ashwin-pc

  log   [02:15:37.144] [fatal][root] Error: Cannot find module '../config'
Require stack:
- /local/home/user/test/opensearch-dashboards-2.12.0/plugins/securityAnalyticsDashboards/server/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/plugin.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/discovery/plugins_discovery.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/discovery/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/plugins_service.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/cli/serve/serve.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/cli/cli.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/cli/dist.js
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:931:15)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:61:29)
    at require (internal/modules/cjs/helpers.js:107:18)
    at Object.<anonymous> (/local/home/user/test/opensearch-dashboards-2.12.0/plugins/securityAnalyticsDashboards/server/index.ts:9:1)
    at Module._compile (internal/modules/cjs/loader.js:1114:14)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1143:10)
    at Module.load (internal/modules/cjs/loader.js:979:32)
    at Function.Module._load (internal/modules/cjs/loader.js:819:12)
    at Module.require (internal/modules/cjs/loader.js:1003:19)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at require (internal/modules/cjs/helpers.js:107:18)
    at PluginWrapper.getConfigDescriptor (/local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/plugin.js:132:30) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [
    '/local/home/user/test/opensearch-dashboards-2.12.0/plugins/securityAnalyticsDashboards/server/index.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/plugin.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/discovery/plugins_discovery.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/discovery/index.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/plugins_service.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/index.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/index.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/cli/serve/serve.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/cli/cli.js',
    '/local/home/user/test/opensearch-dashboards-2.12.0/src/cli/dist.js'
  ]
}

 FATAL  Error: Cannot find module '../config'
Require stack:
- /local/home/user/test/opensearch-dashboards-2.12.0/plugins/securityAnalyticsDashboards/server/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/plugin.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/discovery/plugins_discovery.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/discovery/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/plugins_service.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/plugins/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/core/server/index.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/cli/serve/serve.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/cli/cli.js
- /local/home/user/test/opensearch-dashboards-2.12.0/src/cli/dist.js

There is no issue with 18.16.0 vs 18.19.0, as Sean was mistakenly test on AL2, not AL2023. We properly test again on AL2023 and it passed after removing securityAnalyticsDashboards.
The reason it failed on AL2 is because AL2 doesnt support node 18, thus falls back to node 14.23.1. This version of node does not support jsdom 22+ as it has a minimum requirement of node 16. Since we are still support CentOS7 and the proper deprecation hasnt come yet, assistantDashboards needs to use an older version of jsdom < 22. (@xluo-aws @zane-neo @wanglam @joshuali925)
#4379
https://github.com/opensearch-project/dashboards-assistant/blob/2.12/package.json#L24
https://github.com/jsdom/jsdom/blob/main/Changelog.md#2200


  log   [02:14:19.877] [fatal][root] /local/home/user/test/opensearch-dashboards-2.12.0/plugins/assistantDashboards/node_modules/jsdom/lib/jsdom/living/nodes/HTMLInputElement-impl.js:583
      this[filesSymbol] ||= FileList.createImpl(this._globalObject);
                        ^^^

SyntaxError: Unexpected token '||='
    at compileFunction (<anonymous>)
    at wrapSafe (internal/modules/cjs/loader.js:1029:16)
    at Module._compile (internal/modules/cjs/loader.js:1078:27)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1143:10)
    at Module.load (internal/modules/cjs/loader.js:979:32)
    at Function.Module._load (internal/modules/cjs/loader.js:819:12)
    at Module.require (internal/modules/cjs/loader.js:1003:19)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at Module.Hook._require.Module.require (/local/home/user/test/opensearch-dashboards-2.12.0/node_modules/require-in-the-middle/index.js:80:39)
    at require (internal/modules/cjs/helpers.js:107:18)
    at Object.<anonymous> (/local/home/user/test/opensearch-dashboards-2.12.0/plugins/assistantDashboards/node_modules/jsdom/lib/jsdom/living/generated/HTMLInputElement.js:1875:14)
    at Module._compile (internal/modules/cjs/loader.js:1114:14)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1143:10)

 FATAL  SyntaxError: Unexpected token '||='

Update: opensearch-project/dashboards-assistant#147

cc: @bbarani @prudhvigodithi

Thanks.

Answer 49 · 2024-02-14T02:40:18.000Z

New issue spot on DEB having discussion with @DarshitChanpura .

DEB is not able to pass the initial check in preinstall due to dpkg-query -W will treat 2.12 itself as a already installed version. dpkg-query -s is able to avoid that but will remove entry during upgrade, treating every installation as raw instead of upgrade. dpkg -l has the same issue as dpkg-query -W but resolve the issue with dpkg-query -s.

Awaiting @DarshitChanpura to give a final decision on this.

This issue was spotted during RC testing for deb, and since there is no concrete fool-proof way of stopping the installation during pre-install phase, I've raised a PR: #4453 to remove any changes made to preinst script for DEB distribution. For more details around methods tested please check PR description.

Answer 50 · 2024-02-14T16:25:49.000Z

PR's merged after 6th RC generated.
opensearch-project/dashboards-assistant#147
opensearch-project/security-analytics-dashboards-plugin#886

Answer 51 · 2024-02-14T16:52:03.000Z

@prudhvigodithi For docker, without security, you can modify the template to skip -e DISABLE_INSTALL_DEMO_CONFIG=true as it is disabled by default with this new rc when security is disabled.

docker pull opensearchstaging/opensearch:2.12.0.9408 && docker run -it -p 9200:9200 -e "discovery.type=single-node"  -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9408

Answer 52 · 2024-02-14T18:06:18.000Z

Awaiting merge @prudhvigodithi :

Answer 53 · 2024-02-14T19:14:48.000Z

we will merge this PR opensearch-project/ml-commons#2094 to 2.12

Answer 54 · 2024-02-14T20:00:12.000Z

2.12.0 Performance comparison with 2.11.0

While there is no performance impact on indexing throughput, we are seeing massive gains in overall and certain aggregate query metrics.

http_logs is seeing ~40% improvement in overall search query latencies. Major contribution coming from ~90% reduction in `hourly_agg` query latency.

nyc_taxis is seeing ~10%-15% improvement in overall query latency, while there is ~90% improvement in `autohisto_agg` and `date_histogram_agg` queries.

Answer 55 · 2024-02-14T22:07:05.000Z

[2.12.0 Release] Current Status - 02/14/2024

Most recent Build details:

Most recent OpenSearch build: 🟢
Most recent OpenSearch Dashboards build: 🔴

#4115 (comment)
After the most recent RC build a commit from the security analytics broke the OSD build, related issue opensearch-project/security-analytics-dashboards-plugin#890, PR pending to fix the issue opensearch-project/security-analytics-dashboards-plugin#891
OS is green at this point.

Integration test issues:

Plugin teams please go through the issues and try to close them as soon as possible
https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av2.12.0+label%3Aautocut+%5BAUTOCUT%5D+in%3Atitle+

OpenSearch:

tar x64: CCR and neural-search failed
tar arm64: CCR, geospatial and neural-search failed
deb x64: CCR, neural-search and security-analytics
deb arm64: CCR, index-management, neural-search and security-analytics failed
windows x64: CCR, ml-commons and neural-search failed
rpm arm64: CCR, neural-search and security-analytics failed
rpm x64: CCR, neural-search and security-analytics failed

OpenSearch Dashboards:

tar x64: OSD, alertingDashboards, reportsDashboards, securityAnalyticsDashboards failed
tar arm64: OSD, alertingDashboards, reportsDashboards, securityAnalyticsDashboards failed
deb x64: OSD, alertingDashboards, reportsDashboards, securityAnalyticsDashboards failed
deb arm64: OSD, ganttChartDashboards, alertingDashboards, reportsDashboards, securityAnalyticsDashboards failed
Windows x64: alertingDashboards, anomalyDetectionDashboards, customImportMapDashboards, ganttChartDashboards, indexManagementDashboards, notificationsDashboards, observabilityDashboards, queryWorkbenchDashboards, reportsDashboards, securityAnalyticsDashboards failed
rpm x64: OSD, alertingDashboards, ganttChartDashboards, indexManagementDashboards, reportsDashboards, securityAnalyticsDashboards failed
rpm arm64: OSD, alertingDashboards, reportsDashboards, securityAnalyticsDashboards failed

Answer 56 · 2024-02-14T22:07:19.000Z

@prudhvigodithi few critical changes from ISM and ISM-DP were recently merged to v2.12:

ISM:

ISM-DP:

opensearch-project/index-management-dashboards-plugin#978

I've updated release notes as well:

Answer 57 · 2024-02-15T00:07:29.000Z

7th RC OpenSearch 9419 / OpenSearch Dashboards 7295 - 02/14/2024.

OpenSearch - Build 9419
OpenSearch Dashboards - Build 7295

Use the following Docker-Compose to setup a cluster

docker-compose.yml

  
version: '3'
services:
  opensearch-node1:
    image: opensearchstaging/opensearch:2.12.0.9419
    container_name: opensearch-node1
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node1
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
        hard: 65536
    volumes:
      - opensearch-data1:/usr/share/opensearch/data
    ports:
      - 9200:9200
      - 9600:9600 # required for Performance Analyzer
    networks:
      - opensearch-net
  opensearch-node2:
    image: opensearchstaging/opensearch:2.12.0.9419
    container_name: opensearch-node2
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node2
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536
        hard: 65536
    volumes:
      - opensearch-data2:/usr/share/opensearch/data
    networks:
      - opensearch-net
  opensearch-dashboards:
    image: opensearchstaging/opensearch-dashboards:2.12.0.7295
    container_name: opensearch-dashboards
    ports:
      - 5601:5601
    expose:
      - "5601"
    environment:
      OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
    networks:
      - opensearch-net
volumes:
  opensearch-data1:
  opensearch-data2:
networks:
  opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.12.0.9419

Start without security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9419 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e DISABLE_INSTALL_DEMO_CONFIG=true -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9419

Connect command curl https://localhost:9200/

Start with security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9419 && docker run -it -p 9200:9200 -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9419

Connect command curl --insecure https://localhost:9200/ -u 'admin:myStrongPassword123!'

OpenSearch-Dashboards docker 2.12.0.7295

Start without security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7295 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.12.0.7295

URL https://localhost:5601/

Start with security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7295 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.12.0.7295

URL https://localhost:5601/

Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9419 (Note: Windows version does not have performance analyzer plugin)
  - arm64 [manifest] [tar] [rpm][deb]
  - x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7295
  - arm64 [manifest] [tar][rpm][deb]
  - x64 [manifest] [tar][rpm] [deb] [windows]

Answer 58 · 2024-02-15T15:43:17.000Z

While there is no performance impact on indexing throughput, we are seeing massive gains in overall and certain aggregate query metrics

@rishabh6788 just to satisfy personal curiosity, how many runs we do (to make sure numbers are stable across them)? Thank you.

Answer 59 · 2024-02-15T17:34:30.000Z

@prudhvigodithi We are going to manually sign off on this release for neural-search after discussions in the release channel and approval from @bbarani
Issue with full context is here to be fixed before next release: opensearch-project/neural-search#596

Answer 60 · 2024-02-15T18:22:07.000Z

AD-Dashboard merged a PR into the 2.12 branch to fix the tests that failed after addressing this CVE - https://nvd.nist.gov/vuln/detail/CVE-2023-46308

Answer 61 · 2024-02-15T18:50:05.000Z

@reta The nightly runs for 2.11.0 and 2.12.0 have been running since 2.11.0 was released. We do one run a day and this has been running for past 3 months. Here's the performance graph of 2.11.0 vs 2.12.0 for past 4 months https://s12d.com/T6yK2_gh.
Post 2.12.0 release we will work on improving our public dashboards and make it more meaningful and easy to understand.

Answer 62 · 2024-02-15T23:25:07.000Z

Recent discovery on Windows failing certain test on Cypress with @junqiu-lei :

Certain link such as cy.visit(`${BASE_PATH}/app/maps-dashboards/create`); could not be accessed correctly by cypress. This only happens on Windows with electron 15 (chromium 94) bundled with cypress 9.5.4, only on Windows.
On Linux, the same cypress 9.5.4 version with bundled electron 15 (chromium 94) runs fine without any issues.
On Windows, we have to lock browser to chromium 114 or lower specifically to pass on cypress 9.5.4.
windows-chromium114-cypress954-maps-allpass-videos.log
Windows video recording issues with ffmpeg is due to missing desktop experience libs, that only available on the windows image instead of the current windows/servercore.

Solutions:

Remove BROWSER_PATH=electron on jenkinsfile on windows section specifically to unblock windows integTest runs. Since the windows image already pre-load with chromium 114 binary.
- #4457
(After 2.12.0) Change base windows image from windows/servercore:ltsc2019 to windows:ltsc2019 to unblock video recording.
(After 2.12.0) Remove video disable settings in ftrepo for Windows tests.
(After 2.12.0) Looking for ways to lock chromium to version 114 on all LINUX images to replace bundled electron. For example, if there is any chromium cli/binary installation available on npm or other package manager.
https://www.npmjs.com/package/download-chromium
- #4459

cc: @bbarani @prudhvigodithi

Thanks.

Answer 63 · 2024-02-15T23:25:51.000Z

skills repo merged some PR

opensearch-project/skills#231 fix IT
opensearch-project/skills#228 change missed backporting to 2.12

Answer 64 · 2024-02-16T00:06:18.000Z

8th RC OpenSearch 9424 / OpenSearch Dashboards 7301 - 02/15/2024.

OpenSearch - Build 9424
OpenSearch Dashboards - Build 7301

Use the following Docker-Compose to setup a cluster

docker-compose.yml

  
version: '3'
services:
  opensearch-node1:
    image: opensearchstaging/opensearch:2.12.0.9424
    container_name: opensearch-node1
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node1
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
        hard: 65536
    volumes:
      - opensearch-data1:/usr/share/opensearch/data
    ports:
      - 9200:9200
      - 9600:9600 # required for Performance Analyzer
    networks:
      - opensearch-net
  opensearch-node2:
    image: opensearchstaging/opensearch:2.12.0.9424
    container_name: opensearch-node2
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node2
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536
        hard: 65536
    volumes:
      - opensearch-data2:/usr/share/opensearch/data
    networks:
      - opensearch-net
  opensearch-dashboards:
    image: opensearchstaging/opensearch-dashboards:2.12.0.7301
    container_name: opensearch-dashboards
    ports:
      - 5601:5601
    expose:
      - "5601"
    environment:
      OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
    networks:
      - opensearch-net
volumes:
  opensearch-data1:
  opensearch-data2:
networks:
  opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.12.0.9424

Start without security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9424 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e DISABLE_INSTALL_DEMO_CONFIG=true -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9424

Connect command curl https://localhost:9200/

Start with security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9424 && docker run -it -p 9200:9200 -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9424

Connect command curl --insecure https://localhost:9200/ -u 'admin:myStrongPassword123!'

OpenSearch-Dashboards docker 2.12.0.7301

Start without security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7301 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.12.0.7301

URL https://localhost:5601/

Start with security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7301 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.12.0.7301

URL https://localhost:5601/

Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9424 (Note: Windows version does not have performance analyzer plugin)
  - arm64 [manifest] [tar] [rpm][deb]
  - x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7301
  - arm64 [manifest] [tar][rpm][deb]
  - x64 [manifest] [tar][rpm] [deb] [windows]

Answer 65 · 2024-02-16T00:39:28.000Z

Hello all, Go/No-Go call has been scheduled for 2.12.0 release tomorrow at 9am PT. We will go over the exit criteria for the release and get the votes to finalize the next steps.

Answer 66 · 2024-02-16T16:51:20.000Z

Release v2.12.0 Current Status

Coming from the latest RC build, following is the current status of 2.12.0 release.

Integration test failure issues:

Plugin teams please go through the issues and try to close them as soon as possible
https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av2.12.0+label%3Aautocut+%5BAUTOCUT%5D+in%3Atitle+

OpenSearch

The distribution build https://build.ci.opensearch.org//blue/organizations/jenkins/distribution-build-opensearch/detail/distribution-build-opensearch/9424/pipeline is SUCCESS

Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7905/pipeline
Distribution Type: x64 rpm
Failed Components: security-analytics, neural-search, cross-cluster-replication, sql
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7904/pipeline
Distribution Type: arm64 rpm
Failed Components: neural-search, cross-cluster-replication, security-analytics, alerting
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7903/pipeline
Distribution Type: x64 deb
Failed Components: security-analytics, cross-cluster-replication, neural-search, alerting
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7902/pipeline
Distribution Type: arm64 deb
Failed Components: neural-search, cross-cluster-replication, security-analytics
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7901/pipeline
Distribution Type: arm64 tar
Failed Components: ml-commons, neural-search
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7900/pipeline
Distribution Type: x64 zip
Failed Components: ml-commons, neural-search, cross-cluster-replication, asynchronous-search, flow-framework
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7899/pipeline
Distribution Type: x64 tar
Failed Components: neural-search

OpenSearch Docker Scan Results

The docker scan URL is https://build.ci.opensearch.org/job/docker-scan/2930/artifact/scan_docker_image.txt

OpenSearch Dashboards

The distribution build https://build.ci.opensearch.org//blue/organizations/jenkins/distribution-build-opensearch-dashboards/detail/distribution-build-opensearch-dashboards/7301/pipeline is SUCCESS

Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5614/pipeline
Distribution Type: osd-2.12.0-7301 zip
Failed Components: indexManagementDashboards, mlCommonsDashboards, alertingDashboards, reportsDashboards, securityAnalyticsDashboards, ganttChartDashboards, queryWorkbenchDashboards, observabilityDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5613/pipeline
Distribution Type: osd-2.12.0-7301 deb
Failed Components: OpenSearch-Dashboards, alertingDashboards, reportsDashboards, indexManagementDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5612/pipeline
Distribution Type: osd-2.12.0-7301 rpm
Failed Components: alertingDashboards, OpenSearch-Dashboards, reportsDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5611/pipeline
Distribution Type: osd-2.12.0-7301 rpm
Failed Components: indexManagementDashboards, ganttChartDashboards, alertingDashboards, reportsDashboards, OpenSearch-Dashboards, observabilityDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5610/pipeline
Distribution Type: osd-2.12.0-7301 deb
Failed Components: ganttChartDashboards, OpenSearch-Dashboards, alertingDashboards, reportsDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5609/pipeline
Distribution Type: osd-2.12.0-7301 tar
Failed Components: OpenSearch-Dashboards, alertingDashboards, indexManagementDashboards, reportsDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5608/pipeline
Distribution Type: osd-2.12.0-7301 tar
Failed Components: OpenSearch-Dashboards, reportsDashboards, alertingDashboards, indexManagementDashboards

OpenSearch Dashboards Docker Scan Results

The docker scan URL is https://build.ci.opensearch.org/job/docker-scan/2929/artifact/scan_docker_image.txt

Pending PR’s with release label

https://github.com/issues?q=is%3Aopen+is%3Apr+user%3Aopensearch-project+label%3Av2.12.0+

Pending Issues with release label

https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av2.12.0+

Answer 67 · 2024-02-16T17:28:09.000Z

@prudhvigodithi fix for indexManagementDashboards

opensearch-project/opensearch-dashboards-functional-test#1091

cc: @vikasvb90

Answer 68 · 2024-02-16T17:29:58.000Z

We merged opensearch-project/dashboards-reporting#296 to fix Reporting button missing issue. Can we please take this change in today's RC generation? It's required to fix integration tests opensearch-project/opensearch-dashboards-functional-test#1089.

Answer 69 · 2024-02-16T17:44:27.000Z

The integration test from 8th RC Build detected failures in the following components

Fore more details please check: #4115 (comment)

OpenSearch

Repo	Integ-Tests	AUTOCUT Issue	Comments
security-analytics	🔴	opensearch-project/security-analytics#792
neural-search	🟢	opensearch-project/neural-search#547	Manually signed-off as per this comment
cross-cluster-replication	🟢	opensearch-project/cross-cluster-replication#1317	Manually signed-off per this comment
sql	🟢	opensearch-project/sql#2517	opensearch-project/sql#2517 (comment)
alerting	🔴	opensearch-project/alerting#1381
ml-commons	🟢	opensearch-project/ml-commons#1789	Confirmed by the team as flaky tests and its tracked here. Manually signed off per this comment
asynchronous-search	🟢	opensearch-project/asynchronous-search#534	opensearch-project/asynchronous-search#534 (comment)
anomaly-detection (concurrent search enabled)	🔴	opensearch-project/anomaly-detection#1162	Anomaly detection with concurrent search failure is a known issue and its tracked in opensearch-project/OpenSearch#12331. For 2.12, the workaround / shortcomings will be addressed by documenting the gaps. Need further discussion with concurrent search team to flip it back to green. Pending on this PR

OpenSearch Dashboards

Repo	Integ-Tests	AUTOCUT Issue	Comments
OpenSearch-Dashboards	🔴	opensearch-project/OpenSearch-Dashboards#5633
indexManagementDashboards	🔴	opensearch-project/index-management-dashboards-plugin#968
mlCommonsDashboards	🟢	opensearch-project/ml-commons-dashboards#301	opensearch-project/ml-commons-dashboards#301 (comment)
alertingDashboards	🔴	opensearch-project/alerting-dashboards-plugin#867
reportsDashboards	🟢	opensearch-project/dashboards-reporting#272	Manually signed-off per this comment
securityAnalyticsDashboards	🟢	opensearch-project/security-analytics-dashboards-plugin#857	opensearch-project/security-analytics-dashboards-plugin#857 (comment)
ganttChartDashboards	🟢	opensearch-project/dashboards-visualizations#322	Manually signed-off per this comment
queryWorkbenchDashboards	🟢	opensearch-project/dashboards-query-workbench#259	Manually signed-off per this comment
observabilityDashboards	🟢	opensearch-project/dashboards-observability#1321	opensearch-project/dashboards-observability#1321 (comment)

Answer 70 · 2024-02-16T18:19:51.000Z

Anomaly detection with concurrent search failure is a known issue and its tracked in OpenSearch repo.. For 2.12, the workaround / shortcomings will be addressed by documentating the gaps.

Answer 71 · 2024-02-16T18:31:18.000Z

@prudhvigodithi We have 3 PRs on functional test repo for cypress updates on:

ganttChartDashboards: opensearch-project/opensearch-dashboards-functional-test#1090
reportsDashboards: opensearch-project/opensearch-dashboards-functional-test#1089
observabilityDashboards: opensearch-project/opensearch-dashboards-functional-test#1088

cc: @anirudha @ashwin-pc @kavilla

Answer 72 · 2024-02-16T19:30:18.000Z

@prudhvigodithi Piggybacking off of @ps48's comment, have one more PR on the functional test repository.

queryWorkbenchDashboards: opensearch-project/opensearch-dashboards-functional-test#1092

cc: @anirudha @ashwin-pc @kavilla

Answer 73 · 2024-02-16T19:38:59.000Z

ml-commons IT tests are due to flaky tests issue tracked here opensearch-project/ml-commons#2124. This is a known issue and often times not reproducable from local environment. In the worst case, only some IT tests needs tuning for time_out parameters, etc, which is not a blocker for any features in 2.12.

Answer 74 · 2024-02-16T19:49:07.000Z

ml-commons IT tests are due to flaky tests issue tracked here opensearch-project/ml-commons#2124. This is a known issue and often times not reproducable from local environment. In the worst case, only some IT tests needs tuning for time_out parameters, etc, which is not a blocker for any features in 2.12.

Update the ml-commons to green.

Answer 75 · 2024-02-16T20:05:05.000Z

sql plugin issue is a known issue opensearch-project/sql#1275 which happens only when integ tests are run using few timezones. The timezones are randomly selected and so the results of that particular test are flaky. The issue shouldn't be a blocker. I will spend some time today on the fix.
cc: @bbarani @ps48 @prudhvigodithi @anirudha

Answer 76 · 2024-02-16T20:27:14.000Z

@vamsi-amazon

sql plugin issue is a known issue opensearch-project/sql#1275 which happens only when integ tests are run using few timezones. The timezones are randomly selected and so the results of that particular test are flaky. The issue shouldn't be a blocker. I will spend some time today on the fix. cc: @bbarani @ps48 @prudhvigodithi @anirudha

Are you signing-off on the test failures related to sql plugin? Can I update the table?

Answer 77 · 2024-02-16T21:28:19.000Z

@bbarani Yes. Also, I just raised the PR for fix here: opensearch-project/sql#2522.
Its not a code fix rather fix in the integ test itself. Should I backport to 2.12 branch?

Answer 78 · 2024-02-16T21:28:53.000Z

@bbarani Yes. Also, I just raised the PR for fix here: opensearch-project/sql#2522. Its not a code fix rather fix in the integ test itself. Should I backport to 2.12 branch?

Yes please do. We will generate a new RC at 4pm PT today.

Answer 79 · 2024-02-16T22:36:56.000Z

Merged the PR. thanks @bbarani cc: @anirudha @ps48

Answer 80 · 2024-02-17T00:04:05.000Z

9th RC OpenSearch 9430 / OpenSearch Dashboards 7307 - 02/16/2024.

OpenSearch - Build 9430
OpenSearch Dashboards - Build 7307

Use the following Docker-Compose to setup a cluster

docker-compose.yml

  
version: '3'
services:
  opensearch-node1:
    image: opensearchstaging/opensearch:2.12.0.9430
    container_name: opensearch-node1
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node1
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
        hard: 65536
    volumes:
      - opensearch-data1:/usr/share/opensearch/data
    ports:
      - 9200:9200
      - 9600:9600 # required for Performance Analyzer
    networks:
      - opensearch-net
  opensearch-node2:
    image: opensearchstaging/opensearch:2.12.0.9430
    container_name: opensearch-node2
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node2
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536
        hard: 65536
    volumes:
      - opensearch-data2:/usr/share/opensearch/data
    networks:
      - opensearch-net
  opensearch-dashboards:
    image: opensearchstaging/opensearch-dashboards:2.12.0.7307
    container_name: opensearch-dashboards
    ports:
      - 5601:5601
    expose:
      - "5601"
    environment:
      OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
    networks:
      - opensearch-net
volumes:
  opensearch-data1:
  opensearch-data2:
networks:
  opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.12.0.9430

Start without security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9430 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e DISABLE_INSTALL_DEMO_CONFIG=true -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9430

Connect command curl https://localhost:9200/

Start with security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9430 && docker run -it -p 9200:9200 -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9430

Connect command curl --insecure https://localhost:9200/ -u 'admin:myStrongPassword123!'

OpenSearch-Dashboards docker 2.12.0.7307

Start without security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7307 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.12.0.7307

URL https://localhost:5601/

Start with security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7307 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.12.0.7307

URL https://localhost:5601/

Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9430 (Note: Windows version does not have performance analyzer plugin)
  - arm64 [manifest] [tar] [rpm][deb]
  - x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7307
  - arm64 [manifest] [tar][rpm][deb]
  - x64 [manifest] [tar][rpm] [deb] [windows]

Answer 81 · 2024-02-17T03:02:49.000Z

Hi team, I just merge a PR for skills plugin here https://github.com/opensearch-project/skills/pull/232/files. Will it be in the 2.12 release?

Answer 82 · 2024-02-17T07:30:49.000Z

Release v2.12.0 Current Status

Coming from the latest 8th RC build, following is the current status of 2.12.0 release.

Integration test failure issues:

Plugin teams please go through the issues and try to close them as soon as possible
https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av2.12.0+label%3Aautocut+%5BAUTOCUT%5D+in%3Atitle+

OpenSearch

The distribution build https://build.ci.opensearch.org//blue/organizations/jenkins/distribution-build-opensearch/detail/distribution-build-opensearch/9430/pipeline is SUCCESS

Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7915/pipeline
Distribution Type: arm64 rpm
Failed Components: alerting, neural-search, security-analytics, cross-cluster-replication
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7914/pipeline
Distribution Type: arm64 deb
Failed Components: security-analytics, neural-search, cross-cluster-replication
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7913/pipeline
Distribution Type: x64 zip
Failed Components: index-management, ml-commons, neural-search, cross-cluster-replication, alerting
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7912/pipeline
Distribution Type: x64 deb
Failed Components: cross-cluster-replication, security-analytics, neural-search
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7911/pipeline
Distribution Type: x64 tar
Failed Components: neural-search, security-analytics
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7910/pipeline
Distribution Type: x64 rpm
Failed Components: cross-cluster-replication, neural-search, security-analytics, index-management
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/7909/pipeline
Distribution Type: arm64 tar
Failed Components: ml-commons, neural-search

Docker Scan Results

The docker scan URL is https://build.ci.opensearch.org/job/docker-scan/2934/artifact/scan_docker_image.txt

OpenSearch Dashboards

The distribution build https://build.ci.opensearch.org//blue/organizations/jenkins/distribution-build-opensearch-dashboards/detail/distribution-build-opensearch-dashboards/7307/pipeline is SUCCESS

Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5621/pipeline
Distribution Type: osd-2.12.0-7307 zip
Failed Components: alertingDashboards, ganttChartDashboards, assistantDashboards, queryWorkbenchDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5620/pipeline
Distribution Type: osd-2.12.0-7307 rpm
Failed Components: OpenSearch-Dashboards, indexManagementDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5619/pipeline
Distribution Type: osd-2.12.0-7307 rpm
Failed Components: OpenSearch-Dashboards, indexManagementDashboards, alertingDashboards, reportsDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5618/pipeline
Distribution Type: osd-2.12.0-7307 deb
Failed Components: OpenSearch-Dashboards, alertingDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5617/pipeline
Distribution Type: osd-2.12.0-7307 tar
Failed Components: OpenSearch-Dashboards, alertingDashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5616/pipeline
Distribution Type: osd-2.12.0-7307 deb
Failed Components: alertingDashboards, OpenSearch-Dashboards
Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5615/pipeline
Distribution Type: osd-2.12.0-7307 tar
Failed Components: OpenSearch-Dashboards

Docker Scan Results

The docker scan URL is https://build.ci.opensearch.org/job/docker-scan/2935/artifact/scan_docker_image.txt

Pending PR’s with release label

https://github.com/issues?q=is%3Aopen+is%3Apr+user%3Aopensearch-project+label%3Av2.12.0+

Pending Issues with release label

https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av2.12.0+

Answer 83 · 2024-02-17T07:44:07.000Z

Hi team, I just merge a PR for skills plugin here https://github.com/opensearch-project/skills/pull/232/files. Will it be in the 2.12 release?

Hey @xinyual the RC is already successfully built. We have the Go/No-Go call for 2.12.0 release scheduled on Feb 19th at 9am PT. We will go over the exit criteria for the release and get the votes to finalize the next steps.

Thank you

Answer 84 · 2024-02-19T16:21:05.000Z

Backwards Compatibility Tests.

BWC test job triggered for 8th RC
https://build.ci.opensearch.org/blue/organizations/jenkins/bwc-test/detail/bwc-test/4845/pipeline


2024-02-17 01:30:33 ERROR    | alerting             | with-security        | FAIL  |

2024-02-17 01:30:33 ERROR    | anomaly-detection    | with-security        | FAIL  |

2024-02-17 01:30:33 ERROR    | index-management     | with-security        | FAIL  |

2024-02-17 01:30:33 INFO     | notifications        | with-security        | PASS  |

2024-02-17 01:30:33 ERROR    | opensearch-observability | with-security        | FAIL  |

2024-02-17 01:30:33 ERROR    | sql                  | with-security        | FAIL  |

There is an open META issue for plugins to onboard to the BWC test framework #3671, so at this point the assumption is the BWC tests are executed at the plugin CI level.
@bbarani

Answer 85 · 2024-02-19T16:40:04.000Z

Documentation is GREEN for the 2.12 release.

Answer 86 · 2024-02-19T16:55:07.000Z

Tracking CCR Plugin integ test failure issue in #1334 Issue. Tests are passing locally but there are some admin credential issues in release CI with latest changes. By this we're manually signing-off on CCR plugin

Answer 87 · 2024-02-19T17:39:11.000Z

ISM dashboard plugin has a flaky test failure for which the fix has been raised but will take some time to get to approval stage
opensearch-project/index-management-dashboards-plugin#997
Giving manual signoff on index management dashboard

Answer 88 · 2024-02-19T17:46:39.000Z

Tracking flaky integ tests on dashboardsReports, queryWorkbench and ganttCharts here: opensearch-project/opensearch-dashboards-functional-test#1113. We manually tested these failures manually. We're giving manual sign-off.

Answer 89 · 2024-02-19T18:11:38.000Z

Tracking flaky integ tests on dashboardsReports, queryWorkbench and ganttCharts here: opensearch-project/opensearch-dashboards-functional-test#1113. We manually tested these failures manually. We're giving manual sign-off.

Updated ganttChartDashboards, queryWorkbenchDashboards and reportsDashboards to green.
#4115 (comment)

Answer 90 · 2024-02-19T18:52:00.000Z

The vote was No-go for 2.12.0 release as we couldn't clear the exit criteria for integration tests.

Next Go-No go call is scheduled for tomorrow (Feb 20 2024) morning at 9am PT.

Answer 91 · 2024-02-19T19:47:48.000Z

For OpenSearch Dashboards:

We are seeing test failures on VisBuilder tests. When looking at the results we see a component overlaying it with the classname: vbConfig.

Which aligns to: opensearch-project/dashboards-observability#1135.

After uninstalling the observability plugin:

Answer 92 · 2024-02-19T20:06:33.000Z

For OpenSearch Dashboards:

We are seeing test failures on VisBuilder tests. When looking at the results we see a component overlaying it with the classname: vbConfig.
Which aligns to: [opensearch-project/dashboards-observability#1135](https://github.com/opensearch-project/dashboards-observability/pull/1135).
After uninstalling the observability plugin:

@vamsi-amazon @anirudha @joshuali925 Can you please comment on this issue?

Answer 93 · 2024-02-19T20:25:18.000Z

@mengweieric i think you can use a different classname on
https://github.com/opensearch-project/dashboards-observability/blob/2409cf7ddfaa255653a5156d0fc9f3a7d6a9457d/public/components/event_analytics/explorer/visualizations/config_panel/config_panes/config_controls/data_configurations_panel.scss#L44

Answer 94 · 2024-02-19T21:17:10.000Z

As discussed while debugging AD integ test failure, the issue is found to be generic with composite aggregation when concurrent segment search is enabled. So we are disabling concurrent search for composite aggregation as part of 2.12. Tracking PR for main branch: opensearch-project/OpenSearch#12375

PR for 2.12 branch: opensearch-project/OpenSearch#12380

Answer 95 · 2024-02-20T00:47:54.000Z

10th RC OpenSearch 9445 / OpenSearch Dashboards 7326 - 02/19/2024.

OpenSearch - Build 9445
OpenSearch Dashboards - Build 7326

Use the following Docker-Compose to setup a cluster

docker-compose.yml

  
version: '3'
services:
  opensearch-node1:
    image: opensearchstaging/opensearch:2.12.0.9445
    container_name: opensearch-node1
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node1
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
        hard: 65536
    volumes:
      - opensearch-data1:/usr/share/opensearch/data
    ports:
      - 9200:9200
      - 9600:9600 # required for Performance Analyzer
    networks:
      - opensearch-net
  opensearch-node2:
    image: opensearchstaging/opensearch:2.12.0.9445
    container_name: opensearch-node2
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node2
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123@456"
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536
        hard: 65536
    volumes:
      - opensearch-data2:/usr/share/opensearch/data
    networks:
      - opensearch-net
  opensearch-dashboards:
    image: opensearchstaging/opensearch-dashboards:2.12.0.7326
    container_name: opensearch-dashboards
    ports:
      - 5601:5601
    expose:
      - "5601"
    environment:
      OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
    networks:
      - opensearch-net
volumes:
  opensearch-data1:
  opensearch-data2:
networks:
  opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.12.0.9445

Start without security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9445 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e DISABLE_INSTALL_DEMO_CONFIG=true -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.12.0.9445

Connect command curl https://localhost:9200/

Start with security

Docker command

docker pull opensearchstaging/opensearch:2.12.0.9445 && docker run -it -p 9200:9200 -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' -e "discovery.type=single-node" opensearchstaging/opensearch:2.12.0.9445

Connect command curl --insecure https://localhost:9200/ -u 'admin:myStrongPassword123!'

OpenSearch-Dashboards docker 2.12.0.7326

Start without security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7326 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.12.0.7326

URL https://localhost:5601/

Start with security

Docker command

docker pull opensearchstaging/opensearch-dashboards:2.12.0.7326 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.12.0.7326

URL https://localhost:5601/

Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9445 (Note: Windows version does not have performance analyzer plugin)
  - arm64 [manifest] [tar] [rpm][deb]
  - x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7326
  - arm64 [manifest] [tar][rpm][deb]
  - x64 [manifest] [tar][rpm] [deb] [windows]

Answer 96 · 2024-02-20T05:10:42.000Z

The integration test from 10th RC Build detected failures in the following components

OpenSearch

Repo	Integ-Tests	AUTOCUT Issue	Comments
security-analytics	🟢	opensearch-project/security-analytics#792	looks flaky as passed for x64 tar, Manual sign off in the Go/No-Go call by @praveensameneni.
cross-cluster-replication	🟢	opensearch-project/cross-cluster-replication#1317	Manually signed-off as per this comment
neural-search	🟢	opensearch-project/neural-search#547	Fail with and without concurrent search enabled, Manually signed-off as per this comment, recent integ build passed.
alerting	🟢	opensearch-project/alerting#1381	Manual sign off in the Go/No-Go call by @praveensameneni.
ml-commons	🟢	opensearch-project/ml-commons#1789	Fails with concurrent search enabled, looks flaky as passed for x64 tar and failed for tar arm64. Passed on regular integration test without concurrent search enabled. Confirmed by the team as flaky tests and its tracked here. Manually signed off per this comment, manual sign off from comment.

OpenSearch Dashboards

Repo	Integ-Tests	AUTOCUT Issue	Comments
OpenSearch-Dashboards	🟢	opensearch-project/OpenSearch-Dashboards#5633	Manually signed-off as per comment
reportsDashboards	🟢	opensearch-project/dashboards-reporting#306	Manually signed-off as per comment
ganttChartDashboards	🟢	opensearch-project/dashboards-visualizations#345	Manually signed-off as per comment
alertingDashboards	🟢	opensearch-project/alerting-dashboards-plugin#867	Manual sign off from comment.
indexManagementDashboards	🟢	opensearch-project/index-management-dashboards-plugin#968	Manually signed-off as per comment and comment

Answer 97 · 2024-02-20T05:50:28.000Z

Providing manual sign off for alertingDashboards.

The tests pass with security in this run from earlier today - https://build.ci.opensearch.org/blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5633/pipeline/117#step-638-log-678

And the tests pass without security in this run from 3 days ago - https://build.ci.opensearch.org/blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5621/pipeline/#step-1046-log-162

Since the last new changes merged to the 2.12 branch 5 days ago, this suggests the tests are flaky. PR opensearch-project/opensearch-dashboards-functional-test#1115 updated our functional test repo to increase wait times as we noticed it was taking a long time for pages to load, which was causing tests to fail. The tests became much more reliable when executed locally after these changes.

Answer 98 · 2024-02-20T17:27:50.000Z

For OpenSearch Dashboards,

When looking without-security results. I see the following:

    Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  core-opensearch-dashboards/opensear       94ms        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/aa                                                         │
  │    a_before.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:10        4        4        -        -        - │
  │    ch-dashboards/apps/data_explorer/da                                                         │
  │    ta_source_selector.spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:12        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/da                                                         │
  │    te_nanos_mixed.spec.js                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:11        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/da                                                         │
  │    te_nanos.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      01:36        3        3        -        -        - │
  │    ch-dashboards/apps/data_explorer/di                                                         │
  │    scover_histogram.spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      01:42       17       14        -        3        - │
  │    ch-dashboards/apps/data_explorer/di                                                         │
  │    scover.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:52        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/do                                                         │
  │    c_navigation.spec.js                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:21        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/do                                                         │
  │    c_table.spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:08        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/er                                                         │
  │    rors.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:47        6        6        -        -        - │
  │    ch-dashboards/apps/data_explorer/fi                                                         │
  │    eld_data.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:47        5        5        -        -        - │
  │    ch-dashboards/apps/data_explorer/fi                                                         │
  │    eld_visualize.spec.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:34        3        3        -        -        - │
  │    ch-dashboards/apps/data_explorer/fi                                                         │
  │    lter_editor.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:11        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/in                                                         │
  │    dex_pattern_with_encoded_id.spec.js                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:13        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/in                                                         │
  │    dex_pattern_without_field.spec.js                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:16        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/in                                                         │
  │    spector.spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:14        4        3        -        1        - │
  │    ch-dashboards/apps/data_explorer/la                                                         │
  │    rge_string.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear       34ms       11        -        -       11        - │
  │    ch-dashboards/apps/data_explorer/sa                                                         │
  │    ved_queries.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:37        6        6        -        -        - │
  │    ch-dashboards/apps/data_explorer/sh                                                         │
  │    ared_links.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:06        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/si                                                         │
  │    debar.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:07        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/so                                                         │
  │    urce_filter.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:05        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/zz                                                         │
  │    z_after.spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:35        5        5        -        -        - │
  │    ch-dashboards/apps/vis_builder/basi                                                         │
  │    c.spec.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  core-opensearch-dashboards/opensear      04:19        4        2        2        -        - │
  │    ch-dashboards/apps/vis_builder/dash                                                         │
  │    board.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:21        4        4        -        -        - │
  │    ch-dashboards/apps/vis_builder/expe                                                         │
  │    rimental.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:13        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/area.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:14        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/bar.spec.js                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:13        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/line.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:12        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/metric.spec.js                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:16        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/table.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:22        4        4        -        -        - │
  │    ch-dashboards/apps/vis_type_table/b                                                         │
  │    asic.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      01:02        9        9        -        -        - │
  │    ch-dashboards/apps/vis_type_table/d                                                         │
  │    ata.spec.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  core-opensearch-dashboards/opensear      01:43        4        3        1        -        - │
  │    ch-dashboards/apps/vis_type_table/e                                                         │
  │    mbed.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:41       11       11        -        -        - │
  │    ch-dashboards/apps/vis_type_table/o                                                         │
  │    ptions.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear       16ms        7        -        -        7        - │
  │    ch-dashboards/apps/vis_type_table/s                                                         │
  │    plit.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  core-opensearch-dashboards/opensear      03:28        2        -        2        -        - │
  │    ch-dashboards/apps/vis-augmenter/da                                                         │
  │    shboard_spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        2ms        -        -        -        -        - │
  │    ch-dashboards/dashboard_sample_data                                                         │
  │    _with_datasource_spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:38       34       34        -        -        - │
  │    ch-dashboards/dashboard_sanity_test                                                         │
  │    _spec.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/dashboard_share_copy_                                                         │
  │    link_test.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/datasource-management                                                         │
  │    -plugin/1_create_datasource.spec.js                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/datasource-management                                                         │
  │    -plugin/2_datasource_table.spec.js                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/datasource-management                                                         │
  │    -plugin/3_update_datasource.spec.js                                                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  3 of 41 failed (7%)                      23:41      165      138        5       22        -

Running locally, the first two spec files succeed every time. With and without security:

.

The last test failure is due to it trying to open the doc site from the branch 2.12 in the test: https://opensearch.org/docs/2.12/ which doesn't exist yet.

The last one I will associate a PR to ensure that it doesn't kill the test when the doc site tries to open but spins. And I will fix the flakiness of the first two but not seeing anything that worries me there. Manual sign off for me.

Answer 99 · 2024-02-20T18:22:37.000Z

For ml-commons, the test looks flaky as they only failed on ARM64. From the log , seems all tests failed, that's not normal. I guess the integ test cluster has some issue. All failed test throw same error Connection refused, that seems test cluster not ready or has some issue. Possible reason is the cluster heap size is too small and deploying ML model crashed the cluster.

Answer 100 · 2024-02-20T19:26:15.000Z

For ml-commons, the test looks flaky as they only failed on ARM64. From the log , seems all tests failed, that's not normal. I guess the integ test cluster has some issue. All failed test throw same error Connection refused, that seems test cluster not ready or has some issue. Possible reason is the cluster heap size is too small and deploying ML model crashed the cluster.

The stderr log has the following:

/opt/java/openjdk-17/bin/java: relocation error: /tmp/tmp3mw_9esm/1/local-test-cluster/opensearch-2.12.0/data/ml_cache/pytorch/1.13.1-cpu-precxx11-linux-aarch64/libstdc++.so.6: symbol __cxa_thread_atexit_impl, version GLIBC_2.18 not defined in file libc.so.6 with link time reference

@ylwu-amzn

Release OpenSearch and OpenSearch Dashboards 2.12.0

This Release Issue

Entrance Criteria

OpenSearch 2.12.0 exit criteria status:

OpenSearch-Dashboards 2.12.0 exit criteria status:

Preparation

Campaigns

Release Branch and Version Increment - End of February 4th, 2024

Feature Freeze - End of February 5th, 2024

Code Complete - End of February 5th, 2024

Release Candidate Creation and Testing - First RC Generated (release window opens) on February 6th, 2024

Performance testing validation - End of February 17th, 2024

Pre Release - End of February 20th, 2024

Release - February 20th, 2024

Release Checklist.

Pre-Release activities

Release activities

Post-Release activities

Post Release

Components

OpenSearch

OpenSearch Dashboards

Documentation

1st RC build and results - 02/06/2024

2nd RC build and results - 02/07/2024

OpenSearch CommitID(after 2023-11-30) & Release Notes info

OpenSearch Dashboards CommitID(after 2023-11-30) & Release Notes info

Release update 02/08/2024

OpenSearch components missing release notes

OpenSearch Dashboards components missing release notes

Release update 02/08/2024

OpenSearch components missing release notes

OpenSearch Dashboards components missing release notes

3rd RC build blockers - 02/09/2024

3rd RC build blockers - 02/09/2024 (4PM PT)

4th RC OpenSearch 9396 / OpenSearch Dashboards 7278 - 02/12/2024.

OpenSearch components missing release notes

OpenSearch Dashboards components missing release notes

5th RC OpenSearch 9399 / OpenSearch Dashboards 7280 - 02/12/2024.

OpenSearch components missing release notes

OpenSearch Dashboards components missing release notes

6th RC OpenSearch 9408 / OpenSearch Dashboards 7286 - 02/13/2024.

Components missing the Release notes

Update on this issue

Update on this issue

2.12.0 Performance comparison with 2.11.0

http_logs is seeing ~40% improvement in overall search query latencies. Major contribution coming from ~90% reduction in hourly_agg query latency.

nyc_taxis is seeing ~10%-15% improvement in overall query latency, while there is ~90% improvement in autohisto_agg and date_histogram_agg queries.

[2.12.0 Release] Current Status - 02/14/2024

Most recent Build details:

Integration test issues:

OpenSearch:

OpenSearch Dashboards:

Integ test failures with Concurrent Search enabled

Pending PR’s with 2.12.0 label (14 Open):

Pending issues (160 open issues with 2.12.0 label):

7th RC OpenSearch 9419 / OpenSearch Dashboards 7295 - 02/14/2024.

8th RC OpenSearch 9424 / OpenSearch Dashboards 7301 - 02/15/2024.

Release v2.12.0 Current Status

Integration test failure issues:

OpenSearch

OpenSearch Docker Scan Results

OpenSearch Dashboards

OpenSearch Dashboards Docker Scan Results

Pending PR’s with release label

Pending Issues with release label

The integration test from 8th RC Build detected failures in the following components

OpenSearch

OpenSearch Dashboards

9th RC OpenSearch 9430 / OpenSearch Dashboards 7307 - 02/16/2024.

Release v2.12.0 Current Status

Integration test failure issues:

OpenSearch

Docker Scan Results

OpenSearch Dashboards

Docker Scan Results

Pending PR’s with release label

Pending Issues with release label

Backwards Compatibility Tests.

10th RC OpenSearch 9445 / OpenSearch Dashboards 7326 - 02/19/2024.

http_logs is seeing ~40% improvement in overall search query latencies. Major contribution coming from ~90% reduction in `hourly_agg` query latency.

nyc_taxis is seeing ~10%-15% improvement in overall query latency, while there is ~90% improvement in `autohisto_agg` and `date_histogram_agg` queries.