Template for creating OpenSearch Plugins
This Repo is a GitHub Template repository (Learn more about that). Using it would create a new repo that is the boilerplate code required for an OpenSearch Plugin. This plugin on its own would not add any functionality to OpenSearch, but it is still ready to be installed. It comes packaged with:
- Integration tests of two types: Yaml and IntegTest.
- Empty unit tests file
- Notice and License files (Apache License, Version 2.0)
- A
build.gradle
file supporting this template's current state.
- Create your plugin repo using this template
- Fix up the template to match your new plugin requirements
- License
- Copyright
Create your plugin repo using this template
Click on "Use this Template"
Name the repository, and provide a description.
Depending on the plugin relationship with the OpenSearch organization we currently recommend the following naming conventions and optional follow-up checks:
Official plugins
For the official plugins that live within the OpenSearch organization (i.e. they are included in OpenSearch/plugins/ or OpenSearch/modules/ folder), and which share the same release cycle as OpenSearch itself:
- Do not include the word
plugin
in the repo name (e.g. job-scheduler) - Use lowercase repo names
- Use spinal case for repo names (e.g. job-scheduler)
- Do not include the word
OpenSearch
orOpenSearch Dashboards
in the repo name - Provide a meaningful description, e.g.
An OpenSearch Dashboards plugin to perform real-time and historical anomaly detection on OpenSearch data
.
Thirdparty plugins
For the 3rd party plugins that are maintained as independent projects in separate GitHub repositories with their own release cycles the recommended naming convention should follow the same rules as official plugins with some exceptions and few follow-up checks:
- Inclusion of the words like
OpenSearch
orOpenSearch Dashboard
(and in reasonable cases evenplugin
) are welcome because they can increase the chance of discoverability of the repository - Check the plugin versioning policy is documented and help users know which versions of the plugin are compatible and recommended for specific versions of OpenSearch
- Review CONTRIBUTING.md document which is by default tailored to the needs of Amazon Web Services developer teams. You might want to update or further customize specific parts related to:
- Code of Conduct (if you do not already have CoC policy then there are several options to start with, such as Contributor Covenant),
- Security Policy (you should let users know how they can safely report security vulnerabilities),
- Check if you need explicit part about Trademarks and Attributions (if you use any registered or non-registered trademarks we recommend following applicable "trademark-use" documents provided by respective trademark owners)
Fix up the template to match your new plugin requirements
This is the file tree structure of the source code, as you can see there are some things you will want to change.
`-- src
|-- main
| `-- java
| `-- org
| `-- opensearch
| `-- path
| `-- to
| `-- plugin
| `-- RenamePlugin.java
|-- test
| `-- java
| `-- org
| `-- opensearch
| `-- path
| `-- to
| `-- plugin
| |-- RenamePluginIT.java
| `-- RenameTests.java
`-- yamlRestTest
|-- java
| `-- org
| `-- opensearch
| `-- path
| `-- to
| `-- plugin
| `-- RenameClientYamlTestSuiteIT.java
`-- resources
`-- rest-api-spec
`-- test
`-- 10_basic.yml
Plugin Name
Now that you have named the repo, you can change the plugin class RenamePlugin.java
to have a meaningful name, keeping the Plugin
suffix.
Change RenamePluginIT.java
, RenameTests.java
, and RenameClientYamlTestSuiteIT.java
accordingly, keeping the PluginIT
, Tests
, and ClientYamlTestSuiteIT
suffixes.
Plugin Path
Notice these paths in the source tree:
-- path
`-- to
`-- plugin
Let's call this our plugin path, as the plugin class would be installed in OpenSearch under that path. This can be an existing path in OpenSearch, or it can be a unique path for your plugin. We recommend changing it to something meaningful. Change all these path occurrences to match the path you chose for your plugin:
- Chose a new plugin path
- Go to the
build.gradle
file and update thepathToPlugin
param with the path you've chosen (use dotted notation) - Run
./gradlew preparePluginPathDirs
in the terminal - Move the java classes into the new directories (will require to edit the
package
name in the files as well) - Delete the old directories
build.gradle
file
Update the Update the following section, using the new repository name and description, plugin class name, and plugin path:
def pluginName = 'rename' // Can be the same as new repo name except including words `plugin` or `OpenSearch` is discouraged
def pluginDescription = 'Custom plugin' // Can be same as new repo description
def pathToPlugin = 'path.to.plugin' // The path you chose for the plugin
def pluginClassName = 'RenamePlugin' // The plugin class name
Next update the version of OpenSearch you want the plugin to be installed into. Change the following param:
ext {
opensearch_version = "1.0.0-beta1" // <-- change this to the version your plugin requires
}
Update the tests
Notice that in the tests we are checking that the plugin was installed by sending a GET /_cat/plugins
request to the cluster and expecting rename
to be in the response.
In order for the tests to pass you must change rename
in RenamePluginIT.java
and in 10_basic.yml
to be the pluginName
you defined in the build.gradle
file in the previous section.
Running the tests
You may need to install OpenSearch and build a local artifact for the integration tests and build tools (Learn more here):
~/OpenSearch (main)> git checkout 1.0.0-beta1 -b beta1-release
~/OpenSearch (main)> ./gradlew publishToMavenLocal -Dbuild.version_qualifier=beta1 -Dbuild.snapshot=false
Now you can run all the tests like so:
./gradlew check
Running testClusters with the plugin installed
./gradlew run
Then you can see that your plugin has been installed by running:
curl -XGET 'localhost:9200/_cat/plugins'
Cleanup template code
- You can now delete the unused paths -
path/to/plugin
. - Remove this from the
build.gradle
:
tasks.register("preparePluginPathDirs") {
mustRunAfter clean
doLast {
def newPath = pathToPlugin.replace(".", "/")
mkdir "src/main/java/org/opensearch/$newPath"
mkdir "src/test/java/org/opensearch/$newPath"
mkdir "src/yamlRestTest/java/org/opensearch/$newPath"
}
}
- Last but not least, add your own
README.md
instead of this one
Editing the CI workflow
You may want to edit the CI of your new repo.
In your new GitHub repo, head over to .github/workflows/CI.yml
. This file describes the workflow for testing new push or pull-request actions on the repo.
Currently, it is configured to build the plugin and run all the tests in it.
You may need to alter the dependencies required by your new plugin.
Also, the OpenSearch version in the Build OpenSearch
and in the Build and Run Tests
steps should match your plugins version in the build.gradle
file.
To view more complex CI examples you may want to checkout the workflows in official OpenSearch plugins, such as anomaly-detection.
License
This code is licensed under the Apache 2.0 License. See LICENSE.txt.
Copyright
Copyright OpenSearch Contributors. See NOTICE for details.