stackql: A Go repository from srikharshashi

Deploy, manage and query cloud resources and interact with APIs using SQL

Read the docs »
Raise an Issue · Request a Feature · Developer Guide · BYO Providers

Contents

About The Project
Installation
Usage
Contributing
License
Contact
Acknowledgements

About The Project

StackQL is an open-source project built with Golang that allows you to create, modify and query the state of services and resources across different cloud and SaaS providers (Google, AWS, Azure, Okta, GitHub, etc.) using SQL semantics

How it works

StackQL is a standalone application that can be used in client mode (via exec or shell) or accessed via a Postgres wire protocol client (psycopg2, etc.) using server mode (srv).

StackQL parses SQL statements and transpiles them into API requests to the cloud provider. The API calls are then executed and the results are returned to the user.

StackQL provider definitions are defined in OpenAPI extensions to the providers specification. These definitions are then used to generate the SQL schema and the API client. The source for the provider definitions are stored in the StackQL Registry.

StackQL Context Diagram

The following context diagram describes the StackQL architecture at a high level:

flowchart LR
  subgraph StackQL
    direction BT
    subgraph ProviderDefs
        Registry[Provider Registry Docs]    
    end
    subgraph App
        Proc[$ stackql exec\n$ stackql shell\n$ stackql srv]
        style Proc fill:#000,stroke:#000,color:#fff,text-align:left;

        %% ,font-family:'Courier New', Courier, monospace
    end
  end
  User((User)) <--> StackQL <--> Provider[Cloud Provider API]
  ProviderDefs --> App

More detailed design documentation can be found in the here.

Installation

StackQL is available for Windows, MacOS, Linux, Docker, GitHub Actions and more. See the installation instructions below for your platform.

Installing on MacOS

Homebrew (amd64 and arm64)
- brew install stackql or brew tap stackql/tap && brew install stackql/tap/stackql
MacOS PKG Installer (amd64 and arm64)
- download the latest MacOS PKG installer for StackQL
- run the installer and follow the prompts

Installing on Windows

MSI Installer
- download the latest MSI installer for StackQL
- run the installer and follow the prompts
Chocolatey
- install Chocolatey
- run choco install stackql
ZIP Archive
- download the latest Windows ZIP archive for StackQL
- extract the archive (code signed stackql.exe file) to a directory of your choice
- add the directory to your PATH environment variable (optional)

Installing on Linux

ZIP Archive
- download the latest Linux ZIP archive for StackQL
  - or via curl -L https://bit.ly/stackql-zip -O && unzip stackql-zip
- extract the archive (stackql file) to a directory of your choice
- add the directory to your PATH environment variable (optional)

Getting StackQL from DockerHub

View all available StackQL images on DockerHub. Images available include stackql, stackql-jupyter-demo and more. Pull the latest StackQL base image using:

docker pull stackql/stackql

Using StackQL with GitHub Actions

Use StackQL in your GitHub Actions workflows to automate cloud infrastructure provisioning, IaC assurance, or compliance/security. Available GitHub Actions include: setup-stackql, stackql-exec and more

Usage

StackQL can be used via the interactive REPL shell, or via the exec command or ran as a server using the Postgres wire protocol.

ℹ️ StackQL does not require or install a database.

Interactive Shell

# run interactive stackql queries
stackql shell --auth="${AUTH}"

Execute a statement or file
```
stackql exec --auth="${AUTH}" -i myscript.iql --iqldata vars.jsonnet --output json

# or

stackql exec --auth="${AUTH}" "SELECT id, status FROM aws.ec2.instances WHERE region = 'us-east-1'"
```
ℹ️ output options of json, csv, table and text are available for the exec command using the --output flag

ℹ️ StackQL supports passing parameters using jsonnet or json, see Using Variables

Server

# serve client requests over the Postgres wire protocol (psycopg2, etc.) 
stackql srv --auth="${AUTH}"

For more examples, please check our Blog

Contributing

Contributions are welcome and encouraged. For more information on how to contribute, please see our contributing guide.

License

Distributed under the MIT License. See LICENSE for more information. Licenses for third party software we are using are included in the /licenses directory.

Contact

Get in touch with us via Twitter at @stackql, email us at info@stackql.io or start a conversation using discussions.

Acknowledgements

Forks of the following support our work:

We gratefully acknowledge these pieces of work.

srikharshashi/stackql