1 Billion Row Challange in GO

Introduction

This project is an implementation of the 1 Billion Row Challenge in Go. It involves generating and processing a large dataset of one billion rows efficiently using Go programming language.

Prerequisites

Before running this application, ensure that you have the following prerequisites installed:

Installation

  1. Clone this repository
  git clone https://github.com/kemalkochekov/1BRC-in-GO.git
  1. Navigate to the project directory:
  cd 1BRC-in-GO

Generating Tests

Before running the application, generate tests using the provided Python script:

python3 create_measurements.py 1000000000

Running the Application

To run the application, execute the following command:

go run cmd/main.go

Result

After running the application, the achieved runtime for processing 1 billion rows is approximately 21.064296708 seconds. IMAGE 2024-03-05 00:42:58

Benchmark Result

Benchmarking the application yields a runtime of approximately 21.99330325 seconds.

IMAGE 2024-03-05 00:46:21