NCompileBench

How fast can your computer compile .NET code? Find out!

NCompileBench is a benchmark which compiles .NET Core 3.1 based C#-code. The benchmark runs the benchmark as concurrent and non-concurrent, but the NCompileBench Score is based on the concurrent result.

Requirements

.NET Core 3.1 SDK is required in order to run the benchmark. You can download it from https://dotnet.microsoft.com/download/dotnet-core/3.1

x64 compatible Windows is required.

Getting started

NCompileBench is available as dotnet global tool. To install:

dotnet tool install -g NCompileBench

After installing NCompileBench, it is available for running through the command line:

NCompileBench

Note that the benchmark starts automatically.

Submitting results

The results "database" is available as a Gist: https://gist.github.com/mikoskinen/2560a85bc59ef6baad20d371ab0db6f2#file-ncompilebench-json-results

After running the benchmark, you can submit your score by running:

NCompileBench -submit

To just view the results without running the benchmark you can run:

NCompileBench -scores

Iteration count or how long it takes for the benchmark to finish

NCompileBench will run the compilation benchmark as long as it gets stable-enough results. This means that on a desktop machine with a good cooling, the benchmark usually runs only few iterations. But on a laptop it's possible that the benchmark results fluxate so much that NCompileBench (or to be precise, BenchmarkDotNet) won't be happy with the results and will continue running the benchmark.

Because of this, NCompileBench by defaults limits the iteration count to a maximum of 20. Iteration count limit can be disable by running:

NCompileBench -nomaxiterations

This way you can get even more detailed results but in some cases it can take hours for the benchmark to finish (yes, I'm looking at you, Surface Go 2 with m3).

Acknowledgements

The source code is based on the .NET Performance repository by Microsoft (MIT-licensed).

The benchmark uses BenchmarkDotNet (MIT-licensed).