PengyiPan/low-latency-system

Everything about low latency system.

Low Latency System

A collection of everything about low latency system.

The goal is to collect resouces to help people to get better performance in their system.

Level a message

If you have anything about this project, please submit a GitHub issue here.

Linux OS tuning

• Redhat Linux Performance Tuning Guide A basic manual of tuning Linux OS. It works with RHEL and Centos. Please select the right version number for your system.

• Red Hat Enterprise Linux Network Performance Tuning Guide How to tune network stack in kernel. A low latency system should use kernel bypass instead of kernel stack to improve the performance.

System tuning guides from server vendors

• Configuring and tuning HP ProLiant Servers for low-latency applications This document will be updated months. The latest version is 201710.

• HPE Trade and Match Server: HPE ProLiant XL1x0r Gen9 servers using Intel Xeon E5-1680 v3 processors A solution which uses 1 overclocking CPU to get best performance.

• HPE Gen10 Servers Intelligent System Tuning HP's new tech to remove jitters in G10 system.

• HP Gen8 technologies for low latency, high performance trading and exchanges

• Supermicro HFT-Optimized Servers and the ExaNIC

• Configuring Low-Latency Environments on Dell PowerEdge Servers

• Optimizing the High Frequency Trading GatiRT* Application on the latest Intel® Architecture Server

• HP Gen8 technologies for low latency, high performance trading and exchanges

• Reducing OS-Jitter, (Frame Latency, Latency, Stutter)

• Performance Analysis and Tuning of Red Hat Enterprise Linux

• Optimizing Linux performance on HP Integrity Superdome X

• Optimizing for low latency

• Blog from a guy working in LMAX

  • Reducing system jitters part 1
  • Reducing system jitters part 2

• Linux Performance and Tuning Guidelines

  • 中文版

• Network tuning and performance

• Solarflare Server Adapter User Guide:Performance Tuning on Linux

Benchmarks and tools

• STAC
  • SUT ID: SFC170206 STAC-Network IO UDP over 10GbE using OpenOnload on RHEL 6.6 with Solarflare SFN 8522-PLUS Adapters on HPE ProLiant XL170r Gen9 Trade & Match Servers This test discloses the configurations.

Tools

• Sockperf

• iperf

Faster than 10G network

• Extreme Ethernet Server Networking: 10GbE, 25GbE, 40GbE & 50GbE

• A lecture talk about Linux kernel networking

• A great blog from cloudflare

  • How to receive a million packets
  • Why we use the Linux kernel's TCP stack

• Multi-queue network interfaces with SMP on Linux

  • 中译本：linux下基于SMP架构的多队列网卡的调优

Low Level API

• IB verbs

• ef_vi

• libexanic

Kernel bypass

Solarflare

• OpenOnload Google Talk Compared different accelate technology approach that solarflare used in openonload compared latency, bandwidth by using openonload and kernel

• ASICs argued with FPGAs

• TCP on FPGA made practical and fast

Infiniband, RMDA

• THE GEEK IN THE CORNER Programming odds and ends — InfiniBand, RDMA, and low-latency networking for now.

  A blog for RDMA programming and concept

  • An introduction of infiniband and RDMA

• RDMA programming concepts

• InfiniBand Technology Overview An advanced introduction to IB

• introduction to Infiniband just a simple introduction. Only advantage is there are many diagram.

• Introduction to InfiniBand An introduction to IB from Mellanox whitepaper.

• RDMA aware programming user manual

• OpenOnload NIC / Infiniband RDMA

• Designing Cloud and Grid Computing Systems with InfiniBand and High-Speed Ethernet

• Get Started with Infiniband

• PF_RING

Zero Copy

• Zero Copy I: User-Mode Perspective

Mellanox

• Performance Tuning Guide for Mellanox Network Adapters

  • out date
  • the latest

How to tune libvma and other tools from mellanox to improve network performance.

• VMA Performance Tuning Guide

• Mellanox AcademyIntroduction to InfiniBand

Time tech

• IEEE 1588 & PTP USING EMBEDDED LINUX SYSTEMS

• How to Benchmark Code Execution Times in Intel IA-32 and IA-64 Instruction Set Architectures

Jitter detection

• sysjitter from solarflare

  A tool that measures the jitter experienced by user-level threads running on each CPU core of a computer. Such jitter may be caused by interrupts, OS threads, system management interrupts or other processes on the system.

  All openOnload download is here http://www.openonload.org/download/

• Erez's hiccup tools

  A tool used for measure OS hiccup.

• HP-timetest I don't get this tool now. Need help.

• Google Group: Mechanical-Sympathy

  • A Toolkit to Measure Basic System Performance & OS Jitter
  • Systemic to reduce Linux OS jitter

Unsort

• Ultra Low Latency Trading Systems: A blog about techniques used to build www.SubMicroTrading.com

• Performance Analysis

• A Low-Latency Solution for High Frequecy Trading From IBM and Solarflare It's a very old solution that looks like system has not been tuned well.

• Low Latency in Linux kernel An article from 2000. Very very old.

• Optimizing System Performance

• Design Best Practices for Latency Optimization

• Low Latency Optimization

• Intel i350 NIC datasheet

• Network in Linux kernel

• Understanding TCP/IP network stack and writing network programming

• Trading floor architecture

• Latency in high performance trading system

• How does an algorithmic trading system architecture look like

• Evolution and practice: Low-latency Distributed Applications in Finance

• Technology in banking – a problem in scale and complexity

• Low-latency networks for trading infrastructure Fujitsu A introduction of Fujitsu's optical infrastruction.

• Topics in High Performance Messaging

Report, Whitepaper

• Tolly Test Report:Mellanox Spectrum vs. Broadcom StrataXGS Tomahawk 25GbE & 100GbE Performance Evaluation
• The Next Frontiers for Low Latency Programmers
• Webinar from Mellanox: The latest Trend of Low Latency Programming
• Verbs Programming, Raw Ethernet
• Low Latency Optimization
• Tolly Test Report:Mellanox Spectrum vs. Broadcom StrataXGS Tomahawk 25GbE & 100GbE Performance Evaluation
• The Next Frontiers for Low Latency Programmers
• Webinar from Mellanox: The latest Trend of Low Latency Programming
• Verbs Programming, Raw Ethernet

FPGA

• algo-logic

• A Low Latency Library in FPGA Hardware for High Frequency Trading (HFT) An article from alog-logic. Here is the external link. The origin link on algo-logic.com is 404 error.

• Efficient Event Processing through Reconfigurable Hardware for Algorithmic Trading

• NetFPGA-10G Information A FPGA solution in 2012. Should update to latest news.

• FPGA networking processing card

• FPGA smart NIC card A list of FPGA solution of NIC. A 2013 article, it's a little expired.

• FPGA options for ultra low latency HFT with stunningly convincing Youtube video with Algo Logic with some technical papers A 2013 article also.

• Xeon+FPGA platform for data center

• Intel hybrid CPU+FPGA

• FPGA developer A FPGA site that focus on tech not finance solution.

• How are HFT systems implemented on FPGA nowadays A QA on stackexchange

resource

• intelligent trading technology from A-Team

• nextplatform

About

• My LinkedIn Page
• chenxing@live.com
• 微信 Wechat: trador