/perftools

C-language workspace for prototyping performance tools and tests.

Primary LanguageC++

Solace perftools

Just a general workspace in which I prototype various tools for high-performance tests or eventing.

IPC-based grid compute example with the following applications:

  1. bin/feedHandler: this connects to an orchestrator process and sends it input messages. For this example the input messages just include a timestamp for calculating latency distributions.
  2. bin/orchestrator: this process binds to a socket waiting for connections from a feedHandler data source and calculator destination processes. When it receives messages, it chooses one of the calculators to route the messages to in a round-robin fashion while calculating latency.
  3. bin/calculator: this process represents the end calculation nodes that receive messages from the orchestrator and process them. For now, they just calculate latency from the feedHandler to calc nodes.

To build this example under 64-bit Linux, you must have BOOST libraries installed in your dev environment and download the Solace C-language SDK. Untar/unzip the CCSMP library and add it's [CCSMPDIR]/lib directory to your LD_LIBRARY_PATH. Update the Makefile variable SOLCLIENT_DIR to point to this directory in your local system, you may also need to update it with your path to the BOOST libraries. Then run:

make grid

If all goes well, it should build bin/orchestrator, bin/calculator and bin/feedHandler. There are example shell scripts to run them with same basic pre-selected arguments. You should start them in this order:

  1. ./grid_orchestrator.sh # begins the orchestrator process that listens for other participants; the code for this is tests/orchestrator.cpp
  2. ./grid_calc.sh 1 # starts the first calculator instance and binds it to the orchestrator process; the code is in tests/calculator.cpp
  3. ./grid_calc.sh 2 # starts the second calculator instance and binds it to the orchestrator process; the code is in tests/calculator.cpp
  4. ./grid_source.sh # starts the data source, binds it to the orchestrator and begins sending input messages; the code is in tests/feedHandler.cpp

Additional examples:

  • bin/perfADTest: a high-performance C program to test event latency while varying event rate, size, etc.
  • bin/msgTrace: a high-performance C program to listen for events and dump them to a memory-mapped file; related programs are bin/logRead and bin/dumpIndex.