View on GitHub

Storage Performance Analyzer

Download this project as a .zip file Download this project as a tar.gz file

Description

The Storage Performance Analyzer (SPA) is a software package containing the functionality for the systematic measurement, analysis and regression modeling specifically tailored for storage systems. SPA consists of a benchmark harness that coordinates and controls the execution of the included I/O benchmarks (FFSB and Filebench) and a tailored analysis library used to process and evaluate the collected measurements.

The benchmark harness supports the execution of benchmarks. Using a specification of the benchmark parameter space, which should be run on the remote machine, the software ensures that each of these configurations is executed automatically in a deterministic order. Furthermore, the benchmark harness supports synchronous measurements on co-located virtual machines in virtualized environments. The software ensures that the benchmark results are stored persistently in an SQLite database to provide easy access for further analysis.

The analysis library provides the functionality for the analysis of the measurement results obtained with the benchmark harness. By providing a drop-in solution for the widely accepted statistical framework R, the power of R is combined with the specialized functionality of SPA. The analysis functions help with the derivation and analysis of regression models from the benchmark results. It also contains functionality to optimize many regression techniques to maximize the modeling power in different scenarios. The R environment can be exploited to further analyze the measurements and to generate illustrations of the analysis results.

Spa-setup.png

Information

Lead

Contributors

Requirements

Controller Machine

System Under Test

Download

Sources

SPEC Research Group Tool

License

Publications using the tool

  1. Qais Noorshams, Roland Reeb, Andreas Rentschler, Samuel Kounev, and Ralf Reussner. Enriching Software Architecture Models with Statistical Models for Performance Prediction in Modern Storage Environments. In Proceedings of the 17th International ACM Sigsoft Symposium on Component-Based Software Engineering (CBSE'14), Lille, France, 2014. Full Text.
  2. Qais Noorshams, Axel Busch, Andreas Rentschler, Dominik Bruhn, Samuel Kounev, Petr Tůma, and Ralf Reussner. Automated Modeling of I/O Performance and Interference Effects in Virtualized Storage Systems. In 34th IEEE International Conference on Distributed Computing Systems Workshops (ICDCS 2014 Workshops). 4th International Workshop on Data Center Performance (DCPerf '14), Madrid, Spain, 2014. Full Text.
  3. Qais Noorshams, Kiana Rostami, Samuel Kounev, Petr Tůma, and Ralf Reussner. I/O Performance Modeling of Virtualized Storage Systems. In Proceedings of the IEEE 21st International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS '13), San Francisco, USA, 2013. Full Text.
  4. Qais Noorshams, Dominik Bruhn, Samuel Kounev, and Ralf Reussner. Predictive Performance Modeling of Virtualized Storage Systems using Optimized Statistical Regression Techniques. In Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE '13), Prague, Czech Republic, 2013. Full Text.