Description
The Storage Performance Analyzer (SPA) is a software package containing the functionality for the systematic measurement, analysis and regression modeling specifically tailored for storage systems. SPA consists of a benchmark harness that coordinates and controls the execution of the included I/O benchmarks (FFSB and Filebench) and a tailored analysis library used to process and evaluate the collected measurements.
The benchmark harness supports the execution of benchmarks. Using a specification of the benchmark parameter space, which should be run on the remote machine, the software ensures that each of these configurations is executed automatically in a deterministic order. Furthermore, the benchmark harness supports synchronous measurements on co-located virtual machines in virtualized environments. The software ensures that the benchmark results are stored persistently in an SQLite database to provide easy access for further analysis.
The analysis library provides the functionality for the analysis of the measurement results obtained with the benchmark harness. By providing a drop-in solution for the widely accepted statistical framework R, the power of R is combined with the specialized functionality of SPA. The analysis functions help with the derivation and analysis of regression models from the benchmark results. It also contains functionality to optimize many regression techniques to maximize the modeling power in different scenarios. The R environment can be exploited to further analyze the measurements and to generate illustrations of the analysis results.
Information
Lead
Contributors
Requirements
Controller Machine
- Java 6 or later, Apache Ant for compilation
- Windows, Unix and Mac operating systems tested
- R (http://r-project.org)
- SQLite (http://sqlite.org)
System Under Test
- POSIX compatible operating system (tested on Linux)
- SSH access from the controller machine
Download
Sources
- SPA sources are available on the GitHub page. Version 1.0 can be downloaded with documentation from here.
- Prepared drops (already generated model code and installed plugins) for Linux, Mac OS, and Windows can be downloaded from here.
- If you have any issues, please check our issue tracker or contact Qais Noorshams.
SPEC Research Group Tool
- SPA is a SPEC RG tool and available in the SPEC RG repository of peer-reviewed tools .
License
- GPLv2 or later
Publications using the tool
- Qais Noorshams, Roland Reeb, Andreas Rentschler, Samuel Kounev, and Ralf Reussner. Enriching Software Architecture Models with Statistical Models for Performance Prediction in Modern Storage Environments. In Proceedings of the 17th International ACM Sigsoft Symposium on Component-Based Software Engineering (CBSE'14), Lille, France, 2014. Full Text.
- Qais Noorshams, Axel Busch, Andreas Rentschler, Dominik Bruhn, Samuel Kounev, Petr Tůma, and Ralf Reussner. Automated Modeling of I/O Performance and Interference Effects in Virtualized Storage Systems. In 34th IEEE International Conference on Distributed Computing Systems Workshops (ICDCS 2014 Workshops). 4th International Workshop on Data Center Performance (DCPerf '14), Madrid, Spain, 2014. Full Text.
- Qais Noorshams, Kiana Rostami, Samuel Kounev, Petr Tůma, and Ralf Reussner. I/O Performance Modeling of Virtualized Storage Systems. In Proceedings of the IEEE 21st International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS '13), San Francisco, USA, 2013. Full Text.
- Qais Noorshams, Dominik Bruhn, Samuel Kounev, and Ralf Reussner. Predictive Performance Modeling of Virtualized Storage Systems using Optimized Statistical Regression Techniques. In Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE '13), Prague, Czech Republic, 2013. Full Text.