A Benchmark Suite for Cloud Services
Based on popularity of use and real-world software stacks, representing real-world setups
Download the CloudSuite Applications
CloudSuite is a benchmark suite for cloud services. The third release consists of eight applications that have been selected based on their popularity in today’s datacenters. The benchmarks are based on real-world software stacks and represent real-world setups.
Cloud computing is emerging as a dominant computing platform for providing scalable online services to a global client base. Today’s popular online services (e.g., web search, social networking, and business analytics) are characterized by massive working sets, high degrees of parallelism, and real-time constraints. These characteristics set cloud services apart from desktop (SPEC), parallel (PARSEC), and traditional commercial server applications (TPC). In order to stimulate research into the field of cloud and data-centric computing, we have created CloudSuite, a benchmark suite based on real-world online services.
CloudSuite covers a broad range of application categories commonly found in today’s datacenters. The first release included data analytics, data serving, media streaming, large-scale and computation-intensive tasks, web search, and web serving. The second release expanded CloudSuite with graph analytics and data caching.
CloudSuite 3.0 is a major enhancement over prior releases both in benchmarks and infrastructure. It includes benchmarks that represent massive data manipulation with tight latency constraints such as: in-memory data analytics using Apache Spark, a new real-time video streaming benchmark following today’s most popular video-sharing website setups, and a new web serving benchmark mirroring today’s multi-tier web server software stacks with a caching layer.
A talk, Server Benchmarking and Design with CloudSuite 3.0, was given on March 28th at DATE 2017.
A tutorial, Server Benchmarking with CloudSuite 3.0, will be presented on April 18th at EuroSys 2016.
Instructions on how to set up a cluster of Docker nodes using Docker Swarm.