A Benchmark Suite for Cloud Services

Based on popularity of use and real-world software stacks, representing real-world setups

Download the CloudSuite Applications

About CloudSuite

CloudSuite is a benchmark suite for cloud services. The third release consists of eight applications that have been selected based on their popularity in today’s datacenters. The benchmarks are based on real-world software stacks and represent real-world setups.

Cloud computing is emerging as a dominant computing platform for providing scalable online services to a global client base. Today’s popular online services (e.g., web search, social networking, and business analytics) are characterized by massive working sets, high degrees of parallelism, and real-time constraints. These characteristics set cloud services apart from desktop (SPEC), parallel (PARSEC), and traditional commercial server applications (TPC). In order to stimulate research into the field of cloud and data-centric computing, we have created CloudSuite, a benchmark suite based on real-world online services.

CloudSuite covers a broad range of application categories commonly found in today’s datacenters. The first release included data analytics, data serving, media streaming, large-scale and computation-intensive tasks, web search, and web serving. The second release expanded CloudSuite with graph analytics and data caching.

CloudSuite 3.0 is a major enhancement over prior releases both in benchmarks and infrastructure. It includes benchmarks that represent massive data manipulation with tight latency constraints such as: in-memory data analytics using Apache Spark, a new real-time video streaming benchmark following today’s most popular video-sharing website setups, and a new web serving benchmark mirroring today’s multi-tier web server software stacks with a caching layer.

News Blog

DATE’17 Talk and Demo

A talk, Server Benchmarking and Design with CloudSuite 3.0, was given on March 28th at DATE 2017.

EuroSys’16 Turorial

A tutorial, Server Benchmarking with CloudSuite 3.0, will be presented on April 18th at EuroSys 2016.

We encourage CloudSuite users to subscribe to our GitHub repository and use GitHub issues to request enhancements or
bug fixes, or ask questions.

 
EcoCloud
Parsa
EPFL
Compas
Stony Brook