Renaissance - Benchmarking Suite for Parallel Applications on the JVM (Experience Report)

Prokopec, Aleksandar and Rosà, Andrea and Leopoldseder, David and Duboscq, Gilles and Tu̇ma, Petr and Studener, Martin and Bulej, Lubomír and Zheng, Yudi and Villazón, Alex and Simon, Doug and Würthinger, Thomas and Binder, Walter
Software Engineering 2020

Abstract

Our paper published in the proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2019) proposes Renaissance, a modern benchmark suite whose aim is to advance compiler and virtual machine (VM) research. The publication is complemented by an accepted artifactTo demonstrate that a compiler optimization, a memory management algorithm, or a synchronization technique is useful, a VM researcher needs benchmarks that demonstrate the desired behavior, and at the same time capture representative aspects of real-world applications. During the last decade, multiple new programming paradigms appeared on the Java VM (JVM), including functional programming, big-data processing, parallel and concurrent programming, message-passing, stream processing, and machine learning. The JVM has evolved as a platform too: new features, such as method-handles, variable-handles, the invokedynamic instruction, lambdas, atomic and relaxed memory operations, present new challenges for dynamic compilers and runtime environments. Existing benchmark suites do not capture the new applications, because they were made in a time when these workloads did not exist. Renaissance bridges this gap. The Renaissance suite is an ongoing, open-source effort to collect representative real-world workloads, and to advance the research and development of VMs.

Renaissance is available at https://renaissance.dev/.

[PDF] [BibTex] [GI]

References

[Pr19a] Prokopec, Aleksandar; Rosà, Andrea; Leopoldseder, David; Duboscq, Gilles; Tůma, Petr; Studener, Martin; Bulej, Lubomír; Zheng, Yudi; Villazón, Alex; Simon, Doug; Würthinger, Thomas; Binder, Walter: Renaissance: Benchmarking Suite for Parallel Applications on the JVM. Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI), Phoenix, AR, USA, June 22-26, 2019, 2019.

[Pr19b] Prokopec, Aleksandar; Rosà, Andrea; Leopoldseder, David; Duboscq, Gilles; Tůma, Petr; Studener, Martin; Bulej, Lubomír; Zheng, Yudi; Villazón, Alex; Simon, Doug; Würthinger, Thomas; Binder, Walter: Supplementatry material - Artifact for the paper ŞRenaissance: Benchmarking Suite for Parallel Applications on the JVMŤ published in the proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2019). DOI: 10.1145/3325986. 2019.