Abstract: In this work, we introduce an open-source suite of quantum application-oriented performance benchmarks that is designed to measure the effectiveness of quantum computing hardware at ...

Jailbreakbench is an open-source robustness benchmark for jailbreaking large language models (LLMs). The goal of this benchmark is to comprehensively track progress toward (1) generating successful ...