Predictability is an essential challenge for autonomous vehicles (AVs)’ safety. Deep neural networks have been widely deployed in the AV’s perception pipeline. However, it is still an open question on how to guarantee the perception predictability for AV because there are millions of deep neural networks (DNNs) model combinations and system configurations when deploying DNNs in AVs. This paper proposes configurable predictability testbed (CPT), a configurable testbed for quantifying the predictability in AV’s perception pipeline. CPT provides flexible configurations of the perception pipeline on data, DNN models, fusion policy, scheduling policies, and predictability metrics. On top of CPT, the researchers can profile and optimize the predictability issue caused by different application and system configurations. CPT has been open-sourced at: https://github.com/Torreskai0722/CPT.