With the increasing impacts of climate change and resource depletion, dielectric capacitors, with their exceptional stability, fast charging and discharging rates, and ability to operate under more extreme conditions, are emerging as promising high-demand candidates for high-performance energy storage devices, distinguishing them from traditional electrochemical capacitors and batteries. However, due to the shortcomings of various dielectric ceramics (e.g., paraelectrics (PEs), ferroelectrics (FEs), and antiferroelectrics (AFEs)), their low polarizability, low breakdown strength (BDS), and large hysteresis loss limit their standalone use in the advancement of energy storage ceramics. Therefore, synthesizing novel perovskite-based materials that exhibit high energy density, high energy efficiency, and low loss is crucial for achieving superior energy storage performance. In this review, we outline the recent development of perovskite-based ferroelectric energy storage ceramics from the perspective of combinatorial optimization for tailoring ferroelectric hysteresis loops and comprehensively discuss the properties arising from the different combinations of components. We also provide future guidelines in this realm. Therefore, the combinatorial optimization strategy in this review will open up a practical route toward the application of new high-performance ferroelectric energy storage devices.