In this article, we present the concavity of the minimal $L^2$ integrals related to multiplier ideals sheaves on Stein manifolds. As applications, we obtain a necessary condition for the concavity degenerating to linearity, a characterization for 1-dimensional case, and a characterization for the equality in 1-dimensional optimal $L^2$ extension problem to hold.