This work addresses bi-objective hybrid flow shop scheduling problems considering consistent sublots (Bi-HFSP_CS). The objectives are to minimize the makespan and total energy consumption. First, the Bi-HFSP_CS is formalized, followed by the establishment of a mathematical model. Second, enhanced version of the artificial bee colony (ABC) algorithms is proposed for tackling the Bi-HFSP_CS. Then, fourteen local search operators are employed to search for better solutions. Two different Q-learning tactics are developed to embed into the ABC algorithm to guide the selection of operators throughout the iteration process. Finally, the proposed tactics are assessed for their efficacy through a comparison of the ABC algorithm, its three variants, and three effective algorithms in resolving 95 instances of 35 different problems. The experimental results and analysis showcase that the enhanced ABC algorithm combined with Q-learning (QABC1) demonstrates as the top performer for solving concerned problems. This study introduces a novel approach to solve the Bi-HFSP_CS and illustrates its efficacy and superior competitive strength, offering beneficial perspectives for exploration and research in relevant domains.