The limited space around the Earth is getting cluttered with leftover fragments from old missions, creating a real challenge. As more satellites are launched, even debris pieces as small as 5 mm must be tracked to avoid collisions. However, it is an arduous and challenging task in space. This paper presents a technical exploration of ground-based and in-orbit space debris tracking and orbit determination methods. It highlights the challenges faced during on-ground and in-orbit demonstrations, identifies current gaps, and proposes solutions following technological advancements, such as low-power pose estimation methods. Owing to the numerous atmospheric barriers to ground-based sensors, this study emphasizes the significance of spaceborne sensors for precise orbit determination, complemented by advanced data processing algorithms and collaborative efforts. The ultimate goal is to create a comprehensive catalog of resident space objects (RSO) around the Earth and promote space environment sustainability. By exploring different methods and finding innovative solutions, this study contributes to the protection of space for future exploration and the creation of a more transparent and precise map of orbital objects.