Perceptually-Driven Video Super Resolution for Mobile Live Streaming: An Adaptive Cloud-Assisted Approach

The increasing demand for high-definition live video streaming services on mobile devices is often hindered by unstable network conditions and limited computational capabilities. To address these issues, we introduce an adaptive video super-resolution (VSR) based mobile live streaming method, MOBLIVE. The core idea of MOBLIVE is to selectively offload regions of video frames that critically influence user perception quality to the server-side VSR model for enhancement. To further improve the video quality, we deploy a predictive model to choose the optimal VSR model for each selected region. Additionally, we employ an adaptive graphics processing unit (GPU) scheduling strategy that optimizes the allocation of multiple VSR tasks across multiple GPUs. Experimental results show that our approach outperforms the state-of-the-art method in video multimethod assessment fusion (VMAF) and reduces the latency by an average of 73.7% in the typical networking environment.