MOT in video surveillance is still a challenging aspect due to various complexities like complex occlusion, different poses, small sizes of objects, and so on. Henceforth more research works are under process that concentrate on solving object tracking problems by considering both spatial and visual information. Under these circumstances, this paper aims to propose a new MOT model that tracks the objects precisely. At first, the visibility model of tracking is proposed based on the second derivative model, which considers the second derivative function to predict the objects. Secondly, a spatial tracking model is developed using a nonlinear function. Meanwhile, the objects are tracked by subjecting a new optimization algorithm namely Female Update enabled Cub Updating in LA (FU-CU-LA) that effectively tracks the objects even if moved to the subsequent frames. Subsequently, spatial tracking and optimization-based tracking are integrated, and finally, the resultant center point is integrated with the visual tracking model. The proposed FU-CU-LA-based tacking system is compared with other models to certain measures and proves the superiority of the proposed work.