COVID-19 is an infectious disease that kills millions of people each year and it is a major public health problem around the globe. The current COVID-19 situation is still now concerning, though the vaccination program is running. In this study, we considered a COVID-19 model with a double-dose vaccination strategy to control the current outbreak situation in Bangladesh. The fundamental qualitative analysis of this mathematical model has been performed. The conditions of positive invariance, boundedness with suitable initial conditions were analyzed. We have estimated the basic reproduction number () for disease transmission and determined that our model contains two equilibrium points: the disease-free equilibrium and a disease-endemic equilibrium. We used the Routh-Hurwitz criteria to determine the stability of the equilibria. The disease will be eradicated from the community if  < 1, otherwise the disease persists in the population. To support the qualitative analysis of our model, we performed numerical simulations using MATLAB routine and estimated model parameters. Sensitivity analysis is used to explore the association for Mild and Critical cases concerning the corresponding model parameters. We observed that the most significant parameter to spread the virus is the transmission rate. The numerical simulations showed that a full dose vaccination program significantly reduces the mild and critical cases and has potential impact to eradicate the virus from the community. The information that we generated from our analysis may help the public health professionals to impose the best strategy effectively to control the outbreak situation of the virus in Bangladesh.