In Bangladesh, sweet orange cultivation has been popular among fruit growers as the fruit is in demand. However, the disease of sweet oranges decreases fruit production. Research suggests that computer-aided disease diagnosis and machine learning (IML) models can improve fruit production by detecting and classifying diseases. In this line, a dataset of sweet oranges is required to diagnose the disease. Moreover, like many other fruits, sweet orange disease may vary from country to country. Therefore, in Bangladesh, a sweet orange dataset is required. Lastly, since different ML algorithms require datasets in various formats, only a few existing datasets fulfil the necessity. To fulfil the limitations, a sweet orange dataset in Bangladesh is collected. The dataset was collected in August and comprises high-quality images documenting multiple disease conditions, including Citrus Canker, Citrus Greening, Citrus Mealybugs, Die Back, Foliage Damage, Spiny Whitefly, Powdery Mildew, Shot Hole, Yellow Dragon, Yellow Leaves, and Healthy Leaf. These images provide an opportunity to apply machine learning and computer vision techniques to detect and classify diseases. This dataset aims to help researchers advance agri engineering through ML. Other sweet orange growing countries with having similar environments may find helpful information. Lastly, such experiments using our dataset will assist farmers in taking preventive measures and minimising economic losses.