Every year many of farmers had to face a huge amount of loss due to the papaya disease. From the last several years, thousands of researchers pay attention to the papaya disease recognition system to reduce the losses of farmers. Farmers have no prior knowledge about the detection technique to mitigate the disease. They found the diseases when the papaya already affected and wasted. Due to the loss of cultivation, many of them are now frightening to take steps about planting papaya. On this matter, a research has been performed with the advancement of deep learning technology to detect and classify the papaya disease. CNN model is used according to Keras API. This model becomes reliable with fully connected, where classification is completed and all the process is a deep learning based. It took the fixed size of image 200x200 RGB image as input.