The classification of the brain tumor image is playing a vital role in the medical image domain, and it directly assists the clinicians to understand the severity and to take an appropriate solution. The magnetic resonance imaging tool is used to analyze the brain tissues and to examine the different portion of brain circumstance. We propose the convolutional neural network database learning along with neighboring network limitation (CD_BLNL) technique for brain tumor image classification in medical image processing domain. The proposed system architecture is constructed with multilayer-based metadata learning, and they have integrated with CNN layer to deliver the accurate information. The metadata-based vector encoding is used, and the type of coding estimation for extra dimension is known as sparse. In order to maintain the supervised data in terms of geometric format, the atoms of neighboring limitation are built based on a well-structured -neighbored network. The resultant of the proposed system is considerably strong and subjective for classification. The proposed system used two different datasets, such as BRATS and REMBRANDT, and the proposed brain MRI classification technique outcome is more efficient than the other existing techniques.