Historical data on monuments offers valuable insights into that period's past sculpture, architecture, and preferences. Realising the importance of historical data and the scarcity of data on historical places, this study presents a dataset collected from Panam City. Panam City, established in the late 1300s century, was the capital of the fifteenth-century Bengal ruler Isa Khan. The city was once an important trading and political centre and is now considered a world heritage site by the United Nations Educational Scientific and Cultural Organisation (UNESCO). Panam City is located in Sonargaon, Dhaka, Bangladesh. The aim of data collection is to capture past architectural design, materials used for the building, and the current state of the walls and structures of Panam City. This dataset can benefit researchers, architects, archaeologists, and cultural organisations. Historians and architects can gain insights into the wall's construction methods and materials, informing future restoration efforts. Historic datasets can create exciting AR/VR experiences by digitizing and 3D modelling historical artefacts and environments, integrating them into AR/VR platforms using game engines and development tools, and enhancing the user experience with interactive storytelling and educational content. Tourism boards and cultural heritage organisations can leverage this resource to develop engaging experiences that highlight the rich history and significance of Panama City. By making this data accessible, this study contributes to understanding and appreciating Panam City's historical significance while promoting innovative approaches to heritage preservation in the digital age. This dataset contains 2292 images of degraded wall classes such as Artistic, Corroded Brick, Corroded Plaster, Fungus, and Living Plant.