The idea of establishing the Ma'had Sunan Ampel al-Aly for students at UIN Maulana Malik Ibrahim Malang had been in the works for a long time, since the leadership of KH. Usman Manshur, but it had not been realized. The idea was only realized during the leadership of Prof. Dr. H. Imam Suprayogo, who at that time was still serving as the head of STAIN Malang.
The laying of the first stone for the construction of the Ma'had building began on Ahad Wage, April 4 1999, attended by Kyai from all over East Java, especially from Malang Raya, and within a period of one year, 4 (four) building units consisting of 189 rooms (3 units of 50 rooms each and 1 unit of 39 rooms) and 5 (five) caretaker's houses and 1 (one) house for the director of Ma'had had been successfully completed.
On August 26, 2000, the Ma'had began operating. There were 1,041 students—483 male students and 558 female students—who lived in the magnificent residential units. These students were registered as new students from all faculties.
On April 17, 2001, the 4th President of the Republic of Indonesia, KH. Abdurrahman Wahid was pleased to attend and inaugurate the use of the four Ma'had residences, each of which was named mabna (building unit) al-Ghazali, mabna Ibn Rusyd, mabna Ibn Sina, mabna Ibn Khaldun, a few months later a residential unit with a capacity of 50 rooms for 300 students was built and named Al-Farabi which was inaugurated by the Vice President of the Republic of Indonesia, Hamzah Haz and accompanied by the First Vice President of the Republic of Sudan when inaugurating the change of status of STAIN Malang to the Islamic University of Indonesia Sudan (UIIS).
All Ma'had residential units are now occupied specifically for male students, while female students now occupy 4 (four) new residential units that were built since 2006 and have been completed, 2 (two) of which are named Mabna Ummu Salamah and Mabna Asma' bint Abi Bakar, with a capacity of 64 rooms, each for 640 people, 1 (one) unit named Mabna Fatimah al Zahra with a capacity of 60 rooms for 600 people and 1 (one) unit named Mabna Khadijah al Kubra with a capacity of 48 rooms for 480 people. Each room of the 4 (four) residential units has a capacity of 10 (ten) people. The residential units for male students and for female students are in separate locations within the campus area.
In 2016, the Medical School, named Mabna Ar-Razi, was established on Campus II in Batu City. This was a follow-up to the establishment of the Faculty of Medicine and Health Sciences. The first year saw 50 students enrolled, and the second year saw the same number. The total capacity of the School is 100.
To complement the religious nuances and religious culture of East Javanese Muslims, a monument (inscription) was erected at the entrance to the male student housing unit, depicting the vision and mission of the Ma'had, written in Arabic. The inscription reads:
كونوا أولي الأبصار
(be you people who have the eyes of the heart);
كونوا أولي النهى
(be you people who have intelligence);
كونوا أولي الألباب
(be you people who have reason);
وجاهدوا في الله حق جهاده
(and fight to defend Allah's religion with all seriousness).
Furthermore, to commemorate the services and historic significance of Islamic scholars on the island of Java, soil taken from the Wali Songo (the Nine Saints: a symbol of the struggle of the scholars in Java) was planted around the inscription. This was also intended to instill the historical value of the scholars' struggle, so that students would always remember the urgency of struggle or jihad. li i'laa kalimatillah. The same inscription was then also built in front of the entrance to the female student housing area and in front of the rector's office.