Originally, it was a Vishnu temple built by Beni Madhav Rao Scindia, a Maratha chieftain. Tie temple was destroyed by Aurangzeb in 17th century and the mosque was builtpn its ruins. It is a bletid of Hindu-Muslim architecture and religious sentiments and is also known as “Beni Madhav ka Darera”. The entire lower portion and enclosure walls are of Hindu design and the mosque, Islamic.