Paberžė Manor owner Count Šilingas built a wooden church which soon burned down. In 1858, a wooden Visitation of the Blessed Virgin Mary Church was built (and still stands to this day). Antanas Mackevičius (1828–1863), who was one of the leaders of the 1863 Uprising, was the priest of the church. On 20 March 1863, he read the uprising manifesto and led a group of rebels to fight against the Tsar oppression. In 1966, a Capuchin monk was assigned to Paberžė, priest Algirdas Mykolas Dobrovolskis – Father Stanislovas. The priest repaired and decorated the church, as well as restored the village's cemetery. He built original monuments in the churchyard and the cemetery, as well as established a unique church and folk art museum in the rectory and the granary nearby. The church has particularly valuable paintings and crosses of the most famous Lithuanian wood-carver Vincas Svirskis. It is said that the latter also created the altar of this church.
Paberžė, Gudžiūnai Local Authority, Kėdainiai District