… the first stone was laid on the Duchess of Kent's birth-day, the 17th August, 1827. The building was completed in about two years, and on the 3rd. September, 1829, it was consecrated, with the accustomed ceremonies, by the Bishop of Rochester … The Church, called "Holy Trinity," is a handsome structure in the style of the thirteenth and fourteenth centuries, and is seen to great advantage from many parts of the common. Decimus Burton, Esq. was the Architect, and Messrs. Barrett, of Tunbridge Wells, were the Builders. It cost upwards of £12,000., although the stone used in the building was procured from the Calverley quarry, in the immediate neighbourhood of the church.

Her present Majesty [Queen Victoria], with her royal mother, the Duchess of Kent, having frequently honored Tunbridge Wells by residing there in the season, chiefly at Calverley House, the inhabitants were anxious to afford them a growing proof of their attachment and gratitude. At a meeting of the Freeholders of Rusthall Common, in the autumn of 1834, it was considered that the most appropriate record of their feelings would be shewn in planting a Grove on the common, adjoining Queen Anne's Grove, to be called the Victoria Grove. … [and] on Thursday, the 12th of February, 1835, soon after one o'clock, notwithstanding the torrents of rain which were then falling, the committee of management with the magistrates, and a great number of the inhabitants, preceded by the local band, went in procession from the upper assembly room to the spot selected for the new grove. Precisely at half-past one, William Scoones, Esq. as representative of the Lord of the Manor of Rusthall, planted the first tree, a Lime, and spoke to the following effect :- " In the name and on behalf of Thomas Christopher Gardner, Esq. I plant this tree, being the first of a series of trees to be called the Royal Victoria Grove; and I hope they may flourish for ever and ever, as well as their Royal Patroness." Three cheers were then given, and the band played the national anthem. … On the evening of the 12th upwards of two hundred of the clergy, magistrates, gentry, and inhabitants dined at the Upper Assembly Rooms in celebration of the event. The grove is 550 feet long and 50 feet wide, and consists of three rows of trees, Elms, Limes, and Sycamores - the trees being planted 12 feet apart.