The inn dates back to before 1780, when it was advertised to let in the Norfolk Chronicle on 23 Sep 1780**** as follows:

Bury St Edmund's, Sept. 20 To be Lett, and entered upon directly, or at any Time before Christmas next, that well accustomed Inn known by the Name of The Castle, eligibly situated for both Markets, and late in the occupation of JOHN APPLETON, deceased. The Stock, Household Furniture, Fixtures, etc to be disposed of at the same Time. For Particulars, enquire of HENRY LEECH.

Next door to Moyses Hall which is an old Norman building, dating from about 1180. It was probably built by a Jewish moneylender, and is constructed principally from stone. Later, until 1610 it was an inn. In the eighteenth century a workhouse, gaol, in the nineteenth century a police station…