The 1921 OS map shows the inn at this location. It appears on OS maps at least as late as 1957 but seems to have gone by the 1973 sheet, so presumably closed between those dates.

It seems probable that the building in the modern photographs (Fox Cottage) was actually the pub. The building in the foreground of the old photograph is called Tally-Ho Cottage, but the pub sign visible in the picture appears to actually belong to (the now) Fox Cottage, which is barely visible in the old photo. If you can clarify this or have any more information, please let us know.

This seems to be confirmed by the 1884 OS map, which appears to show the Fox & Hounds as the northern-most of the two buildings.

The pub is also listed as being in "South Elmham St George"…