The Newmarket Pubs website tells us that this seems to have stood roughly where the Doric cinema (later various nightclubs) was built.

It seems to have been open as long ago as the 17th century. It isn't clear when it closed, but this seems to have occurred some time in the 19th century.