Note you can't go down the High Street from the East. You need to turn left into Merton Street (one of the oldest streets in Oxford, cobbled too) and follow it round. You can also access it from St Aldates/The High Street.
Appreciate this is too late for Captain Jack, but may be of use to future Oxford visitors!