He was still a Tory gammon