At their annual conference at Brighton last week, the Tories debated their future. During the speeches and the votes, the man who will have most to do with that future sat silently on the sidelines.