Part of the reason for the mistrust of Brown in the Labour Party was the private knowledge of his excessive drinking, which exacerbated his rude and aggressive style of politics. Anthony Crosland called the leadership election as "A choice between a crook (Wilson) and a drunk (Brown)". The mainstream press of the day did not publicise this problem, but it became publicly apparent when Brown was invited on
Associated-Rediffusion television to pay tribute to
John F. Kennedy after his assassination (Brown was probably the closest Labour politician to Kennedy). Brown had come from a dinner in
Shoreditch where he had already drunk a great deal, and drank more while preparing to go on air - having a row with actor
Eli Wallach which became physical. When Brown went on air, millions of viewers saw him interpret a fair question as an accusation of his having overstated his closeness, then give a morose and slurred tribute from which it was apparent he was intoxicated. Brown had to issue a public apology.
Brown bitterly resented his leadership defeat, which came only a matter of weeks after he had defeated Wilson for the Deputy Leadership. He disappeared for five days after the result was declared, using an assumed name to book a flight to
Glasgow; the newspapers were full of stories about the vanishing politician. When he returned he demanded of Wilson that he be appointed Shadow Foreign Secretary, which Wilson refused to do.
He retained the Deputy Leadership and despite his personal differences, played an important part in advising Wilson about Labour's campaign strategy in the
1964 general election. It was decided that Wilson would make only a limited number of major campaign speeches outside London, while Brown would tour the country speaking in all the marginal seats (his main theme was predicting an imminent economic crisis). Brown later calculated that he had made 100 speeches. In one of them he made a
gaffe by suggesting that the mortgage interest rate could be cut to 3%; the Conservative Chancellor of the Exchequer
Reginald Maudling was quick to capitalise on this and ask how much it would cost.