The only man who scared The Beatles