‘He doesn’t make eye contact and then he talks to you in this monotone voice,’ biographer Michael Wolff says