President Coolidge kept a raccoon as a pet inside the White House. I picked that up by rereading Burt Folsom’s wonderful book, The Myth of the Robber Barons.
I once read that Teddy Roosevelt was so taken with learning ju-jitsu that he had a grappling gym added to the white house.