I read he lived with a gay actor called Anderson Lawler for several months.
He also reportedly had affairs with Ernest Hemingway, and Sir Cecil Beaton recorded having a long affair with Cooper in his diaries.

At least Cooper wasn't a racist like James Stewart though.