Is all humour potentially offensive?

I am wracking my brains trying to think of a type of humour that could not be misconstrued by somebody or group/race of people as offensive even though the intent may not be to offend.
Any ideas/examples?

Story humour - good one. Knock knock jokes are unoffensive but not really that funny (although I guess Tommy Cooper was pretty good at it).