He doesn't mean it, not really. Better to keep expectations around him low. Easier that way. He can slide under the radar and do what needs to be done without any undue attention.

A roll of a broad shoulder. Maybe a hint of a smile, a peek of a dimple. "Nah. No fun in that, boss."