The finger means I'm serious

See, he doesn't just use it when he's mad.

Look for the finger AND the red face. That's the mad one.