Course he did, got to paint the narrative of him being the victim in this situation & how hard done by he is!
I cannot stand people like this - often older, male family members in my experience - who like to belittle and bully. Bottom line, actions have consequences. The real issue is that he wont like that you’ve put your foot down & stood your ground. Hence the attempts to minimise what he did.
Don’t ask his permission, go and see your nan. People like him will find fault regardless. Be kind to yourself