I think he’s saying that the pain he suffered from his father’s parenting is partly due to the pain that his father suffered from his grandparents parenting. Which kinda sounds like he’s saying the Queen was a bad mum?
Well, she did disappear off for months at a time, either on tour or playing Navy wife in Malta, leaving Charles and Anne as small children to be looked after by her parents - no wonder Charles was close to his grandmother. There's an excruciating photo and video clip of HM greeting Charles after an absence - with a handshake. She also handed over family decisions to Philip to make up to him about his secondary position and his children not taking his name; Philip and Charles did not get on for a long time, being totally opposite characters, and Charles completely hated Gordonstoun as opposed to Philip thoroughly enjoying it.
ETA: Philip had not had a family home or close family since he was eight and had been separated from his parents since, with almost no contact. He was open about enjoying the family atmosphere with Elizabeth, Margaret and their parents. He probably didn't have much of a clue about bringing up children and had learned not to show his emotions but "just get on with it" because there was no other option. Perhaps not the best person to be father to a sensitive, romantic, artistic son. I do find it surprising that the Queen was so distant from her first two children though, given the warm and close family she had grown up in.