The past few weeks have been notoriously challenging for the royal couple Prince Harry and Meghan Markle.

The two have been all over the news since the release of their ITV documentary. Some said that the two have revealed too much about life as a royal -- somehting that has reportedly left the Queen upset. 

So when the Duke and Duchess of Sussex announced that they would be taking six weeks off from their royal duties to travel to the U.S. for Thanksgiving, no one was surprised. In truth, the leave might be something that the royal court suggested to cool things off at the palace. 

However, in the "Loose Women" panel, Paul Burrell -- Princess Diana's former butler -- claimed that the Queen was saddened by the news of the couple leaving for the holidays.

Burrell emphasized that the Queen cherishes moments spent with family at her Norfork estate every year. This year would be especially different, as the whole family of Prince Harry has decided to spend Christmas with Meghan Markle's mother in Los Angeles.

Breaking Tradition

Meghan Markle has openly talked about the challenges that came her way when she married into the royal family. However, she and Prince Harry are determined to raise their kid in their own style of "parenting."

Moreover, their decision to spend the holidays in the U.S. is not that surprising. Meghan is American, after all. She has her own traditions she would like to instill in her child. 

However, Paul said that Meghan and Harry were not the first royals to break the traditions. In fact, he said that Princess Diana was thinking about buying a home in Malibu when she died in 1997.

Also, Prince William and Kate have spent two Christmases outside of the palace grounds. They spent it with the family of Duchess Kate at their family home in West Berkshire.

The Sun, earlier this month, exclusively revealed that Prince Harry and Meghan Markle will be out for the holidays to hopefully "recharge their batteries." A Palace spokesman said that the Duke and Duchess of Sussex are hopeful to have some extended family time towards the end of the year. 

The Royal Holidays

At the panel, Paul talked about the royal festivities that have become a tradition over the years. He revealed that the Queen loves being around family.

"She's a mom and a grannie," Paul said.

The former royal butler added that Queen Elizabeth II loved having her grandchildren around the Christmas tree at the Sandringham home, as "she revels in seeing the little ones put the last baubles."

Panellist Stacey Solomon asked Burrell if the Queen would be saddened after Harry and Meghan opted to spend this year's holidays with the Duchess' mother, Doria Ragland.

Paul then admitted that the Queen will be "upset" by it, but he pointed out that the Queen would definitely understand.

"Meghan Markle is half-American, so it is only natural that she would want her child to experience life and festivities where she grew up," he said. 

The decision of Prince Harry and Meghan might have upset the Queen, but they have the support of her Majesty. Everyone is hopeful that the holidays will bring cheer and delight, whether it is spent at the palace or not. 

READ MORE: Royal Signals: Are these Prince Harry, Meghan Markle's Secret Signals?