Despite their seemingly good relationship, rumors started surfacing that Prince Charles was engaged in a feud with Carole Middleton over the time spent with their mutual grandchildren, especially Prince George.