Charlie Sheen's twins were removed from the care of their mother Brooke Mueller this week amid allegations that the kids were not safe.

Los Angeles County Department of Children and Family Services removed 4-year-old Bob and Max out of Mueller's home. Sources told TMZ that officials determined Mueller was abusing drugs again, and the children were placed in the temporary custody of Denise Richards.

Richards, Sheen's ex-wife, is also the mother of his two young daughters.

"Brooke was given many opportunities by social workers to clean up her act. Social workers felt that Bob and Max weren't safe in Brooke's care," a source told Radar Online. "The decision was made late on Thursday afternoon, and the boys are no longer in Brooke's care."

Richards cared for her ex's children when Mueller entered rehab in December 2012. Her attorney, Yale Galanter, at the time shared why Mueller was seeking treatment for her addictions. She confessed to struggling with Adderall.

"Brooke was uncomfortable with the way Adderall was making her behave," Galanter said. "Brooke continues her lifelong battle with drug addiction by taking these steps herself to prevent a further drug relapse."

 Richards spoke to Access Hollywood Live in December of 2012 about opening up her home to the twins when Mueller decided to seek treatment.

"This is not the first time I've had all five, they're Sam and Lola's brothers. It was a full house, lots of love and life," she said. "Brooke knows anytime, and Charlie, that any time they need help with the boys, that I'm there."

Richards acknowledged that the situation was not normal. However, it was one that worked best for their blended family.

"They're our family and they're Sam and Lola's brothers and I can't imagine growing up without my sister, so anytime she needs help, I'm there for the boys," she added. "[Sam and Lola] are the best big sisters to [the boys] and they love them."

A hearing has been scheduled for next week in the hopes of finding a permanent home for the twins. A source said Mueller was depressed over the turn of events. She is "absolutely despondent that she lost her boys." 

Sheen has yet to make any statement and there has been no reason given as to why he was not awarded custody.