Casting rumors continue to swirl regarding season four of the reality series The Real Housewives of Beverly Hills, with reports stating that Kim Richards is ready to leave the show.

Kyle Richards told friends she feels she is being picked on by her cast members Lisa Vanderpump, Brandi Glanville and Yolanda Foster, according to a source. The attacks stemmed from allegations that Kyle's husband, Mauricio Umansky, was cheating on her and because of the bullying, Kyle has reportedly spoken out about quitting the reality show. Now her sister, Kim, is rumored to leave the show if the attacks on Kyle do not stop.

"Kim has come a long way in her sobriety, and isn't afraid to assert herself now. She demanded that the bullying Kyle was being subjected to stop, or else," a second insider said. "Kim only did the show because Kyle wanted her to, and she needs the money. It's not worth it to her though, to see her family getting raked through the coals for ratings."

However, the sisters are likely to stay for the show's fourth season because of contractual obligations, the source added.

Although Umansky previously denied cheating on Kyle, her costars Vanderpump and Glanville still decided "to confront Kyle about it on camera," an insider previously told Radar Online. "They absolutely blindsided her, and were relentless:"

"Brandi maintained she had solid information to prove that Mauricio has been cheating on Kyle. Kyle became extremely upset, and refused to listen to the girls. She felt especially betrayed by Lisa because they had once been so close."

Bravo producers were looking to add new faces to the Housewives cast after the announced departures of Adrienne Maloof and Camille Grammer. A number of women said they were approached to be a part of the show but in the end executives found two new women, a source told E! News.