Vice President Joe Biden's son was kicked out of the Navy after he was tested positive for drugs, The Wall Street Journal reported.

Hunter Biden, 44, was dismissed in February after cocaine was found in his system. The youngest son of the Vice President held a part-time position in the Navy Reserve as a public affairs officer for less than a year. The Navy, however, didn't disclose the reason for his discharge due to privacy laws.

Biden, who is also a managing partner at an investment company, released a statement after the news was revealed by the media on Thursday.

"It was the honor of my life to serve in the U.S. Navy," Biden said. "I deeply regret and am embarrassed that my actions led to my administrative discharge."

Biden was assigned to Navy Public Affairs Support Element East in Norfolk, Va., on May 7, 2013. In June 2013 he was given the failed drug test.

The Vice President's wife, Jill Biden, revealed that she was proud with their son's decision to join the Navy. "This year, I'm looking forward to standing with our son, Hunter, when he is commissioned as an ensign in the United States Navy," Mrs. Biden said in 2012.

The Vice President often speaks about his children during his public appearances. In December, he praised Hunter for his work as the chairman of the World Food Program USA.

"I'm so incredibly proud of him," he said in December.

He has yet to release a statement about the drug incident.