Oliver Hudson Admits He Was Unfaithful to His Wife Before Their Wedding: ‘I Regret Causing Pain’

Oliver Hudson is getting candid about the early days of his relationship with his wife, Erinn Bartlett.

In the most recent episode of his and his sister Kate Hudson’s Sibling Revelry podcast, Oliver, 47, revealed that he was unfaithful to his wife, 51, before their 2006 marriage.

“When I got engaged, something happened psychologically, and I spiraled, and I was unfaithful, and I was cheating, and I was crazy,” Oliver told guest Robyn Lively.

“I never got caught,” he explained. “I told her everything because I couldn’t live with myself and get married and be married and have children with this sort of weight.”

Oliver said he had to get through something “psychologically” and credits Bartlett for being an “amazing woman.”

“And my mother played a big part in it as well,” continued Oliver. “Where it’s about looking at the entirety and the totality of the relationship, not just the action. Even though it might seem extreme, let’s dig in a little bit into why and looking at the whole person rather than this one affliction.”

Oliver said he believes he is a “good man” and is “not malicious.”

“I was going through whatever I was going through and we were able to sort of therapy and do all of it and get through it,” he said. “And honestly, if that didn’t happen I don’t know what kind of a person I would be. So do I regret it? I mean no, I guess not. I regret causing pain. I don’t want to cause anyone any pain.”

His relationship with Bartlett became a topic of conversation after Lively asked him if he’d ever had any regrets.

“Regret is an interesting word,” said Oliver. “I’m not sure I have many regrets because if I didn’t, it was a choice that I made, whether it was a positive one or a negative one. I’ve made some horrible, horrible choices in my life just generally. You would think I regret doing that, but I don’t know who I would be if I didn’t make that choice.”

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

Oliver and Bartlett got engaged in 2004. After tying the knot, he and Bartlett welcomed three children together: Wilder Brooks, 16, Bodhi Hawn, 13, and Rio Laura, 10.