"The worst part was the gaslighting. I felt like a fool," says the man of the relationship that convinced him he wanted to be single instead