"It's not like you're my wife."