Are exes’ names a complete no no?

My husband really likes the particular baby name, Henry, and although it’s a lovely name, it’s the name of an ex of mine. Not the most significant ex, but memorable. Thoughts?