it all depends on your hubby
if he is good at personal relationship and understands the complexity of life
you should be fine
in the first place, he chose to marry you again his family's pressure...
i do know a particular couple, who successfully solved this problem ten years later...
it all depends
it can develop and evolve to both directions
the uncertainty can kill, i know