If both of you would like to put in the effort, look for marriage counsellor and get into open conversations. Talk about it peacefully and see if things will work out.
If both have the mutual understanding on how this is affecting both, something will work out.
Good luck.