How to make things better between us?

Apologize. You need to move on and so does he. He being married should be something that should immediately tell you to move on. I think you need to just have a strictly business relationship and nothing more.