How to make things better bewteen us?

Sorry, but you're a fool for messing around with a married man. If you can't keep your emotions out of the workplace it might be better for you to leave it and find another job.