living with someone while married to someone else

I believe that god brought me and this man together but i am still married to another man{in the process of getting a divorce} i did not leave my husband for this man i had already left but i feel the weight of the sin in my life like a ton of bricks on my chest i love this new man in my life so much he is good to my kids and loves God and provides stability in our lives that we have never known i believe that God gave us each other but the way we met and how we are living leaves me to wonder what God has in store for me with all the burden i feel about living this way i feel if i can get through the divorce that there are great things to come i can do all things through Christ who strengthens me i just have to believe in the greater plan and give it all up to God