Spouse visa

Hi there, I am a Ghanaian citizen who travelled here to the UK on the student visa in 2013.
On December, 2014 I got married to my beautiful wife from Latvia and in January, 2015 we had a letter from the home office inviting us for an interview. This was however before we even lodge an application.
We went for the interview at the home office in Glasgow on 15th of January, 2015 and I got arrested and taken to an immigration detention Centre.
During my incarceration, my solicitors prepared and sent an application to the home office for eea spouse visa which was refused with chance for an appeal.
In March, 2015 my solicitors prepared and Judicial Review and sent to the High Court which aided my release from incarceration.
Upon my release, we filed an appeal to the tribunal against the home office refusal. And appeared in Court.
However, the court refused my appeal as well. At this point my wife's working rights was taken from her and both of us were going to the home office to report periodically.
But in August, 2015 things took a very bad turn and we lost our accommodation due to lack of finance and rent payments.
I had to go stay with a friend while my wife had to stay we her friend as well on two different addresses.
At this point, reporting to the home office became very difficult, as a result of sometimes not even having money to travel for reporting hence we both stopped.
The separation and stress as well as financial woes destroyed our marriage as we would start having arguments on the phone every now and again. And my wife decided to relocate to her sister in Cardiff while I stayed here in Glasgow.
In March, 2016 I met my current girlfriend who is Scottish. And moved in together with her after a year (2017).
She had also separated from her husband she married to in Tunisia in 2007. But sharing parental responsibility with him in Glasgow for their only daughter.
In January, 2020 I decided visit a solicitor and discuss my options to legitimise my stay here in the UK. And he advised there in a possibility but I would have to go through a divorce with my wife. Then get married to the current girlfriend to be able to lodge a fresh application.
I am undergoing divorce at the moment but my current worry is that. I do not even have any I.D. to go register and get married at the council as all my documents are still with the Home Office.
I really need advice on options and what could possibly be the way out for me....
Please help