Early removal scheme, when can I visit UK again?

[zetronix]

Hi,
I was sentenced to 46 months prison sentence in September 2016 following a mistake of trusting someone to invest money wisely, I was arrested for Fraud and accepted my guilt and punishment.
Life moved on and I was in prison for a couple of months when I was handed a notice of liability of deportation. (I am a Swedish national I was in shock as I have built my life in the UK and my partner was British, I thought that I will loose her as well as everything else. I got a solicitor involved who told me that fighting a case like this is very hard, I need exceptional reasons as to why I should not be removed from the UK following my conviction. Anyway In this letter I was given the opportunity to return to Sweden voluntarily and if I choose to do so I'd be released 9 months earlier. I accepted this as I just wanted to get out of that hell hole and back to my family and my partner(who accepted moving to Sweden with me). I served 14 months and was sent back to Sweden in December 2017.

I have resettled back into the community, found my self a decent job with a big company, got married and bought a house, in other words we have now settled well in Sweden.

Question is, When will I be able to visit my inlaws and friends in the UK again?
I have looked all over the papers and i cant seem to see anywhere when I can go back.
The only thing that I can see is that I am not allowed back in to the UK until my Sentence end date (including the licence time) which in my case is in August 2020 and if I do go back then I will be arrested and have to serve the 9 months i got off.
Some people say that I am never allowed back, other information suggest 10 year 5 year and even 2 year.
Anyone here who knows anything about this or whom I can call to ask?