Asylum Seekers To Living Relationships with EEA

Hi i need help because i am very confused .
Please help me and advise me thanks.

I came UK London to jan 2011 and extend my to july 2012 to 18 jan 2015 and for last day to my visa i apply Asylum and i used to live with my Girlfriend she is from Hungary EU and now i apply living relationship visa 18 nov 2017 and i did biometric 8 dec 2017 and now i recived latter from home office and my legal aid solicitors to withdraw asylum if you want to continue living relationship case .

But there is only one problem on that home office latter they said behalf of me .
I withdraw my asylum because i dont have fear to go back i dont have problems to go back every thing is now ok for me there but which is not true.

My fear my problems is not finish i still have threats to go back so how can i sign on that latter .
I send fax to home office and i said i still have life threats i withdraw my asylum just because now my circumstances is change now i have my Girlfriend and she is 6 month pregnant with our baby boy.

But they didnt reply my fax or email .
I am very confused and i dont know what to do i am afraid.
Please help me with your advice thanks.

(Sorry if anyone dont understand anything my English is not good ) i apologise for that.