Thank you for visiting my topic, I hope you can all help me

Okay so I'm a 24 year old, employed British female.
I have been in a genuine relationship since I was 18. We both met at college.
He is a refused asylum seeker. He has exhausted all his asylum claims.
For a long time I didn't marry him because of cultural differences and my parents didn't want to accept it (story of my damn life). But now I've had enough and We really want to get married. Plus I want to go back to his country and visit his family with him too.
Please can you tell me what can we do. I have spoken to immigration officers in my family and they have given their advice but it sounded biased as they are within the family. Like what is the process. Is it simply. We get married at the registry and then he applies for a visa.
Please if you would kindly give me your best advise I would be extremely grateful.
Kind regards x