fiancee settlement refused pls help

Hello all, I applied for a fiancee settlement visa June 30 this year and was refused. I am in the relationship with my boy friend for a year. During the last 6 months we;ve been living in the country of my residence(he is British nationality). We submitted all relevant documents to support the application including bank statement, property deed, evidence of our relationship with letters, cards, phone bills, etc. The refusal letter contains general info about Immigration rules and based only on the balance of probabilities. I appealed against the decision and my boy friend sent in a complaning letter to the embassy. The appeal is in progress and we don't know will it be overturned or the hearing will take place. We now plan to go to Cyprus to get married there. Does anybody know if I can apply for settlement spouse visa from Cyprus though it is not the country where I normally live? Any help pls what can be done in this situation ?

Many thanks

Section 4 - Entry Clearance > 7.