lucyLIPS wrote:He hasn't got a criminal record so it's just the fact that he came here and worked illegally
It's JUST the fact that he came and worked illegally? Why do you dismiss this as though it's like littering? Your partner has willfully entered the UK illegally and then undertaken employment illegally, which could have been undertaken by a law abiding migrant or indeed a member of the resident labour workforce (as per UKBA terminology).
The Home Office view this very seriously and is in fact a criminal offence. Perhaps your partner should have the same view. You can't flout a countries immigration law and then expect them not to remove you.
It's because of this that the Home Office will impose a 10 year re-entry ban (providing he is removed) and therefore won't be "teaching him a lesson" but adhering to the immigration rules.
Anyway, regarding your case. Since you have only been in a relationship for less than 12 months, you don't meet the requirements under Appendix FM. You are not married and you haven't been living together in a relationship akin to marriage for a period of 2 years. Putting the financial requirements aside.
He does not have sole parental responsibility for children in the UK,so cannot meet the requirements under the Parent route. Paragraph EX1 is therefore not applicable.
You could make an argument regarding his private life but he would need to demonstrate how he has lost all social, cultural and family ties to Albania, having only been in the UK for 2 years.
You could try and make the argument that your children are dependent upon him (and yourself) but again this would fall for refusal given the short term of the relationship. Furthermore, his human rights have already been considered as part of his Asylum refusal. The only thing that may not have been considered is your human rights and those of your children. However, the Home Office will argue that any seperation is temporary and you were fully aware of his immigration status when the relationship commenced. Additionally, there is no mention of your children's natural father.
Best bet is to allow your partner to voluntarily depart from the UK incurring only a 12 month ban and then looking at re=entering LAWFULLY after 12 months. Alternatively, you relocating to Albania or looking at the Surinder Singh route.