Permanent residence can only be applied for after you having lived with your partner in the UK for 5 years. He must be working/self-employed/studying or self-sufficient (this is called exercising EU treaty rights). This is under the EEA Directive 2004/38/EC on free movement. The Directive can be found here:
http://eur-lex.europa.eu/LexUriServ/Lex ... 123:en:PDF.
As he is working in the UK at present, you will be eligible to apply for an EEA family permit for you to come to the UK to stay with him. You can find the details here:
https://www.gov.uk/family-permit. You should read the details quite carefully and then post back if you have any questions.
Have you guys thought about getting a civil partnership or a marriage yet? I'm not sure how this process works, but I know it is possible for your to get a civil partnership in certain UK diplomatic posts. I have my civil partnership with my Chinese partner at the British Embassy in Vietnam in 2011. Alternatively, it might be easier if he were to sponsor you to get a visa for another EEA country and then you might be able to get married/civil partnered there. I don't really understand this procedure so I hope someone else will help you.
Please urge your partner not to consider British citizenship yet. This will make things complex. Ask him to wait.
There is a lesbian, gay, bisexual and transgender forum online as well:
http://uklgig.org.uk. You might find some info here.
Hope this helps a little.
C