Kateryna, it really was relevant to establish your husband's UK immigration status prior to Poland joining the EU on 01.05.04. Now that you have supplied that information I think it is possible to comment thus :-
Your husband is entitled to get a UK Permanent Residence sticker in his passport and should proceed to do that. If he does not already have a Residence Permit sticker in his passport he should use
Form EEA1 to apply for that. In any case he should use
Form EEA3 to get a Permanent Residence sticker.
He is entitled to get that based upon what you post by virtue of para 255B which specifically applies to people in your husband's circumstances. That paragraph is contained within
this document.
So once he has that Permanent Residence sticker he is classed as "settled" in the UK. He is then entitled to get you to use form VAF2 to apply for a two-year spouse visa. Alternatively you could use form VAF1 and apply for an EEA Family Permit.
There are differences. Using the form VAF2 will cost £260 but will lead to you being able to apply for British Citizenship after three years in the UK, assuming your husband has become British in the meantime. Conversely the application on VAF1 will cost you nothing but in view of today's announcement it would be six years before you could apply for British Citizenship. You may consider that it is better to apply for the Spouse visa given you will acquire better rights sooner, but that is your choice.
Finally, if you are going the VAF1 route and applying for an EEA Family Permit, a mere Residence Permit in your husband's passport will suffice, rather than a Permanent Residence one needed to apply for a spouse visa using form VAF2. Given the need to show that he is not subject to the A8 transitional arrangements applying to most A8 citizens coming to the UK, I would expect your husband already to have a Residence Permit in his passport. Is that correct?