on and off job can affect my pr

Hello to everyone, im very lucky to have this forum , I hope soneone can enlighten me. Im married to eu national, hes been in uk since 2007, we got married 2010, I received my residence card for eea family member april 2011, but my husband been on and off to his job, 2x last yr but between those gaps he always signed to job center, 2 months without job. The he found a job again. Will this affect my application for permanent resident? He didnt apply for permanent resident, I ask him but doesnt want to... I work full time as well. This coming nov, I will apply for pr. I been in this country ssince 2008 but I was student for two yrs. Pls help....