You are only exempt if your partner is exercising treaty rights (eg working) in another EU state where you are both living and you are returning to the UK from there. if are currently in Australia and your partner is in the UK you won't qualify.
are you and your partner married?