Most of the time they dont contact the referee at all. Even if they did they will not ask anything more than what is on the reference page of your application. As long as your referee knows you and is aware that he has signed your application
you are fine.