Do employers actually call references?

Yes, employers actually call references. Of course, this isn't the case 100% of the time, but you should always choose your references, knowing that a potential employer will likely call them.

After all, employers call them to ensure they're legitimate and see what said person would say about you over the phone. This will allow them to confirm the reference.