There is a problem with your setup as Polylang should do what you expect.
Could you test with a default theme such as twenty twelve and no other plugins activated to check that there is not a conflict somewhere?
Could you precise your Polylang settings?