That looks OK. Can you confirm that your French home page is corretly linked to your English homepage?
If yes we will have to find out if your problem can come from a conflict. De-activate all your plugins except Polylang and switch you theme to Twenty Twelve. Does it work correctly ?
If yes, switch back to your current theme and activate your plugins one by one to find the source of the conflict.