Yes I made a test and understood that the plugin is not what you are looking for.
As for delete permanently, that will delete the translation only rather than the media file itself?
Yes. Polylang takes care of this. The file is deleted only when the last translation is deleted.