once and for all is correct because once and for all means finally and permanently, so that the matter is settled completely.

This idiom or phrase is useful because it helps students understand the intended meaning beyond the individual words.

Examples: We need to solve this problem once and for all. The judge settled the dispute once and for all.

The sentence is about settling an issue completely, so the other time expressions do not fit.