he has left the country permanently is correct because for good means permanently or forever.

This idiom or phrase is useful because it helps students understand the intended meaning beyond the individual words.

Examples: They moved out of the city for good. After the final match, he retired from football for good.

In this phrase, good does not refer to goods, benefit, or shopping.