Use For good when you want to express the idea forever or permanently. The phrase should be understood as a whole expression.

Examples: They moved to the city for good. The shop closed for good.