Use On foot when you want to express the idea by walking. The phrase should be understood as a whole expression.

Examples: We went to school on foot. The park is close, so we can go on foot.