certainly is correct because by all means means certainly, yes, or of course.

This idiom or phrase is useful because it helps students understand the intended meaning beyond the individual words.

Examples: By all means, ask your question. You may borrow my pen, by all means.

The phrase is a polite way to give permission or agreement; it does not mean uncertainty.