most decidedly is correct because by long odds means by far, certainly, or most decidedly.

This idiom or phrase is useful because it helps students understand the intended meaning beyond the individual words.

Examples: She is, by long odds, the best speaker in the class. This is, by long odds, the most difficult question on the test.

The expression is used for strong comparison or emphasis, not for running away or being faithful.