Use By the time when you want to express the idea of when a particular moment happens. It is a fixed expression, so the full phrase carries the meaning.

Examples: By the time we arrived, the show had started. By the time I finished, it was dark.