Question:  Is it possible to have the DM-4 put us where the last file is, in the folder where we last recorded, when we turn  it back on?

Answer: Unfortunately, no.  This is not possible.
Verification Source: Ryusuke Hamakawa, Olympus Product Champion.