It is memoryless just in a different state space.

In the state space that includes all of the time periods, with infinitesimal granularity since the birth of the universe.

Welcome to a well formulated POMDP.