How old were you in your first memory? Like most people, probably no younger than 3 or 4. There are various ideas about where our early memories from childhood go, which we can test by tracking how memories in the brain evolve over development.