I've done archaeological work in Mongolia. The oldest things I've found predate the last glacial maximum. Those rocks might not have survived a few million more years, but I can certainly think of lithics that would.