Caches are important for cpu core performance even when the the working set doesn't fit.