Yes. This is a big headache in graphics, where there are big tables indexed by texture index down at the GPU level. Managing those as the content changes, with the GPU using the data while the CPU alters it, leads to huge complexity in Vulkan graphics.

The two times I've had to deal with a really tough debugging problem in Rust, it's been related to some crate which did that.