One very important task to solve is the ability to select a box from a shelf and set it neatly on a pallet, as well as the reverse. People have been working very hard on this problem for a long time, there are impressive demos out there, yet still nobody is ready to set their best box manipulating robots loose in a real warehouse environment.

How hard can it be to consistently pick up boxes and set them down again in a different location? Pretty hard, apparently.

I mean with rigid plastic containers robots are 'pretty consistent' at it now.

The problem with things like cardboard boxes, especially at any size is internal weight distribution and deformation of the box. If you take someone that is pretty new to stacking boxes at a wearhouse and give them sloppy boxes (ones that bend or otherwise shift) they are going to be pretty slow at it for the first hour or so, then we'll internalize the play in the materials and start speeding up considerably while getting a nice result.

It's pretty amazing how evolution has optimized us for feedback sensing like this.