Yeah the benefits of a model that can understand text well enough is certainly that one could in theory just describe the layout. Just let it know what connects to what, what's on each floor, etc. Might work if it can figure out where it is based on contextual info, but probably not super well yet I imagine. VLAs are known to have very little text context, like sentences worth at most, maybe this one's different.