Can NNs be made to be better than trees on tabular data with some further constraints, or something?

You might find this interesting: https://arxiv.org/abs/1909.06312