His net worth increased due to asset appreciation. Nobody physically transferred him any money and it can fall back down tomorrow. Should he get a refund if Oracle stock tanks?

He pays less next year because Oracle stock is worth less. Just like property taxes on people's houses.

The math on taxing unrealized gains or losses doesn't work out for the reasons you pointed out. Property taxes, on the other hand, have been working for a long time.