Decomposition returns carbon dioxide to the air. Or worse, methane, if there isn't enough oxygen.

Don’t things decompose underground as well?

The carbon stays underground.