Not really, if there was no tax there would be no money.
The most succinct way that I have found to express the relationship between taxation and spending is that spending at the federal level is constrained by aggregate spending this year, not tax receipts last year.
spending is constrained by whatever Congress says it is. the difference is borrowed.
It's logically impossible for a government to borrow the currency it issues. What we refer to as borrowing is just swapping one government liability (reserve balances) for another (treasury bonds).
you don't borrow from the present, you borrow from the future and hope to pay it back with growth