This is why I don't budget. I'm not immensely financially irresponsible: I make maybe 1/3 to 1/5 what the average person on HN makes (~50k), but I still contribute to my 401k enough to get my match, I could fairly easily tank about a 10k expense/probably live for 3-6 months on the money I have set aside with adjustments.
But whenever I've tried to budget, I run into the same problem anorexics do with counting calories. I will literally hurt myself in order to see the savings number go up. I can live on $10/week for food. All it will cost is my health. I can be in pain for 8+ months out of the year (MS muscle spasticity + heat intolerance ) so I don't use my heat or A/C because those cost money. Etc. I will literally berate myself to the point of a panic attack over buying a $25 book from an author I've loved for decades, believing it makes me a horrible human being to be so 'frivolous'.