Do we really take away from the artist? In what way?
The obvious answer is that you take away a purchase the person to give the gift would have made. One could argue that there is also value in propagating someone’s art and potentially increasing the artists customer/patron base. Think of it as advertising or to put it in the context of a drug deal, the first hit’s free. The gift recipient may then go on to buy another work from that artist and even pass on the one they were given to someone else, continuing the cycle.
I’d also argue that there isn’t widespread agreement on reasonable compensation for artists. Personally, I don’t consider artists to be special enough in the context of people that make and produce goods, that they should get unique treatment. Why does a family deserve the financial benefits of trademarks and copyrights decades after the artists death. That’s just one example, but in a time when many’s artists view their livelihoods to be at risk because of AI, it’s not popular to engage in any debate that undermines the artist in any way.