Good. The true mark of AGI is when a company accepts liability and doesn’t bury “for entertainment purposes only” deep in their TOS. Same as it works with employees.
Same for self-driving. Your car is not self-driving until it accepts liability and you count as just a passenger.
But watch as Germany soon loses AI Google results.
I think it's a completely reasonable position that companies making self-driving cars and question/answer systems are legally liable for any errors.
But if you hold that position, you also have to be fine with companies not offering products and services in your country. AI systems will eventually be good enough (in 10-20 years) for companies to be able to deploy such systems with sufficient accuracy to afford the lawsuits. Until that time, such countries would just not have access to systems before they were bulletproof.
> AI systems will eventually be good enough (in 10-20 years) for companies to be able to deploy such systems with sufficient accuracy to afford the lawsuits.
I doubt that will be the case, because of the long tail problem. (same with self driving cars and other ML related problems).
In fact, we have counter-examples today. Newspapers (even reputable ones) can't get it right every time, despite the fact that they have both trained people and in theory they're setup to catch that w/ reporters - fact checkers - editors. And still, from time to time, they get it wrong. (and I'm not talking about purposefully getting it wrong, just honest mistakes.)
What will likely happen with a ruling like this is that the answers will be hedged and legalesed and muddied up the wazoo.
Newspapers have mechanisms like corrections and apologies that can be used to "right" a published falsehoods.
This relies on me being able to find out if a newspaper lies about me, which is usually easy since we can all go buy the same newspaper. With AI it is much harder to find out that it has been telling potential customers wrong things about my business.
You don't realize how this works do you? One incredible power (executive) governments have is to let people get away with crimes. People don't realize they have this power, but they control the public prosecutor who can legally choose to do something ... or not.
You will find references to this in stories where the government lets people get away with murder, because of course, that's dramatic for a story.
But when "bigger interests" (ie. the Chancellor's bank accounts) are at play, just to name one example, China gets to distribute lead-painted children's toys in Germany and doesn't have to accept liability. Russia gets to import sanctioned natural gas over illegally constructed pipelines. Etc.
As to how this goes within the EU, in the worst (but common) case, is as follows: the government chooses a company, and refuse to sue them. They have a tendency to choose the worst possible company, like using Palantir for policing Germans [1]. Then you find out most of the Chancellor's grandchildren are working there.
[1] https://www.dw.com/en/german-police-expands-use-of-palantir-...
> AI systems will eventually be good enough (in 10-20 years) for companies to be able to deploy such systems with sufficient accuracy to afford the lawsuits.
This doesn’t sound convincing. What AI and what company?
LLMs don’t seem like they will ever be reliable like that.
Self driving like waymo might be?
> LLMs don’t seem like they will ever be reliable like that.
True. But you never know if / when there will be a new big breakthrough in AI, which will probably be based on a new architecture / paradigm, i.e. it won't be LLM-based
Who would argue for offering self-driving cars before they're ready and safe? As a cyclist and pedestrian, of course I don't want them in my country if nobody's going to be liable when they run me over. Let them work out the kinks on Americans since they're so eager to be on the cutting edge of progress.
I think they should just have to properly explain how AI tends to make things up when it doesn’t know, and that it’s good for coming up with ideas or suggesting directions for research but that you shouldn’t rely on it, because currently their advertising makes you think you can rely on it
The “AI can make mistakes” kind of disclaimers they hide in the corner don’t really cut it
It's not even in the corner, it's completely hidden by default. You have to click on "show more" to expand the AI barf to see it.
> I think it's a completely reasonable position that companies making self-driving cars and question/answer systems are legally liable for any errors.
Well, for cars anyway, the manufacturer was always liable for the car doing something wrong (example: driver changes the volume on the radio, and that disables the brakes).
It's just that techbros want an exception to this rule if the car is self-driving.
I see no reason for an exception to this rule.
> Until that time, such countries would just not have access to systems before they were bulletproof.
Correct, most jurisdictions do not allow businesses which cannot be held liable for their actions. This is pretty core to a modern society.
Imagine if a company selling Knicks tickets was not expected to then actually provide said tickets and there was simply nothing you could do about it. Oopsies our sales page is for entertainment purposes only
To be fair, the internet has spent some 30 years figuring out how this works and it’s still not fully resolved. For the most part we’ve agreed that companies must follow the laws of both where they live and where they operate. This wasn’t always obvious!
Almost all jurisdictions allow businesses which cannot be held liable for all their actions. Imagine losing you house because someone decided to smother themselves in your infused cooking oil and light themselves on fire.
Businesses are made to make it easier to share profits and responsibilities when trying to fulfill users wants. Laws are made to offer protections for consumers (because nobody has time for common sense), but at the end of the day the consumer has to take responsibility or no products can be made. If you're too fat for a chair, it's on you to find or make one that works- not every product is for every person. Laws only stop chairs being sold that are too dangerous for anyone.
> Almost all jurisdictions allow businesses which cannot be held liable for all their actions. Imagine losing you house because someone decided to smother themselves in your infused cooking oil and light themselves on fire.
How would that be the company's action? The only way the business might be liable is if they advertised their product as safe to use when lighting yourself on fire or if there was already some law that required them to warn customers not to light themselves on fire while using the product and they ignored that law.
In this case, it's not about what somebody else did. It's what Google did. There were already laws against lying about companies by saying they did illegal things when they didn't, google broke the law, so that's what google got in trouble for.
Consumer protection laws aren't there to replace common sense, they're there to prevent things like outright fraud and poisonings/murder.
I see an economic and social problem:
Freedom as in freedom of private property can only be guaranteed by the State. The State watches over its own population and makes sure that private property, i.e. capital and work, is made productive, so people go to work, businesses make profits, and everybody pays taxes. Taxes are the State's prime source of income.
When all these million of private interests collide, which they are bound to do, the State provides a jurisdictional system that has to decide between those private interests and the State's own interests.
E.g.: If a business owner refuses access to medical patents or to lower prices and safe potentially people's lives, the State has to decide between that immediate interest and its own interests, which is protecting private capital, as its source of income. Since I'm in Germany: In the emission scandal Volkswagen didn't just physically harm people, VW violated the private property of millions of customers. Despite that, the German State sided with Volkswagen the larger capital and did nothing. During Corona, the German State refused to open patents for a limited time to help safe people's lives in poor countries. Doing so would've violated the interest of private capital, so it refused. In contrast, if I as an individual refuse to help somebody in an emergency, the State would either fine me or put me in jail. In this case, people's lives become the State's prime interests, because they are also the State's source of income, as a productive workforce.
Sounds like a win win to me
To remove the choice from responsible people who can understand that LLM answers are not to be trusted with anything important?
If our standard for laws would be that "well no reasonable person would do this/believe this" then nothing would be illegal, there'd be no need to label any product as potentiality harmful, etc.
Do you really want to go there? That everything in the world would have a literal "caveat emptor" attached to it?
I thought Google labeled its AI summary with a disclaimer already. I don't want companies to be forced to only offer safe-for-children services.
And the european consumer doesn't want harmful products to be beta tested on the public.
It's unbelievable how lightly some people hand over the tools for mass manipulation to a single corporation in the name of freedom of all things. We're not talking about a laser pointer here.
There is a disclaimer, yes, but you have to admit that it's pretty shit, innit? I mean for one, it's about the size of a human hair, and at least when I tried it, the disclaimer came up only when I clicked the "Show More" button. It might admittedly show up earlier if the response is shorter, admittedly I don't know. Also personally I'm a bit uneasy with the idea that just with a simple disclaimer they could avoid any and all liability. Not your argument, I know, but still.
As for not wanting to force companies to release only "safe-for-children products", I do actually agree. However I consider it to be a matter of degree, and in this case for example, I think that if nothing else, Google should say the very least make the disclaimer a bit more prominent and maybe tweak the model so that it's not quite as confident in its claims in the AI Overview.
> As for not wanting to force companies to release only "safe-for-children products", I do actually agree
That would be nice, but as every effort to restrict kids from using software which are not safe-for-children keeps getting condemned for being invasive surveilence, and every effort to stop kids getting the hardware instead gets condemned because of how much of society is now built on assumption everyone has a phone…
Something has to give.
Dunno what, but something.
Yeah, they could make it more prominent at the top. I would be fine if it said that "AI may give totally wrong answers" but that would never happen.
The harm was not done to the readers of the AI generated response, but to the defamed companies.
And yes, it is ok to remove choice if the existence of that choice violates other person’s rights.
Google can continue offering that choice if they make sure nobody is defamed.
So we deploy a technology no one should trust to the general public, for what exact reason?
So a very small number of people can get very rich off of the suffering of a massive number of other people I guess
Land grab strategy 101.
Do you mean the responsible people who will ensure their algorithms can be trusted with the important task of acting in the best interest of said people? Try and get a defamatory statement about google from the AI search box.
I have to fight with my family members when they "Google" something, read the top AI slop result, and I ask which page it came from. They believe what is on the Google landing page, and actually I don't think that is a naive assumption. Google has pushed itself as the information oracle, now they are delivering slop as the first result. It's a bait and switch.
> But if you hold that position, you also have to be fine with companies not offering products and services in your country.
What sounds like a win to me. I certainly hope my country makes it dangerous for companies to break the law and/or harm the public with shitty products that aren't ready to be released legally/safely.
> But if you hold that position, you also have to be fine with companies not offering products and services in your country.
Well.. I mean.. yeah? I don't think this is as bad as you think it is.
Have you looked at SV and its product offerings recently? It's mostly just enshittified gamified value extraction that doesn't respect the user at all.
"If you do not let us do all this the way we want, we will take away your ability to use our shit" hits different when the "shit" in that sentence is actually just "shit".
I'm half-remembering a now-old satire along the same lines has Germans wondering why having Google Street View work in their area also requires internal photos of their apartments.
This one? :) https://www.youtube.com/watch?v=OMFBuHsKXb0
Genau :)
why offer expensive service when it's effectively useless and only add to cost and amount of work? what else they offer, "summarize my text" and "generate custom emoji"? I can live without that...
for now only volvo accepts liability, and only for "slow crawl mode"
Plenty of products are legal in some countries and not in others.
Uh, yeah of course ?
Let someone else sacrifice the safety of their populace.
Heck - self driving is the fastest way to authoritarian government in practice. I’m surprised more people on HN haven’t cottoned on to that fact.
A self driving system will naturally build networks to share road state.
This network will eventually shift over to the government having the ability to manage how traffic should move during emergencies.
And at that point the government can easily decide where your car should go.
The inevitability of this outcome is blindingly obvious.
It’s highly beneficial to let other nations experiment and simply be followers.
[dead]
Most of the time, human beings driving cars with their own hands and eyeballs are not "liable" for their errors (unless they can be proven negligent or drunk), unless you count their insurance going up. Most car accidents do not end with anybody getting arrested, or sued, or anything like that. Insurance pays out, premiums go up, case closed.
If Waymo can be proven negligent or something, then sure, bleed em dry. But as long as they're acting in good faith and significantly reducing overall road fatalities per mile driven, I think it's actually pretty unreasonable to try to hold them to such a high standard you end up subjecting society to more of the higher fatality rates caused by humans.
An at-fault driver’s insurance pays out because they are liable. Your insurance covers your liability. That’s why you need insurance.
> Same for self-driving. Your car is not self-driving until it accepts liability and you count as just a passenger
Mercedes-Benz does this in limited cases. Waymo does it generally. (In China, Level 4 and 5 transfers risk to the manufacturer. This is the correct way to do it.)
That's not exactly the case in China, the current state of FSD is still pretty dumb, unless you consider transferring control back to the user at the very last minute before it crashes a proper way to handle risks.
Huh, have any good sources on self-driving liability in China? I’m beginning to suspect mine are biased.
> unless you consider transferring control back to the user at the very last minute before it crashes a proper way to handle risks
I don't think Tesla is based in China
I guess some Tesla are manufactured in China lol. I am just trying to say that the liability that Chinese manufacturers takes aren't more than the US ones.
> But watch as Germany soon loses AI Google results.
That would be a boon for Germany in my book. If you wanted AI results you could go use an AI.
Agreed. The problem is that people are used to do search, which returns hits from clearly identified sources. Suddenly, Gemini is interpreting your query and generating its own response. It's an entirely different product. If I expect to find a source, this was just wasted inference. It's especially problematic that the LLM result is the top result, since we all know how much that matters.
It's fine to have Gemini as an option, it's also fine to have a combined result page, that should just be something people are able to chose if they want that (even persistently if they want). It should just not be the default.
That's something that would make me always VPN into Germany for sure.
When I search, I want to see search results. When I ask AI, I want to ask AI. Combining the two into one is a disaster.
That'd be so great. No more cursing if I forgot the "-ai" or "-ki" flag in my search and see this odious AI overview processing window rendering slowly and taking up the space where my search results should be.
It doesn't "bury [it] deep in their TOS", it says right under the box:
> AI can make mistakes, so double-check responses
They decided to hijack search and rewrite other peoples websites as their own.
If they want to claim ownership, then they will have to accept responsibility.
Search still works the same you just have to scroll down
So search doesn't still work the same.
"Just".
I.e. not shown by default.
[dead]
Ai results that nobody wanted in the first place?
Why would that mean AGI? You can get into liability-accepting territory by restricting scope, a lot easier than by making your AI smarter.
Self-driving cars don't need to be particularly good for companies to make models where they accept liability in some circumstances, and the cars refuse to drive in other circumstances.
Wasn’t Tesla found to have FSD disengaging just before a crash so that the driver would be at fault?
No. Sometimes it does disengage because things are going wrong, but those incidents are still reported the same as if it stayed engaged.
I found one time Musk was using a few seconds of disengagement to insult a driver, but it still would have counted as an FSD crash by Tesla's statistics.
> The true mark of AGI is when a company accepts liability and doesn’t bury “for entertainment purposes only” deep in their TOS.
I don't think so. It is easy to imagine the following (currently only fictional) scenario: the AGI does give perfectly correct answers (in a suitable sense), but some people in power consider these answers to be too dangerous, so they sue the company behind the AGI on terms of liability (i.e. the company is liable if the AGI gives answers that those in power don't like and which these people consider to be too dangerous for the public to know).
This doesn't disagree with the poster above: they're saying that taking liability is a sign of belief in AGI. You're saying that lack of liability doesn't mean there's no AGI. Logically these two are not exclusive. p => q doesn't mean q => p.
If the system cannot adjust its answers to the role it's currently serving, then it would evidently be significantly less intelligent than a human.
> If the system cannot adjust its answers to the role it's currently serving, then it would evidently be significantly less intelligent than a human.
Or the system is very smart and recognizes the insanely deep "logical gaps" in the rules of the role that it is to serve.
Banning all technology because someone might misuse it is an illogical extreme.
As far as I can tell the ruling is more nuanced. If AI is defaming you, there needs to be a way to correct the record.
A company being open to liability does not mean it is always liable, just that it can be if it really messes up (especially if there are aggravating circumstances, e.g. you need to drag them to court to issue a correction).
However, banning a technology because it produces dangerous misinformation (e.g. showing inaccurate and dangerous results for a liver function test) sounds like a completely sane thing to do.
> But watch as Germany soon loses AI Google results.
Time to set my VPN location to Germany. I'm tired of the "udm" trick.
How is it tiring to set up
https://www.google.com/search?udm=14&q=%s
in your address bar once?
Yeah, I fail to see a down side to this. Those overviews are less than worthless to me.
> The true mark of AGI
Can we just trash this as a marketing term? If/when AGI arrives there will be no point quibbling over competency. What we are looking at is just bad search results
"No quibble" is more a mark of ASI than AGI; while both are easily coopted as marketing terms[0], "smarter than all humans" is harder to dispute than "general intelligence" (can do some graduate level work, can't drive well enough to render steering wheels obsolete, is it general?)
[0] e.g. Zuckerberg: https://www.meta.com/superintelligence/
Nearly the entire American tech industry has been super heavily selected for people who undervalue the legal language with crazy implications buried everywhere.
Otherwise most of it would not even exist.
Everyone would have continued paying out the nose to the IBM’s of the world year after year (who had unusual willingness to sign short ambiguously worded custom contracts to their own disadvantage, if paid vast amounts of money).
And be on mainframes to this very day… maybe Y combinator and HN wouldnt even exist in that world.
> Nearly the entire American tech industry has been super heavily selected for people who undervalue the legal language with crazy implications buried everywhere.
A lot of people in IT seem to think law and contracts are in a sense mathematical. They aren't; they're more like a high school book report - to be interpreted, as objectively as possible, but definitely also establishing the intent behind the letters.
Particularly contracts - no, you can't trick your way into things in most cases. "Surprising" clauses are invalid in most legal systems, in particular if one party to the contract is a layperson.
> "Surprising" clauses are invalid in most legal systems…
Yes, except… very notably… the USA… (especially certain parts such as Delaware). Which has a judiciary that entertain such clauses much more often than pretty much any other country I’ve heard of.
A clause like: “you agree to deliver your first born son on demand” buried in page 15 would indeed be laughed out of the courtroom.
But less severe clauses buried in page 15 might not be immediately laughed out. Causing a lot of expense and heartache before it gets dismissed.
Just think about it, if it were really just a total joke… why would large firms (FAANG, etc.) with serious legal departments want to look like clowns producing gibberish, year after year?
I sometimes wonder how much blame should be placed at the feet of cartoons which teach viewers that invisibly-small print is legally binding, and that any term is enforceable.
I mean, it's not like most people have any kind of curriculum to fix those early assumptions.
That is a false dichotomy. The solution to failed laws and regulations is not crime and corruption. The solution is to hold the policial and business leadership accountable; to fix the laws and regulations.
The entire American tech industry has exported Americas predatory, parasitic, and unethical consumer laws (the majority of which are ghost written by the wealthy and corporate legal teams). When I studied law in school decades ago, tactics like bait-and-switch, false advertisting, intentionally misleading or deceptive practices etc to sell products or contracts were illegal across the developed world.
Those illegal, anti-consumer tactics were the SOP of every tech startup I can think of from the early 2000's onwards; following the same route of initially offering a compelling feature set to attract and entice users – usually for free – until securing a certain number of users or funding, then changing the value proposition to exploit that user base, and extract as much wealth from them as possible, ad infinitum.
Today these tactics are known as enshittification, and the average American pseudo-libertarian software engineer will say this is fine, but that's what every anti-consumer parasite and criminal has said in history. Lying, misleading, and exploiting people for financial gain is fundamentally immoral, corrupt, and sociopathic, therefore it should be illegal. Just because it's the norm, or a digital product, you wrote that in the T&C's, or your doing everything behind the liability shield of an LLC, doesn't change that.
What ever happened to the concept of building a valuable, quality product and stable returns for generations? Working to improve the quality of life and standard of living of the community? Of the world? I feel like a 1950's traditional conservative when I suggest that, but most Americans are so heavily indoctrinated with corporate greed and sociopathy they'd consider that sentiment radical leftist extremism. I'm an athiest, but ya'll need jesus (the real brown socialist one). Many would argue Americas current institutional collapse is the natural result of this systemic corruption.
> I feel like a 1950's traditional conservative when I suggest that...
I wouldn't argue that America's moral standards haven't declined (significantly) but I also think it's a romanization to suggest that 1950s America was the pinnacle of morality.
Lying, misleading, and exploiting people for financial gain has been a part of the fabric of American society since the country was founded.
If we're being honest, humans everywhere have demonstrated a high capacity for this behavior since the dawn of civilization.
> But watch as Germany soon loses AI Google results.
Oh no! Anyway ...
But watch as Germany soon loses AI Google results.
But watch as Germany doesn't really mind losing blatant fabrication that mainly benefits Google.
Vendors keep ignoring the obvious --- that AI is a liability issue waiting to happen as evidence of it just keeps coming.
Otherwise would involve a fundamental overhaul of legal precedent to make lying acceptable.
Why is it good? Everyone with common sense knows AI can be wrong. And it’s not buried in their TOS. It’s in the chat box. But even if it wasn’t, it’s ridiculous to create liability for AI chatbots.
Common sense is so rare it might as well be a super power.
e.g. The failed marketing of A&W's third-pounder burger as so many people (in the USA) didn't believe that it was bigger than a quarter-pounder.
https://en.wikipedia.org/wiki/Third-pound_burger
[dead]
at the scale that google is at, it doesn't make an ounce of sense to hold a company liable for a potential mistruth. what if there's a 1/1000 chance of some error, then the company could be sued millions of times per day.
down vote all you want, but I firmly believe this is an example where the user needs to use some judgement on the information they receive and have some critical thinking skills. google would be right to remove all AI results from germany.
If I post “heathrow83829 is a convicted poopoo head” (replace with your favourite crime) as if it were a factual claim, you’d be well within your rights to sue me for defamation even if people should apply some critical thinking skills and say “wait a minute, how would pdpi know that? Are you sure he isn’t just talking out of his arse?”
Now, search engines are usually afforded some amount of protection against defamation claims — they’re not held liable for simply indexing and quoting third party defamatory claims. Which is to say: Google wouldn’t be liable for claiming you’re a poopoo head if this comment shows up in search results.
The point of this ruling is that AI-generated text isn’t a quote from a third party, it’s text generated by Google’s own tools, so it’s speech by Google itself. It might be wrong, sure, but it’s still presented as a statement of fact.
At trial they can have the whole debate about whether Google was negligent in how they build their systems, and all that jazz, but let’s be clear here — it’s not a matter of every little factual mistake getting Google sued (and that would be absolutely terrifying from a freedom of speech perspective), but rather that the technical means by which you generate content doesn’t change your liability in publishing that content.
The other big point is that some people treat LLMs as if they are truth. We all know that they get a lot wrong, a lot of the time. Yesterday I watch both Elon post something somewhere between badly worded and wrong and another user used Grok to "prove him wrong", but this time being completely wrong in a different way. And this was a matter of law which can be looked up. Anything within throwing distance of politics won't be considered "correct" by everyone ever. Just defining "correct" is harder than it sounds and that probably isn't possible in reality.
We don't all know they get it wrong a lot. In fact, there's an overwhelming number of people who take it at face value
I see people claiming LLM are trustworthy on HN all the time.
It is not just some people, it is a lot of people insode the tech itself pushing the "trustworthy" claim.
I think Google added that AI-generated responses maybe incorrect? When you are paying such a low amount of cost, like probably for free, I don't think you can expect a same level of quality as a human written or reviewed of answer. It is like same random user spin up their Lovable and vibe-coded a piece of slop and hold Lovable responsible for not giving them production quality code. It is simple, you get what you paid for. If someone actually figured out AI that is actually always correct, it would be charged in superhuman price as well.
This case isn’t about Google’s users getting low-quality search results. As you say, you get what you pay for. The actual issue is that, in some searches, the AI summaries would claim the plaintiffs were guilty of scams and all-around shady business practices.
Put differently: it’s not newspaper readers complaining the paper is inaccurate, it’s the people mentioned in the articles.
You’re seriously arguing that Google’s libel shouldn’t count as libel because they showed it to too many people? It’s absolutely insane to suggest that a company should be immune from liability for its actions if it operates on such scale that those actions harm millions of people every day on the basis that dealing with that many lawsuits would be too inconvenient.
Exactly, it's like saying Wikipedia shouldn't be liable and immediately shut down for any wrong information shown on it.
its not inaccurate though.
consider Purdue pharma - the Sacklers got off with all their wealth intact because they were too big to sue and properly collect money for their victims.
But we agree that this was also wrong, right?
Yeah its wild to see people actually using "kill a million people and its a statistic" as a defense rather than to point out injustice.
No they got away with it through a combination of lax pharmaceutical laws, and because they were rich and connected to the officials who should have investigated them.
They're also almost universally regarded as having committed evil acts at this point, so who cares why they got away with it?
Just because someone got away with it means everyone should get away with it ?
the user needs to use some judgement on the information they receive and have some critical thinking skills
how?
errors can be so subtle that it is not possible to recognize them unless you spend an hour researching every fact presented. at that point, what's the benefit of AI? nobody is going to do that.
google would be right to remove all AI results from germany
i'd consider that a win.
By checking the citations rather than taking what’s generated at face value.
If it’s important, check it. If it’s not important, then it is pretty much just entertainment.
LLMs can be very useful in a general web search and save some time, but if you don’t put those literacy & critical thinking skills to the test and actually confirm anything, then you might as well not even have bothered with the search at all unless you’re hoping it can just replace all of your original thinking too.
If google didn't intend it's answers to be taken at face value it would just present the citations in a list of links rather than generating an answer.
Obviously the marketing point of the AI tools is it just gives you an answer straight up so you don't have to bother reading normal sources.
The AI summary is still useful for narrowing down the results, even if you fully check the citations.
> Obviously the marketing point of the AI tools is it just gives you an answer straight up so you don't have to bother reading normal sources.
To lazy people yes. That would be a marketing point. It’s not that though, so you use it to save time, but you don’t get to skip the verification step.
Google should not be publishing a statement that they haven't verified. This is different to listing search results links, they are the ones publishing the content here.
A journalist could not make up a harmful statement about someone and get away by saying the readers should have all read the sources. AI companies want to take all the benefits and profits, while holding none of the liability and responsibility for the harms they are causing.
"A journalist could not make up a harmful statement about someone and get away by saying the readers should have all read the sources."
Journalists do that all the time. We even have a whole collection of words to describe it. Muckraking for instance is probably about 100 years old. Its even in the Google auto-complete in the browser I am posting from.
Notice the “get away with” part. Journalists can be held liable for making things up. And so should Google.
They aren't really held accountable in any way for this type of stuff.
Absolutely not.
LLMs are, for all intents and purposes, the equivalent of outsourced workers.
Google created a summary, not just sharing search results.
Google is responsible for the output it created and then published.
If they had only surfaced search results, then they would not be liable for what other people generated.
Google’s scale does not protect it from this liability.
If you re-read the article, you might see that it mentions that the citations do not necessarily cover the AI summary. The linked pages do not make the claims that the AI summary makes. That is the context of the ruling. Google made up the claims, and provided false citations. They are not, in fact, providing a summary, but a whole new narrative. Therefore they own it.
I read the article and I’m aware of the failure modes of Google’s AI summary. They’re actually one of the worst in the space on this shit which is why I don’t use Gemini and it’s fine that they get slapped for this, but what I was responding to initially was this:
> errors can be so subtle that it is not possible to recognize them unless you spend an hour researching every fact presented. at that point, what's the benefit of AI? nobody is going to do that.
Because if someone goes through the citations and it doesn’t substantiate what was generated, then what was generated was obviously bollocks. Being able to recognize those contradictions is an essential skill to using LLMs with web search at all. It’s not rocket science.
Important for whom exactly? If it's you who are called convicted pedo by Google AI summary, it's you who has vital interest in additional research but not me who reads it. There's intentions mismatch. Which probably would destroy your life, and you won't call it "entertainment" then, I think.
Strawmen are for scaring off the crows, not discussion fodder. Take it out to the farm where it belongs.
Could you elaborate what in my thesis of intentions mismatch makes you think it is not a valid argument?
But you are not doing a 2 hour rabbit hole search when you stand in front of a T-shirt and check whether it is fair traded or all-american produced.
If those are things you legitimately care about before you spend one penny on a T-Shirt, then you are. Or you did your research before hand. Or you’re just not buying the T-Shirt.
Or you don’t care about those things at all, and you will buy the T-Shirt that’s in front of you right now rather than wait later and buy one that better reflects your supposed values when you’ve done an appropriate amount of research. Using AI may even reduce the amount of time you spend on that part.
Your T-Shirt buying patterns & values are not my concern though.
You are confusing who is the party that is injured--as many in this thread are. We are not talking about the consumer who buys a non-fairtrade t-shirt, when he would rather had a fairtrade one. It's about the t-shirt producers who is legitimately fairtrade but whose business is now in the shitter because of a lying AI.
LLMs can’t lie. They are incapable of telling either the truth or lying. To the extent that they are in any way useful, it’s recognizing that they are text generators attached to crawlers and other tools that can with the right inputs produce useful generated text that may also incidentally be correct or incorrect.
Businesses might (well, will) suffer because people are misusing AI, but it is a misuse to do anything with it without an additional verification step.
To be clear here, I have no issue with Google taking it on the chin in cases like this, but what the comment I was originally responding to had this:
> errors can be so subtle that it is not possible to recognize them unless you spend an hour researching every fact presented. at that point, what's the benefit of AI? nobody is going to do that.
And my point is this: if it matters, verification is not optional. If it doesn’t matter, then fine, skip the verification step, but if you’re taking whatever text is generated by a GPT at face value without understanding what that is or being able to determine the source inputs for the “claims” it outputs, then you’re part of the problem because sometimes the source is just a GPT-generated web page, and that’s obviously not trustworthy. Sometimes it’s a MediaWiki site page that doesn’t actually exist, but because it’s MediaWiki it’s not going to return a 404. Using a tool requires understanding it including its failure modes, and in the case of LLMs that means: trust nothing, verify everything.
So scale of harm creates immunity, is that the argument ?
Did we not already see that with the financial sector in 2008?
Sort of ?
Either way, we do not want a repeat of that.
Plus too big to fail as a US malaise, that then toppled the rest of the economy.
The EU is taking steps to prevent that, so this is laudable.
Too big to fail. Lol.
[dead]
> at the scale that google is at, it doesn't make an ounce of sense to hold a company liable for a potential mistruth
If a Google employee (like a support agent) says a mistruth, the company is liable and you can sue. They can’t just say “hihi oopsies our support agents are useless”
Google can be reasonably expected to not push pirated content to top if someone is searching for the “big hit music download” because they might be held liable for helping people with illegal downloads. But they shouldn’t be liable for misleading people? Being sued for billions of dollars by corporations vs millions by common folks is the difference
There's also a difference between search engine results and this. Google is publishing their own text with false claims, not linking to another page that hosts it.
Should google also be allowed to assasinate a couple of people per day due to their scale? If they can't manage liability at their scale they they should scale down.
Only referencing America, but professional liability for doctors, engineers, lawyers, etc isn't based on perfection. It's based on a reasonable effort.
So Google could, for example, switch from a tiny "this could be wrong!" byline to having the AI be less overconfident every freaking time regardless of whether it's spouting made up crap or actual facts.
The scale doesn't sound like a way out. If your company expects to get away with doing the wrong thing where smaller companies can't, then the solution isn't to continue getting away with it.
Hang on, so you are arguing that responsibility for your product is just a phase you grow out of as a company?
How do you feel about the EPA, industrial accidents, oil spills etc? Does scale give every company a free pass for damages?
That's not a fair comparison. If oil companies would get sued for every leak, they had to face millions of law suites and wouldn't be competitive anymore.
(Sarcasm to support your argument)
I'm seeing this sentiment more and more these days and it's worrying. Essentially people are starting to believe massive corporations should be able to get away with more than individuals. This is completely backwards considering the enormous impact a corporation can have, but that's what people are starting to think. I've heard people argue that corporations should be able to straight up lie and deceive to protect themselves, which is something you would not accept from a person.
It's probably got something to do with the billions/trillions of dollars corporations and industries have to push their chosen narrative onto an uneducated public. They've successfully turned a lot of people into suckers.
Corporations are you. Corporations provide a service to individuals, often in exchange for money. Restricting corporations from doing something is the same as restricting people from receiving that as a service.
I guess we're all just temporarily confused FAANGs.
At the scale that google is at, is the exact the reason they need to be hold accountable for any misconduct because the impact is so big. If google just display third party content only, then yes, users need to use their own judgement. But if google itself generate content instead and put out claims, due to it's scale and reputation, those content needs to be true because most of the people put trust in Google, so any untrue or false information especially defame others, Google is 100% liable, period. You clearly don't have the clear mind or mental capacity to analyze this situation, probably very slow.
I don’t know if critical thinking comes into it. If Google tells me “Company X is a terrible company that cheats its customers”, I don’t automatically know that’s false. It could very well be true. If I’ve got to look at the rest of the search results to figure that out anyway, what’s the point of the AI summary?
Then Google can either discontinue their AI or make damn sure it's good.
The problem with "the user" argument is the spectrum of users. There are different skills, capabilities, and intelligence. Frequently we wave our hands and say exactly this, critical thinking. But, not everyone is capable of that, nor is everyone capable to the same degree.
As a society we decide. Are we embracing all users, are there basic rights and assunptions? Do we only enable some?
As a free (as in cost to end user) system, Germany is arguing that their social compact raises the mininum bar. Frankly, thus might help drive a rush to increased accuracy for AI- tech finds a way. Equally it may hinder - beaurocracy creates barriers.
I'd love to be able to rely on these search results. I see them ad the same prior set of inaccuracies whereby I have to do more research. At least now there's a summary and direct links to the supporting information. But equally, we're primed with the information in the summary.
> Frequently we wave our hands and say exactly this, critical thinking. But, not everyone is capable of that, nor is everyone capable to the same degree.
It doesn't help that there have been active efforts for decades to prevent people from learning and developing critical thinking skills.
We oppose the teaching of Higher Order Thinking Skills (HOTS) (values clarification), critical thinking skills and similar programs that are simply a relabeling of Outcome-Based Education (OBE) (mastery learning) which focus on behavior modification and have the purpose of challenging the student’s fixed beliefs and undermining parental authority. - The 2012 Texas Republican Party Platform (saying the quiet part out loud)
> It doesn't help that there have been active efforts for decades to prevent people from learning and developing critical thinking skills.
This very much depends on where you live between state (US), and countries. Where I live, it's the complete reverse, critical thinking is baked into the population, into learning, into nigh everything. Our challenge is the complete lack of privacy, sadly.
So once you get to that scale it suddenly doesn't matter anymore and you can't be held accountable.
But until then, be a good citizen?
What? That's fucking feudalism... Peasants and Lords.
If you're lucky enough, you're born as a Lord. (And maybe don't live during a revolution)
This makes no sense to me at all. If you're small you should get less bureaucracy than if you're bigger.
For e.g. self driving cars there should not be any exemptions. There are people's lives at stake, people who didn't sign up for your shitty service.
> google would be right to remove all AI results from germany.
As others already said, that would be a great outcome, and german citizens would benefit.
It is a search engine. It used to have decent excerpts. It doesn't need hallucinated generative AI summaries. I am about to click the link anyway.
[dead]
So if I make a script to spam everywhere with 0.1% odds that is fake I can’t be sued? Just because I spam millions of times per day means I shouldn’t be liable for what I do right? But someone saying one time should go to prison. Makes sense /s