My biggest fear at the moment is robot armies and police forces.
Case in point : we're all expecting China needs to invade Taiwan soon, or they will run out of soldiers because of the one child policies of the 70s/80s.
Meanwhile, Ukraine is holding up against a "modern" army with quickly assembled drones.
So it all seems a bit like "they'll never put tanks through the Ardennes", sort of ?
Where and when will the first invasion of a country by a purely remote controlled, AI assisted army take place ?
Will robot battalions embed civilians to act as human shields ? Will the AI learn to mistreat the locals to maintain fear, or will they see it as a needless distraction and rush to the center of powers ?
If war is mostly played out from a disrance, will years of playing RTS give South Korea an edge ?
> If war is mostly played out from a disrance
I left a company because they pivoted to exactly this. There are so many companies in this space today, testing what they call "physical AI autonomy" today, and we have to recognize that this is our today.
There are entire marketplace options for buying the pretrained, supported, private models, or the datasets if you have your own goals. If you're interested purely in ditzing around with GPS denied, or communications lost, you can do that today.
I watched a demo video, in March where a company was sharing their remote instructed (note, not controlled) multiple format (spider, dog) robot swarm. The company claimed to be 35km away from where the drones dropped off the payloads, and the mission was engaged. Lightweight explosives were used to toss off a car.
This is our present.
People saw Black Mirror and made a business plan out of it.
https://en.wikipedia.org/wiki/Metalhead_(Black_Mirror)
Also this shortfilm SlaughterBots from 2019 https://youtu.be/O-2tpwW0kmU?is=F7RNLXcVuLA5A_lA
It’s been a part of sci-fi for a long time.
It's going to happen and at some level I'd rather war casualties were measured in robots rather than people.
My concern is the cottage industry of integrating guns with half baked AI at the lowest cost. And probably vibe coded too.
The companies don't care - a sale is a sale. MoD maybe doesn't care - 90% accuracy and less human casualties on their own side are a win. Governments want to save money and by the time they find out the robots go rogue, it will be too late to do anything about it.
I can't wait for the day that killing a human-any human-is considered a war crime.
And then it will be just another war crime committed daily conflicts, and nothing will happen because there is no world police ?
Ask Ukrainians, Lebanese, Gazaoui, Somalilanders, or even Iranians for that matters - that may not make a big difference to today...
What I would love to see is a local government suing an arms producer for the efficacy of their weapons. (Or even funnier, the owner of a home destroyed by a drone, suiving the GPS company.)
We all know that the only things people in suits are really afraid of, more than hell, is a bad Q4 report and an expensive lawsuit.
The problem is always the same. It's not just MoD (is it MoW now?) that will have access to this.
YoloV8 + optical flow works fine on an esp32. You want to give a drone rough coordinates for a refinery and hit something in it, like a storage tank? That'll work. This means, give it 5 years, relatively small groups will have access to it. This cannot be stopped.
The only real answer is to work to have groups that you can trust to have access to this first.
Sadly, building an AI that analyses camera imagery and aims at humans, from scratch, is these days almost an intern project. It's not really something you can control or ban, the way you can control, dunno, uranium enrichment.
Integrating it with a robot and sticking a gun on it, thankfully, requires a bit more know-how.
> The only real answer is to work to have groups that you can trust to have access to this first.
How will this help exactly?
Friendly fire is going to get crazy. Can’t trust an LLM on its own for more than a few iterations..
Don’t worry, it will auto compact its context.
I can't wait for the Faro Plague and the robot dinosaurs.
Marching humanoid terminator robots will never be as cheap as a drone. Autonomous suicide drone swarms are what should terrify you.
Not marching, but Ukraine uses continuous track machine gun robots seemingly very effectively. They aren’t suicide ones.
https://archive.is/dpNsN
They are an interesting prospect but their use isn't quite as claimed.
They are extremely vulnerable to the same drones humans are.
It's more along the lines of this is a patch were not expecting active fighting this robot can act as a deterrent and surveillance.
Cheaper and simpler than a loitering IRS drone. But more concentrated in domain.
I believe for a while Samsung developed similar drones for the demilitarised zone in Korea. Those could be static as they were hard wired in.
You say that now, but once we perfect AMBAC technology and accidentally release large numbers of Minovsky particles, we will need humanoid combat vehicles to fight our battles!
> Minovsky particles
I love the way these things always have to have names that sound exotic or menacing to English speakers. Where are the Smith particles or the Jim particles?
Well in this case it was made by and for Japanese speakers.
Most military grade drones cost $10k or more and they can only be used once.
An optimized quadruped could probably be built for the same price and have an integrated 60mm mortar instead. The front legs act as the bipod and the rear legs would be designed to dig into the ground for stabilization. The only problem here is reloading the mortar, which could be done using a revolver style magazine. That's 5 shots per robot vs 1 per drone.
Autonomous suicide drone swarms are easily countered by autonomous interceptor swarms.
>Marching humanoid terminator robots
ground bots, not necessarily marching, do have their value. They can have bulletproof armor, while still be relatively lightweight and small and fast. They can easily carry even 20-25mm autocannon - very destructive weapon, sometimes can even succeed against a real tank.
And imagine when a swarm of drones lifts a ground bot, brings and drops it right into the needed point and protects it from the enemy drones while the ground bot just destructs the things around. Synergy between different weapons system has always been the super-weapon.
They can also sit in one spot guarding a position without using much battery. Ukraine recently took territory from Russian forces using ground bots, the first time it's been done without using soldiers on the ground. Now they're starting to scale the bots up to mass production.
the issue is remote control. Ground position means a lot of obstacles in addition to the widespread jamming. One can try to control the bot from the fiber-optic controlled drone hanging over, yet such complication has its own drawbacks. That means that ground bots are in real need of making them autonomous.
They don’t need to be remotely controlled anymore! Autonomous!
[dead]
Which of those is opening doors?
Two drones. One to blast the door open, the next goes through.
Still more cost effective than a humanoid robot, even in the presence of hundreds of doors.
That breaks the building. If you want to destroy the whole thing, conventional weapons has that covered. Drones can't get through nets and doors. Though, have you considered packs of robot dogs with machine guns and one arm/hand? Cheaper than a fully bipedal humanoid robot.
> have you considered packs of robot dogs with machine guns
I don't have it to hand but already a few years ago a defense contractor had attached quite a heavy rifle on some sort of articulable mount to the top of something that looked exactly like Boston Dynamic's Spot. I'm not sure how much ammo it was capable of carrying or what it's range was but it's definitely a concerning development. I think I might become an enthusiastic custom anti-materiel rifle collector in the near future.
I'll carry an ammo belt of little EMP devices.
A microwave weapon could be effective. And reusable.
The Marines did it with a rocket launcher. https://www.twz.com/marines-test-fire-robot-dog-armed-with-r...
One thing exists and is known to work and be cheap. The other it's you musing about what will be possible. So they need to be judged differently. No land robot can move through a war environment in any effective way at the moment and also "open doors" etc. They are too slow. Not drones.
> Marching humanoid terminator robots will never be as cheap as a drone. Autonomous suicide drone swarms are what should terrify you.
If money or economics were relevant in these decisions, most wars would probably not play out in the first place. Tesla probably wouldn't be worth 1.2T. And we certainly wouldn't see AI buildouts happening at their current rates.
Economics and costs only matter for normal humans, small countries, and efforts that might actually help humanity. They're not seemingly considerations in nefarious applications.
It matters quite a bit. If your drone costs $1000, you can build a thousand times more of them than if a drone costs $1M. As the saying goes, quantity has a quality all its own.
This is a lesson the US has yet to learn, and its military drones are really expensive. Ukraine learned it by necessity, and now it's building millions of drones annually.
On the other hand, if Musk really flips his lid, he's one OTA away from a network of ground-delivered lithium bombs. The fear of humanoid bots is their banality: if a government or private company has a reason to build them, then the world is full of hardware with terrifying capability and questionable security.
I think what your parent commenter means is that, if the application is warlike or nefarious, them the money will be found. If, on the other hand, it is humanitarian, then every penny will be counted.
Yes, I get that, but for whatever amount of money is found, you're better off using it more effectively. The cost of things still matters, if you want to win wars against serious adversaries.
One problem the US has had in its Iran adventure is that they're shooting down $30K drones with million dollar missiles, often several of them. Now the missile stockpiles have been depleted by 30% to 50%, depending on missile type, and they're not all that quick to replace.
[dead]
> If money or economics were relevant in these decisions, most wars would probably not play out in the first place.
I don't understand what you mean here.
Aren't wars fought over natural resources or the political power over natural resources.
Obviously people sometimes miscalculate but in principle I mean.
> Aren't wars fought over natural resources or the political power over natural resources.
Not really. They’re fought over fear of the future, desire for control and power over other people. “It’s us or them” captures one of the core calculi of war. It’s not rational, it’s just an expression of evolutionary imperatives.
Or they might decide to, er, pre-deliver the payloads.
"Citizen, congratulations on reaching your age of majority. Report for your Patriotic Assurance Implant at surgical bay 43B."
Not sure China actually needs to invade Taiwan - it just needs to be patient. cf Hong Kong.
Totally agree with you about the dangers of autonomous killing machines - I think the two key problems here are.
1. Reduces the political cost of going to war. Though as Iran has shown, there are other ways to exert political pressure even if the other military can hit you with almost impunity.
2. This is really a follow on from the first - low cost ( in all meanings of the word ) weapons makes asymmetric warfare available to all - and this won't be limited to governments.
On the positive side one of the potential outcomes of 2. is that countries and the world will need to operate on the principle of consent, as force will be nigh on impossible.
> Not sure China actually needs to invade Taiwan - it just needs to be patient.
An interesting point. China has historically been good at being patient.
Is it possible South Koreans edge in RTS games is from their compulsory military service?
Also, China is not likely to invade Taiwan any time soon. It'd be geopolitical suicide and they're currently in a very good spot geopolitically. Invading the country with the rest of the worlds chip fabs is the quickest way to lose that
> Is it possible South Koreans edge in RTS games is from their compulsory military service?
Unlikely, most players postpone their service as long as possible, and majority does not play professionally again after completing it.
Silly Devil's Advocate argument:
What if there are no human soldiers or fighters at all? No-one needs to die in a war again, but wars are won by the side with the stronger tech.
What are the possible outcomes of this? Technologically superior countries start a race to acquire more territory, so large blocks expand and absorb other countries? More wars? Fewer wars? More suffering? Less suffering?
Disclaimer: I'm not imagining this is really possible. As long as some humans from group A don't want to be under the rule of group B, humans will resist and fight. But it is just a thought experiement.
All war tends toward total war, so that will never happen no. The incentive to break any such agreements is too strong.
Philip K Dick wrote a short story similar to this, "The Defenders".
> What if there are no human soldiers or fighters at all? No-one needs to die in a war again, but wars are won by the side with the stronger tech.
Ultimately, the side with more arms will be killing humans, soldiers and citizens of the other side. They simply wont stop at destruction of machines.
Look at Iran war - USA can bomb them without threatening themselves. Or Lebanon - Israel can bomb them with no repercussions. In both cases, weaker side has people killed. In the second one, in an astonishing rate.
I mean if a technological superior country start a race for more territory, we will have another world war and nuclear weapons fired. No robots matter in that scenario.
It becomes nearly impossible for citizens to overthrow dictatorships, and countries with weak democracies will quickly be overpowered by the oligarchs living there, who can now impose their will on the larger population of poor citizens with impunity without worrying about being overthrown by overwhelming numbers. Having an electorate that is so misinformed that it can elect Trump becomes a much more dangerous liability.
China had more births in 2025 than all of europe and russia combined so I don't think they're going to run out of soldiers.
The more important fact is that China makes all the drones
But also more deaths. It's the delta that's important.
Old people don't go to war, how is that important. All that matters is who has the most 20 year olds they don't care about killing.
The births of 2025 will be the warriors of 2050. By then, a bunch of those will be needed to, you know, run things around the country. It's clear that China is going to use tech (as in, artificial wombs, neural implants for optimized beaurocracy, and plenty of robots.)
My big question is:
- will they keep the human bodies warm to care for the elderly, and send robots to war ?
- will they keep the robots to take care of the elderly, and send the young's to war ?
- will they dispose f the elderly to keep their edge ?
- will they play long and wait things out ?
> China needs to invade Taiwan
> It's clear that China is going to use tech
I hear this all the time but the invasion never seems to come. Is it just western projection at this point?
If you believe them.
> we're all expecting China needs to invade Taiwan soon
Ah yes, China has a track record of invading countries.
> or they will run out of soldiers because of the one child policies of the 70s/80s
As opposed to NATO countries who have a steady increase in the number of young conscripts.
> Meanwhile, Ukraine is holding up against a "modern" army with quickly assembled drones.
I don't know why you put modern in parentheses. Russia did make a mistake of not adopting cheap drones earlier in the war. But Russians were the first to use optic fiber drones resistant to electronic warfare which gave them an edge during Summer offensive last year. Ukrainians have since caught up and their allies were able to supply them with large number of drones. But both Ukraine and Russia rely primarily on drone warfare and artillery becomes less important for both sides. Which all explains the static state of this war.
> Ah yes, China has a track record of invading countries.
Claims on Taiwan. Building fake islands in the South China Sea. Encroaching on the Siachen glacier. Attempting to rename Indian states. Port capture in poor nations through default. They have plenty of expansionist tendencies, it’s just early in the game…
> If war is mostly played out from a disrance, will years of playing RTS give South Korea an edge ?
Not sure if this is serious, but RTS skills are different from real-world battlefield skills. Macro is completely different, and while micro skills might be slightly transferrable, computers are so much better that no human will ever be microing real units on a real battlefield.
We are less than 5 years from robot armies. I mean if you put a person behind a Unitree robot, we have robot armies now. Those things run pretty fast and are quite good at obstacle clearance. They also cost $20,000 per unit which is throwaway money by any metric. Full autonomy is real close though.
> Case in point : we're all expecting China needs to invade Taiwan soon, or they will run out of soldiers because of the one child policies of the 70s/80s.
I expect China to invade Taiwan, because they now know they likely can. I do not expect them to "run out of soldiers".
The answer is and always has been "nukes" unfortunately.
Remote controlled autonomous robots/drones can also be used for, say, elder care.
A nurse can log in to a HelperBot remotely, check up on the client, tidy up the house and maybe even give medication. Instead of having to drive around between clients, losing maybe hours a day just on transit, one person can manage more people per day.
...but the same system can be modified for KillerBot easily like we know from EVERY SCI-FI BOOK EVER.
We live in interesting times.
Honestly that sounds dystopian even ignoring the killer robot aspect. Imagine the only "flesh and blood" human contact you have being optimised away to reduce cost by 10-20%.
Yes, in a perfect world we'd have infinite nurses who have infinite time to spend quality time with each client.
In the real world, right now, nurses have a set time in minutes to visit each client and if there's traffic or someone has fallen over and needs extra care, guess what? Someone else gets less time or the nurse has to work overtime, usually un(der)paid. (Sauce: have people in both sides of this equation in my immediate family)
This is why old people get shoved into care homes where they manage 20 clients with one nurse because the transit time is "across the hall". And that's how people get institutionalized, even the fit and healthy ones get demotivated, bored and stop trying. Saw this first hand when my grandmother couldn't live in the house she had lived in for half a century because she couldn't get enough support at home. It took her months to go from mostly alert and energetic to practically waiting to die.
I'd much rather have the daily care of my elder relatives managed by a remote operated bot than watch one more grandparent wither away slowly in an elderly care facility.
>I'd much rather have the daily care of my elder relatives managed by a remote operated bot than watch one more grandparent wither away slowly in an elderly care facility.
Yeah shit, I don't know which is worse. My plan is just dying before I reach that stage.
Ah geez, again this China invading Taiwan nonsense, China ain't USA, Israel or Russia attacking sovereign countries, they just use money to take over, they will do exactly same with Taiwan. Eventually Taiwanese people will figure out that siding with agressive country run by crazy old men is worse option than siding with China.
China has all time in the world not being run by crazies with 5 year election terms rushing to keep their mark in the history, not necessarily positive...
Yeah pretty much Americans are projecting themselves when they talk about China invading other countries.
Who’s been invading and bombing other nations so far lol.
The Taiwanese while being proud Taiwanese (rather than Chinese) are culturally Chinese. After all they came from the mainland after having lost the civil war.
What you said about them siding with China against a common aggressor makes sense. In fact they already did this against the Japanese and took a pause from their onw conflict to fight the Japanese together during WW2.
And it's also true that this "China aggression" is pure Western propaganda.
Which country has been bombing and waging a war somewhere since the inauguration. The same country that has over 700 military bases over the world. (China has 0)
"...rocket's red glare, the bombs bursting in air.."
The majority of Taiwanese are the descendants of the people who lived there before 1949, not the descendants of the Chinese Nationalists who fled there at the end of the civil war. In fact, the Taiwanese were, uniquely among East Asian nationalities, relatively happy being part of the Japanese Empire and have maintained good relations with Japan ever since.
You're correct. But in practice the native people have been assimilated and the predominant culture is that of "Chinese'
Taiwan was occupied by the Japanese during the WW2 and just like everywhere else the Japanese were hated for their criminal actions. Taiwan was no exception. Today there also disputes for example the Senkaku islands.
Russia is not a “modern” army. They are literally using low tech drones from Iran against Ukraine because they can’t come up with their own.
To some extent it already has, Ukraine had a press release a few days ago stating they had attacked and taken a position using only robots and drones for the first time
https://www.businessinsider.com/ukraine-russia-position-take...
I don't think Russian army is very modern -- but maybe that's the reason of your quotation marks.
I kinda think that the competitions among the big dogs (US/Russia/China/etc.) would eventually green light ANY AI/Robots projects if they can justify tipping the scale somehow, and in the process completely destroys the last element of any political counter-weight. Because "fear gives men wings".
I would really hate to live in a dystopian world worse than what is described in the books/movies.