NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
▲US will say "no" to global ban on killer robots (newsweek.com)
bradthebeaverfa 19 hours ago [-]
Absent an enforcement mechanism, laws like this just reward countries that are more willing to ignore the law.

And the UN has repeatedly proven it does not have an effective enforcement mechanism.

adjejmxbdjdn 17 hours ago [-]
Can you give an example of countries being rewarded for ignoring laws absent an enforcement mechanism?

You do realize that the actual enforcement mechanism arises in bilateral relations and through multinational institutions like the EU, NATO, World Bank, IMF, etc.

And it’s usually incredibly successful, especially if the big powers like the U.S. join in.

throwaway473825 16 hours ago [-]
The Budapest Memorandum is a good example. The countries that got to keep their nuclear weapons promised to not invade the countries that gave away theirs. They ignored their promises, and were rewarded for it.
red-iron-pine 5 hours ago [-]
who is they? you're burying the lede
nozzlegear 44 minutes ago [-]
Ukraine, Belarus and Kazakhstan all gave up their nuclear weapons, and in exchange, Russia, the US and the UK promised to respect their independence.

We all know how that went.

notaigenerated 6 hours ago [-]
Israel, Russia, to name a couple.
insane_dreamer 13 hours ago [-]
Israeli occupation of Palestine
vkou 19 hours ago [-]
Sanctions are enough of an enforcement mechanism to make low-value defection more trouble than it's worth.

They aren't a big enough stuck to make high-value defection work, but this seems to squarely fall under low-value.

stickfigure 18 hours ago [-]
Russia and Ukraine are busy making the most autonomous killer robots they can afford. Russia clearly is not deterred by sanctions, and I really don't think Ukraine needs more betrayal.
notaigenerated 6 hours ago [-]
Russia could be deterred by sanctions if they were enforced hard enough. They're literally using american parts in their drones.
stickfigure 28 minutes ago [-]
It's widely understood that sanctions don't prevent countries from getting the parts, they just make it incredibly expensive to do so.

I'm all in favor of more severe sanctions, but have realistic expectations. There's good news - Russia is already delaying paychecks to soldiers. Sanctions are having the expected effect. But they aren't going to stop the war.

tsss 3 hours ago [-]
Betrayal? Big words coming from a country that committed an act of war against its ally Germany and continually antagonizes its other ally Poland to appease all the anti-Polish ethnonationalists in its military ranks.
rgbrenner 18 hours ago [-]
"this seems to squarely fall under low-value"

Using AI so citizens of your own country don't die in war is probably the highest value add there is... especially in the meat grinder that war has turned into now.

vkou 16 hours ago [-]
Sure, if you ascribe infinite value to the life of one citizen in a war, you can justify any degree of barbarity.
tim333 4 hours ago [-]
The worst barbarity seems to come from leaders who value their citizens lives very little.
JumpCrisscross 18 hours ago [-]
> Sanctions are enough of an enforcement mechanism to make low-value defection more trouble than it's worth

One, most drone-type weapons are highly dual use. That makes enforcement tough.

Two, our track record with enforcement sucks. Iran has nuclear materiel. (Not a bomb.) Between America, Russia and China we've created a world where middle powers look increasingly naive for not pursuing their own nukes. And I guess if all else fails, have a smuggler sleep with a CEO and then let David Sacks defend them.

pvaldes 9 hours ago [-]
Another way to see it is that this kind of laws increases a little the cost of ignoring the law.

Also that instead to buy expensive killer robots (that can always be used against the population if an insane dictator takes the power), other countries can invest their non-finite resources in research of defense against killer robots. Also in how to scrap each killer robot destroyed for valuable metals and stuff.

NewJazz 19 hours ago [-]
Yep, that's why folks continue to use nuclear weapons and poison gases!
TiredOfLife 1 hours ago [-]
In past 15 years: War in Syria, Ukraine, Sudan has seen usage of chemical weapons
bryan0 18 hours ago [-]
Fair point, but I wonder how much is the fear of UN sanctions vs the fear of these weapons being used against them in retaliation.
JumpCrisscross 18 hours ago [-]
> why folks continue to use nuclear weapons and poison gases

Nuclear proliferation is enforced at gunpoint by the nuclear powers.

As for chemical weapons, "they are dismantling these systems because they do not expect they will ever have a use for these weapons. Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was" [1].

[1] https://acoup.blog/2020/03/20/collections-why-dont-we-use-ch...

NewJazz 16 hours ago [-]
Cluster munition use gets intense scrutiny and/or serious retaliation. Except in maybe one US-backed case that is widely reviled even in the US.
throwaway473825 16 hours ago [-]
How so? Cluster munitions have been used by all parties in both Ukraine and the Middle East. There have been no consequences, and what would they even be when everyone uses them?
NewJazz 14 hours ago [-]
Hmm, wasn't aware of Iranian usage as well. Indeed the waters are murkier than I had naively assumed.
spwa4 9 hours ago [-]
> Nuclear proliferation is enforced at gunpoint by the nuclear powers.

About all UN enforcement in general, how about I just let the UN GA talk: they voted, again, yesterday, on legally preventing anyone from taking action on human rights. In case you think you didn't read that correctly, yes, PREVENTING:

https://docs.un.org/en/A/C.3/81/L.30

As the UN's own document notes extensively, they have done this vote for 40+ years.

As for nuclear specifically, are you serious? That must be why the UK, France, China, and Russia are helping so much in the US's war on Iran! (and how they stopped China in the 1980s, and ...) (and please don't repeat "but the nuclear deal" Iran was caught TWICE, by the UN, having violated it, and I don't think the US negotiators were lying in the article about how Iranian negotiators were boasting about violating the nuclear deal in Oman, nor do I believe that Trump blew up the nuclear deal out of ego). Just about the only real enforcement the UN does is provide a neutral party to check nuclear proliferation (or should I say semi-enforcement. After all the UN has voted many times to call the IAEA a conspiracy)

We have very publicly chosen to abandon the security architecture of the 20th century. Everyone has, Russia and China, obviously, because they want to attack. But Europe, including the European nuclear powers (yes, France was a bit of a holdout, as they were after WW2), have abandoned largely enforcement on nonproliferation ... and on human rights. In fact if they do anything it's sanctions, and sanctions are both very self-serving and have proven to be utterly ineffective, for many reasons, and the European powers have not changed tactics (we all know why: sanctions are "free", by which I mean they're more expensive than any other measure BUT don't need budget approval, AND sanctions are extremely good for corruption: for moving business to your friends). And while France held out a bit, US is the last Bastion of NATO, and frankly the last state to actually take action, as in do something militarily, on human rights.

When the UN did act, it was far worse than nothing. Their last 3 efforts (by end date) were Haiti, where an earthquake destroyed the state and the UN sent in soldiers who proceeded to start a cholera epidemic with prostitutes, then abandoned the resulting children. Before that the UN was going to prevent escalation in Lebanon, and (just one example) a rocket was fired into Israel less than 2 meters from a UN military base. Hezbollah killed 4 UN soldiers, and nobody ever faced any consequences. Oh and war broke out. And Mali. War broke out with UN soldiers watching. Everyone wanted the UN to leave. If we look back and look at the first 3 UN interventions it would read similarly.

Again, the US military saved (more or less) the situation in Haiti. The US military intervened in Lebanon many times, which was generally, mostly, appreciated. And as for Mali, France tried to intervene but ran away rather than face the Russian Wagner group.

Oh and of course, the UN is the same buildings, and initially the same people, as the League of Nations. The League of Nations, who negotiated the treaty of Versailles, now generally considered the cause of WW2.

So this is not a new thing.

As for alliances, NATO has held, but it is still under US control (mostly because despite how much Europeans scream they hate US power, or the current administration, or ... they demonstrate regularly they hate the idea that another European power might be in control of their military far more than they hate the US). Other European alliances have outright been betrayed. African and some Asian older-colonial alliances, essentially all of them, most under messy circumstances, have ended. Oh and of course one might remark the Budapest memorandum stated that if Crimea was attacked in any way half of Europe would declare war on Russia. Instead, Ukraine got a few loans (and UK/Boris Johnson gave them the Javelins that saved Kyiv)

Yes, I get I'm going to be downvoted for what will no doubt be interpreted as support for 2 very popular politicians (Trump and Johnson), but whatever.

defrost 9 hours ago [-]
> please don't repeat "but the nuclear deal" Iran was caught TWICE, by the UN, having violated it

On what dates, and what "agreement" was violated?

Are you referring to the 2005 UN finding that Iran was in noncompliance with IAEA safeguards that occurred before the first iteration of "the nuclear deal" Joint Plan of Action (JPOA) 2013, and the following iteration of "the nuclear deal" Joint Comprehensive Plan of Action (JCPOA) 2015 ?

spwa4 9 hours ago [-]
Not just that (there's also the 3 statements, and the timing of those statements), plus looking up how enrichment works (the lower the %, the slower it goes, exponentially) which means that Iran was doing nuclear enrichment during the nuclear deal, with the number of centrifuges clearly indicating it was to produce nuclear weapons, not for any other reason. Again, I am very, very sorry, but Trump's and others statements on this particular issue are correct. I understand that it is currently considered critical to people's political beliefs that this isn't true. But the laws of nature (well, engineering) say different.

And as pointed out before, I believe the US negotiators weren't lying when they stated Iran was actually boasting about their enrichment.

Oh and it's not just the US current political views that are offended with this statement. WHO sold Iran those centrifuges, knowing full well the numbers meant that they were meant for nuclear weapons? The German green party and CDU approved that sale ... but it can't be discussed. I mean, were they deceived? Maybe, probably I'm going to say, but it cannot be talked about and especially the obvious question "What is Germany's responsibility here?" can't be asked.

I mean it's like the Netherland's and Belgium's role in giving Pakistan and North Korea nuclear weapons. There, too, the "... and your plan to fix that, dear Belgium and Netherlands, is what, exactly?"

But it's critical to current political beliefs to say otherwise, half of people are mad enough to deny Iran even wants nuclear weapons, so you're probably about to deny physical reality. Have at it.

Kind of like the "detail" from the Iraq war nobody is allowed to talk about anymore. That Ali Chemicali was convicted of using chemical weapons, first by the UN, then by Iraqi courts, in both cases supported by people standing there with chemical burns. But there NEVER WERE chemical weapons (and certainly not a research program or production facilities) in Iraq. NEVER!

The US politically approved history is as stupid and full of lies as any other countries' history.

So there. Pretty sure I have offended and insulted the preferred political beliefs of a solid 90% of USians and Europeans. Sadly, doesn't make it any less true.

defrost 9 hours ago [-]
So ... you're either referring to Iran being non compliant to a deal eight years before it was made, or you're referring to Iran being non compliant to a deal after a major party to the deal withdrew.

Is that correct?

spwa4 7 hours ago [-]
I don't care much for this discussion. Obviously, the deal doesn't actually matter for anything other than feelings. And no, I don't mean official findings I mean statements. Plus there was "a deal" before the deal (before 2013 I mean), which Iran violated even more than the nuclear deal. Iran technically first agreed to not enrich uranium in 1968 and the current government first promised not to enrich uranium in 1974, and they haven't even bothered to withdraw from that (oh, and technically that agreement says it can never be withdrawn from, but let's call that a problem with the usual UN level of realism. It's like what UN GA keeps doing with that "other" conflict: pointing out Hamas has signed a multiple treaties to fight terrorism, therefore they must be fighting terrorism and then saying that Israeli actions violated those treaties)

The simple fact is that Iran cannot be allowed to enrich uranium under any circumstances, deal, no deal, conditions, ... this is political, when push comes to shove it doesn't matters. It cannot be allowed to happen, obviously.

Iran has been under agreement that they weren't going to enrich uranium for longer than the current Iran exists. All Iranian nuclear actions violated NPT, and of course the help they got from Russia and Germany, and the help they gave to North Korea also violated NPT, but that, I'm sure doesn't matter. 1000 violations by Iran, 10 really big violations, and one by Trump/US. Three guesses which part of the list you'll be focusing on ...

This does also mean that the details, AND any blame or who violated what treaty first doesn't matter (cue the endless discussion you're about to start trying to make it sound reasonable what Iran did, it's the "US's fault", right? Or maybe Europe? I've read tankies claiming that. Hell some communists are making the point that if Iran beats the US in this conflict, they'll finally become a true communist state, what they were prevented before by evil Britain capitalist oil companies. Really. An article saying that is on marxist.com). Obviously Iran was the first to violate NPT, both as a principle and as a deal/treaty, but let's say you're right and it wasn't Iran. Or that the JCPOA somehow forgave them and makes everything that happened previously just peachy, which it of course doesn't ...

Fact is Iran has attacked everyone they possibly could, from Argentina to Saddam Hussain, from the Taliban to Norway. Everyone knows what will happen if they get nukes.

JumpCrisscross 7 hours ago [-]
> I don't care much for this discussion

Then why did you start this tangent?!

MiroslavPokorny 15 hours ago [-]
Its nothing more than a gentlemans agreement.
gmerc 19 hours ago [-]
Yea like WMD in Iraq
abeppu 19 hours ago [-]
When Stuart Russell did the Slaughterbots film in 2017, some people thought it was over-the-top, and yet here we are. https://en.wikipedia.org/wiki/Slaughterbots

For the US, I think the history of a distorted 2nd amendment dialogue may make this even worse: "If the government reserves the right to use autonomous killing drones, then the citizens must have a right to the same!" And the difference between a bot that navigates and carries stuff and a bot that navigates and carries and uses a weapon may be a small modification.

jameslk 18 hours ago [-]
> When Stuart Russell did the Slaughterbots film in 2017, some people thought it was over-the-top, and yet here we are. https://en.wikipedia.org/wiki/Slaughterbots

Slaughterbots was a great way of illustrating the issue, but I think Daniel Saurez's "Kill Decision" talk is a lot more useful and more accurately predicts where we are today in issues of autonomous warfare and mitigation, despite being even older: https://www.youtube.com/watch?v=pMYYx_im5QI

He recommends an international framework where no human kill decision is left to be made autonomously (we're well past this stage), all robots announcing their presence and identification at all times where all citizens can track them, drones that patrol other drones not adhering to these requirements. That's where discussions should have started. Historically, it seems weapons have to be abused first to demonstrate how terrible they are, before treaties are enacted

JumpCrisscross 18 hours ago [-]
> all robots announcing their presence and identification at all times where all citizens can track them, drones that patrol other drones not adhering to these requirements

Sorry what, we're going to have drones patrolling checks notes the Arabian Peninsula and also all of Eastern Ukraine, Crimea and Western Russia to make sure all sides' drones there are constantly squawking that they're on a bombing run? Do air-defense missiles and drones have the same obligation?

This sounds like a global no-fly zone. It's unclear the U.S. military can even enforce one over Iran.

jameslk 18 hours ago [-]
> Sorry what, we're going to have drones patrolling checks notes the Arabian Peninsula and also all of Eastern Ukraine, Crimea and Western Russia to make sure all sides' drones there are constantly squawking that they're on a bombing run?

As opposed to drones not announcing themselves, acting with impunity? Yes, I'd rather take the treaty that enforces this. You cannot simply "ban drones" or "ban robots" today, which is the point Daniel makes. You can only mitigate them

JumpCrisscross 18 hours ago [-]
> I'd rather take the treaty that enforces this. You cannot simply "ban drones" or "ban robots" today

Creating a de facto global conflict no-fly zone is about as realistic as banning drones.

jameslk 18 hours ago [-]
I'm not sure where you got the idea about this creating a "global no-fly zone". I think your argument is essentially "patrolling robots effectively results in no fly zone" but that's not what Daniel is saying. Mitigating robots != mitigating all things that fly. Not all robots are flying either. I'd encourage you to watch the talk if you haven't already
JumpCrisscross 17 hours ago [-]
> not sure where you got the idea about this creating a "global no-fly zone"

"Drones that patrol other drones" requires the resources of a no-fly zone.

> Not all robots are flying

No-fly zones are seldom maintained totally aerially.

> I'd encourage you to watch the talk

Will do. That said, I can't see any military power agreeing to have its drones (or air defenses) broadcasting like this.

jameslk 17 hours ago [-]
From what I can see, this video from 13 years ago has almost completely predicted where we are today, which is terrifying. Perhaps I believe perfect is the enemy of good and its better to unwind from somewhere. I do really like the idea of robot makers being forced to add publicly-visible identification signals into their robots as a start. It's not perfect, of course

I appreciate you watching the video and offering your counter perspective

JumpCrisscross 16 hours ago [-]
> this video from 13 years ago has almost completely predicted where we are today, which is terrifying

I'm not loving his history of war and politics mapping feudal economies to armor and castles being broken by scale armies, which in turn enabled nation-states. We had massive armies before: Rome fielded them. Before them, Alexander the Great and phalanxes built scaled armies. The same breaking of armor, in fact, happened with chariots and long spears in the Bronze Age.

As for the threat to democracy, it seems professional armies allow leaders to separate themselves and their populations from the gory effects of war almost as effectively as AWS. Suarez also claims AWS will let leaders decouple population from power (a real concern, I think). But then he says it will permit anonymous war, which also means anonymous rebellion, which undercuts that first risk.

On AWS enabling offense over defense, meanwhile, we've seen that's currently dead wrong. The defender's advantage has grown. Not because air defenses are better. But because mass manufacturing cheap short-range munitions allows one to make their own territory lethal much faster than someone far away can bring their lethality to you.

In summary, I think Suarez offers a prescient and compelling summary of leading thought on AWS thirteen years ago. But he misses some marks. Internally contradicts at times. And as such, I'm not convinced in his proposed solution.

It does, however, contain a kernel of wisdom. Perhaps I could expand on it. Maybe what we need is open-source intelligence from space-based platforms that monitor, real time, the global airspace and ground for likely autonomous activity. What I'm proposing is a panopticon, but no more than Suarez's. It is, however, economically possible. And it could be enacted unilaterally. Knowing who is fielding what in what capacity will let us draw more thoughtful lines. It's not like we don't have a bunch of conflicts brewing as laboratories anyway.

lopsotronic 18 hours ago [-]
Civilian "slaughterbots" would get you into preposterously serious legal problems for a cornucopia of reasons:

0. FAA / ATC stuff

1. Adding self-guidance packages to any rocket to steer it to a specific spot will get attention very rapidly, because any tech info you disperse is going to be ITAR-controlled. This happened a couple decades ago to a few model rocket guys who added GPS targeting, and it happened again not too long ago to some dudes who published a youtube showing their flying widget with an onboard AI Decider/Navigator that flew itself back home. This is helped along by point 0, see above.

2. Your payload is an NFA "destructive device" no matter how you slice it. It's going to need a dozen or so grams of HE, and anything more than 7g OR any amount outside of a gun barrel is legally DD. Also, under Heller, the Second Amendment protects those weapons that are in “common use” by law-abiding citizens, and SC Bruen, SC Rahimi didn't scew with that, but no one is going to say that killbots are "common use" . . . which brings me to . . .

3. “Bearable arms.” - a doohickey that flies off, loiters and engages isn’t “borne” in any ordinary sense. This hasn't been tested in a court yet, but I would bet dollars to donuts that it doesn't come off like "quadcopter == bullet"

You could dodge some or all of these right up until the moment of deployment, but once you hook all the pieces together they're coming down on you like a load of bricks.

Oh no no no no they do not want their citizens/property to be getting their hands on stuff that can actually fight. Here, have an AR instead that you can cuddle.

NoImmatureAdHom 19 hours ago [-]
2A dialogue is, at present, about "bearable arms" (Caetano vs. Massachusetts).

So the question becomes, "Are drones bearable arms?"

Seems to me the answer is an obvious "yes". Since they're small and you can carry them around.

elcritch 18 hours ago [-]
Sometimes court cases get so weird.

Seems pretty clear in the context of the revolutionary war that the purpose of the 2A was to protect the ability of citizens, or more specifically militias, to overthrow a tyrannical government.

Interestingly this has actually happened once in the USA since the revolutionary war, the Battle of Athens in Tennessee in 1946 (1)! Small scale sure but it worked as intended.

1: https://www.libertarianism.org/articles/battle-athens-obscur...

NoImmatureAdHom 3 hours ago [-]
Neat. Yeah, that remains the purpose of the 2A!

I recently talked to an Iranian fellow who lamented his country's state, and was clear that he believed an armed population would let Iran get out of the mess it's in, but also would've prevented the mess in the first place.

MiroslavPokorny 15 hours ago [-]
Not quite.

Back in those days quite a lot of Americans were moving west fighting coyotes and indians.

It doesnt help to pretend it was some noble freedom, or that America is an actual democracy today, because i highly doubt nobody in American wishes to build a ballroom or invade Venezuela.

JumpCrisscross 18 hours ago [-]
Genuine question, what is the legal test for bearability? If you can carry it? Because a suitcase nuke is, by definition, man portable.
chneu 18 hours ago [-]
It doesn't really matter. The modern 2a argument is based on an argument that was never considered valid in its time. 2a arguments and stances are malleable.
gillesjacobs 18 hours ago [-]
There are backpack-sized nukes that fit the definition of bearable arms too [1]. I think there are reasonable limits. Except for myself, I should be allowed to own a DJI drone with hbomb payload, no one else though

1. https://en.wikipedia.org/wiki/Special_Atomic_Demolition_Muni...

baconner 18 hours ago [-]
So is a grenade or a rocket launcher, but we've been pretty well able to regulate private ownership of those, no?
NoImmatureAdHom 3 hours ago [-]
The Americans do regulate ownership of those and all other bearable arms. I think in most states though, it is totally possible (though extremely difficult and expensive) to own such "destructive devices".
rgbrenner 19 hours ago [-]
Russia also opposes this, and they're already letting AI select targets and kill people without human oversight. See this incident from July in Ukraine: https://www.nytimes.com/2026/08/24/world/europe/russia-drone...
pvaldes 9 hours ago [-]
This path leads unavoidably to one or two top Russian politicians killed. Then they will change their point of view really fast.

Why to train your expensive robot to kill an anonymous child in a beach? is a bad use of your money when you can train it to kill a general in their house.

The only part that they didn't realized still is that using $10000 drones to launch bombs is also antieconomical and makes you look bad on TV. Eventually psychos will realize that the future is $500 mosquito drones delivering poison to one particular target. Much more digestible for the public opinion.

I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.

notaigenerated 6 hours ago [-]
Their whole war is a bad use of money. You just don't realize that not all things people do they do for money. Ideology, religion, propaganda have much larger impact on decision making than love for money. Especially in non- or half-capitalist societies.

> I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.

You're living about 5 years behind if you think it's future. It's the present. There's nothing you can do to prevent it.

tim333 3 hours ago [-]
Quite a lot of Russian generals have been killed and they've made many attempts on Zelensky, although not using AI. But the Russia view never seems to be we should stop this stuff, just threatening to hit back harder.
tim333 3 hours ago [-]
I'm not sure banning particular technologies works very well. General principles like don't invade and kill people are good but we've had autonomous killing machines in the form of mines for decades and they don't seem to go away when there's an army invading.
guillybarres 19 hours ago [-]
"Killer robots" is a distasteful phrase, but their use is of course preferable to sending our young men to die in war.
tensor 18 hours ago [-]
And how will you feel when killer robots from other countries are roaming yours killing your young men, women, and children? Don't assume you will always be untouched.
guillybarres 18 hours ago [-]
Of course, that's life. But we have to explore all possibilities and equip ourselves as best we can, accepting any such ban would be detrimental to us and give the advantage to those other countries who may one day find themselves roaming here.
JumpCrisscross 18 hours ago [-]
> when killer robots from other countries are roaming yours

Genuinely unclear how this is different from the drones we've been fielding for decades. Or getting potted by a B-52 from BVR. Or firebombed.

tensor 18 hours ago [-]
That's not my point. I was addressing the notion that these technologies will somehow keep your people safe in a war when it goes both ways. Sure, you won't have to send your people into battle, but neither will the enemy.

And with these sorts of systems there will absolutely be a lot of civilians killed either due to the systems inability to distinguish between non-combatant and combatant or more likely the fact that shitty regimes simply don't value human live, their own country's or others.

JumpCrisscross 18 hours ago [-]
> you won't have to send your people into battle, but neither will the enemy.

Perhaps between nuclear powers. But we've already been doing set-piece battles as proxy wars without drones. Just other people.

At a certain point, you start hitting the other side's production. That means strikes on the homeland. Even if we're in a world where those factories are automated, that's going to result in errors and civilian deaths from time to time.

tensor 17 hours ago [-]
Yes, there is asymmetry between bigger powers and smaller ones, and the smaller often resorts to terrorism. I really don't think there is anything here to crow about. Technology definitely has changed the battlefield, but I wouldn't assume it will necessarily be for the better.

I'm also not saying any given country shouldn't build these things. We all do what we have to in order to survive. I think that's the reality, rather than any illusion that these things will make your people any safer.

mopsi 18 hours ago [-]
I've never understood the opposition to precision weapons, because dumb weapons like wooden planes dropping unguided bombs are far more devastating to bystanders than cruise missiles or AI-guided loitering munitions.

Check out this video of Ukrainian drone narrowly avoiding a civilian: https://x.com/NAAF0Racoon/status/2118492156008841231

30 years ago, that guy would've been a barely visible smudge in a grainy video feed on a gunship's sight. He would've been killed because helicopter crew wouldn't have been able to tell that he was a civilian. With 2026 tech, they can properly identify him, steer the drone away just a few meters before hitting him, and fly down the road to hit the actual enemy group in the area. That guy survived only because modern weapons beam down high-def video and provide control link until the very end instead of just flying or shooting into the nearest heat source once a trigger has been pulled.

tensor 17 hours ago [-]
In the right hands yes they can minimize casualties. I'd love nothing more than for all wars to be fought only between robots. But it only takes one asshole yee ha to let these things wipe out a city or two. That's the price. So we'll all build them, but I don't think we should be happy about it.
notaigenerated 6 hours ago [-]
I'm gonna feel bad, but it's not my fault. THEY started it first.
tsss 3 hours ago [-]
Suddenly we're talking about women and children huh? When men die in the trenches by the hundreds of thousands all is fine, but god forbid the women at home face the same danger.
16 hours ago [-]
carefulfungi 20 hours ago [-]
Would supporting this ban be perceived as more pressure on Ukraine?
18 hours ago [-]
MisterBiggs 19 hours ago [-]
The issue here is that by the time you realize your adversary stopped holding their punches the war will be over. Autonomous systems totally break conventional warfare, there is no ramp up period or chance of retaliation when the rules get broken. Things are going to move well beyond the pace of humans and software at the edge is going to make just as much of a impact as hardware.
JumpCrisscross 18 hours ago [-]
> there is no ramp up period or chance of retaliation when the rules get broken

This has been true of all ranged weapons, across history, over their weapon ranges. Which, since the advent of ICBMs, has been global. (And since when runaway auto-escalation has been a real concern–drones don't materially change that.)

tehjoker 19 hours ago [-]
I don't see how this is true? It depends on the designs, e.g. robustness, weight, agility, etc. Though there is the classic disturbing "slaughterbots" presentation about using cheap drones armed with a few grams of high explosive and facial recognition technology used to cheaply sow chaos.
MisterBiggs 19 hours ago [-]
The argument is more that existing systems could be automated. There’s probably lots of roles on a battleship robots couldn’t do yet, but the humans steering the ship or clicking where ordinance should land could be replaced with autonomous systems
tehjoker 14 hours ago [-]
I can see that being done. I dislike autonomous weapons, but I don’t see how that amounts to an insurmountable edge on a battleship.
naveen99 19 hours ago [-]
there are no more wars, just war games. we have a world order.
JumpCrisscross 18 hours ago [-]
> there are no more wars, just war games. we have a world order

Comforting notion. Unsupported by any evidence.

MisterBiggs 18 hours ago [-]
what’s a world order to a asymmetric conflict
fitblipper 19 hours ago [-]
Why isn't there time for ramp up? Production doesn't go from not existing to ubiquitous over night... usually.

Why isn't there a chance for retaliation? Why couldn't we, you know, shoot back?

MisterBiggs 18 hours ago [-]
If both sides were hiding capabilities behind software flags then the hardware might not matter.

US drones today have to go through a long kill chain to decide if it can take action against a target. We’ve already seen this heavily eroded in Ukraine/Russia. It’s not hard to imagine to losing side removing the human element entirely with just a software flag.

My argument is that autonomous systems will move war so quickly that by the time you react and engage your systems as well the war will be over.

18 hours ago [-]
scoofy 16 hours ago [-]
People need to study game-theory. If there were ever a ban on killer robots, it would be entirely performative.
tonymet 19 hours ago [-]
Finland spent ~ half a billion Euros getting rid of its landmines, only to withdraw from the treaty and rebuild its landmine arsenal in the last couple years.

Landmines are very effective. Likely one of the most effective for defending a long boarder with no natural geographic boundaries. and they are harmful (on purpose).

I mention it because some dangerous things are very effective deterrents. They may sound scary, but they are a lot better than any alternative.

Why would the world's most active and powerful armed forces sign anything banning the use of an effective tool?

18 hours ago [-]
anurodhp 19 hours ago [-]
Has unilateral disarmament ever worked out well?
BLKNSLVR 19 hours ago [-]
We haven't had a nuclear war yet.

But on the flipside, Ukraine gave up it's nuclear weapons on a promise from Russia that they wouldn't invade.

MiroslavPokorny 15 hours ago [-]
Australian citizens havent carried guns for a long time and its significantly safer than other countries where many citizens do carry guns.
vkou 19 hours ago [-]
Bilateral disarmament and arms limitations has an okay track record.
jmclnx 20 hours ago [-]
I wish I can say I am surprised, but I am not. There was a time when I believed these laws would become real, but now we know they won't.

https://en.wikipedia.org/wiki/Three_Laws_of_Robotics

pixl97 19 hours ago [-]
Even in the books where the hardware had this magic there were problems, and that was the entire point of the books.

Reality cannot work in the way the books did, at least not with any type of computing architecture we've made so far. I'd go further and say it's antithetical to general intelligence and problem solving.

bryan0 19 hours ago [-]
I would say the books showed correctly, that it is impossible to avoid "trolley problems", but that is okay and expected. It's still directionally correct to imbue machines with the directive to not harm humans.
Loquebantur 19 hours ago [-]
A drone is a robot as well.

People use robots (and soldiers) to dodge responsibility. By making the operator anonymous, hidden beneath layers of "chain of command", the fiction of "nobody was responsible" is conjured up.

By refusing to outlaw autonomous weapons, the absence of any human operator built-in, the US follows its greed, their wish for killing without remorse and the fiction of "untouchability".

pixl97 19 hours ago [-]
The US is the biggest arms dealer in the world, what made you think we were ever going to ban drones?
18 hours ago [-]
18 hours ago [-]
NoImmatureAdHom 19 hours ago [-]
It's worth considering why bans on nuclear, biological, and chemical weapons seem to work pretty well. We basically have norms against using them, and that works. Nuclear weapons are hard for anyone but a well-resourced nation-state to make, but the other two aren't hard to make or get.

So, what's the difference here?

Is it that killer robots are somehow not norm-breaking? There's something about how we imagine they will be that seems...okay for war? Versus poison gas, which somehow seems not okay for war to most everybody.

What do you think?

JumpCrisscross 18 hours ago [-]
"They are dismantling these systems because they do not expect they will ever have a use for these weapons.

Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was.

That has some big consequences, most of which are actually unpleasant. It means that efforts to ban ‘immoral’ weapons that are effective will likely never succeed. The model that activists thought they were building on is a foundation of sand – the only way you ban weapons is after they are basically useless anyway (to cut that point finer: you get to ban weapons after they stop being useful to the great powers, who may then enforce the ban on smaller states). The idea that we might summon up enough moral indignation to set these weapons aside seems unfounded. We are not nearly so moral as my high school teachers imagined, nor are we so cowardly as a ‘Fremen apologist’ might think. We’ve simply made an amoral calculation about effectiveness" [1].

[1] https://acoup.blog/2020/03/20/collections-why-dont-we-use-ch...

NoImmatureAdHom 3 hours ago [-]
Hmm.

Maybe the argument is: given that the other guy will feel free to do it to me if I do it to him, NBC weapons aren't useful. Which is pretty much the same thing I was saying, it's a norm underpinned by not exactly mutually assured destruction, but something similar in the game theory.

Thinking about it first-order, it seems like at least nuclear and chemical weapons would be "useful". If the Soviets / Chinese weren't nuclear-armed and backing up North Korea / Vietnam, why not nuke 'em a bit to show them we mean business and get them to surrender that way? Holding other things constant, I bet that would have been the strategy.

(I think we're agreeing)

bentt 19 hours ago [-]
Everyone thinks their killer robots will kill the other guys killer robots first.
blooalien 13 hours ago [-]
> Everyone thinks their killer robots will kill the other guys killer robots first.

... and that there definitely won't be some horrific disaster where one (or many more than just one) such killer robots malfunction or run amok, or are taken over by malicious actors hellbent on causing exactly such a disaster.

uptrails 20 hours ago [-]
We'll pass this right after WWIII.

I'm not even joking, almost every "ban on X" in the context of warfare happened after unspeakable atrocities where, once the dust settled, the parties involved looked at the sea of dead bodies and agreed not to do it again. I guess countries learn by doing.

vjvjvjvjghv 19 hours ago [-]
Agreed. And after a few decades/centuries people will forget how bad war is and they will do it again.
tehjoker 19 hours ago [-]
This is mostly but not entirely true. An international ban on blinding laser weapons was enacted before they became widely used.

https://en.wikipedia.org/wiki/Protocol_on_Blinding_Laser_Wea...

analog31 20 hours ago [-]
I don't think we passed a global ban on nuclear weapons or land mines.
michaelt 19 hours ago [-]
https://en.wikipedia.org/wiki/Ottawa_Treaty 162 states have signed a land mine ban.

Non-signatories include the US, China, Russia, India, Pakistan, Israel and Iran. And Ukraine decided to withdraw from the treaty after being invaded by Russia.

So a ban with a lot of signatories, but not by any means universal.

vjvjvjvjghv 19 hours ago [-]
A lot of these treaties will be abandoned once a war becomes existential for a countyr. As far as I know, chemical and biological weapons weren't used in WW2 because they don't make much sense. Same for nuclear weapons after WW2. They aren't very useful and may trigger world wide destruction.
XorNot 19 hours ago [-]
Chemical and biological weapons are both more notable for being relatively ineffective against prepared military forces, but devastating to civilians. They don't usefully generate tactical results on the battlefield. (in part due to their uncontrollability: a bullet goes where you point it, a bomb lands where you throw it, a cloud of gas can hit your own forces if the wind changes at a bad moment).
vjvjvjvjghv 19 hours ago [-]
Land mines mainly rip off limbs of children and framers so nobody really cares. I think it's terrible by the US that haven't joined the ban.

As far as nuclear weapons go, they haven't been banned but we have the non-proliferation treaty that worked to some degree. The use of nuclear weapons is also viewed as a line that after WW2 nobody has tried to cross.

pixl97 19 hours ago [-]
I think one of the biggest issues is the border between the Korea's. One of the more heavily mined areas in Earth.
defrost 19 hours ago [-]
Globally there are 6-8,000 land mine casualties (including deaths) a year, very few of which occur along the Korea's joint border - that's a clearly marked, well known, patrolled, enforced, entrenched moat with few children or farmers at risk.

The three South Korean soldiers recently injured raised awareness of the mines there, but they were patrolling an area with known risks.

The greatest issue in my mind for the past four decades or so are the very many civilian areas about the globe with scattered mines throughout areas where children ideally should be able to play and food grown safely.

* global distribution: https://www.statista.com/chart/26209/landmines-contamination...

* N-S Korea border discussion: https://www.lowyinstitute.org/the-interpreter/almost-a-milli...

vjvjvjvjghv 16 hours ago [-]
When you travel in Laos or Cambodia it's highly recommended not to jump into the bushes to pee because you may step onto a mine or a not exploded bomb.
spprashant 20 hours ago [-]
UN treaties are worth the paper they are written on. I doubt the current US admin cares much about any of the UN treaties, except for when it supports sanctions they want to impose.

In other slightly related news, the US Secretary of State made mockery of International Criminal Court this morning. https://www.reuters.com/world/us/rubio-assails-international...

BLKNSLVR 19 hours ago [-]
Rubio to International Law is Hegseth to Rules of Engagement.

If Rubio finds that an offensive parallel to draw, then it shows how much he has bent his reality lens.

18 hours ago [-]
skeledrew 16 hours ago [-]
Why on earth would the US allow a ban on fully autonomous weapons? Death-causing is a very profitable business and the US is all about profit.
fedpost 20 hours ago [-]
TBF we've had killer robots for decades. Every now and then we shoot down an airliner full of people with them.

Not to be overly glib but that cat has been out of the bag for a long fucking time. Name a capability and I'll give you a conventional munition that has had said capability for over a decade.

hadlock 19 hours ago [-]
We've had the Tomahawk since 1983, the Minuteman since 1962, and at a much smaller scale, the Javelin since 1996. If you want to go back further, the Germans had the V2 as early as 1944. The cat has been out of the bag almost as long as we've had the gift of flight, and predating the modern computer.
fedpost 19 hours ago [-]
I think people also just don't know the broader capabilities of those systems beyond point-and-shoot. There are a number of systems that have had the ability to loiter and look for targets before engaging. The recent advancement has been the ability to do that on higher resolution FPA imagers but it doesn't actually change much fundamentally.

What people should actually be worried about is an AI chain of command. The weapons are very secondary to the kill chain that initiates them.

Fricken 17 hours ago [-]
Landmines are a rudimentary form of killer robot
blooalien 12 hours ago [-]
> Landmines are a rudimentary form of killer robot

I don't think I've ever heard of a landmine that autonomously hunts down it's target. AFAIK you gotta go to where it's been buried and step on it. A killer robot will come to you with or without your consent or any action or lack thereof on your part.

Fricken 8 hours ago [-]
Landmines have claimed over 165,000 casualties just in the 21st century. ED-209 is very scary but also still largely imaginary.
BLKNSLVR 19 hours ago [-]
There's an interesting future if autonomous decision making increasingly becomes accepted. We've already seen glimpses of it with drone strikes target selection going back to post-911 actions, we've seen it more recently with almost the first bombing in Iran hitting a school. "out-dated intelligence".

It seems no one was responsible for Skynet.

AI/autonomous decision making absolves those being paid to be responsible of any responsibility. Can we at least save the ridiculous salaries that they're being paid to no longer make these decisions? It's becoming increasingly obvious that the decision makers are resentful of having to make decisions, and are jumping as quickly as possible to offloading it to "new, well marketed thing".

We're all Shaggy now. "Wasn't me".

misiek08 19 hours ago [-]
Good luck to all of us!

US is the country providing weapons and being active in wars only they've started themselves. Otherwise not taking into account people life value, never in history.

Fricken 19 hours ago [-]
They abandoned the Paris Climate agreement, the Iran Nuclear deal, The Trans Pacific partnership, NAFTA, and UNESCO just to name a few.

US international agreements aren't worth the paper they're printed on, so why not just lie?

MiroslavPokorny 15 hours ago [-]
Because its a bluff so others "fear" that America is building killer robots.

The best defense is for your opponent's imagination to run wild.

vkou 19 hours ago [-]
Americans sign their treaties with pencil.
18 hours ago [-]
reasonableklout 20 hours ago [-]
> Rather than negotiating a binding treaty, the U.S. has proposed five more years of work by the CCW's expert group to develop a nonbinding instrument, according to a November 4 working paper.

> Washington maintains that existing international humanitarian law already applies to autonomous weapons and that a new legally binding treaty is unnecessary.

Sounds like diplomatic stalling

kube-system 20 hours ago [-]
All UN members vote in their own self-interest.

I suspect the "no" votes will coincide with the countries who stand to gain from the production or use of killer robots. And the "yes" votes will coincide with states that have nothing to gain.

Spalau 19 hours ago [-]
Killer robots already exist. The only choice is between being the ones getting shot or also having the ones doing the shooting.
simongr3dal 19 hours ago [-]
Why not both!
rescripting 19 hours ago [-]
Countries who stand to gain from the production or use of killer robots will vote "yes" on a ban of killer robots? How would this bolster use or production?
kube-system 18 hours ago [-]
I accidentally swapped my words, whoopsie
19 hours ago [-]
tehjoker 19 hours ago [-]
This is similar to how America refuses to agree that food for children is a human right. At the UN, we are a supervillain.

https://usun.usmission.gov/explanation-of-position-on-a-thir...

"We dissociate from preambular paragraph 13 because it inaccurately implies that sanctions are not in accordance with international law and pose a danger to food security and nutrition."

So essentially, we reserve the right to murder children by famine.

slowhadoken 20 hours ago [-]
JD Vance is a killer pleasure droid.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 18:56:49 GMT+0000 (Coordinated Universal Time) with Vercel.