.1,JUS .1NASCENDI1 ,ROBOTIC ,W1PONS & !
,M>T5S ,CLAUSE

,PET] ,AS>O

,PUBLI%$ BY ,$W>D ,ELG> ,PUBLI%+
,COPY"R ^C #BJAF BY ,$W>D ,ELG> ,PUBLI%+
,TRANSCRIP;N ( POR;NS (
  ,,ISBN3 #IGHAGHCDGFGCB
,AS>O1 ;,P4 "<#BJAF">4 ,JUS NASCENDI1
  ,ROBOTIC ,W1PONS & ! ,M>T5S ,CLAUSE4 9
  ;,R4 ,CALO1 ;,M4 ,FROOMK91 @& ,I4
  ,KERR "<,$S4">1 .1,ROBOT .1,LAW "<PP4
  #CFG-#CHF">4 ,$W>D ,ELG> ,PUBLI%+4
,FUR!R REPRODUC;N OR 4TRIBU;N 9 O!R ?AN
  A SPECIALIZ$ =MAT IS PROHIBIT$4

,TRANSCRIB$ #BJAG BY
  ,DONALD ;,J4 ,W9IECKI
  ,BOISE1 ,,ID1 ,,USA


,9 #A VOLUME
,BRL PAGES T#A-T#D1 #A-#EG
,PR9T PAGES #CFG-#CHF                T#A
           .1,JUS .1NASCENDI

        ,,,SPECIAL SYMBOLS US$
             9 ? VOLUME,'

.= ,DOT LOCATOR = 8M5;N0
.=9 ,SUP]SCRIPT 9DICATOR "<:5 9 GRADE
  #A MODE">
.=8 ,OP5+ NON-SPECIFIC QUOTE SIGN
.=0 ,CLOS+ NON-SPECIFIC QUOTE SIGN
.=@A ,AT SIGN
.=@& ,AMP]S&
.=@#1 ,SMALL CAPITAL LRS ^W 9DICATOR
  "<,TRANSCRIB] DEF9$">
.=@#7 ,SMALL CAPITAL LRS PASSAGE
  9DICATOR "<,TRANSCRIB] DEF9$">
.=@#' ,SMALL CAPITAL LRS T]M9ATOR
  "<,TRANSCRIB] DEF9$">
.=@.< ,OP5+ TRANSCRIB]'S NOTE SIGN
.=@.> ,CLOS+ TRANSCRIB]'S NOTE SIGN
.=^C ,COPY"R SIGN
.=^S ,SEC;N SIGN
.=^3 ,DI]ESIS "<UMLAUT"> ABV FOLL[+ LR
.=^7 ,BOLDFACE PASSAGE 9DICATOR
.=^' ,BOLDFACE T]M9ATOR              T#B
           .1,JUS .1NASCENDI
.=_? ,HA%TAG
.=_/ ,=W>D SLA% "<,SOLIDUS">
.=" ,L9E 3T9UA;N 9DICATOR )\T SPACE
.="6 ,PLUS SIGN
.="7 ,EQUAL SIGN
.=.7 ,ITALIC PASSAGE 9DICATOR
.=.0 ,P]C5T SIGN
.=.' ,ITALIC T]M9ATOR
.=.1 ,ITALIC ^W 9DICATOR
.=.- ,"USCORE "<,L[L9E">
.=; ,GRADE #A SYMBOL 9DICATOR
.=,' ,CAPITALIZA;N T]M9ATOR
.=,- ,DA%
.=,, ,CAPITALIZ$ ^W 9DICATOR
.=,,, ,CAPITALIZ$ PASSAGE 9DICATOR








                                     T#C
           .1,JUS .1NASCENDI

        ,,,TRANSCRIB]'S NOTES,'

  ,9 ! PR9T V].N ( ? DOCU;T1 FOOTNOTES
#C1 #AG & #AI >E SPLIT ACR TWO PAGES4
,FOOTNOTE #C IS SPLIT ACR PAGES
#CFH-#CFI4 ,FOOTNOTE #AG IS SPLIT ACR
PR9T PAGES #CGE-#CGF4 ,FOOTNOTE #AI IS
SPLIT ACR PAGES #CGF-#CGG">4














                                     T#D
           .1,JUS .1NASCENDI        #CFG

     ,*APT] #AD4 .1,JUS .1NASCENDI
         ,ROBOTIC ,W1PONS & !
            ,M>T5S ,CLAUSE

             ,PET] ,AS>O

  ,! DEVELOP;T ( NEW MILIT>Y TE*NOLOGIES
IS "O ( ! MO/ PRESS+ MOTIVA;NS = NEW
LAW1 .1JUS .1NASCENDI1 9 ,9T]NA;NAL
,HUMANIT>IAN ,LAW "<,,IHL">4 ,! LEGAL;Y
& POT5TIAL REGULA;N ( ROBOTIC &
AUTONOM\S W1PONS1 AL;GSIDE & "S"TS 9
3JUNC;N ) CYB]W>F>E1 H RAIS$ S]I\S "QS &
SP>K$ A GR[+ DEBATE 9 ! 9T]NA;NAL
COMMUN;Y4 ,! ISSUE ( LE?AL AUTONOM\S
W1PONS HAS BE5 TAK5 UP BY ! /ATES "PIES
TO ! ,3V5;N ON ,3V5;NAL ,W1PONS AT !
,UNIT$ ,NA;NS1;9#A ": "QS H BE5 RAIS$ Z
TO :E!R AUTONOM\S ROBOTIC W1PONS1 :
*OOSE & ATTACK T>GETS 9DEP5D5T ( HUMAN
3TROL1 CD 3=M TO EXI/+ ,,IHL OR MI<T
REQUIRE SPECIAL REGULA;N4 ,^! 4CUS.NS H
AL "Q$ :E!R LE?AL AUTONOM\S W1PONS    #A
           .1,JUS .1NASCENDI       A#CFG
MAY 2 MORALLY UNA3EPTABLE EV5 IF !Y 3=M
TO ! LAW4 ,:ILE WE >E 3SID]+ ! V>I\S
R1SONS & M1NS = REGULAT+ AUTONOM\S
W1PONS1 ,I 2LIEVE X IS IMPORTANT TO
3SID] ": NEW 9T]NA;NAL LAW EMANATES F1
"PICUL>LY 9 RESPONSE TO NEW TE*NOLOGIES4
  ,I H ADDRESS$ "S ( ! SPECIFIC R1SONS =
PROHIBIT+ ! USE ( AUTONOM\S W1PONS
ELSE":4;9#B ,? *APT] W 3SID] ! LEGAL
FRAME"W & M1NS BY : NEW LAW CD COME 9TO
PLACE = NEW ROBOTIC TE*NOLOGIES1 Z WELL
Z "S ( ! PHILOSOPHICAL ISSUES T >ISE 9 ?
PROCESS4 ,9DE$1 A GRT D1L ( 5]GY HAS BE5
SP5T TRY+ TO "U/& H[1 :51 & :Y NEW LAW
MI<T 2 NEC = AUTONOM\S W1PONS4 ,A CLE>]
"U/&+ ( ! G5]AL SITUA;N W
"333333
#A ,SEE REPORTS ( ! #BJAD & #BJAE ,UNIT$
  ,NA;NS ,MEET+S ( ,EXP]TS 9 ,G5EVA1
  HTTP3_/_/WWW4UNOG4CH_/#HJBEF,,EE"
  #FJJEHEIDC_/.0#BH;HTTP,PAGES.0#BI"
  _/#F,,CE#JDI,,BE#BB,,EC#GE,A#B,C"
  #ABEG,C#H,D#JJEAC,E#BF;8,OP5,DOCU;T4
#B ,PET] ,AS>O1 .7,ON ,BANN+          #B
           .1,JUS .1NASCENDI       B#CFG
  ,AUTONOM\S ,LE?AL ,SY/EMS3 ,HUMAN
  ,"RS1 ,AUTOMA;N & ! ,DEHUMANIZ+ (
  ,LE?AL ,DECI.N-" MAK+1.' #ID ,9T'L
  ,REV4 ,R$ ,CROSS #FHG "<#BJAB">1
  .1AVAILABLE .1AT HTTPS3_/_/WWW4ICRC4"
  ORG_/5G_/RES\RCES_/DOCU;TS_/>TICLE"
  _/REVIEW-#BJAB_/IRRC-#HHF-AS>O4HTM4
------------------------------------#CFH
ADV.E N ONLY ! DEBATE REG>D+ AUTONOM\S
W1PONS1 B MI<T AL 9=M 4CUS.NS ON
REGULAT+ O!R ROBOTIC TE*NOLOGIES4
  ,! "Q ( REGULAT+ NEW TE*NOLOGIES LIES
AT ! 9T]SEC;N ( ?REE DI6]5T K9DS (
EM]G;E3 ! EM]G;E ( NEW TE*NOLOGICAL
CAPABILITIES1 ! EM]G;E ( NEW NORMS1 & !
EM]G;E ( NEW LAWS4 ,M* ( ! DEBATE OV]
REGULAT+ POT5TIALLY 4RUPTIVE TE*NOLOGIES
LIES 9 :AT ! APPROPRIATE RELA;N%IP ( ^!
%D BE1 9 T]MS ( BO? PRIORITIES & 9 TIM+4
,A COMMON HI/ORIC PATT]N IS = LAWS TO
WAIT = NORMS TO COALESCE >.D ! USE ( NEW
TE*NOLOGIES1 .1I4E41 L;G AF _!
DEVELOP;T4 ,A LESS COMMON APPROA* IS
PREEMPTIVE ,- ": AGREE;T C 2 R1*$     #C
           .1,JUS .1NASCENDI       A#CFH
AB A NEW NORM .12F A TE*NOLOGY EXI/S1 &
LAWS C 2 E/ABLI%$ T PREEMPTS ! DEVELOP;T
&_/OR USE ( A CATEGORY ( TE*NOLOGY4
,RESOLV+ ? "Q DEP5DS ^U DET]M9+ :E!R
SUITABLE GR.DS EXI/ = E/ABLI%+ A NORM 9
! ABS;E ( ! TE*NOLOGY & ! PRACTICES
SURR.D+ XS USE4
  ,? *APT] >GUES T "! IS ALR AN EM]G+
NORM 3C]N+ M1N+;L HUMAN 3TROL OV] !
T>GET+ ( W1PONS & ! USE ( VIOL5T =CE1 &1
Z S*1 "! IS A BASIS = PUTT+ 9 PLACE NEW
LAWS T PREEMPT AUTONOM\S W1PONS4 ,2F
MAK+ ? >GU;T1 H["E1 ,I WANT TO EXAM9E !
NATURE ( EM]G5T ,,IHL & ! POT5TIAL MORAL
BASIS = XS >TICULA;N4
  ,! LAW XF MI<T 2 VIEW$ BY ! CASUAL
OBS]V] Z L>GELY /ABLE & UN*ANG+1 ?\<1 9
FACT1 X IS DYNAMIC 9 V>I\S WAYS4 ,:ILE
9T]PRETA;NS & JURISPRUD;E MAY EVOLVE OV]
"T1 ! FUNDA;TALS ( ! LAW XF APPE> R M
/ABLE4 ,( C\RSE1 )9 NA;NS NEW LEGISLA;N
IS REGUL>LY ADOPT$1 B ? IS L>GELY A
MATT] ( /ATE POLICY & N AN EXACT
CORRELATE TO ! 9TRODUC;N ( NEW        #D
           .1,JUS .1NASCENDI       B#CFH
CU/OM>Y & TR1TY LAW 9 ! 9T]NA;NAL 3TEXT4
,B EV5 9 9T]NA;NAL LAW1 "! IS NEW &
EM]G5T CU/OM>Y & TR1TY LAW1 & ! DYNAMICS
( ! PRACTICE & APPLICA;N ( LAW L1DS TO
EM]G5T JURISPRUD;E & TRANS=MA;NS 9
NORMS4 ,9 ,,IHL1 NEW TE*NOLOGICAL
DEVELOP;TS >E A KEY FACTOR 9 ^!
DYNAMICS4
  ,! 3CEPT ( .1JUS .1NASCENDI IS ( 9T]E/
9 ! 3TEXT ( REGULAT+ EM]G+ TE*NOLOGIES 9
G5]AL1 & ROBOT LAW & REGULATORY POLICY 9
"PICUL>4 ,! EM]G;E ( NEW TE*NOLOGIES C &
DOES *ALL5GE _M ( \R EXI/+ ASSUMP;NS &
TRADI;NAL 9T]PRETA;NS ( ! LAW4 ,!
POT5TIAL ( ROBOTS TO 2COME AG5TS 9 ! _W
*ALL5GES L;G-HELD ASSUMP;NS BUILT 9TO !
LAW T ONLY HUMANS C ACT Z AG5TS 9 !
LEGAL & MORAL S5SE4;9#C ,ROBOTS ?US
PRES5T _M CASES & EXAMPLES
"333333
#C ,( C\RSE1 ! LAW RECOGNIZES HUMAN
  ORGANIZA;NS & 9/ITU;NS ,- S* Z
  CORPORA;NS1 TRU/S1 NON-PR(ITS1 & /ATES
  !MVS ,- Z LEGAL 5TITIES ) C]TA9     #E
           .1,JUS .1NASCENDI       C#CFH
  LEGAL RESPONSIBILITIES4 ,H["E1 ! LAW /
  L>GELY VIEWS ^! ORGANIZA;NS & 9/ITU;NS
  "? ! AG5CY ( _! EMPLOYEES1 TRU/EES1
  (FIC]S1 & EXECUTIVES4 ,? IS TO SAY T !
  LAW / L>GELY ASSUMES T 9DIVIDUAL
  HUMANS >E MAK+ DECI.NS & TAK+ AC;NS1
  EV5 :5 !Y >E ACT+ 9 (FICIAL
  CAPACITIES4
------------------------------------#CFI
9 V>I\S DOMA9S ( LAW = : WE M/ RECONSID]
& REF9E \R VIEW ( ! LAW & XS
APPLICABIL;Y4 ,9 ! MO/ EXTREME CASES1 ?
MAY M1N REVIS+ EXI/+ LAW OR WRIT+ LAW
ANEW4 ,? IS MO/ OBVI\S 9 ! LAWS DESIGN$
TO REGULATE NEW 9DU/RIES T MI<T PRODUCE
ROBOTIC PRODUCTS = APPLICA;NS F ROBOT
SURG]Y1 NURS+ & P]SONAL ASSI/ANTS1 TO
ROBOTIC SELF-DRIV+ C>S & SURVEILL.E
DR"OS4
  ,A"P F ^! NEW 3SUM] 9DU/RIES1 ! >EA 9
: ! "Q ( NEW LAW & NEW REGULA;N IS MO/
PRESS+1 & ! ROBOTIC APPLICA;N DOMA9 ":
VA/ AM.TS ( RESE>* ( DEVELOP;T IS
CURR5TLY 2+ DIRECT$1 IS 9 !           #F
           .1,JUS .1NASCENDI       A#CFI
DEVELOP;T ( ROBOTIC W1PONS4 ,:ILE ^!
TE*NOLOGIES CD F9D USE AM;G CIVILIAN
POLICE =CES & 9DIVIDUALS1 ! PRIM>Y AIM (
CURR5T RESE>* & DEVELOP;T BY /ATES IS
T[>D SOPHI/ICAT$ MILIT>Y W1PONS ) 9CR1S+
DEGREES ( AUTOMA;N & 9=MA;N PROCESS+4
,9SOF> Z ,,IHL GOV]NS ! USE ( W1PONS 9 !
3DUCT ( HO/ILITIES DUR+ 9T]NA;NAL >M$
3FLICTS1 ,I W 3SID] H[ ! EM]G;E (
ROBOTIC W1PONS =CES U TO 3SID] ! EM]G;E
( NEW NORMS & NEW LAW 9 T DOMA94 ,!
NORMS SURR.D+ ! USE ( ROBOTIC &
AUTONOM\S W1PONS 9 LAW 5=CE;T1 P]SONAL
SECUR;Y1 OR 9 CRIM9AL ACTIV;Y >E AL (
3C]N1 B 2Y ! SCOPE ( ? /UDY4 ,X I HOP$ T
A BETT] "U/&+ ( ! EM]G+ NORMS 9 ,,IHL
MI<T AL 9=M ^! O!R DOMA9S ( LAW4
  ,"O "PICUL>LY *ALL5G+ ASPECT ( NEW
TE*NOLOGIES IS _! POT5TIAL = 4RUP;N4
,NEW TE*NOLOGIES BY _! NATURE 4RUPT
PRACTICES & 2HAVIORS4 ,:ILE !
COMPUT]IZA;N ( (FICES DUR+ ! SECOND HALF
( ! TW5TIE? C5TURY MAY N H FUNDA;TALLY
*ANG$ ! BUSI;S T ^? (FICES 3DUCT$     #G
           .1,JUS .1NASCENDI       B#CFI
"<?\< X >GUABLY DID">1 X DID RADICALLY
TRANS=M ! "D-TO-"D ACTIVITIES &
PRACTICES ( ! P :O 3DUCT$ T BUSI;S4;9#D
,_H COMPUT]IZA;N N D"O S1 X WD LIKELY H
FAIL$ TO A*IEVE ! GA9S 9 PRODUCTIV;Y T !
9TRODUC;N ( S* TE*NOLOGIES S"\4 ,! SAME
C 2 SD ( ! AUTOMA;N ( FACTORIES 9 !
N9ETE5? C5TURY1;9#E L1D+ TO ! 9TRODUC;N
( ! F/ NUM]ICALLY 3TROLL$ MA*9ES &
9DU/RIAL ROBOTS4;9#F
"333333
#D @#7,%O%ANA ,ZUB(F1 ,9 ! ,AGE ( !
  ,SM>T ,MA*9E3 ,! ,FUTURE ( ,"W &
  ,P[]@#' "<#AIHH">4
#E @#7,SIEGFRI$ ,GI$ION1 ,ME*ANIZA;N
  ,TAKES ,COMM&@#' "<#AIEE">4
#F @#7,DAVID ;,F4 ,NOBLE1 ,AM]ICA ,BY
  ,DESIGN- ,SCI;E1 ,TE*NOLOGY & ! ,RISE
  ( ,CORPORATE ,CAPITALISM@#' "<#AIGG">4
------------------------------------#CGJ
  ,! 9CR1S$ AUTOMA;N & COMPUT]IZA;N (
W>F>E1 W1PONS1 & ! USE ( VIOL5T =CE LIE
AT ! HE>T ( ! GR[+ 3C]N OV] ROBOTIC
W1PONS4 ,AUTOMA;N & ROBOTIC           #H
           .1,JUS .1NASCENDI       A#CGJ
TE*NOLOGIES >E POIS$ TO REVOLU;NIZE !
PRACTICES ( MOD]N W>F>E4 ,B :AT1 IF
ANY?+1 C OR %D ! LAW D TO %APE ! COM+
REVOLU;N8 ,? "Q L1DS U DIRECTLY TO !
RELAT$ "QS ( H[ NEW LAW "\ TO 2 =M$1 H[
AN EM]G+ TE*NOLOGY MI<T NECESSITATE NEW
LAW1 & :AT ! EM]G5T NORMS "\ TO 2 9 ^!
PROCESSES4 ,X IS ^! "QS T ! CURR5T *APT]
SEEKS TO ADDRESS4

    #A4 ,,,.1JUS .1NASCENDI 9 9T]NA;NAL
    HUMANIT>IAN LAW,'
,! M1NS BY : NEW ,,IHL COMES 9TO 2+ >E
DIV]SE B 9T]RELAT$4 ,,IHL >ISES F !
RECOGNI;N ( CU/OM>Y LAW1 9T]PRETIVE
GUIDEL9ES ON EXI/+ LAW1 ! DOCTR9ES &
POLICIES ( /ATES1 ! PREC$5TS ( C\RTS &
TRIBUNALS1 JUDICIAL OP9IONS & DECI.NS1
9T]NA;NAL DECL>A;NS1 TR1TIES1 & !
9T]AC;NS AM;G ALL ( ^! 9 E/ABLI%+1
CL>IFY+1 CRY/ALLIZ+1 & CODIFY+ PR9CIPLES
& NORMS4 ,X W 2 HELP;L TO REVIEW "S ( !
BASIC 3CEPTS & =MS T 9T]NA;NAL LAW TAKES
2F 3SID]+ H[ ? MI<T EVOLVE 9          #I
           .1,JUS .1NASCENDI       B#CGJ
RESPONSE TO ! DEVELOP;T & USE ( MILIT>Y
ROBOTICS4
  ,TRADI;NALLY1 9T]NA;NAL LAW IS SE5 Z
COM+ F V>I\S S\RCES & 9 V>Y+ DEGREES (
AB/RAC;N ,- CU/OMS & NORMS1;9#G G5]AL
PR9CIPLES & LAWS1 WRITT5 TR1TIES &
3V5;NS1 & JURISPRUD;E4 ,CU/OMS & NORMS
REPRES5T ! TRADI;NAL 2HAVIORS &
EXPECTA;NS T C 2 OBS]V$ 9 ! DECI.NS &
AC;NS ( /ATES & F : G5]AL PR9CIPLES &
LAWS MAY 2 D]IV$4 ,:5 X COMES TO WRITT5
LAWS1 X IS "S"TS >GU$ T TR1TIES PRIM>ILY
AIM TO CODIFY CU/OM>Y LAW1 PUTT+ 9TO
WRIT+ ! NORMS ( 2HAVIOR ALR RECOGNIZ$
"333333
#G ,:ILE ! T]MS 8CU/OMS0 & 8NORMS0 H A
  TE*NICAL M1N+ 9 LAW1 ,I F9D X USE;L 9
  4CUSS+ NASC5T LAW TO TAKE A BROAD]
  VIEW ( ^! T]MS1 9CLUD+ _!
  AN?ROPOLOGICAL S5SES4 ,9 LEGAL
  AN?ROPOLOGY1 CU/OMS & LAWS 3/ITUTE A
  BROAD RANGE ( SOCIALLY OBS]VABLE RULES
  ( 3DUCT1 :ILE LAWS >E ^? RULES T C>RY
  SANC;NS IMPOS$ BY A 3TROLL+        #AJ
           .1,JUS .1NASCENDI       C#CGJ
  AU?OR;Y "<SEE ,LEOPOLD ,POSPISIL1 .7,!
  ,ATTRIBUTES ( ,LAW1.' 9 @#7,LAW &
  ,W>F>E3 ,/UDIES 9 ! ,AN?ROPOLOGY (
  ,3FLICT@#' #BE-#DA "<,PAUL ,BOHANNON
  $41 #AIFG">4 ,COMP>$ ) MO/ NA;NAL
  LEGAL SY/EMS1 9T]NA;NAL LAW REMA9S A
  PRIMITIVE SY/EM ( LAW1 ABS5T C5TRAL
  AU?ORITIES = LEGISLA;N1 5=CE;T1 &
  ADJUDICA;N1 DESPITE HAV+ "S LIMIT$
  9T]NA;NAL BODIES & CODIFICA;NS1
  P1CE-KEEP+ =CES1 & C\RTS4
------------------------------------#CGA
& ADOPT$ BY /ATES "? A PROCESS ( DCLG1
CRY/ALLIZ+1 & CODIFY+4 ,:ILE ? MAY 2
TRUE ( A BROAD RANGE ( 9T]NA;NAL LAW1 "!
>E CLE> 9/.ES 9 ,,IHL ": WRITT5 LAW HAS
EM]G$ SPECIFICALLY 2C ! WIDESPR1D
2HAVIOR ( /ATES RAN C.T] TO %>$ MORAL
S5SIBILITIES & COLLECTIVE 9T]E/S4 ,!
,G5EVA ,3V5;NS ( #AIDI & ! E/ABLI%;T ( !
,UNIT$ ,NA;NS /& Z CLE> EXAMPLES ": !
2HAVIORS ( /ATES _H FAIL$ TO E/ABLI%
A3EPTABLE NORMS "<Z MANIFE/ 9 ! HORRORS
( ,_W ,W> ,,II">1 & NEW              #AA
           .1,JUS .1NASCENDI       A#CGA
PRESCRIPTIVE 9T]NA;NAL LAW & REGULAT+
BODIES 7 DEEM$ NEC4
  ,:ILE CU/OMS & NORMS MAY 2 LAT5T 9 !
AC;NS ( /ATES1 !Y >E (T5 N DESCRIB$ OR
=MULAT$ 9 A S]I\S WAY UNTIL !Y 2COME A
MATT] ( LEGAL & POLITICAL 3C]N4
,SIMIL>LY1 ! D]IVA;N ( "ULY+ PR9CIPLES1
9CLUD+ ! WRIT+ ( 3V5;NS1 IS USUALLY
MOTIVAT$ BY "S MATT] ( DIPLOMATIC OR
LEGAL 3C]N4 ,AM;G ! PROXIMATE MOTIVA;NS
TO CR1TE NEW LAW WE MI<T ID5TIFY V>I\S
CAUSES1 9CLUD+1 B N LIMIT$ TO3 ! EM]G;E
( NEW 2HAVIORS BY /ATES OR NON/ATE
ACTORS1 ! RECOGNI;N OR EXPLOITA;N (
AMBIGUITIES OR 9CONSI/5CIES 9 ! EXI/+
LAW1 OR ! EM]G;E ( NEW TE*NOLOGIES T
TRANS=M ! CAPABILITIES1 2HAVIORS OR
E6ECTS ( AC;NS TAK5 BY /ATES S
DRAMATICALLY T !Y "UM9E BASIC ASSUMP;NS
( CU/OM>Y OR TR1TY LAW4 ,9 EA* CASE1 !
EXI/+ LAW C 2 SE5 Z FALL+ %ORT 9 XS
PURPOSE TO PROTECT ! COLLECTIVE 9T]E/S (
/ATES4
  ,"ULY+ ! :OLE BODY ( LAW1 &        #AB
           .1,JUS .1NASCENDI       B#CGA
"PICUL> EXPRES.NS ( LAW1 WE F9D MORAL;Y4
,"! >E1 ( C\RSE1 DI6]+ VIEWS ON ! RELA;N
( LAW & MORAL;Y1 Z WELL Z V>I\S LEGAL &
MORAL PHILOSOPHIES4 ,B "! IS A WIDELY
HELD 2LIEF T ! LAW AT L1/ AIMS TO
EXPRESS %>$ NORMS1 & T _M LEGAL NORMS
CO9CIDE ) MORAL NORMS4 ,/R;G] VIEWS HOLD
T ! MOTIVA;N & LEGITIMACY ( LAWS1 & %>$
NORMS1 D]IVE F _! BASIS 9 MORAL;Y4 ,X WD
2 WELL 2Y ! SCOPE ( ? *APT] TO ADDRESS !
V>I\S P]SPECTIVES ON ? F.DA;NAL "Q 9 !
PHILOSOPHY ( LAW4 ,=TUNATELY1 9 ! ,,IHL
3TEXT "! IS A L;G/&+ LEGAL CLAUSE T
EXPLICITLY REF]S TO MORAL;Y ,- ! ,M>T5S
,CLAUSE4

    #B4 ,,,! M>T5S CLAUSE
,! ,M>T5S ,CLAUSE IS "S"TS 9VOK$ 9
4>MA;T 3TEXTS 2C X REF]S EXPLICITLY TO !
PUBLIC 3SCI;E4 ,X ?US (F]S A M EXPLICIT
ROLE = PUBLIC OP9ION & ! REPRES5TATIVES
( CIVIL SOCIETY 9 ! MORAL ASSESS;T (
,,IHL4 ,_M LEGAL S*OL>S1 H["E1 WI% TO
RESI/ AN OV]LY BROAD R1D+ ( !        #AD
           .1,JUS .1NASCENDI       C#CGA
CLAUSE & SEEK TO LIMIT XS SCOPE TO A
M]ELY
------------------------------------#CGB
P]FUNCTORY RECOGNI;N ( CU/OM>Y LAW4
,REG>D.S ( "O'S VIEWS ON LEGAL
POSITIVISM1 NATURALISM & 9TEGR;Y1 X
SEEMS R1SONABLE TO VIEW ! LAW Z A HUMAN
3/RUCT T SEEKS TO 5ACT SOCIAL VALUES4 ,!
,M>T5S ,CLAUSE IS N ! ONLY PO9T ":
SOCIAL & MORAL VALUES WEI< ^U ,,IHL ,-
PROTECT+ HUMAN VALUES IS 9 "S VIEWS !
:OLE PO9T ( ,,IHL4 ,NOR IS ! ,M>T5S
,CLAUSE M]ELY AN AC"KL$G;T T CU/OMS &
PRACTICE C EMBODY NORMS1 EV5 IF !Y >E N
WRITT5 D[N4 ,A C>E;L R1D+ ( ! ,CLAUSE &
XS HI/ORY REV1LS "S?+ M 9T]E/+ & COMPLEX
?AN EI ( ^! A3.TS ( X4
  ,! ,M>T5S ,CLAUSE F/ APPE>$ 9 !
,PREAMBLE TO ! ,HAGUE ,3V5;N ,,II ON ,!
,LAWS & ,CU/OMS ( ,W> ON ,L& 9 #AHII4 ,X
HAS BE5 RE/AT$ 9 V>I\S =MS 9 AT L1/ ?REE
O!R 3V5;NS1 MO/ REC5TLY 9 ! #AIGG
,ADDI;NAL ,PROTOCOLS TO ! ,G5EVA
,3V5;NS4;9#H ,ORIG9ALLY PROPOS$ BY   #AE
           .1,JUS .1NASCENDI       A#CGB
,RUSSIAN DELEGATE TO ! ,HAGUE 3V5;N &
JURI/ ;,F4 ;,F4 DE ,M>T5S1 XS 9TRODUC;N
0 MOTIVAT$ BY 3C]NS OV] EXT5D+
HUMANIT>IAN LAW TO >M$ "PISANS 9 O3UPI$
T]RITORIES4;9#I ,AC TO ,M]ON1

  ,! CLAUSE HAS ANCI5T ANTEC$5TS ROOT$ 9
  NATURAL LAW & *IVALRY4 ,X IS >TICULAT$
  9 /R;G LANGUAGE1 BO? RHETORICALLY &
  E?ICALLY1 : GOES A L;G WAY T[>DS
  EXPLA9+ XS RESON.E & 9FLU;E ON ! =MA;N
  & 9T]PRETA;N ( ! LAW ( W> & 9T]NA;NAL
  HUMANIT>IAN LAW4;9#AJ

  ,9 XS V>I\S =MULA;NS X 2CAME M
EXPLICITLY CLE> T X EXPRESS$ ! NO;N T
E?ICAL 3SID]A;N = ! PR9CIPLES ( HUMAN;Y
& ! PUBLIC 3SCI;E %D PROVIDE A F.DA;N =
BO? CU/OM>Y & 3V5;NAL LAW4 ,9 XS MO/
REC5T =MULA;N1 ! ,M>T5S ,CLAUSE /ATES3
8,RECALL+ T1 9 CASES N COV]$ BY ! LAW 9
=CE1 ! HUMAN P]SON REMA9S "U ! PROTEC;N
( ! PR9CIPLES ( HUMAN;Y & ! DICTATES ( !
PUBLIC 3SCI;E40;9#AA                 #AF
           .1,JUS .1NASCENDI       B#CGB
  ,A COMMONLY HELD 9T]PRETA;N ( ! CLAUSE
IS T ACTS >E N LEGAL1 OR P]MISSIBLE1
SIMPLY 2C !Y >E N EXPLICITLY PROHIBIT$
BY ! LAW4 ,9 RECOGNI;N ( ! FACT T _M
ASPECTS ( CU/OM>Y LAW >E N EXPLICITLY
WRITT5 D[N1 "O _C ASSUME T "S?+ IS LEGAL
SIMPLY 2C "! IS NO?+ 9 A GIV5 TR1TY OR
3V5;N T PROHIBITS X4 ,? IS A R M9IMALI/
9T]PRETA;N ( ! CLAUSE1 H["E4
"333333
#H ,!ODOR ,M]ON1 .7,! ,M>T5S ,CLAUSE1
  ,PR9CIPLES ( ,HUMAN;Y1 & ,DICTATES (
  ,PUBLIC ,3SCI;E1.' @#7,AM4 ;,J4 ,9T'L4
  ;,L4@#' #GH-#HI "<#BJJJ">4
#I .1,ID4
#AJ .1,ID4
#AA ,ADDI;NAL ,PROTOCOL ,II TO ! ,G5EVA
  ,3V5;NS4

------------------------------------#CGC
  ,AT ! SAME "T T X RECOGNIZES ! /ATUS (
CU/OM>Y LAW1 ! ,M>T5S ,CLAUSE AL
AC"KL$GES T MORAL;Y 9 G5]AL1 & !
8PR9CIPLES ( HUMAN;Y & ! DICTATES    #AG
           .1,JUS .1NASCENDI       A#CGC
( ! PUBLIC 3SCI;E0 9 "PICUL>1 >E
LEGITIMATE S\RCES = NEW ,,IHL4 ,? IS AN
AC"KL$G;T ( TWO P>ALLEL MORAL F.DA;NS =
! PROTEC;N ( ! HUMAN P]SON )9 EXI/+ &
EM]G+ NORMS & CU/OMS4 ,"! >E V>I\S WAYS
WE MI<T UNPACK ! 3CEPTS ( ! 8PR9CIPLES (
HUMAN;Y0 & ! 8DICTATES ( ! PUBLIC
3SCI;E10 & X IS WOR? EXAM9+ "S ( ^!4
  ,! 8PR9CIPLES ( HUMAN;Y0 MI<T 2
>TICULAT$ Z ! PR9CIPLES D]IV$ F ! ,,UN
,DECL>A;N ( ,HUMAN ,"RS4 ,ALT]NATIVELY1
X MI<T 2 9T]PRET$ TO M1N A M AB/RACT SET
( MORAL PR9CIPLES T "UWRITE \R 3CEP;N (
HUMAN;Y1 & 7 "PIALLY "<& P]H
IMP]FECTLY"> CODIFI$ 9 ! ,,UN ,DECL>A;N
( ,HUMAN ,"RS4 ,T IS TO SAY T "! IS NO
SPECIFIC1 WRITT5 PR9CIPLE ( HUMAN;Y OR
SET ( PR9CIPLES1 B ^! >E EVID5T 9 %>$
NORMS1 & ! ,DECL>A;N ( ,HUMAN ,"RS
EXPLICITLY S"\ TO >TICULATE !M 9 A
CODIFI$ DOCU;T4 ,Z S*1 ^? PR9CIPLES EXI/
ANTEC$5TLY & 9DEP5D5TLY ( ! DOCU;T1 B >E
AL RE9=C$ "? T CODIFICA;N4 ,! PR9CIPLES
( HUMAN;Y MAY N 2 A PROP] PR9CIPLE   #AH
           .1,JUS .1NASCENDI       B#CGC
( LAW1 B R A SET ( MORAL PR9CIPLES T
C>RY LEGAL IMPLICA;NS4 ,Z ) O!R G5]AL
MORAL PR9CIPLES1 ! PR9CIPLES ( HUMAN;Y
>E PROBABLY BE/ ?"\ ( Z A HYBRID ( %>$
2LIEFS1 S5TI;TS1 & ATTEMPTS TO D]IVE
PR9CIPLES F NORMS ( 2LIEF & 2HAVIOR1 OR
CODIFY !M Z DECL>A;NS & 3V5;NS4 ,X AL
IMPLIES T ! "RS 5UM]AT$ 9 ! ,DECL>A;N (
,HUMAN ,"RS MI<T 2 9COMPLETE OR REQUIRE
FUR!R CL>IFICA;N 9 ! FUTURE4
  ,! 8DICTATES ( PUBLIC 3SCI;E0 MI<T AL
2 >TICULAT$ 9 V>I\S WAYS4 ,X IS "S"TS
CA/ Z 2+ R\<LY EQUIVAL5T TO 8PUBLIC
OP9ION10 B ? IS 4SATISFY+ = S"EAL
R1SONS4 ,F/1 WE M/ 3FRONT :AT WE "K AB
PUBLIC OP9ION F ! SOCIAL SCI;ES1 Z WELL
Z XS 2+ SUBJECT TO MANIPULA;N BY
/RATEGIC COMMUNICA;NS & PROPAG&A4 ,B WE
M/ AL RECOGNIZE ! MORALLY RELEVANT
DI6];ES 2T PUBLIC OP9ION & PUBLIC
3SCI;E4
  ,Z A MATT] ( EXP]TISE1 ! PUBLIC IS N
ALW WELL 9=M$ ON COMPLEX ISSUES1 S* Z
9T]NA;NAL LAW1 & LIKELY DOES N       #AI
           .1,JUS .1NASCENDI       C#CGC
HOLD ANY ANTEC$5T OP9ION ON >CANE MATT]S
) COMPLEX LEGAL IMPLICA;NS4 ,? IS N TO
SAY T ONLY ! WELL-9=M$ OR ^? TRA9$ 9
9T]NA;NAL LAW %D "PICIPATE 9 DET]M9+ !
PUBLIC 3SCI;E ON S* MATT]S4 ,9DE$1 S9CE
LEGAL OP9IONS C ALR 2 ASSUM$ TO 2
RELEVANT1 :AT MOTIVAT$ ! AU?ORS ( !
,M>T5S ,CLAUSE TO 9CLUDE ? PHRASE 0 TO
EMPHASIZE ! MORAL1 R ?AN LEGAL1 BASIS =
NORMS4 ,! PO9T IS T ! DICTATES ( PUBLIC
3SCI;E _C 2 R$UC$ TO LEGAL OP9IONS1 & T
MORAL 3SCI;E %D N REQUIRE SPECIAL
EXP]TISE4
------------------------------------#CGD
  ,TR1T+ ! PUBLIC 3SCI;E Z PUBLIC OP9ION
IGNORES :AT WE "K AB PUBLIC OP9ION F !
SOCIAL SCI;ES & COMMUNICA;NS RESE>*4 ,"S
H >GU$ T PUBLIC OP9ION HOLDS UNFAIR
PREJUDICES AG/ AUTONOM\S W1PONS DUE TO !
NEGATIVE PORTRAYAL ( KILL] ROBOTS 9
SCI;E FIC;N BOOKS & FILM4;9#AB ,:ILE
RESE>*]S H "UTAK5 C>E;L & OBJECTIVE
/UDIES ( PUBLIC OP9ION ON KILL] ROBOTS &
AUTONOM\S W1PONS1;9#AC X IS N CLE>   #BJ
           .1,JUS .1NASCENDI       D#CGC
T ? IS R1LLY ! SAME ?+ Z ! PUBLIC 3SCI;E
T ! AU?ORS ( ! ,M>T5S ,CLAUSE _H 9 M9D4
,:ILE AT BE/ PUBLIC OP9ION MI<T 3FIRM
:AT A M C>E;L REFLEC;N ON MATT]S (
3SCI;E REV1LS1 AT XS WOR/1 PUBLIC OP9ION
C 2 SUBJECT TO MANIPULA;N & PROPAG&A4
  ,9 PRES5T+ ! PUBLIC ) PO9T$ "QS &
SIMPLIFI$ EXAMPLES 9 ! ATTEMPT TO ELICIT
_! OP9ION1 Z IS D"O 9 SURVEY RESE>*1
ME?ODOLOGY C P[];LLY %APE ! EXPRES.N (
OP9ION 9 A S+LE /UDY4 ,X IS WELL "KN T !
*OICE ( "WS1 & EV5 ! ORD] ( PRES5T+ "QS1
C H SIGNIFICANT IMPACTS ON ! RESPONSES4
,CRITICAL /UDIES ( PUBLIC OP9ION H
DEMON/RAT$ ! 3CEPT XF TO 2 A SOCIAL
3/RUCT T S]VES PRIM>ILY TO COORD9ATE
POLITICAL COMMUNICA;NS4;9#AD ,!
COMMUNICA;NS 9DU/RY HAS DEPLOY$ ! SOCIAL
SCI;ES S Z TO DELIB]ATELY 3/RUCT PUBLICS
^: OP9IONS C 2 EASILY CATEGORIZ$ &
9FLU;ED4 ,? HAS 2COME AN >T & SCI;E =
PUBLIC RELA;NS PR(ES.NALS1 & XS
9FLU5TIAL P[] C 2 SE5 CLE>LY 9 COMM]CIAL
ADV]TIS+1 Z WELL Z 9 3TEMPOR>Y       #BA
           .1,JUS .1NASCENDI       E#CGC
,U4,S4 ELECTORAL POLITICS4 ,9 XS MO/
EXTREME =MS WE CALL ? MANIPULA;N
PROPAG&A1;9#AE B EV5 9 XS MILD] =MS X
2LIES ! FACT T PUBLIC OP9ION IS N ONLY
DYNAMIC1 B MALL1BLE & 3TROLLABLE TO "S
EXT5T4 ,Z S*1 WE "\ TO "Q PUBLIC
OP9ION'S CAPAC;Y TO S]VE Z ! MORAL
F.DA;N = NEW LAW1 EV5 Z WE 3T9UE TO USE
X Z A S\RCE = 9SI<T 9TO ! PUBLIC 3SCI;E4
  ,M FUNDA;TALLY1 83SCI;E0 HAS AN
EXPLICITLY MORAL 9FLEC;N T 8OP9ION0
LACKS4 ,? IMPLIES N M]ELY HOLD+ AN
OP9ION OR 2LIEF
"333333
#AB ,*>LI ,C>P5T]1 .7,! ,SKY,NET
  ,FACTOR3 ,F\R ,MY?S AB ,SCI;E ,FIC;N &
  ! ,KILL] ,ROBOT ,DEBATE1.' @#1,WA%4
  @#1,PO/1 ,SEPT4 #C1 #BJAF1 HTTPS3_/_/"
  WWW4WA%+TON-PO/4COM_/BLOGS_/MONKEY-"
  CAGE_/WP_/#BJAD_/#JI_/#JC_/!-SKYNET-"
  FACTOR-F\R-MY?S-AB-SCI;E-FIC;N-&-!-"
  KILL]-ROBOT-DEBATE_/4
#AC ,*>LI ,C>P5T]1 .7,H[ ,SC>$ ,>E ,P (
  8,KILL] ,ROBOTS0 & ,:Y ,DOES ,X    #BB
           .1,JUS .1NASCENDI       F#CGC
  ,MATT]8.' @#1,OP5 @#1,DEMOCRACY1 ,JULY
  #D1 #BJAD1 HTTPS3_/_/WWW4"
  OP5DEMOCRACY4NET_/*>LI-C>P5T]_/H[-"
  SC>$->E-P-(-.0;,E#B.0#HJ.0#I,CKILL]-"
  ROBOTS.0;,E#B.0#HJ.0#I;,D-&-:Y-DOES-"
  X-MATT]4
#AD ,NIKOLAS ,ROSE @& ,?OMAS ,OSBORNE1
  .7,D ! ,SOCIAL ,SCI;ES ,CR1TE
  ,PH5OM5A3 ,! ,CASE ( ,PUBLIC ,OP9ION
  ,RESE>*1.' #EJ @#7,BRIT4 ;,J4 ,SOC4@#'
  #CFG "<#AIII">4
#AE ,$W>D ,B]NAYS1 @#1,PROPAG&A
  "<#AIBH">4
------------------------------------#CGE
ON A MORAL ISSUE1 B ACTUALLY FEEL+
COMPELL$ BY1 OR 2LIEV+ 91 A SPECIFIC
MORAL OBLIGA;N OR DUTY4 ,T IS TO SAY1 "O
MAY FEEL ! WEI<T ( MORAL 3SCI;E EV5 :5
"O ACTS OR 2LIEVES AG/ X "<WE MAY EV5
FEEL X MO/ ACUTELY :5 VIOLAT+ X1 Z
REGRET">4 ,?US1 MORAL 3SCI;E IS N SIMPLY
A RESULT ( A MORAL DELIB]A;N ,- ! *OICE
( AC;N1 OR ULTIMATE 2LIEF OR OP9ION AB :
AC;N IS APPROPRIATE4 ,MORAL 3SCI;E   #BC
           .1,JUS .1NASCENDI       A#CGE
9CLUDES ! FELT =CES ( DUTY & OBLIGA;N1 &
! MORAL S5TI;TS ATTA*$ TO ! PROCESSES (
MORAL DELIB]A;N 9 _! TOTAL;Y4
  ,Z S* X IS A 4S]VICE TO R$UCE !
8DICTATES ( PUBLIC 3SCI;E0 TO M]E PUBLIC
OP9ION1 EV5 IF WE MI<T USE ! TOOLS ( !
SOCIAL SCI;ES TO DEVELOP 9SI<TS 9TO !
3T5TS ( ! PUBLIC 3SCI;E4 ,T 3T5T %D AL 2
ELICIT$ "? PUBLIC 4CUS.N1 Z WELL Z
ACADEMIC S*OL>%IP1 >TI/IC & CULTURAL
EXPRES.NS1 9DIVIDUAL REFLEC;N1
COLLECTIVE AC;N1 & ADDI;NAL M1NS1 BY :
SOCIETY DELIB]ATES XS COLLECTIVE MORAL
3SCI;E4 ,9DE$1 ! BE/ PLACE TO LOOK =
EM]G+ NORMS & ! DICTATES ( PUBLIC 3SCI;E
>E 9 ! PUBLIC =UMS 9 : /ATES &
9DIVIDUALS ATTEMPT TO GRAPPLE )1 &
>TICULATE T 3SCI;E4 ,T IS "O R1SON :Y X
IS S CRUCIALLY IMPORTANT T !
REPRES5TATIVES ( CIVIL SOCIETY H A VOICE
9 ^? =UMS1 & T ^? VOICES REPRES5T A
BROAD >RAY ( NA;NAL & 9DIVIDUAL
P]SPECTIVES4
                                     #BD
           .1,JUS .1NASCENDI       B#CGE

    #C4 ,,,A NASC5T PR9CIPLE ,- M1N+;L
    HUMAN 3TROL,'
,?REE KEY SETS ( 3C]NS H EM]G$ F !
4CUS.N ( :E!R TO REGULATE AUTONOM\S
W1PONS SY/EMS4 ,! F/ SET COMPRISES !
3C]NS OV] ! RISKS TO CIVILIANS T S*
W1PONS POSE4;9#AF ,! SECOND SET ( 3C]NS
9CLUDES ! IMPLICA;NS = HUMAN "RS & HUMAN
DIGN;Y F ! USE ( S* SY/EMS4;9#AG ,! ?IRD
SET RELATES TO ! 3C]NS OV] H[ AUTONOM\S
W1PONS MI<T TRANS=M ! USE ( VIOL5T =CE
"333333
#AF .1,SEE ,NOEL ,%>KEY1 .7,SAY+ 8,NO60
  TO ,LE?AL ,AUTONOM\S ,T>GET+1.' #I
  @#7;,J4 ,MIL4 ,E?ICS@#' #CFI
  "<#BJAJ">2 ,M>KUS ,WAGN]1 .7,TAK+
  ,HUMANS ,\ ( ! ,LOOP3 ,IMPLICA;NS =
  ,9T]NA;NAL ,HUMANIT>IAN ,LAW1.' #BA
  @#7;,J4 ;,L4 ,9FO4 @& ,SCI4@#'
  "<#BJAA">1 .1AVAILABLE .1AT HTTP3_/_/"
  PAP]S4SSRN4COM_/SOL#C_/PAP]S4CFM8"
  AB/RACT.-ID"7#AHGDJCI2 @#7,HUMAN ,"RS
  ,WAT*1 .1,LOS+ ,HUMAN;Y3 ,!        #BE
           .1,JUS .1NASCENDI       C#CGE
  ,CASE ,AG/ ,KILL] ,ROBOTS1.' @#7,HUM4
  ,RTS4 ,WAT* ,REP4@#' "<,NOVEMB] #AI1
  #BJAB">1 .1AVAILABLE .1AT HTTP3_/_/"
  WWW4HRW4ORG_/REPORTS_/#BJAB_/#AA_/"
  #AI_/LOS+-HUMAN;Y-#J4
#AG .1,SEE ,HUMAN "RS ,WAT*1 "<#BJAD">
  .7,%AK+ ! ,F.DA;NS3 ,! ,HUMAN ,"RS
  ,IMPLICA;NS ( ,KILL] ,ROBOTS1.'
  @#7,HUM4 ,RTS ,WAT* ,REP4@#' "<,MAY
  #AB1 #BJAD">1 .1AVAILABLE .1AT
  HTTP3_/_/WWW4HRW4ORG_/REPORTS_/"
  #BJAD_/#JE_/#AB_/%AK+-F.DA;NS2 ,*RI/(
  ,HEYNS1 "<#BJAD"> ,REPORT ( ! ,SPECIAL
  ,RAPPORTEUR ON ,EXTRAJUDICIAL1 ,SUMM>Y
  ,OR ,>BITR>Y ,EXECU;NS1 ^S#D1 ,! ,USE
  ( 8,LESS ,LE?AL0 & ,UNMANN$ ,W1PONS 9
  ,LAW ,5=CE;T1 ,U4,N4 ,DOC4
  ,A#FI_/#CCICH "<,JULY #CA1 #BJAD">4
------------------------------------#CGF
9 W>F>E 9 T]MS ( BO? ! PSY*OLOGICAL
RESPONSIBIL;Y TAK5 BY HUMANS 9 DECI.NS
TO USE =CE & ! LEGAL A3.TABIL;Y = 9T5D$
& UN9T5D$ 3SEQU;ES = ! USE ( S*
SY/EMS4;9#AH ,EA* SET ( 3C]NS IS     #BF
           .1,JUS .1NASCENDI       A#CGF
W>RANT$1 Z AUTONOM\S W1PONS SY/EMS
POT5TIALLY POSE S]I\S RISKS TO
CIVILIANS1 TO HUMAN "RS & DIGN;Y1 & TO !
PSY*OLOGY1 NORMS1 & LAWS GOV]N+
A3.TABIL;Y4 ,& :ILE EA* SET ( 3C]NS
IMPLIES A NE$ = SCRUT9IZ+ ! DEVELOP;T &
USE ( AUTONOM\S W1PONS SY/EMS1 !Y D S
"S:AT DI6]5TLY & SU7E/ DI6]5T TYPES (
NORMS4
  ON XS SURFACE1 ! 3C]NS OV] ! RISKS TO
CIVILIANS HOLDS AUTONOM\S W1PONS \ TO 2
ANALOG\S TO L&M9ES OR CLU/] MUNI;NS 9
T]MS ( ! POT5TIAL ( ^! W1PONS TO H
SIGNIFICANT & UN9T5D$ IMPACTS ON
CIVILIANS & CIVILIAN PROP]TY4 ,? 3C]N
L1DS _M TO CA/ ! C5TRAL "Q Z :E!R OR N
AUTONOM\S W1PONS C 2 US$ 9 3=M;Y ) EXI/+
,,IHL REQUIRE;TS4 ,9 "PICUL>1 "! IS A
3C]N Z TO :E!R AUTONOM\S W1PONS C 3=M TO
,>TICLE #EA ( ! #AIGG ,ADDI;NAL
,PROTOCOL ,I ( ! ,G5EVA ,3V5;NS ( #AIDI1
& XS REQUIRE;TS T W1PONS SY/EMS M* 2
CAPABLE ( 2+ US$ 9 A 4CRIM9ATE &
PROPOR;NATE MANN]4 ,T IS1 IF A NEW   #BG
           .1,JUS .1NASCENDI       B#CGF
W1PON IS .19TR9SICALLY 9CAPABLE (
4CRIM9ATE & PROPOR;NATE USE1 ? "\1 TO 2
RECOGNIZ$ 9 ! W1PONS REVIEW REQUIR$ BY
,>TICLE #CF ( ,,AP ,,II1 & X "\ N TO 2
FIELD$ OR US$4 ,S9CE ANY W1PON CD
POT5TIALLY 2 US$ 9 AN 9DISCRIM9ATE OR
4PROPOR;NATE MANN]1 T POT5TIAL IS N
SU6ICI5T TO PROHIBIT XS USE4 ,IF "! >E
CIRCUM/.ES 9 : ! USE WD 2 9DISCRIM9ATE
OR 4PROPOR;NATE1 _! USE "\ TO 2 RE/RICT$
TO ONLY ^? 3TEXTS & CIRCUM/.ES ": !Y C 2
US$ 9 COMPLI.E ) ,,IHL4 ,?US1 IF AN
AUTONOM\S W1PON 0 .19TR9SICALLY 9CAPABLE
( 2+ 4CRIM9ATE & PROPOR;NATE1 X WD 2
PROHIBIT$ 9 ,,IHL2 O!RWISE1 X MI<T 2
P]MISSIBLE IF X 7 US$ 9 SITUA;NS &
3TEXTS ": XS E6ECTS 7 4CRIM9ATE &
PROPOR;NATE4
  ,UNGUID$ MISSILES >E AN EXAMPLE (
W1PONS T C 2 ASSESS$ Z 4CRIM9ATE OR
9DISCRIM9ATE1 DEP5D+ ON ! CIRCUM/.ES4
,LACK+ GUID.E SY/EMS1 MO/ EXP]TS 2LIEVE
S* MISSILES _C 2 US$ 4CRIM9ATELY 9
POPULAT$ >1S4;9#AI ,!Y >E N          #BH
           .1,JUS .1NASCENDI       C#CGF
PROHIBIT$ ALT1
"333333
#AH .1,SEE ,ROB]T ,SP>R[1 .1,KILL]
  .1ROBOTS1 #BD @#7;,J4 ( ,APPLI$
  ,PHIL4@#' #FB "<#BJJG">2 ,AS>O1
  .1SUPRA2 ,HUMAN ,"RS ,WAT*1 .7,LOS+
  ,HUMAN;Y1 SUPRA4.'
#AI ,SEE3 ,9T]NA;NAL ,COMMITTEE ( ! ,R$
  ,CROSS1 .1,CU/OM>Y .1,,IHL1 ,RULE #AB
  8,DEF9I;N ( ,9DISCRIM9ATE ,ATTACK0 &
  ,RULE #GA 8,W1PONS T >E ,BY ,NATURE
  ,9DISCRIM9ATE10 .1AVAILABLE .1AT
  HTTPS3_/_/WWW4ICRC4ORG_/CU/OM>Y-IHL_/"
  5G_/DOCS_/V#B.-RUL.-RULE#AB &
  HTTPS3_/_/WWW4ICRC4ORG_/CU/OM>Y-IHL_/"
  5G_/V#B.-RUL.-RULE#GA2 ,MAYA ,BREHM1
  ,UNA3EPTABLE ,RISK3 ,USE ( ,EXPLOSIVE
  ,W1PONS 9 ,POPULAT$ ,>1S "? ! ,L5S (
  ,?REE ,CASES 2F ! ,,ICTY1 ,,PAX
  @#1,REPORT "<,OCTOB] #BJAD">1
  AVAILABLE AT HTTP3_/_/WWW4PAXVOORVR$E"
  ;4NL_/M$IA_/FILES_/PAX-RAPPORT-"
  UNA3EPTABLE-RISK4PDF4
                                     #BI
           .1,JUS .1NASCENDI        #CGG
H["E1 Z "! >E 3TEXTS 9 : !Y MI<T 2 US$
": !Y D N POSE ANY RISK TO CIVILIANS 2C
"! >E NO CIVILIANS 9 ! VIC9;Y ( ! T>GET$
>EA4 ,( C\RSE1 9 A HI<LY RE/RICT$
5VIRON;T1 MEET+ SU6ICI5T 3DI;NS1 "<E4G41
A L>GE 5 >EA O3UPI$ EXCLUSIVELY BY 5EMY
COMBATANTS & _! EQUIP;T"> !N X MAY 2
POSSIBLE TO CLAIM T ANY W1PON CD 2 US$ )
"S DEGREE ( 4CRIM9A;N & PROPOR;NAL;Y4 ,?
WAS1 9 FACT1 ! >GU;T MADE 9 DEF5SE ( !
A3EPTABIL;Y ( CLU/] MUNI;NS ,- !Y CD 2
US$ 9 C]TA9 WAYS 9 C]TA9 SITUA;NS 9 : !Y
D N H 9DISCRIM9ATE OR 4PROPOR;NATE
E6ECTS4 ,T >GU;T 0 C.T]$ ) EVID;E F !
ACTUAL USE ( ^! W1PONS1 : DEMON/RAT$ !
P]SI/5T E6ECTS ( UNEXPLOD$ MUNI;NS ON
CIVILIANS & ! ONGO+ DANG]S T !Y POS$ L;G
AF AN ATTACK & EV5 L;G AF ! 3FLICT4;9#BJ
  ,_M ( ! CRITICS ( 4>MA;T PROPOSALS
DIRECT$ AT AUTONOM\S W1PONS >GUE T !
RISKS TO CIVILIANS >E UN"KN1 & T "! MAY
2 B5EFITS TO CIVILIANS 9 T]MS ( L[]$
RISK IF S* TE*NOLOGIES >E ALL[$ TO 2
DEVELOP$4;9#BA ,^! CRITICS >E "R     #CJ
           .1,JUS .1NASCENDI       A#CGG
TO ID5TIFY ! IMPORT.E ( ! NORMS & 3V5;NS
T REQUIRE ! 4CRIM9ATE & PROPOR;NATE USE
( =CE1 & ! PROTEC;N ( CIVILIANS4 ,!Y >E
WR;G H["E1 9SOF> Z !Y ATTEMPT TO LIMIT !
3C]NS OV] AUTONOM\S W1PONS TO ONLY ^!
NORMS & TO 9T]PRET !M Z /RICTLY IMPLY+ A
UTILIT>IAN CALCULUS ( RISK M9IMIZA;N ,-
: IS ONLY "O ASPECT ( _!
"333333
#BJ ,BRIAN ,RAPP]T ET AL41 ,! ,ROLE (
  ,CIVIL ,SOCIETY 9 ! ,DEVELOP;T (
  ,/&>DS >.D ,NEW ,W1PONS & ,O!R
  ,TE*NOLOGIES ( ,W>F>E1 #IF @#7,9T'L
  ,REV ,R$ ,CROSS@#' #GFE "<#BJAB">4
#BA .1,SEE @#7,RONALD ;,C4 ,>K91 ,GOV]N+
  ,LE?AL ,2HAVIOR 9 ,AUTONOM\S
  ,ROBOTS@#' "<#BJJI">2 @#7,WILLIAM
  ,BOO?BY1 ,W1PONS & ! ,LAW ( ,>M$
  ,3FLICT@#' "<#BJJI">2 ,G>Y ,M>*ANT ET
  ;;AL41 .7,9T]NA;NAL ,GOV]N.E (
  ,AUTONOM\S ,MILIT>Y ,ROBOTS1.'
  @#7,COLUM4 ,SCI4 @& ,TE*4 ;,L4
  ,REV4@#' "<,DEC4 #CJ1 #BJAJ">1
  .1AVAILABLE .1AT HTTP3_/_/SSRN4"   #CA
           .1,JUS .1NASCENDI       B#CGG
  COM_/AB/RACT"7#AGGHDBD2 ,K5NE? ,&]SON
  @& ,MAT!W ;,C4 ,WAXMAN1 .7,LAW &
  ,E?ICS = ,ROBOT ,SOLDI]S1.' @#1,POL'Y
  @#1,REV4 "<,APRIL #BH1 #BJAB">1
  .1AVAILABLE .1AT HTTP3_/_/SSRN4COM"
  _/AB/RACT"7#BJDFCGE2 ,MI*AEL ;,N4
  ,S*MITT @& ,JE6REY ;,S4 ,?URN]1 .7,\ (
  ! ,LOOP3 ,AUTONOM\S ,W1PON ,SY/EMS & !
  ,LAW ( ,>M$ ,3FLICT1.' @#7,H>V4 ,NAT'L
  ,SECUR;Y ;,J4@#' #BCA "<#BJAC">2 ,M>CO
  ,SASSOLI1 .7,AUTONOM\S ,W1PONS &
  ,9T]NA;NAL ,HUMANIT>IAN ,LAW3
  ,ADVANTAGES1 ,OP5 ,TE*NICAL ,"QS &
  ,LEGAL ,ISSUES TO 2 ,CL>IFI$1.'
  @#7,9T'L4 ;,L4 ,/UD4 _/ ,NAVAL ,W>
  ,COLLEGE@#' #IJ1 #CJH "<#BJAD">2
  ,K5NE? ,&]SON ET4 ;;AL4 .7,ADAPT+ !
  ,LAW ( ,>M$ ,3FLICT TO ,AUTONOM\S
  ,W1PONS1.' @#7,9T'L4 ;,L4 ,/UD4@#'
  "<#BJAD">4
------------------------------------#CGH
9T5T & 9T]PRETA;N4 ,MOREOV]1 ? VIEW
FAILS TO 3SID] H[ EM]G+ TE*NOLOGIES MI<T
DE/ABILIZE NORMS 9 POT5TIALLY        #CB
           .1,JUS .1NASCENDI       A#CGH
H>M;L WAYS1 "PICUL>LY 9 T]MS (
A3.TABIL;Y4
  ,"! AL IS AN EXTREME VIEW T ! ONLY
PURPOSE ( ,,IHL IS TO TRY TO R$UCE !
RISK TO CIVILIANS 9 W>4 ,B ! V>I\S
PROVI.NS ( ,,IHL T APPLY ONLY TO
COMBATANTS ,- F RULES REGULAT+ SURR5D] &
PRISON]S ( W> TO ! TR1T;T ( SICK1 9JUR$1
& EV5 DEC1S$ COMBATANTS ,- MAKE S* A
VIEW UNT5ABLE4 ,A SLI<TLY LESS EXTREME
VIEW HOLDS T ! GOAL ( ,,IHL IS TO
PROTECT AN ESS5TIAL CORE ( HUMAN;Y1 EV5
AM;G ! GRT 9HUMAN;Y ( W> ,- : BR+S U
BACK TO ! 8PR9CIPLES ( HUMAN;Y0 9 !
,M>T5S ,CLAUSE4 ,A BROAD] VIEW HOLDS T
,,IHL HAS _M AIMS1 N ALL ( : >E R$UCIBLE
TO RISK M9IMIZA;N OR PRES]V+ ! PR9CIPLES
( HUMAN;Y1 B T ^? AIMS M/ N SUP]C$E !
PR9CIPLES ( HUMAN;Y4
  ,MOREOV]1 Z ,9 H >GU$ 2F1;9#BB EXI/+
,,IHL IMPOSES SPECIFIC REQUIRE;TS ON
DECI.N-MAK]S1 :O >E AT L1/ IMPLICITLY
HUMAN4 ,X IS AT BE/ AMBIGU\S :AT X WD
M1N TO REPLACE T DECI.N-MAK+ )       #CC
           .1,JUS .1NASCENDI       B#CGH
NONHUMAN COMPUT]S & PROGRAMS ,- EV5 ?\<
!Y >E ! CR1;NS ( HUMANS4 ,"! MAY1 9
FACT1 2 MORAL & LEGAL PROHIBI;NS ON
DELEGAT+ S* DECI.N-MAK+ TO AUTOMATIC
SY/EMS4 ,AT ! V L1/1 EXI/+ CU/OMS &
NORMS1 Z WELL Z WRITT5 3V5;NS GOV]N+
DECI.NS TO USE VIOL5T =CE ALL ASSUME
HUMAN DECI.N-MAK+4 ,^! NORMS1 & !
9T]PRETA;N ( EXI/+ LAWS1 >E CALL$ 9TO "Q
:5 HUMAN DECI.N-MAK+ IS REPLAC$ )
AUTOMAT$ PROCESSES4 ,! NORMS T GOV]N !
REQUIRE;TS ( TAK+ RESPONSIBIL;Y = COMM&
DECI.NS1 & HOLD+ 9DIVIDUALS & /ATES
RESPONSIBLE = ! 3SEQU;ES ( _! DECI.NS1
>E C]TA9LY A MATT] ( 3C]N 9 ! DEVELOP;T
& USE ( AUTONOM\S W1PONS4 ,9 ORD] = !
DECI.NS TO USE =CE TO C.T Z LEGAL
DECI.NS OR MORAL DECI.N1 !Y M/ 2 !
3SID]$ JUDG;TS ( A HUMAN 9 A GIV5
SITUA;N1 ASSESS+ ! AVAILABLE 9=MA;N4 ,AN
AUTOMAT$ PROCESS DESIGN$ 9 ADV.E1 BAS$
ON S5SOR DATA1 IS NEI A LEGAL JUDG;T NOR
A MORAL JUDG;T4 ,SIMIL>LY1 RULES (
5GAGE;T >E N DECI.NS TO 5GAGE OR     #CD
           .1,JUS .1NASCENDI       C#CGH
USE =CE ,- R !Y >E GUID.E TO HUMAN
DECI.N-MAK]S :O W ULTIMATELY MAKE ^?
DECI.NS & C>RY ! RESPONSIBIL;Y = !M4
  ,:5 ?9K+ AB NEW LAW1 X IS HELP;L TO
3SID] ! NATURE ( NORMS & H[ !Y 9=M LAW4
,? IS "S:AT *ALL5G+ :5 3SID]+ NEW
TE*NOLOGIES1 ESPECIALLY ^? T H !
POT5TIAL TO GRTLY 4RUPT EXI/+ PRACTICES4
,PHILOSOPH]S VIEW NORMS Z 3CEPTS
"333333
#BB ,AS>O1 .1SUPRA4

------------------------------------#CGI
T IMPLY OBLIGA;NS T[>D AC;NS ,- P]MIS.NS
OR PROHIBI;NS ON C]TA9 AC;NS4 ,9 !
SOCIAL SCI;ES1 9CLUD+ LEGAL
AN?ROPOLOGY1;9#BC SOCIAL NORMS >E 3CVD Z
PATT]NS ( SOCIAL 2HAVIOR T1 9 VIRTUE (
2+ RELIABLY OBS]VABLE PATT]NS1 MANIFE/
AN "ULY+ SET ( %>$ 2LIEFS AB !
A3EPTABIL;Y ( C]TA9 =MS ( 2HAVIOR4
,9T]NA;NAL LAW COMB9ES ! 3CEPT ( A 2LIEF
TO ACT AC TO OBLIGA;N TGR ) ^! OBS]VABLE
PATT]NS ( 2HAVIOR4 ,?US1 ! /&>D      #CE
           .1,JUS .1NASCENDI       A#CGI
VIEW ( CU/OM>Y LAW IS T CU/OMS M/ 2
RECOGNIZ$ 9 ! 3SI/5T AC;NS ( A
SIGNIFICANT NUMB] ( /ATES BAS$ ON 2LIEFS
T "! IS AN OBLIGA;N TO S ACT1 & N 2
REJECT$ OR IGNOR$ BY A SIGNIFICANT NUMB]
) /ATES1 OR SPECIALLY 9T]E/$ /ATES4
  ,M SPECIFICALLY1 ,>TICLE #BA ( ! ,ROME
,/ATUTE ( ! ,9T]NA;NAL ,C\RT ( ,JU/ICE
REFLECTS :AT >E WIDELY 3SID]$ TO 2 ! F\R
=MAL S\RCES ( 9T]NA;NAL LAW3 3V5;NS1
CU/OMS1 G5]AL PR9CIPLES1 &1 Z A
SUBSIDI>Y S\RCE1 JUDICIAL DECI.NS4;9#BD
,>TICLE #EC ( ! ,VI5NA ,3V5;N ON ! ,LAW
( ,TR1TIES FUR!R 4T+UI%ES A SPECIAL
CLASS ( NORMS Z P]EMPTORY NORMS ,- ^? T
_C 2 D]OGAT$4;9#BE ,( C\RSE1 "! IS NO
DEF9ITIVE LI/ ( : NORMS >E P]EMPTORY1
NOR IS "! A DEF9ITIVE LI/ ( G5]AL
PR9CIPLES OR ( CU/OMS4 ,3V5;NS >E
"333333
#BC ,POSPISIL1 .1SUPRA4
#BD ,>TICLE #BA R1DS3
  8#A4 ,! ,C\RT % APPLY3
  "<A"> ,9 ! F/ PLACE1 ? ,/ATUTE1    #CF
           .1,JUS .1NASCENDI       B#CGI
  ,ELE;TS ( ,CRIMES & XS ,RULES (
  ,PROC$URE & ,EVID;E2
  "<;B"> ,9 ! SECOND PLACE1 ":
  APPROPRIATE1 APPLICABLE TR1TIES & !
  PR9CIPLES & RULES ( 9T]NA;NAL LAW1
  9CLUD+ ! E/ABLI%$ PR9CIPLES ( !
  9T]NA;NAL LAW ( >M$ 3FLICT2
  "<;C"> ,FAIL+ T1 G5]AL PR9CIPLES1 (
  LAW D]IV$ BY ! ,C\RT F NA;NAL LAWS (
  LEGAL SY/EMS ( ! _W 9CLUD+1 Z
  APPROPRIATE1 ! NA;NAL LAWS ( ,/ATES T
  WD NORMALLY EX]CISE JURISDIC;N OV] !
  CRIME1 PROVID$ T ^? PR9CIPLES >E N
  9CONSI/5T ) ? ,/ATUTE & ) 9T]NA;NAL
  LAW & 9T]NA;NALLY RECOGNIZ$ NORMS &
  /&>DS4
  #B4 ,! ,C\RT MAY APPLY PR9CIPLES &
  RULES ( LAW Z 9T]PRET$ 9 XS PREVI\S
  DECI.NS4
  #C4 ,! APPLICA;N & 9T]PRETA;N ( LAW
  PURSUANT TO ? >TICLE M/ 2 3SI/5T )
  9T]NA;NALLY RECOGNIZ$ HUMAN "RS1 & 2
  )\T ANY ADV]SE 4T9C;N F.D$ ON GR.DS S*
  Z G5D] Z DEF9$ 9 >TICLE #G1        #CG
           .1,JUS .1NASCENDI       C#CGI
  P>AGRAPH #C1 AGE1 RACE1 COL\R1
  LANGUAGE1 RELIGION OR 2LIEF1 POLITICAL
  OR O!R OP9ION1 NA;NAL1 E?NIC OR SOCIAL
  ORIG91 W1L?1 BIR? OR O!R /ATUS40
  .1,AVAILABLE .1AT HTTP3_/_/WWW4ICC-"
  CPI49T_/NR_/RDONLYRES_/EA#I;AEFF#G-"
  #EGEB-#D;F#HD-BE#ID-#J;A#FEE;EB#CJ;E"
  #AF_/#J_/ROME.-/ATUTE.-5GLI%4PDF4
#BE ,AM;G ! G5]ALLY A3EPT$ P]EMPTORY
  NORMS >E PROHIBI;NS ON G5OCIDE1
  TORTURE1 SLAV]Y1 & PIRACY4
------------------------------------#CHJ
G5]ALLY 3CVD ( Z WRITT5 CODIFICA;NS (
CU/OMS & G5]AL PR9CIPLES4 ,Z S*1 !Y D
ATTEMPT TO DEF9E NORMS & PR9CIPLES1 ?\<
!Y RECOGNIZE _! ON LIMITA;NS 9 DO+ S1 Z
! ,M>T5S ,CLAUSE XF MAKES CLE>4 ,TR1TIES
>E SE5 Z 9/RU;TS T IMPOSE RE/RIC;NS ON !
2HAVIOR ( /ATES T WD N O!RWISE 2
RE/RICT$ "U CU/OM OR 3V5;N1 B >E LIMIT$
9 T !Y / _C D]OGATE P]EMPTORY
NORMS4;9#BF
  ,9 XS MO/ AB/RACT =M1 TE*NOLOGY IS
SIMPLY A SY/EM ( SKILLS1 TOOLS1 &    #CH
           .1,JUS .1NASCENDI       A#CHJ
PRACTICES4;9#BG ,! 9TRODUC;N ( ANY NEW
TE*NIQUES1 SKILLS1 OR TE*NOLOGICAL TOOLS
NECESS>ILY IMPLIES A TRANS=MA;N 9
PRACTICES1 :E!R AT ! LEVEL ( 9DIVIDUAL
TASKS OR AT ! LEVELS ( TASK MANAGE;T OR
9/ITU;NAL ORGANIZA;N4 ,! "Q IS :E!R ^!
TRANS=MA;NS 3=M TO EXI/+ NORMS1 OR
*ALL5GE ^! NORMS4 ,M PRECISELY1 "! >E
F\R POSSIBILITIES3

"<#A"> ,EXI/+ NORMS MAY 3T9UE TO GOV]N
  PRACTICES AF ! 9TRODUC;N ( A NEW
  TE*NOLOGY1 L>GELY UN*ANG$4
"<#B"> ,EXI/+ NORMS MAY 2 DIM9I%$ OR
  4SOLV$ AF ! 9TRODUC;N ( A NEW
  TE*NOLOGY4
"<#C"> ,NEW NORMS MAY EM]GE TO GOV]N !
  PRACTICES AF ! 9TRODUC;N ( A NEW
  TE*NOLOGY4
"<#D"> ,EXI/+ NORMS MAY 2 TRANS=M$ OR
  RECONCEIV$4

  ,:5 3SID]+ ! NORMS GOV]N+ NEW
TE*NOLOGIES1 WE >E PRES5T$ ) A       #CI
           .1,JUS .1NASCENDI       B#CHJ
*ICK5-&-EGG PROBLEM4 ,IF WE H N YET
IMPLE;T$ A NEW TE*NOLOGY1 WE _C OBS]VE
:AT ! NEW NORMS >E "<IF WE LIMIT NORMS
TO ALR-RECOGNIZ$ & A3EPT$ 2HAVIOR">4 ,WE
C EXAM9E EXI/+ NORMS & TRY TO DET]M9E IF
! USE ( A NEW TE*NOLOGY WD *ALL5GE OR
VIOLATE ^? NORMS4 ,IF S1 WE MI<T TRY TO
REGULATE T TE*NOLOGY & TRY TO 5SURE T !
NORM REMA9S 9 E6ECT4 ,OR WE MI<T F9D
"333333
#BF ,?US1 A GR\P ( /ATES CD N =M A TR1TY
  ORGANIZA;N TO P]MIT !MVS TO 3DUCT
  G5OCIDE1 TORTURE1 SLAV]Y1 OR PIRACY ,-
  OR AT L1/ S* A TR1TY WD N 2 A3EPT$ Z
  REMOV+ ^? /ATES F RESPECT+ ! 9T]NA;NAL
  NORMS PROHIBIT+ ^!4
#BG ,9 ANCI5T ,GREEK1 .1TE*NE M1NT !
  P]=M.E ( A CRAFT1 :AT 9 MOD]N ,5GLI%
  WE MI<T CALL TE*NIQUE4 ,( C\RSE !
  P]=M.E AL REQUIRES ! USE ( ! BODY &
  TOOLS1 & 9 MOD]N ,5GLI% WE (T5 USE
  8TE*NOLOGY0 TO REF] TO SOPHI/ICAT$
  TOOLS4 ,YET ) SOPHI/ICAT$ TE*NOLOGIES1
  S* Z COMPUT]S1 WE >E R1LLY 3C]N$   #DJ
           .1,JUS .1NASCENDI       C#CHJ
  ) _! P]=M.E1 : 5TAILS ! PRACTICE (
  SKILLS Z WELL Z ! FUNC;NAL;Y ( !
  TOOLS4 ,?US1 WE %D ?9K ( TE*NOLOGIES Z
  3SI/+ ( ! FUNC;N ( MAT]IAL TOOLS & !
  SKILL$ PRACTICES ( P 9 3JUNC;N1 Z WELL
  Z _! SY/EMATIC ORGANIZA;N4
------------------------------------#CHA
T X DOES N VIOLATE ^? NORMS1 & S WE %D N
NE$ TO REGULATE X1 & ! EXI/+ NORMS "\ TO
2 SU6ICI5T UNTIL PROV5 O!RWISE4 ,B "! >E
FUR!R POSSIBILITIES4 ,WE MI<T F9D1 AF A
TE*NOLOGY IS ADOPT$1 T NEW SETS (
PRACTICES EM]GE1 FOLL[$ BY NEW
NORMS4;9#BH ,WE MAY AL F9D T !
CAPABILITIES ( A NEW TE*NOLOGY ACTUALLY
MANIFE/ SITUA;NS 9 : WE RECOGNIZE NORMS
T _H ALW BE5 TACITLY ASSUM$1 B N"E
>TICULAT$ OR CODIFI$ 2C X 0 PREVI\SLY
UNNEC4
  ,R ?AN FRAM+ ! CURR5T DEBATE OV]
AUTONOM\S W1PONS Z A UTIL;Y CALCULA;N T
WEI<S ! POT5TIAL RISKS ( A NEW TE*NOLOGY
AG/ XS POT5TIAL B5EFITS1 X WD 2 BETT] TO
VIEW X Z A "Q ( H[ WE MI<T BE/       #DA
           .1,JUS .1NASCENDI       A#CHA
REGULATE ? NEW CLASS ( TE*NOLOGIES1 :
MI<T TAKE _M =MS & H V>I\S SORTS (
CAPABILITIES T *ALL5GE EXI/+ NORMS4 ,T
IS1 :ILE AUTONOM\S W1PONS D POSE _M
OBVI\S RISKS1 X WD 2 DI6ICULT TO
REGULATE OR MITIGATE ^! BAS$ ON
CAPABILITIES T >E Z YET UN"KN4 ,R1 X
MAKES S5SE TO FOCUS ON ! NORMS T W 2
*ALL5G$ OR VIOLAT$ BY ? NEW TE*NOLOGY &
TO TRY TO DET]M9E H[ BE/ TO PROTECT ^?
NORMS F 2+ "UM9$1 OR /R5G!N !M R ?AN
ALL[ !M TO 2 DIM9I%$ BY EM]G+ PRACTICE4
,2C ( ! NEW CAPABILITIES ^! TE*NOLOGIES
W BR+1 X IS AL IMPORTANT TO 3SID] :AT
NASC5T NORMS MAY 2 9 PLACE T H N
PREVI\SLY BE5 RECOGNIZ$ OR >TICULAT$ 2C
! NE$ _H N PREVI\SLY >IS54
  ,9 ! CASE ( AUTONOM\S W1PONS1 :AT IS
R1LLY NEW IS ! AUTOMATIC SELEC;N (
T>GETS Y DECI.NS TO USE VIOL5T =CE AG/
^? T>GETS4 ,:ILE ,S*>RE;9#BI & O!RS H
PO9T$ \ T "! >E V>I\S W1PONS SY/EMS ALR
9 USE T H SIMPLE IMPLE;TA;NS ( ^!
CAPABILITIES1 X IS N AT ALL          #DB
           .1,JUS .1NASCENDI       B#CHA
OBVI\S T ! PRACTICES & NORMS GOV]N+ !
USE ( CURR5T SY/EMS W ADEQUATELY SCALE
TO ! SOPHI/ICA;N & COMPLEX;Y T ROBOTIC &
AUTONOM\S W1PONS SY/EMS APPE> POIS$ TO
A*IEVE 9 ! COM+ YE>S & DECADES4 ,&]SON &
,WAXMAN;9#CJ AGREE T NEW PRACTICES &
NORMS M/ EM]GE TO GOV]N ^! NEW
TE*NOLOGIES1 B WD R SEE ? LEFT TO !
PROCESSES ( SELF-REGULA;N & ! 4SEM9A;N (
BE/ PRACTICES & S(T LAW4 ,S ! DEBATE IS
N :E!R NEW NORMS W EM]GE1 B ": !Y %D
COME F1 H[
"333333
#BH ,AM;G ^! >E 8BE/ PRACTICES0 & O!R
  =MS ( S(T LAW4
#BI ,PAUL ,S*>RE1 @#7,ROBOTICS ON !
  ,BATTLEFIELD1 ,"P ,I3 ,RANGE1 ,P]SI/;E
  & ,D>+1@#' ,C5T] = ,NEW ,AM]ICAN
  ,SECUR;Y ,REPORT1 #DG "<,MAY #BJAD">1
  .1AVAILABLE .1AT HTTP3_/_/CNAS4ORG_/"
  SITES_/DEFAULT_/FILES_/PUBLICA;NS-PDF"
  _/,,CNAS.-,ROBOTICS"ON,!,BATTLEFIELD"
  .-,S*>RE4PDF4
#CJ ,&]SON @& ,WAXMAN1 .1SUPRA4      #DC
           .1,JUS .1NASCENDI        #CHB

!Y %D 2 >TICULAT$1 :O %D >TICULATE !M1 &
:E!R & ": !Y %D 2 CODIFI$4
  ,9 4CUSS+ ^! ISSUES 9 V>I\S =A OV] !
PA/ FEW YE>S1 :AT SEEMS 9CR1S+LY CLE> IS
T "! >E "S NASC5T NORMS & PR9CIPLES
REG>D+ AUTONOM\S W1PONS T >E WIDELY %>$
& T >E 2G9N+ TO TAKE %APE4 ,:AT EM]G$ F
! 4CUS.NS AT ! ,EXP]TS ,MEET+ 3V5$ BY !
,3V5;N ON ,C]TA9 ,3V5;NAL ,W1PONS AT !
,UNIT$ ,NA;NS 9 ,G5EVA 9 ,MAY (
#BJAD1;9#CA 0 A GR[+ 3V]G;E T[>D A NEW
NORM OR PR9CIPLE1 T ( 8M1N+;L HUMAN
3TROL40 ,"! REMA9S "S 4AGREE;T & 3FU.N1
AT L1/ 9 T]M9OLOGY1 OV] ! V>I\S DEF9I;NS
( AUTOMATIC1 AUTONOM\S1 & ! NATURE (
9T5;N1 AG5CY & RESPONSIBIL;Y 9 HI<LY
AUTOMAT$ & AUTONOM\S SY/EMS4 ,YET
DESPITE ? T]M9OLOGICAL 4AGREE;T1 "! 0
BROAD-BAS$ AGREE;T T MILIT>Y ATTACKS & !
USE ( VIOL5T =CE 9 W> %D ALW 2 KEPT "U
M1N+;L HUMAN 3TROL4 ,:AT EXACTLY
3/ITUTES M1N+;L HUMAN 3TROL1 & H[ TO
EVALUATE :E!R A GIV5 W1PONS SY/EM    #DD
           .1,JUS .1NASCENDI       A#CHB
3=MS TO A POSSIBLE REQUIRE;T = X1 >E
MATT]S T REMA9 TO 2 >TICULAT$4
  ,H["E1 X SEEMS Q CLE> T WE H "S?+ T
LOOKS V M* L AN EM]G5T PR9CIPLE4 ,X IS
DI6ICULT TO CALL ? A NORM PROP]1 EV5 ?\<
X IS ! CASE T /ATES CURR5TLY D ACT S Z
TO KEEP W1PONS "U M1N+;L HUMAN 3TROL4 ,X
IS LESS CLE> :E!R !Y ACTUALLY 2LIEVE T
!Y H A %>$ OBLIGA;N TO D S4 ,T 2LIEF &
OBLIGA;N MI<T EM]GE 9 ! FUTURE Z
PRACTICES DEVELOP >.D NEW AUTONOM\S
W1PONS TE*NOLOGIES4 ,B X IS AL POSSIBLE
T S* A NORM MI<T N EM]GE 9 PRACTICE 9 !
ABS;E ( REGULA;NS OR GUIDEL9ES4 ,! R1L
RISK H1 F A MORAL & LEGAL P]SPECTIVE1 IS
T PRACTICES BAS$ 9 POLITICAL & MILIT>Y
EXP$I5CY MI<T GIVE RISE TO W1K NORMS ,-
OR NO NORMS AT ALL ,- & ! USE ( W1PONS
)\T ANY M1N+;L HUMAN 3TROL MAY 2COME
A3EPTABLE Z A .1DE .1FACTO NORM4 ,9 T
CASE1 WE MI<T F9D \RVS 9 A _W ": ! RISK
( UN9T5D$ 3SEQU;ES "<OR ! ABIL;Y TO
/RATEGICALLY OBSCURE "O'S 9T5;NS"> 9 US+
S* W1PONS IS SUB/ANTIAL1 :ILE !      #DE
           .1,JUS .1NASCENDI       B#CHB
RESPONSIBIL;Y & A3.TABIL;Y = S* USE BY
/ATES & 9DIVIDUALS IS LIMIT$ OR EASILY
AVOIDABLE 9 PRACTICE4
  ,X HAS BE5 >GU$ T NO PR(ES.NAL
MILIT>IES WD WANT TO USE S* W1PONS 2C !Y
WD H UNPR$ICTABLE RESULTS4;9#CB ,B
"333333
#CA .1SEE ! ,3V5;N ON ,C]TA9 ,3V5;NAL
,W1PONS WEBSITE ON ,LE?AL ,AUTONOM\S
  ,W1PONS1 HTTP3_/_/WWW4UNOG4*_/#HJBEF"
  ;,,EE#FJJEHEIDC_/"<HTTP,PAGES">_/"
  #F;,,CE#JDI;,,BE#BB;,,EC#GE,A#B;,C"
  #ABEG;,C#H;,D#JJEAC;,E#BF8,OP5,DOCU;T4
#CB ,S*>RE1 .1SUPRA ;N #BI4
------------------------------------#CHC
? IS R SPECULATIVE1 Z S* SY/EMS >E N YET
AVAILABLE1 & ! 2HAVIOR & 2LIEFS ( /ATES
& _! MILIT>IES MAY *ANGE Z NEW
TE*NOLOGIES 2G9 TO 5ABLE NEW K9DS (
OP]A;NS1 TACTICS1 & /RATEGIES4 ,ONCE
/ATES 2G9 TO SEE "S ADVANTAGE TO US+ S*
W1PONS1 !Y MAY 2 RELUCTANT TO IMPOSE ANY
REGULA;NS1 & 9 ! EV5T ( WIDESPR1D USE "!
MAY 2 LL BASIS 9 CU/OM>Y LAW TO      #DF
           .1,JUS .1NASCENDI       A#CHC
RE9 !M 94 ,EV5 IF A H&;L ( C.TRIES )
ADV.ED PR(ES.NAL MILIT>IES 7 TO OBS]VE A
/RICT] SET ( NORMS1 IF A SIGNIFICANT
NUMB] DID N !N A NORM MI<T FAIL TO 2
E/ABLI%$4
  ,Z AN ANALOGY1 X IS HELP;L TO LOOK AT
! 3CEPT ( 8SUP]FLU\S 9JURY & UNNEC
SU6]+0 9 ,,IHL4 ,? PHRASE F/ APPE>$ 9 !
,ST4 ,PET]SBURG ,DECL>A;N ( #AHFH4
,PRIOR TO XS /ATE;T1 X 0 ONLY VAGUELY
RECOGNIZ$ Z A NORM T _H N BE5 >TICULAT$
CLE>LY 2F4 ,T IS1 MILIT>IES ALR
RECOGNIZ$ T "O %D N 9T5;NALLY CAUSE
9JURY OR SU6]+ 2Y :AT 0 NEC TO A*IEVE A
MILIT>Y OBJECTIVE4 ,S :ILE X IS
P]MISSIBLE TO KILL OR W.D 9 ORD] TO
A*IEVE AN OBJECTIVE1 CAUS+ ADDI;NAL
9JURY OR 9CR1S$ SU6]+ T S]VES NO MILIT>Y
PURPOSE "\ TO 2 AVOID$4 ,X CD 2 >GU$ T !
NORM _H EXI/$ ALL AL;G1 B X 0 !
9TRODUC;N ( NEW TE*NOLOGIES ,- EXPLOD+ &
9C5DI>Y BULLETS1 9 T CASE ,- T 9SPIR$ !
>TICULA;N & CODIFICA;N ( ? NORMATIVE
PR9CIPLE4                            #DG
           .1,JUS .1NASCENDI       B#CHC
  ,9 "S S5SE1 ! PROHIBI;N ON ! USE ( ^!
NEW TYPES ( BULLETS1 & ! RECOGNI;N ( ?
NASC5T NORM1 EM]G$ TGR4 ,9 ANO!R S5SE1 !
RECOGNI;N ( ! NORM & XS "ULY+ PR9CIPLE 7
FO;T$ BY UN1SE AT :AT ^! NEW W1PONS
REPRES5T$ = ! FUTURE ( W>F>E4 ,T IS1 WE
MI<T 3SID] T "! 0 "S?+ 9 ! MORAL
S5SIBIL;Y & 3SCI;E ( ! DELEGATES TO !
,ST4 ,PET]SBURG MEET+ T ! USE ( S*
W1PONS IS MORALLY WR;G1 B AL T !Y MAY N
H BE5 ABLE TO /ATE CLE>LY EXACTLY :AT 0
WR;G AB !M 2F ATTEMPT+ TO F9D !
APPROPRIATE LANGUAGE = _! MORAL S5SE4 ,X
TOOK "S EF=T TO "W "? :AT _! MORAL
3SCI;E WAS1 & TO EXPRESS ? 9 ^WS1 Z WELL
Z TO R1* 3S5SUS ON H[ TO CODIFY ? 9 LAW1
& TO >TICULATE ! PROHIBI;N ON W1PONS T X
IMPLI$4
  ,?US1 ! PR9CIPLE ( M1N+;L HUMAN 3TROL
WD APPE> TO 2 "S?+ T HAS HI/ORICALLY BE5
TAK5 = GRANT$ ,- ASSUM$ B N"E /AT$4
,W1PONS ALW REQUIR$ HUMANS TO DECIDE :5
& ": TO USE !M4 ,:ILE BOOBY TRAPS & M9ES
*ALL5G$ ? IMPLICIT ASSUMP;N TO "S    #DH
           .1,JUS .1NASCENDI       C#CHC
EXT5T1 _! USE 0 N SU6ICI5T TO MOTIVATE !
>TICULA;N ( ? NEW PR9CIPLE1 ?\< X DID
SPAWN V>I\S PRACTICES1 NORMS1 & EV5
TR1TIES4 ,AUTONOM\S W1PONS POSE A M*
GRT] *ALL5GE TO \R PREVI\S ASSUMP;NS AB
! DET]M9A;N ( T>GETS & DECI.NS TO
------------------------------------#CHD
USE VIOL5T =CE4 ,Z S*1 !Y H MOTIVAT$ A
4CUS.N & REFLEC;N ON ! PR9CIPLES (
HUMAN;Y & ! DICTATES ( PUBLIC 3SCI;E4 ,X
IS F ? REFLEC;N T ! PR9CIPLE ( M1N+;L
3TROL HAS EM]G$4 ,& 9DE$1 GIV5 !
UNC]TA9TY OV] H[ S* SY/EMS MI<T 2
DEVELOP$ 9 ! FUTURE1 X IS ALL ! M
IMPORTANT TO CL>IFY ! FUNDA;TAL
PR9CIPLES4
  ,M1N+;L HUMAN 3TROL1 Z X HAS ?US F>
BE5 >TICULAT$1 3TA9S S"EAL ELE;TS4;9#CC
,F/1 X IS FUNDA;TALLY HUMANI/ 9 XS
9SI/;E ON EXPLICITLY HUMAN 3TROL (
T>GET+ & FIR+ DECI.NS4 ,IF ANY NEW
PR9CIPLE MI<T 2 3V9C+LY D]IV$ F !
8PR9CIPLES ( HUMAN;Y0 Z EXPRESS$ 9 !
,M>T5S ,CLAUSE1 SURELY X WD 2 A      #DI
           .1,JUS .1NASCENDI       A#CHD
PR9CIPLE T 5SURES HUMAN 3TROL OV] !
VIOL;E ( W>1 POLITICAL & /RATEGIC
DECI.N-MAK+1;9#CD & W> ITSELF4;9#CE
  ,X IS N YET CLE> :AT 3/ITUTES 83TROL0
( A W1PON EXACTLY4 ,S X SEEMS T M 4CUS.N
( ? WD 2 PRUD5T4 ,:ILE A /RICT DEF9I;N
IS N NEC1 A %>$ "U/&+ %D 2 A GOAL (
FUR!R 4CUS.N4 ,3SID]1 AG BY ANALOGY1 !
PR9CIPLE T PROHIBITS 8SUP]FLU\S 9JURY &
UNNEC SU6]+40 ,^! SEEM FAIRLY CLE> Z A
MATT] ( PR9CIPLE ,- 9JURIES & SU6]+ T G
2Y MILIT>Y NECESS;Y4 ,YET Z A MATT] (
PRACTICE1 OR JUDG+ 9DIVIDUAL W1PONS1 X
IS F> F CLE> H[ "O MI<T APPLY ? PR9CIPLE
TO A NEW W1PON "U REVIEW4 ,H[ DOES X
APPLY TO PA9-9DUC+ W1PONS T D LL
PHYSICAL DAMAGE1 = 9/.E8 ,9 PRACTICE1 (
C\RSE1 /ATES H DEVELOP$ NORMS 9 !
APPLICA;N ( ! PR9CIPLE1 %OR+ X UP ) M
EXPLICIT TR1TIES OR GUIDEL9ES Z NEC4 ,AT
! V L1/1 3TROL IMPLIES T ! E6ECTS &
POT5TIAL 3SEQU;ES ( US+ A W1PONS SY/EM
M/ 2 RELIABLE & PR$ICTABLE TO AN EXT5T T
! HUMAN C EX]T "S =M ( 3TROL OV]     #EJ
           .1,JUS .1NASCENDI       B#CHD
X4 ,X AL IMPLIES T ! P]=M.E ( ! SY/EM
"333333
#CC ,! PHRASE 8M1N+;L HUMAN 3TROL0 0
  CO9$ BY ,RI*>D ,MOYES1 & XS 9ITIAL
  >TICULA;N F/ APPE>$ 9 ! BRIEF+ PAP]S (
  ! ,,UK-BAS$ ,,NGO ,>TICLE #CF4 .1,SEE
  ,>TICLE #CF1 .7,KILL] ,ROBOTS3 ,,UK
  ,GOV]N;T ,POLICY ON ,FULLY ,AUTONOM\S
  ,W1PONS.' "<,APRIL #BJAC">1
  .1AVAILABLE .1AT HTTP3_/_/WWW4"
  >TICLE#CF4;ORG_/WP-3T5T_/UPLOADS_/"
  #BJAC_/#JD_/,POLICY.-,PAP]#A4;PDF2
  ,>TICLE #CF1 .7,/RUCTUR+ ,DEBATE ON
  ,AUTONOM\S ,W1PONS ,SY/EMS.'
  "<,NOVEMB] #BJAC">1 .1AVAILABLE .1AT
  HTTP3_/_/WWW4>TICLE#CF4;ORG_/WP-3T5T"
  _/UPLOADS_/#BJAC_/#AA_/,AUTONOM\S-"
  W1PONS-MEMO-=-,,CCW4PDF2 ,>TICLE #CF1
  .7,KEY ,>1S = ,DEBATE ON ,AUTONOM\S
  ,W1PONS ,SY/EMS.' "<,MAY #BJAD">1
  .1AVAILABLE .1AT HTTP3_/_/WWW4"
  >TICLE#CF4;ORG_/WP-3T5T_/UPLOADS_/
  #BJAF_/#JE_/,A#CF-,,CCW-,MAY-"
  #BJAD4;PDF4                        #EA
           .1,JUS .1NASCENDI       C#CHD
#CD ,H1!R ,R(F1 .7,! ,/RATEGIC ,ROBOT
  ,PROBLEM1.' #AC @#7;,J4 ,MIL4
  ,E?ICS@#' #BAA "<#BJAD">4
#CE ,M>K ,GUBRUD1 .7,! ,PR9CIPLE (
  ,HUMAN;Y 9 ,3FLICT1.' @#1,,ICRAC
  @#1,BLOG "<,NOVEMB] #AI1 #BJAB">1
  .1AVAILABLE .1AT HTTP3_/_/ICRAC4NET_/"
  #BJAB_/#AA_/!-PR9CIPLE-(-HUMAN;Y-9-"
  3FLICT_/4
------------------------------------#CHE
M/ 3=M TO ! 9T5;NS ( ! OP]ATOR S* T X IS
POSSIBLE TO 4T+UI% :5 A SY/EM IS "U
3TROL1 & :5 AN OP]ATOR HAS LO/ 3TROL4
  ,ANO!R KEY ASPECT ( M1N+;L HUMAN 3TROL
IS ! 8M1N+;L0 "P4 ,:ILE X IS DI6ICULT TO
DEF9E EXACTLY :AT M1N+;L 3TROL 3SI/S (1
! 3CEPT XF IS CLE> & X SEEMS A R1SONABLE
/&>D1 IF N AN OBVI\S "O4 ,9 "P1 X AIMS
TO PREV5T W1PONS SY/EMS T USE HUMANS
9/RU;TALLY Z APPROVAL ME*ANISMS4 ,=
EXAMPLE1 ORD]+ A SOLDI] TO PRESS A
8FIRE0 BUTTON E "T A LI<T COMES ON WD
IMPLY T A HUMAN IS TE*NICALLY 89 3TROL0
( ! W1PON SY/EM EV5 IF !Y            #EB
           .1,JUS .1NASCENDI       A#CHE
E6ECTIVELY H NO M1N+;L 3TROL OV] :AT !
SY/EM IS T>GET+1 OR H[ & :5 X IS US+
LE?AL =CE AG/ ^? T>GETS4 ,B X AL IMPLIES
M ?AN ?1 9 T M1N+;L 3TROL AL 5TAILS TAK+
RESPONSIBIL;Y = ! USE ( ! W1PON SY/EM1 &
2+ A3.TABLE = ! 3SEQU;ES ( T USE4
  ,9 ORD] TO 5SURE T A SY/EM RETA9S
HUMAN 3TROL1 & "!BY UPHOLDS ! PR9CIPLES
( HUMAN;Y & DOES N TRIVIALIZE HUMAN
AC;NS 9 ! PROCESS1 ! REQUIRE;T = 3TROL
TO 2 M1N+;L IS NEC4 ,= ! KILL+ ( A HUMAN
TO 2 M1N+;L1 X M/ 2 9T5;NAL4 ,T IS1 X M/
2 D"O = R1SON & PURPOSE4
,PHILOSOPHICALLY1 9T5;NAL;Y REQUIRES
"U/&+ ! M1N+ & SIGNIFIC.E ( AN ACT4
,:ILE AUTONOM\S SY/EMS MAY 2 PROGRAMM$
TO ACT 9 A C]TA9 WAY1 GIV5 A C]TA9 SET (
3DI;NS1 !Y _C "U/& ! SIGNIFIC.E ( _!
ACTS4 ,? IS 9 "P :Y !Y _C MAKE LEGAL OR
MORAL JUDG;TS4 ,B ? AL RELATES TO ! "Q (
HUMAN DIGN;Y4 ,IF A COMBATANT IS TO DIE
) DIGN;Y1;9#CF "! M/ 2 "S S5SE 9 : T D1?
IS M1N+;L4 ,9 ! ABS;E ( AN 9T5;NAL &
M1N+;L DECI.N TO USE VIOL;E1 !       #EC
           .1,JUS .1NASCENDI       B#CHE
RESULT+ D1?S >E M1N+.S & >BITR>Y1 & !
DIGN;Y ( ^? KILL$ IS SIGNIFICANTLY
DIM9I%$4
  ,M1N+;L HUMAN 3TROL AL (F]S "S
POSITIVE GUID.E ON H[ SY/EMS "\ TO 2
DESIGN$ TO 9T]FACE ) HUMANS4 ,X OBLIGES
5G9E]S & DESIGN]S TO 3SID] H[ ! USE (
VIOL5T =CE IS A =M ( SYMBOLIC & 9T5;NAL
AC;N1 Z WELL Z A FUNC;NAL P]=M.E4 ,Z S*1
AN 9T]FACE "\ TO PROVIDE XS US] ) !
POT5TIAL TO MAKE M1N+ & TAKE M1N+;L
AC;NS1 Z WELL Z TO P]=M TASKS4 ,"U
,HUMAN ,"RS ,LAW1 "! WD AL 2 A DUTY ^U
/ATES TO 5SURE T S* W1PONS CD N VIOLATE
HUMAN "RS \TSIDE ( >M$ 3FLICT ,- BY
5SUR+
"333333
#CF ,:ILE COMBATANTS >E N 5TITL$ TO A
  DIGNIFI$ D1? "U ,,IHL1 >GUABLY E HUMAN
  REMA9S 5TITL$ TO DIGN;Y "U ,HUMAN ,"RS
  ,LAW1 EV5 IF !Y >E LIABLE TO 2 KILL$ Z
  5EMY COMBATANTS4
------------------------------------#CHF
T M1N+;L HUMAN 3TROL IS MA9TA9$4     #ED
           .1,JUS .1NASCENDI       A#CHF
,MOREOV]1 X C\PLES ! MAK+ ( M1N+ ) 3TROL
OV] ! SY/EM ,- TO ! EXT5T ! SY/EM IS
AUTOMATIC1 ! M1N+ ( XS ACTIVITIES >E
DEP5D5T ^U HI<]-ORD] LEVELS (
ORGANIZA;N1 : MAY N 2 ABLE TO ADDRESS
:AT IS SIGNIFICANT 9 A GIV5 SITUA;N4
,M1N+-MAK+ IS A 4T9CTLY HUMAN CAPAC;Y1 &
>TIFICIAL SY/EMS W LACK S* CAPABILITIES
= ! =ESEEABLE FUTURE4 ,! USE (
AN?ROPOMORPHIZ+ LANGUAGE C (T5 3FUSE !
R1L CAPABILITIES ( SY/EMS1 : IS :Y X IS
IMP]ATIVE T WE MAKE PR9CIPLES L M1N+;L
HUMAN 3TROL CLE>4

    #D4 ,,3CLU.N
,I HOPE T ,I H %[N N ONLY T WE %D VIEW
9T]NA;NAL LAW Z AN EVOLV+ & DYNAMIC
SY/EM1 B AL T XS EVOLU;N "\ TO 2 %AP$ BY
MORAL 3SID]A;NS4 ,! ,M>T5S ,CLAUSE "\ TO
2 VIEW$ N ONLY Z A RECOGNI;N T WRITT5
LAW DOES N FULLY 4PLACE CU/OM>Y LAW1 B
AL Z AN 9VITA;N TO MORAL REFLEC;N ON !
ROLE ( ! PR9CIPLES ( HUMAN;Y & !
DICTATES ( PUBLIC 3SCI;E 9           #EE
           .1,JUS .1NASCENDI       B#CHF
>TICULAT+ & E/ABLI%+ NEW ,,IHL4 ,XS
LEGACY Z AN EXPLICIT RECOGNI;N ( ! ROLE
( MORAL 3SID]A;N 9 ! APPLICA;N ( ,,IHL1
Z WELL Z 9 ! =MULA;N ( NEW LAW1 %D N 2
OV]LOOK$ OR "UE/IMAT$4
  ,& F9ALLY1 ,I PRES5T$ AN EXAMPLE ( AN
EM]G+ NORMATIVE PR9CIPLE 3C]N+ !
DEVELOP;T & USE ( AUTONOM\S W1PONS ,- !
PR9CIPLE ( M1N+;L HUMAN 3TROL4 ,:ILE X
IS 9 "S S5SE NASC5T OR LAT5T 9 EXI/+
2LIEFS & PRACTICES1 X IS AL 9 "S S5SE
EM]G5T 9 ! ONGO+ DEBATES T >E !MVS A
RESPONSE TO ! EXPECTA;NS =1 &
CAPABILITIES (1 EM]G+ TE*NOLOGIES4
  ,X IS MY HOPE T ! CURR5T DEBATE OV] !
REGULA;N ( AUTONOM\S W1PONS C PROGRESS
2Y SPECULATIVE ASSESS;TS ( !
CAPABILITIES & RISKS ( ROBOTIC
TE*NOLOGIES4 ,9/1D1 WE %D FOCUS ON !
?R1TS POS$ TO FUNDA;TAL NORMS (
RESPONSIBIL;Y & A3.TABIL;Y1 & TO ! ?R1TS
TO HUMAN "RS & HUMAN DIGN;Y T ^! NEW
TE*NOLOGIES REPRES5T4 ,& WE %D DRAW ^U !
PR9CIPLES ( HUMAN;Y & DICTATES (     #EF
           .1,JUS .1NASCENDI       C#CHF
PUBLIC 3SCI;E Z WE MOVE =W>D 9 >TICULAT+
NEW NORMATIVE PR9CIPLES & .1JUS
.1NASCENDI1 9CLUD+ M1N+;L HUMAN 3TROL
OV] ! USE ( VIOL5T =CE 9 >M$ 3FLICT4

               ,,! ,,5D

















                                     #EG