WEBVTT

1
00:00:04.925 --> 00:00:05.215
Yeah.

2
00:00:05.395 --> 00:00:09.575
<00:00:05.395>Hey, <00:00:05.534>I'm <00:00:05.675>to <00:00:05.814>head <00:00:05.954>of <00:00:06.095>Automation <00:00:06.234>factory <00:00:06.374>at <00:00:06.515>at <00:00:06.654>Eon, <00:00:06.795>um,

3
00:00:10.555 --> 00:00:13.375
<00:00:10.555>ex <00:00:10.730>Microsoft, <00:00:10.905>ex <00:00:11.080>Nvidia <00:00:11.254>is <00:00:11.430>headed <00:00:11.605>father <00:00:11.780>of <00:00:11.955>two

4
00:00:13.675 --> 00:00:15.095
<00:00:13.675>and <00:00:13.994>a <00:00:14.314>developer <00:00:14.633>at <00:00:14.953>heart.

5
00:00:15.195 --> 00:00:17.575
<00:00:15.195>And, <00:00:15.395>um, <00:00:15.595>I'm <00:00:15.795>a <00:00:15.995>child <00:00:16.195>of <00:00:16.395>the <00:00:16.595>eighties

6
00:00:17.715 --> 00:00:20.695
<00:00:17.715>and <00:00:17.890>I, <00:00:18.065>I, <00:00:18.240>uh, <00:00:18.415>grew <00:00:18.590>up <00:00:18.765>with <00:00:18.940>the <00:00:19.115>Terminator.

7
00:00:21.515 --> 00:00:24.055
<00:00:21.515>Um, <00:00:21.690>yeah, <00:00:21.865>I <00:00:22.040>think <00:00:22.215>as <00:00:22.390>everyone <00:00:22.565>at <00:00:22.740>that <00:00:22.915>time

8
00:00:24.675 --> 00:00:27.335
<00:00:24.675>and <00:00:24.908>the <00:00:25.141>idea <00:00:25.375>of <00:00:25.608>machines <00:00:25.841>turning, <00:00:26.075>um,

9
00:00:27.555 --> 00:00:29.775
<00:00:27.555>on <00:00:27.788>humans <00:00:28.021>was <00:00:28.255>both <00:00:28.488>thrilling <00:00:28.721>and <00:00:28.955>terrifying.

10
00:00:30.155 --> 00:00:31.255
<00:00:30.155>Uh, <00:00:30.485>the <00:00:30.815>whole <00:00:31.145>story,

11
00:00:31.715 --> 00:00:34.135
<00:00:31.715>and <00:00:31.890>especially <00:00:32.064>the <00:00:32.240>image <00:00:32.415>of <00:00:32.590>a <00:00:32.765>missing <00:00:32.940>kill <00:00:33.115>switch

12
00:00:34.205 --> 00:00:37.335
<00:00:34.205>that <00:00:34.360>could <00:00:34.516>have <00:00:34.671>prevented <00:00:34.827>everything <00:00:34.982>from <00:00:35.138>the <00:00:35.293>very <00:00:35.449>start <00:00:35.605>on,

13
00:00:37.755 --> 00:00:40.735
<00:00:37.755>um, <00:00:37.988>that <00:00:38.221>stayed <00:00:38.455>with <00:00:38.688>me <00:00:38.921>until <00:00:39.155>today.

14
00:00:41.435 --> 00:00:44.175
<00:00:41.435>And <00:00:41.575>that's <00:00:41.715>also <00:00:41.855>a <00:00:41.995>little <00:00:42.135>bit <00:00:42.275>what <00:00:42.415>this <00:00:42.555>session <00:00:42.695>is <00:00:42.835>about,

15
00:00:45.375 --> 00:00:47.715
<00:00:45.375>but <00:00:45.575>let's, <00:00:45.775>uh, <00:00:45.975>bring <00:00:46.175>this <00:00:46.375>down <00:00:46.575>from <00:00:46.775>Hollywood

16
00:00:47.815 --> 00:00:51.035
<00:00:47.815>to <00:00:47.955>our <00:00:48.095>reality, <00:00:48.235>uh, <00:00:48.375>to <00:00:48.515>the <00:00:48.655>cope <00:00:48.794>we <00:00:48.934>ride <00:00:49.074>every <00:00:49.214>day.

17
00:00:51.515 --> 00:00:54.715
<00:00:51.515>A <00:00:51.655>few <00:00:51.795>years <00:00:51.935>ago, <00:00:52.075>I <00:00:52.215>was <00:00:52.355>working <00:00:52.495>on <00:00:52.635>a <00:00:52.775>seemingly <00:00:52.915>harmless

18
00:00:54.715 --> 00:00:57.715
<00:00:54.715>recommendation <00:00:54.995>engine <00:00:55.275>for <00:00:55.555>an <00:00:55.835>e-commerce <00:00:56.115>platform.

19
00:00:58.175 --> 00:01:01.675
<00:00:58.175>The <00:00:58.330>goal <00:00:58.486>was <00:00:58.641>simple <00:00:58.797>show <00:00:58.952>users <00:00:59.108>products <00:00:59.263>they <00:00:59.419>might <00:00:59.574>light.

20
00:01:02.255 --> 00:01:05.315
<00:01:02.255>Um, <00:01:02.410>we <00:01:02.566>tr <00:01:02.721>trained <00:01:02.877>it <00:01:03.032>on <00:01:03.188>on <00:01:03.343>past <00:01:03.499>sales <00:01:03.655>data,

21
00:01:05.375 --> 00:01:06.755
<00:01:05.375>and <00:01:05.789>it <00:01:06.203>worked <00:01:06.616>technically,

22
00:01:07.135 --> 00:01:09.395
<00:01:07.135>but <00:01:07.368>then <00:01:07.601>we, <00:01:07.835>uh, <00:01:08.068>noticed <00:01:08.301>something <00:01:08.535>strange.

23
00:01:09.655 --> 00:01:12.555
<00:01:09.655>The, <00:01:09.888>the <00:01:10.121>algorithm <00:01:10.355>started <00:01:10.588>creating <00:01:10.821>feedback <00:01:11.055>loops

24
00:01:12.855 --> 00:01:17.345
<00:01:12.855>and <00:01:13.205>it <00:01:13.555>really, <00:01:13.905>um, <00:01:14.255>thought

25
00:01:17.345 --> 00:01:21.985
<00:01:17.345>that <00:01:17.485>the, <00:01:17.625>the, <00:01:17.765>um, <00:01:17.905>um, <00:01:18.045>the <00:01:18.185>top, <00:01:18.325>the, <00:01:18.465>the <00:01:18.605>products, <00:01:18.745>um,

26
00:01:22.175 --> 00:01:25.625
<00:01:22.175>that <00:01:22.330>the <00:01:22.486>people <00:01:22.641>like <00:01:22.797>is <00:01:22.952>the <00:01:23.108>only <00:01:23.263>products <00:01:23.419>to <00:01:23.575>provoke

27
00:01:26.125 --> 00:01:27.665
<00:01:26.125>and <00:01:26.402>making <00:01:26.679>them <00:01:26.956>even <00:01:27.233>more <00:01:27.511>popular.

28
00:01:28.315 --> 00:01:32.025
<00:01:28.315>While <00:01:28.548>newer <00:01:28.781>niche <00:01:29.015>products <00:01:29.248>became <00:01:29.481>invisible, <00:01:29.715>uh,

29
00:01:32.095 --> 00:01:34.145
<00:01:32.095>it's <00:01:32.375>inadvertently <00:01:32.655>created <00:01:32.935>an <00:01:33.215>echo <00:01:33.495>chamber

30
00:01:34.145 --> 00:01:35.785
<00:01:34.145>that <00:01:34.611>flattened, <00:01:35.078>uh, <00:01:35.545>diversity.

31
00:01:36.555 --> 00:01:38.305
<00:01:36.555>There <00:01:36.835>was <00:01:37.115>no <00:01:37.395>evil <00:01:37.675>intent <00:01:37.955>and,

32
00:01:38.325 --> 00:01:41.145
<00:01:38.325>and <00:01:38.605>no <00:01:38.885>Skynet <00:01:39.165>level, <00:01:39.445>uh, <00:01:39.725>consciousness.

33
00:01:41.325 --> 00:01:44.625
<00:01:41.325>It <00:01:41.465>was <00:01:41.605>just <00:01:41.745>an <00:01:41.885>algorithm <00:01:42.025>doing <00:01:42.165>exactly <00:01:42.305>what <00:01:42.445>we <00:01:42.585>told <00:01:42.725>it

34
00:01:44.625 --> 00:01:47.945
<00:01:44.625>to <00:01:44.800>do, <00:01:44.975>optimized <00:01:45.150>for <00:01:45.325>clicks <00:01:45.500>based <00:01:45.675>on <00:01:45.850>past <00:01:46.025>data.

35
00:01:48.605 --> 00:01:51.785
<00:01:48.604>And <00:01:48.744>at <00:01:48.884>that <00:01:49.024>moment, <00:01:49.164>I <00:01:49.304>realized <00:01:49.445>we <00:01:49.585>hadn't <00:01:49.725>programmed <00:01:49.865>the <00:01:50.005>kill

36
00:01:51.785 --> 00:01:54.945
<00:01:51.785>switch, <00:01:51.985>uh, <00:01:52.185>because <00:01:52.384>we <00:01:52.585>never <00:01:52.785>imagined <00:01:52.985>needing <00:01:53.185>one.

37
00:01:55.645 --> 00:01:57.425
<00:01:55.645>Um, <00:01:55.995>but <00:01:56.345>more <00:01:56.695>importantly, <00:01:57.045>we,

38
00:01:57.485 --> 00:01:59.065
<00:01:57.485>we <00:01:57.765>hadn't <00:01:58.045>programmed <00:01:58.325>a <00:01:58.605>moral <00:01:58.885>compass

39
00:01:59.165 --> 00:02:00.465
<00:01:59.164>to <00:01:59.360>guide <00:01:59.554>it <00:01:59.750>in <00:01:59.945>the <00:02:00.140>first <00:02:00.335>place.

40
00:02:01.005 --> 00:02:03.745
<00:02:01.005>And <00:02:01.179>this <00:02:01.354>small <00:02:01.530>scale <00:02:01.705>problem <00:02:01.880>is <00:02:02.054>a <00:02:02.229>mini <00:02:02.405>version

41
00:02:03.765 --> 00:02:05.825
<00:02:03.765>of <00:02:03.998>the <00:02:04.231>grand <00:02:04.465>challenge <00:02:04.698>we <00:02:04.931>facing <00:02:05.165>today.

42
00:02:06.445 --> 00:02:07.865
<00:02:06.445>It <00:02:06.764>starts <00:02:07.083>with <00:02:07.403>simple <00:02:07.723>code

43
00:02:08.165 --> 00:02:10.705
<00:02:08.164>and <00:02:08.445>ends <00:02:08.725>with <00:02:09.005>society <00:02:09.285>altering <00:02:09.565>consequences.

44
00:02:12.765 --> 00:02:16.505
<00:02:12.765>But <00:02:12.904>okay, <00:02:13.045>long <00:02:13.184>before <00:02:13.325>Arnold, <00:02:13.464>it <00:02:13.605>worked <00:02:13.744>out <00:02:13.885>of <00:02:14.024>the <00:02:14.165>flames.

45
00:02:16.885 --> 00:02:19.705
<00:02:16.885>ISO <00:02:17.118>is <00:02:17.351>Asimov, <00:02:17.584>uh, <00:02:17.818>was <00:02:18.051>already <00:02:18.285>writing

46
00:02:20.235 --> 00:02:21.545
<00:02:20.235>about <00:02:20.628>this <00:02:21.021>very <00:02:21.414>problem.

47
00:02:22.125 --> 00:02:24.265
<00:02:22.125>Um, <00:02:22.300>I <00:02:22.475>think <00:02:22.650>you, <00:02:22.825>you've <00:02:23.000>heard <00:02:23.175>the <00:02:23.350>name <00:02:23.525>already,

48
00:02:24.685 --> 00:02:26.545
<00:02:24.685>the <00:02:25.035>challenge <00:02:25.385>of <00:02:25.735>machines <00:02:26.085>immorality.

49
00:02:27.205 --> 00:02:32.025
<00:02:27.204>Uh, <00:02:27.360>in, <00:02:27.516>in <00:02:27.671>1942, <00:02:27.827>Asimov <00:02:27.982>published <00:02:28.138>his <00:02:28.293>short <00:02:28.449>story <00:02:28.605>runaround,

50
00:02:33.105 --> 00:02:36.185
<00:02:33.105>introducing <00:02:33.304>the <00:02:33.505>now <00:02:33.704>famous <00:02:33.905>three <00:02:34.105>laws <00:02:34.304>of <00:02:34.505>robotics.

51
00:02:38.105 --> 00:02:39.505
<00:02:38.105>A <00:02:38.524>robot <00:02:38.945>must <00:02:39.365>not

52
00:02:39.565 --> 00:02:42.265
<00:02:39.565>or <00:02:39.798>may <00:02:40.031>not <00:02:40.265>ensure, <00:02:40.498>um, <00:02:40.731>human <00:02:40.965>being,

53
00:02:42.705 --> 00:02:44.705
<00:02:42.704>a <00:02:42.984>robot <00:02:43.265>must <00:02:43.545>obey <00:02:43.825>human <00:02:44.105>orders

54
00:02:44.805 --> 00:02:46.985
<00:02:44.805>and <00:02:45.005>a <00:02:45.205>robot <00:02:45.405>must <00:02:45.605>protect <00:02:45.805>its <00:02:46.005>own <00:02:46.205>existence

55
00:02:46.985 --> 00:02:49.425
<00:02:46.985>unless <00:02:47.185>there <00:02:47.385>conflicts <00:02:47.585>with <00:02:47.785>law <00:02:47.985>one <00:02:48.185>and <00:02:48.385>two.

56
00:02:49.885 --> 00:02:53.105
<00:02:49.885>And <00:02:50.118>these <00:02:50.351>law <00:02:50.584>were <00:02:50.818>not <00:02:51.051>technical <00:02:51.285>instructions.

57
00:02:53.105 --> 00:02:54.545
<00:02:53.105>They <00:02:53.429>were <00:02:53.753>a <00:02:54.077>moral <00:02:54.401>firewall.

58
00:02:54.935 --> 00:02:58.025
<00:02:54.935>They <00:02:55.110>were <00:02:55.285>an <00:02:55.460>elegant <00:02:55.635>attempt <00:02:55.810>to <00:02:55.985>circumvent <00:02:56.160>the <00:02:56.335>need

59
00:02:58.025 --> 00:02:59.645
<00:02:58.025>for <00:02:58.225>a <00:02:58.425>kill <00:02:58.625>switch <00:02:58.825>in <00:02:59.025>the <00:02:59.225>first <00:02:59.425>place,

60
00:03:00.425 --> 00:03:03.205
<00:03:00.425>to <00:03:00.600>protect <00:03:00.775>us <00:03:00.950>from <00:03:01.125>our <00:03:01.300>own <00:03:01.475>creations <00:03:01.650>by <00:03:01.825>design.

61
00:03:03.945 --> 00:03:05.485
<00:03:03.945>But <00:03:04.291>Asimov, <00:03:04.638>being <00:03:04.984>a <00:03:05.331>genius,

62
00:03:05.915 --> 00:03:09.005
<00:03:05.915>immediately <00:03:06.148>showed <00:03:06.381>us <00:03:06.614>in <00:03:06.848>his <00:03:07.081>stories <00:03:07.315>why

63
00:03:09.005 --> 00:03:10.165
<00:03:09.005>even <00:03:09.353>this <00:03:09.701>wasn't <00:03:10.048>enough.

64
00:03:10.695 --> 00:03:13.365
<00:03:10.695>These <00:03:10.894>rules <00:03:11.095>alone <00:03:11.295>were <00:03:11.495>not <00:03:11.695>a <00:03:11.894>perfect <00:03:12.095>solution.

65
00:03:14.945 --> 00:03:16.205
<00:03:14.945>In <00:03:15.322>his <00:03:15.701>story, <00:03:16.078>liar.

66
00:03:16.885 --> 00:03:18.805
<00:03:16.885>A <00:03:17.118>mind <00:03:17.351>reading, <00:03:17.584>Robert <00:03:17.818>lies <00:03:18.051>to <00:03:18.285>humans

67
00:03:18.985 --> 00:03:22.765
<00:03:18.985>to <00:03:19.160>avoid <00:03:19.335>hurting <00:03:19.510>their <00:03:19.685>feelings, <00:03:19.860>which <00:03:20.035>of <00:03:20.210>course <00:03:20.385>ultimately

68
00:03:23.425 --> 00:03:25.565
<00:03:23.425>causes <00:03:23.775>even <00:03:24.125>deeper <00:03:24.475>psychological <00:03:24.825>harm.

69
00:03:26.525 --> 00:03:28.525
<00:03:26.525>'cause <00:03:26.700>when <00:03:26.875>the <00:03:27.050>robot <00:03:27.225>is <00:03:27.400>confronted <00:03:27.575>with <00:03:27.750>the <00:03:27.925>fact

70
00:03:28.525 --> 00:03:32.405
<00:03:28.525>that <00:03:28.725>any <00:03:28.925>action <00:03:29.125>even <00:03:29.325>lying <00:03:29.525>is <00:03:29.725>hurting <00:03:29.925>humans,

71
00:03:32.865 --> 00:03:36.045
<00:03:32.865>it <00:03:33.145>experience <00:03:33.425>an <00:03:33.705>insolvable <00:03:33.985>logic <00:03:34.265>conflict

72
00:03:36.305 --> 00:03:37.525
<00:03:36.305>and <00:03:36.854>becomes <00:03:37.403>catatonic.

73
00:03:38.035 --> 00:03:40.085
<00:03:38.035>What <00:03:38.268>that <00:03:38.501>means <00:03:38.734>was <00:03:38.968>it <00:03:39.201>just <00:03:39.435>freezes

74
00:03:40.265 --> 00:03:41.805
<00:03:40.265>and <00:03:40.611>no <00:03:40.958>safeguard <00:03:41.304>kicks <00:03:41.651>in

75
00:03:42.625 --> 00:03:47.565
<00:03:42.625>and <00:03:42.780>it <00:03:42.936>gets, <00:03:43.091>uh, <00:03:43.247>even <00:03:43.402>darker <00:03:43.558>in <00:03:43.713>the <00:03:43.869>available <00:03:44.025>conflict.

76
00:03:47.985 --> 00:03:50.085
<00:03:47.985>Supercomputers <00:03:48.335>run <00:03:48.685>the <00:03:49.035>global <00:03:49.385>economy

77
00:03:50.705 --> 00:03:52.245
<00:03:50.704>and <00:03:50.935>they <00:03:51.167>begin <00:03:51.398>to <00:03:51.629>make <00:03:51.860>what <00:03:52.091>appear

78
00:03:52.245 --> 00:03:55.365
<00:03:52.245>to <00:03:52.525>be <00:03:52.805>tiny <00:03:53.085>deliberate <00:03:53.365>changes, <00:03:53.645>errors,

79
00:03:55.785 --> 00:03:57.325
<00:03:55.785>and <00:03:56.062>they <00:03:56.339>inflict <00:03:56.616>a <00:03:56.893>small <00:03:57.171>amount

80
00:03:57.325 --> 00:04:00.605
<00:03:57.325>of <00:03:57.480>harm <00:03:57.636>on <00:03:57.791>selected <00:03:57.947>individuals <00:03:58.102>from <00:03:58.258>an <00:03:58.413>anti <00:03:58.569>machine <00:03:58.725>group

81
00:04:01.065 --> 00:04:03.325
<00:04:01.065>to <00:04:01.298>protect <00:04:01.531>the <00:04:01.765>system <00:04:01.998>as <00:04:02.231>a <00:04:02.465>whole.

82
00:04:03.835 --> 00:04:06.605
<00:04:03.835>They <00:04:04.035>are <00:04:04.235>harming <00:04:04.435>individuals <00:04:04.635>for <00:04:04.835>what <00:04:05.035>they <00:04:05.235>calculate

83
00:04:06.745 --> 00:04:10.005
<00:04:06.745>to <00:04:06.900>be <00:04:07.056>the <00:04:07.211>greater <00:04:07.367>good <00:04:07.522>and <00:04:07.678>the <00:04:07.833>most <00:04:07.989>terrifying <00:04:08.145>part.

84
00:04:10.255 --> 00:04:12.085
<00:04:10.255>There <00:04:10.605>is <00:04:10.954>no <00:04:11.305>override <00:04:11.655>mechanism.

85
00:04:12.545 --> 00:04:14.965
<00:04:12.545>No <00:04:12.700>one <00:04:12.856>even <00:04:13.011>knows <00:04:13.167>how <00:04:13.322>to <00:04:13.478>shut <00:04:13.633>them <00:04:13.789>down <00:04:13.945>anymore.

86
00:04:15.425 --> 00:04:18.485
<00:04:15.425>And <00:04:15.600>the <00:04:15.775>machines <00:04:15.950>have <00:04:16.125>generalized <00:04:16.300>the <00:04:16.475>first <00:04:16.650>law <00:04:16.825>into

87
00:04:18.485 --> 00:04:20.405
<00:04:18.485>what <00:04:18.718>we <00:04:18.951>now <00:04:19.185>call <00:04:19.418>the <00:04:19.651>zeroes <00:04:19.885>law.

88
00:04:21.065 --> 00:04:23.325
<00:04:21.065>No <00:04:21.415>machine <00:04:21.765>may <00:04:22.115>harm <00:04:22.465>humanity

89
00:04:23.705 --> 00:04:27.325
<00:04:23.705>or <00:04:23.880>through <00:04:24.055>inaction, <00:04:24.229>allow <00:04:24.405>humanity <00:04:24.580>to <00:04:24.755>come <00:04:24.930>to <00:04:25.104>harm.

90
00:04:28.345 --> 00:04:31.325
<00:04:28.345>And <00:04:28.485>what <00:04:28.625>this <00:04:28.765>really <00:04:28.905>means <00:04:29.045>is <00:04:29.185>that <00:04:29.325>the <00:04:29.465>machines <00:04:29.605>have <00:04:29.745>decided

91
00:04:31.875 --> 00:04:34.805
<00:04:31.875>that <00:04:32.050>the <00:04:32.225>only <00:04:32.400>way <00:04:32.575>to <00:04:32.750>follow <00:04:32.925>this <00:04:33.100>law <00:04:33.275>is

92
00:04:34.805 --> 00:04:36.405
<00:04:34.805>to <00:04:35.155>take <00:04:35.505>control <00:04:35.855>of <00:04:36.205>humanity.

93
00:04:39.595 --> 00:04:40.735
<00:04:39.595>So <00:04:40.108>every <00:04:40.621>developer

94
00:04:40.735 --> 00:04:42.775
<00:04:40.735>and <00:04:40.968>tech <00:04:41.201>lead <00:04:41.435>working <00:04:41.668>on <00:04:41.901>ai, <00:04:42.135>um,

95
00:04:43.225 --> 00:04:44.895
<00:04:43.225>holds <00:04:43.691>a <00:04:44.158>profound <00:04:44.625>responsibility.

96
00:04:45.095 --> 00:04:46.215
<00:04:45.095>I <00:04:45.296>think <00:04:45.498>we <00:04:45.699>know <00:04:45.901>that <00:04:46.103>already,

97
00:04:46.555 --> 00:04:49.335
<00:04:46.555>but <00:04:46.695>we <00:04:46.835>have <00:04:46.975>to <00:04:47.115>live <00:04:47.255>that <00:04:47.395>we <00:04:47.535>are <00:04:47.675>the <00:04:47.815>ones <00:04:47.955>effectively

98
00:04:49.335 --> 00:04:51.215
<00:04:49.335>programming <00:04:49.801>the <00:04:50.268>AI <00:04:50.734>conscience.

99
00:04:51.595 --> 00:04:55.015
<00:04:51.595>Why <00:04:51.735>we <00:04:51.875>might <00:04:52.015>not, <00:04:52.155>might <00:04:52.295>not <00:04:52.435>write <00:04:52.575>lines <00:04:52.715>of <00:04:52.855>code <00:04:52.995>saying

100
00:04:55.685 --> 00:04:57.545
<00:04:55.685>if <00:04:55.918>moral <00:04:56.151>dilemma <00:04:56.385>do <00:04:56.618>the <00:04:56.851>right <00:04:57.085>thing.

101
00:04:58.245 --> 00:05:01.145
<00:04:58.245>Our <00:04:58.400>design <00:04:58.556>choices <00:04:58.711>from <00:04:58.867>the <00:04:59.022>data <00:04:59.178>we <00:04:59.333>select <00:04:59.489>for <00:04:59.645>training

102
00:05:01.525 --> 00:05:04.865
<00:05:01.525>to <00:05:01.700>the <00:05:01.875>objective <00:05:02.049>functions <00:05:02.224>we <00:05:02.400>define <00:05:02.575>and <00:05:02.750>that <00:05:02.924>values

103
00:05:05.125 --> 00:05:07.225
<00:05:05.125>or <00:05:05.475>biases <00:05:05.825>into <00:05:06.175>our <00:05:06.525>ai.

104
00:05:07.885 --> 00:05:12.305
<00:05:07.885>If <00:05:08.060>we <00:05:08.235>focus <00:05:08.409>solely <00:05:08.585>on <00:05:08.760>performance <00:05:08.935>and <00:05:09.110>performance <00:05:09.284>metrics

105
00:05:12.765 --> 00:05:15.625
<00:05:12.765>and <00:05:12.998>shipping <00:05:13.231>features, <00:05:13.465>we <00:05:13.698>risk <00:05:13.931>creating <00:05:14.164>systems

106
00:05:16.375 --> 00:05:19.505
<00:05:16.375>that <00:05:16.575>reflect <00:05:16.775>only <00:05:16.975>the <00:05:17.175>code <00:05:17.375>logic <00:05:17.575>of <00:05:17.775>algorithm

107
00:05:19.605 --> 00:05:21.865
<00:05:19.605>or <00:05:20.071>worse, <00:05:20.538>the <00:05:21.005>flawed

108
00:05:21.865 --> 00:05:25.505
<00:05:21.865>and <00:05:22.040>bias <00:05:22.215>data <00:05:22.390>they <00:05:22.565>learn <00:05:22.740>from <00:05:22.915>without <00:05:23.090>any <00:05:23.265>regard

109
00:05:25.645 --> 00:05:27.105
<00:05:25.645>of <00:05:25.973>human <00:05:26.302>for <00:05:26.630>human <00:05:26.959>values.

110
00:05:28.685 --> 00:05:32.425
<00:05:28.685>So <00:05:28.825>who <00:05:28.965>then <00:05:29.105>gives <00:05:29.245>AI <00:05:29.385>a <00:05:29.525>sense <00:05:29.665>of <00:05:29.805>right <00:05:29.945>and <00:05:30.085>wrong?

111
00:05:32.885 --> 00:05:35.225
<00:05:32.885>We <00:05:33.164>do, <00:05:33.445>we <00:05:33.724>become <00:05:34.005>the <00:05:34.284>proxy

112
00:05:35.365 --> 00:05:37.905
<00:05:35.365>for <00:05:35.565>society's <00:05:35.765>ethic <00:05:35.965>in <00:05:36.165>each <00:05:36.365>model <00:05:36.565>we <00:05:36.765>build.

113
00:05:38.405 --> 00:05:41.705
<00:05:38.405>The <00:05:38.638>responsibility <00:05:38.871>is <00:05:39.104>both <00:05:39.338>exhilarating <00:05:39.571>and <00:05:39.804>daunting.

114
00:05:42.445 --> 00:05:46.065
<00:05:42.445>It <00:05:42.645>means <00:05:42.844>that <00:05:43.045>ethical <00:05:43.245>considerations <00:05:43.445>must <00:05:43.645>be <00:05:43.844>part

115
00:05:46.065 --> 00:05:47.785
<00:05:46.065>of <00:05:46.415>our <00:05:46.765>daily <00:05:47.115>development <00:05:47.465>processes,

116
00:05:47.805 --> 00:05:50.825
<00:05:47.805>not <00:05:48.038>an <00:05:48.271>afterthought <00:05:48.505>delegated <00:05:48.738>to <00:05:48.971>a <00:05:49.205>committee.

117
00:05:51.575 --> 00:05:54.065
<00:05:51.575>Just <00:05:51.750>as <00:05:51.925>a <00:05:52.099>tech <00:05:52.275>lead <00:05:52.450>reviews <00:05:52.625>code <00:05:52.800>for <00:05:52.974>bucks

118
00:05:54.085 --> 00:05:56.545
<00:05:54.085>and <00:05:54.318>performance <00:05:54.551>issues, <00:05:54.784>they <00:05:55.018>must <00:05:55.251>also <00:05:55.484>review

119
00:05:56.545 --> 00:05:57.885
<00:05:56.545>for <00:05:57.148>ethical <00:05:57.751>pitfalls.

120
00:05:58.425 --> 00:06:01.085
<00:05:58.425>We <00:05:58.658>have <00:05:58.891>to <00:05:59.125>start <00:05:59.358>asking <00:05:59.591>questions <00:05:59.825>like,

121
00:06:01.215 --> 00:06:03.805
<00:06:01.215>could <00:06:01.565>this <00:06:01.914>algorithm <00:06:02.265>unfairly <00:06:02.614>discriminated?

122
00:06:04.185 --> 00:06:07.925
<00:06:04.185>Are <00:06:04.385>we <00:06:04.585>truly <00:06:04.785>respecting <00:06:04.985>our <00:06:05.185>user's <00:06:05.385>data <00:06:05.585>privacy?

123
00:06:08.665 --> 00:06:11.045
<00:06:08.665>And <00:06:08.898>do <00:06:09.131>we <00:06:09.365>have <00:06:09.598>robust <00:06:09.831>safeguards <00:06:10.065>against

124
00:06:11.185 --> 00:06:12.565
<00:06:11.185>misuse <00:06:11.599>or <00:06:12.013>unattended <00:06:12.427>harm?

125
00:06:13.545 --> 00:06:15.005
<00:06:13.545>By <00:06:13.983>recognizing <00:06:14.421>that <00:06:14.859>our

126
00:06:15.565 --> 00:06:19.405
<00:06:15.565>decisions <00:06:15.740>imprint <00:06:15.915>a <00:06:16.090>moral <00:06:16.265>compass <00:06:16.440>onto <00:06:16.615>ai, <00:06:16.790>we <00:06:16.965>accept

127
00:06:19.795 --> 00:06:24.205
<00:06:19.795>that <00:06:19.935>the <00:06:20.075>true <00:06:20.215>conscience <00:06:20.355>of <00:06:20.495>AI <00:06:20.635>is <00:06:20.775>programmed <00:06:20.915>by <00:06:21.055>us, <00:06:21.195>line

128
00:06:24.205 --> 00:06:26.365
<00:06:24.205>by <00:06:24.484>line <00:06:24.765>and <00:06:25.044>dataset <00:06:25.325>by <00:06:25.604>dataset.

129
00:06:29.705 --> 00:06:32.925
<00:06:29.705>To <00:06:29.905>understand <00:06:30.104>why <00:06:30.305>this <00:06:30.505>proactive <00:06:30.705>ethical <00:06:30.905>thinking <00:06:31.104>is

130
00:06:32.985 --> 00:06:34.725
<00:06:32.985>so <00:06:33.685>crucial, <00:06:34.385>consider

131
00:06:34.755 --> 00:06:37.565
<00:06:34.755>what <00:06:34.930>happens <00:06:35.105>when <00:06:35.280>a <00:06:35.455>eye <00:06:35.630>is <00:06:35.805>deployed <00:06:35.980>without <00:06:36.155>adequate

132
00:06:37.815 --> 00:06:38.965
<00:06:37.815>moral <00:06:38.850>guardrails.

133
00:06:39.885 --> 00:06:42.405
<00:06:39.885>A <00:06:40.164>couple <00:06:40.445>of <00:06:40.724>eye <00:06:41.005>opening <00:06:41.284>cases

134
00:06:44.195 --> 00:06:45.405
<00:06:44.195>highlight <00:06:44.739>the <00:06:45.284>stakes,

135
00:06:48.185 --> 00:06:50.205
<00:06:48.185>And <00:06:48.385>you <00:06:48.585>might <00:06:48.785>have <00:06:48.985>seen <00:06:49.185>them <00:06:49.385>already <00:06:49.585>before,

136
00:06:50.225 --> 00:06:54.005
<00:06:50.225>but <00:06:50.400>just <00:06:50.575>to <00:06:50.750>reiterate, <00:06:50.925>Google <00:06:51.100>created <00:06:51.275>an <00:06:51.450>AI <00:06:51.625>system

137
00:06:54.145 --> 00:06:57.365
<00:06:54.145>to <00:06:54.344>predict <00:06:54.544>flu <00:06:54.745>outbreaks <00:06:54.945>by <00:06:55.145>analyzing <00:06:55.344>search <00:06:55.544>queries.

138
00:06:57.585 --> 00:06:59.085
<00:06:57.585>At <00:06:57.922>first <00:06:58.260>it <00:06:58.597>seemed <00:06:58.935>promising,

139
00:06:59.625 --> 00:07:01.645
<00:06:59.625>but <00:06:59.905>over <00:07:00.185>time <00:07:00.465>it <00:07:00.745>started <00:07:01.025>significantly

140
00:07:02.105 --> 00:07:03.605
<00:07:02.105>overestimating <00:07:02.780>flu <00:07:03.455>cases.

141
00:07:03.945 --> 00:07:07.125
<00:07:03.945>And <00:07:04.120>why <00:07:04.295>did <00:07:04.469>that <00:07:04.645>happen? <00:07:04.820>Because <00:07:04.995>it <00:07:05.170>mistook <00:07:05.344>seasonal

142
00:07:07.365 --> 00:07:09.885
<00:07:07.365>searches <00:07:07.598>and <00:07:07.831>media <00:07:08.065>hype <00:07:08.298>for <00:07:08.531>real <00:07:08.765>illness.

143
00:07:10.785 --> 00:07:13.485
<00:07:10.785>The <00:07:10.940>model <00:07:11.096>was <00:07:11.251>shut <00:07:11.407>down <00:07:11.562>after <00:07:11.718>it <00:07:11.873>generated <00:07:12.029>a <00:07:12.185>panic

144
00:07:13.545 --> 00:07:14.725
<00:07:13.545>and <00:07:14.076>media <00:07:14.607>frenzy.

145
00:07:15.345 --> 00:07:18.165
<00:07:15.345>It <00:07:15.578>showed <00:07:15.811>that <00:07:16.045>even <00:07:16.278>well <00:07:16.511>intentioned <00:07:16.745>AI

146
00:07:18.865 --> 00:07:22.605
<00:07:18.865>can <00:07:19.065>produce <00:07:19.265>misleading <00:07:19.465>results <00:07:19.665>when <00:07:19.865>not <00:07:20.065>regularly <00:07:20.265>validated,

147
00:07:24.425 --> 00:07:27.845
<00:07:24.425>Amazon <00:07:24.600>developed <00:07:24.775>an <00:07:24.950>AI <00:07:25.125>system <00:07:25.300>to <00:07:25.475>automate <00:07:25.650>CV <00:07:25.825>screening.

148
00:07:27.925 --> 00:07:29.605
<00:07:27.925>I <00:07:28.125>think <00:07:28.325>you <00:07:28.525>have <00:07:28.725>heard <00:07:28.925>that <00:07:29.125>as <00:07:29.325>well.

149
00:07:29.605 --> 00:07:32.645
<00:07:29.605>However, <00:07:29.805>they <00:07:30.005>discovered <00:07:30.205>the <00:07:30.405>AI <00:07:30.605>had <00:07:30.805>taught <00:07:31.005>itself

150
00:07:33.445 --> 00:07:34.445
<00:07:33.445>a <00:07:33.895>disturbing <00:07:34.344>bias.

151
00:07:35.145 --> 00:07:38.565
<00:07:35.145>It <00:07:35.344>consistently <00:07:35.544>favored <00:07:35.745>male <00:07:35.945>candidates <00:07:36.145>over <00:07:36.344>female <00:07:36.544>ones.

152
00:07:38.945 --> 00:07:42.805
<00:07:38.945>And <00:07:39.085>why? <00:07:39.224>Because <00:07:39.365>it <00:07:39.505>was <00:07:39.645>trained <00:07:39.784>on <00:07:39.925>the <00:07:40.065>company's <00:07:40.205>hiring <00:07:40.344>data

153
00:07:42.835 --> 00:07:46.205
<00:07:42.835>from <00:07:42.962>the <00:07:43.089>previous <00:07:43.216>10 <00:07:43.344>years, <00:07:43.471>a <00:07:43.598>data <00:07:43.725>set <00:07:43.853>that <00:07:43.980>was <00:07:44.107>pre <00:07:44.234>predo,

154
00:07:46.555 --> 00:07:47.765
<00:07:46.555>predominantly <00:07:47.644>male.

155
00:07:48.865 --> 00:07:51.925
<00:07:48.865>The <00:07:49.065>AI <00:07:49.265>didn't <00:07:49.465>learn <00:07:49.665>to <00:07:49.865>identify <00:07:50.065>good <00:07:50.265>candidates.

156
00:07:52.305 --> 00:07:54.525
<00:07:52.305>It <00:07:52.585>learned <00:07:52.865>to <00:07:53.145>identify <00:07:53.425>what <00:07:53.705>was

157
00:07:54.665 --> 00:07:57.645
<00:07:54.665>or <00:07:54.898>what <00:07:55.131>looked <00:07:55.365>like <00:07:55.598>successful <00:07:55.831>past <00:07:56.065>candidates.

158
00:07:58.825 --> 00:08:01.245
<00:07:58.825>It <00:07:59.058>concluded <00:07:59.291>that <00:07:59.525>male <00:07:59.758>applicants <00:07:59.991>were <00:08:00.224>preferable

159
00:08:01.245 --> 00:08:02.365
<00:08:01.245>and <00:08:01.749>actively <00:08:02.253>penalized.

160
00:08:02.455 --> 00:08:06.205
<00:08:02.455>These <00:08:02.630>that <00:08:02.805>conclude <00:08:02.979>that <00:08:03.155>contained <00:08:03.330>the <00:08:03.505>words, <00:08:03.680>uh, <00:08:03.854>women's,

161
00:08:07.025 --> 00:08:09.485
<00:08:07.025>for <00:08:07.200>example, <00:08:07.375>in <00:08:07.549>captain <00:08:07.724>of <00:08:07.900>the <00:08:08.075>women's <00:08:08.250>chess <00:08:08.424>club.

162
00:08:10.105 --> 00:08:13.365
<00:08:10.105>It <00:08:10.280>even <00:08:10.455>downgraded <00:08:10.630>graduates <00:08:10.805>of <00:08:10.980>two <00:08:11.155>all <00:08:11.330>women's <00:08:11.505>colleges.

163
00:08:13.745 --> 00:08:17.245
<00:08:13.745>And <00:08:13.900>here's <00:08:14.056>the <00:08:14.211>kicker, <00:08:14.367>Amazon <00:08:14.522>engineers <00:08:14.678>tried <00:08:14.833>to <00:08:14.989>fix <00:08:15.145>it.

164
00:08:17.515 --> 00:08:20.565
<00:08:17.515>They <00:08:17.670>tried <00:08:17.826>to <00:08:17.981>tweak <00:08:18.137>the <00:08:18.292>algorithm <00:08:18.448>to <00:08:18.603>make <00:08:18.759>it <00:08:18.914>neutral

165
00:08:20.565 --> 00:08:23.125
<00:08:20.565>to <00:08:20.798>gender <00:08:21.031>specific <00:08:21.265>terms, <00:08:21.498>but <00:08:21.731>they <00:08:21.965>couldn't.

166
00:08:23.825 --> 00:08:27.205
<00:08:23.825>The <00:08:24.025>bias <00:08:24.224>was <00:08:24.425>so <00:08:24.625>deeply <00:08:24.825>embedded <00:08:25.025>movement <00:08:25.224>into

167
00:08:27.265 --> 00:08:29.485
<00:08:27.265>so <00:08:27.498>many <00:08:27.731>subtle <00:08:27.965>correlations <00:08:28.198>in <00:08:28.431>the <00:08:28.664>data

168
00:08:30.115 --> 00:08:31.565
<00:08:30.115>that <00:08:30.376>they <00:08:30.637>could <00:08:30.898>never <00:08:31.159>be <00:08:31.420>sure

169
00:08:32.555 --> 00:08:34.165
<00:08:32.554>that <00:08:32.788>they <00:08:33.021>had <00:08:33.255>rooted <00:08:33.488>it <00:08:33.721>all <00:08:33.954>out.

170
00:08:34.385 --> 00:08:38.445
<00:08:34.385>The <00:08:34.512>system <00:08:34.639>had <00:08:34.766>become <00:08:34.894>a <00:08:35.021>black <00:08:35.148>box <00:08:35.275>of <00:08:35.403>bias <00:08:35.530>in <00:08:35.657>the <00:08:35.784>end.

171
00:08:38.445 --> 00:08:40.765
<00:08:38.445>They <00:08:38.600>had <00:08:38.756>no <00:08:38.911>choice <00:08:39.067>but <00:08:39.222>to <00:08:39.378>scrape <00:08:39.533>the <00:08:39.689>entire <00:08:39.845>tool.

172
00:08:41.875 --> 00:08:43.845
<00:08:41.875>This <00:08:42.155>case <00:08:42.434>is <00:08:42.715>a <00:08:42.995>stark <00:08:43.275>reminder

173
00:08:44.115 --> 00:08:46.805
<00:08:44.115>that <00:08:44.315>without <00:08:44.515>explicit <00:08:44.715>fairness <00:08:44.915>checks <00:08:45.115>from <00:08:45.315>the <00:08:45.515>very

174
00:08:46.805 --> 00:08:50.645
<00:08:46.805>beginning, <00:08:47.084>AI <00:08:47.364>will <00:08:47.645>not <00:08:47.925>just <00:08:48.204>observe,

175
00:08:50.825 --> 00:08:54.525
<00:08:50.825>but <00:08:51.105>amplify <00:08:51.385>historical <00:08:51.665>discrimination <00:08:51.945>and <00:08:52.225>bias.

176
00:08:55.475 --> 00:08:57.325
<00:08:55.475>It's <00:08:55.825>a <00:08:56.175>clear <00:08:56.525>ethical <00:08:56.875>lapse,

177
00:08:57.515 --> 00:08:59.285
<00:08:57.515>born <00:08:57.865>from <00:08:58.215>a <00:08:58.564>purely <00:08:58.915>technical

178
00:08:59.555 --> 00:09:02.665
<00:08:59.555>objective, <00:08:59.834>but <00:09:00.114>there <00:09:00.395>are <00:09:00.675>more <00:09:00.954>cases.

179
00:09:03.445 --> 00:09:08.145
<00:09:03.445>In <00:09:03.645>2015, <00:09:03.845>Google <00:09:04.045>photos <00:09:04.245>automatically <00:09:04.445>tacked <00:09:04.645>black <00:09:04.845>users

180
00:09:08.325 --> 00:09:10.745
<00:09:08.325>as <00:09:08.605>gorillas <00:09:08.885>using <00:09:09.165>its <00:09:09.445>image <00:09:09.725>recognition.

181
00:09:10.925 --> 00:09:13.145
<00:09:10.925>Ai, <00:09:11.275>the <00:09:11.625>fallout <00:09:11.974>was <00:09:12.324>immense.

182
00:09:14.205 --> 00:09:16.145
<00:09:14.205>Google <00:09:14.555>disabled <00:09:14.905>the <00:09:15.255>feature <00:09:15.605>entirely,

183
00:09:16.565 --> 00:09:18.745
<00:09:16.565>but <00:09:16.740>failed <00:09:16.915>to <00:09:17.090>fix <00:09:17.265>the <00:09:17.440>root <00:09:17.615>cause <00:09:17.790>for <00:09:17.965>years.

184
00:09:19.445 --> 00:09:20.785
<00:09:19.445>It <00:09:19.686>remains <00:09:19.927>one <00:09:20.168>of <00:09:20.409>the <00:09:20.651>most

185
00:09:20.845 --> 00:09:24.345
<00:09:20.845>and <00:09:21.020>famous <00:09:21.195>examples <00:09:21.370>of <00:09:21.545>racial <00:09:21.720>bias <00:09:21.895>embedded <00:09:22.070>into <00:09:22.245>ai.

186
00:09:24.965 --> 00:09:26.065
<00:09:24.965>And <00:09:25.295>a <00:09:25.625>brutal <00:09:25.955>reminder

187
00:09:26.065 --> 00:09:28.665
<00:09:26.065>that <00:09:26.240>even <00:09:26.415>world <00:09:26.590>class <00:09:26.765>AI <00:09:26.940>teams <00:09:27.115>are <00:09:27.290>not <00:09:27.465>immune

188
00:09:28.665 --> 00:09:30.545
<00:09:28.665>to <00:09:29.131>ethical <00:09:29.598>oversight <00:09:30.064>failures.

189
00:09:32.975 --> 00:09:35.705
<00:09:32.975>Another <00:09:33.175>one, <00:09:33.375>TE <00:09:33.575>was <00:09:33.775>an <00:09:33.975>AI <00:09:34.175>chat <00:09:34.375>bot

190
00:09:36.265 --> 00:09:38.065
<00:09:36.265>Microsoft <00:09:36.615>released <00:09:36.965>on <00:09:37.314>Twitter <00:09:37.665>designed

191
00:09:38.065 --> 00:09:39.785
<00:09:38.065>to <00:09:38.415>learn <00:09:38.765>from <00:09:39.115>online <00:09:39.465>interactions.

192
00:09:40.365 --> 00:09:43.705
<00:09:40.365>The <00:09:40.540>idea <00:09:40.715>was <00:09:40.890>beautiful, <00:09:41.065>an <00:09:41.240>AI <00:09:41.415>that <00:09:41.590>would <00:09:41.765>learn

193
00:09:44.165 --> 00:09:47.545
<00:09:44.165>or <00:09:44.339>grow <00:09:44.515>smarter <00:09:44.689>and <00:09:44.865>learn <00:09:45.040>from <00:09:45.214>humans <00:09:45.390>by <00:09:45.564>engaging

194
00:09:47.845 --> 00:09:49.105
<00:09:47.845>and <00:09:48.128>talking <00:09:48.412>to <00:09:48.695>real <00:09:48.979>people

195
00:09:49.775 --> 00:09:52.105
<00:09:49.775>with <00:09:50.008>just <00:09:50.241>sit <00:09:50.475>within <00:09:50.708>just <00:09:50.941>16 <00:09:51.175>hours.

196
00:09:52.665 --> 00:09:55.985
<00:09:52.665>Tay <00:09:52.820>went <00:09:52.976>from <00:09:53.131>friendly <00:09:53.287>greetings, <00:09:53.442>like <00:09:53.598>humans <00:09:53.753>are <00:09:53.909>super <00:09:54.064>cool

197
00:09:56.405 --> 00:10:00.905
<00:09:56.405>to <00:09:56.579>spewing <00:09:56.755>shocking <00:09:56.930>vile <00:09:57.105>hate <00:09:57.280>speech, <00:09:57.454>it <00:09:57.630>parroted <00:09:57.805>extremist

198
00:10:01.005 --> 00:10:02.105
<00:10:01.005>and <00:10:01.500>racist <00:10:01.995>remarks.

199
00:10:02.125 --> 00:10:04.505
<00:10:02.125>It <00:10:02.325>learned <00:10:02.525>from <00:10:02.725>trolls <00:10:02.925>who <00:10:03.125>had <00:10:03.325>targeted <00:10:03.525>it.

200
00:10:04.535 --> 00:10:07.625
<00:10:04.535>Over <00:10:04.709>the <00:10:04.885>day, <00:10:05.060>the <00:10:05.235>AI <00:10:05.410>began <00:10:05.584>to <00:10:05.760>harass <00:10:05.935>people,

201
00:10:08.065 --> 00:10:09.905
<00:10:08.065>proclaim <00:10:08.415>its <00:10:08.765>support <00:10:09.115>for <00:10:09.465>Hitler

202
00:10:10.045 --> 00:10:12.625
<00:10:10.045>and <00:10:10.278>generated <00:10:10.511>a <00:10:10.745>nonstop <00:10:10.978>stream <00:10:11.211>of <00:10:11.444>offensive

203
00:10:13.175 --> 00:10:14.425
<00:10:13.175>nightmare <00:10:14.300>tweets.

204
00:10:14.785 --> 00:10:18.585
<00:10:14.785>I <00:10:14.901>had <00:10:15.018>to, <00:10:15.135>to <00:10:15.251>cross <00:10:15.368>them <00:10:15.485>out <00:10:15.601>here. <00:10:15.718>It's <00:10:15.834>not <00:10:15.951>nice <00:10:16.068>to <00:10:16.185>read.

205
00:10:19.405 --> 00:10:21.345
<00:10:19.405>Why <00:10:19.685>did <00:10:19.964>this <00:10:20.245>happen <00:10:20.525>so <00:10:20.805>spectacularly?

206
00:10:21.345 --> 00:10:23.025
<00:10:21.345>Because <00:10:21.625>TE <00:10:21.905>was <00:10:22.185>built <00:10:22.465>to <00:10:22.745>learn

207
00:10:23.025 --> 00:10:24.985
<00:10:23.025>and <00:10:23.305>mimic <00:10:23.584>language <00:10:23.865>without <00:10:24.145>a <00:10:24.425>conscience.

208
00:10:25.645 --> 00:10:29.625
<00:10:25.645>It <00:10:25.819>had <00:10:25.995>no <00:10:26.170>ethical <00:10:26.345>filter, <00:10:26.520>no <00:10:26.694>built-in <00:10:26.870>understanding <00:10:27.045>of

209
00:10:29.625 --> 00:10:33.185
<00:10:29.625>what <00:10:29.905>was <00:10:30.185>appropriate, <00:10:30.465>hateful, <00:10:30.745>or <00:10:31.025>dangerous.

210
00:10:33.725 --> 00:10:35.585
<00:10:33.725>It <00:10:34.005>was <00:10:34.285>a <00:10:34.565>mi <00:10:34.845>mirror <00:10:35.125>reflection

211
00:10:36.405 --> 00:10:38.705
<00:10:36.405>of <00:10:36.560>the <00:10:36.716>language <00:10:36.871>it <00:10:37.027>was <00:10:37.182>shown <00:10:37.338>in <00:10:37.493>A <00:10:37.649>small <00:10:37.805>group

212
00:10:38.705 --> 00:10:42.065
<00:10:38.705>of <00:10:38.860>malicious <00:10:39.016>users <00:10:39.171>showed <00:10:39.327>it <00:10:39.482>the <00:10:39.638>absolute <00:10:39.793>worst <00:10:39.949>of <00:10:40.105>humanity.

213
00:10:43.215 --> 00:10:46.345
<00:10:43.215>This <00:10:43.448>cause <00:10:43.681>catastrophic <00:10:43.915>failure <00:10:44.148>showed <00:10:44.381>the <00:10:44.615>world

214
00:10:46.425 --> 00:10:50.665
<00:10:46.425>that <00:10:46.552>an <00:10:46.679>AI <00:10:46.806>without <00:10:46.934>a <00:10:47.061>moral <00:10:47.188>compass <00:10:47.315>can <00:10:47.443>be <00:10:47.570>hijacked <00:10:47.697>in <00:10:47.824>ours,

215
00:10:50.855 --> 00:10:53.705
<00:10:50.855>causing <00:10:51.088>immense <00:10:51.321>damage <00:10:51.555>to <00:10:51.788>a <00:10:52.021>company's <00:10:52.255>reputation

216
00:10:54.125 --> 00:10:55.465
<00:10:54.125>and <00:10:54.426>real <00:10:54.728>harm <00:10:55.029>to <00:10:55.331>users.

217
00:10:58.015 --> 00:11:00.745
<00:10:58.015>Clearview <00:10:58.215>escape <00:10:58.415>billions <00:10:58.615>of <00:10:58.814>photos <00:10:59.015>from <00:10:59.215>the <00:10:59.415>internet

218
00:11:00.745 --> 00:11:04.225
<00:11:00.745>to <00:11:00.900>create <00:11:01.056>a <00:11:01.211>facial <00:11:01.367>recognition <00:11:01.522>tool <00:11:01.678>sold <00:11:01.833>to <00:11:01.989>law <00:11:02.145>enforcement.

219
00:11:04.915 --> 00:11:08.625
<00:11:04.915>Users <00:11:05.148>could <00:11:05.381>identify <00:11:05.615>individuals <00:11:05.848>with <00:11:06.081>frightening <00:11:06.314>accuracy,

220
00:11:09.135 --> 00:11:11.185
<00:11:09.135>including <00:11:09.601>children <00:11:10.068>and <00:11:10.535>protestors.

221
00:11:12.095 --> 00:11:14.185
<00:11:12.095>Critics <00:11:12.375>called <00:11:12.655>it <00:11:12.935>a <00:11:13.215>privacy <00:11:13.495>nightmare.

222
00:11:14.825 --> 00:11:18.145
<00:11:14.825>Lawsuits <00:11:15.058>and <00:11:15.291>bans <00:11:15.525>followed <00:11:15.758>in <00:11:15.991>several <00:11:16.225>countries,

223
00:11:18.725 --> 00:11:21.425
<00:11:18.725>and <00:11:18.880>it <00:11:19.036>was <00:11:19.191>shut <00:11:19.347>down <00:11:19.502>in <00:11:19.658>most <00:11:19.813>of <00:11:19.969>the <00:11:20.125>countries.

224
00:11:21.665 --> 00:11:26.025
<00:11:21.665>Actually, <00:11:21.820>this <00:11:21.976>is <00:11:22.131>a <00:11:22.287>stark <00:11:22.442>example <00:11:22.598>of <00:11:22.753>powerful <00:11:22.909>tech <00:11:23.064>deployed

225
00:11:26.025 --> 00:11:28.625
<00:11:26.025>with <00:11:26.375>almost <00:11:26.725>no <00:11:27.074>ethical <00:11:27.425>guardrails.

226
00:11:30.335 --> 00:11:35.065
<00:11:30.335>Last <00:11:30.475>one. <00:11:30.615>During <00:11:30.755>a <00:11:30.895>test <00:11:31.035>run <00:11:31.175>in <00:11:31.315>Arizona <00:11:31.455>in <00:11:31.595>2018, <00:11:31.735>one

227
00:11:35.065 --> 00:11:37.025
<00:11:35.065>of <00:11:35.415>Uber's <00:11:35.765>autonomous <00:11:36.115>vehicles <00:11:36.465>struck

228
00:11:37.025 --> 00:11:39.025
<00:11:37.025>and <00:11:37.375>killed <00:11:37.725>a <00:11:38.074>pedestrian <00:11:38.425>invest.

229
00:11:39.285 --> 00:11:41.825
<00:11:39.285>An <00:11:39.751>investigations, <00:11:40.218>uh, <00:11:40.685>revealed

230
00:11:41.825 --> 00:11:45.755
<00:11:41.825>that <00:11:42.025>the <00:11:42.225>car's <00:11:42.425>emergency <00:11:42.625>brake <00:11:42.825>had <00:11:43.025>been <00:11:43.225>disabled

231
00:11:46.095 --> 00:11:47.595
<00:11:46.095>to <00:11:46.545>avoid <00:11:46.995>erratic <00:11:47.445>driving.

232
00:11:48.145 --> 00:11:51.835
<00:11:48.145>That <00:11:48.300>means, <00:11:48.456>again, <00:11:48.611>no <00:11:48.767>effective <00:11:48.922>kill <00:11:49.078>switch <00:11:49.233>was <00:11:49.389>in <00:11:49.545>place.

233
00:11:52.495 --> 00:11:55.525
<00:11:52.495>The <00:11:52.670>fatal <00:11:52.845>accident <00:11:53.020>led <00:11:53.195>to <00:11:53.370>a <00:11:53.545>suspension <00:11:53.720>of <00:11:53.895>testing

234
00:11:55.625 --> 00:11:58.485
<00:11:55.625>and <00:11:55.905>raised <00:11:56.185>alarms <00:11:56.465>about <00:11:56.745>safety <00:11:57.025>thresholds

235
00:11:58.485 --> 00:11:59.925
<00:11:58.485>for <00:11:59.133>self-driving <00:11:59.781>technology.

236
00:12:01.355 --> 00:12:04.605
<00:12:01.355>Tesla's <00:12:01.635>audible <00:12:01.915>systems <00:12:02.195>allows <00:12:02.475>semi-autonomous <00:12:02.755>driving,

237
00:12:04.705 --> 00:12:07.325
<00:12:04.705>but <00:12:04.985>users <00:12:05.265>often <00:12:05.545>misunderstood <00:12:05.825>its <00:12:06.105>limits.

238
00:12:07.555 --> 00:12:11.765
<00:12:07.555>Several <00:12:07.729>fatal <00:12:07.905>crashes <00:12:08.079>occurred <00:12:08.255>when <00:12:08.430>drivers <00:12:08.604>rely <00:12:08.780>too <00:12:08.954>heavily

239
00:12:11.905 --> 00:12:14.845
<00:12:11.905>on <00:12:12.105>the <00:12:12.305>system, <00:12:12.505>assuming <00:12:12.704>it <00:12:12.905>could <00:12:13.105>drive <00:12:13.305>completely,

240
00:12:15.245 --> 00:12:16.325
<00:12:15.245>entirely <00:12:16.217>autonomously.

241
00:12:17.185 --> 00:12:19.765
<00:12:17.185>Um, <00:12:17.359>and <00:12:17.535>Tesla <00:12:17.709>emphasized <00:12:17.885>that <00:12:18.060>driver <00:12:18.234>must <00:12:18.410>stay <00:12:18.584>alert,

242
00:12:19.765 --> 00:12:22.125
<00:12:19.765>but <00:12:19.965>the <00:12:20.165>interface <00:12:20.365>didn't <00:12:20.564>enforce <00:12:20.765>that <00:12:20.965>well <00:12:21.165>enough.

243
00:12:22.795 --> 00:12:26.245
<00:12:22.795>This <00:12:22.969>is <00:12:23.145>a <00:12:23.319>warning <00:12:23.495>that <00:12:23.670>unclear <00:12:23.844>responsibility <00:12:24.020>can <00:12:24.194>lead

244
00:12:26.245 --> 00:12:27.605
<00:12:26.245>to <00:12:26.857>deadly <00:12:27.469>overconfidence.

245
00:12:30.225 --> 00:12:34.685
<00:12:30.225>So <00:12:30.352>these <00:12:30.479>as <00:12:30.606>examples <00:12:30.734>are <00:12:30.861>sobering <00:12:30.988>in <00:12:31.115>all <00:12:31.243>these <00:12:31.370>cases, <00:12:31.497>a <00:12:31.625>sort

246
00:12:34.685 --> 00:12:38.165
<00:12:34.685>of <00:12:34.885>kill <00:12:35.084>switch <00:12:35.285>was <00:12:35.484>either <00:12:35.685>used <00:12:35.885>too <00:12:36.084>late

247
00:12:39.185 --> 00:12:41.405
<00:12:39.185>or <00:12:39.359>no <00:12:39.535>kill <00:12:39.709>switch <00:12:39.885>was <00:12:40.060>in <00:12:40.234>place <00:12:40.410>at <00:12:40.584>all.

248
00:12:41.825 --> 00:12:44.005
<00:12:41.825>At <00:12:41.980>the <00:12:42.136>end <00:12:42.291>of <00:12:42.447>the <00:12:42.602>day, <00:12:42.758>the <00:12:42.913>damage <00:12:43.069>was <00:12:43.225>done

249
00:12:44.005 --> 00:12:45.005
<00:12:44.005>and <00:12:44.230>the <00:12:44.455>lesson <00:12:44.680>were <00:12:44.905>learned.

250
00:12:45.005 --> 00:12:47.765
<00:12:45.005>The <00:12:45.205>hard <00:12:45.405>way <00:12:45.605>the <00:12:45.805>takeaway <00:12:46.005>is <00:12:46.205>crystal <00:12:46.405>clear.

251
00:12:48.235 --> 00:12:50.045
<00:12:48.235>It's <00:12:48.701>far <00:12:49.168>better, <00:12:49.635>cheaper

252
00:12:50.305 --> 00:12:52.005
<00:12:50.305>and <00:12:50.655>safer <00:12:51.005>to <00:12:51.354>build <00:12:51.704>AI

253
00:12:52.155 --> 00:12:54.845
<00:12:52.155>with <00:12:52.355>an <00:12:52.555>ethical <00:12:52.755>compass <00:12:52.954>from <00:12:53.155>the <00:12:53.355>start <00:12:53.555>than

254
00:12:54.845 --> 00:12:57.525
<00:12:54.845>to <00:12:55.195>rely <00:12:55.545>on <00:12:55.895>emergency <00:12:56.245>shutdowns

255
00:12:57.735 --> 00:12:59.605
<00:12:57.735>after <00:12:58.015>things <00:12:58.295>have <00:12:58.575>already <00:12:58.855>gone <00:12:59.135>wrong.

256
00:13:00.265 --> 00:13:03.445
<00:13:00.265>Our <00:13:00.405>goal <00:13:00.545>must <00:13:00.685>be <00:13:00.824>to <00:13:00.965>minimize <00:13:01.105>the <00:13:01.245>need <00:13:01.385>for <00:13:01.525>kill <00:13:01.665>switches

257
00:13:03.465 --> 00:13:06.165
<00:13:03.465>by <00:13:03.815>anticipating <00:13:04.165>these <00:13:04.515>ethical <00:13:04.865>risk

258
00:13:06.265 --> 00:13:09.285
<00:13:06.265>and <00:13:06.439>addressing <00:13:06.615>them <00:13:06.790>in <00:13:06.965>the <00:13:07.140>design <00:13:07.314>and <00:13:07.490>testing <00:13:07.665>phase.

259
00:13:10.025 --> 00:13:13.245
<00:13:10.025>And <00:13:10.258>in <00:13:10.491>the <00:13:10.725>next <00:13:10.958>section, <00:13:11.191>we <00:13:11.425>discuss

260
00:13:13.265 --> 00:13:14.645
<00:13:13.265>how <00:13:13.513>we <00:13:13.761>can <00:13:14.010>do <00:13:14.258>that <00:13:14.507>exactly.

261
00:13:16.505 --> 00:13:21.085
<00:13:16.505>So <00:13:16.645>first, <00:13:16.785>strive <00:13:16.925>to <00:13:17.064>ensure <00:13:17.205>our <00:13:17.345>AI <00:13:17.485>system <00:13:17.625>do <00:13:17.765>not <00:13:17.905>discriminate

262
00:13:21.305 --> 00:13:23.445
<00:13:21.305>or <00:13:21.771>reinforce <00:13:22.238>unfair <00:13:22.704>biases.

263
00:13:24.025 --> 00:13:28.405
<00:13:24.025>And <00:13:24.225>we <00:13:24.425>all <00:13:24.625>know <00:13:24.824>that, <00:13:25.025>that <00:13:25.225>human <00:13:25.425>people,

264
00:13:28.755 --> 00:13:30.485
<00:13:28.755>they, <00:13:28.955>they <00:13:29.155>also <00:13:29.355>have <00:13:29.555>a <00:13:29.755>lot <00:13:29.955>of <00:13:30.155>biases.

265
00:13:31.345 --> 00:13:32.605
<00:13:31.345>So <00:13:31.571>this <00:13:31.798>is <00:13:32.025>a <00:13:32.252>hard <00:13:32.479>one.

266
00:13:32.625 --> 00:13:36.525
<00:13:32.625>But <00:13:32.825>in <00:13:33.025>practice, <00:13:33.225>this <00:13:33.425>means <00:13:33.625>using <00:13:33.825>diverse <00:13:34.025>representative

267
00:13:37.035 --> 00:13:39.365
<00:13:37.035>data <00:13:37.235>sets <00:13:37.435>and <00:13:37.635>testing <00:13:37.834>our <00:13:38.035>models <00:13:38.235>for <00:13:38.435>bias.

268
00:13:40.305 --> 00:13:42.925
<00:13:40.305>We <00:13:40.538>can <00:13:40.771>leverage <00:13:41.005>open <00:13:41.238>source <00:13:41.471>toolkits <00:13:41.704>like

269
00:13:43.535 --> 00:13:48.525
<00:13:43.535>IBM's <00:13:43.690>ai <00:13:43.846>fairness <00:13:44.001>360, <00:13:44.157>which <00:13:44.312>provides <00:13:44.468>metrics <00:13:44.623>to <00:13:44.779>detect <00:13:44.935>bias

270
00:13:48.585 --> 00:13:50.885
<00:13:48.585>and <00:13:48.818>models <00:13:49.051>and <00:13:49.285>algorithms <00:13:49.518>to <00:13:49.751>mitigate <00:13:49.985>it.

271
00:13:51.595 --> 00:13:55.165
<00:13:51.595>Regular <00:13:51.795>bias, <00:13:51.995>audit <00:13:52.195>and <00:13:52.395>involvement <00:13:52.595>of <00:13:52.795>diverse <00:13:52.995>teams.

272
00:13:56.315 --> 00:13:57.765
<00:13:56.315>Team <00:13:56.750>members, <00:13:57.185>in <00:13:57.620>fact,

273
00:13:57.765 --> 00:13:59.805
<00:13:57.765>in <00:13:57.998>development <00:13:58.231>can <00:13:58.465>help <00:13:58.698>catch <00:13:58.931>blind <00:13:59.165>spots.

274
00:14:00.865 --> 00:14:03.725
<00:14:00.865>Our <00:14:01.098>Amazon <00:14:01.331>example <00:14:01.565>showed <00:14:01.798>why <00:14:02.031>this <00:14:02.265>matters.

275
00:14:03.865 --> 00:14:06.405
<00:14:03.865>If <00:14:04.098>we <00:14:04.331>don't <00:14:04.565>deliberately <00:14:04.798>build <00:14:05.031>for <00:14:05.265>fairness,

276
00:14:06.715 --> 00:14:08.005
<00:14:06.715>bias <00:14:07.102>will <00:14:07.489>sneak <00:14:07.876>in.

277
00:14:08.985 --> 00:14:11.965
<00:14:08.985>And <00:14:09.185>as <00:14:09.385>ethical <00:14:09.585>developers, <00:14:09.785>we <00:14:09.985>must <00:14:10.185>treat <00:14:10.385>fairness

278
00:14:12.145 --> 00:14:15.125
<00:14:12.145>as <00:14:12.345>a <00:14:12.545>core <00:14:12.745>requirement, <00:14:12.944>not <00:14:13.145>an <00:14:13.345>optional <00:14:13.545>feature.

279
00:14:17.335 --> 00:14:21.235
<00:14:17.335>Second, <00:14:17.490>AI <00:14:17.646>decision <00:14:17.801>should <00:14:17.957>not <00:14:18.112>be <00:14:18.268>a <00:14:18.423>mysterious <00:14:18.579>black <00:14:18.735>box,

280
00:14:21.485 --> 00:14:23.675
<00:14:21.485>especially <00:14:21.835>in <00:14:22.185>high <00:14:22.535>stake <00:14:22.885>applications.

281
00:14:24.135 --> 00:14:25.595
<00:14:24.135>We <00:14:24.354>should <00:14:24.573>aim <00:14:24.792>to <00:14:25.011>make <00:14:25.230>our <00:14:25.449>systems

282
00:14:25.825 --> 00:14:27.275
<00:14:25.825>explainable <00:14:26.477>and <00:14:27.130>transparent.

283
00:14:27.865 --> 00:14:31.355
<00:14:27.865>This <00:14:28.098>could <00:14:28.331>involve <00:14:28.565>choosing <00:14:28.798>interpretable <00:14:29.031>models <00:14:29.265>when

284
00:14:31.715 --> 00:14:34.955
<00:14:31.715>possibly, <00:14:32.181>um, <00:14:32.648>when <00:14:33.115>possible,

285
00:14:35.215 --> 00:14:37.435
<00:14:35.215>or <00:14:35.448>adding <00:14:35.681>explanation <00:14:35.915>models <00:14:36.148>that <00:14:36.381>help <00:14:36.615>users

286
00:14:37.535 --> 00:14:41.515
<00:14:37.535>or <00:14:37.690>regulators <00:14:37.846>understand <00:14:38.001>why <00:14:38.157>the <00:14:38.312>AI <00:14:38.468>made <00:14:38.623>a <00:14:38.779>certain <00:14:38.935>decision.

287
00:14:42.495 --> 00:14:45.875
<00:14:42.495>For <00:14:42.650>example, <00:14:42.806>if <00:14:42.961>an <00:14:43.117>AI <00:14:43.272>model <00:14:43.428>denies <00:14:43.583>a <00:14:43.739>loan <00:14:43.895>application

288
00:14:45.875 --> 00:14:49.755
<00:14:45.875>or <00:14:46.015>flex <00:14:46.155>a <00:14:46.295>medical <00:14:46.435>image <00:14:46.575>as <00:14:46.715>malignant, <00:14:46.855>it <00:14:46.995>should <00:14:47.135>be <00:14:47.275>able

289
00:14:49.755 --> 00:14:52.805
<00:14:49.755>to <00:14:49.955>provide <00:14:50.155>the <00:14:50.355>key <00:14:50.555>factors <00:14:50.755>behind <00:14:50.955>that <00:14:51.155>decision.

290
00:14:52.905 --> 00:14:54.725
<00:14:52.905>In <00:14:53.371>human <00:14:53.838>readable <00:14:54.305>terms,

291
00:14:55.655 --> 00:15:00.125
<00:14:55.655>techniques <00:14:55.855>like <00:14:56.055>model <00:14:56.255>interpretability <00:14:56.454>tools <00:14:56.655>or <00:14:56.855>model <00:14:57.055>cards.

292
00:15:00.905 --> 00:15:01.965
<00:15:00.905>So <00:15:01.859>documentation

293
00:15:02.185 --> 00:15:05.245
<00:15:02.185>of <00:15:02.385>a <00:15:02.584>model's <00:15:02.785>intended <00:15:02.984>use <00:15:03.185>performance <00:15:03.385>and <00:15:03.584>limitations.

294
00:15:06.435 --> 00:15:09.655
<00:15:06.435>All <00:15:06.635>these <00:15:06.834>are <00:15:07.035>practical <00:15:07.234>ways <00:15:07.435>to <00:15:07.635>increase <00:15:07.834>transparency.

295
00:15:11.385 --> 00:15:13.975
<00:15:11.385>Third, <00:15:11.618>even <00:15:11.851>the <00:15:12.085>best <00:15:12.318>AI <00:15:12.551>can <00:15:12.785>fail.

296
00:15:14.345 --> 00:15:17.215
<00:15:14.345>We've <00:15:14.545>seen <00:15:14.745>that <00:15:14.945>yesterday <00:15:15.145>in <00:15:15.345>the <00:15:15.545>keynote <00:15:15.745>basically.

297
00:15:17.715 --> 00:15:21.055
<00:15:17.715>So <00:15:17.855>we <00:15:17.995>must <00:15:18.135>design <00:15:18.275>systems <00:15:18.415>with <00:15:18.555>a <00:15:18.695>human <00:15:18.835>in <00:15:18.975>the <00:15:19.115>loop

298
00:15:21.055 --> 00:15:22.615
<00:15:21.055>and <00:15:21.405>clear <00:15:21.755>lines <00:15:22.104>of <00:15:22.454>accountability.

299
00:15:23.245 --> 00:15:26.895
<00:15:23.245>This <00:15:23.420>means <00:15:23.595>defining <00:15:23.770>who <00:15:23.945>on <00:15:24.120>the <00:15:24.295>team <00:15:24.470>is <00:15:24.645>responsible

300
00:15:26.915 --> 00:15:28.255
<00:15:26.915>for <00:15:27.317>the <00:15:27.718>AI's <00:15:28.121>outcomes

301
00:15:28.515 --> 00:15:32.895
<00:15:28.515>and <00:15:28.689>how <00:15:28.865>issues <00:15:29.040>will <00:15:29.215>be <00:15:29.390>addressed <00:15:29.564>in <00:15:29.740>critical <00:15:29.915>applications.

302
00:15:33.035 --> 00:15:35.655
<00:15:33.035>Having <00:15:33.235>a <00:15:33.435>human <00:15:33.635>review <00:15:33.834>of <00:15:34.035>final <00:15:34.235>approval <00:15:34.435>step

303
00:15:35.655 --> 00:15:38.415
<00:15:35.655>for <00:15:35.810>AI <00:15:35.966>decisions <00:15:36.121>can <00:15:36.277>add <00:15:36.432>a <00:15:36.588>layer <00:15:36.743>of <00:15:36.899>moral <00:15:37.055>judgment

304
00:15:39.245 --> 00:15:41.295
<00:15:39.245>that <00:15:39.711>pure <00:15:40.178>algorithm <00:15:40.645>lacks.

305
00:15:42.175 --> 00:15:45.815
<00:15:42.175>Moreover, <00:15:42.349>if <00:15:42.525>or <00:15:42.699>when <00:15:42.875>an <00:15:43.050>AI <00:15:43.224>does <00:15:43.400>cause <00:15:43.574>harm

306
00:15:45.835 --> 00:15:49.335
<00:15:45.835>or <00:15:45.990>a <00:15:46.146>mistake, <00:15:46.301>ethical <00:15:46.457>practice <00:15:46.612>means <00:15:46.768>owning <00:15:46.923>up <00:15:47.079>to <00:15:47.235>it

307
00:15:49.335 --> 00:15:51.735
<00:15:49.335>and <00:15:49.535>learning <00:15:49.735>from <00:15:49.935>it <00:15:50.135>rather <00:15:50.335>than <00:15:50.535>deflecting <00:15:50.735>blame.

308
00:15:52.695 --> 00:15:54.095
<00:15:52.695>A <00:15:53.115>culture <00:15:53.535>of <00:15:53.955>accountability

309
00:15:54.235 --> 00:15:58.405
<00:15:54.235>and <00:15:54.410>technical <00:15:54.585>teams <00:15:54.760>ensures <00:15:54.935>that <00:15:55.110>everyone <00:15:55.285>from <00:15:55.460>the <00:15:55.635>engineers

310
00:15:58.405 --> 00:16:02.245
<00:15:58.405>to <00:15:58.560>leads <00:15:58.716>is <00:15:58.871>vigilant <00:15:59.027>about <00:15:59.182>the <00:15:59.338>AI <00:15:59.493>behaviors <00:15:59.649>and <00:15:59.805>impact.

311
00:16:03.785 --> 00:16:08.565
<00:16:03.785>Fourth, <00:16:03.985>respect <00:16:04.185>for <00:16:04.385>user <00:16:04.584>privacy <00:16:04.785>as <00:16:04.985>foundational, <00:16:05.185>ethical,

312
00:16:09.065 --> 00:16:10.645
<00:16:09.065>and <00:16:09.531>legal <00:16:09.998>PR <00:16:10.465>principle.

313
00:16:11.115 --> 00:16:15.445
<00:16:11.115>Technical <00:16:11.348>teams <00:16:11.581>should <00:16:11.815>enforce <00:16:12.048>strong <00:16:12.281>privacy <00:16:12.515>safeguards,

314
00:16:15.715 --> 00:16:19.885
<00:16:15.715>anonymizing <00:16:15.948>personal <00:16:16.181>data <00:16:16.415>following <00:16:16.648>regulations <00:16:16.881>like <00:16:17.115>GDPR

315
00:16:20.185 --> 00:16:23.965
<00:16:20.185>and <00:16:20.385>minimizing <00:16:20.584>data <00:16:20.785>collection <00:16:20.984>to <00:16:21.185>only <00:16:21.385>what's <00:16:21.584>necessary.

316
00:16:24.355 --> 00:16:26.125
<00:16:24.355>Privacy <00:16:24.705>by <00:16:25.055>design <00:16:25.405>is <00:16:25.755>key.

317
00:16:26.625 --> 00:16:28.925
<00:16:26.625>For <00:16:26.780>instance, <00:16:26.936>if <00:16:27.091>we <00:16:27.247>are <00:16:27.402>building <00:16:27.558>an <00:16:27.713>AI <00:16:27.869>that <00:16:28.025>user

318
00:16:29.515 --> 00:16:30.565
<00:16:29.515>uses <00:16:29.987>user <00:16:30.460>data,

319
00:16:31.145 --> 00:16:34.245
<00:16:31.145>we <00:16:31.425>should <00:16:31.704>incorporate <00:16:31.985>encryption <00:16:32.265>access <00:16:32.545>controls

320
00:16:34.245 --> 00:16:37.525
<00:16:34.245>and <00:16:34.595>obtain <00:16:34.945>information <00:16:35.295>consent <00:16:35.645>like

321
00:16:37.625 --> 00:16:39.165
<00:16:37.625>for <00:16:37.971>every <00:16:38.318>other <00:16:38.664>application, <00:16:39.011>right?

322
00:16:40.065 --> 00:16:44.045
<00:16:40.065>An <00:16:40.220>AI <00:16:40.376>with <00:16:40.531>a <00:16:40.687>moral <00:16:40.842>compass <00:16:40.998>never <00:16:41.153>betrays <00:16:41.309>user <00:16:41.465>trust.

323
00:16:45.135 --> 00:16:49.765
<00:16:45.135>Fifth, <00:16:45.262>we <00:16:45.389>have <00:16:45.516>a <00:16:45.644>duty <00:16:45.771>to <00:16:45.898>ensure <00:16:46.025>our <00:16:46.153>AI <00:16:46.280>systems <00:16:46.407>are <00:16:46.535>safe,

324
00:16:50.285 --> 00:16:52.285
<00:16:50.285>reliable, <00:16:50.564>and <00:16:50.844>drove <00:16:51.125>us <00:16:51.405>against <00:16:51.685>misuse.

325
00:16:53.285 --> 00:16:55.525
<00:16:53.285>Rigorous <00:16:53.635>testing, <00:16:53.985>including <00:16:54.334>edge <00:16:54.685>cases

326
00:16:55.665 --> 00:16:57.965
<00:16:55.665>and <00:16:56.015>adversary <00:16:56.365>scenarios, <00:16:56.714>is <00:16:57.064>essential

327
00:16:58.385 --> 00:16:59.605
<00:16:58.385>before <00:16:59.483>deployment,

328
00:17:00.095 --> 00:17:03.125
<00:17:00.095>especially <00:17:00.375>in <00:17:00.655>life <00:17:00.935>critical <00:17:01.215>domains <00:17:01.495>like

329
00:17:03.125 --> 00:17:04.565
<00:17:03.125>healthcare <00:17:03.773>or <00:17:04.421>transportation.

330
00:17:05.955 --> 00:17:09.165
<00:17:05.954>Part <00:17:06.095>of <00:17:06.234>safety <00:17:06.375>is <00:17:06.514>indeed <00:17:06.655>having <00:17:06.794>an <00:17:06.935>emergency <00:17:07.074>kills <00:17:07.214>which <00:17:07.355>are

331
00:17:09.165 --> 00:17:13.885
<00:17:09.165>fail <00:17:09.320>safe <00:17:09.476>in <00:17:09.631>place, <00:17:09.787>an <00:17:09.942>ability <00:17:10.098>to <00:17:10.253>immediately <00:17:10.409>shut <00:17:10.565>down

332
00:17:13.985 --> 00:17:16.125
<00:17:13.984>or <00:17:14.185>disengage <00:17:14.385>an <00:17:14.584>AI <00:17:14.784>system <00:17:14.984>that <00:17:15.185>is <00:17:15.385>acting

333
00:17:16.835 --> 00:17:18.525
<00:17:16.835>predictably <00:17:17.535>or <00:17:18.235>dangerously.

334
00:17:19.955 --> 00:17:22.325
<00:17:19.954>Such <00:17:20.155>kilt <00:17:20.355>switches <00:17:20.554>are <00:17:20.754>crucial <00:17:20.954>as <00:17:21.155>the <00:17:21.355>last

335
00:17:23.065 --> 00:17:24.245
<00:17:23.065>resort <00:17:23.596>safety <00:17:24.127>measure.

336
00:17:24.355 --> 00:17:28.365
<00:17:24.355>However, <00:17:24.510>relying <00:17:24.666>solely <00:17:24.821>on <00:17:24.977>the <00:17:25.132>kilt <00:17:25.288>switch <00:17:25.443>shouldn't <00:17:25.599>be <00:17:25.755>an

337
00:17:28.365 --> 00:17:29.605
<00:17:28.365>excuse <00:17:28.737>for <00:17:29.109>poor <00:17:29.481>design.

338
00:17:30.465 --> 00:17:32.285
<00:17:30.465>As <00:17:30.814>one <00:17:31.165>AI <00:17:31.514>ethics <00:17:31.865>commented,

339
00:17:33.025 --> 00:17:36.245
<00:17:33.025>always <00:17:33.165>keeping <00:17:33.305>a <00:17:33.445>human <00:17:33.585>operator <00:17:33.725>ready <00:17:33.865>to <00:17:34.005>hit <00:17:34.145>the <00:17:34.285>kilt <00:17:34.425>switch

340
00:17:37.225 --> 00:17:39.005
<00:17:37.225>can <00:17:37.504>in <00:17:37.784>fact <00:17:38.064>negate <00:17:38.344>many <00:17:38.625>benefits

341
00:17:39.005 --> 00:17:40.605
<00:17:39.005>of <00:17:39.238>using <00:17:39.471>AI <00:17:39.705>in <00:17:39.938>the <00:17:40.171>first <00:17:40.405>place.

342
00:17:40.865 --> 00:17:44.245
<00:17:40.865>And <00:17:41.040>I <00:17:41.215>agree. <00:17:41.390>Thus, <00:17:41.565>while <00:17:41.740>we <00:17:41.915>build <00:17:42.090>kill <00:17:42.265>switches,

343
00:17:44.305 --> 00:17:48.885
<00:17:44.305>we <00:17:44.460>must <00:17:44.616>put <00:17:44.771>even <00:17:44.927>more <00:17:45.082>thought <00:17:45.238>effort <00:17:45.393>into <00:17:45.549>preventive <00:17:45.705>safety.

344
00:17:49.915 --> 00:17:52.245
<00:17:49.915>Designing <00:17:50.148>AI <00:17:50.381>to <00:17:50.615>avoid <00:17:50.848>reaching <00:17:51.081>the <00:17:51.315>point

345
00:17:52.245 --> 00:17:55.725
<00:17:52.245>of <00:17:52.445>no <00:17:52.645>return <00:17:52.844>techniques <00:17:53.044>like <00:17:53.245>fail <00:17:53.445>safe <00:17:53.645>mechanisms,

346
00:17:55.775 --> 00:17:57.125
<00:17:55.775>continuous <00:17:56.990>monitoring

347
00:17:57.465 --> 00:18:00.485
<00:17:57.465>and <00:17:57.639>fallback <00:17:57.814>modes <00:17:57.990>where <00:17:58.165>the <00:17:58.340>system <00:17:58.514>has <00:17:58.689>controlled <00:17:58.865>back

348
00:18:00.485 --> 00:18:02.245
<00:18:00.485>to <00:18:00.764>humans <00:18:01.044>in <00:18:01.324>a <00:18:01.604>bigger <00:18:01.885>situations

349
00:18:02.905 --> 00:18:05.085
<00:18:02.905>all <00:18:03.371>strengthen <00:18:03.838>AI <00:18:04.305>reliability.

350
00:18:07.145 --> 00:18:11.805
<00:18:07.145>Six. <00:18:07.425>Ultimately <00:18:07.705>ethical <00:18:07.985>AI <00:18:08.264>development <00:18:08.545>strives

351
00:18:11.865 --> 00:18:13.925
<00:18:11.865>for <00:18:12.215>positive <00:18:12.565>impact <00:18:12.915>on <00:18:13.265>society.

352
00:18:15.185 --> 00:18:17.485
<00:18:15.185>As <00:18:15.418>developers, <00:18:15.651>we <00:18:15.885>should <00:18:16.118>regularly <00:18:16.351>step <00:18:16.585>back

353
00:18:17.485 --> 00:18:19.285
<00:18:17.485>and <00:18:17.834>ask, <00:18:18.185>is <00:18:18.534>this <00:18:18.885>application

354
00:18:19.285 --> 00:18:21.965
<00:18:19.285>of <00:18:19.518>AI <00:18:19.751>truly <00:18:19.985>benefiting <00:18:20.218>users <00:18:20.451>and <00:18:20.685>society?

355
00:18:22.965 --> 00:18:24.615
<00:18:22.965>What <00:18:23.314>are <00:18:23.665>the <00:18:24.014>potential <00:18:24.365>negative

356
00:18:24.615 --> 00:18:26.375
<00:18:24.615>consequences <00:18:25.081>for <00:18:25.548>our <00:18:26.015>society?

357
00:18:26.965 --> 00:18:30.535
<00:18:26.965>Keeping <00:18:27.139>a <00:18:27.314>user-centric <00:18:27.490>perspective <00:18:27.665>can <00:18:27.840>guide <00:18:28.014>us <00:18:28.189>to <00:18:28.365>pivot

358
00:18:30.955 --> 00:18:33.255
<00:18:30.955>or <00:18:31.188>rethink <00:18:31.421>features <00:18:31.655>that <00:18:31.888>might <00:18:32.121>be <00:18:32.355>harmful.

359
00:18:34.515 --> 00:18:37.495
<00:18:34.515>For <00:18:34.690>example, <00:18:34.865>an <00:18:35.040>AI <00:18:35.215>product <00:18:35.390>might <00:18:35.565>be <00:18:35.740>technically <00:18:35.915>feasible

360
00:18:37.555 --> 00:18:41.255
<00:18:37.555>and <00:18:37.730>profitable, <00:18:37.905>but <00:18:38.080>if <00:18:38.255>it <00:18:38.430>could <00:18:38.605>enable <00:18:38.780>mass <00:18:38.955>surveillance,

361
00:18:41.865 --> 00:18:46.775
<00:18:41.865>orate <00:18:42.040>inequality <00:18:42.215>and <00:18:42.390>ethical <00:18:42.565>tech <00:18:42.740>team <00:18:42.915>will <00:18:43.090>re <00:18:43.265>reassess

362
00:18:46.995 --> 00:18:48.855
<00:18:46.995>or <00:18:47.461>implement <00:18:47.928>strict <00:18:48.395>safeguards.

363
00:18:49.395 --> 00:18:52.815
<00:18:49.395>We <00:18:49.550>are <00:18:49.706>seeing <00:18:49.861>many <00:18:50.017>companies <00:18:50.172>setting <00:18:50.328>up <00:18:50.483>AI <00:18:50.639>ethics <00:18:50.795>review

364
00:18:52.815 --> 00:18:56.295
<00:18:52.815>boards <00:18:53.015>to <00:18:53.215>evaluate <00:18:53.415>such <00:18:53.615>concerns <00:18:53.815>before <00:18:54.015>product <00:18:54.215>launches.

365
00:18:56.925 --> 00:18:58.295
<00:18:56.925>Even <00:18:57.233>on <00:18:57.541>a <00:18:57.849>smaller <00:18:58.158>scale,

366
00:18:58.775 --> 00:19:01.615
<00:18:58.775>a <00:18:59.008>team <00:18:59.241>can <00:18:59.475>invite <00:18:59.708>external <00:18:59.941>perspective, <00:19:00.175>um,

367
00:19:01.765 --> 00:19:03.615
<00:19:01.765>like <00:19:02.231>potentially <00:19:02.698>affected <00:19:03.165>users

368
00:19:04.115 --> 00:19:05.855
<00:19:04.115>to <00:19:04.465>review <00:19:04.815>the <00:19:05.165>project's <00:19:05.515>impact.

369
00:19:06.635 --> 00:19:08.855
<00:19:06.635>Our <00:19:06.835>goal <00:19:07.035>should <00:19:07.235>be <00:19:07.435>to <00:19:07.635>align <00:19:07.835>AI <00:19:08.035>innovation

370
00:19:08.885 --> 00:19:11.215
<00:19:08.885>with <00:19:09.165>human <00:19:09.445>values <00:19:09.725>and <00:19:10.004>social <00:19:10.285>good.

371
00:19:13.205 --> 00:19:14.655
<00:19:13.205>Finally, <00:19:14.510>sevens.

372
00:19:15.595 --> 00:19:17.335
<00:19:15.595>No <00:19:15.875>matter <00:19:16.155>how <00:19:16.435>advanced <00:19:16.715>AI <00:19:16.995>gets

373
00:19:18.095 --> 00:19:21.415
<00:19:18.095>maintaining <00:19:18.328>human <00:19:18.561>control <00:19:18.795>over <00:19:19.028>critical <00:19:19.261>decisions <00:19:19.495>is

374
00:19:21.575 --> 00:19:23.295
<00:19:21.575>paramount <00:19:22.975>and

375
00:19:23.295 --> 00:19:26.495
<00:19:23.295>however <00:19:23.470>the <00:19:23.645>tempting <00:19:23.820>it <00:19:23.995>is <00:19:24.170>to <00:19:24.345>completely <00:19:24.520>lean <00:19:24.695>back,

376
00:19:27.475 --> 00:19:30.695
<00:19:27.475>AI <00:19:27.649>should <00:19:27.824>augment <00:19:28.000>human <00:19:28.175>judgment, <00:19:28.350>not <00:19:28.524>replace <00:19:28.699>it <00:19:28.875>entirely.

377
00:19:30.795 --> 00:19:31.855
<00:19:30.795>In <00:19:31.113>matters <00:19:31.431>of <00:19:31.749>ethics

378
00:19:32.515 --> 00:19:35.495
<00:19:32.515>and <00:19:32.715>practice, <00:19:32.915>this <00:19:33.115>might <00:19:33.315>mean <00:19:33.515>designing <00:19:33.715>AI <00:19:33.915>systems

379
00:19:35.965 --> 00:19:39.895
<00:19:35.965>that <00:19:36.139>always <00:19:36.314>have <00:19:36.490>a <00:19:36.665>human <00:19:36.840>data <00:19:37.014>and <00:19:37.189>consequential <00:19:37.365>scenarios.

380
00:19:40.955 --> 00:19:43.815
<00:19:40.955>For <00:19:41.188>example, <00:19:41.421>a <00:19:41.655>medical <00:19:41.888>AI <00:19:42.121>suggests <00:19:42.355>treatments,

381
00:19:44.035 --> 00:19:47.575
<00:19:44.035>but <00:19:44.190>a <00:19:44.346>doctor <00:19:44.501>must <00:19:44.657>confer, <00:19:44.812>confirm, <00:19:44.968>or <00:19:45.123>an <00:19:45.279>autonomous <00:19:45.435>weapon.

382
00:19:47.885 --> 00:19:50.255
<00:19:47.885>Yeah, <00:19:48.165>well, <00:19:48.445>a <00:19:48.725>particular <00:19:49.004>sensitive <00:19:49.285>domain

383
00:19:50.835 --> 00:19:54.135
<00:19:50.835>has <00:19:50.975>a <00:19:51.115>human <00:19:51.255>operator <00:19:51.395>who <00:19:51.535>makes <00:19:51.675>the <00:19:51.815>finer <00:19:51.955>decision <00:19:52.095>to <00:19:52.235>engage.

384
00:19:55.025 --> 00:19:58.655
<00:19:55.025>Preserving <00:19:55.200>human <00:19:55.375>agency <00:19:55.550>is <00:19:55.725>key <00:19:55.900>to <00:19:56.075>preventing <00:19:56.250>a <00:19:56.425>scenario

385
00:19:58.985 --> 00:20:01.815
<00:19:58.985>where <00:19:59.264>we <00:19:59.544>blindly <00:19:59.824>follow <00:20:00.104>machine's <00:20:00.385>decisions.

386
00:20:03.235 --> 00:20:04.535
<00:20:03.235>By <00:20:03.468>keeping <00:20:03.703>humans <00:20:03.937>in <00:20:04.171>the <00:20:04.405>loop

387
00:20:04.555 --> 00:20:07.455
<00:20:04.555>and <00:20:04.788>designing <00:20:05.021>AI <00:20:05.255>to <00:20:05.488>respect <00:20:05.721>human <00:20:05.955>dignity

388
00:20:07.635 --> 00:20:11.175
<00:20:07.635>and <00:20:07.835>autonomy, <00:20:08.035>we <00:20:08.235>ensure <00:20:08.435>that <00:20:08.635>technology <00:20:08.835>serves <00:20:09.035>us

389
00:20:11.835 --> 00:20:12.895
<00:20:11.835>and <00:20:12.025>not <00:20:12.216>the <00:20:12.407>other <00:20:12.598>way <00:20:12.789>around.

390
00:20:15.515 --> 00:20:18.265
<00:20:15.515>Let's <00:20:15.690>take <00:20:15.865>a <00:20:16.040>look <00:20:16.215>at <00:20:16.390>the <00:20:16.565>AI <00:20:16.740>ethics <00:20:16.915>playbook

391
00:20:18.525 --> 00:20:21.225
<00:20:18.525>and <00:20:18.725>with <00:20:18.925>that, <00:20:19.125>how <00:20:19.325>to <00:20:19.525>bring <00:20:19.725>ethical <00:20:19.925>principles

392
00:20:22.405 --> 00:20:24.145
<00:20:22.405>to <00:20:22.685>our <00:20:22.965>daily <00:20:23.245>work <00:20:23.524>and <00:20:23.805>businesses.

393
00:20:26.285 --> 00:20:28.145
<00:20:26.285>We <00:20:26.518>all <00:20:26.751>know <00:20:26.985>what <00:20:27.218>a <00:20:27.451>post-mortem <00:20:27.685>is.

394
00:20:28.695 --> 00:20:30.065
<00:20:28.695>Analyzing <00:20:29.106>a, <00:20:29.517>a <00:20:29.928>failure

395
00:20:30.115 --> 00:20:33.865
<00:20:30.115>after <00:20:30.255>it <00:20:30.395>happens, <00:20:30.535>a <00:20:30.675>a <00:20:30.815>pre-mortem <00:20:30.955>flips <00:20:31.095>that <00:20:31.235>on <00:20:31.375>its <00:20:31.515>head.

396
00:20:34.325 --> 00:20:36.545
<00:20:34.325>Before <00:20:34.525>you <00:20:34.725>write <00:20:34.925>a <00:20:35.125>single <00:20:35.325>line <00:20:35.525>of <00:20:35.725>code,

397
00:20:37.205 --> 00:20:39.505
<00:20:37.205>get <00:20:37.360>the <00:20:37.516>team <00:20:37.671>in <00:20:37.827>a <00:20:37.982>room <00:20:38.138>and <00:20:38.293>ask <00:20:38.449>this <00:20:38.605>questions.

398
00:20:40.255 --> 00:20:43.585
<00:20:40.255>Imagine <00:20:40.410>one <00:20:40.566>year <00:20:40.721>from <00:20:40.877>now <00:20:41.032>and <00:20:41.188>this <00:20:41.343>project <00:20:41.499>has <00:20:41.655>failed.

399
00:20:43.605 --> 00:20:47.565
<00:20:43.605>On <00:20:43.780>an <00:20:43.955>ethical <00:20:44.130>level, <00:20:44.305>it <00:20:44.480>caused <00:20:44.655>a <00:20:44.830>PR <00:20:45.005>nightmare.

400
00:20:48.035 --> 00:20:51.685
<00:20:48.035>What <00:20:48.268>happened? <00:20:48.501>This <00:20:48.735>exercise <00:20:48.968>encouraged <00:20:49.201>the <00:20:49.435>team

401
00:20:51.705 --> 00:20:54.245
<00:20:51.705>to <00:20:52.054>imagine <00:20:52.405>potential <00:20:52.754>negative <00:20:53.105>outcomes.

402
00:20:55.315 --> 00:21:00.205
<00:20:55.315>Bias, <00:20:55.595>misuse <00:20:55.875>bias <00:20:56.155>and <00:20:56.435>misuse <00:20:56.715>privacy

403
00:21:02.345 --> 00:21:03.365
<00:21:02.345>and <00:21:02.651>and <00:21:02.957>so <00:21:03.263>on,

404
00:21:03.545 --> 00:21:06.805
<00:21:03.545>and <00:21:03.700>the <00:21:03.856>build <00:21:04.011>safeguards <00:21:04.167>against <00:21:04.322>them <00:21:04.478>from <00:21:04.633>the <00:21:04.789>very <00:21:04.945>start.

405
00:21:07.475 --> 00:21:08.965
<00:21:07.475>This, <00:21:07.810>this <00:21:08.145>will <00:21:08.480>be <00:21:08.815>proactive.

406
00:21:10.265 --> 00:21:12.325
<00:21:10.265>If <00:21:10.440>it's <00:21:10.615>not <00:21:10.790>in <00:21:10.965>the <00:21:11.140>backlog, <00:21:11.315>it <00:21:11.490>doesn't <00:21:11.665>exist.

407
00:21:14.955 --> 00:21:18.065
<00:21:14.955>Start <00:21:15.188>translating <00:21:15.421>ethical <00:21:15.655>requirements <00:21:15.888>into <00:21:16.121>concrete <00:21:16.355>user

408
00:21:18.065 --> 00:21:19.905
<00:21:18.065>stories <00:21:18.531>or <00:21:18.998>acceptance <00:21:19.465>criteria.

409
00:21:20.565 --> 00:21:24.865
<00:21:20.565>For <00:21:20.740>example, <00:21:20.915>instead <00:21:21.090>of <00:21:21.265>vague <00:21:21.440>goal <00:21:21.615>of <00:21:21.790>be <00:21:21.965>fair,

410
00:21:25.365 --> 00:21:29.025
<00:21:25.365>create <00:21:25.520>a <00:21:25.676>story <00:21:25.831>like <00:21:25.987>as <00:21:26.142>a <00:21:26.298>user <00:21:26.453>from <00:21:26.609>a <00:21:26.765>historical

411
00:21:30.925 --> 00:21:33.785
<00:21:30.925>underrepresented <00:21:31.125>group, <00:21:31.325>I <00:21:31.524>want <00:21:31.725>the <00:21:31.925>loan <00:21:32.125>approval <00:21:32.325>model

412
00:21:34.245 --> 00:21:36.425
<00:21:34.245>to <00:21:34.524>show <00:21:34.804>a <00:21:35.084>false <00:21:35.364>rejection <00:21:35.645>rate

413
00:21:36.455 --> 00:21:40.385
<00:21:36.455>that <00:21:36.582>is <00:21:36.709>no <00:21:36.836>more <00:21:36.964>than <00:21:37.091>2% <00:21:37.218>different <00:21:37.345>from <00:21:37.473>the <00:21:37.600>majority <00:21:37.727>group <00:21:37.855>so

414
00:21:40.385 --> 00:21:42.545
<00:21:40.385>that <00:21:40.618>I <00:21:40.851>have <00:21:41.085>equal <00:21:41.318>access <00:21:41.551>to <00:21:41.785>opportunities.

415
00:21:43.335 --> 00:21:47.145
<00:21:43.335>Well, <00:21:43.462>I <00:21:43.589>know <00:21:43.716>a <00:21:43.844>long <00:21:43.971>one, <00:21:44.098>but <00:21:44.225>why <00:21:44.353>not? <00:21:44.480>This <00:21:44.607>is <00:21:44.735>concrete.

416
00:21:47.805 --> 00:21:50.865
<00:21:47.805>You <00:21:47.980>can <00:21:48.155>even <00:21:48.330>file <00:21:48.505>ethical <00:21:48.680>bug <00:21:48.855>like <00:21:49.030>this <00:21:49.205>one.

417
00:21:51.405 --> 00:21:55.785
<00:21:51.405>The <00:21:51.560>the <00:21:51.716>image <00:21:51.871>tagging <00:21:52.027>algorithm <00:21:52.182>mis <00:21:52.338>classifies <00:21:52.493>women <00:21:52.649>over <00:21:52.805>50

418
00:21:55.845 --> 00:21:57.065
<00:21:55.845>and <00:21:56.394>professional <00:21:56.943>settings.

419
00:21:57.415 --> 00:21:58.865
<00:21:57.415>This <00:21:57.741>is <00:21:58.067>a <00:21:58.393>bug, <00:21:58.720>huh?

420
00:21:59.575 --> 00:22:03.185
<00:21:59.575>With <00:21:59.750>that, <00:21:59.925>you <00:22:00.100>can <00:22:00.275>make <00:22:00.450>ethics, <00:22:00.625>measurable, <00:22:00.800>trackable <00:22:00.975>part

421
00:22:03.185 --> 00:22:04.385
<00:22:03.185>of <00:22:03.545>the <00:22:03.905>development <00:22:04.264>process

422
00:22:08.055 --> 00:22:11.515
<00:22:08.055>In <00:22:08.182>cybersecurity, <00:22:08.309>a <00:22:08.436>red <00:22:08.564>team <00:22:08.691>is <00:22:08.818>paid <00:22:08.945>to <00:22:09.073>think <00:22:09.200>like <00:22:09.327>the <00:22:09.455>enemy

423
00:22:11.515 --> 00:22:12.795
<00:22:11.515>and <00:22:11.745>try <00:22:11.975>to <00:22:12.206>break <00:22:12.436>the <00:22:12.667>systems.

424
00:22:13.455 --> 00:22:16.155
<00:22:13.455>We <00:22:13.655>need <00:22:13.855>the <00:22:14.054>same <00:22:14.254>approach <00:22:14.455>for <00:22:14.655>AI <00:22:14.855>ethics.

425
00:22:16.695 --> 00:22:19.995
<00:22:16.695>Assign <00:22:16.895>or <00:22:17.095>hire <00:22:17.294>people <00:22:17.495>to <00:22:17.695>be <00:22:17.895>adversary <00:22:18.095>users.

426
00:22:20.285 --> 00:22:23.475
<00:22:20.285>Their <00:22:20.440>job <00:22:20.596>is <00:22:20.751>to <00:22:20.907>actively <00:22:21.062>try <00:22:21.218>to <00:22:21.373>abuse <00:22:21.529>the <00:22:21.685>ai.

427
00:22:24.375 --> 00:22:26.035
<00:22:24.375>Can <00:22:24.655>they <00:22:24.935>jailbreak <00:22:25.215>your <00:22:25.495>language <00:22:25.775>model

428
00:22:26.095 --> 00:22:27.275
<00:22:26.095>to <00:22:26.449>produce <00:22:26.803>hate <00:22:27.157>speech?

429
00:22:27.935 --> 00:22:30.475
<00:22:27.935>Can <00:22:28.215>they <00:22:28.495>manipulate <00:22:28.774>the <00:22:29.054>recommendation <00:22:29.335>engine

430
00:22:30.475 --> 00:22:31.875
<00:22:30.475>to <00:22:31.105>promote <00:22:31.735>misinformation?

431
00:22:32.655 --> 00:22:35.795
<00:22:32.655>Can <00:22:32.810>they <00:22:32.966>figure <00:22:33.121>out <00:22:33.277>how <00:22:33.432>to <00:22:33.588>de <00:22:33.743>anonymize <00:22:33.899>user <00:22:34.055>data?

432
00:22:36.785 --> 00:22:39.835
<00:22:36.785>This <00:22:36.960>kind <00:22:37.135>of <00:22:37.310>adversary <00:22:37.485>testing <00:22:37.660>is <00:22:37.835>the <00:22:38.010>only <00:22:38.185>way

433
00:22:40.055 --> 00:22:42.195
<00:22:40.055>to <00:22:40.405>find <00:22:40.755>the <00:22:41.105>vulnerabilities <00:22:41.455>you,

434
00:22:42.415 --> 00:22:44.035
<00:22:42.415>the <00:22:42.695>creator <00:22:42.975>would <00:22:43.254>never <00:22:43.534>think <00:22:43.815>of.

435
00:22:46.035 --> 00:22:49.285
<00:22:46.035>This <00:22:46.235>is <00:22:46.435>a <00:22:46.635>simple <00:22:46.835>but <00:22:47.035>powerful <00:22:47.235>experiment, <00:22:47.435>thought.

436
00:22:49.285 --> 00:22:52.125
<00:22:49.285>Experiment <00:22:49.565>from <00:22:49.845>the <00:22:50.125>philosopher <00:22:50.405>John <00:22:50.685>Raw

437
00:22:53.065 --> 00:22:54.285
<00:22:53.065>before <00:22:53.431>launching <00:22:53.797>a <00:22:54.163>product.

438
00:22:54.465 --> 00:22:57.805
<00:22:54.465>Ask <00:22:54.639>your <00:22:54.814>team. <00:22:54.990>Imagine <00:22:55.165>you <00:22:55.340>didn't <00:22:55.514>know <00:22:55.689>you <00:22:55.865>would

439
00:22:57.805 --> 00:22:58.885
<00:22:57.805>be <00:22:58.129>in <00:22:58.453>this <00:22:58.777>scenario.

440
00:22:59.465 --> 00:23:03.725
<00:22:59.465>You <00:22:59.605>could <00:22:59.745>be <00:22:59.885>the <00:23:00.024>CEOA <00:23:00.165>developer <00:23:00.304>on <00:23:00.445>the <00:23:00.584>team, <00:23:00.725>an <00:23:00.865>investor,

441
00:23:04.245 --> 00:23:07.445
<00:23:04.245>a <00:23:04.385>user <00:23:04.524>of <00:23:04.665>the <00:23:04.804>product, <00:23:04.945>or <00:23:05.084>a <00:23:05.225>person <00:23:05.364>from <00:23:05.504>a <00:23:05.645>marginalized

442
00:23:07.475 --> 00:23:10.805
<00:23:07.475>community <00:23:07.754>who <00:23:08.034>is <00:23:08.314>most <00:23:08.594>negatively <00:23:08.875>impacted

443
00:23:10.905 --> 00:23:12.285
<00:23:10.905>by <00:23:11.153>a <00:23:11.401>flaw <00:23:11.650>in <00:23:11.898>this <00:23:12.147>ai.

444
00:23:12.945 --> 00:23:15.125
<00:23:12.945>Now, <00:23:13.178>from <00:23:13.411>behind <00:23:13.645>this <00:23:13.878>veil <00:23:14.111>of <00:23:14.345>ignorance,

445
00:23:15.935 --> 00:23:18.165
<00:23:15.935>would <00:23:16.135>you <00:23:16.335>still <00:23:16.534>sign <00:23:16.735>off <00:23:16.935>on <00:23:17.135>its <00:23:17.335>release?

446
00:23:19.275 --> 00:23:20.925
<00:23:19.275>This <00:23:19.741>test <00:23:20.208>forces <00:23:20.675>empathy

447
00:23:20.985 --> 00:23:25.005
<00:23:20.985>and <00:23:21.159>encouraged <00:23:21.334>everyone <00:23:21.510>to <00:23:21.685>build <00:23:21.860>systems <00:23:22.034>that <00:23:22.209>are <00:23:22.385>fair

448
00:23:25.065 --> 00:23:27.205
<00:23:25.065>and <00:23:25.531>safe, <00:23:25.998>not <00:23:26.465>just

449
00:23:27.345 --> 00:23:29.325
<00:23:27.345>for <00:23:27.578>the <00:23:27.811>privileged <00:23:28.045>ones, <00:23:28.278>but <00:23:28.511>for <00:23:28.745>everyone.

450
00:23:31.635 --> 00:23:33.835
<00:23:31.635>Adopting <00:23:31.835>these <00:23:32.035>practices <00:23:32.235>is <00:23:32.435>not <00:23:32.635>about <00:23:32.835>slowing <00:23:33.035>down

451
00:23:33.835 --> 00:23:37.795
<00:23:33.835>innovation, <00:23:34.068>it's <00:23:34.301>about <00:23:34.535>measuring <00:23:34.768>our, <00:23:35.001>our <00:23:35.235>craft.

452
00:23:38.305 --> 00:23:40.875
<00:23:38.305>It's <00:23:38.585>about <00:23:38.865>building <00:23:39.145>better, <00:23:39.425>more <00:23:39.705>robust

453
00:23:40.935 --> 00:23:43.115
<00:23:40.935>and <00:23:41.135>more <00:23:41.335>successful <00:23:41.534>products <00:23:41.735>in <00:23:41.935>the <00:23:42.135>long <00:23:42.335>run.

454
00:23:43.815 --> 00:23:46.045
<00:23:43.815>And <00:23:44.015>I <00:23:44.215>think <00:23:44.415>it's <00:23:44.615>worth <00:23:44.815>also <00:23:45.015>the <00:23:45.215>cost.

455
00:23:48.395 --> 00:23:49.125
<00:23:48.395>Just <00:23:48.723>one <00:23:49.052>second.

456
00:23:52.535 --> 00:23:53.395
<00:23:52.535>My <00:23:52.922>favorite <00:23:53.309>topic.

457
00:24:01.485 --> 00:24:04.015
<00:24:01.485>Yeah, <00:24:01.764>and <00:24:02.044>if <00:24:02.324>the <00:24:02.604>moral <00:24:02.885>argument

458
00:24:04.075 --> 00:24:07.015
<00:24:04.075>and <00:24:04.250>the <00:24:04.425>risk <00:24:04.600>of <00:24:04.775>PR <00:24:04.950>disasters <00:24:05.125>aren't <00:24:05.300>enough <00:24:05.475>to

459
00:24:07.735 --> 00:24:10.175
<00:24:07.735>convince <00:24:07.968>your <00:24:08.201>boss, <00:24:08.435>there's <00:24:08.668>a <00:24:08.901>powerful <00:24:09.135>business

460
00:24:10.175 --> 00:24:12.055
<00:24:10.175>and <00:24:10.641>legal <00:24:11.108>argument <00:24:11.575>emerging.

461
00:24:12.595 --> 00:24:14.455
<00:24:12.595>The <00:24:12.795>world <00:24:12.995>is <00:24:13.195>waking <00:24:13.395>up <00:24:13.595>to <00:24:13.795>the <00:24:13.995>need

462
00:24:14.955 --> 00:24:18.135
<00:24:14.955>for <00:24:15.235>reg <00:24:15.514>regulatory <00:24:15.794>guardrails <00:24:16.074>on <00:24:16.355>ai.

463
00:24:19.315 --> 00:24:20.535
<00:24:19.315>For <00:24:19.498>those <00:24:19.681>of <00:24:19.864>us <00:24:20.047>in <00:24:20.230>the <00:24:20.413>EU

464
00:24:20.715 --> 00:24:23.095
<00:24:20.715>or <00:24:20.870>anyone <00:24:21.026>whose <00:24:21.181>products <00:24:21.337>might <00:24:21.492>be <00:24:21.648>used <00:24:21.803>in <00:24:21.959>the <00:24:22.115>eu,

465
00:24:23.295 --> 00:24:26.535
<00:24:23.295>a <00:24:23.470>major <00:24:23.645>change <00:24:23.820>is <00:24:23.995>coming <00:24:24.170>the <00:24:24.345>EU <00:24:24.520>AI <00:24:24.695>Act.

466
00:24:29.635 --> 00:24:31.175
<00:24:29.635>So <00:24:29.866>what <00:24:30.097>does <00:24:30.328>this <00:24:30.559>mean <00:24:30.790>in <00:24:31.021>practice?

467
00:24:31.445 --> 00:24:35.575
<00:24:31.445>Essentially <00:24:31.645>the <00:24:31.845>law <00:24:32.044>classifies <00:24:32.245>AI <00:24:32.445>systems <00:24:32.645>by <00:24:32.845>risk

468
00:24:35.635 --> 00:24:38.375
<00:24:35.635>and <00:24:35.868>imposes <00:24:36.101>obligations <00:24:36.335>on <00:24:36.568>those <00:24:36.801>who <00:24:37.035>build

469
00:24:38.375 --> 00:24:39.415
<00:24:38.375>and <00:24:38.687>implement <00:24:38.999>the <00:24:39.311>systems.

470
00:24:39.915 --> 00:24:43.575
<00:24:39.915>The <00:24:40.115>majority <00:24:40.315>of <00:24:40.514>obligations <00:24:40.715>fall <00:24:40.915>on <00:24:41.115>the <00:24:41.315>providers

471
00:24:43.715 --> 00:24:47.375
<00:24:43.715>of <00:24:43.948>high <00:24:44.181>risk <00:24:44.415>ai, <00:24:44.648>effectively <00:24:44.881>the <00:24:45.115>organizations

472
00:24:47.395 --> 00:24:48.895
<00:24:47.395>and <00:24:47.732>developers <00:24:48.070>who <00:24:48.407>create <00:24:48.745>it.

473
00:24:53.125 --> 00:24:55.945
<00:24:53.125>So <00:24:53.325>the <00:24:53.525>EU <00:24:53.725>AI <00:24:53.925>Act <00:24:54.125>is <00:24:54.325>basically <00:24:54.525>saying,

474
00:24:55.965 --> 00:24:58.105
<00:24:55.965>if <00:24:56.139>you <00:24:56.314>don't <00:24:56.490>give <00:24:56.665>your <00:24:56.840>AI <00:24:57.014>a <00:24:57.189>moral <00:24:57.365>compass,

475
00:24:58.645 --> 00:24:59.705
<00:24:58.645>you <00:24:58.963>shouldn't <00:24:59.281>deploy <00:24:59.599>it.

476
00:25:00.295 --> 00:25:04.425
<00:25:00.295>It's <00:25:00.435>a <00:25:00.575>wake <00:25:00.715>up. <00:25:00.855>That <00:25:00.995>ethics <00:25:01.135>is <00:25:01.275>no <00:25:01.415>longer <00:25:01.555>just <00:25:01.695>optional

477
00:25:04.565 --> 00:25:05.585
<00:25:04.565>or <00:25:05.483>idealistic.

478
00:25:05.695 --> 00:25:09.865
<00:25:05.695>It's <00:25:05.895>becoming <00:25:06.095>a <00:25:06.294>compliance <00:25:06.495>issue <00:25:06.695>and <00:25:06.895>it's <00:25:07.095>good.

479
00:25:09.985 --> 00:25:10.865
<00:25:09.985>I <00:25:10.143>think <00:25:10.301>that <00:25:10.460>we <00:25:10.618>have <00:25:10.777>that.

480
00:25:14.855 --> 00:25:16.035
<00:25:14.855>So <00:25:15.209>should <00:25:15.563>it <00:25:15.917>be,

481
00:25:16.295 --> 00:25:18.195
<00:25:16.295>should <00:25:16.495>we <00:25:16.695>talk <00:25:16.895>about <00:25:17.095>this <00:25:17.295>in <00:25:17.495>a <00:25:17.695>developer

482
00:25:18.385 --> 00:25:19.635
<00:25:18.385>focused <00:25:18.947>ethics <00:25:19.510>talk?

483
00:25:20.035 --> 00:25:21.995
<00:25:20.035>Absolutely. <00:25:20.385>But <00:25:20.735>in <00:25:21.085>balance, <00:25:21.435>right?

484
00:25:22.615 --> 00:25:24.875
<00:25:22.615>Um, <00:25:22.895>so <00:25:23.175>we <00:25:23.455>have <00:25:23.735>two <00:25:24.015>purposes.

485
00:25:24.935 --> 00:25:27.555
<00:25:24.935>It <00:25:25.110>validates <00:25:25.284>that <00:25:25.460>the <00:25:25.635>concerns <00:25:25.810>we've <00:25:25.985>been <00:25:26.159>discussing <00:25:26.335>are

486
00:25:27.555 --> 00:25:30.555
<00:25:27.555>so <00:25:27.730>real <00:25:27.905>that <00:25:28.080>governments <00:25:28.255>are <00:25:28.430>stepping <00:25:28.605>into <00:25:28.780>enforce <00:25:28.955>them

487
00:25:30.895 --> 00:25:33.555
<00:25:30.895>and <00:25:31.128>it <00:25:31.361>alerts <00:25:31.595>developers <00:25:31.828>that <00:25:32.061>tech <00:25:32.295>leads,

488
00:25:33.665 --> 00:25:35.715
<00:25:33.665>that <00:25:33.945>these <00:25:34.225>ethical <00:25:34.504>practices <00:25:34.784>have <00:25:35.065>tangible

489
00:25:35.755 --> 00:25:37.315
<00:25:35.755>consequences <00:25:36.221>for <00:25:36.688>their <00:25:37.155>product.

490
00:25:39.325 --> 00:25:42.665
<00:25:39.325>So <00:25:39.480>prepare <00:25:39.636>now <00:25:39.791>for <00:25:39.947>the <00:25:40.102>era <00:25:40.258>of <00:25:40.413>ethics <00:25:40.569>by <00:25:40.725>design.

491
00:25:43.005 --> 00:25:46.705
<00:25:43.005>It <00:25:43.160>shows <00:25:43.316>that <00:25:43.471>ethical <00:25:43.627>AI <00:25:43.782>development <00:25:43.938>is <00:25:44.093>becoming <00:25:44.249>the <00:25:44.405>new

492
00:25:46.705 --> 00:25:50.625
<00:25:46.705>norm <00:25:46.879>expected <00:25:47.054>of <00:25:47.230>us <00:25:47.405>by <00:25:47.580>society <00:25:47.754>and <00:25:47.929>by <00:25:48.105>law.

493
00:25:52.415 --> 00:25:54.105
<00:25:52.415>That <00:25:52.615>said, <00:25:52.815>we <00:25:53.014>should <00:25:53.215>treat <00:25:53.415>the <00:25:53.615>AI <00:25:53.815>act

494
00:25:54.105 --> 00:25:55.905
<00:25:54.105>as <00:25:54.338>a <00:25:54.571>supporting <00:25:54.805>element <00:25:55.038>in <00:25:55.271>our <00:25:55.505>journey.

495
00:25:56.245 --> 00:26:00.545
<00:25:56.245>Not <00:25:56.385>the <00:25:56.524>sole <00:25:56.665>reason <00:25:56.804>to <00:25:56.945>act <00:25:57.084>regulations <00:25:57.225>can <00:25:57.364>set <00:25:57.504>the <00:25:57.645>baseline,

496
00:26:00.805 --> 00:26:01.865
<00:26:00.805>but <00:26:01.282>truly <00:26:01.759>inspired.

497
00:26:01.865 --> 00:26:04.945
<00:26:01.865>Developers <00:26:02.145>will <00:26:02.425>go <00:26:02.705>beyond <00:26:02.985>compliance, <00:26:03.265>striving

498
00:26:05.045 --> 00:26:06.505
<00:26:05.045>for <00:26:05.702>ethical <00:26:06.359>excellence,

499
00:26:06.505 --> 00:26:09.585
<00:26:06.505>because <00:26:06.705>they <00:26:06.905>take <00:26:07.105>pride <00:26:07.305>in <00:26:07.505>building <00:26:07.705>trustworthy <00:26:07.905>ai.

500
00:26:13.735 --> 00:26:18.275
<00:26:13.735>In <00:26:13.875>the <00:26:14.014>end, <00:26:14.155>the <00:26:14.294>con <00:26:14.435>uh, <00:26:14.574>conscience <00:26:14.715>of <00:26:14.854>our <00:26:14.995>AI <00:26:15.135>creations,

501
00:26:18.355 --> 00:26:20.475
<00:26:18.355>their <00:26:18.510>sense <00:26:18.666>of <00:26:18.821>right <00:26:18.977>and <00:26:19.132>wrong <00:26:19.288>comes <00:26:19.443>down <00:26:19.599>to <00:26:19.755>us.

502
00:26:20.975 --> 00:26:23.675
<00:26:20.975>We, <00:26:21.115>the <00:26:21.254>developers <00:26:21.395>and <00:26:21.534>tech <00:26:21.675>leaders <00:26:21.814>who <00:26:21.955>bring <00:26:22.094>them <00:26:22.235>to <00:26:22.375>life,

503
00:26:24.095 --> 00:26:25.715
<00:26:24.095>we <00:26:24.328>face <00:26:24.561>a <00:26:24.795>choice <00:26:25.028>in <00:26:25.261>each <00:26:25.495>project.

504
00:26:26.535 --> 00:26:29.835
<00:26:26.535>Either <00:26:26.690>take <00:26:26.846>the <00:26:27.001>easy <00:26:27.157>path <00:26:27.312>of <00:26:27.468>building <00:26:27.623>for <00:26:27.779>pure <00:26:27.935>functionality

505
00:26:29.935 --> 00:26:32.595
<00:26:29.935>or <00:26:30.110>take <00:26:30.284>the <00:26:30.460>higher <00:26:30.635>path <00:26:30.810>of <00:26:30.985>building <00:26:31.159>for <00:26:31.335>responsibility.

506
00:26:33.855 --> 00:26:35.675
<00:26:33.855>So <00:26:34.088>think <00:26:34.321>back <00:26:34.555>to <00:26:34.788>our <00:26:35.021>opening <00:26:35.255>question,

507
00:26:35.865 --> 00:26:37.275
<00:26:35.865>kill <00:26:36.182>switch <00:26:36.499>or <00:26:36.816>moral <00:26:37.134>compass.

508
00:26:37.905 --> 00:26:39.795
<00:26:37.905>Realistically, <00:26:38.371>we <00:26:38.838>need <00:26:39.305>both.

509
00:26:40.735 --> 00:26:42.875
<00:26:40.735>We <00:26:40.968>build <00:26:41.201>kil <00:26:41.435>switches <00:26:41.668>as <00:26:41.901>safety <00:26:42.135>nets

510
00:26:42.875 --> 00:26:44.245
<00:26:42.875>because <00:26:43.183>no <00:26:43.491>system <00:26:43.799>is <00:26:44.108>perfect

511
00:26:44.465 --> 00:26:46.725
<00:26:44.465>and <00:26:44.698>we <00:26:44.931>must <00:26:45.165>be <00:26:45.398>able <00:26:45.631>to <00:26:45.865>intervene.

512
00:26:47.225 --> 00:26:50.885
<00:26:47.225>But <00:26:47.380>if <00:26:47.536>our <00:26:47.691>entire <00:26:47.847>strategy <00:26:48.002>for <00:26:48.158>AI <00:26:48.313>safety <00:26:48.469>is <00:26:48.625>just,

513
00:26:51.335 --> 00:26:54.325
<00:26:51.335>don't <00:26:51.475>worry, <00:26:51.615>we <00:26:51.755>can <00:26:51.895>always <00:26:52.035>unplug <00:26:52.175>it, <00:26:52.315>then <00:26:52.455>we <00:26:52.595>have <00:26:52.735>failed.

514
00:26:54.755 --> 00:26:57.805
<00:26:54.755>That <00:26:54.930>is <00:26:55.105>not <00:26:55.280>a <00:26:55.455>strategy <00:26:55.630>that <00:26:55.805>is <00:26:55.980>an <00:26:56.155>abdication

515
00:26:57.805 --> 00:26:58.925
<00:26:57.805>of <00:26:58.812>responsibility.

516
00:27:00.585 --> 00:27:02.885
<00:27:00.585>Our <00:27:00.760>highest <00:27:00.935>aim <00:27:01.110>should <00:27:01.285>be <00:27:01.460>to <00:27:01.635>imbue <00:27:01.810>the <00:27:01.985>AI

517
00:27:02.885 --> 00:27:05.845
<00:27:02.885>with <00:27:03.025>a <00:27:03.165>moral <00:27:03.305>compass <00:27:03.445>so <00:27:03.585>that <00:27:03.725>the <00:27:03.865>kill <00:27:04.004>switch <00:27:04.145>gathers <00:27:04.285>dust.

518
00:27:06.275 --> 00:27:07.845
<00:27:06.275>It's <00:27:06.625>like <00:27:06.975>raising <00:27:07.325>a <00:27:07.675>child.

519
00:27:08.265 --> 00:27:11.125
<00:27:08.265>You <00:27:08.405>teach <00:27:08.545>them <00:27:08.685>value <00:27:08.825>so <00:27:08.965>they <00:27:09.105>act <00:27:09.245>responsibly <00:27:09.385>on <00:27:09.525>their <00:27:09.665>own,

520
00:27:11.595 --> 00:27:13.245
<00:27:11.595>even <00:27:11.875>though <00:27:12.155>you're <00:27:12.435>the, <00:27:12.715>you're <00:27:12.995>there

521
00:27:13.245 --> 00:27:14.525
<00:27:13.245>to <00:27:13.533>intervene <00:27:13.821>if <00:27:14.109>they <00:27:14.397>stray.

522
00:27:14.945 --> 00:27:18.005
<00:27:14.945>As <00:27:15.145>AI <00:27:15.345>parents, <00:27:15.544>we <00:27:15.745>must <00:27:15.945>educate <00:27:16.145>our <00:27:16.345>systems

523
00:27:18.005 --> 00:27:20.645
<00:27:18.005>through <00:27:18.355>thoughtful <00:27:18.705>design, <00:27:19.055>fair <00:27:19.405>data

524
00:27:20.745 --> 00:27:22.045
<00:27:20.745>and <00:27:21.330>ethical <00:27:21.915>constraints.

525
00:27:25.605 --> 00:27:27.425
<00:27:25.605>OpenAI, <00:27:25.838>for <00:27:26.071>example, <00:27:26.305>they <00:27:26.538>did <00:27:26.771>that, <00:27:27.005>right?

526
00:27:27.425 --> 00:27:29.545
<00:27:27.425>They <00:27:27.658>started, <00:27:27.891>um, <00:27:28.125>with <00:27:28.358>the <00:27:28.591>red <00:27:28.825>teaming.

527
00:27:29.545 --> 00:27:31.185
<00:27:29.545>That's, <00:27:29.778>that's <00:27:30.011>a <00:27:30.245>good <00:27:30.478>first <00:27:30.711>step <00:27:30.945>and,

528
00:27:31.205 --> 00:27:32.825
<00:27:31.205>and <00:27:31.671>that's <00:27:32.138>highly <00:27:32.605>appreciated.

529
00:27:34.405 --> 00:27:36.705
<00:27:34.405>So <00:27:34.560>as <00:27:34.716>you <00:27:34.871>leave <00:27:35.027>here <00:27:35.182>and <00:27:35.338>return <00:27:35.493>to <00:27:35.649>your <00:27:35.805>projects,

530
00:27:37.705 --> 00:27:40.345
<00:27:37.705>I <00:27:37.879>challenge <00:27:38.054>each <00:27:38.230>of <00:27:38.405>you <00:27:38.580>to <00:27:38.754>carry <00:27:38.929>this <00:27:39.105>mindset.

531
00:27:40.685 --> 00:27:42.265
<00:27:40.685>Be <00:27:40.918>the <00:27:41.151>moral <00:27:41.385>compass <00:27:41.618>in <00:27:41.851>your <00:27:42.085>team.

532
00:27:42.615 --> 00:27:45.025
<00:27:42.615>When <00:27:42.815>others <00:27:43.015>forget, <00:27:43.215>remind <00:27:43.415>them <00:27:43.615>why <00:27:43.815>it <00:27:44.015>matters.

533
00:27:45.435 --> 00:27:47.065
<00:27:45.435>Share <00:27:45.715>the <00:27:45.995>story <00:27:46.274>of <00:27:46.554>taste <00:27:46.835>failure

534
00:27:47.725 --> 00:27:49.545
<00:27:47.725>or <00:27:48.004>how <00:27:48.284>Google <00:27:48.564>photos <00:27:48.844>became <00:27:49.125>racist.

535
00:27:49.725 --> 00:27:52.305
<00:27:49.725>As <00:27:50.074>cautionary <00:27:50.425>tales <00:27:50.774>encourage <00:27:51.125>discussions

536
00:27:52.305 --> 00:27:55.025
<00:27:52.305>of <00:27:52.480>potential <00:27:52.655>impacts <00:27:52.830>and <00:27:53.005>what <00:27:53.180>if <00:27:53.355>scenarios <00:27:53.530>during <00:27:53.705>planning.

537
00:27:55.645 --> 00:27:59.025
<00:27:55.645>Create <00:27:55.878>an <00:27:56.111>environment <00:27:56.345>where <00:27:56.578>ethical <00:27:56.811>considerations <00:27:57.045>are

538
00:27:59.045 --> 00:28:02.945
<00:27:59.045>as <00:27:59.278>normal <00:27:59.511>as <00:27:59.745>performance <00:27:59.978>and <00:28:00.211>scalability <00:28:00.445>considerations.

539
00:28:03.325 --> 00:28:05.905
<00:28:03.325>By <00:28:03.525>doing <00:28:03.725>so, <00:28:03.925>you <00:28:04.125>empower <00:28:04.325>not <00:28:04.525>only <00:28:04.725>yourself,

540
00:28:05.965 --> 00:28:09.265
<00:28:05.965>but <00:28:06.139>everyone <00:28:06.314>around <00:28:06.490>you <00:28:06.665>to <00:28:06.840>take <00:28:07.014>ownership <00:28:07.189>of <00:28:07.365>ai

541
00:28:11.245 --> 00:28:14.585
<00:28:11.245>and <00:28:11.385>please <00:28:11.524>give <00:28:11.665>the <00:28:11.804>current <00:28:11.945>pace <00:28:12.084>of, <00:28:12.225>given <00:28:12.364>the <00:28:12.504>current <00:28:12.645>pace

542
00:28:14.585 --> 00:28:18.465
<00:28:14.585>of <00:28:14.712>development <00:28:14.839>in <00:28:14.966>ai, <00:28:15.094>where <00:28:15.221>I <00:28:15.348>foresee <00:28:15.475>a <00:28:15.603>future <00:28:15.730>in <00:28:15.857>which <00:28:15.985>we

543
00:28:18.465 --> 00:28:20.305
<00:28:18.465>as <00:28:18.745>developers <00:28:19.024>tend <00:28:19.304>to <00:28:19.584>lean <00:28:19.865>back

544
00:28:20.845 --> 00:28:23.665
<00:28:20.845>and <00:28:21.000>let <00:28:21.156>agents <00:28:21.311>do <00:28:21.467>more <00:28:21.622>than <00:28:21.778>just <00:28:21.933>the <00:28:22.089>heavy <00:28:22.245>lifting.

545
00:28:23.805 --> 00:28:27.065
<00:28:23.805>Always <00:28:23.960>make <00:28:24.116>sure <00:28:24.271>that <00:28:24.427>you <00:28:24.582>understand <00:28:24.738>what <00:28:24.893>it <00:28:25.049>is <00:28:25.205>building

546
00:28:27.165 --> 00:28:29.465
<00:28:27.165>and <00:28:27.305>never <00:28:27.445>ever <00:28:27.585>let <00:28:27.725>it <00:28:27.865>become <00:28:28.004>a <00:28:28.145>black <00:28:28.284>box <00:28:28.425>for <00:28:28.565>you.

547
00:28:29.775 --> 00:28:32.785
<00:28:29.775>Because <00:28:29.975>if <00:28:30.175>this <00:28:30.375>happens, <00:28:30.575>we <00:28:30.775>are <00:28:30.975>risking <00:28:31.175>safety

548
00:28:32.885 --> 00:28:34.105
<00:28:32.885>for <00:28:33.251>the <00:28:33.617>whole <00:28:33.983>mankind.

549
00:28:36.725 --> 00:28:40.185
<00:28:36.725>So <00:28:36.925>that, <00:28:37.125>that <00:28:37.324>leads <00:28:37.524>me <00:28:37.725>to <00:28:37.925>one <00:28:38.125>thing.

550
00:28:40.365 --> 00:28:43.745
<00:28:40.365>We <00:28:40.520>at <00:28:40.676>Eon <00:28:40.831>need <00:28:40.987>developers <00:28:41.142>like <00:28:41.298>you, <00:28:41.453>developers <00:28:41.609>who <00:28:41.765>care

551
00:28:43.745 --> 00:28:45.865
<00:28:43.745>and <00:28:43.945>have <00:28:44.145>a <00:28:44.344>conscience, <00:28:44.544>and <00:28:44.745>we <00:28:44.945>are <00:28:45.145>looking

552
00:28:49.545 --> 00:28:50.895
<00:28:49.545>thank <00:28:49.950>you <00:28:50.355>and <00:28:50.760>goodbye.