WEBVTT

1
00:00:02.575 --> 00:00:03.665
<00:00:02.575>Alright, <00:00:03.065>so <00:00:03.556>hello.

2
00:00:03.665 --> 00:00:06.585
<00:00:03.665>Welcome <00:00:03.820>to <00:00:03.976>our <00:00:04.131>talk <00:00:04.287>about <00:00:04.442>deep <00:00:04.598>fakes <00:00:04.753>in <00:00:04.909>real <00:00:05.064>time.

3
00:00:06.845 --> 00:00:10.825
<00:00:06.845>So <00:00:07.000>we, <00:00:07.156>that's <00:00:07.311>me, <00:00:07.467>Lesh, <00:00:07.622>and <00:00:07.778>the <00:00:07.933>people <00:00:08.089>at <00:00:08.245>TNG.

4
00:00:10.925 --> 00:00:12.185
<00:00:10.925>And <00:00:11.114>you <00:00:11.303>have <00:00:11.492>to <00:00:11.681>imagine <00:00:11.870>there's <00:00:12.059>people

5
00:00:12.205 --> 00:00:14.345
<00:00:12.205>who <00:00:12.405>actually <00:00:12.605>do <00:00:12.805>deep <00:00:13.005>fakes <00:00:13.205>in <00:00:13.405>real <00:00:13.605>time.

6
00:00:14.365 --> 00:00:17.425
<00:00:14.365>And <00:00:14.540>this <00:00:14.715>is <00:00:14.890>what <00:00:15.065>our <00:00:15.240>talk <00:00:15.415>is <00:00:15.590>about <00:00:15.765>today.

7
00:00:17.685 --> 00:00:20.945
<00:00:17.685>So <00:00:17.860>to <00:00:18.035>jump <00:00:18.209>straight <00:00:18.384>in, <00:00:18.560>that's <00:00:18.735>the <00:00:18.910>wrong <00:00:19.084>button.

8
00:00:21.915 --> 00:00:23.665
<00:00:21.915>We'll <00:00:22.148>have <00:00:22.381>a <00:00:22.615>short <00:00:22.848>round <00:00:23.081>of <00:00:23.314>introduction,

9
00:00:23.665 --> 00:00:26.425
<00:00:23.665>and <00:00:23.820>first <00:00:23.976>one <00:00:24.131>who's <00:00:24.287>gonna <00:00:24.442>introduce <00:00:24.598>himself <00:00:24.753>is <00:00:24.909>gonna <00:00:25.064>be

10
00:00:26.605 --> 00:00:28.225
<00:00:26.605>Thomas <00:00:28.005>Andres.

11
00:00:31.405 --> 00:00:33.745
<00:00:31.405>So, <00:00:31.605>hello <00:00:31.805>everybody. <00:00:32.005>My <00:00:32.205>name <00:00:32.405>is <00:00:32.605>Thomas <00:00:32.805>Andres.

12
00:00:33.945 --> 00:00:36.545
<00:00:33.945>I <00:00:34.085>study <00:00:34.225>computer <00:00:34.365>sciences <00:00:34.505>and <00:00:34.645>after <00:00:34.785>my <00:00:34.925>studies <00:00:35.065>I <00:00:35.205>joined <00:00:35.345>t

13
00:00:36.545 --> 00:00:39.425
<00:00:36.545>and <00:00:36.745>g, <00:00:36.945>the <00:00:37.145>company <00:00:37.345>I'm <00:00:37.545>currently <00:00:37.745>also <00:00:37.945>working.

14
00:00:40.045 --> 00:00:42.345
<00:00:40.045>And, <00:00:40.220>uh, <00:00:40.395>I'm <00:00:40.570>now <00:00:40.745>one <00:00:40.920>of <00:00:41.095>the <00:00:41.270>managing <00:00:41.445>partners

15
00:00:42.345 --> 00:00:45.705
<00:00:42.345>and <00:00:42.519>together <00:00:42.695>with <00:00:42.870>Martin <00:00:43.045>who <00:00:43.220>will <00:00:43.394>introduce <00:00:43.570>himself <00:00:43.745>next.

16
00:00:46.385 --> 00:00:48.225
<00:00:46.385>I <00:00:46.665>created <00:00:46.945>a <00:00:47.224>lot <00:00:47.504>of <00:00:47.785>prototypes

17
00:00:48.225 --> 00:00:50.385
<00:00:48.225>or <00:00:48.425>we <00:00:48.625>created <00:00:48.825>a <00:00:49.025>lot <00:00:49.225>of <00:00:49.425>prototypes, <00:00:49.625>um,

18
00:00:50.835 --> 00:00:52.465
<00:00:50.835>concerning <00:00:51.535>augmented <00:00:52.235>reality,

19
00:00:52.465 --> 00:00:54.705
<00:00:52.465>virtual <00:00:52.815>reality, <00:00:53.165>robotics, <00:00:53.515>gesture <00:00:53.865>control.

20
00:00:54.765 --> 00:00:58.785
<00:00:54.765>And <00:00:54.940>now <00:00:55.115>we <00:00:55.290>switched <00:00:55.465>over <00:00:55.640>to, <00:00:55.815>uh, <00:00:55.990>artificial <00:00:56.165>intelligence.

21
00:00:59.325 --> 00:01:02.665
<00:00:59.325>And, <00:00:59.525>uh, <00:00:59.725>this <00:00:59.925>is <00:01:00.125>one <00:01:00.325>of <00:01:00.525>our <00:01:00.725>interesting,

22
00:01:02.775 --> 00:01:04.425
<00:01:02.775>hopefully <00:01:03.475>interesting <00:01:04.175>showcases.

23
00:01:04.425 --> 00:01:06.665
<00:01:04.425>So, <00:01:04.625>Martin, <00:01:04.825>do <00:01:05.024>you <00:01:05.224>want <00:01:05.425>to <00:01:05.625>introduce <00:01:05.825>yourself?

24
00:01:07.415 --> 00:01:10.025
<00:01:07.415>Yeah, <00:01:07.615>hello <00:01:07.815>there. <00:01:08.015>My <00:01:08.215>name <00:01:08.415>is <00:01:08.615>Martin <00:01:08.815>Fer.

25
00:01:10.085 --> 00:01:12.785
<00:01:10.085>Uh, <00:01:10.285>I <00:01:10.485>studied <00:01:10.685>computer <00:01:10.885>sciences <00:01:11.085>and <00:01:11.285>applied <00:01:11.485>sciences,

26
00:01:12.925 --> 00:01:15.825
<00:01:12.925>and <00:01:13.065>I'm <00:01:13.205>working <00:01:13.345>for <00:01:13.485>TNG <00:01:13.625>Technology <00:01:13.765>for <00:01:13.905>15 <00:01:14.045>years <00:01:14.185>right <00:01:14.325>now,

27
00:01:16.245 --> 00:01:18.705
<00:01:16.245>and <00:01:16.400>I'm <00:01:16.556>part <00:01:16.711>of <00:01:16.867>the <00:01:17.022>innovation <00:01:17.178>hacking <00:01:17.333>team <00:01:17.489>as <00:01:17.645>well.

28
00:01:18.805 --> 00:01:19.985
<00:01:18.805>So <00:01:19.070>let's <00:01:19.336>go <00:01:19.601>to <00:01:19.867>Jonas.

29
00:01:21.845 --> 00:01:23.265
<00:01:21.845>Yes. <00:01:22.100>So <00:01:22.356>my <00:01:22.611>name <00:01:22.867>is <00:01:23.123>Jonas.

30
00:01:23.265 --> 00:01:25.705
<00:01:23.265>You <00:01:23.498>might <00:01:23.731>recognize <00:01:23.965>the <00:01:24.198>body <00:01:24.431>right <00:01:24.665>here,

31
00:01:25.805 --> 00:01:27.785
<00:01:25.805>but <00:01:25.980>I've <00:01:26.155>been <00:01:26.330>with <00:01:26.505>TNG <00:01:26.680>for <00:01:26.855>three <00:01:27.030>years <00:01:27.205>now.

32
00:01:27.825 --> 00:01:29.265
<00:01:27.825>I <00:01:28.041>work <00:01:28.257>at <00:01:28.473>the <00:01:28.689>Innovation <00:01:28.905>hacking <00:01:29.121>team

33
00:01:29.365 --> 00:01:31.665
<00:01:29.365>and <00:01:29.565>I <00:01:29.765>do <00:01:29.964>cool <00:01:30.164>stuff <00:01:30.365>such <00:01:30.565>as <00:01:30.765>DeepFakes.

34
00:01:32.325 --> 00:01:35.585
<00:01:32.325>And <00:01:32.500>before <00:01:32.675>we <00:01:32.850>start <00:01:33.025>talking <00:01:33.200>about <00:01:33.375>DeepFakes, <00:01:33.550>we <00:01:33.725>want

35
00:01:35.585 --> 00:01:37.065
<00:01:35.585>to <00:01:35.851>show <00:01:36.117>you <00:01:36.384>a <00:01:36.650>little <00:01:36.917>video

36
00:01:37.175 --> 00:01:40.505
<00:01:37.175>that <00:01:37.350>I <00:01:37.524>found <00:01:37.700>just <00:01:37.875>this <00:01:38.050>morning <00:01:38.225>actually <00:01:38.399>on <00:01:38.575>YouTube.

37
00:01:41.205 --> 00:01:43.425
<00:01:41.205>So, <00:01:41.438>um, <00:01:41.671>it's <00:01:41.905>a <00:01:42.138>bit <00:01:42.371>weird, <00:01:42.605>Thomas.

38
00:01:43.675 --> 00:01:44.825
<00:01:43.675>We'll, <00:01:43.822>we'll <00:01:43.970>just <00:01:44.118>have <00:01:44.266>a <00:01:44.414>look <00:01:44.562>at <00:01:44.710>it.

39
00:01:44.905 --> 00:01:47.345
<00:01:44.905>I, <00:01:45.060>I <00:01:45.216>was <00:01:45.371>quite <00:01:45.527>confused <00:01:45.682>by <00:01:45.838>this <00:01:45.993>video. <00:01:46.149>Okay. <00:01:46.305>Okay.

40
00:01:47.655 --> 00:01:50.905
<00:01:47.655>President <00:01:47.810>Trump <00:01:47.966>is <00:01:48.121>a <00:01:48.277>total <00:01:48.432>and <00:01:48.588>complete <00:01:48.743>dip <00:01:48.899>s**t, <00:01:49.055>right?

41
00:01:51.085 --> 00:01:54.105
<00:01:51.085>So, <00:01:51.225>so <00:01:51.365>you <00:01:51.505>can, <00:01:51.645>you <00:01:51.785>can <00:01:51.925>see <00:01:52.065>this <00:01:52.205>is <00:01:52.345>Obama <00:01:52.485>here

42
00:01:54.245 --> 00:01:55.865
<00:01:54.245>and <00:01:54.525>he <00:01:54.805>says <00:01:55.085>some <00:01:55.365>weird <00:01:55.645>things.

43
00:01:56.455 --> 00:01:58.865
<00:01:56.455>It's <00:01:56.688>kind <00:01:56.921>of <00:01:57.155>confusing <00:01:57.388>to <00:01:57.621>me. <00:01:57.855>Um,

44
00:01:59.345 --> 00:02:00.345
<00:01:59.345>I <00:01:59.645>can't <00:01:59.945>believe <00:02:00.245>it.

45
00:02:00.495 --> 00:02:01.385
<00:02:00.495>Yeah, <00:02:00.695>I <00:02:00.895>don't <00:02:01.095>know. <00:02:01.296>Let's

46
00:02:01.385 --> 00:02:02.505
<00:02:01.385>just <00:02:01.511>have <00:02:01.637>a <00:02:01.763>look <00:02:01.889>at <00:02:02.015>it <00:02:02.141>again. <00:02:02.267>Yeah, <00:02:02.393>yeah.

47
00:02:02.505 --> 00:02:05.105
<00:02:02.505>President <00:02:02.679>Trump <00:02:02.854>is <00:02:03.030>a <00:02:03.205>total <00:02:03.380>and <00:02:03.554>complete <00:02:03.729>dip <00:02:03.905>s**t.

48
00:02:05.725 --> 00:02:06.785
<00:02:05.725>And <00:02:05.915>I <00:02:06.106>think <00:02:06.297>that's <00:02:06.488>pretty <00:02:06.679>weird.

49
00:02:06.785 --> 00:02:08.705
<00:02:06.785>That's <00:02:06.960>kind <00:02:07.134>of <00:02:07.310>a <00:02:07.485>career <00:02:07.660>ender <00:02:07.835>for <00:02:08.009>him <00:02:08.185>here.

50
00:02:08.825 --> 00:02:11.585
<00:02:08.824>'cause <00:02:08.980>you <00:02:09.136>can <00:02:09.291>clearly <00:02:09.447>see <00:02:09.602>this <00:02:09.758>is <00:02:09.913>Obama. <00:02:10.069>It's <00:02:10.225>Obama's

51
00:02:11.585 --> 00:02:12.585
<00:02:11.585>Voice. <00:02:11.885>It's <00:02:12.185>definitely <00:02:12.485>Obama.

52
00:02:12.585 --> 00:02:13.305
<00:02:12.585>Yeah. <00:02:13.233>And

53
00:02:13.425 --> 00:02:14.985
<00:02:13.425>It's, <00:02:13.658>it's <00:02:13.891>a <00:02:14.125>video <00:02:14.358>from <00:02:14.591>the <00:02:14.825>internet,

54
00:02:14.985 --> 00:02:16.065
<00:02:14.985>so <00:02:15.179>it <00:02:15.373>has <00:02:15.568>to <00:02:15.762>be <00:02:15.957>real.

55
00:02:16.365 --> 00:02:18.225
<00:02:16.365>So <00:02:16.715>I <00:02:17.065>think <00:02:17.415>absolutely. <00:02:17.765>Yeah,

56
00:02:18.225 --> 00:02:19.865
<00:02:18.225>that's <00:02:18.505>pretty <00:02:18.785>bad. <00:02:19.065>That's <00:02:19.345>pretty <00:02:19.625>bad.

57
00:02:20.255 --> 00:02:21.385
<00:02:20.255>Come, <00:02:20.424>come <00:02:20.594>on, <00:02:20.763>come <00:02:20.933>on, <00:02:21.102>come <00:02:21.272>on.

58
00:02:21.515 --> 00:02:22.665
<00:02:21.515>Let's, <00:02:21.773>let's <00:02:22.032>stop <00:02:22.291>us <00:02:22.549>here.

59
00:02:22.765 --> 00:02:26.545
<00:02:22.765>So <00:02:22.964>please, <00:02:23.165>please, <00:02:23.364>um, <00:02:23.565>didn't <00:02:23.765>you <00:02:23.964>just, <00:02:24.165>uh,

60
00:02:26.545 --> 00:02:27.785
<00:02:26.545>had <00:02:26.731>a <00:02:26.917>look <00:02:27.103>to <00:02:27.289>the <00:02:27.475>whole <00:02:27.661>video.

61
00:02:28.805 --> 00:02:33.065
<00:02:28.805>So <00:02:28.945>you <00:02:29.085>see <00:02:29.225>it's <00:02:29.365>the <00:02:29.505>same <00:02:29.645>like, <00:02:29.785>uh, <00:02:29.925>for <00:02:30.065>newspaper <00:02:30.205>articles,

62
00:02:33.065 --> 00:02:35.545
<00:02:33.065>just <00:02:33.265>don't <00:02:33.465>only <00:02:33.665>read <00:02:33.865>the, <00:02:34.065>the, <00:02:34.265>the <00:02:34.465>headline.

63
00:02:36.285 --> 00:02:39.465
<00:02:36.285>So <00:02:36.412>you <00:02:36.539>should <00:02:36.666>have <00:02:36.794>a <00:02:36.921>look <00:02:37.048>to <00:02:37.175>the, <00:02:37.303>to <00:02:37.430>the <00:02:37.557>whole <00:02:37.685>video.

64
00:02:39.885 --> 00:02:40.945
<00:02:39.885>So <00:02:40.203>let's <00:02:40.521>do <00:02:40.839>it.

65
00:02:41.635 --> 00:02:44.345
<00:02:41.635>We're <00:02:41.774>entering <00:02:41.915>an <00:02:42.054>era <00:02:42.195>in <00:02:42.334>which <00:02:42.475>our <00:02:42.614>enemies <00:02:42.755>can <00:02:42.894>make <00:02:43.035>it

66
00:02:44.345 --> 00:02:46.945
<00:02:44.345>look <00:02:44.484>like <00:02:44.625>anyone <00:02:44.765>is <00:02:44.905>saying <00:02:45.045>anything <00:02:45.185>at <00:02:45.325>any <00:02:45.465>point <00:02:45.605>in <00:02:45.745>time,

67
00:02:47.695 --> 00:02:49.145
<00:02:47.695>even <00:02:47.881>if <00:02:48.067>they <00:02:48.254>would <00:02:48.440>never <00:02:48.627>say <00:02:48.813>those <00:02:49.000>things.

68
00:02:50.565 --> 00:02:54.465
<00:02:50.565>So, <00:02:50.704>uh, <00:02:50.845>for <00:02:50.984>instance, <00:02:51.125>they <00:02:51.265>could <00:02:51.405>have <00:02:51.545>me <00:02:51.685>say <00:02:51.825>things <00:02:51.965>like,

69
00:02:55.665 --> 00:02:58.105
<00:02:55.665>I <00:02:55.945>don't <00:02:56.225>know, <00:02:56.505>Killmonger <00:02:56.785>was <00:02:57.065>right,

70
00:02:59.265 --> 00:03:01.925
<00:02:59.265>or, <00:02:59.440>uh, <00:02:59.614>Ben <00:02:59.790>Carson <00:02:59.964>is <00:03:00.140>in <00:03:00.315>the <00:03:00.489>sunken <00:03:00.665>place.

71
00:03:02.265 --> 00:03:03.645
<00:03:02.265>Or <00:03:02.679>how <00:03:03.093>about <00:03:03.507>this?

72
00:03:03.645 --> 00:03:07.325
<00:03:03.645>Simply <00:03:03.800>President <00:03:03.956>Trump <00:03:04.111>is <00:03:04.267>a <00:03:04.422>total <00:03:04.578>and <00:03:04.733>complete <00:03:04.889>dip <00:03:05.045>s**t.

73
00:03:08.505 --> 00:03:11.365
<00:03:08.505>Now <00:03:08.680>you <00:03:08.855>see, <00:03:09.030>I <00:03:09.204>would <00:03:09.380>never <00:03:09.555>say <00:03:09.730>these <00:03:09.905>things,

74
00:03:12.425 --> 00:03:15.685
<00:03:12.425>at <00:03:12.565>least <00:03:12.705>not <00:03:12.845>in <00:03:12.985>a <00:03:13.125>public <00:03:13.265>address, <00:03:13.405>but <00:03:13.545>someone <00:03:13.685>else <00:03:13.825>would.

75
00:03:16.675 --> 00:03:19.485
<00:03:16.675>Someone <00:03:17.141>like <00:03:17.608>Jordan <00:03:18.075>Keel,

76
00:03:20.915 --> 00:03:22.165
<00:03:20.915>this <00:03:21.196>is <00:03:21.477>a <00:03:21.758>dangerous <00:03:22.040>time.

77
00:03:23.195 --> 00:03:26.365
<00:03:23.195>Yeah, <00:03:23.475>this <00:03:23.755>is <00:03:24.035>a <00:03:24.315>dangerous <00:03:24.595>time.

78
00:03:27.145 --> 00:03:28.485
<00:03:27.145>So <00:03:27.748>the <00:03:28.351>topic

79
00:03:28.745 --> 00:03:31.965
<00:03:28.745>around <00:03:28.945>deep <00:03:29.145>fakes <00:03:29.345>is <00:03:29.545>a <00:03:29.745>very <00:03:29.945>controversial <00:03:30.145>topic.

80
00:03:32.425 --> 00:03:36.365
<00:03:32.425>And <00:03:32.580>Carl <00:03:32.736>Backstrom <00:03:32.891>of <00:03:33.047>the <00:03:33.202>University <00:03:33.358>of <00:03:33.513>Washington, <00:03:33.669>he <00:03:33.825>said,

81
00:03:37.035 --> 00:03:39.045
<00:03:37.035>when <00:03:37.234>a <00:03:37.435>new <00:03:37.635>technology <00:03:37.835>like <00:03:38.035>this <00:03:38.234>comes <00:03:38.435>along,

82
00:03:39.305 --> 00:03:42.445
<00:03:39.305>the <00:03:39.460>most <00:03:39.616>dangerous <00:03:39.771>period <00:03:39.927>is <00:03:40.082>when <00:03:40.238>the <00:03:40.393>technology <00:03:40.549>is <00:03:40.705>out

83
00:03:42.445 --> 00:03:44.805
<00:03:42.445>there, <00:03:42.644>but <00:03:42.845>the <00:03:43.045>public <00:03:43.245>isn't <00:03:43.445>aware <00:03:43.644>of <00:03:43.845>it,

84
00:03:45.505 --> 00:03:48.845
<00:03:45.505>that's <00:03:45.704>when <00:03:45.905>it <00:03:46.105>can <00:03:46.305>be <00:03:46.505>used <00:03:46.704>most <00:03:46.905>effectively.

85
00:03:49.545 --> 00:03:50.965
<00:03:49.545>So <00:03:49.800>now <00:03:50.056>let's <00:03:50.311>have <00:03:50.567>a <00:03:50.823>look

86
00:03:51.705 --> 00:03:56.245
<00:03:51.704>to <00:03:51.904>the <00:03:52.105>stuff <00:03:52.304>we <00:03:52.505>just <00:03:52.704>saw <00:03:52.904>the <00:03:53.105>agenda.

87
00:03:56.425 --> 00:03:59.965
<00:03:56.425>We <00:03:56.600>want <00:03:56.775>to <00:03:56.950>differentiate <00:03:57.125>between <00:03:57.300>different <00:03:57.475>types <00:03:57.650>of <00:03:57.825>fakes.

88
00:03:59.995 --> 00:04:02.725
<00:03:59.995>Then <00:04:00.150>we <00:04:00.306>want <00:04:00.461>to <00:04:00.617>have <00:04:00.772>a <00:04:00.928>look <00:04:01.083>to <00:04:01.239>deep <00:04:01.395>fakes

89
00:04:02.755 --> 00:04:03.965
<00:04:02.755>with <00:04:03.118>Deep <00:04:03.481>Face <00:04:03.844>lab,

90
00:04:03.965 --> 00:04:06.245
<00:04:03.965>which <00:04:04.165>is <00:04:04.365>the <00:04:04.565>original <00:04:04.765>implementation <00:04:04.965>of <00:04:05.165>deep <00:04:05.365>fakes.

91
00:04:06.755 --> 00:04:08.525
<00:04:06.755>Then <00:04:06.988>we <00:04:07.221>want <00:04:07.454>to <00:04:07.688>discuss <00:04:07.921>the <00:04:08.155>project,

92
00:04:09.225 --> 00:04:12.285
<00:04:09.225>how <00:04:09.424>we <00:04:09.625>made <00:04:09.825>deep <00:04:10.025>fakes <00:04:10.225>in <00:04:10.424>real <00:04:10.625>time.

93
00:04:13.265 --> 00:04:14.965
<00:04:13.265>And <00:04:13.545>last <00:04:13.825>but <00:04:14.105>not <00:04:14.385>least, <00:04:14.665>fields

94
00:04:14.965 --> 00:04:16.485
<00:04:14.965>of <00:04:15.307>application <00:04:15.649>and <00:04:15.991>a <00:04:16.333>conclusion.

95
00:04:16.865 --> 00:04:20.325
<00:04:16.865>So <00:04:17.005>let's <00:04:17.144>have <00:04:17.285>a <00:04:17.425>look <00:04:17.565>to <00:04:17.704>the <00:04:17.845>stuff <00:04:17.985>we <00:04:18.125>just <00:04:18.265>saw.

96
00:04:20.325 --> 00:04:24.245
<00:04:20.325>This <00:04:20.500>is <00:04:20.675>the <00:04:20.849>Obama <00:04:21.024>lip <00:04:21.200>sync <00:04:21.375>in <00:04:21.550>news <00:04:21.724>articles.

97
00:04:24.275 --> 00:04:27.805
<00:04:24.275>Very, <00:04:24.450>very <00:04:24.625>often <00:04:24.799>it's, <00:04:24.974>um, <00:04:25.150>tagged <00:04:25.325>with, <00:04:25.500>um, <00:04:25.674>yeah,

98
00:04:27.945 --> 00:04:30.175
<00:04:27.945>the <00:04:28.411>keyword <00:04:28.878>deep <00:04:29.344>fakes,

99
00:04:30.635 --> 00:04:33.495
<00:04:30.635>but <00:04:30.775>in <00:04:30.914>fact, <00:04:31.055>let's <00:04:31.195>have <00:04:31.335>a <00:04:31.474>look <00:04:31.615>what <00:04:31.755>it <00:04:31.895>really <00:04:32.034>is.

100
00:04:33.915 --> 00:04:38.375
<00:04:33.915>So <00:04:34.090>a <00:04:34.265>voice <00:04:34.440>do, <00:04:34.615>um, <00:04:34.790>was <00:04:34.965>imitating <00:04:35.140>Barrick <00:04:35.315>Obama

101
00:04:39.075 --> 00:04:40.175
<00:04:39.075>and <00:04:39.570>just, <00:04:40.065>uh,

102
00:04:40.175 --> 00:04:42.775
<00:04:40.175>they <00:04:40.408>just <00:04:40.641>recorded <00:04:40.875>some <00:04:41.108>audio <00:04:41.341>wave <00:04:41.575>information.

103
00:04:43.565 --> 00:04:47.575
<00:04:43.565>This <00:04:43.740>audio <00:04:43.915>information <00:04:44.090>goes <00:04:44.265>into <00:04:44.440>a <00:04:44.615>recurrent <00:04:44.790>neural <00:04:44.965>network.

104
00:04:48.075 --> 00:04:51.495
<00:04:48.075>And <00:04:48.230>with <00:04:48.386>this <00:04:48.541>recurrent <00:04:48.697>neural <00:04:48.852>network, <00:04:49.008>you <00:04:49.163>are <00:04:49.319>able <00:04:49.474>to

105
00:04:52.095 --> 00:04:53.855
<00:04:52.095>identify <00:04:52.795>mouth <00:04:53.495>positions.

106
00:04:54.155 --> 00:04:57.655
<00:04:54.155>So <00:04:54.294>you <00:04:54.434>can <00:04:54.575>do <00:04:54.715>mouth <00:04:54.854>tracking <00:04:54.994>based <00:04:55.135>on <00:04:55.275>audio <00:04:55.414>wave <00:04:55.554>forms,

107
00:04:58.515 --> 00:05:01.775
<00:04:58.515>and <00:04:58.655>then <00:04:58.794>you <00:04:58.935>just <00:04:59.075>look <00:04:59.215>up <00:04:59.354>in <00:04:59.495>the <00:04:59.635>original <00:04:59.775>video <00:04:59.914>source,

108
00:05:02.235 --> 00:05:06.895
<00:05:02.235>the <00:05:02.410>best <00:05:02.585>fitting, <00:05:02.760>uh, <00:05:02.935>mouth, <00:05:03.110>um, <00:05:03.285>for, <00:05:03.460>uh, <00:05:03.635>yeah,

109
00:05:07.695 --> 00:05:09.135
<00:05:07.695>specific <00:05:07.954>things <00:05:08.213>you <00:05:08.472>want <00:05:08.731>to <00:05:08.991>say.

110
00:05:09.165 --> 00:05:11.295
<00:05:09.165>Then <00:05:09.398>you <00:05:09.631>copy <00:05:09.865>that, <00:05:10.098>you <00:05:10.331>retime <00:05:10.565>that,

111
00:05:11.715 --> 00:05:12.975
<00:05:11.715>and <00:05:11.998>then <00:05:12.282>it <00:05:12.565>looks <00:05:12.849>like

112
00:05:13.565 --> 00:05:16.375
<00:05:13.565>that <00:05:13.740>Obama <00:05:13.915>is <00:05:14.090>saying <00:05:14.265>things <00:05:14.440>he <00:05:14.615>would <00:05:14.790>never <00:05:14.965>say,

113
00:05:17.155 --> 00:05:21.955
<00:05:17.155>at <00:05:17.271>least <00:05:17.388>not <00:05:17.505>in <00:05:17.621>the <00:05:17.738>public <00:05:17.854>address, <00:05:17.971>but <00:05:18.088>as <00:05:18.205>this <00:05:18.321>is <00:05:18.438>just <00:05:18.554>copy

114
00:05:22.175 --> 00:05:26.955
<00:05:22.175>and <00:05:22.302>paste, <00:05:22.429>um, <00:05:22.556>this <00:05:22.684>is <00:05:22.811>not <00:05:22.938>approved <00:05:23.065>as <00:05:23.193>a <00:05:23.320>real <00:05:23.447>deep <00:05:23.575>fake.

115
00:05:27.485 --> 00:05:29.075
<00:05:27.485>Let's <00:05:27.718>have <00:05:27.951>a <00:05:28.185>look <00:05:28.418>to <00:05:28.651>something <00:05:28.885>else,

116
00:05:29.125 --> 00:05:31.035
<00:05:29.125>which <00:05:29.405>is <00:05:29.685>called <00:05:29.965>Face <00:05:30.245>swap <00:05:30.525>Jonas.

117
00:05:32.305 --> 00:05:36.605
<00:05:32.305>Yes. <00:05:32.432>So <00:05:32.559>what <00:05:32.686>you <00:05:32.814>can <00:05:32.941>see <00:05:33.068>here <00:05:33.195>is <00:05:33.323>the <00:05:33.450>so-called <00:05:33.577>face <00:05:33.705>swap,

118
00:05:36.605 --> 00:05:38.725
<00:05:36.605>as <00:05:36.780>you <00:05:36.955>would <00:05:37.130>find <00:05:37.305>it <00:05:37.480>in <00:05:37.655>apps <00:05:37.830>like <00:05:38.005>Snapchat

119
00:05:38.745 --> 00:05:39.885
<00:05:38.745>or <00:05:39.087>masquerade <00:05:39.429>or <00:05:39.771>something.

120
00:05:40.585 --> 00:05:43.625
<00:05:40.585>And <00:05:40.818>as <00:05:41.051>you <00:05:41.284>can <00:05:41.518>see <00:05:41.751>it, <00:05:41.984>Martin

121
00:05:43.645 --> 00:05:45.065
<00:05:43.645>and <00:05:43.787>I, <00:05:43.929>we <00:05:44.070>had <00:05:44.212>a <00:05:44.355>beautiful <00:05:44.497>day <00:05:44.639>in <00:05:44.781>the <00:05:44.923>office

122
00:05:45.085 --> 00:05:46.825
<00:05:45.085>and <00:05:45.364>just <00:05:45.645>playing <00:05:45.924>around <00:05:46.205>faffing <00:05:46.484>around.

123
00:05:47.325 --> 00:05:49.825
<00:05:47.325>And <00:05:47.452>what <00:05:47.579>you <00:05:47.706>can <00:05:47.834>also <00:05:47.961>see <00:05:48.088>that <00:05:48.215>is <00:05:48.343>that <00:05:48.470>there's <00:05:48.597>some <00:05:48.724>kind

124
00:05:49.825 --> 00:05:52.145
<00:05:49.825>of <00:05:50.104>face <00:05:50.385>detection <00:05:50.664>algorithm <00:05:50.945>that <00:05:51.224>kind

125
00:05:52.145 --> 00:05:54.145
<00:05:52.145>of <00:05:52.344>crops <00:05:52.544>out <00:05:52.745>the <00:05:52.945>area <00:05:53.145>of <00:05:53.344>our <00:05:53.544>faces.

126
00:05:54.725 --> 00:05:57.285
<00:05:54.725>And <00:05:54.900>then <00:05:55.075>what <00:05:55.250>happens <00:05:55.425>is <00:05:55.600>it's <00:05:55.775>basically <00:05:55.950>a <00:05:56.125>glorified

127
00:05:57.285 --> 00:05:58.485
<00:05:57.284>copy <00:05:57.554>and <00:05:57.825>paste <00:05:58.095>once <00:05:58.365>again.

128
00:05:58.485 --> 00:06:00.605
<00:05:58.485>So <00:05:58.685>it <00:05:58.885>takes <00:05:59.085>my <00:05:59.285>face, <00:05:59.485>pastes <00:05:59.685>it <00:05:59.885>onto

129
00:06:01.285 --> 00:06:02.765
<00:06:01.285>Martin's <00:06:01.618>head <00:06:01.951>and <00:06:02.284>vice <00:06:02.616>versa.

130
00:06:03.505 --> 00:06:05.605
<00:06:03.505>So <00:06:03.705>you <00:06:03.905>see <00:06:04.105>the <00:06:04.305>illusion <00:06:04.505>also <00:06:04.705>just <00:06:04.905>kind

131
00:06:05.605 --> 00:06:08.165
<00:06:05.605>of <00:06:05.780>quickly <00:06:05.955>breaks <00:06:06.130>once <00:06:06.305>you <00:06:06.480>start <00:06:06.655>doing <00:06:06.830>more <00:06:07.005>extreme

132
00:06:08.165 --> 00:06:09.725
<00:06:08.165>things <00:06:08.631>with <00:06:09.098>our <00:06:09.565>faces.

133
00:06:10.105 --> 00:06:11.485
<00:06:10.105>And <00:06:10.312>the <00:06:10.519>worst <00:06:10.726>thing <00:06:10.933>is <00:06:11.140>here, <00:06:11.347>yeah,

134
00:06:11.515 --> 00:06:13.605
<00:06:11.515>obviously <00:06:11.794>the <00:06:12.075>face <00:06:12.354>is <00:06:12.635>only <00:06:12.914>copy

135
00:06:13.605 --> 00:06:16.205
<00:06:13.605>and <00:06:13.805>paste, <00:06:14.005>there <00:06:14.205>is <00:06:14.405>no <00:06:14.605>deep <00:06:14.805>learning <00:06:15.005>involved

136
00:06:16.585 --> 00:06:17.725
<00:06:16.585>in <00:06:16.927>generating <00:06:17.269>the <00:06:17.611>faces.

137
00:06:17.905 --> 00:06:22.165
<00:06:17.905>So <00:06:18.032>for <00:06:18.159>us, <00:06:18.286>this <00:06:18.414>is <00:06:18.541>not <00:06:18.668>a <00:06:18.795>deepfake, <00:06:18.923>this <00:06:19.050>is <00:06:19.177>not <00:06:19.304>approved.

138
00:06:23.435 --> 00:06:25.535
<00:06:23.435>So <00:06:23.635>let's <00:06:23.835>have <00:06:24.035>a <00:06:24.235>look <00:06:24.435>at <00:06:24.635>another <00:06:24.835>example.

139
00:06:25.595 --> 00:06:28.815
<00:06:25.595>And <00:06:25.750>that <00:06:25.906>is <00:06:26.061>the <00:06:26.217>face-to-face <00:06:26.372>approach <00:06:26.528>here <00:06:26.683>from <00:06:26.839>the <00:06:26.995>two

140
00:06:29.055 --> 00:06:30.855
<00:06:29.055>Munich, <00:06:29.335>also <00:06:29.615>known <00:06:29.895>as <00:06:30.175>real-time <00:06:30.455>reenactment.

141
00:06:31.475 --> 00:06:34.735
<00:06:31.475>And <00:06:31.602>what <00:06:31.729>you <00:06:31.856>can <00:06:31.984>see <00:06:32.111>here <00:06:32.238>is <00:06:32.365>you <00:06:32.493>have <00:06:32.620>a <00:06:32.747>source <00:06:32.875>actor

142
00:06:34.765 --> 00:06:36.215
<00:06:34.765>that <00:06:34.982>sits <00:06:35.200>in <00:06:35.417>front <00:06:35.635>of <00:06:35.852>a <00:06:36.070>camera

143
00:06:36.315 --> 00:06:38.335
<00:06:36.315>and <00:06:36.515>a <00:06:36.715>target <00:06:36.915>actor, <00:06:37.115>usually <00:06:37.315>a <00:06:37.515>loop <00:06:37.715>video.

144
00:06:39.155 --> 00:06:41.455
<00:06:39.155>And, <00:06:39.505>uh, <00:06:39.854>the <00:06:40.205>facial <00:06:40.554>expressions

145
00:06:41.455 --> 00:06:44.295
<00:06:41.455>of <00:06:41.610>the <00:06:41.766>source <00:06:41.921>actor <00:06:42.077>are <00:06:42.232>projected <00:06:42.388>onto <00:06:42.543>the <00:06:42.699>target <00:06:42.854>actor.

146
00:06:44.295 --> 00:06:46.415
<00:06:44.295>And <00:06:44.450>it <00:06:44.606>looks <00:06:44.761>like <00:06:44.917>the <00:06:45.072>target <00:06:45.228>actor <00:06:45.383>would <00:06:45.539>say <00:06:45.695>things

147
00:06:46.725 --> 00:06:48.095
<00:06:46.725>that <00:06:47.033>he <00:06:47.341>was <00:06:47.649>not <00:06:47.958>saying.

148
00:06:48.835 --> 00:06:53.375
<00:06:48.835>And <00:06:48.990>this <00:06:49.146>is <00:06:49.301>all <00:06:49.457>based <00:06:49.612>upon <00:06:49.768>a <00:06:49.923>parametric <00:06:50.079>face <00:06:50.234>model.

149
00:06:53.515 --> 00:06:58.335
<00:06:53.515>So <00:06:53.655>the <00:06:53.794>underlying <00:06:53.935>model, <00:06:54.075>it, <00:06:54.215>uh, <00:06:54.354>it, <00:06:54.495>uh, <00:06:54.635>consists <00:06:54.775>of <00:06:54.914>apart

150
00:06:58.435 --> 00:07:01.015
<00:06:58.435>for <00:06:58.715>the <00:06:58.995>face <00:06:59.275>shape <00:06:59.555>and <00:06:59.835>appearance,

151
00:07:01.515 --> 00:07:05.215
<00:07:01.515>and <00:07:01.655>one <00:07:01.794>for <00:07:01.935>the <00:07:02.075>facial <00:07:02.215>expression <00:07:02.354>that <00:07:02.495>you <00:07:02.635>can <00:07:02.775>probably <00:07:02.914>see

152
00:07:05.215 --> 00:07:07.415
<00:07:05.215>that <00:07:05.414>pretty <00:07:05.614>soon <00:07:05.815>in <00:07:06.015>the <00:07:06.215>slides <00:07:06.414>as <00:07:06.614>well.

153
00:07:08.285 --> 00:07:10.455
<00:07:08.285>Yeah, <00:07:08.518>it's <00:07:08.751>gonna <00:07:08.985>take <00:07:09.218>a <00:07:09.451>while <00:07:09.685>anyways,

154
00:07:10.455 --> 00:07:13.055
<00:07:10.455>what <00:07:10.582>you <00:07:10.709>can <00:07:10.836>then <00:07:10.964>do <00:07:11.091>is <00:07:11.218>you <00:07:11.345>can <00:07:11.473>fit <00:07:11.600>this <00:07:11.727>parametric <00:07:11.854>face

155
00:07:13.055 --> 00:07:15.895
<00:07:13.055>model <00:07:13.210>to <00:07:13.366>both <00:07:13.521>your <00:07:13.677>source <00:07:13.832>actor <00:07:13.988>and <00:07:14.143>your <00:07:14.299>target <00:07:14.455>actor.

156
00:07:16.565 --> 00:07:19.055
<00:07:16.565>Take <00:07:16.765>the <00:07:16.965>facial <00:07:17.165>expressions <00:07:17.365>of <00:07:17.565>your <00:07:17.765>source <00:07:17.965>actor

157
00:07:19.075 --> 00:07:22.335
<00:07:19.075>and <00:07:19.230>splice <00:07:19.386>it <00:07:19.541>with <00:07:19.697>the <00:07:19.852>appearance <00:07:20.008>from <00:07:20.163>your <00:07:20.319>target <00:07:20.474>actor.

158
00:07:22.715 --> 00:07:24.095
<00:07:22.715>And <00:07:22.921>then <00:07:23.129>you <00:07:23.336>end <00:07:23.543>up <00:07:23.750>with <00:07:23.957>something

159
00:07:24.095 --> 00:07:26.175
<00:07:24.095>that <00:07:24.295>looks <00:07:24.495>a <00:07:24.695>little <00:07:24.895>bit <00:07:25.095>something <00:07:25.295>like <00:07:25.495>this.

160
00:07:26.765 --> 00:07:30.895
<00:07:26.765>However, <00:07:26.892>the <00:07:27.019>big <00:07:27.146>issue <00:07:27.274>for <00:07:27.401>here <00:07:27.528>is <00:07:27.655>this <00:07:27.783>is <00:07:27.910>all <00:07:28.037>done <00:07:28.164>using,

161
00:07:31.475 --> 00:07:33.135
<00:07:31.475>uh, <00:07:32.175>classical <00:07:32.875>optimization.

162
00:07:33.235 --> 00:07:35.455
<00:07:33.235>So <00:07:33.435>there's <00:07:33.635>no <00:07:33.835>deep <00:07:34.035>learning <00:07:34.235>in <00:07:34.435>here <00:07:34.635>whatsoever.

163
00:07:36.355 --> 00:07:39.935
<00:07:36.355>So <00:07:36.482>for <00:07:36.609>that <00:07:36.736>reason, <00:07:36.864>we <00:07:36.991>cannot <00:07:37.118>really <00:07:37.245>call <00:07:37.373>this <00:07:37.500>a <00:07:37.627>deep <00:07:37.755>fake.

164
00:07:40.355 --> 00:07:42.575
<00:07:40.355>And <00:07:40.530>you <00:07:40.705>can <00:07:40.880>see, <00:07:41.055>uh, <00:07:41.230>the <00:07:41.405>parametric <00:07:41.580>face <00:07:41.755>models,

165
00:07:42.675 --> 00:07:44.095
<00:07:42.675>how <00:07:42.888>they <00:07:43.101>would <00:07:43.314>look <00:07:43.527>like <00:07:43.740>right <00:07:43.953>there.

166
00:07:44.755 --> 00:07:47.175
<00:07:44.755>Um, <00:07:44.930>so <00:07:45.105>this <00:07:45.280>is <00:07:45.455>not <00:07:45.630>a <00:07:45.805>deep <00:07:45.980>fake, <00:07:46.155>uh,

167
00:07:47.175 --> 00:07:48.895
<00:07:47.175>this <00:07:47.375>is <00:07:47.575>not <00:07:47.775>a, <00:07:47.975>a <00:07:48.175>deep <00:07:48.375>learning <00:07:48.575>base.

168
00:07:48.965 --> 00:07:52.135
<00:07:48.965>This <00:07:49.120>is <00:07:49.276>not <00:07:49.431>a <00:07:49.587>deep <00:07:49.742>fake. <00:07:49.898>This <00:07:50.053>is <00:07:50.209>not <00:07:50.365>approved.

169
00:07:52.995 --> 00:07:55.095
<00:07:52.995>So <00:07:53.228>what <00:07:53.461>exactly <00:07:53.695>is <00:07:53.928>a <00:07:54.161>deepfake <00:07:54.395>then?

170
00:07:58.405 --> 00:08:03.015
<00:07:58.405>Yeah, <00:07:58.532>so <00:07:58.659>for <00:07:58.786>all <00:07:58.914>the <00:07:59.041>stuff <00:07:59.168>we <00:07:59.295>just <00:07:59.423>saw, <00:07:59.550>there <00:07:59.677>are <00:07:59.804>yeah,

171
00:08:03.015 --> 00:08:06.295
<00:08:03.015>papers <00:08:03.170>available <00:08:03.326>where <00:08:03.481>you <00:08:03.637>can <00:08:03.792>just, <00:08:03.948>uh, <00:08:04.103>have <00:08:04.259>a <00:08:04.414>look

172
00:08:06.355 --> 00:08:07.695
<00:08:06.355>how <00:08:06.757>stuff <00:08:07.159>is <00:08:07.561>working.

173
00:08:07.995 --> 00:08:10.975
<00:08:07.995>So <00:08:08.150>we <00:08:08.306>thought <00:08:08.461>maybe <00:08:08.617>we <00:08:08.772>can <00:08:08.928>find <00:08:09.083>some <00:08:09.239>papers <00:08:09.395>on

174
00:08:11.085 --> 00:08:12.095
<00:08:11.085>deep <00:08:11.388>fakes <00:08:11.691>as <00:08:11.994>well.

175
00:08:12.675 --> 00:08:14.215
<00:08:12.675>So <00:08:12.906>we <00:08:13.137>did <00:08:13.368>a <00:08:13.599>lot <00:08:13.830>of <00:08:14.061>research

176
00:08:14.395 --> 00:08:17.095
<00:08:14.395>and, <00:08:14.534>uh, <00:08:14.674>the <00:08:14.815>only <00:08:14.955>thing <00:08:15.094>we <00:08:15.234>just <00:08:15.375>found <00:08:15.515>was <00:08:15.655>a <00:08:15.794>forum

177
00:08:17.225 --> 00:08:18.575
<00:08:17.225>entry <00:08:17.832>in <00:08:18.440>Reddit.

178
00:08:19.215 --> 00:08:23.735
<00:08:19.215>A <00:08:19.354>person <00:08:19.494>named <00:08:19.635>Deep <00:08:19.775>Faker <00:08:19.914>was, <00:08:20.054>uh, <00:08:20.195>yeah, <00:08:20.335>creating, <00:08:20.474>um, <00:08:20.614>some

179
00:08:24.285 --> 00:08:25.735
<00:08:24.285>kind <00:08:24.720>of <00:08:25.155>fake <00:08:25.590>videos.

180
00:08:26.155 --> 00:08:29.735
<00:08:26.155>Um, <00:08:26.354>so <00:08:26.554>he <00:08:26.755>took <00:08:26.955>his, <00:08:27.155>uh, <00:08:27.354>famous <00:08:27.554>actresses

181
00:08:30.395 --> 00:08:34.335
<00:08:30.395>and <00:08:30.594>he <00:08:30.794>placed <00:08:30.995>that <00:08:31.195>into <00:08:31.395>another <00:08:31.594>movie <00:08:31.794>genre.

182
00:08:35.155 --> 00:08:39.615
<00:08:35.155>And, <00:08:35.310>um, <00:08:35.466>yeah, <00:08:35.621>so <00:08:35.777>we <00:08:35.932>watched <00:08:36.088>a <00:08:36.243>lot <00:08:36.399>of <00:08:36.554>videos

183
00:08:39.835 --> 00:08:41.055
<00:08:39.835>and <00:08:40.018>we <00:08:40.201>did <00:08:40.384>a <00:08:40.567>lot <00:08:40.750>of <00:08:40.933>research.

184
00:08:41.275 --> 00:08:43.095
<00:08:41.275>Our, <00:08:41.508>our, <00:08:41.741>our <00:08:41.975>eyes <00:08:42.208>are <00:08:42.441>still <00:08:42.674>bleeding,

185
00:08:43.435 --> 00:08:48.255
<00:08:43.434>but <00:08:43.562>finally <00:08:43.689>we <00:08:43.816>can <00:08:43.944>show <00:08:44.071>you, <00:08:44.198>uh, <00:08:44.325>a <00:08:44.453>video <00:08:44.580>which <00:08:44.707>is, <00:08:44.834>uh,

186
00:08:48.255 --> 00:08:49.535
<00:08:48.255>hopefully <00:08:48.639>acceptable <00:08:49.023>for <00:08:49.406>you.

187
00:08:49.675 --> 00:08:51.015
<00:08:49.675>So <00:08:49.847>let's <00:08:50.019>have <00:08:50.191>a <00:08:50.364>look <00:08:50.536>to <00:08:50.708>this <00:08:50.881>one.

188
00:08:51.795 --> 00:08:55.565
<00:08:51.795>And, <00:08:51.950>uh, <00:08:52.106>this <00:08:52.261>is <00:08:52.417>a <00:08:52.572>snippet <00:08:52.728>from <00:08:52.883>the <00:08:53.039>movie <00:08:53.194>Superman.

189
00:08:55.985 --> 00:08:58.605
<00:08:55.985>And, <00:08:56.218>uh, <00:08:56.451>it's <00:08:56.685>all <00:08:56.918>about, <00:08:57.151>uh, <00:08:57.385>uh,

190
00:08:58.625 --> 00:08:59.965
<00:08:58.625>Amy <00:08:58.866>Adams <00:08:59.107>here <00:08:59.348>in <00:08:59.589>this <00:08:59.831>case.

191
00:09:00.945 --> 00:09:03.605
<00:09:00.945>So <00:09:01.178>let's <00:09:01.411>have <00:09:01.645>a <00:09:01.878>look <00:09:02.111>to <00:09:02.345>her.

192
00:09:03.825 --> 00:09:06.245
<00:09:03.825>So <00:09:03.980>on <00:09:04.136>the <00:09:04.291>left <00:09:04.447>side <00:09:04.602>you <00:09:04.758>can <00:09:04.913>see <00:09:05.069>Amy <00:09:05.225>Adams.

193
00:09:06.385 --> 00:09:08.485
<00:09:06.385>And <00:09:06.585>who <00:09:06.785>was <00:09:06.985>that <00:09:07.185>on <00:09:07.385>the <00:09:07.585>right <00:09:07.785>side?

194
00:09:09.145 --> 00:09:12.965
<00:09:09.145>It <00:09:09.285>looked <00:09:09.425>like <00:09:09.564>Amy <00:09:09.704>Adams <00:09:09.845>as <00:09:09.985>well, <00:09:10.125>but <00:09:10.265>with <00:09:10.405>another <00:09:10.545>face.

195
00:09:13.835 --> 00:09:15.485
<00:09:13.835>Okay, <00:09:14.301>let's <00:09:14.768>zoom <00:09:15.235>in.

196
00:09:17.115 --> 00:09:20.295
<00:09:17.115>So <00:09:17.242>what <00:09:17.369>we <00:09:17.496>can <00:09:17.624>see <00:09:17.751>here <00:09:17.878>is <00:09:18.005>actually <00:09:18.133>on <00:09:18.260>the <00:09:18.387>right <00:09:18.515>side,

197
00:09:20.895 --> 00:09:23.775
<00:09:20.895>a <00:09:21.095>Nicholas <00:09:21.295>Cagey <00:09:21.495>fight <00:09:21.694>version <00:09:21.895>of <00:09:22.095>Amy <00:09:22.295>Adams.

198
00:09:24.595 --> 00:09:28.135
<00:09:24.595>And <00:09:24.795>this <00:09:24.995>was <00:09:25.195>created <00:09:25.395>using <00:09:25.595>Deep <00:09:25.795>Face <00:09:25.995>Lab.

199
00:09:29.445 --> 00:09:33.215
<00:09:29.445>Yeah. <00:09:29.678>As <00:09:29.911>this <00:09:30.145>video <00:09:30.378>man, <00:09:30.611>uh, <00:09:30.845>material,

200
00:09:33.485 --> 00:09:36.815
<00:09:33.485>this <00:09:33.765>manipulated <00:09:34.045>video <00:09:34.325>material <00:09:34.605>is <00:09:34.885>generated

201
00:09:37.475 --> 00:09:39.055
<00:09:37.475>by <00:09:37.825>a <00:09:38.175>trained <00:09:38.525>neural <00:09:38.875>network.

202
00:09:39.645 --> 00:09:43.615
<00:09:39.645>This <00:09:39.819>is <00:09:39.995>definitely <00:09:40.170>approved <00:09:40.345>as <00:09:40.520>a <00:09:40.694>real <00:09:40.870>deep <00:09:41.045>fake.

203
00:09:44.195 --> 00:09:47.535
<00:09:44.195>And <00:09:44.311>now <00:09:44.428>we <00:09:44.545>want <00:09:44.661>to <00:09:44.778>have <00:09:44.895>a <00:09:45.011>look <00:09:45.128>how <00:09:45.245>such <00:09:45.361>deep <00:09:45.478>fakes <00:09:45.595>are

204
00:09:48.125 --> 00:09:49.935
<00:09:48.125>created <00:09:48.475>with <00:09:48.825>Deep <00:09:49.175>Face <00:09:49.525>Lab.

205
00:09:51.235 --> 00:09:54.615
<00:09:51.235>And <00:09:51.410>now <00:09:51.585>we <00:09:51.760>want <00:09:51.935>to <00:09:52.110>start <00:09:52.285>with, <00:09:52.460>uh, <00:09:52.635>yeah,

206
00:09:54.735 --> 00:09:59.415
<00:09:54.735>a <00:09:54.910>motivational <00:09:55.085>speech, <00:09:55.260>deep <00:09:55.435>fakes <00:09:55.610>with <00:09:55.785>Deep <00:09:55.960>Face <00:09:56.135>Lab,

207
00:09:59.995 --> 00:10:02.775
<00:09:59.995>Shaaba <00:10:00.228>famous <00:10:00.461>actor <00:10:00.695>in <00:10:00.928>movies <00:10:01.161>like <00:10:01.395>Transformers.

208
00:10:03.505 --> 00:10:04.735
<00:10:03.505>Let's <00:10:04.058>get <00:10:04.612>motivated.

209
00:10:05.995 --> 00:10:07.335
<00:10:05.995>Do <00:10:06.397>it, <00:10:06.799>do <00:10:07.201>it.

210
00:10:07.945 --> 00:10:10.055
<00:10:07.945>Don't <00:10:08.225>let <00:10:08.505>your <00:10:08.785>dreams <00:10:09.065>be <00:10:09.345>dreams

211
00:10:11.045 --> 00:10:12.735
<00:10:11.045>yesterday, <00:10:11.511>you <00:10:11.978>said <00:10:12.444>tomorrow.

212
00:10:13.195 --> 00:10:14.495
<00:10:13.195>So <00:10:13.780>just <00:10:14.365>do

213
00:10:14.495 --> 00:10:15.495
<00:10:14.495>It. <00:10:14.945>So <00:10:15.395>make,

214
00:10:15.495 --> 00:10:17.295
<00:10:15.495>let's <00:10:15.670>have <00:10:15.845>a <00:10:16.020>look <00:10:16.195>to <00:10:16.370>the <00:10:16.545>face <00:10:16.720>come <00:10:16.895>true.

215
00:10:18.555 --> 00:10:20.735
<00:10:18.555>So <00:10:18.905>did <00:10:19.255>you <00:10:19.604>recognize <00:10:19.954>something?

216
00:10:23.155 --> 00:10:25.745
<00:10:23.155>Maybe <00:10:23.388>it <00:10:23.621>looks <00:10:23.855>a <00:10:24.088>little <00:10:24.321>bit <00:10:24.555>different.

217
00:10:27.485 --> 00:10:30.585
<00:10:27.485>So <00:10:27.625>actually <00:10:27.765>what <00:10:27.905>we <00:10:28.045>can <00:10:28.185>see <00:10:28.325>here <00:10:28.465>is <00:10:28.605>a <00:10:28.745>Martin <00:10:28.885>Unified

218
00:10:30.585 --> 00:10:31.825
<00:10:30.585>version <00:10:30.864>of <00:10:31.143>Shaya <00:10:31.422>lab <00:10:31.701>above.

219
00:10:32.565 --> 00:10:35.665
<00:10:32.565>And, <00:10:32.798>um, <00:10:33.031>we <00:10:33.265>created <00:10:33.498>this <00:10:33.731>video, <00:10:33.965>uh,

220
00:10:35.665 --> 00:10:37.385
<00:10:35.665>within <00:10:36.015>five <00:10:36.365>to <00:10:36.714>six <00:10:37.064>hours.

221
00:10:38.165 --> 00:10:40.385
<00:10:38.165>So <00:10:38.365>we <00:10:38.564>have <00:10:38.765>a <00:10:38.964>powerful <00:10:39.165>machine <00:10:39.365>with <00:10:39.564>two,

222
00:10:40.405 --> 00:10:43.065
<00:10:40.405>and <00:10:40.605>we <00:10:40.805>are <00:10:41.005>10 <00:10:41.204>80 <00:10:41.405>ti <00:10:41.605>graphic <00:10:41.805>cards.

223
00:10:43.685 --> 00:10:47.345
<00:10:43.685>So <00:10:43.859>we <00:10:44.035>trained <00:10:44.209>a <00:10:44.385>neural <00:10:44.560>network <00:10:44.734>with <00:10:44.910>video <00:10:45.084>material,

224
00:10:47.965 --> 00:10:50.105
<00:10:47.965>and <00:10:48.140>we <00:10:48.315>want <00:10:48.490>to <00:10:48.665>show <00:10:48.840>you <00:10:49.015>how <00:10:49.190>that <00:10:49.365>works.

225
00:10:50.965 --> 00:10:55.225
<00:10:50.965>So <00:10:51.105>here's <00:10:51.245>a <00:10:51.385>assumed <00:10:51.525>inversion, <00:10:51.665>so <00:10:51.805>you <00:10:51.945>can <00:10:52.085>have, <00:10:52.225>uh, <00:10:52.365>um,

226
00:10:55.415 --> 00:10:57.945
<00:10:55.415>yeah, <00:10:55.570>a <00:10:55.726>look <00:10:55.881>on <00:10:56.037>this, <00:10:56.192>how <00:10:56.348>the <00:10:56.503>result <00:10:56.659>look <00:10:56.814>like,

227
00:10:57.945 --> 00:11:01.625
<00:10:57.945>and <00:10:58.072>it's <00:10:58.199>really <00:10:58.326>not <00:10:58.454>bad <00:10:58.581>for <00:10:58.708>five <00:10:58.835>to <00:10:58.963>six <00:10:59.090>hours <00:10:59.217>of <00:10:59.345>training.

228
00:11:02.045 --> 00:11:06.585
<00:11:02.045>So <00:11:02.185>Thomas, <00:11:02.324>what <00:11:02.464>do <00:11:02.604>we <00:11:02.745>need <00:11:02.885>to <00:11:03.025>create <00:11:03.165>such <00:11:03.305>deep <00:11:03.444>fakes?

229
00:11:07.015 --> 00:11:11.145
<00:11:07.015>Yeah, <00:11:07.215>actually <00:11:07.415>there <00:11:07.615>is, <00:11:07.814>um, <00:11:08.015>some <00:11:08.215>video <00:11:08.415>material

230
00:11:11.255 --> 00:11:13.385
<00:11:11.255>that <00:11:11.488>you <00:11:11.721>need <00:11:11.955>and, <00:11:12.188>uh, <00:11:12.421>there <00:11:12.655>is

231
00:11:13.385 --> 00:11:15.105
<00:11:13.385>of <00:11:13.665>course <00:11:13.944>the <00:11:14.225>video <00:11:14.505>material <00:11:14.785>from

232
00:11:15.825 --> 00:11:18.065
<00:11:15.825>which <00:11:15.965>we <00:11:16.105>will <00:11:16.245>have <00:11:16.385>a <00:11:16.525>look <00:11:16.665>at <00:11:16.805>a <00:11:16.945>little <00:11:17.085>bit <00:11:17.225>later.

233
00:11:18.405 --> 00:11:22.145
<00:11:18.405>But <00:11:18.579>there <00:11:18.755>is <00:11:18.930>also <00:11:19.105>video <00:11:19.280>material, <00:11:19.454>uh, <00:11:19.630>from <00:11:19.805>Martin,

234
00:11:22.905 --> 00:11:24.425
<00:11:22.905>I <00:11:23.178>think <00:11:23.452>I <00:11:23.725>just <00:11:23.999>went <00:11:24.272>to.

235
00:11:24.425 --> 00:11:25.705
<00:11:24.425>No, <00:11:24.655>that's <00:11:24.885>fine. <00:11:25.116>Oh <00:11:25.346>yeah. <00:11:25.577>Okay.

236
00:11:25.725 --> 00:11:29.105
<00:11:25.725>So <00:11:25.852>this <00:11:25.979>one <00:11:26.106>is, <00:11:26.234>uh, <00:11:26.361>the, <00:11:26.488>the <00:11:26.615>video <00:11:26.743>material <00:11:26.870>from <00:11:26.997>Shy <00:11:27.125>above.

237
00:11:29.175 --> 00:11:30.185
<00:11:29.175>Okay, <00:11:29.402>we <00:11:29.629>will <00:11:29.856>take <00:11:30.084>that.

238
00:11:30.645 --> 00:11:33.665
<00:11:30.645>And <00:11:30.800>the <00:11:30.956>second <00:11:31.111>one <00:11:31.267>is, <00:11:31.422>uh, <00:11:31.578>the <00:11:31.733>one <00:11:31.889>from <00:11:32.045>Martin.

239
00:11:34.045 --> 00:11:37.185
<00:11:34.045>And <00:11:34.172>as <00:11:34.299>you <00:11:34.426>can <00:11:34.554>see, <00:11:34.681>Martin <00:11:34.808>is <00:11:34.935>fooling <00:11:35.063>around <00:11:35.190>a <00:11:35.317>little <00:11:35.444>bit.

240
00:11:37.185 --> 00:11:41.745
<00:11:37.185>And <00:11:37.301>this <00:11:37.418>has <00:11:37.535>a <00:11:37.651>reason <00:11:37.768>because <00:11:37.885>he <00:11:38.001>needs <00:11:38.118>to <00:11:38.234>do <00:11:38.351>the <00:11:38.468>exact, <00:11:38.584>uh,

241
00:11:42.055 --> 00:11:44.905
<00:11:42.055>same, <00:11:42.405>uh, <00:11:42.755>expressions <00:11:43.104>that <00:11:43.454>Shia

242
00:11:44.905 --> 00:11:47.785
<00:11:44.905>above <00:11:45.105>does <00:11:45.305>in <00:11:45.505>the <00:11:45.704>original <00:11:45.905>video <00:11:46.105>as <00:11:46.305>well.

243
00:11:48.245 --> 00:11:51.025
<00:11:48.245>So <00:11:48.385>we <00:11:48.525>need <00:11:48.665>a <00:11:48.805>laughing <00:11:48.945>Martin, <00:11:49.085>we <00:11:49.225>need <00:11:49.365>a <00:11:49.505>crying <00:11:49.645>Martin,

244
00:11:51.125 --> 00:11:52.465
<00:11:51.125>we <00:11:51.426>need <00:11:51.728>a <00:11:52.029>screaming <00:11:52.331>Martin.

245
00:11:52.685 --> 00:11:55.805
<00:11:52.685>He <00:11:52.824>needs <00:11:52.964>to <00:11:53.104>look <00:11:53.244>at <00:11:53.385>the <00:11:53.525>camera <00:11:53.665>from <00:11:53.805>different <00:11:53.944>angles <00:11:54.084>from

246
00:11:55.805 --> 00:11:57.925
<00:11:55.805>the <00:11:56.005>site <00:11:56.204>and <00:11:56.405>so <00:11:56.604>on <00:11:56.805>and <00:11:57.005>so <00:11:57.204>on.

247
00:11:57.985 --> 00:12:01.645
<00:11:57.985>And <00:11:58.160>all <00:11:58.335>the, <00:11:58.510>uh, <00:11:58.685>facial <00:11:58.860>expressions <00:11:59.035>that <00:11:59.210>we <00:11:59.385>need,

248
00:12:02.225 --> 00:12:05.285
<00:12:02.225>we <00:12:02.380>need <00:12:02.536>them <00:12:02.691>both <00:12:02.847>in <00:12:03.002>the <00:12:03.158>source <00:12:03.313>video <00:12:03.469>as <00:12:03.625>well

249
00:12:05.865 --> 00:12:07.525
<00:12:05.865>as <00:12:06.215>in <00:12:06.565>the <00:12:06.915>target <00:12:07.265>video.

250
00:12:08.155 --> 00:12:12.165
<00:12:08.155>Okay. <00:12:08.329>And <00:12:08.505>with <00:12:08.680>that, <00:12:08.855>we <00:12:09.030>can <00:12:09.204>now <00:12:09.380>go <00:12:09.555>on

251
00:12:12.305 --> 00:12:16.005
<00:12:12.305>and, <00:12:12.444>um, <00:12:12.584>yeah, <00:12:12.724>do <00:12:12.864>some <00:12:13.005>little <00:12:13.145>bit <00:12:13.285>of <00:12:13.425>data <00:12:13.564>set <00:12:13.704>preparation.

252
00:12:16.465 --> 00:12:21.125
<00:12:16.465>So <00:12:16.620>what <00:12:16.776>we <00:12:16.931>do <00:12:17.087>here <00:12:17.242>is <00:12:17.398>we <00:12:17.553>need <00:12:17.709>to, <00:12:17.865>uh,

253
00:12:21.345 --> 00:12:25.325
<00:12:21.345>we <00:12:21.520>need <00:12:21.695>to <00:12:21.870>extract <00:12:22.045>some, <00:12:22.220>um, <00:12:22.395>some <00:12:22.570>faces <00:12:22.745>here.

254
00:12:25.545 --> 00:12:27.885
<00:12:25.545>And, <00:12:25.719>uh, <00:12:25.895>we <00:12:26.069>are <00:12:26.245>doing <00:12:26.420>this <00:12:26.594>frame <00:12:26.770>by <00:12:26.944>frame.

255
00:12:27.885 --> 00:12:30.205
<00:12:27.885>So <00:12:28.085>we're <00:12:28.285>taking <00:12:28.485>each <00:12:28.685>video <00:12:28.885>by <00:12:29.085>the <00:12:29.285>frame,

256
00:12:30.625 --> 00:12:33.205
<00:12:30.625>and <00:12:30.800>then <00:12:30.975>we <00:12:31.150>are <00:12:31.325>doing <00:12:31.500>a <00:12:31.675>face <00:12:31.850>recognition <00:12:32.025>on

257
00:12:33.235 --> 00:12:34.565
<00:12:33.235>each <00:12:33.634>of <00:12:34.033>those <00:12:34.432>frames.

258
00:12:35.025 --> 00:12:36.925
<00:12:35.025>And <00:12:35.305>then <00:12:35.584>we <00:12:35.865>extract <00:12:36.145>the <00:12:36.425>face.

259
00:12:37.025 --> 00:12:40.525
<00:12:37.025>So <00:12:37.165>we <00:12:37.305>just <00:12:37.444>take, <00:12:37.584>uh, <00:12:37.725>the, <00:12:37.865>the, <00:12:38.005>the, <00:12:38.145>the <00:12:38.285>face <00:12:38.425>itself

260
00:12:40.665 --> 00:12:42.645
<00:12:40.665>and <00:12:41.015>not <00:12:41.365>all <00:12:41.714>the <00:12:42.064>surroundings.

261
00:12:42.945 --> 00:12:44.925
<00:12:42.945>So <00:12:43.178>this <00:12:43.411>is, <00:12:43.645>uh, <00:12:43.878>the <00:12:44.111>inner <00:12:44.345>parts

262
00:12:44.985 --> 00:12:47.445
<00:12:44.985>of <00:12:45.218>the <00:12:45.451>green <00:12:45.685>contour <00:12:45.918>of <00:12:46.151>the <00:12:46.385>face.

263
00:12:47.945 --> 00:12:50.365
<00:12:47.945>And <00:12:48.100>then <00:12:48.256>we <00:12:48.411>also <00:12:48.567>align <00:12:48.722>it <00:12:48.878>a <00:12:49.033>little <00:12:49.189>bit <00:12:49.345>so

264
00:12:50.365 --> 00:12:52.365
<00:12:50.365>that <00:12:50.565>it <00:12:50.765>is <00:12:50.965>looking <00:12:51.165>centrally <00:12:51.365>into <00:12:51.565>the <00:12:51.765>camera.

265
00:12:52.505 --> 00:12:53.525
<00:12:52.505>So <00:12:52.688>this <00:12:52.872>is <00:12:53.055>a <00:12:53.239>little <00:12:53.423>bit

266
00:12:53.525 --> 00:12:55.845
<00:12:53.525>of <00:12:53.758>data <00:12:53.991>normalization <00:12:54.225>that <00:12:54.458>we <00:12:54.691>do <00:12:54.925>here.

267
00:12:56.385 --> 00:13:00.165
<00:12:56.385>And <00:12:56.525>this <00:12:56.665>can <00:12:56.805>actually <00:12:56.944>be <00:12:57.085>done <00:12:57.225>by <00:12:57.365>a <00:12:57.505>single <00:12:57.645>neural <00:12:57.785>network,

268
00:13:00.615 --> 00:13:02.245
<00:13:00.615>which <00:13:00.965>is <00:13:01.315>called <00:13:01.665>face <00:13:02.015>net.

269
00:13:02.625 --> 00:13:05.925
<00:13:02.625>And, <00:13:02.765>uh, <00:13:02.905>face <00:13:03.045>net, <00:13:03.185>most <00:13:03.325>of <00:13:03.465>you <00:13:03.605>have <00:13:03.745>probably <00:13:03.885>already <00:13:04.025>worked

270
00:13:05.925 --> 00:13:09.205
<00:13:05.925>with <00:13:06.125>it <00:13:06.324>because <00:13:06.525>if <00:13:06.724>you <00:13:06.925>have, <00:13:07.125>uh, <00:13:07.324>windows

271
00:13:09.625 --> 00:13:12.605
<00:13:09.625>and <00:13:09.825>if <00:13:10.025>you <00:13:10.225>are, <00:13:10.425>uh, <00:13:10.625>using <00:13:10.825>windows <00:13:11.025>hello

272
00:13:13.025 --> 00:13:14.885
<00:13:13.025>to <00:13:13.305>activate <00:13:13.584>windows <00:13:13.865>using <00:13:14.145>your <00:13:14.425>face,

273
00:13:15.155 --> 00:13:17.765
<00:13:15.155>then <00:13:15.435>you <00:13:15.714>have <00:13:15.995>already <00:13:16.275>used <00:13:16.555>it

274
00:13:17.765 --> 00:13:21.485
<00:13:17.765>because <00:13:17.892>it <00:13:18.019>is <00:13:18.146>the <00:13:18.274>central <00:13:18.401>part, <00:13:18.528>uh, <00:13:18.655>that <00:13:18.783>is, <00:13:18.910>uh, <00:13:19.037>taking <00:13:19.165>care

275
00:13:21.485 --> 00:13:22.885
<00:13:21.485>of <00:13:22.115>face <00:13:22.745>identification.

276
00:13:23.345 --> 00:13:25.005
<00:13:23.345>So <00:13:23.578>how <00:13:23.811>does <00:13:24.045>face <00:13:24.278>net <00:13:24.511>do <00:13:24.745>this?

277
00:13:25.625 --> 00:13:29.805
<00:13:25.625>It <00:13:25.765>takes <00:13:25.905>face <00:13:26.045>and <00:13:26.185>then <00:13:26.325>it <00:13:26.465>extracts <00:13:26.605>landmarks <00:13:26.745>from <00:13:26.885>this <00:13:27.025>face.

278
00:13:29.985 --> 00:13:33.885
<00:13:29.985>So <00:13:30.160>72 <00:13:30.335>landmarks <00:13:30.510>in <00:13:30.685>total, <00:13:30.860>it <00:13:31.035>extracts <00:13:31.210>the <00:13:31.385>contour

279
00:13:33.885 --> 00:13:36.965
<00:13:33.885>of <00:13:34.025>your <00:13:34.165>face, <00:13:34.305>but <00:13:34.444>also <00:13:34.585>your <00:13:34.725>nose, <00:13:34.865>your <00:13:35.005>mouth, <00:13:35.145>your <00:13:35.285>eyes,

280
00:13:37.305 --> 00:13:38.445
<00:13:37.305>and <00:13:37.510>so <00:13:37.715>on <00:13:37.920>and <00:13:38.125>so <00:13:38.331>on.

281
00:13:38.705 --> 00:13:42.845
<00:13:38.705>And <00:13:38.845>the <00:13:38.985>position <00:13:39.125>can <00:13:39.265>then <00:13:39.405>be <00:13:39.545>put <00:13:39.685>again <00:13:39.825>into <00:13:39.965>the <00:13:40.105>image.

282
00:13:43.465 --> 00:13:45.805
<00:13:43.465>Um, <00:13:43.698>but <00:13:43.931>we <00:13:44.165>can <00:13:44.398>also <00:13:44.631>use <00:13:44.865>it

283
00:13:45.865 --> 00:13:48.565
<00:13:45.865>for <00:13:46.145>this <00:13:46.425>is <00:13:46.705>these <00:13:46.985>extraction <00:13:47.265>purposes.

284
00:13:49.185 --> 00:13:51.885
<00:13:49.185>And <00:13:49.312>if <00:13:49.439>you <00:13:49.566>have <00:13:49.694>a <00:13:49.821>closer <00:13:49.948>look <00:13:50.075>at <00:13:50.203>it, <00:13:50.330>so <00:13:50.457>this <00:13:50.584>is

285
00:13:52.225 --> 00:13:55.685
<00:13:52.225>how <00:13:52.380>the <00:13:52.536>extraction, <00:13:52.691>uh, <00:13:52.847>how <00:13:53.002>the <00:13:53.158>extracted <00:13:53.313>phase <00:13:53.469>looks <00:13:53.625>like

286
00:13:56.225 --> 00:13:57.245
<00:13:56.225>it <00:13:56.531>is <00:13:56.837>quite <00:13:57.143>good.

287
00:13:57.585 --> 00:13:59.165
<00:13:57.585>In <00:13:57.818>most <00:13:58.051>cases <00:13:58.285>it <00:13:58.518>works <00:13:58.751>quite <00:13:58.985>well

288
00:13:59.625 --> 00:14:04.005
<00:13:59.625>and <00:13:59.780>it <00:13:59.936>detects <00:14:00.091>the <00:14:00.247>phase, <00:14:00.402>um, <00:14:00.558>in <00:14:00.713>a, <00:14:00.869>in <00:14:01.025>a

289
00:14:04.545 --> 00:14:06.365
<00:14:04.545>really <00:14:04.895>sens <00:14:05.245>a <00:14:05.594>sensible <00:14:05.944>manner.

290
00:14:06.865 --> 00:14:10.805
<00:14:06.865>And <00:14:07.005>then <00:14:07.145>there <00:14:07.285>are <00:14:07.425>some <00:14:07.565>glitches <00:14:07.705>where <00:14:07.845>the <00:14:07.985>hand <00:14:08.125>is <00:14:08.265>detected

291
00:14:10.905 --> 00:14:13.365
<00:14:10.905>as <00:14:11.045>a <00:14:11.185>face, <00:14:11.324>but <00:14:11.464>in <00:14:11.605>most <00:14:11.745>cases <00:14:11.885>it <00:14:12.025>works <00:14:12.165>pretty <00:14:12.305>well.

292
00:14:13.865 --> 00:14:17.005
<00:14:13.865>Um, <00:14:14.098>the <00:14:14.331>problem <00:14:14.565>with, <00:14:14.798>uh, <00:14:15.031>this <00:14:15.265>is

293
00:14:17.355 --> 00:14:19.005
<00:14:17.355>however, <00:14:17.705>that <00:14:18.055>is <00:14:18.405>pretty <00:14:18.755>slow.

294
00:14:19.105 --> 00:14:21.605
<00:14:19.105>So <00:14:19.280>one, <00:14:19.455>even <00:14:19.630>if <00:14:19.805>you <00:14:19.980>have <00:14:20.155>a <00:14:20.330>capable <00:14:20.505>machine,

295
00:14:21.865 --> 00:14:22.965
<00:14:21.865>you <00:14:22.195>have <00:14:22.525>one <00:14:22.855>frame

296
00:14:23.025 --> 00:14:25.365
<00:14:23.025>and <00:14:23.165>it <00:14:23.305>takes <00:14:23.444>about <00:14:23.584>half <00:14:23.725>a <00:14:23.865>second <00:14:24.005>or <00:14:24.145>something <00:14:24.285>like <00:14:24.425>that.

297
00:14:25.905 --> 00:14:29.125
<00:14:25.905>So <00:14:26.032>this <00:14:26.159>is <00:14:26.286>not, <00:14:26.414>uh, <00:14:26.541>what <00:14:26.668>you <00:14:26.795>can <00:14:26.923>do <00:14:27.050>when <00:14:27.177>real <00:14:27.305>time.

298
00:14:30.015 --> 00:14:33.275
<00:14:30.015>Um, <00:14:30.131>but <00:14:30.248>if <00:14:30.365>you <00:14:30.481>have <00:14:30.598>a <00:14:30.715>look <00:14:30.831>at <00:14:30.948>results, <00:14:31.064>it <00:14:31.181>looks <00:14:31.298>quite <00:14:31.415>well

299
00:14:33.275 --> 00:14:35.395
<00:14:33.275>because <00:14:33.415>real <00:14:33.555>time <00:14:33.694>is <00:14:33.834>not <00:14:33.975>a <00:14:34.115>thing <00:14:34.255>for <00:14:34.395>us <00:14:34.535>right <00:14:34.675>now.

300
00:14:35.855 --> 00:14:37.275
<00:14:35.855>And, <00:14:36.174>uh, <00:14:36.494>you <00:14:36.813>see <00:14:37.133>the

301
00:14:38.125 --> 00:14:40.315
<00:14:38.125>faces <00:14:38.325>are <00:14:38.525>always <00:14:38.725>looking <00:14:38.925>centrally <00:14:39.125>into <00:14:39.325>the <00:14:39.525>camera.

302
00:14:40.455 --> 00:14:44.115
<00:14:40.455>The <00:14:40.582>nose <00:14:40.709>is <00:14:40.836>somehow <00:14:40.964>in <00:14:41.091>the <00:14:41.218>middle, <00:14:41.345>always, <00:14:41.473>um, <00:14:41.600>they <00:14:41.727>are <00:14:41.855>not,

303
00:14:44.575 --> 00:14:46.755
<00:14:44.575>uh, <00:14:44.750>tilted <00:14:44.925>to <00:14:45.100>the <00:14:45.275>side <00:14:45.450>or <00:14:45.625>something <00:14:45.800>like <00:14:45.975>that.

304
00:14:47.295 --> 00:14:50.875
<00:14:47.295>And <00:14:47.469>this <00:14:47.645>is <00:14:47.819>quite <00:14:47.995>okay <00:14:48.170>the <00:14:48.344>way <00:14:48.520>it <00:14:48.694>is.

305
00:14:51.465 --> 00:14:54.125
<00:14:51.465>And <00:14:51.698>we <00:14:51.931>can <00:14:52.165>now <00:14:52.398>use <00:14:52.631>these <00:14:52.865>phases

306
00:14:54.125 --> 00:14:57.365
<00:14:54.125>and <00:14:54.252>Jonas <00:14:54.379>will <00:14:54.506>tell <00:14:54.634>us <00:14:54.761>a <00:14:54.888>little <00:14:55.015>bit <00:14:55.143>what <00:14:55.270>we <00:14:55.397>are <00:14:55.525>doing

307
00:14:57.515 --> 00:14:59.805
<00:14:57.515>with <00:14:57.981>the <00:14:58.448>prepared <00:14:58.915>dataset.

308
00:15:01.745 --> 00:15:04.365
<00:15:01.745>Yes. <00:15:01.945>So <00:15:02.145>now <00:15:02.345>we <00:15:02.545>have <00:15:02.745>prepared <00:15:02.945>our <00:15:03.145>dataset,

309
00:15:04.585 --> 00:15:07.485
<00:15:04.585>and <00:15:04.740>now <00:15:04.896>we <00:15:05.051>want <00:15:05.207>to <00:15:05.362>feed <00:15:05.518>this <00:15:05.673>into <00:15:05.829>the <00:15:05.985>brain

310
00:15:07.505 --> 00:15:08.805
<00:15:07.505>of <00:15:07.895>our <00:15:08.285>deep <00:15:08.675>fake.

311
00:15:08.805 --> 00:15:10.565
<00:15:08.805>And <00:15:09.038>that <00:15:09.271>is <00:15:09.505>the <00:15:09.738>deep <00:15:09.971>neural <00:15:10.204>network,

312
00:15:10.975 --> 00:15:13.205
<00:15:10.975>which <00:15:11.175>is <00:15:11.375>in <00:15:11.575>our <00:15:11.775>case <00:15:11.975>an <00:15:12.175>auto <00:15:12.375>encoder.

313
00:15:13.505 --> 00:15:16.165
<00:15:13.505>And <00:15:13.632>as <00:15:13.759>you <00:15:13.886>can <00:15:14.014>see, <00:15:14.141>the <00:15:14.268>auto <00:15:14.395>encoder <00:15:14.523>consists <00:15:14.650>of <00:15:14.777>two <00:15:14.905>parts.

314
00:15:16.225 --> 00:15:17.925
<00:15:16.225>So <00:15:16.425>on <00:15:16.625>one <00:15:16.825>hand <00:15:17.025>we <00:15:17.225>have <00:15:17.425>the <00:15:17.625>encoder,

315
00:15:18.105 --> 00:15:21.445
<00:15:18.105>and <00:15:18.245>that <00:15:18.385>takes <00:15:18.525>the <00:15:18.665>face <00:15:18.805>images <00:15:18.945>that <00:15:19.085>we <00:15:19.225>have <00:15:19.365>just <00:15:19.505>generated

316
00:15:21.785 --> 00:15:23.125
<00:15:21.785>and <00:15:22.086>kind <00:15:22.388>of <00:15:22.689>compresses <00:15:22.991>them.

317
00:15:23.125 --> 00:15:24.485
<00:15:23.125>It, <00:15:23.533>it <00:15:23.941>extracts <00:15:24.349>information

318
00:15:24.985 --> 00:15:28.365
<00:15:24.985>and <00:15:25.160>compresses <00:15:25.335>it <00:15:25.510>to <00:15:25.685>a <00:15:25.860>so-called <00:15:26.035>latent <00:15:26.210>space <00:15:26.385>representation

319
00:15:28.555 --> 00:15:30.405
<00:15:28.555>that <00:15:28.905>contains <00:15:29.255>information, <00:15:29.604>for <00:15:29.954>example,

320
00:15:30.415 --> 00:15:33.725
<00:15:30.415>about <00:15:30.589>facial <00:15:30.765>expression, <00:15:30.939>the <00:15:31.115>lighting <00:15:31.290>conditions, <00:15:31.464>as <00:15:31.640>well <00:15:31.814>as

321
00:15:33.725 --> 00:15:35.405
<00:15:33.725>for <00:15:33.958>example, <00:15:34.191>how <00:15:34.425>the <00:15:34.658>face <00:15:34.891>is <00:15:35.125>oriented.

322
00:15:35.865 --> 00:15:38.285
<00:15:35.865>And <00:15:36.020>then <00:15:36.176>we <00:15:36.331>have <00:15:36.487>the <00:15:36.642>decoder <00:15:36.798>that <00:15:36.953>takes <00:15:37.109>this <00:15:37.265>information

323
00:15:38.285 --> 00:15:40.845
<00:15:38.285>and <00:15:38.518>tries <00:15:38.751>to <00:15:38.985>reconstruct <00:15:39.218>the <00:15:39.451>original <00:15:39.685>image

324
00:15:41.275 --> 00:15:42.805
<00:15:41.275>from <00:15:41.733>set <00:15:42.193>latent <00:15:42.651>space.

325
00:15:43.425 --> 00:15:46.205
<00:15:43.425>So <00:15:43.658>to <00:15:43.891>do <00:15:44.125>this <00:15:44.358>on <00:15:44.591>a <00:15:44.824>deepfake

326
00:15:46.205 --> 00:15:49.085
<00:15:46.205>or <00:15:46.345>in <00:15:46.485>a <00:15:46.625>deepfake <00:15:46.765>context, <00:15:46.905>now <00:15:47.045>we <00:15:47.185>have <00:15:47.325>two <00:15:47.465>auto <00:15:47.605>encoders

327
00:15:49.305 --> 00:15:50.685
<00:15:49.305>and <00:15:49.615>those <00:15:49.925>share <00:15:50.236>one <00:15:50.546>encoders.

328
00:15:50.685 --> 00:15:53.685
<00:15:50.685>So <00:15:50.812>for <00:15:50.939>example, <00:15:51.066>we <00:15:51.194>can <00:15:51.321>take <00:15:51.448>a <00:15:51.575>phase <00:15:51.703>of <00:15:51.830>sha <00:15:51.957>Buf, <00:15:52.084>feed

329
00:15:53.685 --> 00:15:56.005
<00:15:53.685>that <00:15:53.840>into <00:15:53.996>the <00:15:54.151>encoder, <00:15:54.307>then <00:15:54.462>we <00:15:54.618>get <00:15:54.773>the <00:15:54.929>latent <00:15:55.084>space,

330
00:15:56.425 --> 00:15:59.605
<00:15:56.425>we <00:15:56.580>then <00:15:56.736>decode <00:15:56.891>that <00:15:57.047>through <00:15:57.202>the <00:15:57.358>decoder <00:15:57.513>of <00:15:57.669>sha <00:15:57.824>Buf,

331
00:15:59.605 --> 00:16:03.165
<00:15:59.605>and <00:15:59.732>then <00:15:59.859>we <00:15:59.986>end <00:16:00.114>up <00:16:00.241>with <00:16:00.368>pretty <00:16:00.495>much <00:16:00.623>exactly <00:16:00.750>the <00:16:00.877>same <00:16:01.005>picture

332
00:16:03.165 --> 00:16:06.085
<00:16:03.165>that <00:16:03.365>we <00:16:03.564>had <00:16:03.765>before, <00:16:03.964>which <00:16:04.165>is <00:16:04.365>quite <00:16:04.564>boring.

333
00:16:06.185 --> 00:16:08.565
<00:16:06.185>But <00:16:06.385>the <00:16:06.584>very <00:16:06.785>interesting <00:16:06.984>thing <00:16:07.185>comes <00:16:07.385>in <00:16:07.584>now,

334
00:16:08.565 --> 00:16:11.845
<00:16:08.565>if <00:16:08.720>we <00:16:08.876>take <00:16:09.031>a <00:16:09.187>face <00:16:09.342>of <00:16:09.498>Shala, <00:16:09.653>BUF <00:16:09.809>encode <00:16:09.965>that,

335
00:16:11.845 --> 00:16:13.165
<00:16:11.845>and <00:16:12.043>then <00:16:12.241>we <00:16:12.439>take <00:16:12.637>the <00:16:12.834>latent <00:16:13.033>space

336
00:16:13.165 --> 00:16:15.925
<00:16:13.165>and <00:16:13.365>decode <00:16:13.564>that <00:16:13.765>through <00:16:13.964>the <00:16:14.165>decoder <00:16:14.365>of <00:16:14.564>Martin.

337
00:16:16.225 --> 00:16:17.765
<00:16:16.225>So <00:16:16.456>we <00:16:16.687>end <00:16:16.918>up <00:16:17.149>with <00:16:17.380>the <00:16:17.611>face

338
00:16:18.155 --> 00:16:19.805
<00:16:18.155>that <00:16:18.388>looks <00:16:18.621>a <00:16:18.855>little <00:16:19.088>bit <00:16:19.321>like <00:16:19.555>Martin,

339
00:16:19.865 --> 00:16:21.445
<00:16:19.865>but <00:16:20.215>with <00:16:20.565>the <00:16:20.915>facial <00:16:21.265>expressions

340
00:16:21.445 --> 00:16:23.405
<00:16:21.445>of <00:16:21.678>Shala <00:16:21.911>buf <00:16:22.145>in <00:16:22.378>the <00:16:22.611>original <00:16:22.845>image.

341
00:16:24.365 --> 00:16:27.425
<00:16:24.365>And <00:16:24.540>this <00:16:24.715>is <00:16:24.890>exactly <00:16:25.065>how <00:16:25.240>a <00:16:25.415>deepfake <00:16:25.590>would <00:16:25.765>work.

342
00:16:28.445 --> 00:16:31.545
<00:16:28.445>So <00:16:28.572>if <00:16:28.699>we <00:16:28.826>now <00:16:28.954>have <00:16:29.081>a <00:16:29.208>look <00:16:29.335>at <00:16:29.463>how <00:16:29.590>this, <00:16:29.717>this <00:16:29.845>training

343
00:16:31.605 --> 00:16:34.385
<00:16:31.605>of <00:16:31.760>our <00:16:31.916>Neur <00:16:32.071>network <00:16:32.227>would <00:16:32.382>look <00:16:32.538>like <00:16:32.693>in <00:16:32.849>something <00:16:33.005>like

344
00:16:34.385 --> 00:16:36.865
<00:16:34.385>Deepfake <00:16:34.525>lab, <00:16:34.665>you <00:16:34.805>can <00:16:34.944>see <00:16:35.085>here <00:16:35.225>we <00:16:35.365>have <00:16:35.505>a <00:16:35.645>training <00:16:35.785>progress

345
00:16:36.865 --> 00:16:39.585
<00:16:36.865>after <00:16:37.565>60,001 <00:16:38.265>iterations.

346
00:16:39.585 --> 00:16:41.625
<00:16:39.585>And <00:16:39.760>you <00:16:39.935>can <00:16:40.110>see <00:16:40.285>we're <00:16:40.460>doing <00:16:40.635>one <00:16:40.810>from <00:16:40.985>Nicholas

347
00:16:41.695 --> 00:16:42.865
<00:16:41.695>Cage <00:16:42.046>to <00:16:42.397>Donald <00:16:42.748>Trump.

348
00:16:43.565 --> 00:16:46.065
<00:16:43.565>And <00:16:43.765>we <00:16:43.965>have <00:16:44.165>a <00:16:44.365>couple <00:16:44.565>of <00:16:44.765>columns <00:16:44.965>here.

349
00:16:46.065 --> 00:16:48.145
<00:16:46.065>And <00:16:46.265>the <00:16:46.465>first <00:16:46.665>column <00:16:46.865>is <00:16:47.065>the <00:16:47.265>training <00:16:47.465>data.

350
00:16:48.165 --> 00:16:50.585
<00:16:48.165>So <00:16:48.320>the <00:16:48.476>extractive <00:16:48.631>faces <00:16:48.787>that <00:16:48.942>we <00:16:49.098>have <00:16:49.253>for <00:16:49.409>Nicholas <00:16:49.564>Cage.

351
00:16:50.585 --> 00:16:53.745
<00:16:50.585>And <00:16:50.740>the <00:16:50.896>second <00:16:51.051>column <00:16:51.207>is <00:16:51.362>basically <00:16:51.518>what <00:16:51.673>the <00:16:51.829>auto <00:16:51.985>encoder

352
00:16:53.745 --> 00:16:57.345
<00:16:53.745>for <00:16:53.920>Nicholas <00:16:54.095>Cage <00:16:54.270>spits <00:16:54.445>out <00:16:54.620>after <00:16:54.795>these <00:16:54.970>60,001 <00:16:55.145>iterations.

353
00:16:57.845 --> 00:16:59.625
<00:16:57.845>And <00:16:58.020>then <00:16:58.195>we <00:16:58.370>have <00:16:58.545>the <00:16:58.720>same <00:16:58.895>for <00:16:59.070>Donald <00:16:59.245>Trump.

354
00:16:59.765 --> 00:17:02.585
<00:16:59.765>So <00:16:59.920>we <00:17:00.076>have <00:17:00.231>the <00:17:00.387>input <00:17:00.542>images, <00:17:00.698>so <00:17:00.853>the <00:17:01.009>training <00:17:01.165>data,

355
00:17:02.975 --> 00:17:04.465
<00:17:02.975>what <00:17:03.243>the <00:17:03.511>auto <00:17:03.779>encoder <00:17:04.047>spits <00:17:04.316>out.

356
00:17:04.485 --> 00:17:07.585
<00:17:04.484>And <00:17:04.640>then <00:17:04.796>finally <00:17:04.951>we <00:17:05.107>have <00:17:05.262>a <00:17:05.418>column <00:17:05.573>that <00:17:05.729>shows <00:17:05.885>you

357
00:17:07.615 --> 00:17:11.585
<00:17:07.615>what <00:17:07.742>comes <00:17:07.869>out <00:17:07.996>if <00:17:08.124>we <00:17:08.251>take <00:17:08.378>the <00:17:08.505>face <00:17:08.633>of, <00:17:08.760>um, <00:17:08.887>Donald <00:17:09.015>Trump

358
00:17:11.645 --> 00:17:14.305
<00:17:11.645>and <00:17:11.845>encode <00:17:12.045>that <00:17:12.244>and <00:17:12.444>decode <00:17:12.645>that <00:17:12.845>with <00:17:13.045>the

359
00:17:15.125 --> 00:17:18.045
<00:17:15.125>or <00:17:15.474>decoder <00:17:15.825>of <00:17:16.175>Nicholas <00:17:16.525>Cage.

360
00:17:18.065 --> 00:17:19.765
<00:17:18.065>So <00:17:18.240>we <00:17:18.415>end <00:17:18.590>up <00:17:18.765>with <00:17:18.940>faces <00:17:19.115>of <00:17:19.290>Nicholas <00:17:19.465>Cage

361
00:17:20.045 --> 00:17:22.165
<00:17:20.045>that <00:17:20.245>have <00:17:20.445>the <00:17:20.645>facial <00:17:20.845>expression <00:17:21.045>of <00:17:21.245>Donald <00:17:21.445>Trump.

362
00:17:22.905 --> 00:17:26.525
<00:17:22.905>And <00:17:23.021>if <00:17:23.138>we <00:17:23.254>now <00:17:23.371>have <00:17:23.488>a <00:17:23.605>closer <00:17:23.721>look <00:17:23.838>at <00:17:23.954>how <00:17:24.071>we <00:17:24.188>train <00:17:24.305>this,

363
00:17:27.305 --> 00:17:29.965
<00:17:27.305>we <00:17:27.538>basically <00:17:27.771>have <00:17:28.005>two <00:17:28.238>separate <00:17:28.471>auto <00:17:28.705>encoders

364
00:17:29.965 --> 00:17:31.125
<00:17:29.965>that <00:17:30.139>we <00:17:30.312>train <00:17:30.486>at <00:17:30.661>the <00:17:30.835>same <00:17:31.009>time.

365
00:17:31.225 --> 00:17:34.245
<00:17:31.225>So <00:17:31.365>we <00:17:31.504>have <00:17:31.645>phases <00:17:31.784>of <00:17:31.925>Martin <00:17:32.064>feed <00:17:32.205>those <00:17:32.344>into <00:17:32.485>Martin's <00:17:32.625>auto

366
00:17:34.245 --> 00:17:36.845
<00:17:34.245>encoder, <00:17:34.400>and <00:17:34.556>in <00:17:34.711>the <00:17:34.867>beginning <00:17:35.022>there <00:17:35.178>will <00:17:35.333>just <00:17:35.489>be <00:17:35.645>something

367
00:17:37.105 --> 00:17:38.805
<00:17:37.105>coming <00:17:37.385>out <00:17:37.665>of <00:17:37.945>that <00:17:38.225>auto <00:17:38.505>encoder

368
00:17:39.105 --> 00:17:41.605
<00:17:39.105>and <00:17:39.305>we <00:17:39.505>compare <00:17:39.705>the <00:17:39.905>output <00:17:40.105>against <00:17:40.305>the <00:17:40.505>input,

369
00:17:41.785 --> 00:17:43.245
<00:17:41.785>create <00:17:42.047>a <00:17:42.310>loss <00:17:42.573>function <00:17:42.836>with <00:17:43.099>that,

370
00:17:43.245 --> 00:17:45.685
<00:17:43.245>and <00:17:43.478>train <00:17:43.711>the <00:17:43.945>network <00:17:44.178>to <00:17:44.411>minimize <00:17:44.645>this.

371
00:17:46.225 --> 00:17:48.325
<00:17:46.225>And <00:17:46.380>we <00:17:46.536>do <00:17:46.691>the <00:17:46.847>same <00:17:47.002>thing <00:17:47.158>at <00:17:47.313>the <00:17:47.469>same <00:17:47.625>time

372
00:17:49.105 --> 00:17:50.845
<00:17:49.105>for, <00:17:49.571>uh, <00:17:50.038>Charlotte <00:17:50.505>B.

373
00:17:51.225 --> 00:17:53.005
<00:17:51.225>And <00:17:51.425>by <00:17:51.625>doing <00:17:51.824>this <00:17:52.024>at <00:17:52.225>the <00:17:52.425>same <00:17:52.625>time,

374
00:17:53.145 --> 00:17:56.445
<00:17:53.145>and <00:17:53.320>by <00:17:53.495>those <00:17:53.670>two <00:17:53.845>auto <00:17:54.020>encoders <00:17:54.195>sharing <00:17:54.370>one <00:17:54.545>encoder,

375
00:17:56.625 --> 00:17:59.285
<00:17:56.625>we <00:17:56.765>end <00:17:56.905>up <00:17:57.045>with <00:17:57.185>an <00:17:57.325>encoder <00:17:57.465>that <00:17:57.605>can <00:17:57.745>understand <00:17:57.885>both <00:17:58.025>faces,

376
00:17:59.335 --> 00:18:01.165
<00:17:59.335>break <00:17:59.535>them <00:17:59.735>down <00:17:59.935>to <00:18:00.135>the <00:18:00.335>same <00:18:00.535>latent <00:18:00.735>space.

377
00:18:01.465 --> 00:18:04.045
<00:18:01.465>And <00:18:01.605>this <00:18:01.745>is <00:18:01.885>the <00:18:02.024>exact <00:18:02.165>reason <00:18:02.304>why <00:18:02.445>the <00:18:02.584>deepfake <00:18:02.725>finally <00:18:02.865>works.

378
00:18:04.585 --> 00:18:06.085
<00:18:04.585>So <00:18:05.035>speaking <00:18:05.485>about <00:18:05.935>training,

379
00:18:06.135 --> 00:18:09.165
<00:18:06.135>let's <00:18:06.262>have <00:18:06.389>a <00:18:06.516>look <00:18:06.644>at <00:18:06.771>the <00:18:06.898>quick <00:18:07.025>time <00:18:07.153>lapse <00:18:07.280>of <00:18:07.407>the <00:18:07.535>training.

380
00:18:09.225 --> 00:18:11.245
<00:18:09.225>So <00:18:09.399>you <00:18:09.574>can <00:18:09.750>see <00:18:09.925>we're <00:18:10.100>just <00:18:10.274>feeding <00:18:10.449>in <00:18:10.625>faces,

381
00:18:11.345 --> 00:18:12.925
<00:18:11.345>and <00:18:11.545>you <00:18:11.745>can <00:18:11.945>see <00:18:12.145>we're <00:18:12.345>starting <00:18:12.545>from <00:18:12.745>gray

382
00:18:12.925 --> 00:18:14.885
<00:18:12.925>because <00:18:13.205>for <00:18:13.485>some <00:18:13.764>reason <00:18:14.044>we're <00:18:14.325>initializing

383
00:18:14.905 --> 00:18:15.925
<00:18:14.905>on <00:18:15.134>neur <00:18:15.364>nets <00:18:15.593>to <00:18:15.822>zero.

384
00:18:16.665 --> 00:18:18.925
<00:18:16.665>And <00:18:16.898>very <00:18:17.131>quickly <00:18:17.365>the <00:18:17.598>Neur <00:18:17.831>network <00:18:18.065>starts

385
00:18:19.065 --> 00:18:21.805
<00:18:19.065>to <00:18:19.265>learn <00:18:19.465>the <00:18:19.665>rough <00:18:19.865>shapes <00:18:20.065>of <00:18:20.265>the <00:18:20.465>faces.

386
00:18:22.785 --> 00:18:25.245
<00:18:22.785>And <00:18:22.912>right <00:18:23.039>about <00:18:23.166>now, <00:18:23.294>you <00:18:23.421>can <00:18:23.548>see <00:18:23.675>how <00:18:23.803>the <00:18:23.930>faces <00:18:24.057>are <00:18:24.185>starting

387
00:18:25.265 --> 00:18:27.085
<00:18:25.265>to <00:18:25.440>kind <00:18:25.615>of <00:18:25.790>shift <00:18:25.965>and <00:18:26.140>twist <00:18:26.315>a <00:18:26.490>little <00:18:26.665>bit.

388
00:18:27.465 --> 00:18:29.725
<00:18:27.465>And <00:18:27.620>this <00:18:27.776>is <00:18:27.931>the <00:18:28.087>new <00:18:28.242>network <00:18:28.398>learning, <00:18:28.553>the <00:18:28.709>next <00:18:28.865>thing,

389
00:18:29.725 --> 00:18:31.685
<00:18:29.725>which <00:18:29.958>is <00:18:30.191>the <00:18:30.425>rotation <00:18:30.658>of <00:18:30.891>the <00:18:31.125>face.

390
00:18:31.685 --> 00:18:33.165
<00:18:31.685>And <00:18:31.951>it's <00:18:32.217>pretty <00:18:32.484>interesting <00:18:32.750>how <00:18:33.017>it,

391
00:18:33.585 --> 00:18:36.165
<00:18:33.585>how <00:18:33.818>it <00:18:34.051>learns <00:18:34.285>things <00:18:34.518>in <00:18:34.751>different <00:18:34.985>orders.

392
00:18:37.105 --> 00:18:39.565
<00:18:37.105>So <00:18:37.260>if <00:18:37.416>we <00:18:37.571>skip <00:18:37.727>ahead <00:18:37.882>a <00:18:38.038>couple <00:18:38.193>of <00:18:38.349>thousand <00:18:38.505>iterations,

393
00:18:39.565 --> 00:18:43.885
<00:18:39.565>you <00:18:39.692>can <00:18:39.819>now <00:18:39.946>see <00:18:40.074>that <00:18:40.201>going <00:18:40.328>from <00:18:40.455>like <00:18:40.583>the <00:18:40.710>pretty <00:18:40.837>basic, <00:18:40.965>uh,

394
00:18:44.285 --> 00:18:46.765
<00:18:44.285>standard <00:18:44.565>face, <00:18:44.845>the <00:18:45.125>dfas <00:18:45.405>now <00:18:45.685>start

395
00:18:46.765 --> 00:18:48.845
<00:18:46.765>to <00:18:47.045>show <00:18:47.325>facial <00:18:47.605>expressions <00:18:47.885>as <00:18:48.165>well.

396
00:18:48.865 --> 00:18:50.445
<00:18:48.865>So <00:18:49.098>this <00:18:49.331>is <00:18:49.565>basically <00:18:49.798>the <00:18:50.031>final <00:18:50.265>step.

397
00:18:50.445 --> 00:18:53.925
<00:18:50.445>After <00:18:50.645>learning <00:18:50.845>the <00:18:51.044>general <00:18:51.245>appearance, <00:18:51.445>the <00:18:51.645>face <00:18:51.845>rotation,

398
00:18:53.945 --> 00:18:57.005
<00:18:53.945>it <00:18:54.178>now <00:18:54.411>learns <00:18:54.645>the, <00:18:54.878>uh, <00:18:55.111>facial <00:18:55.345>expressions

399
00:18:57.005 --> 00:18:58.085
<00:18:57.005>and <00:18:57.199>we're <00:18:57.393>gonna <00:18:57.588>skip <00:18:57.782>a <00:18:57.977>couple

400
00:18:58.085 --> 00:19:00.085
<00:18:58.085>of <00:18:58.435>more <00:18:58.785>thousand <00:18:59.135>iterations <00:18:59.485>ahead.

401
00:19:00.905 --> 00:19:03.405
<00:19:00.905>And <00:19:01.605>right <00:19:02.305>about,

402
00:19:07.155 --> 00:19:08.765
<00:19:07.155>well, <00:19:07.388>this <00:19:07.621>took <00:19:07.855>quite <00:19:08.088>a <00:19:08.321>lot <00:19:08.555>longer,

403
00:19:08.895 --> 00:19:11.805
<00:19:08.895>right <00:19:09.070>about <00:19:09.245>now <00:19:09.420>you <00:19:09.595>can <00:19:09.770>see <00:19:09.945>that <00:19:10.120>the <00:19:10.295>reproductions

404
00:19:11.805 --> 00:19:13.045
<00:19:11.805>of <00:19:12.028>our <00:19:12.251>faces <00:19:12.474>look <00:19:12.697>pretty <00:19:12.921>good.

405
00:19:13.385 --> 00:19:14.925
<00:19:13.385>But <00:19:13.616>if <00:19:13.847>we're <00:19:14.078>going <00:19:14.309>from <00:19:14.540>a, <00:19:14.771>uh,

406
00:19:15.665 --> 00:19:17.805
<00:19:15.665>if <00:19:15.820>we're <00:19:15.976>doing <00:19:16.131>a <00:19:16.287>deepfake <00:19:16.442>from <00:19:16.598>Martin <00:19:16.753>to <00:19:16.909>Sha <00:19:17.065>LaBuff,

407
00:19:17.805 --> 00:19:19.925
<00:19:17.805>you <00:19:17.932>can <00:19:18.059>see <00:19:18.186>we <00:19:18.314>still <00:19:18.441>have <00:19:18.568>some <00:19:18.695>green <00:19:18.823>artifacts <00:19:18.950>in <00:19:19.077>the <00:19:19.205>face.

408
00:19:20.225 --> 00:19:21.765
<00:19:20.225>So <00:19:20.502>we're <00:19:20.779>obviously <00:19:21.056>not <00:19:21.333>there <00:19:21.611>yet.

409
00:19:22.015 --> 00:19:23.405
<00:19:22.015>We'll <00:19:22.223>have <00:19:22.432>to <00:19:22.640>do <00:19:22.849>some <00:19:23.057>further <00:19:23.266>training,

410
00:19:24.195 --> 00:19:27.215
<00:19:24.195>but <00:19:24.370>now <00:19:24.544>we <00:19:24.720>have <00:19:24.895>a <00:19:25.070>perfectly <00:19:25.245>trained <00:19:25.419>neural <00:19:25.595>network,

411
00:19:27.375 --> 00:19:28.935
<00:19:27.375>a <00:19:27.725>perfectly <00:19:28.075>trained <00:19:28.425>auto <00:19:28.775>code.

412
00:19:28.965 --> 00:19:30.135
<00:19:28.965>What <00:19:29.140>do <00:19:29.316>we <00:19:29.491>do <00:19:29.667>with <00:19:29.842>that? <00:19:30.018>Now?

413
00:19:30.155 --> 00:19:32.015
<00:19:30.155>How <00:19:30.388>does <00:19:30.621>the <00:19:30.855>inference <00:19:31.088>look <00:19:31.321>like, <00:19:31.555>Martin?

414
00:19:33.125 --> 00:19:34.655
<00:19:33.125>Yeah, <00:19:33.321>let's <00:19:33.518>have <00:19:33.715>a <00:19:33.911>look <00:19:34.108>to <00:19:34.305>the <00:19:34.502>inference.

415
00:19:34.715 --> 00:19:38.135
<00:19:34.715>By <00:19:34.855>the <00:19:34.995>way, <00:19:35.135>uh, <00:19:35.274>for <00:19:35.415>the <00:19:35.554>input <00:19:35.695>material, <00:19:35.834>it's <00:19:35.975>not <00:19:36.115>necessary

416
00:19:38.275 --> 00:19:41.335
<00:19:38.275>to <00:19:38.430>get <00:19:38.586>filmed, <00:19:38.741>uh, <00:19:38.897>in <00:19:39.052>front <00:19:39.208>of <00:19:39.363>a <00:19:39.519>green <00:19:39.675>screen.

417
00:19:41.755 --> 00:19:45.295
<00:19:41.755>So, <00:19:41.930>um, <00:19:42.105>this <00:19:42.280>is <00:19:42.455>just <00:19:42.630>for <00:19:42.805>demonstration <00:19:42.980>purpose <00:19:43.155>here.

418
00:19:45.635 --> 00:19:47.935
<00:19:45.635>So <00:19:45.762>in <00:19:45.889>fact, <00:19:46.016>it's <00:19:46.144>just <00:19:46.271>better <00:19:46.398>if <00:19:46.525>it's <00:19:46.653>not, <00:19:46.780>uh, <00:19:46.907>in <00:19:47.035>front

419
00:19:47.935 --> 00:19:49.015
<00:19:47.935>of <00:19:48.259>a <00:19:48.583>screen <00:19:48.907>screen.

420
00:19:49.395 --> 00:19:51.775
<00:19:49.395>Anyway, <00:19:49.570>let's <00:19:49.745>have <00:19:49.920>a <00:19:50.095>look <00:19:50.270>to <00:19:50.445>the <00:19:50.620>influence <00:19:50.795>workflow.

421
00:19:52.315 --> 00:19:56.585
<00:19:52.315>So <00:19:52.490>if <00:19:52.665>the <00:19:52.840>neural <00:19:53.015>network <00:19:53.190>is <00:19:53.365>trained <00:19:53.540>well <00:19:53.715>enough,

422
00:19:56.585 --> 00:19:58.945
<00:19:56.585>we <00:19:56.740>can <00:19:56.896>now <00:19:57.051>start, <00:19:57.207>we <00:19:57.362>start <00:19:57.518>with <00:19:57.673>the <00:19:57.829>video <00:19:57.985>frame.

423
00:19:58.965 --> 00:20:03.065
<00:19:58.965>In <00:19:59.105>this <00:19:59.245>case, <00:19:59.385>of <00:19:59.524>course, <00:19:59.665>an <00:19:59.804>original <00:19:59.945>Shiat <00:20:00.084>lab <00:20:00.225>video <00:20:00.365>frame.

424
00:20:03.575 --> 00:20:07.425
<00:20:03.575>Then <00:20:03.730>we <00:20:03.886>put, <00:20:04.041>uh, <00:20:04.197>then <00:20:04.352>we <00:20:04.508>do <00:20:04.663>a <00:20:04.819>phase <00:20:04.975>recognition,

425
00:20:07.445 --> 00:20:09.425
<00:20:07.445>as <00:20:07.645>we <00:20:07.845>already <00:20:08.044>told <00:20:08.245>you, <00:20:08.445>via <00:20:08.645>face <00:20:08.845>net.

426
00:20:10.925 --> 00:20:14.505
<00:20:10.925>And <00:20:11.158>this <00:20:11.391>phase, <00:20:11.625>um, <00:20:11.858>is <00:20:12.091>the <00:20:12.325>input

427
00:20:14.685 --> 00:20:16.865
<00:20:14.685>for <00:20:15.034>our <00:20:15.385>trained <00:20:15.735>auto <00:20:16.085>encoder.

428
00:20:16.865 --> 00:20:18.825
<00:20:16.865>And <00:20:17.040>this <00:20:17.215>auto <00:20:17.390>encoder <00:20:17.565>will <00:20:17.740>give <00:20:17.915>us <00:20:18.090>back <00:20:18.265>two

429
00:20:18.825 --> 00:20:20.065
<00:20:18.825>very <00:20:19.383>important <00:20:19.941>information.

430
00:20:21.145 --> 00:20:26.105
<00:20:21.145>One <00:20:21.285>information <00:20:21.425>is <00:20:21.565>the, <00:20:21.705>yeah, <00:20:21.845>uh, <00:20:21.985>um, <00:20:22.125>a <00:20:22.264>deep <00:20:22.405>faked <00:20:22.545>face,

431
00:20:26.275 --> 00:20:30.385
<00:20:26.275>which <00:20:26.450>fits, <00:20:26.625>um, <00:20:26.800>well <00:20:26.975>enough <00:20:27.150>to <00:20:27.325>the <00:20:27.500>input <00:20:27.675>phase

432
00:20:30.385 --> 00:20:34.785
<00:20:30.385>of <00:20:30.525>SHA <00:20:30.665>lab <00:20:30.805>birth, <00:20:30.945>but <00:20:31.085>with <00:20:31.225>my <00:20:31.365>face <00:20:31.504>and <00:20:31.645>a <00:20:31.785>mask.

433
00:20:35.685 --> 00:20:39.625
<00:20:35.685>And <00:20:35.885>the <00:20:36.085>mask <00:20:36.284>combined <00:20:36.485>with <00:20:36.685>the, <00:20:36.885>um, <00:20:37.085>phase,

434
00:20:40.255 --> 00:20:42.265
<00:20:40.255>with <00:20:40.605>the <00:20:40.955>faked <00:20:41.305>phase <00:20:41.655>will

435
00:20:42.885 --> 00:20:46.345
<00:20:42.885>result <00:20:43.118>in <00:20:43.351>a <00:20:43.585>final <00:20:43.818>merged <00:20:44.051>video <00:20:44.285>frame,

436
00:20:46.435 --> 00:20:47.805
<00:20:46.435>which <00:20:46.681>is <00:20:46.928>a <00:20:47.174>deep <00:20:47.421>fake <00:20:47.668>one.

437
00:20:49.075 --> 00:20:51.485
<00:20:49.075>Okay, <00:20:49.275>so <00:20:49.475>this <00:20:49.675>is <00:20:49.875>how <00:20:50.075>the <00:20:50.275>inference <00:20:50.475>workflow

438
00:20:51.665 --> 00:20:52.805
<00:20:51.665>is <00:20:51.921>for <00:20:52.178>Deep <00:20:52.434>Face <00:20:52.691>Lab.

439
00:20:52.805 --> 00:20:56.165
<00:20:52.805>And <00:20:52.945>now <00:20:53.085>let's <00:20:53.225>have <00:20:53.365>a <00:20:53.505>look <00:20:53.645>to <00:20:53.785>DeepFakes <00:20:53.925>in <00:20:54.065>real <00:20:54.205>time.

440
00:20:57.065 --> 00:21:01.525
<00:20:57.065>So <00:20:57.181>back <00:20:57.298>in <00:20:57.415>the <00:20:57.531>days <00:20:57.648>when <00:20:57.765>we <00:20:57.881>started <00:20:57.998>the <00:20:58.115>project <00:20:58.231>on <00:20:58.348>real <00:20:58.465>time

441
00:21:01.525 --> 00:21:03.725
<00:21:01.525>DeepFakes, <00:21:01.805>uh, <00:21:02.085>yeah, <00:21:02.365>you <00:21:02.645>may <00:21:02.925>wonder

442
00:21:03.725 --> 00:21:05.125
<00:21:03.725>what <00:21:03.976>was <00:21:04.229>the <00:21:04.481>motivation <00:21:04.733>behind <00:21:04.985>that?

443
00:21:05.535 --> 00:21:07.045
<00:21:05.535>There <00:21:05.988>were <00:21:06.441>different <00:21:06.894>motivations.

444
00:21:07.505 --> 00:21:10.045
<00:21:07.505>So <00:21:07.705>at <00:21:07.905>first <00:21:08.105>we <00:21:08.305>wanted <00:21:08.505>to <00:21:08.705>work <00:21:08.905>that,

445
00:21:10.195 --> 00:21:11.605
<00:21:10.195>that <00:21:10.448>it <00:21:10.702>works <00:21:10.956>with <00:21:11.210>any <00:21:11.464>face.

446
00:21:11.705 --> 00:21:14.085
<00:21:11.705>So <00:21:11.832>the <00:21:11.959>idea <00:21:12.086>was <00:21:12.214>you <00:21:12.341>just <00:21:12.468>stand <00:21:12.595>in <00:21:12.723>front <00:21:12.850>of <00:21:12.977>a <00:21:13.105>camera

447
00:21:14.905 --> 00:21:19.085
<00:21:14.905>and, <00:21:15.032>uh, <00:21:15.159>even <00:21:15.286>if <00:21:15.414>your <00:21:15.541>face <00:21:15.668>is <00:21:15.795>not <00:21:15.923>trained <00:21:16.050>on <00:21:16.177>our <00:21:16.305>neural

448
00:21:19.085 --> 00:21:20.325
<00:21:19.085>network, <00:21:19.457>it <00:21:19.829>should <00:21:20.201>work.

449
00:21:21.195 --> 00:21:24.965
<00:21:21.195>Then <00:21:21.370>we <00:21:21.544>just <00:21:21.720>didn't <00:21:21.895>want <00:21:22.070>to <00:21:22.245>replace <00:21:22.419>the <00:21:22.595>face.

450
00:21:25.145 --> 00:21:28.885
<00:21:25.145>We <00:21:25.300>wanted <00:21:25.456>to <00:21:25.611>replace <00:21:25.767>the <00:21:25.922>whole <00:21:26.078>head <00:21:26.233>within <00:21:26.389>the <00:21:26.545>ears,

451
00:21:29.505 --> 00:21:30.845
<00:21:29.505>the <00:21:29.907>hairs <00:21:30.309>and <00:21:30.711>everything.

452
00:21:31.455 --> 00:21:34.445
<00:21:31.455>Everything <00:21:31.735>should <00:21:32.014>work <00:21:32.294>in <00:21:32.574>ridiculous <00:21:32.855>speed.

453
00:21:35.025 --> 00:21:38.645
<00:21:35.025>And <00:21:35.165>last <00:21:35.305>but <00:21:35.445>not <00:21:35.585>least, <00:21:35.725>yeah, <00:21:35.865>some <00:21:36.005>kind <00:21:36.145>of <00:21:36.285>clean <00:21:36.425>coat.

454
00:21:40.225 --> 00:21:44.445
<00:21:40.225>Um, <00:21:40.380>now <00:21:40.536>we <00:21:40.691>want <00:21:40.847>to <00:21:41.002>show <00:21:41.158>you <00:21:41.313>the <00:21:41.469>different <00:21:41.625>parts.

455
00:21:44.865 --> 00:21:48.925
<00:21:44.865>Um, <00:21:45.065>uh, <00:21:45.265>the <00:21:45.465>workflow <00:21:45.665>of <00:21:45.865>Deep <00:21:46.065>Face <00:21:46.265>Lab,

456
00:21:49.185 --> 00:21:52.525
<00:21:49.185>we <00:21:49.385>substituted <00:21:49.585>stuff <00:21:49.784>like, <00:21:49.985>for <00:21:50.185>example, <00:21:50.385>face <00:21:50.585>recognition.

457
00:21:52.665 --> 00:21:55.685
<00:21:52.665>So <00:21:52.865>Thomas, <00:21:53.065>how <00:21:53.264>did <00:21:53.465>we <00:21:53.665>solve <00:21:53.865>the <00:21:54.065>slow

458
00:21:55.835 --> 00:21:56.885
<00:21:55.835>face <00:21:56.307>net <00:21:56.780>implementation?

459
00:21:58.615 --> 00:22:00.665
<00:21:58.615>Yeah, <00:21:58.815>we <00:21:59.015>did, <00:21:59.215>uh, <00:21:59.415>quite <00:21:59.615>a <00:21:59.815>few <00:22:00.015>things

460
00:22:00.805 --> 00:22:04.105
<00:22:00.805>and <00:22:00.960>there's <00:22:01.116>a <00:22:01.271>small <00:22:01.427>spoiler <00:22:01.582>alert <00:22:01.738>here <00:22:01.893>in <00:22:02.049>the <00:22:02.205>end,

461
00:22:04.355 --> 00:22:07.505
<00:22:04.355>there <00:22:04.495>will <00:22:04.635>be <00:22:04.775>not <00:22:04.915>much <00:22:05.055>left <00:22:05.195>or <00:22:05.335>of <00:22:05.475>the <00:22:05.615>original <00:22:05.755>workflow.

462
00:22:07.925 --> 00:22:10.425
<00:22:07.925>So <00:22:08.080>the <00:22:08.236>first <00:22:08.391>thing <00:22:08.547>we <00:22:08.702>took <00:22:08.858>care <00:22:09.013>of <00:22:09.169>was, <00:22:09.325>uh,

463
00:22:10.655 --> 00:22:12.025
<00:22:10.655>face <00:22:11.888>recognition.

464
00:22:12.045 --> 00:22:13.425
<00:22:12.045>So <00:22:12.293>there <00:22:12.541>are <00:22:12.790>two <00:22:13.038>steps <00:22:13.287>here.

465
00:22:13.445 --> 00:22:16.225
<00:22:13.445>The <00:22:13.600>first <00:22:13.756>one <00:22:13.911>would <00:22:14.067>be <00:22:14.222>to <00:22:14.378>really <00:22:14.533>recognize <00:22:14.689>the <00:22:14.845>area

466
00:22:16.635 --> 00:22:18.545
<00:22:16.635>where <00:22:16.790>the <00:22:16.946>face <00:22:17.101>is, <00:22:17.257>and <00:22:17.412>this <00:22:17.568>is <00:22:17.723>where <00:22:17.879>we <00:22:18.035>have

467
00:22:18.545 --> 00:22:20.305
<00:22:18.545>to <00:22:18.895>have <00:22:19.245>a <00:22:19.595>look <00:22:19.945>first.

468
00:22:20.565 --> 00:22:23.585
<00:22:20.565>Uh, <00:22:20.765>we <00:22:20.965>took <00:22:21.165>open <00:22:21.365>CV <00:22:21.565>in <00:22:21.765>this <00:22:21.965>case.

469
00:22:23.885 --> 00:22:25.945
<00:22:23.885>Um, <00:22:24.235>open <00:22:24.585>CV <00:22:24.935>is <00:22:25.285>normally,

470
00:22:26.005 --> 00:22:28.785
<00:22:26.005>so <00:22:26.180>the <00:22:26.355>computer <00:22:26.530>vision <00:22:26.705>library <00:22:26.880>is <00:22:27.055>normally <00:22:27.230>not <00:22:27.405>known

471
00:22:29.085 --> 00:22:32.225
<00:22:29.085>for <00:22:29.285>being <00:22:29.485>capable <00:22:29.685>of, <00:22:29.885>uh, <00:22:30.085>detecting, <00:22:30.285>uh, <00:22:30.485>phases

472
00:22:32.225 --> 00:22:35.185
<00:22:32.225>or <00:22:32.399>something <00:22:32.574>like <00:22:32.750>that, <00:22:32.925>or, <00:22:33.100>uh, <00:22:33.274>also <00:22:33.449>neural <00:22:33.625>networks.

473
00:22:35.185 --> 00:22:37.745
<00:22:35.185>But <00:22:35.340>there <00:22:35.496>is <00:22:35.651>an <00:22:35.807>experimental <00:22:35.962>branch <00:22:36.118>which <00:22:36.273>you <00:22:36.429>can <00:22:36.585>use,

474
00:22:37.965 --> 00:22:40.345
<00:22:37.965>and <00:22:38.139>then <00:22:38.314>you <00:22:38.490>can <00:22:38.665>load <00:22:38.840>tens <00:22:39.014>of <00:22:39.189>low <00:22:39.365>files

475
00:22:40.845 --> 00:22:44.345
<00:22:40.845>and <00:22:41.078>this <00:22:41.311>will <00:22:41.545>execute <00:22:41.778>the <00:22:42.011>neural <00:22:42.245>network

476
00:22:45.065 --> 00:22:49.545
<00:22:45.065>directly <00:22:45.205>on <00:22:45.345>the <00:22:45.485>images <00:22:45.625>that <00:22:45.765>you <00:22:45.905>get <00:22:46.045>with, <00:22:46.185>uh, <00:22:46.325>the, <00:22:46.465>yeah,

477
00:22:49.815 --> 00:22:53.465
<00:22:49.815>with <00:22:49.955>the <00:22:50.095>limitation <00:22:50.235>that <00:22:50.375>it's <00:22:50.515>all <00:22:50.655>also <00:22:50.795>limited <00:22:50.935>to <00:22:51.075>the <00:22:51.215>CPU.

478
00:22:53.465 --> 00:22:55.105
<00:22:53.465>But <00:22:53.698>this <00:22:53.931>was <00:22:54.165>fine <00:22:54.398>in <00:22:54.631>our <00:22:54.865>case

479
00:22:55.285 --> 00:22:58.865
<00:22:55.285>as <00:22:55.485>the <00:22:55.685>GPU <00:22:55.885>is <00:22:56.085>doing <00:22:56.285>other <00:22:56.485>things <00:22:56.685>anyway.

480
00:22:59.285 --> 00:23:03.785
<00:22:59.285>So, <00:22:59.412>um, <00:22:59.539>let's <00:22:59.666>have <00:22:59.794>a <00:22:59.921>look <00:23:00.048>at <00:23:00.175>how <00:23:00.303>the <00:23:00.430>real <00:23:00.557>time, <00:23:00.685>um,

481
00:23:04.015 --> 00:23:06.145
<00:23:04.015>face <00:23:04.365>detection <00:23:04.715>works <00:23:05.065>in <00:23:05.415>OpenCV.

482
00:23:06.365 --> 00:23:09.235
<00:23:06.365>And <00:23:06.565>here <00:23:06.765>you <00:23:06.965>can <00:23:07.165>see <00:23:07.365>it's <00:23:07.565>quite <00:23:07.765>fine.

483
00:23:09.455 --> 00:23:12.875
<00:23:09.455>Uh, <00:23:09.571>it <00:23:09.688>works <00:23:09.804>quite <00:23:09.921>well, <00:23:10.038>even <00:23:10.155>if <00:23:10.271>I <00:23:10.388>put <00:23:10.504>my <00:23:10.621>hand <00:23:10.738>in <00:23:10.855>front

484
00:23:12.875 --> 00:23:16.795
<00:23:12.875>of <00:23:13.002>my <00:23:13.129>face <00:23:13.256>or <00:23:13.384>even <00:23:13.511>if <00:23:13.638>I <00:23:13.765>look <00:23:13.893>at <00:23:14.020>the <00:23:14.147>screen <00:23:14.275>sideways,

485
00:23:16.905 --> 00:23:19.155
<00:23:16.905>even <00:23:17.080>if <00:23:17.254>Martin <00:23:17.430>is <00:23:17.605>fooling <00:23:17.780>around <00:23:17.955>in <00:23:18.129>the <00:23:18.305>background,

486
00:23:19.255 --> 00:23:21.995
<00:23:19.255>it <00:23:19.430>can <00:23:19.605>do <00:23:19.780>multiple <00:23:19.955>phases <00:23:20.130>at <00:23:20.305>the <00:23:20.480>same <00:23:20.655>time

487
00:23:22.455 --> 00:23:27.115
<00:23:22.455>and <00:23:22.595>also <00:23:22.735>track <00:23:22.875>them <00:23:23.014>over <00:23:23.155>a <00:23:23.294>number <00:23:23.435>of <00:23:23.574>iterations <00:23:23.715>as <00:23:23.855>well.

488
00:23:27.295 --> 00:23:28.795
<00:23:27.295>So <00:23:27.565>this <00:23:27.835>is <00:23:28.105>working <00:23:28.375>quite <00:23:28.645>good.

489
00:23:29.375 --> 00:23:31.515
<00:23:29.375>And <00:23:29.575>now <00:23:29.775>we <00:23:29.975>need <00:23:30.175>a <00:23:30.375>second <00:23:30.575>step <00:23:30.775>actually,

490
00:23:31.585 --> 00:23:35.995
<00:23:31.585>because <00:23:31.818>in <00:23:32.051>our <00:23:32.285>original <00:23:32.518>implementation, <00:23:32.751>it <00:23:32.985>was,

491
00:23:37.175 --> 00:23:38.955
<00:23:37.175>uh, <00:23:37.375>it <00:23:37.575>was <00:23:37.774>the, <00:23:37.975>uh, <00:23:38.175>the, <00:23:38.375>the <00:23:38.575>case

492
00:23:38.955 --> 00:23:41.395
<00:23:38.955>that <00:23:39.235>we <00:23:39.514>needed <00:23:39.794>a <00:23:40.074>face <00:23:40.355>extraction.

493
00:23:41.735 --> 00:23:45.445
<00:23:41.735>So <00:23:41.862>we <00:23:41.989>also <00:23:42.116>need <00:23:42.244>to <00:23:42.371>just <00:23:42.498>identify <00:23:42.625>the <00:23:42.753>parts <00:23:42.880>of <00:23:43.007>the <00:23:43.135>face.

494
00:23:45.655 --> 00:23:48.925
<00:23:45.655>Since <00:23:45.795>we <00:23:45.935>want <00:23:46.075>to <00:23:46.215>do <00:23:46.355>the <00:23:46.495>whole <00:23:46.635>head <00:23:46.774>now, <00:23:46.915>we <00:23:47.055>have

495
00:23:48.925 --> 00:23:50.805
<00:23:48.925>to <00:23:49.158>do <00:23:49.391>things <00:23:49.625>a <00:23:49.858>little <00:23:50.091>bit <00:23:50.325>differently.

496
00:23:51.345 --> 00:23:52.645
<00:23:51.345>So <00:23:51.579>in <00:23:51.813>this <00:23:52.047>case, <00:23:52.281>we <00:23:52.514>need

497
00:23:52.645 --> 00:23:55.525
<00:23:52.645>to <00:23:52.925>do <00:23:53.205>a <00:23:53.485>so-called <00:23:53.764>phase <00:23:54.045>segmentation.

498
00:23:56.305 --> 00:23:59.605
<00:23:56.305>And, <00:23:56.538>uh, <00:23:56.771>the <00:23:57.005>segmentation <00:23:57.238>is, <00:23:57.471>uh, <00:23:57.705>something

499
00:23:59.605 --> 00:24:01.205
<00:23:59.605>that <00:23:59.805>I <00:24:00.005>also <00:24:00.205>want <00:24:00.405>to <00:24:00.605>show <00:24:00.805>you <00:24:01.005>here.

500
00:24:01.545 --> 00:24:04.045
<00:24:01.545>Uh, <00:24:01.745>it <00:24:01.945>is <00:24:02.145>also, <00:24:02.345>uh, <00:24:02.545>kind <00:24:02.745>of <00:24:02.945>smurfing,

501
00:24:04.305 --> 00:24:06.805
<00:24:04.305>so <00:24:04.480>everybody <00:24:04.655>looks <00:24:04.830>blue <00:24:05.005>right <00:24:05.180>now <00:24:05.355>in <00:24:05.530>the <00:24:05.705>face.

502
00:24:07.305 --> 00:24:10.525
<00:24:07.305>And, <00:24:07.505>uh, <00:24:07.705>this <00:24:07.905>also <00:24:08.105>works <00:24:08.305>in <00:24:08.505>real <00:24:08.705>time,

503
00:24:10.585 --> 00:24:12.805
<00:24:10.585>and <00:24:10.785>this <00:24:10.985>is <00:24:11.185>quite <00:24:11.385>good <00:24:11.585>actually <00:24:11.785>at, <00:24:11.985>uh,

504
00:24:12.905 --> 00:24:17.365
<00:24:12.905>and, <00:24:13.045>uh, <00:24:13.185>uh, <00:24:13.325>works <00:24:13.465>if <00:24:13.605>I <00:24:13.745>don't <00:24:13.885>look <00:24:14.024>too <00:24:14.165>much <00:24:14.305>sideways

505
00:24:17.365 --> 00:24:20.205
<00:24:17.365>because <00:24:17.598>if, <00:24:17.831>uh, <00:24:18.065>my <00:24:18.298>face <00:24:18.531>is, <00:24:18.765>uh,

506
00:24:20.205 --> 00:24:22.765
<00:24:20.205>looking <00:24:20.405>at <00:24:20.605>the <00:24:20.804>camera <00:24:21.004>from <00:24:21.205>the <00:24:21.405>site, <00:24:21.605>um,

507
00:24:23.065 --> 00:24:24.405
<00:24:23.065>the <00:24:23.306>illusion <00:24:23.547>breaks <00:24:23.788>a <00:24:24.029>little <00:24:24.271>bit.

508
00:24:24.495 --> 00:24:27.885
<00:24:24.495>We'll <00:24:24.635>have <00:24:24.774>a <00:24:24.915>look <00:24:25.054>at <00:24:25.195>why <00:24:25.334>this <00:24:25.475>is <00:24:25.614>the <00:24:25.754>case <00:24:25.895>a

509
00:24:27.885 --> 00:24:28.925
<00:24:27.885>little <00:24:28.197>bit <00:24:28.509>later <00:24:28.821>on.

510
00:24:29.505 --> 00:24:33.125
<00:24:29.505>But, <00:24:29.660>uh, <00:24:29.816>first <00:24:29.971>let's <00:24:30.127>have <00:24:30.282>a <00:24:30.438>look <00:24:30.593>how <00:24:30.749>this <00:24:30.905>works.

511
00:24:33.905 --> 00:24:36.365
<00:24:33.905>So, <00:24:34.138>um, <00:24:34.371>for <00:24:34.605>phase <00:24:34.838>segmentation, <00:24:35.071>we <00:24:35.305>need

512
00:24:36.365 --> 00:24:39.125
<00:24:36.365>to <00:24:36.598>actually <00:24:36.831>two <00:24:37.065>different, <00:24:37.298>uh, <00:24:37.531>neural <00:24:37.765>networks.

513
00:24:39.185 --> 00:24:42.845
<00:24:39.185>Um, <00:24:39.340>the <00:24:39.496>reason <00:24:39.651>for <00:24:39.807>that <00:24:39.962>is, <00:24:40.118>uh, <00:24:40.273>so-called <00:24:40.429>transfer <00:24:40.585>learning.

514
00:24:42.945 --> 00:24:45.645
<00:24:42.945>But, <00:24:43.085>uh, <00:24:43.225>let's <00:24:43.365>have <00:24:43.504>a <00:24:43.645>look <00:24:43.784>at, <00:24:43.925>uh, <00:24:44.064>the <00:24:44.205>different <00:24:44.345>networks.

515
00:24:45.645 --> 00:24:47.925
<00:24:45.645>First <00:24:45.995>we <00:24:46.345>have <00:24:46.695>mobile <00:24:47.045>net,

516
00:24:47.925 --> 00:24:49.605
<00:24:47.925>which <00:24:48.158>is <00:24:48.391>a <00:24:48.625>fast <00:24:48.858>neural <00:24:49.091>net <00:24:49.325>network,

517
00:24:49.615 --> 00:24:54.005
<00:24:49.615>which <00:24:49.770>you <00:24:49.926>can <00:24:50.081>also <00:24:50.237>just <00:24:50.392>execute <00:24:50.548>on <00:24:50.703>a <00:24:50.859>mobile <00:24:51.015>device.

518
00:24:54.185 --> 00:24:57.565
<00:24:54.185>And <00:24:54.360>this <00:24:54.534>is <00:24:54.710>pre-trained, <00:24:54.885>so <00:24:55.060>it <00:24:55.235>already <00:24:55.409>knows, <00:24:55.585>um,

519
00:24:57.965 --> 00:25:01.165
<00:24:57.965>a <00:24:58.120>little <00:24:58.276>bit <00:24:58.431>about, <00:24:58.587>um, <00:24:58.742>cats <00:24:58.898>and <00:24:59.053>dogs <00:24:59.209>and <00:24:59.365>cars

520
00:25:01.385 --> 00:25:02.405
<00:25:01.385>and <00:25:01.691>stuff <00:25:01.997>like <00:25:02.303>that.

521
00:25:02.625 --> 00:25:04.845
<00:25:02.625>But <00:25:02.905>it's <00:25:03.185>normally <00:25:03.465>used <00:25:03.745>for <00:25:04.025>classification,

522
00:25:04.945 --> 00:25:07.965
<00:25:04.945>so <00:25:05.120>it <00:25:05.294>detects <00:25:05.470>exactly <00:25:05.645>when <00:25:05.820>something <00:25:05.995>is <00:25:06.169>a <00:25:06.345>cat

523
00:25:08.025 --> 00:25:09.405
<00:25:08.025>or <00:25:08.273>a <00:25:08.521>dog <00:25:08.770>or <00:25:09.018>something <00:25:09.267>else.

524
00:25:10.265 --> 00:25:12.445
<00:25:10.265>Um, <00:25:10.615>so <00:25:10.965>we <00:25:11.315>just <00:25:11.665>skipped

525
00:25:13.145 --> 00:25:16.045
<00:25:13.145>or <00:25:13.300>cut <00:25:13.456>away <00:25:13.611>the <00:25:13.767>last <00:25:13.922>layers <00:25:14.078>of <00:25:14.233>this <00:25:14.389>neural <00:25:14.545>network.

526
00:25:16.385 --> 00:25:19.805
<00:25:16.385>And <00:25:16.585>then <00:25:16.785>we, <00:25:16.985>uh, <00:25:17.185>added <00:25:17.385>another <00:25:17.585>neural <00:25:17.785>network,

527
00:25:19.815 --> 00:25:23.365
<00:25:19.815>which <00:25:19.931>is <00:25:20.048>a <00:25:20.165>unit, <00:25:20.281>uh, <00:25:20.398>which <00:25:20.515>is <00:25:20.631>a <00:25:20.748>network <00:25:20.865>which <00:25:20.981>you <00:25:21.098>can <00:25:21.215>use

528
00:25:23.825 --> 00:25:26.325
<00:25:23.825>for <00:25:24.175>segmentation <00:25:24.525>of <00:25:24.875>the <00:25:25.225>images.

529
00:25:26.905 --> 00:25:31.245
<00:25:26.905>And <00:25:27.060>now <00:25:27.216>we <00:25:27.371>can <00:25:27.527>just <00:25:27.682>train <00:25:27.838>this <00:25:27.993>neural <00:25:28.149>network <00:25:28.305>using,

530
00:25:31.505 --> 00:25:33.285
<00:25:31.505>so <00:25:31.785>the <00:25:32.065>pre-trained, <00:25:32.345>uh, <00:25:32.625>mobile <00:25:32.905>network,

531
00:25:33.285 --> 00:25:35.005
<00:25:33.285>which <00:25:33.518>we <00:25:33.751>will <00:25:33.985>not <00:25:34.218>change <00:25:34.451>at <00:25:34.685>all.

532
00:25:35.585 --> 00:25:39.925
<00:25:35.585>And <00:25:35.740>we <00:25:35.896>are <00:25:36.051>training <00:25:36.207>the <00:25:36.362>unit <00:25:36.518>using <00:25:36.673>our <00:25:36.829>own <00:25:36.985>segmentation.

533
00:25:39.945 --> 00:25:42.085
<00:25:39.945>So <00:25:40.178>this <00:25:40.411>reduces <00:25:40.645>the <00:25:40.878>number <00:25:41.111>of <00:25:41.345>images

534
00:25:42.085 --> 00:25:45.685
<00:25:42.085>that <00:25:42.212>you <00:25:42.339>need <00:25:42.466>from <00:25:42.594>a <00:25:42.721>few <00:25:42.848>million <00:25:42.975>to <00:25:43.103>a <00:25:43.230>few <00:25:43.357>thousand <00:25:43.485>actually.

535
00:25:46.425 --> 00:25:51.245
<00:25:46.425>But <00:25:46.552>still <00:25:46.679>we <00:25:46.806>need <00:25:46.934>something <00:25:47.061>that <00:25:47.188>can, <00:25:47.315>uh, <00:25:47.443>that <00:25:47.570>we <00:25:47.697>can <00:25:47.825>train

536
00:25:51.245 --> 00:25:53.765
<00:25:51.245>with <00:25:51.385>as <00:25:51.524>a, <00:25:51.665>so <00:25:51.804>some <00:25:51.945>data <00:25:52.084>that <00:25:52.225>we <00:25:52.364>can <00:25:52.504>train <00:25:52.645>with.

537
00:25:54.465 --> 00:25:58.885
<00:25:54.465>And <00:25:54.620>this <00:25:54.776>is <00:25:54.931>done <00:25:55.087>using, <00:25:55.242>um, <00:25:55.398>uh, <00:25:55.553>cell <00:25:55.709>mask <00:25:55.865>hq.

538
00:25:58.955 --> 00:26:02.485
<00:25:58.955>This <00:25:59.110>is <00:25:59.266>a <00:25:59.421>data <00:25:59.577>set <00:25:59.732>where <00:25:59.888>one <00:26:00.043>guy <00:26:00.199>just, <00:26:00.355>uh,

539
00:26:02.485 --> 00:26:06.405
<00:26:02.485>took <00:26:02.764>30,000 <00:26:03.044>celebrities <00:26:03.324>and <00:26:03.604>masked <00:26:03.885>them.

540
00:26:06.545 --> 00:26:10.125
<00:26:06.545>So <00:26:06.685>he <00:26:06.825>took, <00:26:06.965>uh, <00:26:07.105>uh, <00:26:07.245>the, <00:26:07.385>he <00:26:07.525>did <00:26:07.665>it <00:26:07.805>by <00:26:07.945>hand

541
00:26:10.625 --> 00:26:14.005
<00:26:10.625>and <00:26:10.765>he <00:26:10.905>just, <00:26:11.045>uh, <00:26:11.185>said, <00:26:11.325>okay, <00:26:11.465>here <00:26:11.605>we <00:26:11.745>have <00:26:11.885>a <00:26:12.025>face.

542
00:26:14.115 --> 00:26:17.365
<00:26:14.115>Okay, <00:26:14.270>let's <00:26:14.426>draw <00:26:14.581>the <00:26:14.737>face, <00:26:14.892>then <00:26:15.048>we'll <00:26:15.203>draw <00:26:15.359>the <00:26:15.515>hair,

543
00:26:17.365 --> 00:26:19.805
<00:26:17.365>then <00:26:17.505>we <00:26:17.645>draw <00:26:17.785>the <00:26:17.925>nose, <00:26:18.065>and <00:26:18.205>so <00:26:18.345>on <00:26:18.485>and <00:26:18.625>so <00:26:18.765>on.

544
00:26:19.905 --> 00:26:21.805
<00:26:19.905>And <00:26:20.138>he <00:26:20.371>did <00:26:20.605>this <00:26:20.838>for <00:26:21.071>30,000 <00:26:21.305>images.

545
00:26:22.145 --> 00:26:25.645
<00:26:22.145>And <00:26:22.300>these <00:26:22.456>are <00:26:22.611>now <00:26:22.767>used <00:26:22.922>for <00:26:23.078>us <00:26:23.233>to <00:26:23.389>train <00:26:23.545>our

546
00:26:26.165 --> 00:26:28.005
<00:26:26.165>segmentation <00:26:27.565>network.

547
00:26:28.945 --> 00:26:30.605
<00:26:28.945>And <00:26:29.178>here <00:26:29.411>you <00:26:29.645>can <00:26:29.878>see <00:26:30.111>the <00:26:30.345>results.

548
00:26:30.945 --> 00:26:33.525
<00:26:30.945>So <00:26:31.145>this <00:26:31.345>is <00:26:31.544>how <00:26:31.745>the <00:26:31.945>segmentation <00:26:32.145>looks <00:26:32.345>like.

549
00:26:33.585 --> 00:26:37.445
<00:26:33.585>Uh, <00:26:33.712>it <00:26:33.839>looks, <00:26:33.966>uh, <00:26:34.094>it <00:26:34.221>has <00:26:34.348>different <00:26:34.475>colors <00:26:34.603>for, <00:26:34.730>uh, <00:26:34.857>for <00:26:34.985>eyes,

550
00:26:37.545 --> 00:26:42.085
<00:26:37.545>for <00:26:37.672>hair, <00:26:37.799>and <00:26:37.926>for <00:26:38.054>a <00:26:38.181>lot <00:26:38.308>of <00:26:38.435>other <00:26:38.563>parts <00:26:38.690>of <00:26:38.817>the <00:26:38.945>face.

551
00:26:42.545 --> 00:26:45.125
<00:26:42.545>We <00:26:42.778>only <00:26:43.011>needed <00:26:43.245>the <00:26:43.478>whole <00:26:43.711>head <00:26:43.945>actually.

552
00:26:45.825 --> 00:26:48.325
<00:26:45.825>So <00:26:46.058>next <00:26:46.291>one <00:26:46.525>would <00:26:46.758>be <00:26:46.991>mask <00:26:47.225>planning.

553
00:26:48.585 --> 00:26:50.045
<00:26:48.585>And <00:26:48.804>this <00:26:49.023>will <00:26:49.242>be <00:26:49.461>done <00:26:49.680>by <00:26:49.899>Martin.

554
00:26:51.915 --> 00:26:56.565
<00:26:51.915>Yeah. <00:26:52.055>So, <00:26:52.195>um, <00:26:52.335>as <00:26:52.475>we <00:26:52.615>already <00:26:52.754>told <00:26:52.895>you, <00:26:53.034>uh, <00:26:53.175>we <00:26:53.315>want

555
00:26:56.565 --> 00:26:58.405
<00:26:56.565>to <00:26:56.740>replace <00:26:56.915>the <00:26:57.090>whole <00:26:57.265>head, <00:26:57.440>not <00:26:57.615>just <00:26:57.790>the <00:26:57.965>face.

556
00:26:59.065 --> 00:27:02.525
<00:26:59.065>And <00:26:59.240>so <00:26:59.415>we <00:26:59.590>have <00:26:59.765>to <00:26:59.940>make <00:27:00.115>some, <00:27:00.290>um, <00:27:00.465>yeah,

557
00:27:02.525 --> 00:27:04.805
<00:27:02.525>improvements <00:27:02.805>on <00:27:03.085>the <00:27:03.365>mask, <00:27:03.645>mask <00:27:03.925>blending.

558
00:27:05.625 --> 00:27:07.845
<00:27:05.625>And <00:27:05.825>so <00:27:06.025>let's <00:27:06.225>have <00:27:06.425>a <00:27:06.625>look <00:27:06.825>on <00:27:07.025>that

559
00:27:08.315 --> 00:27:10.605
<00:27:08.315>because <00:27:08.595>we <00:27:08.875>run <00:27:09.155>into <00:27:09.435>some <00:27:09.715>problems.

560
00:27:10.625 --> 00:27:12.005
<00:27:10.625>So <00:27:10.873>let's <00:27:11.121>imagine <00:27:11.370>that <00:27:11.618>we <00:27:11.867>want

561
00:27:12.005 --> 00:27:13.765
<00:27:12.005>to <00:27:12.238>place <00:27:12.471>Thomas <00:27:12.705>Head <00:27:12.938>on <00:27:13.171>my <00:27:13.405>head.

562
00:27:14.475 --> 00:27:17.665
<00:27:14.475>Then <00:27:14.754>sometimes <00:27:15.034>something <00:27:15.314>weird <00:27:15.594>could <00:27:15.875>happen.

563
00:27:18.915 --> 00:27:20.225
<00:27:18.915>Let's <00:27:19.504>pause <00:27:20.093>here.

564
00:27:20.805 --> 00:27:24.065
<00:27:20.805>And <00:27:20.945>you <00:27:21.085>can <00:27:21.225>see <00:27:21.365>that <00:27:21.505>we <00:27:21.645>will <00:27:21.785>sometimes <00:27:21.925>have <00:27:22.065>some <00:27:22.205>kind

565
00:27:24.065 --> 00:27:25.305
<00:27:24.065>of <00:27:24.623>overlay <00:27:25.181>problem.

566
00:27:26.365 --> 00:27:29.425
<00:27:26.365>And, <00:27:26.520>uh, <00:27:26.676>the <00:27:26.831>question <00:27:26.987>is <00:27:27.142>how <00:27:27.298>can <00:27:27.453>we <00:27:27.609>solve <00:27:27.765>this?

567
00:27:29.605 --> 00:27:32.865
<00:27:29.605>So <00:27:29.732>the <00:27:29.859>idea <00:27:29.986>was <00:27:30.114>we <00:27:30.241>have <00:27:30.368>to <00:27:30.495>get <00:27:30.623>rid <00:27:30.750>of <00:27:30.877>my <00:27:31.005>head

568
00:27:32.885 --> 00:27:35.265
<00:27:32.885>and <00:27:33.040>then <00:27:33.196>just <00:27:33.351>place <00:27:33.507>Thomas <00:27:33.662>said <00:27:33.818>on <00:27:33.973>top <00:27:34.129>of <00:27:34.285>it.

569
00:27:36.545 --> 00:27:40.925
<00:27:36.545>So <00:27:36.652>how <00:27:36.760>can <00:27:36.868>we <00:27:36.975>do <00:27:37.083>that <00:27:37.191>here <00:27:37.298>for <00:27:37.406>this, <00:27:37.514>uh, <00:27:37.621>we <00:27:37.729>have, <00:27:37.837>um, <00:27:37.945>yeah,

570
00:27:41.175 --> 00:27:42.245
<00:27:41.175>image <00:27:41.656>in <00:27:42.138>painting.

571
00:27:42.665 --> 00:27:45.845
<00:27:42.665>Um, <00:27:42.865>this, <00:27:43.065>uh, <00:27:43.264>is <00:27:43.465>available <00:27:43.665>in <00:27:43.865>open <00:27:44.065>CV

572
00:27:46.425 --> 00:27:50.325
<00:27:46.425>and <00:27:46.565>it <00:27:46.705>is <00:27:46.845>normally <00:27:46.985>used <00:27:47.125>to, <00:27:47.264>yeah, <00:27:47.405>uh, <00:27:47.544>repair <00:27:47.685>old <00:27:47.825>photos,

573
00:27:50.375 --> 00:27:51.805
<00:27:50.375>where <00:27:50.632>are <00:27:50.889>some <00:27:51.147>crutches <00:27:51.404>on <00:27:51.662>it?

574
00:27:52.465 --> 00:27:56.045
<00:27:52.465>So <00:27:52.620>let's <00:27:52.776>start <00:27:52.931>the <00:27:53.087>demo <00:27:53.242>on, <00:27:53.398>let's <00:27:53.553>see <00:27:53.709>what <00:27:53.865>happens.

575
00:27:56.625 --> 00:27:58.605
<00:27:56.625>So <00:27:56.975>hopefully <00:27:57.325>you <00:27:57.675>can <00:27:58.025>see

576
00:28:01.415 --> 00:28:05.905
<00:28:01.415>that <00:28:01.555>my <00:28:01.695>head <00:28:01.835>gets <00:28:01.975>deleted <00:28:02.115>somehow <00:28:02.254>and <00:28:02.395>Jonah's <00:28:02.534>head <00:28:02.675>as <00:28:02.815>well.

577
00:28:06.325 --> 00:28:10.645
<00:28:06.325>So <00:28:06.500>this <00:28:06.675>is <00:28:06.850>still <00:28:07.025>very <00:28:07.200>fast. <00:28:07.375>It's <00:28:07.550>real <00:28:07.725>time.

578
00:28:11.705 --> 00:28:14.885
<00:28:11.705>And <00:28:11.985>yeah, <00:28:12.264>how <00:28:12.544>does <00:28:12.824>it <00:28:13.105>work?

579
00:28:15.185 --> 00:28:18.925
<00:28:15.185>You <00:28:15.325>can <00:28:15.465>see <00:28:15.605>when <00:28:15.745>I <00:28:15.885>place <00:28:16.024>my <00:28:16.165>finger, <00:28:16.304>for <00:28:16.445>example, <00:28:16.585>here

580
00:28:19.745 --> 00:28:23.755
<00:28:19.745>to <00:28:19.945>the <00:28:20.145>section <00:28:20.344>where <00:28:20.544>the <00:28:20.745>fragmentation <00:28:20.945>was <00:28:21.145>done,

581
00:28:25.245 --> 00:28:28.905
<00:28:25.245>um, <00:28:25.419>that <00:28:25.594>the <00:28:25.770>pixels <00:28:25.945>are <00:28:26.120>just <00:28:26.294>going <00:28:26.469>into <00:28:26.645>the

582
00:28:28.905 --> 00:28:30.545
<00:28:28.905>base <00:28:29.371>of <00:28:29.838>my <00:28:30.305>head.

583
00:28:31.205 --> 00:28:33.305
<00:28:31.205>So <00:28:31.438>there <00:28:31.671>are <00:28:31.905>two <00:28:32.138>types <00:28:32.371>available, <00:28:32.605>Talia

584
00:28:33.325 --> 00:28:34.425
<00:28:33.325>and, <00:28:33.655>uh, <00:28:33.985>another <00:28:34.315>one.

585
00:28:35.335 --> 00:28:39.195
<00:28:35.335>And, <00:28:35.490>uh, <00:28:35.646>it's <00:28:35.801>very <00:28:35.957>easy <00:28:36.112>to <00:28:36.268>use <00:28:36.423>with <00:28:36.579>open <00:28:36.735>cwe.

586
00:28:40.665 --> 00:28:43.235
<00:28:40.665>Okay, <00:28:40.945>so <00:28:41.225>let's <00:28:41.504>stop <00:28:41.784>the <00:28:42.065>demo

587
00:28:44.655 --> 00:28:48.235
<00:28:44.655>and <00:28:44.935>let's <00:28:45.215>move <00:28:45.495>on. <00:28:45.774>Join <00:28:46.055>us.

588
00:28:48.985 --> 00:28:52.355
<00:28:48.985>Yeah, <00:28:49.140>so <00:28:49.296>we've <00:28:49.451>pretty <00:28:49.607>much <00:28:49.762>talked <00:28:49.918>about <00:28:50.073>everything <00:28:50.229>in <00:28:50.385>the

589
00:28:52.355 --> 00:28:54.995
<00:28:52.355>deep <00:28:52.510>fake <00:28:52.666>pipeline <00:28:52.821>that <00:28:52.977>has <00:28:53.132>nothing <00:28:53.288>to <00:28:53.443>do <00:28:53.599>with <00:28:53.755>the

590
00:28:55.705 --> 00:28:57.715
<00:28:55.705>real <00:28:55.985>deep <00:28:56.264>deepfake, <00:28:56.544>which <00:28:56.824>is <00:28:57.105>done

591
00:28:57.715 --> 00:28:59.035
<00:28:57.715>by <00:28:57.952>the <00:28:58.190>auto <00:28:58.427>encoder, <00:28:58.665>of <00:28:58.903>course.

592
00:28:59.495 --> 00:29:01.715
<00:28:59.495>And <00:28:59.635>of <00:28:59.774>course <00:28:59.915>here <00:29:00.054>we <00:29:00.195>also <00:29:00.334>had <00:29:00.475>to <00:29:00.614>do <00:29:00.754>a <00:29:00.895>couple

593
00:29:01.735 --> 00:29:06.075
<00:29:01.735>of <00:29:01.890>modifications <00:29:02.046>because <00:29:02.201>we <00:29:02.357>wanted <00:29:02.512>to <00:29:02.668>have <00:29:02.823>the <00:29:02.979>deepfake <00:29:03.135>work

594
00:29:06.075 --> 00:29:07.555
<00:29:06.075>for <00:29:06.341>basically <00:29:06.607>any <00:29:06.874>kind <00:29:07.140>of <00:29:07.407>face.

595
00:29:07.815 --> 00:29:10.275
<00:29:07.815>So <00:29:07.990>not <00:29:08.165>just <00:29:08.340>overfitted <00:29:08.515>and <00:29:08.690>train <00:29:08.865>for <00:29:09.040>two <00:29:09.215>phases,

596
00:29:10.275 --> 00:29:11.635
<00:29:10.275>but <00:29:10.581>for <00:29:10.887>basically <00:29:11.193>any <00:29:11.499>phase.

597
00:29:12.295 --> 00:29:13.835
<00:29:12.295>So <00:29:12.572>our <00:29:12.849>solution <00:29:13.126>to <00:29:13.403>this <00:29:13.681>was

598
00:29:13.835 --> 00:29:16.995
<00:29:13.835>to <00:29:13.975>not <00:29:14.115>only <00:29:14.255>train <00:29:14.395>two <00:29:14.535>auto <00:29:14.675>encoders, <00:29:14.815>but <00:29:14.955>end <00:29:15.095>auto <00:29:15.235>encoders.

599
00:29:16.995 --> 00:29:19.315
<00:29:16.995>So <00:29:17.195>we <00:29:17.395>can <00:29:17.594>now <00:29:17.794>train <00:29:17.995>as <00:29:18.195>many <00:29:18.395>people

600
00:29:19.375 --> 00:29:20.795
<00:29:19.375>as <00:29:19.588>we <00:29:19.801>want <00:29:20.014>at <00:29:20.227>the <00:29:20.440>same <00:29:20.653>time.

601
00:29:20.935 --> 00:29:22.675
<00:29:20.935>And <00:29:21.135>this <00:29:21.335>has <00:29:21.534>the <00:29:21.735>nice <00:29:21.935>side <00:29:22.135>effect <00:29:22.335>that

602
00:29:23.425 --> 00:29:25.795
<00:29:23.425>once <00:29:23.625>the <00:29:23.825>neural <00:29:24.024>network <00:29:24.225>has <00:29:24.425>seen <00:29:24.625>a <00:29:24.825>bunch

603
00:29:25.815 --> 00:29:29.235
<00:29:25.815>of <00:29:25.970>different <00:29:26.126>people, <00:29:26.281>it <00:29:26.437>is <00:29:26.592>pretty <00:29:26.748>good <00:29:26.903>at <00:29:27.059>just <00:29:27.215>recognizing

604
00:29:29.375 --> 00:29:34.355
<00:29:29.375>and, <00:29:29.550>and, <00:29:29.725>uh, <00:29:29.900>uh, <00:29:30.075>recognizing <00:29:30.250>different <00:29:30.425>kinds <00:29:30.600>of <00:29:30.775>faces

605
00:29:34.455 --> 00:29:36.555
<00:29:34.455>and <00:29:34.595>basically <00:29:34.735>any <00:29:34.875>face <00:29:35.014>that <00:29:35.155>stands <00:29:35.294>in <00:29:35.435>front <00:29:35.574>of <00:29:35.715>the <00:29:35.855>camera.

606
00:29:37.855 --> 00:29:39.835
<00:29:37.855>And <00:29:38.030>the <00:29:38.205>only <00:29:38.380>thing <00:29:38.555>that <00:29:38.730>we, <00:29:38.905>the <00:29:39.080>only <00:29:39.255>issue

607
00:29:39.835 --> 00:29:42.845
<00:29:39.835>that <00:29:39.990>we <00:29:40.146>had <00:29:40.301>now <00:29:40.457>is <00:29:40.612>that <00:29:40.768>with <00:29:40.923>all <00:29:41.079>these <00:29:41.235>modifications,

608
00:29:43.025 --> 00:29:46.685
<00:29:43.025>the <00:29:43.225>task <00:29:43.425>became <00:29:43.625>increasingly <00:29:43.825>the <00:29:44.025>task <00:29:44.225>of <00:29:44.425>DeepFakes

609
00:29:46.685 --> 00:29:49.325
<00:29:46.685>that <00:29:46.860>is <00:29:47.034>became <00:29:47.210>increasingly <00:29:47.385>hard <00:29:47.560>for <00:29:47.735>our <00:29:47.909>neural <00:29:48.085>network.

610
00:29:49.905 --> 00:29:51.845
<00:29:49.905>And <00:29:50.060>it <00:29:50.216>kind <00:29:50.371>of <00:29:50.527>started <00:29:50.682>to <00:29:50.838>struggle <00:29:50.993>a <00:29:51.149>little <00:29:51.305>bit,

611
00:29:51.845 --> 00:29:53.925
<00:29:51.845>and <00:29:51.985>we <00:29:52.125>could <00:29:52.265>see <00:29:52.405>that <00:29:52.545>in <00:29:52.685>the <00:29:52.825>results <00:29:52.965>that <00:29:53.105>it <00:29:53.245>showed.

612
00:29:54.425 --> 00:29:58.745
<00:29:54.425>So <00:29:54.625>got <00:29:54.825>weird <00:29:55.024>things <00:29:55.225>like <00:29:55.425>Picasso <00:29:55.625>paintings <00:29:55.825>and,

613
00:29:59.765 --> 00:30:03.825
<00:29:59.765>and <00:29:59.965>Donald <00:30:00.165>Trumps <00:30:00.365>with <00:30:00.565>eyes <00:30:00.765>on <00:30:00.965>their <00:30:01.165>foreheads

614
00:30:03.885 --> 00:30:07.025
<00:30:03.885>and <00:30:04.165>yeah, <00:30:04.445>I <00:30:04.725>don't <00:30:05.004>even <00:30:05.285>know.

615
00:30:07.025 --> 00:30:11.465
<00:30:07.025>And <00:30:07.152>man <00:30:07.279>bear <00:30:07.406>pig, <00:30:07.534>and <00:30:07.661>Obama <00:30:07.788>with <00:30:07.915>a, <00:30:08.043>with <00:30:08.170>a <00:30:08.297>balloon <00:30:08.425>head.

616
00:30:12.125 --> 00:30:14.585
<00:30:12.125>So <00:30:12.265>it <00:30:12.405>was <00:30:12.545>pretty <00:30:12.685>clear <00:30:12.825>that <00:30:12.965>at <00:30:13.105>this <00:30:13.245>point <00:30:13.385>we <00:30:13.525>had

617
00:30:14.585 --> 00:30:16.745
<00:30:14.585>to <00:30:14.865>do <00:30:15.145>something <00:30:15.425>about <00:30:15.705>the <00:30:15.985>training

618
00:30:16.745 --> 00:30:18.225
<00:30:16.745>of <00:30:17.011>our <00:30:17.277>neur <00:30:17.544>network <00:30:17.810>as <00:30:18.077>well.

619
00:30:18.565 --> 00:30:21.305
<00:30:18.565>So <00:30:18.705>what <00:30:18.845>we <00:30:18.985>decided <00:30:19.125>to <00:30:19.265>do <00:30:19.405>was <00:30:19.545>to <00:30:19.685>help <00:30:19.825>out, <00:30:19.965>uh,

620
00:30:21.325 --> 00:30:24.225
<00:30:21.325>to <00:30:21.500>help <00:30:21.675>the <00:30:21.850>neur <00:30:22.025>network <00:30:22.200>out <00:30:22.375>by <00:30:22.550>applying <00:30:22.725>something

621
00:30:24.225 --> 00:30:26.065
<00:30:24.225>that <00:30:24.574>is <00:30:24.925>called <00:30:25.274>GaN <00:30:25.625>training.

622
00:30:27.045 --> 00:30:29.825
<00:30:27.045>And <00:30:27.220>what <00:30:27.395>exactly <00:30:27.570>is <00:30:27.745>GaN <00:30:27.920>training <00:30:28.095>now? <00:30:28.270>Martin? <00:30:28.445>Yeah,

623
00:30:30.385 --> 00:30:33.945
<00:30:30.385>GaN <00:30:30.618>training <00:30:30.851>GaN <00:30:31.085>means <00:30:31.318>generative <00:30:31.551>adversarial <00:30:31.785>network.

624
00:30:34.165 --> 00:30:38.465
<00:30:34.165>And <00:30:34.340>in <00:30:34.514>fact, <00:30:34.690>it's, <00:30:34.865>um, <00:30:35.040>consisting <00:30:35.215>of <00:30:35.389>two <00:30:35.565>parts.

625
00:30:39.165 --> 00:30:42.425
<00:30:39.165>So <00:30:39.320>on <00:30:39.476>the <00:30:39.631>one <00:30:39.787>hand <00:30:39.942>we <00:30:40.098>have, <00:30:40.253>uh, <00:30:40.409>the <00:30:40.565>generator

626
00:30:43.125 --> 00:30:47.225
<00:30:43.125>and <00:30:43.325>the <00:30:43.525>generator <00:30:43.725>creates, <00:30:43.925>um, <00:30:44.125>for <00:30:44.325>example, <00:30:44.525>artificial

627
00:30:47.875 --> 00:30:49.025
<00:30:47.875>faces, <00:30:48.910>heads,

628
00:30:50.235 --> 00:30:53.775
<00:30:50.235>and <00:30:50.435>presents <00:30:50.635>that <00:30:50.834>to <00:30:51.034>a <00:30:51.235>so-called <00:30:51.435>disc <00:30:51.635>discriminator.

629
00:30:54.635 --> 00:30:59.005
<00:30:54.635>And <00:30:54.915>the <00:30:55.195>discriminator <00:30:55.475>also <00:30:55.754>gets <00:30:56.035>served,

630
00:30:59.035 --> 00:31:01.925
<00:30:59.035>sometimes <00:30:59.385>photographs <00:30:59.735>of <00:31:00.085>real <00:31:00.435>people.

631
00:31:02.545 --> 00:31:06.765
<00:31:02.545>So <00:31:02.745>the <00:31:02.945>discriminator <00:31:03.145>has <00:31:03.345>to <00:31:03.545>decide, <00:31:03.745>uh, <00:31:03.945>when

632
00:31:07.345 --> 00:31:10.605
<00:31:07.345>is <00:31:07.578>a <00:31:07.811>face <00:31:08.045>or <00:31:08.278>ahead <00:31:08.511>artificially <00:31:08.745>generated,

633
00:31:10.945 --> 00:31:13.925
<00:31:10.945>or <00:31:11.178>when <00:31:11.411>it <00:31:11.645>is <00:31:11.878>a <00:31:12.111>real <00:31:12.345>photograph.

634
00:31:14.425 --> 00:31:17.925
<00:31:14.425>So <00:31:14.625>this <00:31:14.825>is <00:31:15.024>a <00:31:15.225>fight <00:31:15.425>between <00:31:15.625>the <00:31:15.825>generator

635
00:31:18.225 --> 00:31:19.605
<00:31:18.225>and <00:31:18.846>the <00:31:19.467>discriminator

636
00:31:28.745 --> 00:31:28.965
Now.

637
00:31:29.585 --> 00:31:34.285
<00:31:29.585>So <00:31:29.701>we <00:31:29.818>want <00:31:29.935>to <00:31:30.051>do <00:31:30.168>a <00:31:30.285>offline <00:31:30.401>role <00:31:30.518>play <00:31:30.635>game <00:31:30.751>now <00:31:30.868>with <00:31:30.985>you

638
00:31:34.545 --> 00:31:37.085
<00:31:34.545>to <00:31:34.895>better <00:31:35.245>understand <00:31:35.595>the <00:31:35.945>functionality

639
00:31:37.185 --> 00:31:39.485
<00:31:37.185>behind <00:31:37.651>the <00:31:38.118>John <00:31:38.585>training.

640
00:31:40.185 --> 00:31:44.405
<00:31:40.185>And <00:31:40.385>so <00:31:40.585>let's <00:31:40.784>start <00:31:40.985>with <00:31:41.185>round <00:31:41.385>one, <00:31:41.585>but

641
00:31:44.405 --> 00:31:48.605
<00:31:44.405>before <00:31:44.532>we <00:31:44.659>do <00:31:44.786>that, <00:31:44.914>we <00:31:45.041>have <00:31:45.168>to, <00:31:45.295>um, <00:31:45.423>give <00:31:45.550>you <00:31:45.677>some <00:31:45.805>roles.

642
00:31:48.785 --> 00:31:53.325
<00:31:48.785>So, <00:31:48.960>um, <00:31:49.135>we <00:31:49.310>start <00:31:49.485>at <00:31:49.660>first <00:31:49.835>with, <00:31:50.010>um, <00:31:50.185>Thomas.

643
00:31:53.705 --> 00:31:57.325
<00:31:53.705>Thomas. <00:31:53.879>Yeah, <00:31:54.054>yeah. <00:31:54.230>You <00:31:54.405>will <00:31:54.580>be <00:31:54.754>the <00:31:54.929>generator, <00:31:55.105>right?

644
00:31:57.655 --> 00:32:00.645
<00:31:57.655>Definitely. <00:31:57.782>So <00:31:57.909>I <00:31:58.036>will <00:31:58.164>do <00:31:58.291>it. <00:31:58.418>You'll <00:31:58.545>do <00:31:58.673>it, <00:31:58.800>okay. <00:31:58.927>Yeah, <00:31:59.055>yeah.

645
00:32:00.645 --> 00:32:04.765
<00:32:00.645>Perfect. <00:32:00.820>Awesome. <00:32:00.995>And, <00:32:01.170>uh, <00:32:01.345>Jonas, <00:32:01.520>he <00:32:01.695>will <00:32:01.870>be, <00:32:02.045>yes,

646
00:32:04.785 --> 00:32:05.885
<00:32:04.785>the <00:32:05.775>discriminator.

647
00:32:05.955 --> 00:32:07.285
<00:32:05.955>Cool. <00:32:06.354>Yeah. <00:32:06.753>Okay. <00:32:07.152>Yeah.

648
00:32:07.285 --> 00:32:12.035
<00:32:07.285>So, <00:32:07.460>um, <00:32:07.635>Jonas, <00:32:07.810>so <00:32:07.985>please, <00:32:08.160>uh, <00:32:08.335>go <00:32:08.510>to <00:32:08.685>the

649
00:32:12.565 --> 00:32:15.515
<00:32:12.565>table <00:32:12.740>there, <00:32:12.915>uh, <00:32:13.090>close <00:32:13.265>your <00:32:13.440>eyes <00:32:13.615>and <00:32:13.790>your <00:32:13.965>ears.

650
00:32:15.895 --> 00:32:19.355
<00:32:15.895>Yes. <00:32:16.070>And, <00:32:16.245>uh, <00:32:16.420>the <00:32:16.595>generator, <00:32:16.770>Thomas. <00:32:16.945>Yeah, <00:32:17.120>yeah, <00:32:17.295>yeah.

651
00:32:19.455 --> 00:32:22.875
<00:32:19.455>Um, <00:32:19.582>I <00:32:19.709>give <00:32:19.836>you <00:32:19.964>a <00:32:20.091>task <00:32:20.218>right <00:32:20.345>now. <00:32:20.473>Okay. <00:32:20.600>Okay. <00:32:20.727>Okay. <00:32:20.855>Yeah.

652
00:32:23.215 --> 00:32:26.915
<00:32:23.215>So <00:32:23.355>let's <00:32:23.495>start <00:32:23.635>with <00:32:23.774>round <00:32:23.915>one. <00:32:24.054>Round <00:32:24.195>one, <00:32:24.334>okay. <00:32:24.475>Four. <00:32:24.615>Okay.

653
00:32:26.935 --> 00:32:27.955
<00:32:26.935>So <00:32:27.088>what <00:32:27.241>do <00:32:27.394>you <00:32:27.547>have <00:32:27.699>to <00:32:27.852>do?

654
00:32:28.215 --> 00:32:30.595
<00:32:28.215>So <00:32:28.681>your <00:32:29.148>task <00:32:29.615>is,

655
00:32:30.935 --> 00:32:33.545
<00:32:30.935>can <00:32:31.168>you <00:32:31.401>see <00:32:31.635>this <00:32:31.868>face? <00:32:32.101>What <00:32:32.335>is

656
00:32:33.585 --> 00:32:34.265
<00:32:33.585>A <00:32:33.891>face? <00:32:34.197>Exactly?

657
00:32:34.845 --> 00:32:38.705
<00:32:34.845>You <00:32:34.972>don't <00:32:35.099>know <00:32:35.226>what <00:32:35.354>a <00:32:35.481>face <00:32:35.608>is? <00:32:35.735>No. <00:32:35.863>Why? <00:32:35.990>I <00:32:36.117>dunno, <00:32:36.245>I'm

658
00:32:38.705 --> 00:32:41.285
<00:32:38.705>Just <00:32:39.054>randomly <00:32:39.405>initialized <00:32:39.754>neural <00:32:40.105>network.

659
00:32:41.745 --> 00:32:43.325
<00:32:41.745>Ah, <00:32:42.094>so <00:32:42.445>all <00:32:42.794>your <00:32:43.145>weights

660
00:32:43.325 --> 00:32:46.805
<00:32:43.325>and <00:32:43.500>biases <00:32:43.675>are <00:32:43.850>on <00:32:44.025>default, <00:32:44.200>like <00:32:44.375>zero <00:32:44.550>or <00:32:44.725>random

661
00:32:46.945 --> 00:32:48.085
<00:32:46.945>or <00:32:47.201>whatever <00:32:47.458>random, <00:32:47.714>I <00:32:47.971>think.

662
00:32:48.265 --> 00:32:49.885
<00:32:48.265>Ah, <00:32:48.545>okay. <00:32:48.825>Okay. <00:32:49.105>Okay. <00:32:49.385>So, <00:32:49.665>okay.

663
00:32:49.885 --> 00:32:54.285
<00:32:49.885>The <00:32:50.040>task <00:32:50.196>is <00:32:50.351>that <00:32:50.507>you <00:32:50.662>should <00:32:50.818>recreate <00:32:50.973>this <00:32:51.129>phase. <00:32:51.285>Yeah.

664
00:32:54.555 --> 00:32:56.335
<00:32:54.555>So <00:32:54.788>you <00:32:55.021>should <00:32:55.255>paint <00:32:55.488>that <00:32:55.721>right <00:32:55.955>now,

665
00:32:56.715 --> 00:32:59.935
<00:32:56.715>and <00:32:56.870>we <00:32:57.026>want <00:32:57.181>to <00:32:57.337>present <00:32:57.492>that <00:32:57.648>to <00:32:57.803>the <00:32:57.959>discriminator <00:32:58.115>with

666
00:33:00.605 --> 00:33:03.615
<00:33:00.605>your <00:33:00.838>output <00:33:01.071>and <00:33:01.305>with <00:33:01.538>a <00:33:01.771>real <00:33:02.005>face.

667
00:33:03.955 --> 00:33:05.975
<00:33:03.955>And <00:33:04.304>the <00:33:04.655>discriminator <00:33:05.004>should <00:33:05.355>Yeah.

668
00:33:06.075 --> 00:33:07.415
<00:33:06.075>Um, <00:33:06.316>decide <00:33:06.557>which <00:33:06.798>one <00:33:07.039>is <00:33:07.281>real

669
00:33:07.415 --> 00:33:09.335
<00:33:07.415>and <00:33:07.590>which <00:33:07.764>one <00:33:07.940>is <00:33:08.115>fake. <00:33:08.290>This <00:33:08.465>is <00:33:08.639>the <00:33:08.815>idea.

670
00:33:09.885 --> 00:33:10.935
<00:33:09.885>Okay. <00:33:10.074>So <00:33:10.263>can <00:33:10.452>You <00:33:10.640>do <00:33:10.830>that?

671
00:33:11.275 --> 00:33:12.575
<00:33:11.275>No, <00:33:11.860>Please <00:33:12.445>stop.

672
00:33:13.805 --> 00:33:16.255
<00:33:13.805>Okay. <00:33:14.505>Uh, <00:33:15.205>okay.

673
00:33:16.635 --> 00:33:20.335
<00:33:16.635>Um, <00:33:16.915>let's <00:33:17.195>just <00:33:17.475>do <00:33:17.754>something <00:33:18.035>maybe.

674
00:33:20.645 --> 00:33:22.375
<00:33:20.645>Okay, <00:33:20.845>I'll, <00:33:21.045>I'll <00:33:21.245>do <00:33:21.445>what <00:33:21.645>I <00:33:21.845>always <00:33:22.045>do.

675
00:33:22.495 --> 00:33:26.975
<00:33:22.495>I <00:33:22.650>just <00:33:22.806>draw <00:33:22.961>some <00:33:23.117>random <00:33:23.272>lines <00:33:23.428>and <00:33:23.583>maybe <00:33:23.739>some <00:33:23.895>points.

676
00:33:27.395 --> 00:33:31.335
<00:33:27.395>And <00:33:27.535>this <00:33:27.675>is <00:33:27.815>what <00:33:27.955>I <00:33:28.095>always <00:33:28.235>do <00:33:28.375>if <00:33:28.514>I'm <00:33:28.655>newly <00:33:28.795>initialized,

677
00:33:31.395 --> 00:33:33.135
<00:33:31.395>so <00:33:31.745>it <00:33:32.095>must <00:33:32.445>be <00:33:32.795>good.

678
00:33:34.525 --> 00:33:36.535
<00:33:34.525>Okay. <00:33:34.875>So, <00:33:35.225>so, <00:33:35.575>mm-hmm. <00:33:35.925>Mm-hmm.

679
00:33:37.335 --> 00:33:39.965
<00:33:37.335>I <00:33:37.615>think <00:33:37.895>this <00:33:38.175>is <00:33:38.455>perfect. <00:33:38.735>This

680
00:33:39.965 --> 00:33:40.965
<00:33:39.965>Is <00:33:40.145>perfect. <00:33:40.324>It's <00:33:40.504>perfect. <00:33:40.685>Yeah. <00:33:40.865>Okay.

681
00:33:40.965 --> 00:33:43.085
<00:33:40.965>So <00:33:41.431>you're <00:33:41.898>finished? <00:33:42.365>Yeah.

682
00:33:43.345 --> 00:33:45.485
<00:33:43.345>So <00:33:43.520>we <00:33:43.695>go <00:33:43.870>to <00:33:44.045>the <00:33:44.220>next <00:33:44.395>slide? <00:33:44.570>Yeah. <00:33:44.745>Yeah.

683
00:33:45.595 --> 00:33:48.765
<00:33:45.595>Okay. <00:33:45.945>Let's <00:33:46.295>do <00:33:46.645>it. <00:33:46.995>Okay.

684
00:33:49.105 --> 00:33:50.805
<00:33:49.105>So <00:33:50.505>discriminator,

685
00:33:50.905 --> 00:33:51.905
Yes.

686
00:33:53.145 --> 00:33:57.645
<00:33:53.145>So <00:33:53.285>please, <00:33:53.425>can <00:33:53.565>you <00:33:53.705>decide <00:33:53.845>which <00:33:53.985>one <00:33:54.125>is <00:33:54.264>a <00:33:54.405>real <00:33:54.545>phase

687
00:33:57.705 --> 00:34:00.165
<00:33:57.705>and <00:33:58.054>which <00:33:58.405>one <00:33:58.754>is <00:33:59.105>generated

688
00:34:00.625 --> 00:34:02.765
<00:34:00.625>by <00:34:01.325>the <00:34:02.025>generator?

689
00:34:03.625 --> 00:34:04.685
<00:34:03.625>Oh, <00:34:03.863>that's <00:34:04.101>a <00:34:04.340>tough <00:34:04.579>one.

690
00:34:05.045 --> 00:34:07.565
<00:34:05.045>'cause <00:34:05.245>I've <00:34:05.445>literally <00:34:05.645>never <00:34:05.845>seen <00:34:06.045>anything <00:34:06.245>at <00:34:06.445>all.

691
00:34:08.265 --> 00:34:12.125
<00:34:08.264>Uh, <00:34:08.464>I <00:34:08.665>guess <00:34:08.864>I'm <00:34:09.065>just <00:34:09.264>gonna <00:34:09.464>guess <00:34:09.665>randomly

692
00:34:12.145 --> 00:34:13.445
<00:34:12.145>and <00:34:12.340>say <00:34:12.534>the <00:34:12.730>left <00:34:12.925>one <00:34:13.120>is <00:34:13.315>real.

693
00:34:14.105 --> 00:34:16.365
<00:34:14.105>The <00:34:14.245>left <00:34:14.385>one <00:34:14.525>is <00:34:14.665>real. <00:34:14.804>Yeah, <00:34:14.945>the <00:34:15.085>left <00:34:15.225>one. <00:34:15.365>Why <00:34:15.505>not?

694
00:34:17.425 --> 00:34:20.995
<00:34:17.425>Ah, <00:34:17.565>ah, <00:34:17.705>you <00:34:17.845>are <00:34:17.985>wrong. <00:34:18.125>So <00:34:18.265>yeah, <00:34:18.405>what <00:34:18.545>did <00:34:18.685>you <00:34:18.825>learn?

695
00:34:21.505 --> 00:34:22.915
<00:34:21.505>Yeah, <00:34:21.758>it <00:34:22.012>seems <00:34:22.266>like <00:34:22.520>the, <00:34:22.774>the,

696
00:34:22.915 --> 00:34:25.555
<00:34:22.915>the <00:34:23.090>real <00:34:23.264>face <00:34:23.440>actually <00:34:23.614>has <00:34:23.790>like, <00:34:23.965>some, <00:34:24.139>some <00:34:24.315>kind

697
00:34:25.555 --> 00:34:28.595
<00:34:25.554>of <00:34:25.694>connected <00:34:25.835>line <00:34:25.975>and <00:34:26.114>like <00:34:26.254>the, <00:34:26.395>the <00:34:26.534>shape <00:34:26.674>of <00:34:26.815>a <00:34:26.955>face.

698
00:34:31.105 --> 00:34:32.315
<00:34:31.105>Yeah, <00:34:31.649>yeah. <00:34:32.194>Yeah.

699
00:34:32.315 --> 00:34:33.955
<00:34:32.315>That <00:34:32.548>was <00:34:32.781>definitely <00:34:33.014>something <00:34:33.248>I <00:34:33.481>learned. <00:34:33.715>Yeah.

700
00:34:34.185 --> 00:34:36.515
<00:34:34.185>Okay. <00:34:34.418>Next <00:34:34.651>round. <00:34:34.884>Yeah, <00:34:35.118>let's, <00:34:35.351>okay. <00:34:35.585>So,

701
00:34:37.185 --> 00:34:38.185
<00:34:37.185>Okay. <00:34:37.634>Co <00:34:38.085>connect

702
00:34:38.185 --> 00:34:40.035
<00:34:38.185>connected <00:34:38.534>lines <00:34:38.884>mm-hmm. <00:34:39.235>You <00:34:39.585>said?

703
00:34:40.225 --> 00:34:41.995
<00:34:40.225>Yeah. <00:34:40.574>Okay. <00:34:40.924>Okay. <00:34:41.275>Connect. <00:34:41.625>Okay.

704
00:34:42.055 --> 00:34:43.995
<00:34:42.054>So <00:34:42.254>you <00:34:42.455>learn <00:34:42.654>something. <00:34:42.855>I <00:34:43.054>remember <00:34:43.254>that. <00:34:43.455>Okay.

705
00:34:44.005 --> 00:34:46.315
<00:34:44.005>Round <00:34:44.355>two. <00:34:44.705>Round <00:34:45.055>two. <00:34:45.405>So

706
00:34:47.585 --> 00:34:49.195
<00:34:47.585>Connected <00:34:48.284>lines, <00:34:48.985>huh?

707
00:34:49.545 --> 00:34:51.235
<00:34:49.545>Okay, <00:34:49.895>let's <00:34:50.245>do <00:34:50.595>it. <00:34:50.945>Okay.

708
00:34:51.385 --> 00:34:55.995
<00:34:51.385>I'll <00:34:51.665>just <00:34:51.945>create <00:34:52.225>some <00:34:52.505>connected <00:34:52.785>lines.

709
00:34:57.175 --> 00:35:02.115
<00:34:57.175>So <00:34:57.302>there <00:34:57.429>is <00:34:57.556>also <00:34:57.684>some <00:34:57.811>line <00:34:57.938>here <00:34:58.065>and <00:34:58.193>there <00:34:58.320>is <00:34:58.447>a <00:34:58.575>line,

710
00:35:02.655 --> 00:35:05.875
<00:35:02.655>and <00:35:02.888>this <00:35:03.121>one <00:35:03.355>is <00:35:03.588>also <00:35:03.821>some <00:35:04.055>lines.

711
00:35:06.455 --> 00:35:08.355
<00:35:06.455>And <00:35:07.154>yeah, <00:35:07.855>so

712
00:35:09.625 --> 00:35:11.875
<00:35:09.625>that <00:35:09.975>sounds <00:35:10.325>pretty <00:35:10.675>good, <00:35:11.025>actually.

713
00:35:12.035 --> 00:35:13.475
<00:35:12.035>I, <00:35:12.466>I <00:35:12.899>think <00:35:13.331>this

714
00:35:13.475 --> 00:35:14.475
<00:35:13.475>Is <00:35:13.700>it. <00:35:13.924>You're <00:35:14.150>finished. <00:35:14.375>Okay.

715
00:35:14.475 --> 00:35:15.555
<00:35:14.475>Okay. <00:35:15.446>Okay.

716
00:35:15.815 --> 00:35:19.315
<00:35:15.815>So <00:35:16.095>dear <00:35:16.375>disc <00:35:16.655>discriminator. <00:35:16.935>Yes. <00:35:17.215>Yeah.

717
00:35:19.415 --> 00:35:23.115
<00:35:19.415>Can <00:35:19.555>you, <00:35:19.695>can <00:35:19.835>you <00:35:19.975>decide <00:35:20.115>which <00:35:20.255>one <00:35:20.395>is <00:35:20.535>a <00:35:20.675>real <00:35:20.815>painting?

718
00:35:23.335 --> 00:35:25.475
<00:35:23.335>Uh, <00:35:23.615>or <00:35:23.895>a <00:35:24.175>real <00:35:24.455>picture <00:35:24.735>photograph?

719
00:35:25.475 --> 00:35:28.205
<00:35:25.475>And <00:35:25.708>which <00:35:25.941>one <00:35:26.174>is <00:35:26.408>the <00:35:26.641>generated <00:35:26.875>one?

720
00:35:28.425 --> 00:35:30.445
<00:35:28.425>Wow, <00:35:28.600>that's <00:35:28.775>a <00:35:28.950>tough <00:35:29.125>one, <00:35:29.300>because <00:35:29.475>they <00:35:29.650>both <00:35:29.825>look

721
00:35:30.815 --> 00:35:31.965
<00:35:30.815>quite <00:35:31.160>real <00:35:31.505>to <00:35:31.850>me.

722
00:35:32.905 --> 00:35:35.925
<00:35:32.905>That's <00:35:33.032>a <00:35:33.159>tough <00:35:33.286>one. <00:35:33.414>Well, <00:35:33.541>I <00:35:33.668>have <00:35:33.795>to <00:35:33.923>say <00:35:34.050>though, <00:35:34.177>last <00:35:34.305>time,

723
00:35:36.125 --> 00:35:38.885
<00:35:36.125>I, <00:35:36.325>I <00:35:36.525>also <00:35:36.725>kind <00:35:36.925>of <00:35:37.125>noticed <00:35:37.325>that, <00:35:37.525>um,

724
00:35:39.065 --> 00:35:41.125
<00:35:39.065>the <00:35:39.298>real <00:35:39.531>one <00:35:39.765>was <00:35:39.998>slightly <00:35:40.231>more <00:35:40.465>shaded,

725
00:35:41.305 --> 00:35:43.045
<00:35:41.305>did <00:35:41.585>have <00:35:41.865>like, <00:35:42.145>colors <00:35:42.424>in <00:35:42.705>there.

726
00:35:43.305 --> 00:35:46.485
<00:35:43.305>So <00:35:43.412>I <00:35:43.520>have <00:35:43.628>to <00:35:43.735>say, <00:35:43.843>I <00:35:43.951>think <00:35:44.058>the <00:35:44.166>left <00:35:44.274>one <00:35:44.381>is <00:35:44.489>the <00:35:44.597>real <00:35:44.705>one.

727
00:35:47.755 --> 00:35:48.755
<00:35:47.755>Is <00:35:48.205>that <00:35:48.655>right?

728
00:35:49.465 --> 00:35:50.175
<00:35:49.465>Let's <00:35:49.678>have <00:35:49.891>a <00:35:50.104>look.

729
00:35:55.205 --> 00:35:58.385
<00:35:55.205>The <00:35:55.345>left <00:35:55.485>one <00:35:55.625>is <00:35:55.765>the <00:35:55.904>real <00:35:56.045>one. <00:35:56.185>Yes. <00:35:56.325>Yeah. <00:35:56.465>Perfect. <00:35:56.605>Awesome.

730
00:35:58.385 --> 00:36:00.905
<00:35:58.385>Awesome. <00:35:58.560>Okay. <00:35:58.735>Okay. <00:35:58.910>Okay. <00:35:59.085>Okay. <00:35:59.260>Okay. <00:35:59.435>Okay. <00:35:59.610>Okay. <00:35:59.785>I

731
00:36:00.905 --> 00:36:02.185
<00:36:00.905>Really <00:36:01.135>need <00:36:01.365>to <00:36:01.596>train <00:36:01.826>hard. <00:36:02.057>Now

732
00:36:02.285 --> 00:36:03.825
<00:36:02.285>You, <00:36:02.515>you <00:36:02.747>have <00:36:02.978>to <00:36:03.209>train <00:36:03.439>hard, <00:36:03.671>right?

733
00:36:04.295 --> 00:36:06.145
<00:36:04.295>Okay. <00:36:04.761>So <00:36:05.228>after <00:36:05.695>thousands

734
00:36:06.245 --> 00:36:08.145
<00:36:06.245>and <00:36:06.711>thousands <00:36:07.178>of <00:36:07.645>iterations,

735
00:36:09.005 --> 00:36:11.425
<00:36:09.005>the <00:36:09.285>generator <00:36:09.565>becomes <00:36:09.845>better <00:36:10.125>and <00:36:10.405>better.

736
00:36:12.045 --> 00:36:14.145
<00:36:12.045>So <00:36:12.185>I <00:36:12.325>don't <00:36:12.465>know <00:36:12.605>how <00:36:12.745>much <00:36:12.885>time <00:36:13.025>you <00:36:13.165>have <00:36:13.305>in <00:36:13.445>front

737
00:36:14.145 --> 00:36:15.665
<00:36:14.145>of <00:36:14.487>your <00:36:14.829>monitors <00:36:15.171>right <00:36:15.513>now,

738
00:36:15.765 --> 00:36:19.905
<00:36:15.765>but <00:36:15.920>we <00:36:16.076>skipped <00:36:16.231>those <00:36:16.387>th <00:36:16.542>a <00:36:16.698>thousand <00:36:16.853>iterations <00:36:17.009>round <00:36:17.165>three.

739
00:36:20.085 --> 00:36:24.225
<00:36:20.085>And <00:36:20.240>now <00:36:20.396>let's <00:36:20.551>see <00:36:20.707>how <00:36:20.862>good <00:36:21.018>the <00:36:21.173>generator <00:36:21.329>is <00:36:21.485>now.

740
00:36:25.255 --> 00:36:27.625
<00:36:25.255>Okay. <00:36:25.455>So <00:36:25.655>I <00:36:25.855>trained <00:36:26.055>a <00:36:26.255>lot <00:36:26.455>right <00:36:26.655>now,

741
00:36:27.965 --> 00:36:31.345
<00:36:27.965>and <00:36:28.072>what <00:36:28.180>I <00:36:28.288>first <00:36:28.395>have <00:36:28.503>to <00:36:28.611>do <00:36:28.718>is <00:36:28.826>I'll <00:36:28.934>have <00:36:29.041>to <00:36:29.149>create <00:36:29.257>some <00:36:29.365>kind

742
00:36:31.345 --> 00:36:33.625
<00:36:31.345>of, <00:36:31.544>yeah, <00:36:31.745>skin <00:36:31.944>tone <00:36:32.145>or <00:36:32.345>something <00:36:32.544>like <00:36:32.745>that.

743
00:36:34.165 --> 00:36:37.155
<00:36:34.165>So <00:36:34.445>just <00:36:34.725>take <00:36:35.005>something <00:36:35.285>like <00:36:35.565>that.

744
00:36:40.375 --> 00:36:44.935
<00:36:40.375>Um, <00:36:40.725>Just <00:36:41.075>create <00:36:41.425>some <00:36:41.775>kind

745
00:36:45.035 --> 00:36:46.615
<00:36:45.035>of <00:36:45.501>face <00:36:45.968>or <00:36:46.435>something.

746
00:36:48.515 --> 00:36:51.455
<00:36:48.515>Oh, <00:36:48.865>Yeah, <00:36:49.214>come <00:36:49.565>on. <00:36:49.915>Okay.

747
00:36:52.355 --> 00:36:55.935
<00:36:52.355>And <00:36:52.530>then <00:36:52.705>we <00:36:52.880>also <00:36:53.055>need <00:36:53.230>a <00:36:53.405>mouth <00:36:53.580>in <00:36:53.755>here.

748
00:37:02.045 --> 00:37:03.575
<00:37:02.045>Yeah, <00:37:03.422>big

749
00:37:03.635 --> 00:37:04.635
<00:37:03.635>Fat. <00:37:03.935>All <00:37:04.235>right, <00:37:04.535>that's

750
00:37:04.635 --> 00:37:05.495
<00:37:04.635>good. <00:37:05.022>That's <00:37:05.409>good.

751
00:37:05.955 --> 00:37:10.115
<00:37:05.955>And <00:37:06.082>then <00:37:06.209>we <00:37:06.336>also <00:37:06.464>need <00:37:06.591>some <00:37:06.718>eyes. <00:37:06.845>Let's <00:37:06.973>do <00:37:07.100>it <00:37:07.227>up <00:37:07.355>here.

752
00:37:15.805 --> 00:37:18.135
<00:37:15.805>Okay. <00:37:16.154>Yeah, <00:37:16.504>I <00:37:16.855>think, <00:37:17.205>um,

753
00:37:18.385 --> 00:37:21.215
<00:37:18.385>maybe <00:37:18.585>a <00:37:18.785>bit <00:37:18.985>more <00:37:19.185>eyes <00:37:19.385>here, <00:37:19.585>little <00:37:19.785>bit.

754
00:37:24.705 --> 00:37:28.035
<00:37:24.705>Okay. <00:37:24.938>And <00:37:25.171>I, <00:37:25.404>I <00:37:25.638>think <00:37:25.871>I'm, <00:37:26.105>I'm,

755
00:37:28.035 --> 00:37:29.115
<00:37:28.035>I'm <00:37:28.229>pretty <00:37:28.423>good <00:37:28.618>with <00:37:28.812>that <00:37:29.006>one.

756
00:37:30.175 --> 00:37:32.755
<00:37:30.175>And <00:37:30.375>so, <00:37:30.575>so <00:37:30.775>Martin, <00:37:30.975>I <00:37:31.175>think <00:37:31.375>I'm <00:37:31.575>finished.

757
00:37:33.175 --> 00:37:36.395
<00:37:33.175>You're <00:37:33.375>finished? <00:37:33.575>Okay. <00:37:33.775>Oh <00:37:33.975>my <00:37:34.175>God, <00:37:34.375>that's <00:37:34.575>scary.

758
00:37:37.055 --> 00:37:39.115
<00:37:37.055>Um, <00:37:37.335>okay, <00:37:37.615>dear. <00:37:37.895>Discriminate <00:37:38.174>or <00:37:38.455>peace.

759
00:37:39.145 --> 00:37:41.275
<00:37:39.145>Yeah, <00:37:39.611>well, <00:37:40.078>I <00:37:40.545>have

760
00:37:41.275 --> 00:37:44.155
<00:37:41.275>to <00:37:41.430>say <00:37:41.586>those <00:37:41.741>pretty <00:37:41.897>look <00:37:42.052>exactly <00:37:42.208>the <00:37:42.363>same <00:37:42.519>to <00:37:42.675>me.

761
00:37:45.895 --> 00:37:49.115
<00:37:45.895>You <00:37:46.095>literally <00:37:46.295>cannot <00:37:46.495>distinguish, <00:37:46.695>uh, <00:37:46.895>those <00:37:47.095>two <00:37:47.295>images.

762
00:37:49.295 --> 00:37:52.075
<00:37:49.295>So <00:37:49.422>I <00:37:49.549>have <00:37:49.676>to <00:37:49.804>say, <00:37:49.931>yeah, <00:37:50.058>I'll <00:37:50.185>have <00:37:50.313>to <00:37:50.440>throw <00:37:50.567>the <00:37:50.695>towel

763
00:37:52.075 --> 00:37:55.355
<00:37:52.075>and <00:37:52.250>say, <00:37:52.424>uh, <00:37:52.600>probably, <00:37:52.774>I <00:37:52.950>don't <00:37:53.125>know, <00:37:53.299>probably <00:37:53.475>the,

764
00:37:55.415 --> 00:37:56.715
<00:37:55.415>the <00:37:55.610>right <00:37:55.805>one <00:37:56.000>is <00:37:56.195>the <00:37:56.390>real <00:37:56.585>one.

765
00:37:56.715 --> 00:38:00.075
<00:37:56.715>Is <00:37:56.890>that <00:37:57.065>correct? <00:37:57.240>Oh, <00:37:57.415>damn. <00:37:57.590>No, <00:37:57.765>no, <00:37:57.940>it's <00:37:58.115>not.

766
00:38:00.545 --> 00:38:02.795
<00:38:00.545>Anyways, <00:38:00.895>so, <00:38:01.245>uh, <00:38:01.595>pretty <00:38:01.945>fun.

767
00:38:03.175 --> 00:38:04.555
<00:38:03.175>We <00:38:03.330>are <00:38:03.485>just <00:38:03.640>gonna <00:38:03.796>have <00:38:03.951>a <00:38:04.106>quick <00:38:04.261>look <00:38:04.417>at

768
00:38:04.585 --> 00:38:06.835
<00:38:04.585>what <00:38:04.740>exactly <00:38:04.896>just <00:38:05.051>happened <00:38:05.207>here <00:38:05.362>on <00:38:05.518>a <00:38:05.673>more <00:38:05.829>technical <00:38:05.985>level.

769
00:38:06.835 --> 00:38:07.995
<00:38:06.835>So <00:38:07.043>we <00:38:07.252>have <00:38:07.461>the <00:38:07.670>real <00:38:07.879>faces,

770
00:38:08.735 --> 00:38:11.395
<00:38:08.735>and <00:38:08.890>we <00:38:09.046>have <00:38:09.201>the <00:38:09.357>ones <00:38:09.512>generated <00:38:09.668>by <00:38:09.823>our <00:38:09.979>auto <00:38:10.135>encoder,

771
00:38:11.895 --> 00:38:14.555
<00:38:11.895>and <00:38:12.128>we <00:38:12.361>train <00:38:12.595>a <00:38:12.828>discriminator <00:38:13.061>on, <00:38:13.295>uh,

772
00:38:14.555 --> 00:38:17.515
<00:38:14.555>distinguishing <00:38:14.788>whether <00:38:15.021>a <00:38:15.254>face <00:38:15.488>is <00:38:15.721>real <00:38:15.955>fake.

773
00:38:18.295 --> 00:38:22.035
<00:38:18.295>And, <00:38:18.435>um, <00:38:18.575>at <00:38:18.715>the <00:38:18.855>same <00:38:18.995>time, <00:38:19.135>we <00:38:19.275>also <00:38:19.415>train <00:38:19.555>the <00:38:19.695>generator

774
00:38:22.415 --> 00:38:25.755
<00:38:22.415>to <00:38:22.590>generate <00:38:22.765>faces <00:38:22.940>that <00:38:23.115>look <00:38:23.290>real <00:38:23.465>to <00:38:23.640>the <00:38:23.815>discriminator.

775
00:38:25.755 --> 00:38:30.675
<00:38:25.755>In <00:38:25.862>this <00:38:25.970>way, <00:38:26.078>we <00:38:26.185>have <00:38:26.293>like, <00:38:26.401>kind <00:38:26.508>of <00:38:26.616>a, <00:38:26.724>uh, <00:38:26.831>um, <00:38:26.939>zero <00:38:27.047>sum <00:38:27.155>game

776
00:38:30.675 --> 00:38:33.675
<00:38:30.675>that <00:38:30.850>those <00:38:31.025>two <00:38:31.200>are <00:38:31.375>playing, <00:38:31.550>so <00:38:31.725>generator <00:38:31.900>and <00:38:32.075>discriminator.

777
00:38:34.375 --> 00:38:37.725
<00:38:34.375>And, <00:38:34.502>um, <00:38:34.629>by <00:38:34.756>doing <00:38:34.884>this, <00:38:35.011>both <00:38:35.138>of <00:38:35.265>them <00:38:35.393>will <00:38:35.520>improve <00:38:35.647>over <00:38:35.775>time,

778
00:38:37.785 --> 00:38:40.285
<00:38:37.785>as <00:38:37.940>you've <00:38:38.096>just <00:38:38.251>seen <00:38:38.407>in <00:38:38.562>the <00:38:38.718>offline <00:38:38.873>role <00:38:39.029>play <00:38:39.185>game.

779
00:38:40.825 --> 00:38:44.125
<00:38:40.825>So, <00:38:40.980>without <00:38:41.136>further <00:38:41.291>ado, <00:38:41.447>we're <00:38:41.602>just <00:38:41.758>gonna <00:38:41.913>skip <00:38:42.069>ahead <00:38:42.225>to

780
00:38:44.625 --> 00:38:47.445
<00:38:44.625>how <00:38:44.800>this <00:38:44.975>now <00:38:45.150>looks <00:38:45.325>as <00:38:45.500>a <00:38:45.675>final <00:38:45.850>deep <00:38:46.025>fake.

781
00:38:48.025 --> 00:38:52.285
<00:38:48.025>And <00:38:48.141>you <00:38:48.258>can <00:38:48.375>now <00:38:48.491>see <00:38:48.608>I <00:38:48.725>am <00:38:48.841>a <00:38:48.958>deep <00:38:49.075>fake <00:38:49.191>of <00:38:49.308>who's <00:38:49.425>that?

782
00:38:52.685 --> 00:38:55.205
<00:38:52.685>I <00:38:52.918>think <00:38:53.151>that <00:38:53.384>is, <00:38:53.618>uh, <00:38:53.851>Kim <00:38:54.085>Jong-un.

783
00:38:55.675 --> 00:38:57.045
<00:38:55.675>Just, <00:38:55.983>just <00:38:56.291>gonna <00:38:56.599>skip <00:38:56.908>faces,

784
00:38:57.045 --> 00:38:58.365
<00:38:57.045>and <00:38:57.214>you <00:38:57.384>can <00:38:57.554>see <00:38:57.723>it <00:38:57.893>looks <00:38:58.063>way <00:38:58.232>better.

785
00:38:58.425 --> 00:39:00.805
<00:38:58.425>We <00:38:58.600>don't <00:38:58.775>have <00:38:58.950>the <00:38:59.125>eyes <00:38:59.300>on <00:38:59.475>the <00:38:59.650>forehead <00:38:59.825>anymore,

786
00:39:01.385 --> 00:39:02.765
<00:39:01.385>and <00:39:01.562>we <00:39:01.739>can <00:39:01.917>just <00:39:02.094>skip <00:39:02.272>through <00:39:02.449>a <00:39:02.627>couple.

787
00:39:02.865 --> 00:39:05.805
<00:39:02.865>You <00:39:02.992>can <00:39:03.119>see <00:39:03.246>now <00:39:03.374>I'm <00:39:03.501>deep, <00:39:03.628>I'm <00:39:03.755>being <00:39:03.883>deep <00:39:04.010>faked <00:39:04.137>to <00:39:04.265>myself.

788
00:39:06.385 --> 00:39:09.885
<00:39:06.385>Um, <00:39:06.585>and <00:39:06.785>now <00:39:06.985>I'm, <00:39:07.185>we <00:39:07.385>have <00:39:07.585>a <00:39:07.785>couple

789
00:39:09.885 --> 00:39:11.245
<00:39:09.885>of <00:39:10.089>other <00:39:10.293>people <00:39:10.497>in <00:39:10.701>here <00:39:10.904>as <00:39:11.109>well.

790
00:39:11.755 --> 00:39:13.725
<00:39:11.755>Yeah, <00:39:11.988>we <00:39:12.221>have <00:39:12.455>people <00:39:12.688>like <00:39:12.921>Donald <00:39:13.155>Trump,

791
00:39:13.945 --> 00:39:16.605
<00:39:13.945>and <00:39:14.120>you <00:39:14.295>can <00:39:14.470>still <00:39:14.645>see <00:39:14.820>it's <00:39:14.995>not <00:39:15.170>quite <00:39:15.345>perfect.

792
00:39:16.985 --> 00:39:19.925
<00:39:16.985>So <00:39:17.125>for <00:39:17.265>that <00:39:17.405>reason, <00:39:17.545>we've <00:39:17.685>done <00:39:17.825>a <00:39:17.965>couple <00:39:18.105>of <00:39:18.245>more, <00:39:18.385>uh,

793
00:39:19.925 --> 00:39:21.045
<00:39:19.925>things <00:39:20.261>in <00:39:20.597>the <00:39:20.933>meantime,

794
00:39:21.785 --> 00:39:26.045
<00:39:21.785>and <00:39:21.912>that <00:39:22.039>is <00:39:22.166>to, <00:39:22.294>well <00:39:22.421>tweak <00:39:22.548>a <00:39:22.675>little <00:39:22.803>bit <00:39:22.930>more <00:39:23.057>here, <00:39:23.185>here

795
00:39:26.065 --> 00:39:28.485
<00:39:26.065>and <00:39:26.265>there, <00:39:26.465>and <00:39:26.665>move <00:39:26.865>completely <00:39:27.065>to <00:39:27.265>TensorFlow <00:39:27.465>too,

796
00:39:28.485 --> 00:39:31.165
<00:39:28.485>which <00:39:28.685>allowed <00:39:28.885>us <00:39:29.085>to <00:39:29.285>do <00:39:29.485>things <00:39:29.685>like <00:39:29.885>this.

797
00:39:31.745 --> 00:39:36.685
<00:39:31.745>So, <00:39:31.900>uh, <00:39:32.056>if <00:39:32.211>you'd <00:39:32.367>be, <00:39:32.522>uh, <00:39:32.678>if <00:39:32.833>you'd <00:39:32.989>actually <00:39:33.145>be

798
00:39:36.685 --> 00:39:38.285
<00:39:36.685>so <00:39:36.884>nice <00:39:37.085>to <00:39:37.285>turn <00:39:37.485>off <00:39:37.685>our <00:39:37.884>screen <00:39:38.085>cap

799
00:39:38.345 --> 00:39:41.525
<00:39:38.345>or <00:39:38.500>the, <00:39:38.656>our <00:39:38.811>slides <00:39:38.967>so <00:39:39.122>we <00:39:39.278>can <00:39:39.433>see <00:39:39.589>our <00:39:39.745>faces

800
00:39:41.625 --> 00:39:42.725
<00:39:41.625>and <00:39:41.955>yeah, <00:39:42.285>that's <00:39:42.615>beautiful.

801
00:39:43.305 --> 00:39:46.005
<00:39:43.305>So, <00:39:43.460>um, <00:39:43.616>as <00:39:43.771>you <00:39:43.927>can <00:39:44.082>see, <00:39:44.238>I'm <00:39:44.393>now <00:39:44.549>have <00:39:44.705>alesh,

802
00:39:46.005 --> 00:39:47.725
<00:39:46.005>but <00:39:46.145>we <00:39:46.285>have <00:39:46.425>a <00:39:46.565>couple <00:39:46.705>different <00:39:46.845>faces <00:39:46.985>in <00:39:47.125>here <00:39:47.265>as <00:39:47.405>well.

803
00:39:47.785 --> 00:39:50.605
<00:39:47.785>So <00:39:47.912>we <00:39:48.039>have <00:39:48.166>a <00:39:48.294>deep <00:39:48.421>fake <00:39:48.548>version <00:39:48.675>of <00:39:48.803>me, <00:39:48.930>which <00:39:49.057>is <00:39:49.185>great

804
00:39:50.625 --> 00:39:53.325
<00:39:50.625>and <00:39:50.800>kind <00:39:50.975>of <00:39:51.150>creepy <00:39:51.325>because <00:39:51.500>it <00:39:51.675>just <00:39:51.850>stares <00:39:52.025>upwards.

805
00:39:53.825 --> 00:39:56.765
<00:39:53.825>But <00:39:53.980>you <00:39:54.136>can <00:39:54.291>also <00:39:54.447>see <00:39:54.602>that <00:39:54.758>it <00:39:54.913>really <00:39:55.069>now <00:39:55.225>manages

806
00:39:56.765 --> 00:39:58.645
<00:39:56.765>to <00:39:56.998>preserve <00:39:57.231>the <00:39:57.464>shape <00:39:57.698>of <00:39:57.931>the <00:39:58.165>head.

807
00:39:58.665 --> 00:40:00.405
<00:39:58.665>It <00:39:58.898>doesn't <00:39:59.131>kind <00:39:59.365>of <00:39:59.598>stretch <00:39:59.831>it <00:40:00.065>to,

808
00:40:00.425 --> 00:40:01.805
<00:40:00.425>to <00:40:00.632>the <00:40:00.839>dimensions <00:40:01.046>of <00:40:01.253>my <00:40:01.460>real <00:40:01.667>head.

809
00:40:01.805 --> 00:40:04.245
<00:40:01.805>It <00:40:01.980>works <00:40:02.154>out <00:40:02.330>also <00:40:02.504>with <00:40:02.680>people <00:40:02.855>that <00:40:03.029>have <00:40:03.205>glasses.

810
00:40:04.745 --> 00:40:07.485
<00:40:04.745>And <00:40:04.872>you <00:40:04.999>can <00:40:05.126>also <00:40:05.254>see <00:40:05.381>it, <00:40:05.508>we <00:40:05.635>are <00:40:05.763>changing <00:40:05.890>the <00:40:06.017>entire <00:40:06.145>head.

811
00:40:07.505 --> 00:40:08.565
<00:40:07.505>It <00:40:07.743>works <00:40:07.982>in <00:40:08.220>real <00:40:08.459>time.

812
00:40:09.225 --> 00:40:11.805
<00:40:09.225>And <00:40:09.400>as <00:40:09.575>I'm <00:40:09.750>speaking <00:40:09.924>to <00:40:10.100>you <00:40:10.275>as <00:40:10.450>Angela <00:40:10.625>Merkel,

813
00:40:11.805 --> 00:40:14.925
<00:40:11.805>there's <00:40:11.944>another <00:40:12.085>nice <00:40:12.225>effect <00:40:12.365>that <00:40:12.504>I <00:40:12.645>can <00:40:12.785>talk <00:40:12.924>about <00:40:13.065>right <00:40:13.205>now.

814
00:40:14.945 --> 00:40:17.845
<00:40:14.945>And <00:40:15.120>that <00:40:15.295>is, <00:40:15.470>it's <00:40:15.645>a <00:40:15.820>data <00:40:15.995>driven <00:40:16.170>driven <00:40:16.345>process.

815
00:40:17.945 --> 00:40:20.645
<00:40:17.945>The <00:40:18.100>deepfake <00:40:18.256>can <00:40:18.411>only <00:40:18.567>reproduce <00:40:18.722>what <00:40:18.878>it <00:40:19.033>has <00:40:19.189>seen <00:40:19.345>previously.

816
00:40:20.705 --> 00:40:23.845
<00:40:20.705>So <00:40:20.938>for <00:40:21.171>example, <00:40:21.404>Angela <00:40:21.638>Merkel <00:40:21.871>cannot <00:40:22.105>smile.

817
00:40:24.435 --> 00:40:27.765
<00:40:24.435>I'll <00:40:24.590>try <00:40:24.746>to <00:40:24.901>do <00:40:25.057>that, <00:40:25.212>and <00:40:25.368>you'll <00:40:25.523>see <00:40:25.679>it <00:40:25.835>looks,

818
00:40:28.345 --> 00:40:29.685
<00:40:28.345>it <00:40:28.646>looks <00:40:28.948>creepy <00:40:29.249>as <00:40:29.551>hell.

819
00:40:30.225 --> 00:40:34.565
<00:40:30.225>Um, <00:40:30.400>so <00:40:30.575>that's, <00:40:30.750>that's <00:40:30.924>one <00:40:31.100>fun <00:40:31.275>thing <00:40:31.450>about <00:40:31.625>DeepFakes.

820
00:40:34.565 --> 00:40:36.845
<00:40:34.565>So <00:40:34.740>right <00:40:34.915>now <00:40:35.090>I'm <00:40:35.265>gonna <00:40:35.440>switch <00:40:35.615>to <00:40:35.790>Vladimir <00:40:35.965>Putin

821
00:40:36.845 --> 00:40:38.205
<00:40:36.845>and <00:40:37.089>give <00:40:37.334>it <00:40:37.579>over <00:40:37.824>to <00:40:38.069>Martin

822
00:40:38.345 --> 00:40:39.845
<00:40:38.345>to <00:40:38.537>tell <00:40:38.730>us <00:40:38.923>a <00:40:39.116>little <00:40:39.309>bit <00:40:39.502>more <00:40:39.694>about

823
00:40:40.105 --> 00:40:41.285
<00:40:40.105>the <00:40:40.459>fields <00:40:40.813>of <00:40:41.167>applications.

824
00:40:41.285 --> 00:40:43.165
<00:40:41.285>And <00:40:41.412>if <00:40:41.539>I <00:40:41.666>know, <00:40:41.794>if <00:40:41.921>you <00:40:42.048>can <00:40:42.175>give <00:40:42.303>us <00:40:42.430>our <00:40:42.557>slides <00:40:42.685>back,

825
00:40:43.555 --> 00:40:44.885
<00:40:43.555>that <00:40:43.953>would <00:40:44.353>be <00:40:44.752>nice.

826
00:40:45.155 --> 00:40:46.325
<00:40:45.155>Yeah. <00:40:45.418>Martin, <00:40:45.681>take <00:40:45.944>it <00:40:46.207>away.

827
00:40:47.495 --> 00:40:50.805
<00:40:47.495>Thank <00:40:47.670>you, <00:40:47.845>Ronald. <00:40:48.020>Okay, <00:40:48.194>yeah, <00:40:48.370>what <00:40:48.545>are <00:40:48.720>the <00:40:48.895>fields

828
00:40:50.865 --> 00:40:51.925
<00:40:50.865>of <00:40:51.819>application?

829
00:40:52.465 --> 00:40:54.925
<00:40:52.465>So, <00:40:52.620>um, <00:40:52.776>this <00:40:52.931>is <00:40:53.087>a <00:40:53.242>question <00:40:53.398>you <00:40:53.553>may <00:40:53.709>ask <00:40:53.865>yourself,

830
00:40:55.025 --> 00:40:56.565
<00:40:55.025>but <00:40:55.371>there <00:40:55.718>are <00:40:56.064>several, <00:40:56.411>um,

831
00:40:57.265 --> 00:40:58.765
<00:40:57.265>and <00:40:57.433>let's <00:40:57.602>have <00:40:57.771>a <00:40:57.940>look <00:40:58.108>to <00:40:58.277>some <00:40:58.446>of <00:40:58.615>them.

832
00:40:59.185 --> 00:41:03.165
<00:40:59.185>So <00:40:59.360>at <00:40:59.535>first, <00:40:59.710>um, <00:40:59.884>let's <00:41:00.060>talk <00:41:00.235>about, <00:41:00.410>uh, <00:41:00.585>movie

833
00:41:03.305 --> 00:41:04.605
<00:41:03.305>and <00:41:03.890>entertainment <00:41:04.475>industry.

834
00:41:05.105 --> 00:41:08.525
<00:41:05.105>So, <00:41:05.305>um, <00:41:05.505>how <00:41:05.705>many <00:41:05.905>times, <00:41:06.105>um, <00:41:06.305>uh, <00:41:06.505>the,

835
00:41:08.545 --> 00:41:12.005
<00:41:08.545>the <00:41:08.745>Hollywood <00:41:08.945>studios <00:41:09.145>were <00:41:09.345>recreating, <00:41:09.545>um, <00:41:09.745>yeah, <00:41:09.945>actors

836
00:41:12.105 --> 00:41:15.085
<00:41:12.105>and <00:41:12.338>actresses, <00:41:12.571>which <00:41:12.805>are <00:41:13.038>not <00:41:13.271>alive <00:41:13.505>anymore.

837
00:41:15.625 --> 00:41:18.245
<00:41:15.625>So <00:41:15.800>here <00:41:15.975>in <00:41:16.150>this <00:41:16.325>case, <00:41:16.500>we <00:41:16.675>see <00:41:16.850>Princess <00:41:17.025>Leia.

838
00:41:18.245 --> 00:41:20.925
<00:41:18.245>And <00:41:18.478>now <00:41:18.711>the <00:41:18.944>question <00:41:19.178>is, <00:41:19.411>which <00:41:19.645>one

839
00:41:21.025 --> 00:41:24.565
<00:41:21.025>of <00:41:21.258>those <00:41:21.491>both <00:41:21.725>snippets <00:41:21.958>are <00:41:22.191>CGI <00:41:22.425>generated

840
00:41:24.785 --> 00:41:26.605
<00:41:24.785>and <00:41:25.018>which <00:41:25.251>one <00:41:25.484>is <00:41:25.718>a <00:41:25.951>deep <00:41:26.185>fake?

841
00:41:28.825 --> 00:41:32.725
<00:41:28.825>So <00:41:28.964>please <00:41:29.105>guess <00:41:29.245>3, <00:41:29.384>2, <00:41:29.524>1, <00:41:29.665>and <00:41:29.805>we <00:41:29.944>will <00:41:30.085>solve <00:41:30.225>that.

842
00:41:33.065 --> 00:41:35.805
<00:41:33.065>So <00:41:33.265>the <00:41:33.465>upper <00:41:33.665>part <00:41:33.865>is <00:41:34.065>A <00:41:34.265>ZGI <00:41:34.465>effect,

843
00:41:35.985 --> 00:41:38.285
<00:41:35.985>and <00:41:36.140>the <00:41:36.296>bottom <00:41:36.451>part <00:41:36.607>is <00:41:36.762>created <00:41:36.918>by <00:41:37.073>a <00:41:37.229>deep <00:41:37.385>fake.

844
00:41:39.145 --> 00:41:42.565
<00:41:39.145>So <00:41:39.345>the <00:41:39.545>main <00:41:39.745>difference <00:41:39.945>between <00:41:40.145>both, <00:41:40.345>both <00:41:40.545>methods

845
00:41:43.145 --> 00:41:46.285
<00:41:43.145>are <00:41:43.345>hundred <00:41:43.545>thousands, <00:41:43.745>if <00:41:43.945>not <00:41:44.145>millions <00:41:44.345>of <00:41:44.545>dollars,

846
00:41:46.675 --> 00:41:48.085
<00:41:46.675>because <00:41:46.992>for <00:41:47.309>the <00:41:47.626>deep <00:41:47.944>fake,

847
00:41:48.265 --> 00:41:50.205
<00:41:48.265>you <00:41:48.545>just <00:41:48.825>need <00:41:49.105>some <00:41:49.384>video <00:41:49.665>material.

848
00:41:50.425 --> 00:41:52.005
<00:41:50.425>You <00:41:50.658>just <00:41:50.891>learn <00:41:51.125>that <00:41:51.358>in <00:41:51.591>our <00:41:51.825>talk.

849
00:41:52.425 --> 00:41:56.205
<00:41:52.425>And <00:41:52.565>for <00:41:52.705>ZGI, <00:41:52.845>it <00:41:52.985>takes <00:41:53.125>so <00:41:53.265>much <00:41:53.405>effort <00:41:53.545>to <00:41:53.685>do <00:41:53.825>that.

850
00:41:56.345 --> 00:42:01.285
<00:41:56.345>You <00:41:56.452>have <00:41:56.560>to, <00:41:56.668>you, <00:41:56.775>you <00:41:56.883>need <00:41:56.991>a, <00:41:57.098>a, <00:41:57.206>a <00:41:57.314>good <00:41:57.421>actor, <00:41:57.529>then <00:41:57.637>you <00:41:57.745>need

851
00:42:01.305 --> 00:42:03.645
<00:42:01.305>to, <00:42:01.654>um, <00:42:02.004>recreate <00:42:02.355>3D <00:42:02.705>masks

852
00:42:03.985 --> 00:42:06.605
<00:42:03.985>and <00:42:04.218>by <00:42:04.451>a <00:42:04.685>special, <00:42:04.918>um, <00:42:05.151>yeah, <00:42:05.385>filming,

853
00:42:06.635 --> 00:42:08.605
<00:42:06.635>filming <00:42:06.915>technique <00:42:07.195>and <00:42:07.475>stuff <00:42:07.755>like <00:42:08.035>that.

854
00:42:08.625 --> 00:42:12.365
<00:42:08.625>And <00:42:08.825>there <00:42:09.025>is <00:42:09.225>much <00:42:09.425>manual <00:42:09.625>processing <00:42:09.825>behind <00:42:10.025>that,

855
00:42:12.945 --> 00:42:16.465
<00:42:12.945>and <00:42:13.225>it's <00:42:13.505>very, <00:42:13.785>very, <00:42:14.065>yeah, <00:42:14.345>expensive.

856
00:42:17.485 --> 00:42:21.345
<00:42:17.485>Of <00:42:17.660>course, <00:42:17.835>DeepFakes <00:42:18.010>can <00:42:18.185>be <00:42:18.360>used <00:42:18.535>here <00:42:18.710>to <00:42:18.885>generate,

857
00:42:21.525 --> 00:42:23.065
<00:42:21.525>to <00:42:21.987>create <00:42:22.449>fake <00:42:22.911>news,

858
00:42:23.605 --> 00:42:27.505
<00:42:23.605>but <00:42:23.780>as <00:42:23.955>you <00:42:24.130>learn <00:42:24.305>today <00:42:24.480>as <00:42:24.655>well, <00:42:24.830>you <00:42:25.005>can

859
00:42:28.415 --> 00:42:31.305
<00:42:28.415>bust <00:42:28.881>fake <00:42:29.348>news <00:42:29.815>using

860
00:42:31.995 --> 00:42:34.545
<00:42:31.995>those <00:42:32.461>generative <00:42:32.928>adversarial <00:42:33.395>networks.

861
00:42:34.605 --> 00:42:36.785
<00:42:34.605>By <00:42:34.805>the <00:42:35.005>way, <00:42:35.205>there <00:42:35.405>are <00:42:35.605>web <00:42:35.805>services <00:42:36.005>available

862
00:42:37.075 --> 00:42:39.385
<00:42:37.075>where <00:42:37.308>you <00:42:37.541>can <00:42:37.774>upload <00:42:38.008>video <00:42:38.241>your <00:42:38.475>material,

863
00:42:39.525 --> 00:42:42.825
<00:42:39.525>and <00:42:39.665>it <00:42:39.805>gets <00:42:39.945>checked <00:42:40.085>if <00:42:40.225>it <00:42:40.365>is <00:42:40.505>maybe <00:42:40.645>a <00:42:40.785>deep <00:42:40.925>fake,

864
00:42:43.045 --> 00:42:45.825
<00:42:43.045>but <00:42:43.511>be <00:42:43.978>sure, <00:42:44.445>remember

865
00:42:45.825 --> 00:42:48.665
<00:42:45.825>that <00:42:46.024>this <00:42:46.225>is <00:42:46.424>a <00:42:46.625>cat <00:42:46.825>and <00:42:47.024>mouse <00:42:47.225>game.

866
00:42:49.485 --> 00:42:53.985
<00:42:49.485>So <00:42:49.660>the, <00:42:49.835>the, <00:42:50.010>the, <00:42:50.185>the <00:42:50.360>the <00:42:50.535>generative <00:42:50.710>adversarial <00:42:50.885>network,

867
00:42:54.285 --> 00:42:56.545
<00:42:54.285>um, <00:42:54.518>has <00:42:54.751>to <00:42:54.984>be <00:42:55.218>drained <00:42:55.451>well <00:42:55.685>enough.

868
00:42:56.645 --> 00:42:59.545
<00:42:56.645>And <00:42:56.772>yeah, <00:42:56.899>as <00:42:57.026>I <00:42:57.154>already <00:42:57.281>told <00:42:57.408>you, <00:42:57.535>cat <00:42:57.663>and <00:42:57.790>mouse <00:42:57.917>my <00:42:58.045>game.

869
00:43:00.245 --> 00:43:04.035
<00:43:00.245>So <00:43:00.372>now <00:43:00.499>this <00:43:00.626>is <00:43:00.754>the <00:43:00.881>end <00:43:01.008>of <00:43:01.135>our <00:43:01.263>talk, <00:43:01.390>I <00:43:01.517>would <00:43:01.645>say.

870
00:43:04.695 --> 00:43:09.675
<00:43:04.695>And, <00:43:04.835>um, <00:43:04.975>if <00:43:05.115>you <00:43:05.255>are <00:43:05.395>interested <00:43:05.535>in <00:43:05.675>other <00:43:05.815>talks, <00:43:05.955>for <00:43:06.095>example,

871
00:43:09.705 --> 00:43:11.515
<00:43:09.705>like <00:43:10.055>the <00:43:10.404>style <00:43:10.755>transfer <00:43:11.105>ai,

872
00:43:11.805 --> 00:43:14.795
<00:43:11.805>which <00:43:12.004>is <00:43:12.205>a <00:43:12.404>really <00:43:12.605>good <00:43:12.805>introduction <00:43:13.004>into, <00:43:13.205>um,

873
00:43:14.985 --> 00:43:19.635
<00:43:14.985>deep <00:43:15.218>neural <00:43:15.451>networks, <00:43:15.685>then <00:43:15.918>just, <00:43:16.151>um, <00:43:16.385>uh,

874
00:43:19.635 --> 00:43:21.435
<00:43:19.635>scan <00:43:19.835>this <00:43:20.035>QR <00:43:20.235>code <00:43:20.435>on <00:43:20.635>the <00:43:20.835>left <00:43:21.035>side.

875
00:43:21.615 --> 00:43:23.995
<00:43:21.615>And, <00:43:21.770>uh, <00:43:21.926>I <00:43:22.081>don't <00:43:22.237>think <00:43:22.392>there <00:43:22.548>is <00:43:22.703>the <00:43:22.859>need <00:43:23.015>to,

876
00:43:25.095 --> 00:43:27.675
<00:43:25.095>to <00:43:25.294>photograph <00:43:25.495>the <00:43:25.694>right <00:43:25.895>side, <00:43:26.095>uh, <00:43:26.294>QR <00:43:26.495>code

877
00:43:27.675 --> 00:43:30.555
<00:43:27.675>because, <00:43:27.850>um, <00:43:28.025>you <00:43:28.200>actually <00:43:28.375>attended <00:43:28.550>this <00:43:28.725>talk <00:43:28.900>right <00:43:29.075>now.

878
00:43:30.895 --> 00:43:32.875
<00:43:30.895>So <00:43:31.128>we <00:43:31.361>hope <00:43:31.595>you <00:43:31.828>had <00:43:32.061>much <00:43:32.295>fun.

879
00:43:33.135 --> 00:43:37.395
<00:43:33.135>And <00:43:33.251>we <00:43:33.368>are <00:43:33.485>available <00:43:33.601>for <00:43:33.718>a <00:43:33.835>q <00:43:33.951>and <00:43:34.068>a <00:43:34.185>session <00:43:34.301>after <00:43:34.418>our <00:43:34.535>talk.

880
00:43:37.775 --> 00:43:40.955
<00:43:37.775>So <00:43:37.975>thank <00:43:38.175>you <00:43:38.375>very <00:43:38.575>much, <00:43:38.775>Thomas <00:43:38.975>and <00:43:39.175>Jonas,

881
00:43:43.425 --> 00:43:45.005
<00:43:43.425>and <00:43:44.825>bye-bye.

882
00:43:45.775 --> 00:43:49.165
<00:43:45.775>Thank <00:43:46.125>you, <00:43:46.475>Thomas, <00:43:46.825>Martin, <00:43:47.175>Jonas,

883
00:43:51.105 --> 00:43:53.645
<00:43:51.105>uh, <00:43:51.805>um, <00:43:52.505>Vladimir

884
00:43:53.745 --> 00:43:57.005
<00:43:53.745>and <00:43:53.872>so <00:43:53.999>on, <00:43:54.126>uh, <00:43:54.254>for <00:43:54.381>the <00:43:54.508>great <00:43:54.635>talk <00:43:54.763>was <00:43:54.890>really, <00:43:55.017>I, <00:43:55.145>I,

885
00:43:57.085 --> 00:43:59.285
<00:43:57.085>I <00:43:57.201>enjoyed <00:43:57.318>it <00:43:57.435>for <00:43:57.551>the <00:43:57.668>second <00:43:57.785>time, <00:43:57.901>even <00:43:58.018>more <00:43:58.135>than <00:43:58.251>I <00:43:58.368>did <00:43:58.485>for,

886
00:43:59.285 --> 00:44:00.725
<00:43:59.285>for <00:43:59.500>the <00:43:59.716>last <00:43:59.933>time <00:44:00.149>because <00:44:00.365>I <00:44:00.581>could

887
00:44:00.965 --> 00:44:02.125
<00:44:00.965>concentrate <00:44:01.173>on <00:44:01.382>more <00:44:01.591>on <00:44:01.800>the <00:44:02.009>details.

888
00:44:02.455 --> 00:44:04.685
<00:44:02.455>There <00:44:02.688>already <00:44:02.921>have <00:44:03.154>been <00:44:03.388>some <00:44:03.621>questions <00:44:03.855>here,

889
00:44:04.915 --> 00:44:08.605
<00:44:04.915>some <00:44:05.055>you <00:44:05.195>already <00:44:05.335>answered <00:44:05.475>is, <00:44:05.615>uh, <00:44:05.755>about, <00:44:05.895>uh, <00:44:06.035>what <00:44:06.175>about, <00:44:06.315>uh,

890
00:44:08.745 --> 00:44:13.485
<00:44:08.745>the, <00:44:08.884>uh, <00:44:09.025>the <00:44:09.165>real <00:44:09.305>world <00:44:09.444>use <00:44:09.585>of, <00:44:09.725>uh, <00:44:09.865>the <00:44:10.005>real <00:44:10.145>benefits

891
00:44:13.515 --> 00:44:16.925
<00:44:13.515>with, <00:44:13.670>as <00:44:13.826>you <00:44:13.981>said, <00:44:14.137>with <00:44:14.292>the, <00:44:14.448>uh, <00:44:14.603>special <00:44:14.759>effects <00:44:14.915>team.

892
00:44:17.385 --> 00:44:20.245
<00:44:17.385>Uh, <00:44:17.525>and <00:44:17.665>I <00:44:17.805>think <00:44:17.945>one <00:44:18.085>of <00:44:18.225>the <00:44:18.365>questions <00:44:18.505>I <00:44:18.645>would <00:44:18.785>like

893
00:44:20.245 --> 00:44:22.845
<00:44:20.245>to <00:44:20.352>give <00:44:20.460>you <00:44:20.568>here, <00:44:20.675>and <00:44:20.783>then <00:44:20.891>I <00:44:20.998>would, <00:44:21.106>uh, <00:44:21.214>ask <00:44:21.321>you <00:44:21.429>to <00:44:21.537>go <00:44:21.645>over

894
00:44:22.865 --> 00:44:24.965
<00:44:22.865>to <00:44:23.064>the <00:44:23.265>q <00:44:23.464>and <00:44:23.665>a <00:44:23.865>launch <00:44:24.064>is, <00:44:24.265>uh,

895
00:44:24.965 --> 00:44:26.805
<00:44:24.965>where <00:44:25.198>do <00:44:25.431>you <00:44:25.665>see <00:44:25.898>DeepFakes <00:44:26.131>going <00:44:26.365>next?

896
00:44:27.065 --> 00:44:28.525
<00:44:27.065>What's <00:44:27.503>the <00:44:27.941>next <00:44:28.379>step?

897
00:44:30.245 --> 00:44:30.665
Mm-hmm.

898
00:44:37.305 --> 00:44:38.725
<00:44:37.305>So <00:44:37.624>what's <00:44:37.944>the <00:44:38.263>next <00:44:38.583>step?

899
00:44:38.745 --> 00:44:42.125
<00:44:38.745>So <00:44:38.900>obviously, <00:44:39.056>uh, <00:44:39.211>deep <00:44:39.367>defects <00:44:39.522>are <00:44:39.678>gonna <00:44:39.833>go <00:44:39.989>further <00:44:40.145>forward

900
00:44:42.265 --> 00:44:43.445
<00:44:42.265>in <00:44:42.619>terms <00:44:42.973>of <00:44:43.327>resolution.

901
00:44:43.465 --> 00:44:46.885
<00:44:43.465>So <00:44:43.605>they're <00:44:43.745>gonna <00:44:43.885>be <00:44:44.025>more <00:44:44.165>sharp, <00:44:44.305>more <00:44:44.445>hard <00:44:44.585>to <00:44:44.725>um, <00:44:44.865>uh,

902
00:44:47.235 --> 00:44:48.965
<00:44:47.235>distinguish <00:44:47.585>from <00:44:47.935>the <00:44:48.285>real <00:44:48.635>thing.

903
00:44:49.545 --> 00:44:51.885
<00:44:49.545>But <00:44:49.778>what <00:44:50.011>DeepFakes <00:44:50.245>only <00:44:50.478>solve <00:44:50.711>it <00:44:50.945>is

904
00:44:51.885 --> 00:44:53.245
<00:44:51.885>just <00:44:52.191>swapping <00:44:52.497>out <00:44:52.803>a <00:44:53.109>face.

905
00:44:53.265 --> 00:44:55.885
<00:44:53.265>It <00:44:53.420>doesn't <00:44:53.576>really <00:44:53.731>work <00:44:53.887>for <00:44:54.042>the <00:44:54.198>rest <00:44:54.353>of <00:44:54.509>the <00:44:54.665>body.

906
00:44:55.905 --> 00:44:58.045
<00:44:55.905>It <00:44:56.080>doesn't <00:44:56.255>really <00:44:56.430>work <00:44:56.605>for <00:44:56.780>the <00:44:56.955>voice <00:44:57.130>just <00:44:57.305>yet,

907
00:44:58.585 --> 00:44:59.685
<00:44:58.585>at <00:44:58.783>least <00:44:58.981>not <00:44:59.179>in <00:44:59.377>real <00:44:59.575>time.

908
00:44:59.745 --> 00:45:02.045
<00:44:59.745>So <00:44:59.900>I <00:45:00.056>think <00:45:00.211>the <00:45:00.367>next <00:45:00.522>really <00:45:00.678>interesting <00:45:00.833>step <00:45:00.989>will <00:45:01.145>be

909
00:45:02.045 --> 00:45:04.645
<00:45:02.045>to <00:45:02.200>make <00:45:02.356>basically <00:45:02.511>everything <00:45:02.667>else <00:45:02.822>that <00:45:02.978>is <00:45:03.133>not <00:45:03.289>the <00:45:03.445>face

910
00:45:05.195 --> 00:45:06.805
<00:45:05.195>also <00:45:05.475>look <00:45:05.755>legitimate <00:45:06.035>in <00:45:06.315>a <00:45:06.595>deepfake.

911
00:45:06.805 --> 00:45:11.285
<00:45:06.805>So <00:45:06.944>that <00:45:07.085>is <00:45:07.225>doing, <00:45:07.365>um, <00:45:07.504>a, <00:45:07.645>a <00:45:07.785>type <00:45:07.924>of <00:45:08.065>voice <00:45:08.205>cloning,

912
00:45:11.285 --> 00:45:15.085
<00:45:11.285>which <00:45:11.412>is <00:45:11.539>not <00:45:11.666>possible <00:45:11.794>in <00:45:11.921>real <00:45:12.048>time <00:45:12.175>yet <00:45:12.303>doing, <00:45:12.430>um, <00:45:12.557>some <00:45:12.685>type

913
00:45:15.085 --> 00:45:18.605
<00:45:15.085>of <00:45:15.260>like, <00:45:15.435>yeah, <00:45:15.610>kind <00:45:15.785>of, <00:45:15.960>uh, <00:45:16.135>adjusting <00:45:16.310>the <00:45:16.485>clothing,

914
00:45:18.715 --> 00:45:21.045
<00:45:18.715>adjusting <00:45:18.915>the <00:45:19.115>body <00:45:19.315>posture <00:45:19.515>and <00:45:19.715>stuff <00:45:19.915>like <00:45:20.115>that.

915
00:45:21.095 --> 00:45:22.725
<00:45:21.095>Doing <00:45:21.294>all <00:45:21.495>of <00:45:21.694>this <00:45:21.895>in <00:45:22.095>an <00:45:22.294>automated <00:45:22.495>fashion,

916
00:45:23.295 --> 00:45:24.405
<00:45:23.295>gonna <00:45:23.628>skip <00:45:23.961>this <00:45:24.294>head.

917
00:45:25.025 --> 00:45:27.845
<00:45:25.025>And, <00:45:25.180>um, <00:45:25.336>yeah, <00:45:25.491>that's <00:45:25.647>gonna <00:45:25.802>be <00:45:25.958>definitely <00:45:26.113>the <00:45:26.269>next <00:45:26.425>move

918
00:45:27.905 --> 00:45:30.765
<00:45:27.905>for <00:45:28.138>DeepFakes <00:45:28.371>as <00:45:28.605>well <00:45:28.838>as <00:45:29.071>just <00:45:29.305>DeepFakes

919
00:45:30.765 --> 00:45:35.525
<00:45:30.765>and <00:45:30.881>AI <00:45:30.998>as <00:45:31.115>such, <00:45:31.231>being <00:45:31.348>one <00:45:31.464>more <00:45:31.581>tool <00:45:31.698>in <00:45:31.815>the <00:45:31.931>tool <00:45:32.048>create <00:45:32.165>of,

920
00:45:35.665 --> 00:45:40.085
<00:45:35.665>um, <00:45:35.840>creatives <00:45:36.015>and <00:45:36.190>professionals <00:45:36.365>to <00:45:36.540>do <00:45:36.715>fun <00:45:36.890>stuff <00:45:37.065>with.

921
00:45:40.715 --> 00:45:42.045
<00:45:40.715>Yeah, <00:45:41.114>that <00:45:41.513>was <00:45:41.912>actually,

922
00:45:42.045 --> 00:45:44.205
<00:45:42.045>there <00:45:42.245>was <00:45:42.445>one <00:45:42.645>follow <00:45:42.845>up <00:45:43.045>question, <00:45:43.245>another <00:45:43.445>question.

923
00:45:44.305 --> 00:45:45.725
<00:45:44.305>How <00:45:44.560>do <00:45:44.816>you <00:45:45.071>fake <00:45:45.327>the <00:45:45.583>voice?

924
00:45:45.965 --> 00:45:47.645
<00:45:45.965>I <00:45:46.140>guess <00:45:46.315>you <00:45:46.490>have <00:45:46.665>to <00:45:46.840>have <00:45:47.015>an <00:45:47.190>actor <00:45:47.365>right

925
00:45:47.645 --> 00:45:48.765
<00:45:47.645>now <00:45:47.846>who <00:45:48.048>can <00:45:48.249>fake <00:45:48.451>the <00:45:48.653>voice.

926
00:45:48.835 --> 00:45:52.285
<00:45:48.835>It's <00:45:48.990>not <00:45:49.146>the, <00:45:49.301>uh, <00:45:49.457>the <00:45:49.612>AI <00:45:49.768>at <00:45:49.923>the <00:45:50.079>moment, <00:45:50.235>right?

927
00:45:53.145 --> 00:45:56.125
<00:45:53.145>So <00:45:53.261>for, <00:45:53.378>for, <00:45:53.495>for <00:45:53.611>us, <00:45:53.728>no, <00:45:53.845>we <00:45:53.961>don't <00:45:54.078>have <00:45:54.195>any <00:45:54.311>kind <00:45:54.428>of, <00:45:54.545>uh,

928
00:45:56.125 --> 00:45:57.965
<00:45:56.125>voice <00:45:56.358>deep <00:45:56.591>fake <00:45:56.825>built <00:45:57.058>into <00:45:57.291>our <00:45:57.525>software,

929
00:45:58.185 --> 00:46:00.845
<00:45:58.185>but <00:45:58.360>there <00:45:58.535>are <00:45:58.710>different <00:45:58.884>approaches <00:45:59.060>to, <00:45:59.235>to <00:45:59.410>recreating <00:45:59.585>voices.

930
00:46:01.475 --> 00:46:05.125
<00:46:01.475>What <00:46:01.591>you <00:46:01.708>need <00:46:01.825>for <00:46:01.941>that <00:46:02.058>usually <00:46:02.174>is <00:46:02.291>also <00:46:02.408>a, <00:46:02.525>a <00:46:02.641>large <00:46:02.758>data <00:46:02.875>set

931
00:46:05.125 --> 00:46:08.365
<00:46:05.125>of, <00:46:05.325>of <00:46:05.525>voice <00:46:05.725>samples <00:46:05.925>or <00:46:06.125>not <00:46:06.325>so <00:46:06.525>large.

932
00:46:08.545 --> 00:46:09.605
<00:46:08.545>The <00:46:08.735>only <00:46:08.926>issue <00:46:09.117>here <00:46:09.308>is <00:46:09.499>that

933
00:46:09.605 --> 00:46:11.485
<00:46:09.605>that <00:46:09.805>does <00:46:10.005>not <00:46:10.205>work <00:46:10.405>in <00:46:10.605>real <00:46:10.805>time <00:46:11.005>yet.

934
00:46:12.105 --> 00:46:13.245
<00:46:12.105>So <00:46:12.618>for <00:46:13.131>example,

935
00:46:13.275 --> 00:46:15.365
<00:46:13.275>what <00:46:13.475>you <00:46:13.675>would <00:46:13.875>typically <00:46:14.075>find <00:46:14.275>in <00:46:14.475>your <00:46:14.675>smartphone,

936
00:46:15.365 --> 00:46:17.565
<00:46:15.365>your <00:46:15.645>Google, <00:46:15.924>or <00:46:16.205>a <00:46:16.484>Siri <00:46:16.765>assistant

937
00:46:17.665 --> 00:46:20.805
<00:46:17.665>of <00:46:17.820>those <00:46:17.976>voices <00:46:18.131>are <00:46:18.287>generated <00:46:18.442>by <00:46:18.598>a <00:46:18.753>pretty <00:46:18.909>similar <00:46:19.065>technique.

938
00:46:21.505 --> 00:46:24.525
<00:46:21.505>Um, <00:46:21.680>so, <00:46:21.855>uh, <00:46:22.030>applying <00:46:22.205>this <00:46:22.380>to <00:46:22.555>basically <00:46:22.730>any <00:46:22.905>kind

939
00:46:24.525 --> 00:46:26.525
<00:46:24.525>of <00:46:24.805>voice <00:46:25.085>leads <00:46:25.365>to, <00:46:25.645>well, <00:46:25.925>more

940
00:46:26.525 --> 00:46:28.005
<00:46:26.525>and <00:46:26.747>more <00:46:26.969>convincing <00:46:27.191>results <00:46:27.413>when <00:46:27.635>it <00:46:27.857>comes

941
00:46:28.005 --> 00:46:29.165
<00:46:28.005>to <00:46:28.213>voice <00:46:28.422>deep <00:46:28.631>fakes <00:46:28.840>as <00:46:29.049>well.

942
00:46:30.135 --> 00:46:34.325
<00:46:30.135>Great. <00:46:30.310>Thanks <00:46:30.485>Thomas <00:46:30.660>Martin <00:46:30.835>Jonas, <00:46:31.010>it's <00:46:31.185>always <00:46:31.360>a <00:46:31.535>pleasure

943
00:46:34.325 --> 00:46:36.405
<00:46:34.325>to <00:46:34.480>listen <00:46:34.636>to <00:46:34.791>your <00:46:34.947>talks <00:46:35.102>in <00:46:35.258>German <00:46:35.413>or <00:46:35.569>in <00:46:35.725>English.