WEBVTT 00:00:00.000 --> 00:00:04.840 align:middle line:90% 00:00:04.840 --> 00:00:07.750 align:middle line:84% We've been looking at many different types of technologies 00:00:07.750 --> 00:00:10.690 align:middle line:90% now, for capturing human motion. 00:00:10.690 --> 00:00:14.140 align:middle line:84% Or even muscles, and muscle sensing, and other types 00:00:14.140 --> 00:00:16.100 align:middle line:90% of data. 00:00:16.100 --> 00:00:18.160 align:middle line:84% And these are used for the analysis, 00:00:18.160 --> 00:00:20.770 align:middle line:84% and for more scientific purposes. 00:00:20.770 --> 00:00:24.520 align:middle line:84% But in our group here at the University of Oslo, 00:00:24.520 --> 00:00:26.370 align:middle line:84% and also around the world, many people 00:00:26.370 --> 00:00:30.190 align:middle line:84% are using the same type of technologies to create music. 00:00:30.190 --> 00:00:35.320 align:middle line:84% And one word that describes this and that's often used, 00:00:35.320 --> 00:00:38.650 align:middle line:84% is that NIME, which stands for New Interfaces 00:00:38.650 --> 00:00:40.490 align:middle line:90% for Musical Expression. 00:00:40.490 --> 00:00:44.170 align:middle line:84% And here one of the ideas is that we use technology 00:00:44.170 --> 00:00:48.190 align:middle line:84% to create sounds and music, but this also 00:00:48.190 --> 00:00:51.580 align:middle line:84% requires that we work with the mappings from them. 00:00:51.580 --> 00:00:53.830 align:middle line:84% Different types of motion to sound. 00:00:53.830 --> 00:00:57.050 align:middle line:84% And Christian, you have a sensor here now, 00:00:57.050 --> 00:00:59.560 align:middle line:84% can you just tell a little bit about how 00:00:59.560 --> 00:01:01.133 align:middle line:84% you have been approaching this, when 00:01:01.133 --> 00:01:03.550 align:middle line:84% you've been trying to make this into a musical instrument. 00:01:03.550 --> 00:01:09.700 align:middle line:84% Sure, I've been looking at this arm band called the MYO, which 00:01:09.700 --> 00:01:14.620 align:middle line:84% has eight sensors that captures the muscle tension of the lower 00:01:14.620 --> 00:01:18.310 align:middle line:84% arm, in addition to a gyroscope and accelerometer. 00:01:18.310 --> 00:01:23.680 align:middle line:84% Which allows you to extract the orientation of the device. 00:01:23.680 --> 00:01:27.400 align:middle line:84% And I've been using this for a musical instrument 00:01:27.400 --> 00:01:29.860 align:middle line:90% to control sound. 00:01:29.860 --> 00:01:33.220 align:middle line:84% That's already there, sort of process with sound effects. 00:01:33.220 --> 00:01:36.820 align:middle line:84% And also to trigger sounds like piano sounds, or drum sounds. 00:01:36.820 --> 00:01:40.812 align:middle line:90% [MYO DEVICE PLAYING] 00:01:40.812 --> 00:02:16.572 align:middle line:90% 00:02:16.572 --> 00:02:21.808 align:middle line:90% [MUSIC CONTINUES] 00:02:21.808 --> 00:03:23.550 align:middle line:90% 00:03:23.550 --> 00:03:28.350 align:middle line:84% And it's quite effective in how it works, with low latency, 00:03:28.350 --> 00:03:30.822 align:middle line:90% and very high-- 00:03:30.822 --> 00:03:32.030 align:middle line:90% something right, on the data. 00:03:32.030 --> 00:03:36.720 align:middle line:84% Yeah, and how is this connected to the-- 00:03:36.720 --> 00:03:40.110 align:middle line:84% kind of studies you have doing on sounds and actions? 00:03:40.110 --> 00:03:41.850 align:middle line:90% How is this related to working-- 00:03:41.850 --> 00:03:43.350 align:middle line:84% I mean, the other way around really? 00:03:43.350 --> 00:03:45.540 align:middle line:84% Now what is interesting is when you 00:03:45.540 --> 00:03:48.120 align:middle line:84% know how people relate movement to sound, 00:03:48.120 --> 00:03:53.340 align:middle line:84% you can use that knowledge to map the data from this device 00:03:53.340 --> 00:03:55.320 align:middle line:90% into a synthesiser. 00:03:55.320 --> 00:03:59.190 align:middle line:84% For instance, if you were to control some sort of tone, 00:03:59.190 --> 00:04:01.350 align:middle line:84% going up and down, maybe you would 00:04:01.350 --> 00:04:04.350 align:middle line:84% want to use this armband, going up 00:04:04.350 --> 00:04:06.370 align:middle line:90% and down to control that pitch. 00:04:06.370 --> 00:04:08.910 align:middle line:84% So if you know that people relate pitch 00:04:08.910 --> 00:04:11.100 align:middle line:84% to vertical movement, up and down, 00:04:11.100 --> 00:04:13.080 align:middle line:84% maybe you want to use that information 00:04:13.080 --> 00:04:20.430 align:middle line:84% and let this movement be mapped to pitch on your synthesiser. 00:04:20.430 --> 00:04:23.400 align:middle line:84% And one thing that many people often are a little bit confused 00:04:23.400 --> 00:04:24.943 align:middle line:90% about, is this-- 00:04:24.943 --> 00:04:26.610 align:middle line:84% when we were talking about technologies, 00:04:26.610 --> 00:04:28.568 align:middle line:84% that you have either you can make an instrument 00:04:28.568 --> 00:04:31.110 align:middle line:84% or you can make more of a musical device. 00:04:31.110 --> 00:04:33.500 align:middle line:84% What is your-- what is your take on this? 00:04:33.500 --> 00:04:37.620 align:middle line:84% I guess that's a big debate, but I 00:04:37.620 --> 00:04:41.250 align:middle line:84% don't see why we should confine musical instruments 00:04:41.250 --> 00:04:43.200 align:middle line:90% to very narrow things. 00:04:43.200 --> 00:04:46.020 align:middle line:84% I would say, if you use this to control the DJ mix, 00:04:46.020 --> 00:04:48.070 align:middle line:90% it's still a musical instrument. 00:04:48.070 --> 00:04:50.760 align:middle line:84% It's not some sort of musical device, 00:04:50.760 --> 00:04:54.220 align:middle line:84% a musical instrument can be many things. 00:04:54.220 --> 00:04:56.850 align:middle line:84% So one of the things that we see then, 00:04:56.850 --> 00:04:58.410 align:middle line:84% when we work with music technology 00:04:58.410 --> 00:05:01.210 align:middle line:84% for creating new music, is that it is possible 00:05:01.210 --> 00:05:04.620 align:middle line:84% then to use knowledge from our scientific studies. 00:05:04.620 --> 00:05:07.440 align:middle line:84% Also for Creative Studies, and what we also learned 00:05:07.440 --> 00:05:09.030 align:middle line:84% is that it's possible to use really 00:05:09.030 --> 00:05:14.750 align:middle line:84% any type of technology to create new musical instruments.