Windows

Loading...

Из курса от партнера Universitat Pompeu Fabra of Barcelona

Audio Signal Processing for Music Applications

179 оценки

Universitat Pompeu Fabra of Barcelona

Audio Signal Processing for Music Applications

179 оценки

In this course you will learn about audio signal processing methodologies that are specific for music and of use in real applications. We focus on the spectral processing techniques of relevance for the description and transformation of sounds, developing the basic theoretical and practical knowledge with which to analyze, synthesize, transform and describe audio signals in the context of music applications. The course is based on open software and content. The demonstrations and programming exercises are done using Python under Ubuntu, and the references and materials for the course come from open online repositories. We are also distributing with open licenses the software and materials developed for the course.

Из урока

Short-time Fourier transform

STFT equation; analysis window; FFT size and hop size; time-frequency compromise; inverse STFT. Demonstration of tools to compute the spectrogram of a sound and on how to analyze a sound using them. Implementation of the windowing of sounds using Python and presentation of the STFT functions from the sms-tools package, explaining how to use them.

Познакомьтесь с преподавателями

Xavier Serra
Full Professor
Dept. of Information and Communication Technologies, UPF
Prof Julius O Smith, III
Professor of Music and (by courtesy) Electrical Engineering
CCRMA

Hello, welcome back to the course on audio signal processing for music applications.

This week, we're talking about the short-time Fourier transform.

And one of the fundamental elements of this transform is the analysis window.

So in this programming lecture I want to talk about windows but

from a programming perspective.

So let's open a text editor GEdit, in which I typed

a script that what it does is to get a window.

In this case the hamming window, and then it computes the spectrum of the window.

But since I have to do all this zero phase windowing and

center things around zero and zero padding.

At the end, the code is a little bit longer than what it would be desirable.

So let's go through the code and talk about the main aspects of it.

Well first, we have the packages that we need,

import, numpy, scipy and matplotlib.

Then we have the lines that relate to the window, so

we defined the window length in this case,

63 and the very row that we keep that is M, capital M.

Then we called a function GetWindow,

which it has two parameters.

The name of the window on the size, so the window I chose is the hanning window.

Which is the raised cosine function.

And then I need the variables that keep the middle of the window information.

And it has to handle this even are not situations so

the middle can be different depending on even an outside.

So the two sides might have different number of samples.

Okay, then we need to prepare the window for computing FFT.

So to place the window at the zeroth location, so

what we're going to do is we create a buffer of the size of the 51

that we want to compute, in this case 512 samples.

And then we place the window around the zeroth sample.

So we take the second half of the window and place it at the beginning and

the first half of the window and place it at the end.

Then we can compute the spectrum of this buffer, okay.

So we will compute the buffer using the FFT algorithm and

then we comvert the complex spectrum into absolute value and phase.

The absolute value in order to convert it to decibels,

which is the way that we like to see the information of the magnitude,

we have to make sure that there are no zeroes so

that the lock of zero is not there.

So we will have to check if the absolute value is

below this epsilon value which is the minimum value we can have in Python.

So that's why we have these three lines of code.

And then we compute the angle of the complex values.

And then in order to show it better, to display the spectrum,

the magnitude and phase spectra and

see it centered in the middle, let's say of the array.

We undo this zero phase windowing thing so

that we place back the data in the middle of the array,

it's easier to visualize.

Okay let's run it, so

we are in a iPython with Pylab in it, so

we have the matplotlib package already

within it and we can run the script.

Okay, that's it and now we can start plotting things that we have computed.

For example, we can plot the window, okay.

So, this is the hanning window, which is this raised cosine going from

zero to one and the 63 samples that we have computed.

Then we can plot how this window has been placed in the FFT buffer.

So we can plot the FFT buffer.

Okay, so here the window is centered at zero.

So we have the second half from zero to half of the window, and the first half

right before the 512 valley of the FFT buffer, okay?

And now we compute the FFT.

We can plot the magnitude spectrum resulting from that.

Okay so this is the magnitude spectrum again centered around zero so

here we have the positive frequency values.

And in the second part we have the negative values.

So a better way to display that is to move things around and

locate the main lobe in the center so that's how we did and

mx1 has the information in the center.

And if we plot the phase, we can also show the location

of the phases and here what is important of course are the phases in the middle.

And here we have these two pi discontinuities but basically everything

is zero, modulus two pi and it's a clear.

It's good because that means we centered the window around zero and

therefore we have what we call a zero phase window.

Okay, in order to visualize the X axis better.

Here, I typed some commands to plot it

in a way that the access are better shown.

So here what I did was to plot against an X axis array.

That has been normalized so

that the zero parting does not affect, so we divide by N and multiple by M.

So we actually see the samples, let's say of, with respect to the window and

they also have normalized the magnitude so that the maximum is zero decibels.

And I'm only plotting the values that go in the x axis from minus 22 to 20 and

the dB values, I'm plotting from minus 80 to zero.

Now, if we run this script with these lines added,

well we are seeing the magnitude spectrum of the hanning window.

But with an x axis that shows the center around zero.

And decibels starting from zero.

So now we can check the values we talked about that describe the window.

We mentioned that the main lobe.

The width of the main lobe is an important characteristic of the window.

In here we can see, if we look from the bottom

right side where our x value is of the cursor.

We can see that this main lobe sort of deep is at minus two.

And this other one is at two so clearly this main lobe at this location,

the weight is around four samples or to be called four bins.

And this is what we mentioned about the hanning window.

And then also we talked about the side lobe level, the highest side lobe level.

And here again we can put the cursor at highest side lobe level and

it tells me kind of the value that this has.

And it's around minus 31 decibels which is the kind of thing that we mention.

Okay so now we can keep changing the window and

for example we can put instead of the hamming, instead of the hanning we can put

the hamming and compute the same script.

And okay that's a different window and

if we can measure the main lobe width we see that it also has four samples,

but now the side lobe level is much lower.

So the highest side lobe is around minus 42 decibels,

which is the kind of things we mentioned in the theory class, okay?

And if we go to another window, for example we go to the Blackman window,

Blackman window and we save it and run it.

Okay well, yes that's what we saw in the theory class and

now the main lobe is wider.

It's around six bins and

the side lobe level is much lower around 58 decibels.

And then finally the last window that we also talked about,

this was the Blackman-Harris window.

Blackman-Harris window that we can compute.

And if we run it, okay.

So now, in fact we are not seeing the side lobes and this is because

the range that we are specifying doesn't even reach where the side lobe is.

So let's change the display.

And let's change the axis, instead of having minus 80.

Let's put at least minus 100 so

that when we show it, now we are seeing the side lobes.

In fact the highest side lobe is around minus 92 decibels.

And now the main lobe is quite wider, is around eight bins.

Okay so this is a good way to visualize and try to understand the windows.

And so please feel free to play around with that.

Now I want to do it but with a sinusoid,

so to analyze a sinusoid that has a window.

And this is another script.

This is much shorter, because instead of calling the FFT and

worrying about all this centering around zero.

And worrying about the zero parting etc., I call directly the dftAnal

function that we have in the SMS tools directory.

So now what I do is I specify the directory of

the models where I have all the models of the SMS tools and

I import the dftModel file, okay?

So that I can call this dftAnal function that receives as input signal,

the window, and the FFT size and automatically does all

the operations that we just showed in the previous script.

Okay, so in this script basically what I do is I get

sine wave with a given frequency.

In this case, a frequency is 5,000 Hertz.

Of course a sampling rate of 44,100 and

I compute 101 samples of a sinusoid which are basically

going to be the same length of the window size I am using.

For example, in this case I am using the hanning window, but

maybe let's change it and let's use, for

example the hamming window.

Okay, and now we compute the analysis.

And here, I also display in a way the output so

that I centered everything on top about the hertz.

So we're going to display only the positive part,

because the dftAnal only computes at the positive part of the spectrum.

Then I will be displaying it, showing it in hertz.

So let's execute this file, test1.

Okay, and this is the sinusoid of what I have analyzed.

And this is the shape of the window, in fact.

So this proves what we talked about in theory.

That when we analyze a sine wave, and we multiplied by a given window.

In fact, what we've seen in the spectrum, is the transfer of the window.

Centered at the frequency of the sinusoid, okay?

5,000 hertz and with the amplitude of the sinusoid.

The amplitude in this case was normalized and is not here an important thing.

But we would also see the amplitude of the sinusoid.

And of course we see the standard characteristics of the window and

here the x axis is in hertz.

So we need to understand the relationship between

frequency in hertz and all these other values, the beans that we talked about.

And of course, if we change the window and

we compute the like the one we mentioned,

the Blackman-Harris, okay so

now we do this computation, okay and now we are seeing.

Again the Blackman-Harris window, the magnitude spectrum but

centered at the frequency of the sinusoid.

Okay, so that's basically all I wanted to talk about in this lecture.

So we have been using some packages from Python and also of course,

we have been using the sms tools in order to get DFT analysis code from that.

And that's all, so we have been focusing on one aspect of the short-time

Fourier transform which is analysis window which is a fundamental element.

And unless we understand how windows work it's going to be very difficult to

understand how spectrograms and how the short-time Fourier transform and

other spectral analysis systems work.

So please make sure that you understand the concept of windowing and

how it affects when either by itself when we see

the spectrum or when we window a particular signal.

And therefore, so how we see the spectrum of

particular signal having been windowed in a certain way.

So thank you very much.

And I hope to see you in next program in class that we will basically put

it together with the whole code of the short-time Fourier Transform and

we will be able to understand the whole implementation of the STFT.

So see you then, bye bye.

Ознакомьтесь с нашим каталогом

Присоединяйтесь бесплатно и получайте персонализированные рекомендации, обновления и предложения.

Coursera делает лучшее в мире образование доступным каждому, предлагая онлайн-курсы от ведущих университетов и организаций.

© Coursera Inc., 2018 Все права защищены.

Загрузить из App Store

Загрузить в Google Play