last day (15 days later) » 

11:20 AM
3
A: KNeighborsRegressor as denoising algorithm

Maxwell RedactedIt is a supervised learning algorithm - that is the best answer, normally the algorithm is first trained with known data and it tries to interpret a function that best represents that data such that a new point can be produced for a previously unseen input. Put simply it will determine the point ...

 
What kind of noise is removed here?
 
I'd say High frequency, it is not really removing noise, but is really producing a representation of the original signal as the chap on kaggle says: learns to find the explainable variance and omit the incidental variance so it is removing incidental signals such as spikes but probably amplifies repeating low frequency signals - though I cannot say for certain without further investigation
 
I was asked whether I'm doing it globally or locally? What does it mean? What approach is presented in the article?
 
who asked? is this for an assignment?
 
it's one of my tasks, yes. I asked here to fully understand the topic
 
11:20 AM
fine, with all respect, I am not going to answer provide you with a complete answer, however, it is not difficult to figure out if you read that link I provided above and you try to understand how the KNN works
 
Hi, I red this article yesterday
I have chosen k=100 which means that the algorithm is calculating mean value between 100 nearest points to give me its prediction. And step by step the whole signal is finally estimated. What what exactly could mean doing it locally or globally?
Is it about weigts?
 
define what locally and globally mean
 
he ment, I think,globally as going through whole signal and its points.
 
11:39 AM
So this is something I am fuzzy on, my interpretation is that globally means the same operation is performed on all the points regardless of their position, whereas, a local operation is very much dependent on it's location and it's relation to other points
it is important you understand that the output of the RNN in this application is a representation of the original signal. It has Modeled the signal rather than filtered it
 
11:58 AM
yes, I understand it, however im still confused which this local/global differentiation
 
my interpretation
globally means the same operation is performed on all the points regardless of their position - if you subtract the same value from all points or apply a mapping function
local operation is very much dependent on it's location and it's relation to other points - such as rolling average
 
but KNN chooses some points nearby it and gives us approximated value, lets say from 10 points i receive 1 final value and on and on
 
yes but think critically
 
critically?
 
"KNN chooses some points nearby and gives us approximated value" which definition does this fit
 
12:08 PM
it fits locally of course...
 
Now that being said - as I have mention we are not using the KNN in a traditional sense, we are creating a function which represents the signal - a function which applied at every point regardless of it's location - so one could argue it is a global operation
 
can I make it local?
 
the answer simplest answer is that yes it is a local operation but it is a new way of processing the signal so it is really quite grey
 
how could I justify that it is local? He will bombard me with questions
 
"KNN chooses some points nearby and gives us approximated value" - that is the justification
the fact it is dependent on nearby points in my opinion makes it a local opperation
looking at the section on classification of the article i linked it gives a visual description of how the algorithm makes decisions
 
12:17 PM
yes I read it all, i think i will start a discussion on SO about it,cause he is unlikely to accept this solution without any justification
 
thank you for your time and help
 
No worries I hope it goes well, what is your field of study?
 
Its biomedical engineering with spec, Artificial intelligence
 
Then you are gonna want to understand KNNs and EMG signals
 

last day (15 days later) »