« first day (298 days earlier)      last day (2923 days later) » 

7:12 AM
@Amro Found a good paper on how to apply L1 regularization to SGD: aclweb.org/anthology/P/P09/P09-1054.pdf. Will implement this in the engine.
 
 
6 hours later…
1:32 PM
hey guys!
what's up?
 
 
6 hours later…
7:18 PM
@rayryeng nice.
@rayryeng here is an old but good paper by LeCun et al: Efficient BackProp
it discusses practical issues when training neural networks
things like batch vs. stochastic learning, shuffling and normalization of inputs, output encoding, choice of activation functions, weights initialization, learning rates and momentum values, second-order optimization methods, etc..
 
 
2 hours later…
8:59 PM
@excaza No it did not! The question is the sufficient proof of that. While the documentation does in fact say that the actual name of the file needs to be a string, and that the names of the variables that need to be saved need to be strings, it did so in such a way that despite reading through it for at lest 5 times, I missed it. This is, in my opinion, a combination of badly written error message and not so nicely written documentation. The fact that I'm missing the ticks in variable name was not clear to me until I saw the answer here. — AndrejaKo 2 hours ago
oy vey
 

« first day (298 days earlier)      last day (2923 days later) »