« first day (2118 days earlier)      last day (1103 days later) » 

4:21 PM
@flawr MyGrad v2.0 is out mygrad.readthedocs.io/en/latest. Apparently a lightweight numpy-friendly autograd library. You might find it interesting.
I find it surprising that f.backward() sets the gradients on the independent variables but I'm sure that's a general autograd thing.
I wonder how useful/efficient it would be to use this numpy-friendly autograd in jacobians for scipy optimize routines
 
 
3 hours later…
7:27 PM
huh I wasn't aware of this
do you know jax? (github.com/google/jax)
 
I don't do anything autograd or similar
I just knew you did
I've seen jax mentioned once or twice on the mailing list
 
it's basically the successor of HIPS
I haven't really used it much
 
*sage nodding*
You need not tell me more about this HIPS because I absolutely know what it is.
 
well, it's the predecessor of jax:P
 
You see? I knew it!
 
7:33 PM
hehe
you are wise you must know everything
 
Unfortunately I don't know the known unknowns nor the unknown unknowns
 
Then the best thing is training a neural network I think.
In the cloud with kubernetes and agile blockchain development.
 
using a quantum architecture
 
ah yes, of course
@AndrasDeak I don't know how well known it is, but for most autograd engines (those who use backward-mode-differnetiation) the time complexity of evaluating a gradient (in a certain point) is two times that of evaluating the function. (or the same as evaluating the function, if you have already evaluated it)
you just need more memory than in a straightforward function-evaluation
so to compute a jacobian of a function that has an n-dimensional output, the complexity becomes n times that
 
Which... is better than doing a numerical approximation, right?
plus it's exact
@flawr I don't know how well-known it is either; I'm a layman
 
7:43 PM
@AndrasDeak for numerical differnetiation (the (f(x+h)-f(x))/h type) you need at least 2x the number of inputs of evaluations
@AndrasDeak exactly!
 
So what are you saying? That the complexity is non-trivial, and especially for array-valued functions the computational cost might be larger, but it's exact so anything else is silly. Right?
I bet the exactness of the jacobian can/will lead to fewer optimization steps (although probaby not n times if you need n times more evaluations for the exact jacobian)
 
@AndrasDeak In backward-mode differentiation for a scalar-valued functinon the gradient has the same time complexity as the evaluation, for an array(of dimension n)-valued function the time complexity is just n times the evaluation of the function
wtih numerical differentiation the compelxity is dependent on the input size (the number of values that you want the gradient for)
and usually you have a lot more inputs than outputs in most practical problems. (if you have a lot more outputs than inputs then you should really reconsider your optimization problem:)
 
autograd is rarely worse than numerical differentiation, but numerical differentition is a quite frequently a lot worse than autograd
better now?
 
YES! thanks
 
7:53 PM
and with many autograd engines you can actually also build a computation graph for the derivative/s, if you have enough ram:)
 
mygrad does things with graphs, I saw that in their docs. Might have even been computation graphs.
there was something about them being reset when you use the variable in a new expression
 
yep the computation graph is what you need for normal backward-mode-autograd
the example is nice
w = mg.tensor(10.0)
learning_rate = 0.3
num_steps = 10
print(w)

for step_cnt in range(num_steps):
    ℒ = w ** 2    # compute L(w) (this also "nulls" any derivatives")
    ℒ.backward()  # compute derivative of L

    # Update w via gradient-step..
    # We do an augmented update on the underlying numpy-array
    # stored by `w`
    w.data -= learning_rate * w.grad
    print(w)
:D
 
unicode identifiers are a sin
 
I just looke through the docs, and it looks quite nice. And it seems to be really lightweight.
But if the lightweightness is not an issues I'd still use pytorch over mygrad - it interfaces with numpy quite well too, and it is basicaly the "numpy done right"
and in pytorch you can even autograd through an SVD if you want:)
and unlike numpy, all functions are available as members of the array("tensor") class
 
8:10 PM
Hey guys, new to MATLAB and trying to get a little help combining two data sets into a single graph, can anyone help me oput?+
 
8:22 PM
maybe?
 
I have a graph with covid deaths for the year and non covid deaths for the year, I need to find the date with the most combined deaths for the year.
 
I bet the data don't share an x axis
 
They do, it's all based on "deaths per week" for a 66 week period.
 
is the fact that it is about covid or deaths relevant for your question?
 
No, just the variable that were presented in the problem,
Could be birds born per week...
 
8:42 PM
so I recommend describing it without anything that is not relevant to the problem
makes it easier to help
 
Also freaks out fewer people
 
8:58 PM
Sounds good, thank you for the advice.
 
9:53 PM
@Mtnglf based on what you have said you merely have to sum the two arrays and take their argmax
 
 
2 hours later…
11:33 PM
in Python, 10 secs ago, by Andras Deak
SO trying to follow up on their promise to tackle outdated content https://meta.stackoverflow.com/questions/406675/outdated-answers-results-from-use-case-survey
 

« first day (2118 days earlier)      last day (1103 days later) »