« first day (2711 days earlier)      last day (507 days later) » 

12:35 AM
Bring balance to The Force (by approving crankery; there's too little of it)
 
 
10 hours later…
10:14 AM
@CrisLuengo that sounds like 90% of todays ML papers
@CrisLuengo in that regard the ML field is in a very sorry state
@CrisLuengo Maybe I can help you with that: Let's say we have an array of shape (c1, h, w) (i.e. an image with c1 channels), then an 1x1 convolution is usually used as a transformation transforming (c1, h, w) -> (c2, h, w), so h w become "batch" dimensions
maybe what might be confusing is that in most deep learning libraries a "convolution" block does not just one convolution
so in classical terms if we talk about a 2d convolution, you have a kernel of size e.g. 3x3 and apply it to every channel of the image separately
but in the DL libraries a 3x3 convolutions refers to applying C different 3x3 kernels (one for each of the image channels) and summing them up
I think this is what might have confused you, if not please ignore!
(But feel free to ping me for stuff like this, I've mainly used pytorch a lot in the past few years, but I'm just as fed up about the misuse of terms and notation, and about the blind copying of shitty formulas the authors themselves don't even understand, but just add to make it look more serious.)
I hope it makes sense
 
10:45 AM
@AndrasDeak--СлаваУкраїні sorry, as usual I am always shit with terminology. In any case, yeah that was the solution, thanks a lot :)
@CrisLuengo I work in a maths department with maths people doing maths for deep learning. Their papers are solid as fuck, really good in the maths sense. Not everything is like that, albeit I will accept that the mayority may be
@CrisLuengo yes, in ML its (h,w,c)
they call the 3rd dimension of the data "channel"
I also have seen quite a lot of 1x1 convolutions, which is not incorrect, but perhaps obtuse
But unfortunately you should know that these terms are the norm in ML talk XD
same, feel free to ping me. I think @flawr has more experience than me, but I am all deep into the deep learning, as my group is basically 40% people doing maths for DL, 40% people doing applied DL, and 20% of poor souls doing weird maths shenanigans like optimal transport
 
@AnderBiguri 1% reconstructing pictures of bees
 
hahaha indeed, indeeed
 
@AnderBiguri I think he knows that. Question is what "channel-wise addition" as a binary op might mean.
 
fair
 
 
3 hours later…
1:57 PM
@flawr so it is c2 different weighted additions of the original c1 channels.
@AnderBiguri that part makes sense. I’m confused about the naming of literally everything else. :D
Why do they need a special symbol for plain old addition? Why do they need a separate symbol for this “channel-wise addition”, which adds two equally-sized arrays? In how many ways can you add two equally-sized arrays?
 
2:25 PM
@CrisLuengo yes I feel like that doesn't really make any sense other than maybe if we're talking about broadcasting
@CrisLuengo right
 
 
2 hours later…
4:03 PM
OK, sat down to read the remainder of the paper. I love how they put a whole paragraph explaining the F1 score, when the didn't even bother spelling out "ReLU", let alone tell me what the hell it is.
I bet that every single ML paper explains F1 score, and that everyone feels the need to explain it in their paper because they see it explained in every paper and so it must be necessary to do so.
 
4:39 PM
Cargo cult paper writing
 
This one is really LOL. “I want to do X” (that’s the whole post”. Comment: “thanks for sharing your plans, do you have an actual question?”. Replay: “ya, I want to do X”. stackoverflow.com/questions/74656158/…
 
Why don't you downvote crap like that?
Incentive: at -3 we can delvote it sooner :P
 
5:10 PM
I usually do. This one I didn't vote and didn't close-vote. I must have gotten distracted by something this morning when after leaving the comment. It happens.
 
5:30 PM
@CrisLuengo an interesting paper, I bet!
 
6:05 PM
@AndrasDeak--СлаваУкраїні I have a child. :)
 

« first day (2711 days earlier)      last day (507 days later) »