« first day (2142 days earlier)      last day (1071 days later) » 

8:37 AM
@flawr yesterday I spent some time reading the maths about DIP
As an AI skeptic, and a reconstruction guy, I kinda love it
Machine learning? nah, but actually, the CNN structure itself is a good regularizer/prior, because it hates noise
crazy concept, I love it
I was confused by the "no training" part of DIP, but it makes sense, because its not really training/learning at all
 
absolutely! while we still barely understand any theoretical things about neural networks, through a ton on trial and error we managed to get some grasp of what kind of how we need to build them to work well for certain tasks.
@AnderBiguri when I experimented with it I realized that when it is "finished" changing the "input" (the fixed noise) usually has practially no effect on the output
or when you use a constant input (same colour everywhere) with some dot in the middle, the image "grows" from the inside out like some mold:)
depending on what kind of network you use obviously
 
yeah, in some sense that is the idea, right? you just have no input, you just train the NN to go and learn to produce the image you want on its own, it just happens to learn first what we thing of "natural image" rather than noise
its really weird, I will be playing with this a lo in the next months
 
hm I wonder what happens if you try to inpaint two pictures simultaneously (use one network, but two different noise-images as input, one for each picture)
What I also find interesting is that the introductino of convolutional layers enabled all the image stuff with neural networks, but since then there hasn't really been a successfull other type of fundamental block. what if there is some other kind of crazy operation that would work a lot better?
maybe we'll never know as all the results since are based on convolutions
 
I will be replicating one paper that uses a "static" image as input. So there are "dynamic PET" images that are taken on short adcquisitions over long time. This paper goes and uses all the data to create a high qualty PET image (but loses all dynamic information) and gives that as input to the DIP to denoise the low SNR dynamic PET images. They show that that is prefered to just adding noise
I heard something about binary networks, transformer networs and some other stuff
people are playing with other operations that are not conv
 
9:14 AM
haven't looked into transformers much, but that sounds interesting
are you gonna make a transformer-dip? :)
 
10:16 AM
I dont think so hehe
I really dont have much time in my main job to be playing with CNNs
binary networs are also interesting, they are about applying bitwise operations in each layer, instead of convolutions
 
 
2 hours later…
11:50 AM
@AnderBiguri I heard a talk from a guy who's working on th compression of neural network, and fromw hat I understood they could reduce the memory footprint by a lot, but only for deployed models. You still had to train them with floats, what they did was basically a post processing step that involved pruning/compressing the weights/structure.
 
@flawr thats a different thing I think. That is intel deploying some bit-wise precise compressed NN, which is also awesome
I think binary networs is literally training bitwise operators on input data, rather than convolutions. e.g. first layer may flip bit 3 and xor bit 7 of the input uint8
 
Oh now I understand, that's is interesting!
Do you have some reference where they did this?
 
let me dig that
reding the baics maybe I described it wrong, but its around that
 
thanks!
 
dude started his PhD in 2016 and has 2389 citations
 
12:32 PM
we need a canonical for this: stackoverflow.com/questions/67503170/…
 
12:59 PM
@AnderBiguri this poor guy just rediscovered the en.wikipedia.org/wiki/Pigeonhole_principle
 
hahahaha
 
@AnderBiguri can't find a good one, maybe we should make a self-answered one?
 
yeah I could not either. I agree we should make one
 
or we could answer this one and use it as a dupetarget for others, cause the example is not too complicated
 
I think better make a new one, simply because all of them have somehow particular examples, and it would make more sense to have an example reduced to the absurd, as I believe people learn from a noob example with a good answer better.
 
1:11 PM
hm ok
 
 
1 hour later…
2:18 PM
@AnderBiguri But people are still going to ask their question. Explaining why they get the error doesn’t help them. The error message is clear and obvious, if you don’t know what to do with it, then understanding the cause of the error doesn’t help. These people need to be told how to fix their code so it doesn’t produce an error. They’re idiots, they need it spelled out. They probably don’t understand any of the code that they post in the first place.
Do I sound jaded?
 
hahahaha
Yeah, true, but also we can dupehammer it and get along with our day
 
2:32 PM
That’s true. :)
 
 
5 hours later…
7:39 PM
@AnderBiguri isn't it in @AndrasDeak's list of canonicals on GitHub? Given that the literal error message as a title is only from Nov 2019, I guess we've (or roomba did) deleted all the previous version
 
Hm, I can't find one from the titles alone. Might need to write a proper Q/A ourselves in that case.
I know the common advice is to take an existing question, polish it as best we can and answer it, but that usually feels crap. The question is usually shit, answers just dump code. Might as well write your own proper Q/A
@flawr I like that in the cover picture description they need to explicitly state, within brackets, that the top left hole has two pigeons :P
stackoverflow.com/search?q=user%3A5211833+swiss+cheese Apparently I've made the Swiss cheese comparison a few times
 
8:46 PM
posted on May 12, 2021 by Cleve Moler

The Bucky Ball provides an elegant example of a graph, the connectivity of the Buckminster Fuller geodesic dome.We are also demonstrating publishing this blog with the Live Editor and running... read more >>

 
 
2 hours later…
10:47 PM
@Adriaan yeah, havent found it, which is a surprise
Mathworks staff opening issues in TIGRE, WTF: github.com/CERN/TIGRE/issues/297
 
that autograph just bumped up to £5
 
hahaha
dude has oppened like 20 issues in other repos, hes doing a bit of self promotion I think
 
want me to flag?
does indeed look a bit spammy... shame
 
nah, its good, I actually find his suggestion useful, albeit indeed it comes from a slight spammy attitude
I do actually need some CI and dude has decent tutorials on it, so more like an annoying banner on Google that actually happens to sell exactly what you need. I don't like the way, but OK, you got me.
 
yup
 
10:53 PM
however dude seems to be posting in many repos that have a .travis.yaml file, so I assume have proper running CI
 
There were some recent changes to github actions because some assholes were opening malicious PRs to mine bitcoin using the projects' CI allowance.
 
dang
 
I didn't post about that here because only you and Cris have projects I know about, and neither have github actions
the current status is that if a new contributor opens a PR, a maintainer has to enable CI for it each time
 
I was thinking of using that, and I use UCL/STIR and synerbi/sirf which are moving to Github Actions, so I will let them know.
 
Which is of course a huge pain in the ass for large projects, and people are trying to make github make something different. Like only do this when the PR touches the CI config (which is necessary to mine bitcoin).
a while back Travis CI severely cut back on open-source CI allowances, exactly because of such abuse
 
10:55 PM
so, basically they make a PR that needs to run CI, but the unit tests mine bitcoin? smart
 
@AnderBiguri normally every PR runs CI, the trick is that their PR changes CI so that it doesn't run the project, but it runs their miner instead
 
@AndrasDeak yeah STIR and SIRF are having serious issues with travis credits, which is why they were trying to move to actions I think
 
It would be enough to restrict new contributors who touch CI. Or maybe restrict everyone the first time they touch CI.
 
yeah, I get shout at some times when I make docs changes and forget to do [ci skip] :D
Interesting issue actually. Will bring this forward on the meetings just for them to be aware
 
@AnderBiguri from numpy/scipy mailing list discussions it seemed to me that legit open-source projects can beg for more credits and travis will grudgingly give more...
 
10:58 PM
@AndrasDeak yeah, we do this, but we need to do it super often
 
Travis' issue, as I understood, was people opening repos of their own that mines bitcoin directly. This github one is new, and it uses the allowance of legit projects.
@AnderBiguri this is the newest item docs.github.com/en/actions/managing-workflow-runs/…
 
Thanks! its actually a quite decent solution for now
 
Actually, that's the "how to enable CI for new contributors". This is the blog post github.blog/…
@AnderBiguri unless you're numpy or PHP
 
yeah fair, our stuff runs in much smaller user-bases
anyway, gotago to bed, tons of works to do tomorrow!
thanks for the tips!
 
night :)
 
11:15 PM
@AndrasDeak A simpler solution would be to only use the CI configuration in the branch that the PR is on, ignoring any changes to the configuration made by the PR.
The purpose of running CI on a PR is to verify that the code changes don’t break any test, and to verify test coverage doesn’t change, etc.
 
How would that work? The PR changes the branch.
and sometimes the configuration actually has to be changed
 
I think Travis does this, actually. You can always get the .yml file from the main repository, and overwrite whatever the PR has.
 
If you ignore bad actors than you absolutely want to keep the PR's changes to the config
 

« first day (2142 days earlier)      last day (1071 days later) »