« first day (141 days earlier)      last day (3088 days later) » 

8:00 PM
0
Q: Create and store a large array in Matlab

Oliver AmundsenI need to store and output a large array from a script. When I just try initialize it as: A = zeros(3000,1000,11000); I get the: ??? Error using ==> zeros Out of memory. Type HELP MEMORY for your options. Any ideas please? Thanks!

Another stupid question
Will the majority of your matrix be zero? Use sparse in that case. BTW, you are trying to represent a 3000 x 1000 x 11000 x 64 bits = 2.112 x 10^12 bits = 2112 TB full matrix on your computer. No commercial computer in the world can create what you want. — rayryeng 2 mins ago
 
You're definitely with one
 
@excaza It just reminded me of the old joke... "Doctor, it hurts when I do this..." "Then stop doing that!"
 
@beaker I heard that one on Star Trek TNG. It was already lame in the eighties:D
 
@AndrasDeak That one was lame before the first time it was told. ;)
 
@rayryeng 2 PB, not bad
 
8:02 PM
@rayryeng lmao
His response...
"Oh I can't do it?" "Well I just wanted to do it, so it's optimized"
 
lmao
 
Tell him "You'll math him the fuck up"
 
HAHAHAHA
 
@rayryeng The OP just needs to Download More Ram.
 
@TroyHaskin You can DO THAT? :-o
 
8:10 PM
"I can play Grand Theft Auto 7 at 120 FPS ultra 4K totally smoothly , thank you so much for this usefull stuff!
-intel core i9 4.80Ghz
-Titan XL 4 way sli
-120GB RAM"
 
It actually works
I totally downloaded 128 GB of RAM and it's working
 
:D
thank goodness I have broadband
it would take forever to download over a dial-up connection
 
8:25 PM
@AndrasDeak You can download highspeed internet too
 
yeah sparse won't work either for this OP lol
he said only perhaps 20-30% is all zeroes.
 
yeah, it'd have to be 99.2-99.3% zeros
 
haha for sure
99.3% being zeroes of 2112 TB is about 14.78 TB of non-zero memory
 
LOL
 
that's manageable in a commercial grade cluster setting per se.
yeah I think the OP has to go back to the drawing board. lol
 
8:29 PM
I think he realized that
 
OK, I'll abandon the idea of storing the array then. Thanks! — Oliver Amundsen 3 mins ago
 
hahahhaha
 
Seriously?
They can do the thing without storing that ridiculous matrix ... WHY WOULD YOU WANT TO STORE IT THEN?
 
@TroyHaskin Because then they can just display it to the screen all at once!
;)
 
lmao
Just tell him to use eval. It'll work.
Just like downloading RAM for free.
 
8:31 PM
It does does now and operates on individual 3000x1000 arrays. But I needed to output the whole thing. Maybe, as you say, it's impossible. — Oliver Amundsen 26 mins ago
 
I missed that part.
so the OP has 11000 individual 3000 x 1000 arrays?... on disk?
 
@beaker Wow ... just ... I'm done.
 
LOL
 
ok, I'm gonna stop before I get frustrated
 
@rayryeng it's populated in a for loop
i guess the data is generated
 
8:33 PM
What the hell is with the slew of XY problems today?
 
because all of the ones from yesterday are off RTFMing
 
lmao
 
somebody had to fill the void
okay, maybe he was planning on storing all 11000 arrays to a file or something... that might make some sense
 
That's possible, but it will require a lot of I/O.
The OP would have to find the right file corresponding to the right slice and edit the right entry in the text file that corresponds to the location in the matrix.
 
Why do you try to limit me!!! dreamyhopes.files.wordpress.com/2015/04/…
 
8:38 PM
If this is what they want, it's possible but slow
lmao
He has a sense of humour. I'll give him that.
!!!!!!
GET MOAR RAM
 
oh man... i'm afraid to click on that ;)
 
IT WORKS
0
Q: Create and store a large array in Matlab

Oliver AmundsenI need to store and output a large array from a script. When I just try initialize it as: A = zeros(3000,1000,11000); I get the: ??? Error using ==> zeros Out of memory. Type HELP MEMORY for your options. Any ideas please? Thanks!

Vote to close the large memory question. It's useless as it is.
 
done
up to 9.7K in the close queue :(
 
lmfao
 
@Ballbreaker DID YOU GET MOAR RAM?
it r0x0rs my s0x0rs!
 
8:51 PM
My client emails us : "Hey so how much work would it be to put your custom software on our mobile phones if we're connected to the local network"

me in my head : ....omg lol so much

My boss: "What kind of mobile?"
Client: "Blackberries" lmfao
I actually died
 
uh.. NO
Blackberry development is another beast.... say FUCKING NO lol
 
At least the new ones have android supported, but still lmao
My boss: "Android yes, IOS maybe, Blackberry no"
 
:D
We don't support Blackberry at all with our platforms
... and people have asked many times.
"Do you guys support Blackberry"?
Ray: No
"Why not?"
Ray: Just.... no.
 
What if someone sideloaded with Android? Would it sorta work
Or would you not care if people do it, you just wouldn't "support" it?
 
it would sort of work
we don't provide support for it though
 
9:03 PM
yeah figured
I'm looking forward to the client response for this
OMg hahahhaahhahahaa
"Yeah we were going to upgrade to the Priv soon anyways I think :)"
Jesus, those phones are so expensive
 
9:20 PM
hahaha Priv?
shit
 
hahaha yeah
I aaalllmooostt want to include this line in my profile description
"Please email all complaints to my personal HR department, so they may file it away under the category of "Nobody gives a ****"
Might be a little aggressive though
 
9:49 PM
@beaker :-D I've been meaning to publish the compiler this week, but I've been too busy with a paper. A reviewer wants "minor changes", and says the paper length should be reduced by half! Strange concept of "minor" :-) I expect to finish that this weekend (the deadeline is Thursday).
So within I few days I will have time to finish a couple of things with the compiler and publish it. It will be a preliminary, but rather usable version. I'm making some small changes with respect to the document Ray linked. I'll also publish the updated document with an indication of what those changes are. I intend to use this Esolang page for that: esolangs.org/wiki/MATL. I'll let you know here
 
@LuisMendo Cool, I look forward to trying it out!
@LuisMendo I guess "minor" means you don't have to re-generate all of your data ;)
 
@beaker Yeah... they are minor in the usual paper journal sense... But reducing length that much is painful. I know I'm verbose on papers, I tend to explain every detail. But once you've written it, every sentence seems indispensable :-) Anyway I'm targeting at a 30-35% length reduction. I hope that will be enough
@beaker Nice Hitchhiker's quote BTW :-D
 
:D
I have no idea what a 2d neural network would be... stackoverflow.com/questions/33814976/…
 
The OP is misreading the 2D NN link that he/she posted
it's a neural network designed to work with images. That doesn't mean it's a 2D NN
 
okay, so they're just limiting which connections are made to the hidden layer based on 2d localization on the input layer... i wonder if it's worth the bother
 
10:03 PM
it is probably still a standard NN configuration, but the inputs and neuron weights are probably tailored towards image data.
 
no, i think they're actively researching a different type of NN, not just using 2d input
 
oh is that it?
 
@beaker MATL: it3L)w4L)hD. 11 bytes :-) Pity we can't use it yet
 
oh never mind I see it
 
i dunno, if they're just starting maybe they are confused ;)
 
10:04 PM
Take in an input... duplicate the last three elements in the stack....
 
@LuisMendo okay, I gotta go parse that out now ;)
 
yeah I haven't read the standard in a while lol
I have to look at the cheat sheet
 
@beaker No need :-)
i      % input
t      % duplicate
3      % number literal
L      % paste from multi-level clipboard L
)      % reference () indexing
w      % swap elements in stack
4      % number literal
L      % paste from multi-level clipboard L
)      % reference () indexing
h      % horizontal concatenation
D      % display
 
ahhaha there we go
is this a code golf challenge?
 
yes
 
10:05 PM
Levels 3 and 4 of clipboard L are predefined with [1 2 0] and [2 2 0]
 
aha! that's what i was missing :D
 
@LuisMendo There was a challenge to display the France flag on your screen.
Does MATL currently support visualization of data?
or saving data?
they said you can display, or use STDOUT to save the image
 
@rayryeng Hm... We need to add ìmage! :-) I mentioned that in my previous message to you
Currently only plot
 
oh yeah I forgot lol. Sorry I haven't gotten to the email yet
yeah image is probably a good thing to use.
 
No worries! I've been busy too
 
10:07 PM
@LuisMendo I will answer very soon my friend :)
I've been working on my job application
To York University. I'm on the research statement... the last part of the application
 
@rayryeng The one for a University position?
 
I've done the cover letter, teaching statement... updated my CV
 
Oh, yes, that one
 
yes!
 
That would be great! I love working in the university
 
10:08 PM
I haven't started the research statement yet because it's the most difficult part of the application
I'm sure you do :D. It's the reason why I pursued my PhD.
There were no job openings when I graduated, so I went into industry. I also didn't appreciate the politics where I went to school.
so going somewhere else would be nice.
 
What's a research statement? A resume of research you've done, published papers etc?
 
It's an exposition of what research you have performed to showcase your skills and what research you intend to perform in the future should you be hired
why that research is useful.
why that research would be important to the university you are applying to
what exactly you need, and what you are going to do in order for the research to be carried out.
 
I see. That's hard to write. You want to do it right
 
For sure. I've looked at a lot of samples, and they're all quite different.
I wanted to look through a bunch and try and establish common ground, but I haven't found any that were in common with each other.
 
The most important rule: do it in LaTeX!
:-)
 
10:11 PM
oh I did :D
Everything has been done in LaTeX.
 
Grrreat. That gets you halfway there
:-D
 
Here's my CV if you'd like to have a look. I found an Academic LaTeX CV template online
 
Wow! the formatting is impressive
Those timelines at the left
 
I know :D. Not my doing lol.
It was the template.
Here's where I found it if you're curious
 
I would suggest narrower lines. There's a rule that more than 66-70 chars per line are hard to read
 
10:12 PM
@LuisMendo For sure. It's a work in progress.
Any comments from you of course are appreciated :)
 
You have a lot of publications, specially for someone who doesn't work in academia (yet?). In Spain, at least, it's not very common to publish stuff unless you have or pursue and academic job
 
@LuisMendo oh :)
 
You linked StackOverflow :-)
 
It's more conference than journal unfortunately.
Journal publications are more important.
@LuisMendo Yes I did :D.
but thank you :) I do hope that tips the odds in my favour.
I also did not officially become a postdoctoral fellow, but the research grant I received from the government basically is a PDF but in industry.
So it might as well be a PDF.
 
@rayryeng Yeah... that's why I focus on journals (I'm currently working on a paper for IEEE Antennas and Propagation Magazine). But it takes away the fun of travelling
 
10:16 PM
oh :D
for sure. I wanted to focus on getting my method out there for people to know about. Journals take a long time to publish and that can hinder your ability to get the method known
 
@rayryeng A reasearch grant is usually appreciated. The selection process is hard
 
I also didn't have enough at the time to publish a journal. It was only after I graduated was I able to put something out there.
Sorry @Divakar hi!
 
I just some motivation to do some golfing, some day maybe :)
 
:D:D DO IT
 
Go ahead! Ander is already there!! @Divakar
 
10:18 PM
But all that wiki, manual, everything looks kool!
 
@LuisMendo thanks :) I hope the committee sees that
 
And soon there'll be MATL!
@rayryeng I'm sure they will!
 
It's Luis's python thing, I am just delaying it :)
 
@Divakar Hahaha. That's not fair!
 
Ander is where?
:P
 
10:19 PM
In Code golf.
I saw an answer by him just today
 
yeah he had an easy question lol
 
4
A: Separate a list into even-indexed and odd-indexed parts

Ander BiguriMATLAB, 26 @(x)[x(1:2:end) x(2:2:end)] similar to the python one.

 
it was code to place the even positions of an array appearing first, then the odd after.
 
It's just that, I got too many addictions and golfing .. might be another one, thats what I am afraid about TBH :)
 
well, it's a great way to start
 
10:20 PM
@Divakar You fear is justified, I think :-)
 
I know!!
 
@LuisMendo And you're just feeding that by making us more competitive ;)
 
making us more nerds!
 
The main reason that I don't golf more is that I get tired of working up a beautiful 80-byte answer only to see a CJam answer that's 5 bytes
 
or nerdy* I guess
 
10:21 PM
Which is why we gotta get MATL off the ground soon.
I guarantee that there are solutions with smaller byte counts in MATL compared to the other leading golfing languages.
 
Hmm... we all were a little nerds to begin with :-)
 
We have the power of broadcasting and vectorization!
 
And accumarraying!
 
to begin with.. like as newborns? nahh!
 
Those are two of Divakar's favourite words!
 
10:22 PM
na, mine are DIE LOOPS
 
lmao
OH... speaking of that...
 
No. It's KILL LOOPS. Which sounds more aggressive
 
Maybe we should have an easter egg in MATL
one of the layers of the clipboard contents has the string 'KILL LOOPS'
 
There is :-D
Hahaha
Well, not that one
 
:( lol
 
10:23 PM
There's a why
 
bsxfun in MATL evaluates to Divakar's avatar
 
LOL
 
@excaza :D
Just calling bsxfun() by itself should draw Divakar's avatar in MATLAB. I agree.
 
or a QR code for his profile
 
:D
 
10:24 PM
DIE LOOPS is like you are cursing loops, much more graphic sorta ;)
 
oh! @LuisMendo, in the document you were looking for alternative values for the default clipboard contents...
how useful would it be to have 255?
 
@beaker But I think that's ont of the thinggs I changed...
 
for images, very useful.
 
or do you have a maxint?
 
but srsly, how far has this MATL gone, like when are we seeing it on ground?
 
10:25 PM
okay, i just thought of it doing the french flag thing
 
Hm... Okay, maybe 255 would be useful. But the clipboard levels 1--9 are already taken. And 10L takes up the same chars as 255
 
yup
 
@Divakar Hopefully in a few days I'll publish the compiler. Not finished but useable. And probably full of bugs :-D
 
@LuisMendo speaking of teaching, I've been invited to come back to my university to teach a 4th year course.
No one else is teaching it because they're either on sabbatical or those who can teach it have graduated.
 
@rayryeng I read something about taht in the chat! But I thought it was the Matlab talk part two
 
10:26 PM
haha I almost read that "bugs" as "drugs" instead ;)
 
That sounds great!
 
oh :)
 
full of drugs - MATL!
 
@LuisMendo The advanced part #2 MATLAB tutorial will be happening in early January
they want to wait until the new year.
 
@Divakar Hahaha. Well, in a way...
 
10:27 PM
yeahhh addiction way!
nice Ray!
and why lemons in the wiki page for MATL?
 
@Divakar It's Esolang default. No idea. But they look nice!
 
or is it like an esolangs thing?
ah yeah I see
 
@Divakar Maybe they're exploding lemons
nope, those are limes
 
in summer maybe ..
 
@rayryeng 4th year is probably the best. Students are more mature, and know more stuff. Or at least they are supposed to :-)
 
10:31 PM
matured for ....are we talking about students or lemons/limes?
 
Oranges :-P
More Spanish-like :-)
 
haaha I wouldn't know, though I would like to!
 
@LuisMendo yes I hope :D
 
Well, I gotta go. I have some pages to squeeze out of my paper...
 
The course is also available to graduate students too.
I'll be teaching Machine Learning.
 
10:34 PM
squeeze!
 
Luis wants to x(:) out of his paper.
 
Hahahaha
 
good luck @LuisMendo
 
oh nice, some paper! Luis good luck!
see you around!
 
naranjas?
 
10:35 PM
Thanks! @beaker @Divakar. It's about MIMO transmission with audio.
@beaker Bingo! :-)
Bye! See you all!
 
LuisMendo: "MIMO" -- beaker: "meep"
 
that's like french to me, but good luck Luis!
 
@AndrasDeak Multiple Input Multiple Output :)
just like SISO for single, SIMO and also MISO
 
i just realized i don't know how to say lime in spanish
that's surprising
 
eslimo
sorry:D
 
10:39 PM
lmao
 
I know the proper word is "inuit"
 
Inuit?
Like the Indigenous Canadian Peoples?
 
yup
 
OK then lol
 
:D
not very convincing
I was trying to be punny. I always fail when I do that
If only @Ballbreaker was here...
 
10:40 PM
@AndrasDeak Stalk searchsorted, einsum, those are the killers, like literally.
 
I still don't understand einsum.
I've looked at the examples, but the notation doesn't make any sense to me
 
LOL
 
Ray, context is Andras is looking for NumPy stuffs, so I am giving him some suggestions.
 
@Divakar for sure :) but I'd still like to know how numpy.einsum works lol
 
well more like stalking as he has put himself :)
 
10:42 PM
@Divakar einsum I already know and cherish, thanks:)
 
that's because the say limón in mexico :))
 
but then searchsorted might be the next target
 
@Divakar it also look like numpy.searchsorted basically performs binary search
it tells you where the element should be inserted to maintain order.
 
yeah that should be
 
@rayryeng it's almost straightforward to me
 
10:43 PM
that's great. I didn't know that existed. I always wrote my own.
 
but we get similar constructs in theoretical physics, so my cognitive processes might be primed to these things
 
@AndrasDeak that's probably it.
 
@Divakar actually I was looking at our OP's profile page to see when they were online
they owe me an accept:P
and I saw that they only have 2 questions, so I checked out the other one as well --> ran into you
 
which OP?
 
1
Q: Python Reshape 3d array into 2d

pallagoI want to reshape the numpy array as it is depicted, from 3D to 2D. Unfortunately, the order is not correct. A assume to have a numpy array (1024, 64, 100) and want to convert it to (1024*100, 64). Does anybody has an idea how to maintain the order? I have a sample data data[0,0,0]=1 data[0...

where I stalked you:P
 
10:46 PM
need to ping that bastard !
I even forgot that one
ah!
 
:)
I vectorized the shit out of his other question
I was pretty happy to outvectorize a numpy gold badger
 
@Divakar How does the transpose syntax work?
 
It might be beginner's luck...
 
That is something I never fully understood.
 
@rayryeng it's matlab's permute, isn't it?
 
10:48 PM
is it?
 
without letting you add singletons
 
seriously? never mind then.
 
at first glance, that's what it seemed to me
but I'm a n00b
 
exactly same as permute Ray!
yeah good shit!
that latest vectorization one by you was really good! @AndrasDeak
 
So it's permute without adding singleton dimensions. That's all I need
 
10:48 PM
@Divakar thanks!:)
 
exacto!
my net is lagging, so my sentences might be coming off in random order
exacto!
 
@Divakar "I know that feel"
it's effing frustrating to bounce off the error message 3 times in a row
 
What's annoying too is that because I type very fast, sometimes SO chat thinks I'm spamming
 
@rayryeng you rang...?
 
there are times where I have to wait EIGHT seconds before posting another message.
@Dev-iL I meant to ping Divakar, but pinged you instead :) lol. but hi though.
 
10:52 PM
Oh, sorry... Goodbye then ;)
 
:(
I DIDN'T SAY GO
WE NEED YOUR MATLAB BREAKING SKILLS
 
Well that dod moshe was what, Old Mcdonald? @Dev-iL :)
 
lol there's nothing else for me to do in the next half hour anyhow... I'm taking the train
Yeah... Like I said
 
like in the cartoon?
 
You should've asked the guy how his cow was doing :-P
 
10:54 PM
@Dev-iL :D isn't it late there?
 
@rayryeng 1 AM
 
Coming back from a wedding in a different city.. Its1am
 
ahhhh
 
so Andras, Luis and I are his nephews, to answer his question
 
very nice.
what's this Old McDonald stuff?
 
10:55 PM
@Divakar whose nephews?
and whose question?:D
You lost me
 
Ray - some guy whose nick is amusing to those of us that understand Hebrew
 
@Dev-iL =={Dev-iL};D
 
that pyramid matrix OP
 
Lol probably
 
@Divakar still not following
or I missed the exact meaning of dod moshe
Aaaah
I misread your post
2 mins ago, by Divakar
so Andras, Luis and I are his nephews, to answer his question
 
10:58 PM
@AndrasDeak but I find it interesting that by the nickname some people use you can deduce with a high probability some info about them.. Such as country of origin
 
as in "so (Andras, Luis and I) are his nephews"
 
his name is dod moshe, which in hebrew means some Old Mcdonald, so I guessing its like the Donald Duck. Now his question had three answers from Andras, I and Luis, so basically we are his nephews! Phew!
 
@Dev-iL well, sure, mostly you don't want to obfuscate your affiliations
@Divakar Aaaah, OK. But don't you mean Scrooge McDuck? I know Donald was a relative too, but I don't know the specifics...
 
c'mon, who would guess that i'm from sesame street?
 
@beaker I thought you came from a chemistry lab until you changed the gravatar:P
 

« first day (141 days earlier)      last day (3088 days later) »