« first day (2115 days earlier)      last day (2824 days later) » 
00:00 - 20:0020:00 - 00:00

12:17 AM
if people are finding as many examples of plagarism as I am and only Shog9 is dealing with it - I almost feel sorry for him
 
=/ That's tedious
 
I'm starting to look at pandas now....at this point I'm thinking of writing a script to web-scrape and search each topic's first line or two. It's really that blatant
 
@JGreenwell hmmm interesting. Check this out. I was thinking that ngrams would help here. Something that you can do in pandas: stackoverflow.com/questions/36572221/…
 
CountVectorizer calculates ngrams
as part of the method - as I recall
Though the OP is missing an opportunity by splitting the data on the period (stop-point) to determine associated words and build some context
granted that assuming the dataset is larger and its not just homework
...or were you asking how you would calculate ngrams with just pandas?
 
12:41 AM
Yeah. I realize that what I posted does not find ngrams....I was more looking to see if pandas had something that find all ngrams
I don't know anything about pandas. I would ahve to go through docs as well
 
in pandas you would use apply(pd.Series).stack() and maybe .value_counts() or use Counter
yeah, add value_counts
typically I use scikit-learn or nltk to find ngrams because I'm already loading them for other reasons (if you have to deal with the overhead - might as well make it work)
 
so the main idea is that you would find ngrams of a SOD post, then you would crawl, generate ngrams of other pages and compare for similarities?
or maybe not even get ngrams of other pages
but use the ngrams to just find patterns in text
 
oh, yeah. For this I literally meant I was just going to scrape and then search through google api for exact matches and then output the ones that do
at this point that would give enough work that I wouldn't need to go deeper.........though that is an interesting idea for a project
argh! I have Master's dissertation due next month and final project (plus teaching) - I promised myself "no more projects" :)
 
and your brain is naturally looking for distractions
so this one is real juicy
 
well, problem with n-grams for programming code is the non-plagiarism use of common concepts and words (like GIGO) so would have to expand to n-grams of groups of words
also would have to exclude common, known (i.e. don't need cited) algorithms - though this is worse with math (y = mx+b)
grr...idjaw
get out of my head with this
;)
 
12:55 AM
everything can be explained with sponge bob
I'm actually trying to find something to occupy my time dev-wise.
 
beware nltk it will temp you with easy statistical correlations using n-grams and bag-of-words - 'til you find yourself having hushed conversations about context, grammar, productions, symbols - and eventually derivative trees shudder
then comes ambiguity statements in context-free environments (and how to increase the understanding of these types of text).....at that point you realize NLP stuck its hooks in you and there is no escape
 
 
1 hour later…
2:34 AM
Hi, all, I'm trying to build CPython extension module written in C++ on Windows (Visual Studio 2015 C/C++ Compiler) so that I can load it with the "python_d" interpreter because I need to debug the module. I think I might accidentally be asking an XY Problem so I'll also add that the extension module (pyodbc) is not a Visual Studio project but I still want to step through the code in a particular file. Can that be done?
 
3:32 AM
You could use pypyodbc, which is a pure python replacement for pyodbc
FWIW
 
4:03 AM
In PyCharm, how do I direct the interpreter to my requirements.txt so I don't have to manually add all the packages?
 
Right, did that
not sure what is supposed to happen, but the package list is still empty
restarted pycharm as well
 
is it working with pip?
 
yeah
it's an existing project that runs fine on its own
 
They had a bug about that, let me see if it is still up/got fixed
 
4:14 AM
saw a pop up just now, a notification line about missing dependencies
it's installing now, I assume it was it
not sure what triggered it
 
 
2 hours later…
6:18 AM
I keep forgetting that I have a dupe hammer.
I think this was reasonable, but since it's my answer, it'd be good if someone took a look and made sure I'm not biased:
2
Q: What are "cell variables" in Python?

sun qingyaoI've heard the term "cell variable" for many places(e.g. when people talking about the super() magic of Python and closure), but I can't find its definition on this site or in the documentation. So, I think this question is necessary: What's a "cell variable"?

 
Looks good to me
 
6:51 AM
@ZeroPiraeus I can close and reopen :D
*reopen and close
in this order :D
@ZeroPiraeus though, I guess you could also add details about super() there
 
Well, I think I called it right ... was just a little surprised at my unilateral success, having forgotten about the hammer.
 
Sundaycbg
 
Wotcha :-)
 
For sale: One early rising child. In fact no, free to a mildly indifferent or better home.
 
How is it with a mop? I could use a cleaner ...
 
6:55 AM
Heh. I think he's probably a net generator of mess.
Comes bundled with a bunch of lego though, so y'know...
 
That is a plus.
 
How would he fair as a chimney sweep?
 
How terribly victorian of you. :D
I swear, all I want is to get to sleep in till like maybe half 8 on a Sunday.
 
To be fair I woke up at 0630 naturally.
 
I'm pretty sure you could have been here by 7 to take over... :P
 
7:05 AM
Sunday trains are a swine. Plus I'm not sure you can afford my consulting fees.
 
Mm, fair point. I suspect you're probably an order of magnitude more expensive than our normal childcare. On the plus side, 4 year old data scientist as a result? Score.
 
How much does childcare go for nowadays?
 
I'm having a think about a project I'm tinkering with - it's to replace a (completely horrible, massive) spreadsheet. There's comparatively few data input sheets, the rest of it is number crunching + data output/analysis/scenario modelling. So in terms of structur, thinking of: regular database entry from webforms for the 'front end' -> postgres -> use django-pandas or similar to pull out dataframes to replicate the pivot table functionality - sound terrible or kind of reasonable?
Eh, our childminder is I think £45/day per child (she usually has 4 in), the nursery he goes to 2 days a week is about £80/day, but you get a day and a half/week subsidised by the local authority.
When he goes to school in Sept we'll get about £750/month back...
 
Ah really, I thought it was more expensive than that.
 
Our childminder is super inexpensive, despite being wonderful. I'd hazard the median around here (Z2 london) is about £60/day.
There's a private nursery up the road that's £9k a term (3 terms a year)
Most of the kids in his class at school went there. :)
 
7:15 AM
Yeah I know of places like that back at home.
 
On my pandas thing - other option is to take the data straight from the form into pandas, but then I have to handle persistence, so probably pickling it or similar, seems a bit clunkier?
 
I think pickling anything for production persistence is a bad idea.
 
Yeah, that was part of my thinking. Plus having it in a pickled dataframe doesn't lend itself to subsequently changing the numbers in the same way, idt.
 
Do you need to do your pivot table analysis on demand (i.e. for each form) or as part of batch of multiple forms?
 
Batch - usually with the outputs from several input forms together (as an example, you might be entering costs for a bunch of items in one page, global discounting rates in another, risk profiles in another, yearly spend profiles in another, and then looking at a combination of all of those in the visualisation.)
 
7:21 AM
Ah but it'll be a per user batch, it won't be like "Run this once every 24 hours"
It'll be "Run this once a single user has done the needful, possibly on multiple forms"
If you're persisting to db and then reading back out, would it be better to just use message queues?
 
Yep - so probably once they've completed a series of forms.
Oh, interesting, yes actually - completed set X of forms, calculate the scenarios for X now, store job result.
 
 
1 hour later…
9:20 AM
Morning run status: successfully accomplished - took the small one out on his bike while I ran alongside. #multitasking
 
 
2 hours later…
11:15 AM
cbg
 
ahoy hoy
 
user559633
11:36 AM
cbg
 
Is it Sunday stream day today? :)
 
user559633
It is! My chroma key setup is all wonky -- I wish I bought some wood and painted it green instead of getting a muslin backdrop. The DIY lighting I whipped up (LED bench lamp + homemade flat filter) is less than ideal when the sky is very gray or it's late night.
 
\o/
Well - it's still the most pro-setup any of us have :)
 
user559633
One of my audio engineering buddies watched the FTL stream and told me about a few audio issues that I really need to fix, so if I have time, I'll address those before the stream too.
 
Cabbage. Is the link in my comment close enough to be a dupe target? stackoverflow.com/questions/38683610/…
 
11:52 AM
Are you FTLing again?
 
user559633
I'm going to try a stream of "The Long Dark." I haven't played it in months, so it will be interesting to see changes and I'm hoping the exploration will be a good time for others.
 
If you get No Mans Sky you should stream that.
If you don't get it, then I'll judge you mightily.
 
user559633
Is it out and/or in Beta?
 
13th August is release.
 
but, it's in the main documentation :( ... I just don't get it
http://stackoverflow.com/documentation/python/topic-requests/4932
 
user559633
11:57 AM
@Ffisegydd Oh, then sure, I'll stream that.
 
user559633
I bet it will be a solid 3/7.
 
happy morning all
 
user559633
Morning
 
user559633
The heat broke, which means my chubby cat is a heat seeking missile of meows and nudges. (Sorry, this isn't very MTFL)
 
12:00 PM
APPROVED
 
user559633
OMG THANKS
 
SO WELCOME
 
user559633
OMG BUT STILL THANKS
 
HUGS
 
user559633
OMG THANKS BUT LET'S JUST BE FRIENDS
 
12:02 PM
it's fine...it's cool. OK. Sure. f-f-f-f-frieeendzooooned
 
user559633
FRIENDZONED AT LEAST HAS 'FRIEND' IN IT
 
 
user559633
clueless is more
 
user559633
I like the documentation edit setup. 4 editors on an import + the output
 
user559633
choo choo rep train leaving the station
 
12:06 PM
 
user559633
My cat has a teddy bear that he carries around too! We call it "his baby" and he grabs it and cuddles with it when he gets lonely.
 
We've already deleted an "Easter Eggs" docs topic once.
Looks like it's time to delete it again!
Do people lose rep if their topic gets deleted?
 
let's find out. I can go edit one of those easter eggs
you can upvote it
delete it
and we see what magic happens
 
I requested the entire thing be deleted.
 
there we go
76
score
5
5 examples
12 contributors
my edit is best edit
 
user559633
haha i made one too
 
Why not delete the entire topic?
 
user559633
i want to be the fifth person on the rep train for a copy/paste of an import
 
Umm... think it's gone now
 
user559633
idjaaaaaaaaaaaaw! shakes fists at sky
 
12:13 PM
\o/
 
haha I got a notification for a conflicted edit
 
Ruin everyones fun forever!
Fucking idiots.
 
Umm.. that might have been the wrong button to click...
 
someone killed the easter egg choochoo train
 
I really hate Docs.
Python really does not need this crap.
All it is is just people replicating much better content from the official docs for rep.
Docs might be a really good idea for other languages, but it's just filling us up with copied/plagiarised crap.
</rant>
 
12:17 PM
How can I get some cheap rep from docs to push me over 500? :p
That seems to be the central use of docs.
 
user559633
can a moderator plz ban withnail repeatedly?
 
@tristan how much are you paying? :p
 
If you ban him twice, does that unban him?
 
user559633
if u get banned in SO do u get b& irl?
 
user559633
@JonClements i will let you win in worms
 
12:21 PM
Yo! Take the deal!
take it!
 
@tristan how can banning be real if SO isn't?
 
@tristan Yes... it's not well known, but SO has a secret team of mercenaries that if you receive a sufficient ban on SO, drive to your house and bundle you into a van and keep you hidden for the duration of your ban.
I hear they force your eyes open and play endless cute cat videos/slideshow pictures to help the rehabilitation process...
 
user559633
reality is just the universe's screensaver
 
user559633
> You've earned the "Documentation Pioneer" badge (Contributed 3+ substantive pieces of documentation in the first month of documentation).
 
user559633
 
12:30 PM
:D
 
12:56 PM
first time I've seen an answer the links to docs
0
A: Python - using list() and manipulating lists

DeepSpace[[0]] * len(s) doesn't do what you think it does, see this example: List multiplication and common references

and so it begins
 
1:08 PM
Wow... this going to take a while... putting Python related posts from the SO dump into ES
 
what's ES?
 
elastic search (or just elastic now)
 
oh. Awesome. I worked with ES a little while back.
I wonder if I still have the code lying around
oh cool I do! That was a fun project.
 
@JonClements is that ES code opensource?
 
1:19 PM
I think so...
 
user559633
what's the SO dump? docs?
 
@tristan Python posts...
 
As a follow-up to a UTF-8 question I answered the other day, I just wrote a function that decodes UTF-8 manually. :) stackoverflow.com/a/38653062/4014959 I guess it may be useful to people who want to get a deeper understanding of how UTF-8 works.
 
great answer @PM2Ring
 
1:35 PM
Thanks, idjaw! I must confess that writing it has increased my understanding of UTF-8. :)
 
and reading it increased mine :P
 
But I guess that's part of the fun of writing answers on SO. Not only do you educate others, you educate yourself.
 
1:56 PM
Anyone out there using Scrapy Cluster from http://scrapy-cluster.readthedocs.io/en/latest/index.html
it seems promising but i doubt it is release for production yet ?
 
2:33 PM
cbg
 
@Ffisegydd I had one I flagged because it was 100% copied docs and then the person just added a cite and thought it was okay....I'm seriously going to pull out my old TA notes to explain why that doesn't work
@tristan SO dumps? either NLP questions or C#
 
user559633
i was making a cheap, ugly joke :/
 
Gah! I've run out of things to say to this guy: stackoverflow.com/questions/38684721/…
 
Well, he's a delight
 
user559633
2:51 PM
Oh fun, it's a "i have an answer or explanation in mind, don't you dare try to teach me anything"
 
I'd usually say go to chat but with someone like that: Cut the Cord
now for good news: Pointed one of my students - teaching himself Python atm, on that early "I want to do everything but am starting to realize I need to focus on one subject" point and leaning towards CS or developer paths - toward SOPython. Well, and the actual docs plus gave him a book
 
user559633
voted to close as unclear as he obviously just wants to be correct
 
@idjaw dupe
 
@JGreenwell Yeah. I accidentally clicked on the "Continue in Chat" but immediately bailed out. But in that Chat he mysteriously said:
in Discussion between PM 2Ring and Έρικ Κωνσταντόπουλος, 18 mins ago, by Έρικ Κωνσταντόπουλος
@PM2Ring They will be, because the global namespace definition does not exist.
But I'm not going to reply any more, there's no point.
 
user559633
"i think that the memory is freed" was my sign to "just not"
 
3:00 PM
He got annoyed, at first, when he found out our recommended reading list is not a list of programming books. Which allowed me to laugh and say "oh, there is an SO Question about that, that's really just a map of how Python programmers brains work through literature" as an opener to talking about Python philosophy, methodology, and other such topics
kids got a good shot of becoming a solid developer (or data scientist, analyst, engineer, etc) from that I hope
 
wat
no H2G2 on the recommended reading, how can it be?
 
@PM2Ring wait, what?
 
@PM2Ring this made me do this:
 
yeah, it is missing some Douglas Adams
 
perhaps I should pull a prank and put Digital Fortress and Angels and Demons by Dan Brown on there.
 
3:06 PM
American Gods, hmm. Not read that, that might be some holiday reading...
 
it is good Withnail
I bought a copy of it at a library sale (love those)
 
I really ought to get around to adding some suggestions to that reading list...
 
@AnttiHaapala only if I can make a rant about all the things wrong in Digital Fortress (a one digit password for instance....that a "super computer" can't break)
 
@JGreenwell Dan Brown truly masters the technique of suspension of belief
 
also Pu239-U235 = 4 not 3 :P
I forget the plot, my wife wanted me to read it with her and has hence never again asked me to read anything with her, cause all I did was point out the errors
 
3:12 PM
lol.
but at least it is somewhat believable to someone who doesn't know tech...
A&D on the other hand...
 
@Withnail It's amazing.
 
A&D gets me in trouble so I don't discuss it much (people mistake it for theology and mistake me for someone who wants to argue Christian theology)
 
I actually enjoyed DVC and A+D just because I like religious history, whether it's true or not :P
Then again, I've not read it in 7-8 years, and I think if I did a re-read then I wouldn't enjoy it so much now.
 
though that may be just a US thing
 
I like Plutonium-238. Pity that it costs about $USD70,000 per kg, and is highly restricted. :)
 
3:20 PM
arguing about Christian theology is one of my favourites as well :d
 
BTW after one day with the new Dyson I can confirm that it's amazeballs.
 
lol
I guess that's good news for future FizzyWife
 
Pfft.
 
"You stay away from my Dyson, go watch TV or something"
 
We always had an agreement that I'd cook and she'd do the dishes. Now we've moved into a place that has a dishwasher, so now I just cook (and load the dishes...).
 
user559633
3:25 PM
is there a vacuum called the dyson sphere? edit: the call it the "ball." boo.
 
I want my wife to let me cook, but no.
 
Yeah to be fair I think it's better that I cook :P
 
My wife have the same agreement (me cook, her dishes)....which is weird since I have no sense of smell (and therefore limited taste) but apparently am a fair cook
 
Worst criterion for choosing a wife is to choose someone who can cook.
Then you can't enjoy cooking any longer.
 
unless they cook professionally and therefore want you to cook most of the time cause that's all they do at work (have a friend where this is true)
 
3:28 PM
yeah, she could be a pro, but she is like "then I wouldn't enjoy cooking at home"
so far I am allowed to only make oat porridge and steaks. :/
 
Great. Thanks Tristan. Started reading about Dyson Spheres again on Wiki, the trail went something like Dyson Sphere -> Niven Ring -> Ringworld -> Halo. Now I want to play Halo. Thanks.
 
if you broil the steaks you can get a small grate (which fits in the pan) and then cook potatoes (if par-boil) or vegs under them
plus grate can give some grill marks
 
Which now wants me want No Mans Sky even more.
Truly, you are the worst person ever.
 
user559633
@Ffisegydd Oh, halo there.
 
user559633
@Ffisegydd You sound just like my mother.
 
3:38 PM
It's time for the truth, @tristan. I'm sure you've been suspecting it for a while now, but finally I have to confess, I think I'm gonna make a pizza for dinner.
 
user559633
The Long Dark stream at 1PM EDT/1700 UTC/6PM London time. Click here to watch, use the twitch chat to communicate.
 
user559633
@Ffisegydd I fucking knew it.
 
user559633
I'm off vegetarianism, so I'm going to make steak/cheese/onion sandwiches.
 
Phone is currently being repaired for 2 weeks or so. Been given a replacement phone. I'm worried that if I go outside with it, all the hipsters will think I'm one of them D:
 
D spheres just make me want to watch TNG 6x04 ~107th time.
 
3:41 PM
Installed applications include a stopwatch, a timer, and a converter.
 
what does it convert? squirrel skins to cowry shells?
 
No idea
 
Fun fact, the Finnish word "raha" (money) originally meant squirrel fur.
 
That's not very fun.
Especially if you're a squirrel.
 
sorry, I didn't know. I've always thought you were a julia set
 
3:47 PM
I never said I was a squirrel. Was just pointing out a fact.
Can't believe you assumed I was a squirrel, typical white male.
 
4:12 PM
@AnttiHaapala Good ol' Scotty :)
 
"I know this ship like the back of me hand" turns around and rams into a beam
 
4:30 PM
Yeah... that scene was probably the only decent bit in ST5 :)
 
I also liked when Kirk tries to hug Spook: "Please, sir, not in front of the Klingons" but that's it ;)
 
cbg Robert
 
@AnttiHaapala sounds amazing
@JGreenwell sup to the up
 
4:44 PM
Yeah, voted
 
> One person used his knowledge that he wasn't schizophrenic to prove that he was. That is, having been diagnosed as free of psychosis, he viewed his overpowering belief that he was schizophrenic, as delusional: which can be a schizophrenic symptom. Then, as a delusional person, this proved to him that he was schizophrenic.
60% funny, 40% sad
 
I've seen some good Downfall videos but this is one of the best
cc. @tristan @Antti at least
"It's okay you can use bash on Windows 10 now" literally nearly fell off my chair.
 
but you can ;)
 
"You are a bunch of Node.js hipsters that just HAVE to install everything you read on Hacker News!" you know me so well Adolf D:
 
user559633
5:06 PM
Streaming now in case anyone's interested
 
hell yeah :)
 
Hawaii looks different :)
 
6:00 PM
hmm....I might need to start using R again :|
 
Owch.
I'm not a fan, myself.
 
SAS maybe an option and that's not as bad....or its worse; depends on projects and data really
but yeah, I learned R at first (well, when restarting career in 2012) and vastly preferred Python
 
I've heard worse things about SAS than R.
At least R is open source.
 
@JGreenwell I used SAS from '98 to '04 :(
 
@Ffisegydd She said "Don't cry, you can run bash on Windows 10 now", but yeah, that sentence was the best one! :D
 
6:13 PM
Anyone used Sandman? Sounds pretty handy.
 
Fizzy, shhh...I'm trying to lie to myself right now
 
Oh, well, in that case - goshdarnit R is the best.
 
 
1 hour later…
7:23 PM
lol
just read that if you're an UKian engineer holding Eur Ing title, you can get that in your passport.
 
7:35 PM
"Other than members of the legal profession appointed Queen's Counsel and
engineers who hold the qualification "Eur Ing" (European Engineer), requests
for professional and academic qualifications to be recorded in a passport
should be refused."
 
7:46 PM
I love when people fill out surveys just to say stuff like "None", "NA", etc for every single question
 
I once embarked on a mission to improve the quality of my junk mail. Ticked all the £100k+ income boxes on every survey i got
Got a very confused and mildly embarassing call that asked me to clarify was I in fact living with my parents while earning that much. :D I may have strung them along for quite a while.
 
user559633
I used to love messing with those. Eventually, I got to the level of obscure that I was getting advertisements for elderly jewish women.
4
 
I hate you people right now
 
Mission accomplished. o/
 
00:00 - 20:0020:00 - 00:00

« first day (2115 days earlier)      last day (2824 days later) »