« first day (3439 days earlier)      last day (1509 days later) » 
00:00 - 14:0014:00 - 00:00

2:01 PM
Mmm, but df['a'] = df['a'].astype(pd.Int64Dtype()) gives TypeError: object cannot be converted to an IntegerDtype
And df.dtypes gives:
a      Int64
b     object
c    float64
dtype: object
So I'm confused by the error. I'm doing something dumb, surely?
 
@JonClements Ah, right. I know that. :)
 
>>> df.dtypes
a     object
b     object
c    float64
dtype: object
both before and after fillna ^
 
What version?
 
just installed it
1.0.2
 
pandas 1..oh that's fancy
 
2:05 PM
Ok, so something is wonky here. I'm on 1.0.0
 
sounds like a bug that was fixed
unsurprising, with all the new stuff in 1.0
but the NULL stays in df.a
 
Ahh... I'm also on 1.0.0
 
update yourself before you wreck yourself
 
... speechless...
 
Can't remember if v1 has switched to pd.NA by default or it's something you have to do...
on 1.0.2 now then...
 
2:10 PM
Wait, but why didn't 1.0.0 make the column a float type?
 
check the 1.0.1 and 1.0.2 release notes, I bet it's in the former
 
"a" shouldn't default to object, should it?
But it's 1.0.2 that's now making it an object dtype for you (before I upgrade)
That screws with some pretty fundamental stuff. Like taking a mean and being vectorized but ignoring NaN
 
fresh cbg everyone
 
@Sam take your time ;)
 
Sam
Yeh i just realised lol!
I was thinking element-wise
Greetings, anyway
 
2:14 PM
don't look at python 2 code, for what it's worth
hey
 
Sam
@AndrasDeak It seems to be non-optional when reading through a lot of work in academia
 
Sorry, I meant 1.0.2 (not 1.0.0) should have made "a" a float type to deal with NaN, not object type. I'm confused now
 
@Sam ugh
 
Sam
Yup. Happy Monday
 
>>> isinstance(np.int64(1), pd.Int64Dtype().type)
True
>>> isinstance(pd.NA, pd.Int64Dtype().type)
False
class NAType(C_NAType)
 |  NAType(*args, **kwargs)
 |
 |  NA ("not available") missing value indicator.
 |
 |  .. warning::
 |
 |     Experimental: the behaviour of NA can still change without warning.
 |
 |  .. versionadded:: 1.0.0
 |
 |  The NA singleton is a missing value indicator defined by pandas. It is
 |  used in certain new extension dtypes (currently the "string" dtype).
so it's 1. experimental and 2. probably string-like
 
2:18 PM
Ugh
 
but not too much
 
@Sam wouldn't say that to Bob Geldoff :p
 
>>> pd.StringDtype().type
<class 'str'>
>>> isinstance(pd.NA, 'str')
False
 
This seems messed-up to me. There has to be a bigger picture behind this or I'm missing something
 
Well...have you perused the pd.NA and experimental dtypes docs yet?
 
2:22 PM
@Aran-Fey Hey, did you solve this?
 
I did have a look through but this is the only time I've actually tried to use it
 
@Peilonrayz It ended up having nothing to do with sphinx. The compose key program I use on Windows got stuck and replaced my commas with cedilla characters. Took me a while to figure that one out...
 
Oh, that must have been fun to solve
 
I was this close to sending the sphinx devs a bug report
 
@Aran-Fey haha, would've made a perfect SO question
 
2:33 PM
Lol, and now ctrl + . opens the reload script in Spyder 4 rather than actually restarting the kernel for me. This has become a confusing time indeed
 
cabbages, all
 
@inspectorG4dget hey
 
anyone else working from home?
 
@inspectorG4dget Only for the last 7 years or so? :p
 
nice! I can't really get any work done from home, so I always try to get to the office. They've "strongly encourage"d us to work from home because of COVID-19. It's too distracting at home!
 
2:37 PM
Let me guess, you have kids and/or pets
 
or a playstation
 
Sam
@inspectorG4dget My office closed down today
 
@Sam hey Sam
 
Sam
@AndyK Hello!
 
@Sam how are you?
 
Sam
2:40 PM
My temp is in the normal range and I am not coughing, .....so i'm going to say good. How are you :)
 
@Aran-Fey none of the above, in fact. About 13 years ago (when I was an undergrad), I made the decision to not work from home my dorm , because I'd go to sleep wired and wake up tired. Since then (and especially when I started my PhD), I've always made home a relaxation/non-work space. So now, it's pretty hard to turn it on at home and crank out some productivity
 
WFH cbg
 
@inspectorG4dget you'll get bored after a week. This is my prediction. I worked from home for over 2 years and it gets old, fast. You just need deliverables
 
2:42 PM
Single monitor is not productivity-conducive
 
my non-work-desk (which is actually a repurposed dining table) is definitely not as productive as my work desk with all my ref books and 3monitor setup. Plus, my home setup has my personal computer with steam
 
discipline gadget, discipline :)
 
Shouldn't MisterMiyagi be delivering the lines on discipline?
 
I suppose so... but he does seem a little obsessed with wax...
 
ack! I shouldn't have mentioned steam. That's really not the issue for me. For me, the issue is being unable to get psyched up to crank out some work, when I'm home. RIght now, I'm sitting in pants, shirt, tie, shoes, just to maintain some similarity to my work presence
 
2:46 PM
bathrobe atm, hoping not to get pinged into any Slack video chats
 
"Webcam is broken" works every time
 
@inspectorG4dget Must not interpret "pants" the British way... I don't want that image in my head :)
 
:o
what's pants in britain?
 
wait what? NOw I gotta know!
 
underwear... so gadget's been too lazy to actually put trousers on :)
 
2:49 PM
i suppose it's a good thing you can only really see the upper body in skype calls :P
 
ahh. nah... I did my morning routine just to see if it helped me get psyched up for work. Results: poor
 
My NJ friend calls them "u-trou"
 
is that h1p5t3r speak or something?
 
@roganjosh My namesake currently snores happily in an armchair, knowing that his slaves servants are nearby. Not the best situation to give lectures on discipline.
 
No, dates waaaay before hipster was a word
 
2:52 PM
@MisterMiyagi way to undo 6 months of learning from Sensei. Now I don't know what to do with my life
 
find a comfy armchair, and enjoy life!
 
.... I can live with that :)
Though, intermittently dealing with the Mother Rolls. I do hope that I'm not gored during a harvest
 
If anyone is interested, I'm streaming on Twitch all day today! Starting a Python project - don't know what it's going to do yet, maybe bot for my stream... twitch.tv/aaronchall
 
@Sam not too bad, chilling at home
 
Sam
@AndyK working or off?
 
3:03 PM
listenning to Johnny Halliday
@Sam working
feeling tired though
 
Sam
Nice. Yeah i dont have a proper home office to feel comfy
 
@Sam I have a desk
weather is grey though
 
Sam
What part of the globe are you?
 
@Sam France
 
Sam
Ah, how are the supermarkets holding up??
 
3:11 PM
/me imagines people sword fighting each other with baguettes to claim the last toilet roll :p
 
@Sam what can you say? I thought it was apocryphal. So I went out to try to buy some toilet papers. I went into a bug supermarket... ppl were lining up to buy foods (so far for social distanciation)... Same for the next one, close to my house
and finally, arrived at the last one
no toilet papers, pasta, nada... There were beers though...
 
Sam
@JonClements Only the strongest shall wipe their ....
 
@AndyK at least they had essentials then :)
 
@JonClements indeed
 
I know France has some strange culinary tastes... but a "bug" supermarket? Have frogs and snails gone out of fashion now? :p /me runs
 
3:16 PM
@JonClements ha ha ha lmao
 
@AndyK so the problem is...? :)
 
@roganjosh no problem, I just wanted to point out that they forgot the beers... ha ha ha (more for me)
 
Hey; the people doing runs on supermarkets aren't too smart to begin with
 
@roganjosh you know when you are afraid, scared for your life, it can turn the smartest people to not the smatest.
 
ironic since that's generally the time it's better to be smart :)
What one should do is when there's a shop with goods still available and you see people arguing over it or whatever, just get close to 'em and start sniffling and coughing etc...
 
3:24 PM
@JonClements ha ha ha
 
@JonClements good way to clear the waiting room if you need a doctor. I'm disappointed that people haven't got on board with the shrink-wrapping idea
 
It's not quite as exciting as encasing someone in carbonite though is it? :p
 
I don't know. We could play some funky music while it happens. Solo didn't get that
 
So what's up?
 
3:43 PM
@roganjosh yeah... that'll put 'em at ease :)
@AaronHall yo... I will try and drop by one of your streams one day... just a little busy today :(
 
@JonClements elevator music, then? :P
 
@roganjosh I don't know... music from Benny Hill might work :)
 
Ok, I think the consensus is ditching Vader, and we'll go with a Charlie Chaplin effort. It definitely conveys "we know what we're doing" and will calm nerves while being lashed to a pallet and sharing wrapped
 
sounds like a plan... and don't you love it when a plan comes together... /me plays the appropriate theme tune...
 
@JonClements would love to have anyone to talk to any time. I don't know if I'm streaming too much or shadowbanned me, but they don't even list me in the tags or categories (whenever I've checked...)
 
3:57 PM
that sounds a little desperate :)
I've got stuff to get out the door by 6, (about 2 hours), so if you're still about then, I'll see if I can't pop by
 
please put your work first.
I had a friend drop by last night, we caught up and I showed them what I was doing, so I'm not entirely in a vacuum...
 
@AaronHall what is the url of your stream, please?
 
twitch.tv/aaronchall
 
@AaronHall thanks
 
stackoverflow.com/q/60709130/4799172 needs more detail. The OP has already suggested that there's unknown detail and I fear a rabbit hole
 
4:07 PM
Seems answerable to me, since we can see C:\Users\theok\AppData\Local\Programs\Python\Python38-32\python.exe in their PATH
 
I missed that. Ok, they have a python interpreter
 
not necessarily, but chances are high (:
 
user10984358
Is adding “noob question” prevent close votes?
 
Depends. Sometimes it helps, other times it only makes things worse
 
user10984358
To most of the people watching the main feed half are noob question
 
user10984358
4:18 PM
Somethings I ask here are definitely noobish but I guess I would rather point it by saying I’m a beginner.
 
I only care about whether the person has made steps to research the problem themselves, when it comes to me close-voting (or it's a dupe)
 
user10984358
I think he meant adding the path on sublime’s build system not the environment variable
 
Hi guys, has anyone some experience with NLP? More precisely the nltk library in python
 
Presumably you're after more experience than having heard of it? :p
 
user10984358
Fwiw I use sublime on a Mac and windows and I never had to change the build system. It automatically detected my python in both cases. In my Mac it even detected my conda installed python3 and not 2.7
 
4:25 PM
@Mez13 I'm not aware of people here that have done a lot of NLP but if you just go ahead and ask whatever it is, you may get lucky
 
the only thing I know about nltk is that it's not for production purposes, that would be spacy
 
@JonClements Ok. I'm using nltk to lemmatize some documents. But, I noticed that it doesn't work well with the suffix -ing. I mean, it's does not convert "using" to "use" for exemple. I find it weird cause it is one of the most frequent case
 
is there any reason it should... the root of "used", "using" is presumably "us" ?
 
@JonClements You're talking about stemming, that I don't really like. I want lemmatization
It works for -ed, "loved" becomes "love", not "love"; but "loving" stays "loving"
 
okie dokies... seems like it should be a fairly common question with a solution or reason why that's the case somewhere by now then...
 
4:31 PM
Also, "feet" becomes "foot", "teeth" becomes "tooth", blablabla
@JonClements Yep, it should
 
morning cabbage
 
Fresh cabbage to you, Code
 
@AndrasDeak thanks for mentioning that... spacy is now on my "things to look at when I have time but know I never will list" :p
 
4:55 PM
@roganjosh BoJo the Clown is talking about stuff...
 
Yeah, I can hear it in the other room
 
Shall I get the shrink wrap to put you out of your misery? :p
 
I'm in my local; I went out for some food since we don't have great stuff in the freezer... and I guess they'll be shut down in a few days
 
Almost seems like every time you're chatting you're in the local!
 
They're listening intently, probably to see if they will be closed down. Maybe we can shrink-wrap them too?
@JonClements Just supporting local business!
 
4:58 PM
(but yeah... seems like you should enjoy it while you can... :( )
 
Also, no internet at home, which is becoming a building and annoying issue
 
oh?
is it blocked by the walls of toilet roll? :p
 
My mother refuses to buy anything unless there is some cashback offer to be had, so it's not easy to get broadband installed
Every day I expected her name to flash up when I was working for a supermarket. Thank yam we don't have the same surname :P It's a revolving door of pointless electrical appliances to reach the spend threshold and they then get taken back. I actually don't know how they don't catch it but that wasn't my issue
 
I laugh but she saves maybe £1k a year from it. Maybe I'm the fool
 
5:09 PM
:D something goes wrong with btc nowadays :D keep dancing up/down
 
"something"
 
(I should stress that it's all legitimate, but the vouchers only state a minimum spend to get the discount, they don't talk about returns)
 
anyone wanna chat about sklearn for a bit?
 
@roganjosh "that's why we can't have nice things"
 
5:14 PM
@AndrasDeak I'd half agree, and then I think "you guys really need to sort this out". I had it in my head that large chains know all about us from loyalty cards... they do not
 
The fact that they don't or can't catch it doesn't make it ethical
the existence of a loophole doesn't imply you should abuse it
 
I have a regression model for a binary classification problem. sklearn.metrics.roc_auc_score clearly tries a bunch of thresholds for the regression outputs in order to compute the best possible AUC. However, in order for me to use that regressor in production, I need to know what that threshold is, which sklearn.metrics.roc_auc_score doesn't seem to tell me. Any thoughts on how I can get this, aside from "use simulated annealing to figure out the threshold with test data and a pickled model"?
 
@AndrasDeak Well, I could flip that round and ask if it's ethical what supermarkets do to their suppliers. It's gonna be tit-for-tat though and a race to the bottom
 
@roganjosh Hmm? Is this an "it's okay to steal from thieves" argument?
 
I get the impression that retailers don't roll out promotions like these without first asking "is it still profitable if 1% of customers exploit the hell out of this?". Presumably it is, or else they wouldn't do it.
 
5:18 PM
@inspectorG4dget with ovo?
 
@AndrasDeak It's not an argument because I already concede. I'm the one that gets drawn in to the "20% off" deals :P
@Kevin My experience is that they have no idea
 
@αԋɱҽԃαмєяιcαη OVO and OVR would be identical in this case, given that it's binary classification, just performned with a regressor
 
@inspectorG4dget can you find in the source where this happens? github.com/scikit-learn/scikit-learn/blob/95d4f0841/sklearn/…
 
And that's not based on a single retailer. Several. They need to get their yam together and integrate systems, which they're starting to do
 
I skimmed some relevant code but can't see explicit references to thresholds, unless it's in _average_binary_score elsewhere
 
5:22 PM
@AndrasDeak fair enough. I haven't really looked at the source. But experimental evidence suggests that this is what is happening
In [5]: roc_auc_score([1,1,0,0],[0.8, 0.3, 0.29, 0.1])
Out[5]: 1.0

In [6]: roc_auc_score([1,1,0,0],[0.8, 0.3, 0.3, 0.1])
Out[6]: 0.875

In [7]: roc_auc_score([1,1,0,0],[0.8, 0.4, 0.3, 0.1])
Out[7]: 1.0
 
@αԋɱҽԃαмєяιcαη iiiiiinteresting. Thank you
 
@inspectorG4dget you welcome, i were having the same issue . and have been searching too much. but that answer solved it for me and make it clear :D i was mixing things up
 
5:51 PM
@αԋɱҽԃαмєяιcαη hey! wanna help explain some stuff to me please? Got a few minutes?
never mind. I think I just figured it out
 
@inspectorG4dget just got back. sorry was hitting my head with google BigQuery data transfer :D working from home is making my brain in wrong direction :( ay
 
@αԋɱҽԃαмєяιcαη you and me, both. I just wasted a bunch of time trying to figure out what the yams thresholds meant, when returned by auc(...)
 
that's will return all features with non-zero variance
the same as the default for VarianceThreshold()
 
wait what?!
 
 
2 hours later…
7:39 PM
this has actually helped. Many thanks
 
8:19 PM
@inspectorG4dget you welcome. glad to help
 
 
1 hour later…
9:29 PM
VSCode tutorial: "With Ctrl+Alt+UpArrow you can create a 2nd cursor in the line above"
Me: *presses Ctrl+Alt+UpArrow*
Computer: *Switches from desktop 4 to desktop 3*
Me: Oh, right
 
Can't super or something block that behaviour?
I can't remember if I used alt to block super's binding or the other way around...and either case it was gnome on debian and if I recall correctly you're on arch
 
no idea, but I use the same shortcut on Windows, and that definitely can't do that
I'm just gonna change VSCode's hotkey
 
9:50 PM
any recommendation for Python interpreter syntax highlighting in windows ?
 
you mean in the REPL?
 
Huh. I never thought of that.
 
Hmm, looks like bpython will be a good choice.
 
10:18 PM
I watched the first couple of minutes of episode 1 of Charles in Charge, couldn't bear to watch more, now youtube suggests I watch episode 2. Really, youtube?
 
10:34 PM
@αԋɱҽԃαмєяιcαη I always use ipython
 
i will give it a try. thanks @AndrasDeak
 
if you don't want/need the In[...]/Out[...] headers you can start it with ipython --classic to get the usual >>> prompt
 
11:19 PM
I was going to suggest ipython but then I looked up bpython and I decided not to weigh in...
 
@AaronHall :P
 
cabbage
 
00:00 - 14:0014:00 - 00:00

« first day (3439 days earlier)      last day (1509 days later) »