« first day (4933 days earlier)      last day (12 days later) » 

11:39 AM
tree-sitter is surprisingly great :o finally can stop trying to use regex to make my own parser...
 
11:59 AM
I was just about to go through the workflow of minting a PyPI token to feed it to GitHub. I see they have "Trusted Publisher Management" now. Has anyone used that already? Any experience versus manually managed tokens?
 
 
1 hour later…
1:03 PM
@MisterMiyagi Yeah ๐Ÿ‘ mate ๐Ÿ˜Ž, I've just โฒ๏ธ given this a try ๐Ÿค” and it's great ๐ŸŽ‰! ๐Ÿ”Ÿ/๐Ÿ”Ÿ would do again! ๐Ÿ”
 
1:19 PM
I always knew MM was on the brink of insanity... ๐Ÿ˜ฎโ€๐Ÿ’จ time to put someone in that room for a while
 
I never knew MM could put so many emojis in a single sentence :o
 
Mar 24 at 9:20, by MisterMiyagi
That button is so worth it, isn't it? ๐Ÿ˜Ž
 
Yeah but I mean, that's like one emoji. Not enough to call that "many"
 
He needs a month at least away from a Mac and anything written by Tiangolo. With a bit of luck he might recover. We can only pray
Welp, it looks like statsmodels completely ignores attempts at limiting CPU use with:
from threadpoolctl import ThreadpoolController  # noqa

CONTROLLER = ThreadpoolController()  # noqa
 
1:35 PM
trying to train a yolo model have never been so hard. Can't even find a ready made runnable example with a small dataset. And the syntax seems to have some changes between v5 and v8....why do they make it so hard I don't get it
 
Given that I have to now do hyperparameter tuning for 700 stores and can't limit it from consuming literally all my compute, I guess I can clock off for a couple of days. This laptop will just sit in a corner doing its own thing
I guess DS can sometimes get:
 
2:33 PM
@roganjosh If you do things properly you have a server for training and your machine can be used to work. Also using a laptop for DS sounds insane. But I've been there and done that :P
 
2:50 PM
"insane" is a good way to describe the situation. The company has to migrate their entire data services to something else, which makes a mess of just about everything. Couple that with me just losing patience with Azure + DataBricks and it's easier and much faster to run everything local
At one point I had sqlite3 running locally nearly an order of magnitude faster than the spark cluster - "remind me why we're doing this again?"
 
@roganjosh xD
wow that sounds so crazy. Yeah just buy a server. We have assembled 3 over the last few years and it serves us very well
 
3:07 PM
It's not a case of buying a server. This is a decades-old multi-national retailer with nearly half a million employees... there are lots of data systems and, right now, they aren't all connected in this transition so it has to go via a local download. I just got sick of uploading it to DataBricks when it works faster on my local processor anyway
Sorry, uploading to Azure to then loading into databricks. And work with notebooks. And cry. No thanks...
 
3:47 PM
@roganjosh this is my yesterday/today
 
 
3 hours later…
6:57 PM
@roganjosh A week ๐Ÿ—“๏ธ of detox ๐Ÿต should ๐Ÿ™ help โค๏ธโ€๐Ÿฉน. I'm in France ๐Ÿ‡ซ๐Ÿ‡ท on a business ๐Ÿ‘จโ€๐Ÿ”ฌ trip ๐Ÿ‘จโ€๐Ÿ’ป and the food ๐Ÿฅ goes right โฐ to the head ๐Ÿคช ...
@roganjosh Cloudbursting is a thing, you know, right? ;)
 
 
1 hour later…
8:24 PM
@MisterMiyagi polars just smashes it out of the park on the data. By the time the spark โšก๏ธcluster ๐Ÿ˜๏ธ fires up โฌ†๏ธ polars โ„๏ธ has already done it โฐ
 
It's time like this when I wonder why they bothered with letters in the first place back in the days!
The power of a single button...
 
It helps that I got given an M3 Pro laptop with 32 GB RAM. I didn't even ask for it. Other teams scoffed and said it was a waste of money. Well, look at roganjosh cruising on doing everything locally for a multinational company (good lord, don't let anything happen to the laptop...)
 
Well, they should be able to afford more than one. :P
 
The whole DS team has the same version of laptop. I'm sharding it soon, but the in-person kind
"Please God don't let this just live on my laptop"
At the same time, that concern is much lower than "please God, don't make me work on this data in DataBricks". Quite the endorsement.
 
8:44 PM
@roganjosh to be honest, it's not a waste if you don't care about longterm usage (everything is soldered) and also if you care more about power efficiency (use less watts than a Desktop with same computational power)
I even considered getting one, just for the power usage. But I can get more powerful computation for cheaper, even if it use more electricity
 
Well, I was being kinda tongue-in-cheek on that one, but I can beat DataBricks on... everything. I will only use DataBricks when forced (which I eventually will be). It's garbage.
I've not pushed local processing further than 1bn rows of data here, so maybe it will win there, but... it doesn't look good from my perspective. The UI is crap and it's slower than local processing
 
9:05 PM
๐Ÿคถ I think I nearly got it for this emoji thing
 
 
2 hours later…
10:48 PM
@roganjosh What, on your dataset, for the type of queries you make? How general is that statement?
 

« first day (4933 days earlier)      last day (12 days later) »