« first day (3292 days earlier)      last day (1673 days later) » 

8:00 PM
@RaghavSood I learned many things in here, but I wouldn't go as far as saying the overall talking in this room is productive :D
 
But so can open source apps for the latter point
Or giving talks, unless you're @AdamMc331
@MehdiB. Just gotta multitask
 
I don't plan to make blogs hide behind paywalls, it's just a way of me contributing back to the community
 
Definitely depends on the blog as well, but my thinking was that there is such a saturation of people trying to get into them, but almost nobody continuing to do them that it's not too bad of chances if you are active in keeping it going
 
I'm murdering servers while talking here, for instance
 
But yeah a programming blog? Idk
 
8:01 PM
Passive income from blogs works if you regularly post about reasonably broad topics (travel, sports, etc). Technical ones, not so much
 
@TaseerAhmad was more thinking from ad $$
 
But a good lead from a technical blog can far outweight most passive ones
 
Yeah that's what I was thinking
 
Consulting gigs can be lucrative
 
Ads? I did not know about it 0_0
 
8:01 PM
@RaghavSood same, but the config doesn't get applied and it's driving me nuts
 
@TaseerAhmad it's probably best to not have ANY ads for a good while until you have a reader base
 
See, that's your problem, you're trying to make the servers do stuff
I'm just straight up decommissioning them
I'd just go with no ads at all on a personal blog
 
spark's internals are hard, my cluster have 10 nodes and they don't get utilised, only 1 does
 
I started making a self improvement blog, and ended up getting bored of it. Was hoping to ride that improvement train
 
When should I set up my own website?
 
8:03 PM
I'd also avoid medium, but it's fine if you just want to see how your blogging goes
Depends on what you mean by "own website"
 
@ballBreaker Yeah, I remember you talked about it before, it was more of a irony though :P
 
Do the old, self-improvement blog -> life coach
 
Github pages + huge/jekyll make for excellent personal blogs at 0 cost
 
I meant a website that serves as a portfolio
 
And you get the bonus of not having to deal with medium's nonsense popups
@TaseerAhmad When you have a portfolio to show, even if it is just one thing + a blog
There is no real minimum bar for a website
You can have one with just your name and an email on it
 
8:04 PM
Yeah that's true
Even if it is just to secure the domain name for the future, not a horrible idea
 
Oh okay
 
1 hour ago, by bluetoothfx
;)
lmao
 
It's like printing personal business cards
but you don't own a business, it's just a business card with your personal information
It doesn't make it NOT a business card..
gnomesayin?
 
Technically, if it is not for a business, it would make it a name card, not a business card
 
people have words for everything, don't they
 
8:06 PM
@ballBreaker kdeyeah
 
yo yo mawmf
sup mawwwwmf rr rrr rrr gnomesaYIiiiiii?
- Einstein, 1944
 
it's the J and the T gnomesaYIiiiiii
 
hahaha
I love that you watch TPB
 
J-Rock was pretty funny :D
 
I honestly didn't think non-canadians really watched it ever
 
8:08 PM
This is why this room ranks lower on the productivity scale
It's all you, bB
 
Someone even came in here and commented how the r15 room is alive again.. I haven't been in here since Wednesday.. coincidence?
 
Yes.
 
me neither bb, so pretty sure you're the coincidence!
 
I knew it, the world revolves around me. Damn, it feels good to be this massive
I keep waiting for Raghav to continue his sentence
 
It was meant as a stuck task to consume your resources forever
But we terminated it, just to be nice
 
8:11 PM
Give him a few secs, he's probably rotating his log files
Serious question @raghav - do you rotate your logs by time or by size or both?
 
Logrotate on device by size
Along with near realtime streaming to graylog
So even if the device fills up, graylog continues accepting logs
Rotated logs are compressed and moved to S3
 
How do you name a full log? Mylog.log.count.date ?
 
service.date.tar.gz for archives, and just service.log for the current one
If tar needs to part it up, then yes, a part name
But that only happens for one service, so eh
 
How do you know which one to get back to if needed then?
 
We have metadata records in the db, such as which action was done on which date. Look up the date, then go fetch the log
That's the advantage of blockchain stuff, there's always a timestamped copy elsewhere :D
So we can look up date/user details, then get the appropriate log fro archives
 
8:18 PM
so you fetch the log from s3 by creation date?
 
Yup
Sometimes it is a range of dates, since some services don't produce much
So we archive a week or a month at a time
 
Gotcha, thanks
 
There's probably a better way to do it (and we do have graylog for the last 1-2 years, which just lets you search directly)
But for us searching logs is relatively rare, so not much motivation to move to a better system
 
that makes sense
 
Graylog is good tho, if you just want a central place to search logs in more or less realtime
Can get expensive if you have a lot tho
 
8:25 PM
I'm not sure about the best practices of logging in data systems... especially in an AWS setup
 
Really depends on what you need - do you need indexed, searchable logs, or just archives?
 
EMR logs per node, then archives the whole thing and puts it in S3, but it's usually useless, because good luck going through 10 logs of 10 nodes
I want them searchable
 
You should set up something like graylog, then
We set it up about 2 years ago, currently have around 3 billion entries in it
Haven't really had to manage it
Mostly just works, as long as you provision enough space
You can keep archives on s3 and use graylog alongside to ensure you don't lose messages, since graylog can drop stuff in certain cases
And similarly your file based logs might run out of space
 
@MehdiB. we use datadog for a lot of stuff
 
Two independent copies helps
 
8:28 PM
Obviously costs money though
for logging and metrics
 
and where do you get the metrics from? cloudwatch?
 
Datadog/splunk etc get super expensive super quickly tho :D
 
we do use datadog but as far as I know, mainly for infra monitoring
 
We do metrics separately via prometheus and grafana, it is not part of our logging flow
 
I don't remember costs but I don't think it's too bad if you do it correctly
 
8:31 PM
I'm more interested in the application logging, especially the progress of the jobs I submit
 
For progress, it may be simpler to set up a specialized dashboard (I'm not familiar with EMR but it's possible AWS has something already)
 
yeah but unfortunately, I rarely have time to investigate things like that sigh..
 
Yeah, never enough time to do it all
 
8:48 PM
I don't know what you're talking about
Finished everything in my sprint then some and have 2 days left
Plenty of time
 
I work alone and I get projects from A to Z on my own
 
Woah look at me, I'm codeMagic and I run fast
 
Same
I need more Raghavs
Ought to invest in some cloning research
 
Care to share your findings afterwards?
we need a Dr Krieger
 
:D
Can't wait for season 11
 
8:56 PM
same, hope it's as good as the 10th, the 9th was pretty bad imo
 
I avoided the 10th thinking it would be like the nineth
worth the watch, then?
I could FEEEL the writers giving up on it the past 2 seasons
 
yeah definitely worth the watch, we finally got good jokes and a nice plot
 
10th is definitely better than 9th
But I didn't leak the whole dream stuff as much as the original storylines
Hopeful for 11 to go back to that
 
guys going to sleep
 
Nice, I'll have to check out the 10th then
Speaking of cloning, the new netflix show with Paul Rudd is amazing
called "Living with Yourself"
Highly recommend
 
9:00 PM
I hate paul rudd
 
:O
I need 2 leave now
 
he was so boring on friends and now he has to live with the consequences
 
o/`
 
bb is shocked :D
@RaghavSood same, i don't know why they diverged like that
@tim check out re-zero, the plot is quite intense and it doesn't have goblins (it's not the bisounours either) :D
 
Anyone used hetzner?
 
9:35 PM
@RaghavSood what about my talks
 
I can't watch anything he stars in
I hate his face
 
That's a lot of hate for Adam just over talks, Tim
Just focus on the slides, don't look at Adam's face
 
hngggg
 
@AdamMc331 They are usually missing some key points
 
9:47 PM
That's unfair, time constraints require that Adam only dip into the lake of available information
 
oh he had them but they were lost
 
damn, that was brutal, guys XD
 
The only way I can feel better about myself is to marginalize Adam's success
he knows I'm just jealous
 
robot.your-server.de - finally, a business that understands their target user base
 
Hahaha
I saw a couple of websites that creeped me out
One was a website on which you buy a 45$ service to actually influence X to do Y through very targeted ads
And some of the services was "convince your partner they shouldn't leave you"
This is so evil
 
9:55 PM
Ruining your life as a Service
 
how the hell isn't this illegal
 
Even if it is, who's gonna stop it
 
at least put them down from the web
it freaked me out
 
Mehdi have you seen the boys?
 
10:08 PM
Is he trying to crack open a cold one?
 
He just might be
 
Nope Tim! is it good?
@RaghavSood wtf
 
Once you're on the internet, you can never hide
 
@MehdiB. um what
 
Why do you think I'm so paranoid of them
It's not paranoia if they're out to get you
 
10:11 PM
@RaghavSood rightfully so! :D damn, that was dark!
 
I need to find friends who think like that
The possibilities
 
@DaveS 😂😂😂
 
Are you saying that someone goes on there and buys ad space on their partners devices to suboconciouslly discourage them them from leaving?
 
indeed
and there are a list of defined use cases, "how to be happy" to create a mini happy cult in your brain persuading you you're happy
 
Why is that creepy?
That's how companies advertise to people
Why is it weird when people do it directly
 
10:14 PM
because you don't advertise a product still bound by certain barriers: money, need, rationalisation from the partner
but that actually manipulates your life, not just your consumption habits, but your own brain
 
Humans need all that too
Alrighty, my server is here
Now to install NixOS and set up the disks
 
Use targeted ads to convince your boss you need a promotion
 
I'm gonna share the websites 1min30 and then I delete
 
wow
 
isn't that creepy?
 
10:18 PM
I'm gonna use the gaming one on my wife
 
similarly, its a bit scary and creepy that Russia and china are putting out apps on us app stores that encourage users to upload pictures of their faces
 
@MehdiB. what is good? Anyway do you know where the boys are?
 
and its concerning millions of people fall for it and celebs encourage their followers
 
Russia? Do you know Facebook?
3
 
10:19 PM
^
this isn't a new thing
 
@TimCastelijns I rather an American company than foreign one.
Is that nationalistic? No, I don't think so.
 
It's not a foreign company if you're Chinese
 
@TimCastelijns hahaha no XD is this a reference ? :D
 
@DaveS Chinese ppl shouldn't and wouldn't like Chinese gov
and since companies are controlled by gov they shouldn't like them either
 
Nobody likes Chinese government except for Chinese government
 
10:20 PM
I don't trust any Russian or Chinese company
 
I don't trust any company
 
I don't trust
 
Facebook is commercializing my data, not weaponizing it
 
What Russians do for political power Facebook does for cash
 
I was building on Dave's joke, Mehdi. I want to see the boys
 
10:22 PM
People are stupid and its frustrating
 
@JBis oh yeah? What about the propaganda platform it provides?
 
That's why we must recycle them
 
Ah XD
 
> Platform
 
10:22 PM
Yes that's what I said jbis
 
@MehdiB. You blame us government for child porn? They funded the tor networks creation
you blame YouTube for all the bad videos
you blame SO for all the bad questions?
 
0-100
 
Its a platform, not their job
@TimCastelijns I brought it back down. But still same logic.
 
@JBis uh. Yes
 
@TimCastelijns ok bad example
I blame Facebook for exposing info to Cambridge analytica etc. not for Russia using it
Idk how you fix it tho
how do you suggest Facebook goes about it? Or us?
 
10:25 PM
@JBis uh no, it is, when you provide a platform you're a moderator, that's a responsibility, and notice that they acknowledged that and are seriously working on it, that's why they have dozens of thousands of moderators and content classification AIs
 
^
content needs to be moderated and privacy laws need to be enacted to protect users
 
I guess the issue is that they let through content that benefits them even though morally questionable
 
@MehdiB. But Facebook can't win. They are criticized for moderating also.
articles come out about false positives made by the AI that are controversial
 
there will always be critics
 
articles come out about the moderators having psychological issues cause of what they wathc
^ thats the bigger issue
 
10:27 PM
yeah that's a problem
 
@TimCastelijns that's a clever point, for monetisation purposes good to let this pass
 
And FB gets blames for A. Not paying them enough and B. Making them watch that stuff
 
Thanks. I based it on the US elections
 
@TimCastelijns How do you mean?
what do they let through that benefits them?
 
ads * views
 
10:29 PM
the real issue is the people
 
Don't play ignorant. Everyone knows what fb does
 
people are stupid and cruel
and that cant be solved no matter how hard we try to pretend we can
 
that's the reality we live
 
@JBis and what is fb made of?
 
Bytes!
 
10:31 PM
hmmf
@MehdiB. PHP, as I said people are stupid and cruel
 
Php and people
 
Anyone familiar with zfs?
 
I like how this semi serious discussion suddenly turned into php bashing
 
It truly is the #1 issue facing humanity though
If it wasn't for PHP the Russians couldn't have gotten Trump elected
 
@TimCastelijns Hahaha let's blame the bad targeted ads we got about php XD
 
10:34 PM
Idea: if we break php we kill two birds with one stone
 
Should we have a civil discussion with the php room on neutral grounds? The Matlab room
 
Idea: Russians purposely push vulnerable code to php repo and then exploit it on Facebook
 
So they just push normal PHP code then?
3
 
@MehdiB. the PHP room is NSFW
2
 
Not Suitable For Work
 
10:36 PM
@DaveS yeah we gotta explain them how bad php is for mankind
 
Not Seriously For Work
We must look to more important things
Such as helping me with ZFS
 
@RaghavSood is a help vampire
He asked same question twice in the span of 5 min
 
The second time wasn't a question, more of a directive
 
The php repo thing is actually kinda scary. I wonder if the community would catch.
 
10:51 PM
It happens semi-frequently with node
Happens with a lot of languages, it's easy to sneak in stuff upstream in some dependency
 
remember jcenter()? I member
 

« first day (3292 days earlier)      last day (1673 days later) »