« first day (3382 days earlier)      last day (1548 days later) » 

12:56 AM
@Tim this is especially concerning
37
A: Change in roles for Jon Ericson (leaving SE)

aparente001College Confidential is a good site and it will be even better with you on board. (I can't help but wonder what factors might have led you to this decision, but of course it's up to you how much or how little you want to share.) Update: Here is an excerpt of the Jan 17, 2020 blog post Jon publ...

 
Tim
1:32 AM
nothing new
 
How is it suggested to store SQL db/table creation scripts in a project?
They only need to be created once but if I share the project on github people need to be able to construct the databases.
 
Depending on what you're using, you can have a file that has something like if !table_name exists: create table
I don't know if that's preferred or not but we've done that in a lot of different projects
@JBis ^
 
1:55 AM
make a scripts thats going to create and setup everything
 
So actual code in the lang for project? Not just straight SQL scripts?
 
that would be good actually
i was thinking more of a shell/bash script
but i guess you would want to cover as much platforms as possilbe
so yeah, lang of a project should be good
 
SHIT
I'm fucking stupid
Managed to drop the frying pan on my foot
6
 
lmfao
@IvanMilisavljevic really? alright.
 
yeah, you would want it the same as what the project uses
would be a lot easier in multiple ways
 
2:11 AM
ok thanks
 
2:24 AM
@JBis Normally, you have a bunch of SQL/DSL scripts, which some library or other program can run against a db as migrations, db tracks its current state, program checks the db version vs. migration list and applies all the missing SQL commands
Most migration systems opt for a DSL since SQL is not truly portable
So they'll take the DSL and emit the correct SQL depending on the db you're connecting to
I know some people who keep a skeleton RoR project solely to handle db state since rails has really good interfaces for it
But you can find something like this in all major languages
 
3:05 AM
@RaghavSood wouldnt you want the same db type all the time?
 
3:26 AM
Depends on the application
A lot of applications have dual operating modes
For highly available set ups, they want something like Postgres which can cluster and scale
While single node deployments can get by just fine with sqlite
Plus, sometimes you want to retain the ability to move between dbs at a later date - sqlite might be enough for starting out, but on the off chance that you get enough users to need to grow, you don't want to rewrite the entire db layer just to move to postgres
But generally, the larger you get, the more closely coupled you will end up to your primary db
It helps in those cases since you can get a lot more performance and db specific features to make life easier
 
 
7 hours later…
10:42 AM
7 hours later...
 
No.
 
11:05 AM
yo @RaghavSood do you have an answer to this?
12 hours ago, by Ivan Milisavljevic
What would be the optimal arch pattern for backend services nowadays?
 
I do
For $150/hr
Really tho, depends heavily on what you're building a backend for
And what you need out of it
 
best i can do is 5$
 
We'll have to bill in 30s increments then, 120 increments minimum upfront
I would avoid throwing in vault, consul etc. unless you really need them
 
basically im building playstore reivews indexing api
 
For many services, you can build a very robust backend with just a db, cache, and app layer
 
11:09 AM
i know
but i want to use them, becuse im feeling nostalgic
 
How will you be serving that data?
For storing pure text info, just postgres with fulltext indexing or any other text friendly db (basically all of them) is enough
 
2 entrypoints CLI and HTTP
 
If you're going to be serving it up in some form besides just storing it and doing a bunch of out of the loop processing, then you can look at what you need for caching etc.
But for a low traffic system, you probably don't need anything
 
im planning to go with PG + Elastic
 
Why both?
 
11:12 AM
well i guess PG as a store and elastic for search and analysiss
elastic with kibana on top
 
You can probably skip postgres then, elasticsearch should be able to handle simpler models directly
 
also its important to note thats just a side project of mine
i want to do sentiment analysis and reviews tagging, sorting and stuff like that in the end
 
Hmmmmm
I'd say you'd be fine with postgres and an app layer
 
And then have a utility pipeline to move it into elastic+kibana for when you need to analyze stuff
And then store the results back into postgres
 
11:14 AM
ok im down with that
basically pg as a main data store
 
That'll let you keep the elastic search deployment simple without having to scale it to handle all of your data at once
 
and Logstash as an adapter for data processing
 
And postgres is pretty rock solid for lots of data going in and out
Ideally, you should use something like grpc services to define your API endpoints
 
i will do that a little bit later for sure
 
You can then either use the grpc code directly, or wrap it with an HTTP gateway for an HTTP option (can still use grpc while doing that)
The advantage being that having everything defined in protobufs as gRPC endpoints and models makes it trivial to generate server/client stubs for most languages
 
11:16 AM
i know
 
So when you need to throw together a shell or http or any new tool, half the work is done for you
 
ok that makes sense
i had this part mostly covered in my mind
 
Remember to run it all behind tor with no links to your own google account since I'm pretty sure scraping all the reviews is against ToS
Best to change your name and get a few new passports too for when Google comes for you
 
i was asking about code arch patterns mostly
yeha thats going to be another issue
basically Playstore gives you the api to pull the data for your app
and there is a seciont with simmilar apps
 
For architecture, I'd say modularize as much as you can, but keep things monorepo and single service as much as possible - splitting into tons of microservices early on can be more of a headache than it is worth
 
11:19 AM
so my idea is to pull reviews from competition basically, so you can use that thata for marketing/roadman and stuff
 
Fair enough
That's probably not all that against ToS
 
yeah but you cant really pull reviews from apps that are not your own
 
You probably can if you can get a service account or token from the owners
 
so thats a step i have yet to figure out
@RaghavSood i dont thing that would be possible
 
You can consider just scraping it :D
 
11:22 AM
yeah there are couple of apis that are doing this for you
if you have any repos with solid arch approach share it :)
 
Hmm, none of mine are public
What language are you working in?
 
ah not yours necessarily, if you know someone is doing the good work
im fine with any language
im thinking about Vert.x or Spring Boot
 
I'm mostly familiar with golang, but you can look at dgraph, go-ethereum, badger, for those
The general approach will likely translate across a few languages
Maybe not all the way to Java tho
 
Tbh, the only way to get here is to build it :D
 
11:36 AM
for sure
it was so long since i did this stuff
 
Offer's still up if you want to help me with my blockchain stuff :D
 
but its super fun, thats why im doing it like its going to require insanse scale
 
The best way to do that is to build something at an insane scale :D
 
@RaghavSood thats really tempting
 
11:37 AM
Just thinking about it will miss stuff
I guarantee it :D
Source: I missed stuff
 
in the end i will be the only one using it
so yeah everything needs to be HA
 
sup the bot and the humans
what voodoo shit you building?
 
HA is a deep hole to get into
The last nines take up 90% of the time
Time that is better spent on other stuff
I wouldn't bother with more than 99.9% unless you have deep, deep pockets and people to spare
 
23 mins ago, by Ivan Milisavljevic
so my idea is to pull reviews from competition basically, so you can use that thata for marketing/roadman and stuff
Playstore indexing apis
@RaghavSood as i said for my own fun
 
Fun or not, even doing it on your spare time will limit how HA you can get just based on cost
 
11:43 AM
but i have to have a mindset for something like that :D
 
It's easy to run two db instances
It's not so cheap to run geographically distributed stacks in their entirety
It's not that it's not doable, it's just expensive :D
 
Instead, I will let you join my team for the low, low cost of $500/month
Even better, you'll earn a 5% commission on anyone else you get to join the team under you!
 
lol
that sound like a
 
Nonsense
It's a reverse funnel scheme
Totally different
 
11:46 AM
haha
!rotate
 
Permission denied
 
12:28 PM
Dodo
 
1:03 PM
\o/
 
2:00 PM
~\o/~
waft
 
2:13 PM
@WarrenFaith Wow that was depressing... It says to be aware and then use that awareness to develop coping mechanisms for your miserable existence. lol
 
 
3 hours later…
5:19 PM
posted on January 19, 2020

Android Weekly #397 #outlook a{ padding:0; } body{ width:100% !important; margin:0; padding:0; } body *{ -ms-text-size-adjust:none!important; -webkit-text-size-adjust:none!important; } body,.wrapper{ background:#ffffff; color:#505050; font-family:Arial, sans-serif; font-size:12px; } table,table td{ border-collapse:c

 
@IvanMilisavljevic oic
 
6:16 PM
@CaliFornia I like how you changed your name while keeping the "CF" abbreviation relevant :D
 
 
2 hours later…
Tim
8:15 PM
@Mehdi have you seen Good Boys?
 
 
1 hour later…
9:16 PM
o/
 
10:11 PM
yo, Mauks
 

« first day (3382 days earlier)      last day (1548 days later) »