« first day (1744 days earlier)      last day (1555 days later) » 

6:40 AM
good morning
 
7:17 AM
morning all
 
Hello hello :-)
 
7:40 AM
Hello
 
7:51 AM
Anyone know anything about creating tests to evaluate data scientists? We opened a position for data scientist and we are getting a lot of CVs so they told me to create a test in order to filter them
 
8:11 AM
what tools they need to use, then Google should have plenty of example tests?
Recently we had interviews, I just made up stuff from scripts I used in the past, R+bash
 
@Sotos I would usually check if they are have some basic understanding of ML rather just using stuff out of the box. One of my favorite questions is "What is the difference between regression and time series analysis?" most of the black box users won't be able to answer this
Then you can go into stuff like whats sigmoid, what is back-propagation, chain rule, forward-propagation, cross-validation, stuff like that
finally, I would give them some easy coding task and see how they approach it, do they Google, do they solve it wisely or just using a plain loop, etc.
@Sotos I like this question a lot stackoverflow.com/questions/42897389/…
It is very easy but there are so many ways to solve it
 
@DavidArenburg This is the direction I am going. I want to see If the understand the concepts not just of ML but statistics in general too. So stuff like 'describe the types of probability sampling' or 'descriptive Vs inferential stats', then some ML (I loved your question, I am stealing it) and finally coding
 
I had one guy that solved it very creatively, instead of switching > and < around, he just moved the values around the < > sign. This way, he didn't need to know what's the sign. E.g., instead of b<3 -> b>3, his simply did b<3 -> 3<b, I thought it was absolutely brilliant
 
8:26 AM
nice one!
 
brilliant indeed!
These type of questions can show a lot about someone.
This is great! Thanks David!!!
 
Indeed. An important thing is not to ask too complicated questions, as you will need to spend a lot of time on explaining them and then wait a long time for a solution. A simple question can also be answered brilliantly or balantly
 
I remember at my phd viva, one of the examiners asked (about measuring goodness of fit): Why is this value (say) 4.5? And my answer was 'because that's the value that maximizes the likelihood function'. Examiner looked at me and said 'That's a great answer' :D
 
@Tensibai :-) (thanks !!)
 
you're welcome :)
 
 
1 hour later…
10:28 AM
ok asking here as I'm banging my head:
Source:
> lapply(dat$x,str_locate_all, pattern=my_patterns)[[10]]
[[1]]
     start end
[1,]     1  10

[[2]]
     start end
[1,]    12  16
[2,]    27  31

[[3]]
     start end
I wish to get :
> data.frame(start=c(1,12,27),end=c(10,16,31))
  start end
1     1  10
2    12  16
3    27  31
> dput(lapply(dat$x,str_locate_all, pattern=my_patterns)[[10]])
list(structure(c(1L, 10L), .Dim = 1:2, .Dimnames = list(NULL,
    c("start", "end"))), structure(c(12L, 27L, 16L, 31L), .Dim = c(2L,
2L), .Dimnames = list(NULL, c("start", "end"))), structure(integer(0), .Dim = c(0L,
2L), .Dimnames = list(NULL, c("start", "end"))))
 
That looks like do.call(rbind, your_list)...
 
Thanks :)
(Still playing with a question from yesterday)
 
@Tensibai data.table::rbindlist(myList)
@Tensibai closing as dupe :) stackoverflow.com/q/2851327/680068
 
rbindlist barks that the data are not data.frame or data.tables or list :shrug:
aww, I applied it on the external lapply.. silly me
> rbindlist(str_locate_all(dat$x[10],my_patterns))
Error in rbindlist(str_locate_all(dat$x[10], my_patterns)) :
  Item 1 of list input is not a data.frame, data.table or list
Ok, I'm not that crazy, it was indeed crashing
 
10:44 AM
Yeah, it needs input as list of df or dt
 
do.call(rbind works, and this let me stay in base R :p
(for the sake of it)
 
if data is small do.call(rbind is fine.
 
from an OP comment: "(dat has 14k rows), my_patterns 46 elements"
 
132
Q: Why is rbindlist "better" than rbind?

Chinmay PatilI am going through documentation of data.table and also noticed from some of the conversations over here on SO that rbindlist is supposed to be better than rbind. I would like to know why is rbindlist better than rbind and in which scenarios rbindlist really excels over rbind? Is there any adv...

 
 
1 hour later…
11:50 AM
#TIL data.table::fcase stackoverflow.com/a/59446689/680068 looks like a recent feature.
 
 
6 hours later…

« first day (1744 days earlier)      last day (1555 days later) »