« first day (61 days earlier)      last day (3238 days later) » 

12:42 AM
@Jaap So there might be hope, after all ;P
 
 
7 hours later…
7:31 AM
Hello
 
 
1 hour later…
8:56 AM
Hi !
 
Hello @CathG
 
9:50 AM
just in time to say goodmorning to you all
at least in my timezone ;-)
 
lol. Good morning @Jaap
 
@CathG hi!
 
hi guys
 
Hi David
I'm working with a coloured elephant today :-)
 
@DavidArenburg hi
 
9:56 AM
@Jaap hi
 
Morning @Jaap
Hello @DavidArenburg
 
@Tensibai hi man
 
@CathG have fun!
 
@Jaap thanks, for now, I'm trying to just install the package and for that I had to upgrade R (to "World-Famous Astronaut" ^^), so I'm re-installing every package, it takes a lot of time......
 
@CathG i wrote a script for that a while ago
 
10:23 AM
@CathG Hi to you to (sorry for not responding)
 
10:54 AM
@DavidArenburg, np I considered myself among the "guys" ;-)
@Jaap thank for the link, can't reach the page though, must have security problems...
@Tensibai, sorry, forgot to say thanks for the clarification around "," or "." as decimals ! :-)
 
11:10 AM
setwd("~/Dropbox/Data")

# get all installed packages before upgrading R and write them to a file
pack <- data.frame((.packages(all.available=TRUE)))
write.table(pack, file="pack.txt", sep="\t", row.names = FALSE)

# upgrade R

# read file with previously installed package names and convert to a vector
x <- read.table("pack.txt", sep="\t", header=TRUE, strip.white=TRUE)
y <- as.vector(x[,1])

# get vector of installed packages included in base R install
z <- .packages(all.available=TRUE)

# creat vecor of packages that need to be installed
@CathG see above ;-)
 
@Arun any input on this comment. He is right about the documentations but I think he is wrong regarding the risk of using copy on anything else than data.table objects.
 
If anyone has suggestions for improvement of the above procedure, I like to hear them :-)
 
@Jaap thanks :-) (for now, I only had a "script" with the list of all packages I use - I update it each time I install a new package - one line for CRAN packages, one line for Bioconductor packages...). The "upgrade R" part is kind of a problem for me though, as I haven't got admin privileges, so I have to find a workaround....
 
@CathG np, you're welcome
@CathG and @Jaap For this kind of task I would go using Chef and a cookbook managing the installation which could allow to determine a list of packages too.
 
11:31 AM
@Tensibai I think you should have a talk with my system administrators ;-)
 
Specifically for @CathG So you can ask your helpdesk/sysadmins to set a task (on windows) or a sudo entry along with a limited right on the files to allow you to change version and package list only so your admin is OK with what is done, and you have the freedom of updating/changing what has to be done in a defined range
<= sysadmin inside :)
 
That would definitely be better than what I'm doing right now, I'm not sure they will bother doing this though... but I still can ask. Thanks !!
 
You're welcome ;)
@CathG there's already a cookbook for this github.com/stevendanna/cookbook-r but mainly aimed at linux target
 
thanks (again), I'm on windows though :-(
 
sounds not too hard to get to windows (mainly path change and command lines to adapt)
@DavidArenburg flagged NAA
 
@Tensibai yes me too
 
@DavidArenburg @Tensibai, I'm gonna also flag but it's only monday and I'm still gentle so I think I'll explain the concept of indices to the guy first..............................
 
@CathG As you wish, but you'd better tell him he should ask a question instead of answering with his question (that's what the NAA flag is for, the deletion give the reason to the author without needing to enter a discution with him)
(Take him as a shorter for he/she, his/her, and so on)
 
@Tensibai, to explain that, I flagged the "answer" (like you said, he will have the exact reason). But you're right, I'll add something anyway because I don't want to encourage him to post questions as answers !
 
12:25 PM
@CathG I'm affraid that's the exact opposite, getting an answer in comment for a question asked as an answer on another question is not discouraging IMHO
The gentle commetn could be: Open your own question and ping me in comment with @... See How to Ask to improve your question before that
 
well, even with the comment on the fact it is not an answer ?
I like your "gentle comment", gonna do that instead next time ! :-)
 
;o)
By experience, if there's what they're looking for in the comment, anything along won't be read
 
@DavidArenburg I also flagged it as NAA
 
@DavidArenburg I think it's an issue with the external pointer. Either copy() needs to restrict to data.table input or it should take care of list of data.tables appropriately.. Could you please file an issue? Thank you!
 
@Arun I'm not sure I'll be able to formulate it correctly.
 
12:41 PM
@Tensibai interesting, can you use that on a single PC as wel (i see references to servers)
 
@Jaap yep, chef a 'solo' or 'zero' mode allowing it to be used isolated
In fact the chef-server install itself is done via a solo run of chef-client
(One in many use case)
 
12:54 PM
@Tensibai thanx, at the moment I need to finsih some other stuff; but will look into it more thoroughly later (somewhere during the summer probably)
 
@Jaap You're welcome, we're managing 400 servers with Chef, if you're stuck somewhere I'll be happy to help
 
@Tensibai thanx! I will keep it in mind :-)
@Tensibai one quick question: is it possible to update R (and the installed packages) on several computers at home from one of them?
 
@Jaap I'm out of knowledge there, not managing R that much. I assume you may 'proxy-cache' CRAN to avoid redownloading at each time. But I don't know if there's specific R tools for this
 
@Tensibai one of the things I'm looking for is a solution to keep the packages I installed on my iMac & MacBook in sync (i.e. the same packages on both)
@Tensibai anyhow: I will dive into Chef later, it looks really interesting
 
@Jaap it is really helping for configuration management
 
 
2 hours later…
2:56 PM
@StevenBeaupré Though I don't look at their profile before answering questions, but some people just ignore even repeated requests to accept a solution. For example, this guy. He posted more than 30 questions and just accepted one answer. I commented repeatedly to his posts for accepting solutions, but he is not ignoring. Still his questions gets answers.
 
@akrun not sure what you mean by setting. if i add setkey before the "onceby" one, it does indeed speed up (only 30% slower than keyit), if that's what you meant
 
@Frank I meant that for the secondary runs, it would take less time,
 
oh, right. that's also part of why i only ran it once
replications=1, just using benchmark because it gives a nice table, not for proper/normal benchmarking
 
I thought setkey for a single run would be costly,
 
that's also what i had been told, or at least it wouldn't be beneficial
i've added that benchmark
or item
about twice as fast to set the key in this instance
 
3:06 PM
@StevenBeaupré If you have lots of time, this person's posts take a half-day or full.
@Frank I'll check it
@Frank I haven't used rbenchmark. Is it better than microbenchmark
@Frank Any idea about clubbing the two slice to a single one here I like @DavidArenburg's approach with rev, but it seemed tricky
 
@akrun I don't think my rev approach is very efficient though...
I like Thomases approach better
 
@DavidArenburg His approach is good, I modified my second solution inspired from his
 
@akrun yes, I saw
I also used which too as its better than match
I don't have time for SO lately, so most of my recent answers are not so good :(
 
3:22 PM
@DavidArenburg busy with work?
 
@akrun yes
and other stuff
 
@DavidArenburg I will see u later.
gtg
 
@akrun bye
 
3:39 PM
@akrun i don't know much about benchmarking. i was just looking for tabular output instead of a bunch of system.time statements
@DavidArenburg I'm using 1.9.4 here at work. The results may differ in 1.9.5. Anyway, I think it's fair to say they're all about the same except the one that recognizes that only two character values are relevant for the OP's application, c(NA_character_,""). It's hard to generalize such a thing as this, I suspect. One could also try using a logical column and then altering its storage mode to integer (takes about the same as +, I guess).
 
onceby is faster two times than once? Strange IMO
I'm guessing this should be benchmarked several times on fresh sessions maybe
 
if i knew the reasons for differences in performance, i'd've discussed them :) happy to add anything if you figure it out

yeah, i never came across the "right" way to benchmark data.table's modify-by-reference operations. that might make a good SO question
the data.table wiki has some benchmarks against dplyr and pandas, but i never looked into how it was done
 
You also cheated by seeing at his previous question :)
 
what i find strange is that oncebyk is so much faster than onceby. setting the key simply to use it once shouldn't be beneficial. that was like the first thing i was told about data.table
 
I wasn't able to reproduce OPs data cause didn't know why is he using !nzchar(x) in the frist place.
 
3:51 PM
you're right :)
 
I wouldn't use it in the first place
you keyit is nice though
Though I'm surprised key doesn't have an overhead
 
maybe it has to do with the smallish number of groups in my example
 
@Frank I think you also gaining from the binary join
 
agstudy introduced the OP to nzchar to match ""
i'd never seen the function before
 
probably v 1.9.5 will have different results too
 
3:53 PM
yeah
 
I once suggested key + binary join in one of my answers instead of just == and got a full rain of criticism from eddi :)
 
i don't read too much into the results that is useful for practical application beyond: consider matching the char vectors directly instead of testing with is.na and nzchar
 
k
need to go
 
cya
eddi knows many things that i don't, but i think we've all been guilty of extrapolating known cases of inefficiency beyond where they actually apply or are relevant
 
 
4 hours later…
7:41 PM
@akrun slice() only accepts one expression. I managed to do it in one call using filter()
 

« first day (61 days earlier)      last day (3238 days later) »