« first day (1483 days earlier)      last day (2328 days later) » 

par
11:56 AM
I'm using R fread to read a table with 3 columns and 87 million roads (3.3GB size).
its taking more than 10 minutes to read in, is this normal? I remember fread crunching through files of 3/4 GB much quicker than this in the past...
 
par
12:41 PM
took over an hour to read a 3.3GB file with fread
 
 
4 hours later…
4:47 PM
3.3 GB that takes an hour is long
Does it not spit out any warning?
you can specify the column types in advance
 
 
2 hours later…
6:40 PM
@Heisenberg I would guess that he's running out of real RAM.
@par How much memory do you have available when you do this? Is your machine swapping?
 

« first day (1483 days earlier)      last day (2328 days later) »