« first day (1419 days earlier)      last day (3544 days later) » 

11:00 PM
My guess is that windows is locking the directory every time you do a move. So only one image can be moved at a time
and OS moves, in-and-of-themselves are SLOW if you are on an HDD
it is faster on an SSD but still fairly slow when doing so many of them
 
it's on a SSD
 
Here is the real question, If you were to copy paste all the files manually, how long would it take?
 
I ran it on my ubuntu laptop last night and the outcome was even worse
but this laptop also has a weaker cpu
by that you mean every file one by another or as a bunch?
 
as a bunch
if you were to just copy all of them, then paste all of them in a new directory, how long would it take for windows to do all the copies
If that is at least half the time of your overall program, that is probably the real issue.
 
about 25 seconds
 
11:06 PM
hmm...
What profiler are you using?
 
ahh screw it - just going to delete my answer...
 
cProfile
 
rbrb all
 
rbrb
 
rbrb
 
11:09 PM
@Demnogonis What are your top 3 hot spots now?
OMG i know one thing that will help
untab line 92
 
combicount = len(combinations)?
 
cant believe I didnt see that earlier...
ya
You are getting the length everytime
you only need the length at the end
 
that was actually a mistake
but the consumed time seems to be fractional if I am reading this correctly
6453302/6453296 0.899 0.000 0.899 0.000 {built-in method len}
 
You mean you tabbed it on accident? Ya, that happens to new python programmers.
ya, its possible it might not change much. But it is one thing to improve upon.
 
yes definetly :D
thats the full profiler output
{method 'acquire' of '_thread.lock' objects} seems to be an issue
oddly I cant find any calls for math.sqrt or calc_rms() in general o.o
 
11:16 PM
Can you sort by cumtime?
 
not without rerunning it
I dumped this output into a text file because the buffer of the windows console is still awfully small
 
Ya... I would guess the issue is that the os is locking at each image move, and each thread is waiting for the lock to do the move. You can test this by NOT doing the move, just to see how long it takes
I would comment out lines 42-49. Do a quick test.
But unfortunately I got to go, so if you need further help, hit me up tomorrow, or post a question and tag me in a comment.
 
yep I will
It's 1:20 AM in germany already
I'll let it run over night and hit you tomorrow
thanks for your help :)
rbrb all
 
11:32 PM
rbrb
 
11:54 PM
I know I'm going to regret eating strawberry trifle at 1am... my excuse though is it's declicious
 
That's quite often my reasoning when opening a second bottle ...
(not of trifle. That would be odd)
 
Oh, the times I've ended up on the floor not knowing how I got there after too many bottles of trifle? :p
@Zero my logic does make sense on this one doesn't it?
 

« first day (1419 days earlier)      last day (3544 days later) »