« first day (399 days earlier)      last day (2986 days later) » 

Rob
1:00 PM
we could train it on existing successful dupe votes
 
Sam
Whatever works
 
Rob
how we decide the inputs is the hard part
which might be done by your library (forgot its name)
 
Sam
That's why we have a (basic) interface to create as many different algos as needed for testing
@Rob Library?
 
Rob
You included a resource file
to (I'm assuming) measure the linguist distance between text?
 
Sam
Oh, the PoS tagger.
Nope
That's the BagOfWords class
 
Rob
1:02 PM
What does it do, exactly?
The library that is
 
Sam
It calcs the cosine similarity between a pool of "documents" and a given query.
pool of docs = dupe targets
 
Rob
Ahh
Nice
 
Sam
Here's a link to the models file.
Just unzip it in the same dir where settings.txt lives.
 
user3956566
@Sam thnx
 
Sam
9.8MB shouldn't be too big for you. ;)
I need to push some code for reading the file though
 
1:06 PM
@Sam - 46.4 if unzipped :P
 
Sam
Ik
Disk space is cheap
 
Not when my mac cries - running out of space :P.. anyways
 
Sam
@MsY pushing
 
user3956566
oh I will roo
 
Sam
@TheLostMind :p
 
1:08 PM
And xcode crashed.. lol
 
user3956566
pushing
 
user5912150
Ada started.
 
user5912150
I found a message: 'How to build a command line tool like disk part' on stackoverflow.com
 
user5912150
I found a message: 'How to add a view in a Tablerow in android?' on stackoverflow.com
 
user5912150
I found a message: 'Jquery setTimout ruins all func' on stackoverflow.com
 
user3956566
1:13 PM
@Ada sleep
 
user5912150
Bye, sleeps for me!
 
user3956566
ok onto algorithms
 
user3956566
@TheLostMind forget the chat
 
user3956566
are you able to assist with testing against key phrases?
 
Hiya!
 
Sam
1:16 PM
Hey
 
Mind if I test a small message here?
 
Sam
Sure
 
Does that look transparent for all ^^
 
Sam
The bg, yes.
 
This is not ^^
So we need a bug report there
 
user3956566
1:18 PM
I'm using Tiny's dark script so it's all back to front
 
@MsYvette - I am still on my office laptop.. But I am working on it :).. I can do that
 
user3956566
@TheLostMind I think I need to go to bed
 
user3956566
I've had 3 hours sleep and it's after midnight
 
@MsYvette - ?
 
user3956566
I have to drive to the country tomorrow
 
user3956566
1:20 PM
I got to bed at 4am and up at 7
 
@MsYvette - Hmm. OK..
 
user3956566
I'm exhausted
 
@MsYvette - sleep
 
user3956566
I wanted to test on the dupe target mentioned in the project
 
Bye, sleeps for me!
 
user3956566
1:22 PM
under KeyPhrases.cs
 
OK..
 
user3956566
it links two posts and I wrote down the phrases I wanted to search on
 
user3956566
The do a test for accuracy and slowly increase the posts
 
user3956566
by number of linked posts closed against the target
 
user3956566
so going from top down
 
user3956566
1:23 PM
and I'm not convinced post to post checking is the way to go
 
hold on
 
user3956566
I wanted to pick groups or key phrases from the target dupe and any other high voted dupe of the target that has a variation on the theme
 
user3956566
we're trying two different algorithms
 
user3956566
to see which is more accurate
 
Sam
> The type or namespace name 'StackExchangeWebSockets' could not be found
....
 
user3956566
have you pulled
 
Sam
yes
 
user3956566
@BhargavRao voted
 
user3956566
I will run it again
 
Thanks :-)
 
user5912150
1:26 PM
Ada started.
 
user5912150
I found a message: 'SSHing from AWS Instance to AWS Instance using .pem asks for passphrase' on stackoverflow.com
 
user5912150
I found a message: 'TRX to HTML using TRXER - formatexception invalid string for TimeSpan' on stackoverflow.com
 
user5912150
I found a message: 'How to get a value input from html returned of cURL?' on stackoverflow.com
 
Hi @Ada
 
user5912150
Bye, sleeps for me!
 
1:27 PM
LoL.
 
user3956566
@Sam there's a lot of error handling that will need to be managed
 
user3956566
I'm putting her to sleep
 
I thought I killed @Ada...
 
@MsYvette - So for "http://stackoverflow.com/questions/4660142/what-is-a-nullreferenceexception-and‌​-how-do-i-fix-it" ==> extract nullreferenceexception?
@PraveenKumar - say that again and you will never see the light of day :P
 
@TheLostMind Why?
 
user3956566
1:28 PM
in the comments in the keyphrases.cs I have written the phrases I think that need to be searched
 
Sam
wth
The assemblies are referenced
 
@MsYvette - My apologies but I think this won't scale.. we are talking about several hunderd questions here right?
 
Sam
The directives are there
Why the heck won't it compile
 
user3956566
@Sam psuhed
 
user3956566
@TheLostMind ok that's the feedback I needed
 
Sam
1:29 PM
pulled
 
user3956566
so we need to go with Sam's solution
 
Sam
Ha ha
13 errors now
 
user3956566
:D
 
user3956566
hm
 
user3956566
I don't know Sam
 
1:30 PM
yes. That is the right approach.. Cosine difference
 
user3956566
Mine's fine
 
user3956566
ok
 
user3956566
I need to look at the maths of it
 
@TheLostMind Who's cousin?
 
Ada started.
I found a message: 'How do I persist SIM card serial?' on stackoverflow.com
 
user3956566
1:31 PM
@Sam I need to drive to the country tomorrow
 
I found a message: 'Best practice for support check of REST methods' on stackoverflow.com
 
user3956566
and prob wont' be around for much of the next 16 - 20 hours
 
I found a message: 'Hazelcast 3.6 - Map get element' on stackoverflow.com
I found a message: 'I want to make a number of different lists with different names' on stackoverflow.com
 
Sam
ok
 
I found a message: 'How to prevent duplicate appSettings in web.config' on stackoverflow.com
 
user3956566
1:31 PM
I want to make sure I contribute more than dribble
 
user3956566
I see you got rid of the errors
 
Sam
Indeed
Caching...
 
user3956566
ah
 
user3956566
You guys will have finished it by the time I come back.. :/
 
@MsYvette You leaving Ada alone and going?
 
Sam
1:33 PM
I need to optimize my cosine sim method now...
@MsYvette Lol
I doubt that
 
user3956566
@BhargavRao yes
 
user3956566
I'm doing a very poor job
 
user3956566
sniff
 
Sam
It's only your first bot
 
user3956566
I better go to bed, I'm horribly sleep deprived
 
1:34 PM
@MsYvette - Now that using regex is out of question.. Am I of any use now? :P
 
user3956566
night and thank you for all the hlep
 
Sam
Sleep well
 
See ya
 
user3956566
@TheLostMind no not yet
 
user3956566
just wait
 
user3956566
1:34 PM
I'm sure you can help
 
LOl.. good night
 
user3956566
Bye my darling friends and some of you my SO children xoxox
 
Sam
Cya
 
bye
 
user3956566
\o o/
 
user3956566
1:35 PM
what is that? I am tired
 
(facepalm)
 
Sam
Getting 500'd here
Bot can't join chat
 
@Sam . Yes.. SE has some issues :P
 
Sam
I've noticed :p
 
lol.. I thought so
 
Sam
1:44 PM
Apparently calculating the cosine sim over 185k words is pretty intensive...
 
how much time does it take?
 
Sam
This is why I wanted to use a PoS tagger
 
Ahhhh I forgot this room.
 
Sam
I dunno ._.
 
dang.. I don't know C-sharp.. :(
 
Sam
1:45 PM
I killed it before it had a chance to complete
 
really?.. thats not good news
 
Sam
Ik
I originally wrote the method to be more maintainer-friendly...
I never bothered optimising it.
 
Thats not a bad thing.. Premature optimziation is the root of all evil.. So you are on the right track :P
 
Sam
Yeah, ik
Fgs VS
 
ok .. I didn't get that
 
Sam
1:47 PM
VS crashing again.
(Visual Studio, my IDE)
 
whats FGs?
 
Sam
For God/Goodness Sake
 
oh.. I will remember that
 
@MsYvette hi :)
 
Sam
@TheLostMind I'll run some benchmarks
 
1:50 PM
On what?.. @Sam .. Interestingly I ran some benchmarks on regexes today :P
 
Sam
My consine sim class
 
Oh.. Yes. Thats a good idea
 
Sam
Yeah, I need to see where the bottleneck is.
 
I will try to use that library in java (it should be available)
cool
 
Sam
1:51 PM
It should be
The C# wrapper for it sucks
 
I will sit here and cheer for you :P
 
Sam
I can not emphasise that enough.
:p
 
lol.. Go Sam
!!
 
Sam
Woo
 
Sam
1:54 PM
Had to get some snacks. :p
 
Ada started.
I found a message: 'Three.js - Merge multiple geometries/meshes removing common areas' on stackoverflow.com
 
Sam
Well, it's pretty darn good for memory.
Not so much for cpu.
 
what does top say?
 
Sam
I'm on Windows. :p
 
1:58 PM
Ah.. Sorry.. my bad
 
Sam
CPU: 26%, Mem: 385 MiB.
 
Not so bad.. I must say
 
Sam
I'd switch to Ubuntu if given the opportunity.
 
and you will not regret it :P
 
Sam
But all my tools are pretty much Win-only.
 
1:59 PM
of course they will be.. C sharpie :P
 
Sam
Eventually, sure.
 
lol.. anyways.. I will go now.. if there is anything a java programmer can do to help, do let me know @Sam. Cheers.. Have a great day :)
 
Sam
So as VS comes out for linux, I can kiss windows goodbye.
@TheLostMind Alright, thanks. :) You too!
 
of course.. many people would do that
bye
 
Sam
Cya
Ha ha, 8 mins 15 secs to compute the similarity of one post.
 
2:07 PM
Ada started.
 
What the hell?.. Man really?.
 
Sam
Yep
 
How many cores do you have?
 
Sam
4
 
physical?
 
Sam
2:11 PM
But it's not utilising all of them
Logical
 
ok..
I see
This is a CPU intensive operation.. shouldn't work this bad..
whats the name of the library again?
 
Sam
Even if I were to use more threads, 8 mins is still awful
 
Will download it
for java
lol 1 minute would be aweful
 
Sam
Lol ikr
Standford.NLP.POSTagger
 
ok
tx
 
2:13 PM
Idli, Dosa, Vada, Sambar.
 
Sam
The tagger itself isn't enabled in this project yet though.
Np
 
check again :P @PraveenKumar
@Sam - Oh I see
 
Sam
Due to performance issues.
 
@TheLostMind Oops.
 
Sam
The C# wrapper has terrible memory leaks (reaching +1 GiB), so.
 
2:15 PM
lol.. call java library from C# then :P
 
Sam
Eh
I'd prefer to just rip out the essential parts of the lib and implement my own C# version.
 
see. that makes more sense
 
Sam
I've had a look at the source... So. Many. Layers. Of. Abstraction. o_o
Even to do stupidly simple things.
It's crazy.
 
lol.. I will have to see if I understand how the java code part on my system :P
 
2:21 PM
tX
 
3:02 PM
Ada started.
I found a message: 'Is there any solution to convert string to money amount?' on stackoverflow.com
Ada started.
Ada started.
I found a message: 'confirmation of account not working' on stackoverflow.com
Ada started.
I found a message: 'How can I pass a variable from imacros to a javascript?' on stackoverflow.com
 
Sam
3:21 PM
Finally found the bottleneck
It's as I suspected, reconstructing the dupe targets is the most intensive operation in the method.
Which would be due to the class's design.
 
Ada started.
I found a message: 'Passing an array from a json file to angular custom directive' on stackoverflow.com
 
Sam
> An unhandled exception of type 'System.AggregateException' occurred in mscorlib.dll

Additional information: One or more errors occurred.
... so helpful.
 
inner exceptions?
 
Sam
Yesh
Just wasn't expecting that "additional information"
 
Entity framework is the same way. "An exception occurred, check the inner exceptions for details"
and then I punch my computer monitor
 
Sam
3:36 PM
:)
Well that's what happens when you try to use Parallel.ForEach without checking the source collection.
 
nice
 
Sam
Throwing more threads at the function only masks the root issue though. I need to redesign the entire class.
Yay
 

« first day (399 days earlier)      last day (2986 days later) »