« first day (399 days earlier)      last day (3010 days later) » 

Rob
Rob
13:00
we could train it on existing successful dupe votes
Sam
Sam
Whatever works
Rob
Rob
how we decide the inputs is the hard part
which might be done by your library (forgot its name)
Sam
Sam
That's why we have a (basic) interface to create as many different algos as needed for testing
@Rob Library?
Rob
Rob
You included a resource file
to (I'm assuming) measure the linguist distance between text?
Sam
Sam
Oh, the PoS tagger.
Nope
That's the BagOfWords class
Rob
Rob
13:02
What does it do, exactly?
The library that is
Sam
Sam
It calcs the cosine similarity between a pool of "documents" and a given query.
pool of docs = dupe targets
Rob
Rob
Ahh
Nice
Sam
Sam
Here's a link to the models file.
Just unzip it in the same dir where settings.txt lives.
user3956566
@Sam thnx
Sam
Sam
9.8MB shouldn't be too big for you. ;)
I need to push some code for reading the file though
13:06
@Sam - 46.4 if unzipped :P
Sam
Sam
Ik
Disk space is cheap
Not when my mac cries - running out of space :P.. anyways
Sam
Sam
@MsY pushing
user3956566
oh I will roo
Sam
Sam
@TheLostMind :p
13:08
And xcode crashed.. lol
user3956566
pushing
user5912150
Ada started.
user5912150
I found a message: 'How to build a command line tool like disk part' on stackoverflow.com
user5912150
I found a message: 'How to add a view in a Tablerow in android?' on stackoverflow.com
user5912150
I found a message: 'Jquery setTimout ruins all func' on stackoverflow.com
user3956566
13:13
@Ada sleep
user5912150
Bye, sleeps for me!
user3956566
ok onto algorithms
user3956566
@TheLostMind forget the chat
user3956566
are you able to assist with testing against key phrases?
Sam
Sam
13:16
Hey
Mind if I test a small message here?
Sam
Sam
Sure
Does that look transparent for all ^^
Sam
Sam
The bg, yes.
This is not ^^
So we need a bug report there
user3956566
13:18
I'm using Tiny's dark script so it's all back to front
@MsYvette - I am still on my office laptop.. But I am working on it :).. I can do that
user3956566
@TheLostMind I think I need to go to bed
user3956566
I've had 3 hours sleep and it's after midnight
@MsYvette - ?
user3956566
I have to drive to the country tomorrow
user3956566
13:20
I got to bed at 4am and up at 7
@MsYvette - Hmm. OK..
user3956566
I'm exhausted
@MsYvette - sleep
user3956566
I wanted to test on the dupe target mentioned in the project
Bye, sleeps for me!
user3956566
13:22
under KeyPhrases.cs
user3956566
it links two posts and I wrote down the phrases I wanted to search on
user3956566
The do a test for accuracy and slowly increase the posts
user3956566
by number of linked posts closed against the target
user3956566
so going from top down
user3956566
13:23
and I'm not convinced post to post checking is the way to go
hold on
user3956566
I wanted to pick groups or key phrases from the target dupe and any other high voted dupe of the target that has a variation on the theme
user3956566
we're trying two different algorithms
user3956566
to see which is more accurate
Sam
Sam
> The type or namespace name 'StackExchangeWebSockets' could not be found
....
user3956566
have you pulled
Sam
Sam
yes
user3956566
@BhargavRao voted
user3956566
I will run it again
Thanks :-)
user5912150
13:26
Ada started.
user5912150
I found a message: 'SSHing from AWS Instance to AWS Instance using .pem asks for passphrase' on stackoverflow.com
user5912150
I found a message: 'TRX to HTML using TRXER - formatexception invalid string for TimeSpan' on stackoverflow.com
user5912150
I found a message: 'How to get a value input from html returned of cURL?' on stackoverflow.com
user5912150
Bye, sleeps for me!
13:27
LoL.
user3956566
@Sam there's a lot of error handling that will need to be managed
user3956566
I'm putting her to sleep
I thought I killed @Ada...
@MsYvette - So for "http://stackoverflow.com/questions/4660142/what-is-a-nullreferenceexception-and‌​-how-do-i-fix-it" ==> extract nullreferenceexception?
@PraveenKumar - say that again and you will never see the light of day :P
@TheLostMind Why?
user3956566
13:28
in the comments in the keyphrases.cs I have written the phrases I think that need to be searched
Sam
Sam
wth
The assemblies are referenced
@MsYvette - My apologies but I think this won't scale.. we are talking about several hunderd questions here right?
Sam
Sam
The directives are there
Why the heck won't it compile
user3956566
@Sam psuhed
user3956566
@TheLostMind ok that's the feedback I needed
Sam
Sam
13:29
pulled
user3956566
so we need to go with Sam's solution
Sam
Sam
Ha ha
13 errors now
user3956566
:D
user3956566
hm
user3956566
I don't know Sam
13:30
yes. That is the right approach.. Cosine difference
user3956566
Mine's fine
user3956566
ok
user3956566
I need to look at the maths of it
@TheLostMind Who's cousin?
Ada started.
I found a message: 'How do I persist SIM card serial?' on stackoverflow.com
user3956566
13:31
@Sam I need to drive to the country tomorrow
I found a message: 'Best practice for support check of REST methods' on stackoverflow.com
user3956566
and prob wont' be around for much of the next 16 - 20 hours
I found a message: 'Hazelcast 3.6 - Map get element' on stackoverflow.com
I found a message: 'I want to make a number of different lists with different names' on stackoverflow.com
Sam
Sam
ok
I found a message: 'How to prevent duplicate appSettings in web.config' on stackoverflow.com
user3956566
13:31
I want to make sure I contribute more than dribble
user3956566
I see you got rid of the errors
Sam
Sam
Indeed
Caching...
user3956566
ah
user3956566
You guys will have finished it by the time I come back.. :/
@MsYvette You leaving Ada alone and going?
Sam
Sam
13:33
I need to optimize my cosine sim method now...
@MsYvette Lol
I doubt that
user3956566
@BhargavRao yes
user3956566
I'm doing a very poor job
user3956566
sniff
Sam
Sam
It's only your first bot
user3956566
I better go to bed, I'm horribly sleep deprived
13:34
@MsYvette - Now that using regex is out of question.. Am I of any use now? :P
user3956566
night and thank you for all the hlep
Sam
Sam
Sleep well
See ya
user3956566
@TheLostMind no not yet
user3956566
just wait
user3956566
13:34
I'm sure you can help
LOl.. good night
user3956566
Bye my darling friends and some of you my SO children xoxox
Sam
Sam
Cya
user3956566
\o o/
user3956566
13:35
what is that? I am tired
(facepalm)
Sam
Sam
Getting 500'd here
Bot can't join chat
@Sam . Yes.. SE has some issues :P
Sam
Sam
I've noticed :p
lol.. I thought so
Sam
Sam
13:44
Apparently calculating the cosine sim over 185k words is pretty intensive...
how much time does it take?
Sam
Sam
This is why I wanted to use a PoS tagger
Ahhhh I forgot this room.
Sam
Sam
I dunno ._.
dang.. I don't know C-sharp.. :(
Sam
Sam
13:45
I killed it before it had a chance to complete
really?.. thats not good news
Sam
Sam
Ik
I originally wrote the method to be more maintainer-friendly...
I never bothered optimising it.
Thats not a bad thing.. Premature optimziation is the root of all evil.. So you are on the right track :P
Sam
Sam
Yeah, ik
Fgs VS
ok .. I didn't get that
Sam
Sam
13:47
VS crashing again.
(Visual Studio, my IDE)
whats FGs?
Sam
Sam
For God/Goodness Sake
oh.. I will remember that
@MsYvette hi :)
Sam
Sam
@TheLostMind I'll run some benchmarks
13:50
On what?.. @Sam .. Interestingly I ran some benchmarks on regexes today :P
Sam
Sam
My consine sim class
Oh.. Yes. Thats a good idea
Sam
Sam
Yeah, I need to see where the bottleneck is.
I will try to use that library in java (it should be available)
cool
Sam
Sam
13:51
It should be
The C# wrapper for it sucks
I will sit here and cheer for you :P
Sam
Sam
I can not emphasise that enough.
:p
lol.. Go Sam
!!
Sam
Sam
Woo
Sam
Sam
13:54
Had to get some snacks. :p
Ada started.
I found a message: 'Three.js - Merge multiple geometries/meshes removing common areas' on stackoverflow.com
Sam
Sam
Well, it's pretty darn good for memory.
Not so much for cpu.
what does top say?
Sam
Sam
I'm on Windows. :p
13:58
Ah.. Sorry.. my bad
Sam
Sam
CPU: 26%, Mem: 385 MiB.
Not so bad.. I must say
Sam
Sam
I'd switch to Ubuntu if given the opportunity.
and you will not regret it :P
Sam
Sam
But all my tools are pretty much Win-only.
13:59
of course they will be.. C sharpie :P
Sam
Sam
Eventually, sure.
lol.. anyways.. I will go now.. if there is anything a java programmer can do to help, do let me know @Sam. Cheers.. Have a great day :)
Sam
Sam
So as VS comes out for linux, I can kiss windows goodbye.
@TheLostMind Alright, thanks. :) You too!
of course.. many people would do that
bye
Sam
Sam
Cya
Ha ha, 8 mins 15 secs to compute the similarity of one post.
14:07
Ada started.
What the hell?.. Man really?.
Sam
Sam
Yep
How many cores do you have?
Sam
Sam
4
physical?
Sam
Sam
14:11
But it's not utilising all of them
Logical
ok..
I see
This is a CPU intensive operation.. shouldn't work this bad..
whats the name of the library again?
Sam
Sam
Even if I were to use more threads, 8 mins is still awful
Will download it
for java
lol 1 minute would be aweful
Sam
Sam
Lol ikr
Standford.NLP.POSTagger
14:13
Idli, Dosa, Vada, Sambar.
Sam
Sam
The tagger itself isn't enabled in this project yet though.
Np
check again :P @PraveenKumar
@Sam - Oh I see
Sam
Sam
Due to performance issues.
@TheLostMind Oops.
Sam
Sam
The C# wrapper has terrible memory leaks (reaching +1 GiB), so.
14:15
lol.. call java library from C# then :P
Sam
Sam
Eh
I'd prefer to just rip out the essential parts of the lib and implement my own C# version.
see. that makes more sense
Sam
Sam
I've had a look at the source... So. Many. Layers. Of. Abstraction. o_o
Even to do stupidly simple things.
It's crazy.
lol.. I will have to see if I understand how the java code part on my system :P
14:21
tX
15:02
Ada started.
I found a message: 'Is there any solution to convert string to money amount?' on stackoverflow.com
Ada started.
Ada started.
I found a message: 'confirmation of account not working' on stackoverflow.com
Ada started.
I found a message: 'How can I pass a variable from imacros to a javascript?' on stackoverflow.com
Sam
Sam
15:21
Finally found the bottleneck
It's as I suspected, reconstructing the dupe targets is the most intensive operation in the method.
Which would be due to the class's design.
Ada started.
I found a message: 'Passing an array from a json file to angular custom directive' on stackoverflow.com
Sam
Sam
> An unhandled exception of type 'System.AggregateException' occurred in mscorlib.dll

Additional information: One or more errors occurred.
... so helpful.
inner exceptions?
Sam
Sam
Yesh
Just wasn't expecting that "additional information"
Entity framework is the same way. "An exception occurred, check the inner exceptions for details"
and then I punch my computer monitor
Sam
Sam
15:36
:)
Well that's what happens when you try to use Parallel.ForEach without checking the source collection.
nice
Sam
Sam
Throwing more threads at the function only masks the root issue though. I need to redesign the entire class.
Yay

« first day (399 days earlier)      last day (3010 days later) »