« first day (399 days earlier)
← previous day
next day →
last day (1394 days later) »
00:00 - 03:00
03:00 - 09:00
09:00 - 12:00
12:00 - 13:00
13:00 - 16:00
17:00 - 19:00
19:00 - 00:00
Rob
1:00 PM
we could train it on existing successful dupe votes
Sam
Whatever works
Rob
how we decide the inputs is the hard part
which might be done by your library (forgot its name)
Sam
That's why we have a (basic) interface to create as many different algos as needed for testing
@Rob Library?
Rob
You included a resource file
to (I'm assuming) measure the linguist distance between text?
Sam
Oh, the PoS tagger.
Nope
That's the BagOfWords class
Rob
1:02 PM
What does it do, exactly?
The library that is
Sam
It calcs the cosine similarity between a pool of "documents" and a given query.
pool of docs = dupe targets
Rob
Ahh
Nice
Sam
Here
's a link to the models file.
Just unzip it in the same dir where settings.txt lives.
Ms Yvette
@Sam thnx
Sam
9.8MB shouldn't be too big for you. ;)
I need to push some code for reading the file though
TheLostMind
1:06 PM
@Sam - 46.4 if unzipped :P
Sam
Ik
Disk space is cheap
TheLostMind
Not when my mac cries -
running out of space
:P.. anyways
Sam
@MsY pushing
Ms Yvette
oh I will roo
Sam
@TheLostMind :p
TheLostMind
1:08 PM
And xcode crashed.. lol
Ms Yvette
pushing
user5912150
Ada
started.
user5912150
I found a message: 'How to build a command line tool like disk part' on stackoverflow.com
user5912150
I found a message: 'How to add a view in a Tablerow in android?' on stackoverflow.com
user5912150
I found a message: 'Jquery setTimout ruins all func' on stackoverflow.com
Ms Yvette
1:13 PM
@Ada sleep
user5912150
Bye, sleeps for me!
Ms Yvette
ok onto algorithms
@TheLostMind forget the chat
are you able to assist with testing against key phrases?
Bhargav Rao
Hiya!
Sam
Hey
Bhargav Rao
Mind if I test a small message here?
Sam
1:16 PM
Sure
Bhargav Rao
Does that look transparent for all ^^
Sam
The bg, yes.
Bhargav Rao
This is not ^^
So we need a bug report there
Ms Yvette
I'm using Tiny's dark script so it's all back to front
TheLostMind
@MsYvette - I am still on my office laptop.. But I am working on it :).. I can do that
Ms Yvette
1:20 PM
@TheLostMind I think I need to go to bed
I've had 3 hours sleep and it's after midnight
TheLostMind
@MsYvette - ?
Ms Yvette
I have to drive to the country tomorrow
I got to bed at 4am and up at 7
TheLostMind
@MsYvette - Hmm. OK..
Ms Yvette
I'm exhausted
TheLostMind
@MsYvette - sleep
Ms Yvette
1:21 PM
I wanted to test on the dupe target mentioned in the project
TheLostMind
Bye, sleeps for me!
Ms Yvette
under KeyPhrases.cs
TheLostMind
OK..
Ms Yvette
it links two posts and I wrote down the phrases I wanted to search on
The do a test for accuracy and slowly increase the posts
by number of linked posts closed against the target
so going from top down
and I'm not convinced post to post checking is the way to go
TheLostMind
hold on
Ms Yvette
1:24 PM
I wanted to pick groups or key phrases from the target dupe and any other high voted dupe of the target that has a variation on the theme
we're trying two different algorithms
to see which is more accurate
Sam
> The type or namespace name 'StackExchangeWebSockets' could not be found
....
Bhargav Rao
Comments please
meta.stackoverflow.com/questions/316721/…
Ms Yvette
have you pulled
Sam
yes
Ms Yvette
@BhargavRao voted
I will run it again
Bhargav Rao
1:26 PM
Thanks :-)
user5912150
Ada
started.
user5912150
I found a message: 'SSHing from AWS Instance to AWS Instance using .pem asks for passphrase' on stackoverflow.com
user5912150
I found a message: 'TRX to HTML using TRXER - formatexception invalid string for TimeSpan' on stackoverflow.com
user5912150
I found a message: 'How to get a value input from html returned of cURL?' on stackoverflow.com
Praveen Kumar
Hi @Ada
user5912150
1:27 PM
Bye, sleeps for me!
Praveen Kumar
LoL.
Ms Yvette
@Sam there's a lot of error handling that will need to be managed
I'm putting her to sleep
Praveen Kumar
I thought I killed @Ada...
TheLostMind
@MsYvette - So for "http://stackoverflow.com/questions/4660142/what-is-a-nullreferenceexception-and-how-do-i-fix-it" ==> extract nullreferenceexception?
@PraveenKumar - say that again and you will never see the light of day :P
Praveen Kumar
@TheLostMind Why?
Ms Yvette
1:28 PM
in the comments in the keyphrases.cs I have written the phrases I think that need to be searched
Sam
wth
The assemblies are referenced
TheLostMind
@MsYvette - My apologies but I think this won't scale.. we are talking about several hunderd questions here right?
Sam
The directives are there
Why the heck won't it compile
Ms Yvette
@Sam psuhed
@TheLostMind ok that's the feedback I needed
Sam
pulled
Ms Yvette
1:29 PM
so we need to go with Sam's solution
Sam
Ha ha
13 errors now
Ms Yvette
:D
hm
I don't know Sam
TheLostMind
yes. That is the right approach.. Cosine difference
Ms Yvette
Mine's fine
ok
I need to look at the maths of it
Praveen Kumar
@TheLostMind Who's cousin?
Pham
1:30 PM
Ada
started.
I found a message: 'How do I persist SIM card serial?' on stackoverflow.com
Ms Yvette
@Sam I need to drive to the country tomorrow
Pham
I found a message: 'Best practice for support check of REST methods' on stackoverflow.com
Ms Yvette
and prob wont' be around for much of the next 16 - 20 hours
Pham
I found a message: 'Hazelcast 3.6 - Map get element' on stackoverflow.com
I found a message: 'I want to make a number of different lists with different names' on stackoverflow.com
Sam
ok
Pham
1:31 PM
I found a message: 'How to prevent duplicate appSettings in web.config' on stackoverflow.com
Ms Yvette
I want to make sure I contribute more than dribble
I see you got rid of the errors
Sam
Indeed
Caching...
Ms Yvette
ah
You guys will have finished it by the time I come back.. :/
Bhargav Rao
@MsYvette You leaving Ada alone and going?
Sam
I need to optimize my cosine sim method now...
@MsYvette Lol
I doubt that
Ms Yvette
1:33 PM
@BhargavRao yes
I'm doing a very poor job
sniff
Sam
It's only your first bot
Ms Yvette
I better go to bed, I'm horribly sleep deprived
TheLostMind
@MsYvette - Now that using regex is out of question.. Am I of any use now? :P
Ms Yvette
night and thank you for all the hlep
Sam
Sleep well
Bhargav Rao
1:34 PM
See ya
Ms Yvette
@TheLostMind no not yet
just wait
I'm sure you can help
TheLostMind
LOl.. good night
Ms Yvette
Bye my darling friends and some of you my SO children xoxox
Sam
Cya
TheLostMind
bye
Ms Yvette
1:35 PM
\o o/
what is that? I am tired
TheLostMind
(facepalm)
Sam
Getting 500'd here
Bot can't join chat
TheLostMind
@Sam . Yes.. SE has some issues :P
Sam
I've noticed :p
TheLostMind
lol.. I thought so
Sam
1:44 PM
Apparently calculating the cosine sim over 185k words is pretty intensive...
TheLostMind
how much time does it take?
Sam
This is why I wanted to use a PoS tagger
Kevin Guan
Ahhhh I forgot this room.
Sam
I dunno ._.
TheLostMind
dang.. I don't know C-sharp.. :(
Sam
1:45 PM
I killed it before it had a chance to complete
TheLostMind
really?.. thats not good news
Sam
Ik
I originally wrote the method to be more maintainer-friendly...
I never bothered optimising it.
TheLostMind
Thats not a bad thing.. Premature optimziation is the root of all evil.. So you are on the right track :P
Sam
Yeah, ik
Fgs VS
TheLostMind
ok .. I didn't get that
Sam
1:47 PM
VS crashing again.
(Visual Studio, my IDE)
TheLostMind
whats FGs?
Sam
For God/Goodness Sake
TheLostMind
oh.. I will remember that
Naveen Nikhil
@MsYvette hi :)
Sam
@TheLostMind I'll run some benchmarks
TheLostMind
1:50 PM
On what?.. @Sam .. Interestingly I ran some benchmarks on regexes today :P
Sam
My consine sim class
TheLostMind
Oh.. Yes. Thats a good idea
Sam
Yeah, I need to see where the bottleneck is.
Praveen Kumar
\o/
TheLostMind
I will try to use that library in java (it should be available)
cool
Sam
1:51 PM
It should be
The C# wrapper for it
sucks
TheLostMind
I will sit here and cheer for you :P
Sam
I can not emphasise that enough.
:p
TheLostMind
lol.. Go Sam
!!
Sam
Woo
TheLostMind
..
Sam
1:54 PM
Had to get some snacks. :p
TheLostMind
ok
Pham
Ada
started.
I found a message: 'Three.js - Merge multiple geometries/meshes removing common areas' on stackoverflow.com
Sam
Well, it's pretty darn good for memory.
Not so much for cpu.
TheLostMind
what does top say?
Sam
I'm on Windows. :p
TheLostMind
1:58 PM
Ah.. Sorry.. my bad
Sam
CPU: 26%, Mem: 385 MiB.
TheLostMind
Not so bad.. I must say
Sam
I'd switch to Ubuntu if given the opportunity.
TheLostMind
and you will not regret it :P
Sam
But all my tools are pretty much Win-only.
TheLostMind
1:59 PM
of course they will be.. C sharpie :P
Sam
Eventually, sure.
TheLostMind
lol.. anyways.. I will go now.. if there is anything a java programmer can do to help, do let me know @Sam. Cheers.. Have a great day :)
Sam
So as VS comes out for linux, I can kiss windows goodbye.
@TheLostMind Alright, thanks. :) You too!
TheLostMind
of course.. many people would do that
bye
Sam
Cya
Ha ha, 8 mins 15 secs to compute the similarity of one post.
Pham
2:07 PM
Ada
started.
TheLostMind
What the hell?.. Man really?.
Sam
Yep
TheLostMind
How many cores do you have?
Sam
4
TheLostMind
physical?
Sam
2:11 PM
But it's not utilising all of them
Logical
TheLostMind
ok..
I see
This is a CPU intensive operation.. shouldn't work this bad..
whats the name of the library again?
Sam
Even if I were to use more threads, 8 mins is still awful
TheLostMind
Will download it
for java
lol 1 minute would be aweful
Sam
Lol ikr
Standford.NLP.POSTagger
TheLostMind
ok
tx
Praveen Kumar
2:13 PM
Idli, Dosa, Vada, Sambar.
Sam
The tagger itself isn't enabled in this project yet though.
Np
TheLostMind
check again :P @PraveenKumar
@Sam - Oh I see
Sam
Due to performance issues.
Praveen Kumar
@TheLostMind Oops.
Sam
The C# wrapper has terrible memory leaks (reaching +1 GiB), so.
TheLostMind
2:15 PM
lol.. call java library from C# then :P
Sam
Eh
I'd prefer to just rip out the essential parts of the lib and implement my own C# version.
TheLostMind
see. that makes more sense
Sam
I've had a look at the source... So. Many. Layers. Of. Abstraction. o_o
Even to do stupidly simple things.
It's crazy.
TheLostMind
lol.. I will have to see if I understand how the java code part on my system :P
Sam
Have fun
TheLostMind
2:21 PM
tX
Pham
3:02 PM
Ada
started.
I found a message: 'Is there any solution to convert string to money amount?' on stackoverflow.com
Ada
started.
Ada
started.
I found a message: 'confirmation of account not working' on stackoverflow.com
Ada
started.
I found a message: 'How can I pass a variable from imacros to a javascript?' on stackoverflow.com
Sam
3:21 PM
Finally found the bottleneck
It's as I suspected, reconstructing the dupe targets is the most intensive operation in the method.
Which would be due to the class's design.
Pham
Ada
started.
I found a message: 'Passing an array from a json file to angular custom directive' on stackoverflow.com
Sam
> An unhandled exception of type 'System.AggregateException' occurred in mscorlib.dll
Additional information: One or more errors occurred.
... so helpful.
gunr2171
inner exceptions?
Sam
Yesh
Just wasn't expecting that "additional information"
gunr2171
Entity framework is the same way. "An exception occurred, check the inner exceptions for details"
and then I punch my computer monitor
Sam
3:36 PM
:)
Well that's what happens when you try to use Parallel.ForEach without checking the source collection.
gunr2171
nice
Sam
Throwing more threads at the function only masks the root issue though. I need to redesign the entire class.
Yay
00:00 - 03:00
03:00 - 09:00
09:00 - 12:00
12:00 - 13:00
13:00 - 16:00
17:00 - 19:00
19:00 - 00:00
« first day (399 days earlier)
← previous day
next day →
last day (1394 days later) »
all rooms
Transcript for
Feb
11
Feb '16
12
Feb
13
SOCVR Testing Facility
Testing lab for the SO Close Vote Reviewers (with all their bo...
1
ai
bots
coffee
plops
waffles
join this room
about this room
00:00
06:00
12:00
18:00
all times are UTC
site design / logo © 2019 Stack Exchange Inc;
legal
mobile