« first day (214 days earlier)      last day (2005 days later) » 

1:50 AM
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4.5 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4.5 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4.5 No Action Needed review on NAA answer.
 
rawr
 
2:07 AM
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4.5 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4.5 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4.5 No Action Needed review on NAA answer.
 
2:47 AM
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4.5 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: late answer Score: 4 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 5.5 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 6 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: first post Score: 4 No Action Needed review on NAA answer.
[ ActionNeeded | Sentinel ] Link to Review Type: late answer Score: 0 No Action Needed review on NAA answer.
 
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
 
3:06 AM
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
asdf
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
@SpotDetector bl
 
3:22 AM
@FrankerZ Your response has been recorded.
 
THANK GOD
@SpotDetector tp
 
@FrankerZ Your response has been recorded.
 
@SpotDetector tp
 
@FrankerZ Your response has been recorded.
 
@SpotDetector bl
 
3:24 AM
@FrankerZ Your response has been recorded.
 
@SpotDetector bl
 
@FrankerZ Your response has been recorded.
 
@SpotDetector tp
 
@FrankerZ Your response has been recorded.
 
If any of you guys want to help, I'm looking for more feedback, especially from the ♦ moderators. Up above are 6 posts (Everything after the ===), and there will gradually be more throughout the days. I need help classifying these posts. Simply reply to the post with the following:
tp (If you think a moderator would take action against the reviewer, ie. A clearly bad review). bl (Borderline. ie. It's a link only, but it has some text, and the reviewer wasn't 100% wrong marking it as 'No Action Needed'), or. fp (After a review, the post would likely be undeleted, as it can be considered an answer, and should not have been deleted by review)
 
3:48 AM
hmm.. it depends actually. mods avoid review banning users unless it's either (1) a serious mistake (like no action needed on spam), (2) a series of incorrect recent multiple reviews, (3) poor review history, and the ban length is determined mostly by 2 & 3
so although it's great that you're classifying reviews to custom flag those users, hopefully you can highlight several recent incorrect reviews the user has made.
 
 
5 hours later…
9:01 AM
[ ActionNeeded | Sentinel ] Link to Review Type: late answer Score: 6.5 No Action Needed review on NAA answer.
 
 
2 hours later…
11:17 AM
[ ActionNeeded | Sentinel ] Link to Review Type: late answer Score: 5 No Action Needed review on NAA answer.
 
11:56 AM
@FrankerZ @Samuel sometimes - someone just hits the wrong button - even the best of reviewers have "off days"... mods are aware of that... like we are with comments - some user that's been long standing suddenly gets pushed to the point of obscenities... they've had a crap day and they're boiling inside and something flipped a switch somewhere where it otherwise it just wouldn't happen.
we'll clear up the mess and hopefully once that person feels embarrassed enough (by themselves) the next day - that's it...
 
@JonClements yes, that's what I mean - we don't want to punish the occasional mistake, we want to stop/correct a poor pattern
 
Yup... if you're constantly doing "F* you", "F* you", "F* you" everwhere, then you're not welcome
but if you leave a comment or something out of frustration saying "oh f* this"... who cares... really... we're all people - we have our "moments"...
 
 
1 hour later…
1:06 PM
@JonClements @Saumel The decision for this bot ultimately came from a post I made here. The point is to try and catch bad reviewers, in an attempt to try and educate users how to correctly flag/review a post. I do agree a Review Ban for one bad review is a bit drastic, but ATM, there's no other way to say "Hey! Look, you made a bad review. Be careful in the future."
 
@FrankerZ fair 'nuff... so you're thinking of trying to do something that augments the audit system?
 
At this point: I think education is important. If they're reviewing clear questions as No Action Needed, what happens when Natty misses a clear question in the future. Some of this content can hang around for years until it gets attention by some other NATO post, or edit causing the question to become active again.
I think these queues are an important first step. They're essentially most likely going to become a users first interaction with the site.
 
on a grand scale though - for what you're talking about - how much of this really matters? (Sorry, I'm not deliberately being obstructive or anything like that... I'm trying to get to grips with what you aim to achieve)
SO currently has 177 banned reviewers (from what I see in the mod page stuff)
 
Yeah, I suppose you're right. This is a bit on the low end of the scale, but none-the-less it's trying to make an improvement with how the queues are being handled. We have Queen tracking down nasty comments, Natty searching through bad answers, Guttenburg seeking out plagarism, Generic Bot tracking flags to alert reviewers of potentially bad edits/good reviews. What's next...? Seems like trying to target/improve the review queues was a logical next step.
 
(I think most of 'em are automated but I see a handful of mod issued review bans there)
 
1:16 PM
What are your thoughts? I have the time. I have some sanity remaining from my workings with node.js. Is this really needed? That's why I wanted feedback, I wanted to see what your feelings were.
Can we change this into something more useful? Have any other ideas for something else?
 
my feeling is that this is something that SO (the company) should be dealing with... the entire review system could do with a great overhaul anyway...
the review/audit system is flawed... everyone who's spent time on the site and gets in moderation stuff knows that...
sorry - phone one sec.
 
Well, I think my system, paired with some type of ability to warn users as a first step (Instead of straight review banning people), would go a long way. It would allow users to come up with algorithms to seek out/find bad reviewers, and then mods can act on them without issuing a review ban first.
 
[ ChatCradle ] Keeping the room fresh...
 
1:32 PM
Okay... to clarify a few things though - mods usually don't get involved in review bans... that's what the audit system does, it provides warnings, and will automatically issue review bans... where does what you're proposing come into this?
 
idk, maybe what I am purposing is dumb. I just see a lot of non-english speakers, and people who aren't familiar with the queues, try and go in and help, but they're actually more destructive. I feel like education should be important, and having an ability for mods to let users know that a review was done incorrectly without causing a ban (But also put on a structured tier system for punishments, like the audit system).
If they don't even review for the period, do they even see the ban? This is my main issue.
 
1:53 PM
not dumb at all - all ideas are welcome
firstly, mods can (and have done) notify users of some fairly dubious reviews/actions without banning them from review... a kind of "Hey - it looks like you're doing what you think's good and while we appreciate effort, please take some time to look at..."
 
But I think that's a highly manual step, that in most cases a mod wouldn't bother to do, due to the effort required. (Not to mention, there's no way of tracking that, other than to go through their past messages, and in that case more manual digging)
 
2:10 PM
How about a website, where where the mods can go to track users reviews throughout the queue. You would be able to sort by a ratio of deleted posts from 'No Action Needed'? Using that data, you could pick out potentially problematic users.
 
[ ActionNeeded | Sentinel ] Link to Review Type: late answer Score: 5.5 No Action Needed review on NAA answer.
 
@FrankerZ ummm... not sure... mods already have access to pages that show reviews and audits and we can drill down to users if needs be...
 
But see ratios of their reviews to deleted posts? Something that they can sort by? I'm suggesting tying together 2 pieces of data, that can show you a trend of a possible problematic users.
At this point though, I think you might be right. It may not really matter, as they're not super important anyway.
And would likely result in better TLC by the SO staff directly
 
2:31 PM
don't feel disheartened... your heart's in the right place - I'm just umm... thinking I don't want you to waste time/effort on something that's either not useful or can only be practical if done by the system back-end
 
Nah, you're right. Unfortunately, without me actually being able to see the tools you have, it's hard for me to make decisions on that. I figure seeing a ratio of deleted posts to no action needed, would at least give you a jump start on to potentially bad reviews.
 
keep it in mind for the moment... I've gotta get ready for a video conference in 18 minutes.... (get ready as in make it look like an attempt I've brushed my hair kind of thing)... shall we catch up later?
 
Yeah, no problem. I really thank you for your input.
 
3:03 PM
And I really appreciate your time thinking about such things and wanting to make a difference...
/me puppy high 5
 
 
7 hours later…
9:55 PM
[ SpotDetector ] Initializing nose, starting the hunt.
[ SpotDetector ] Initializing nose, starting the hunt.
[ SpotDetector ] Initializing nose, starting the hunt.
[ SpotDetector ] Initializing nose, starting the hunt.
[ SpotDetector ] Initializing nose, starting the hunt.
 
10:09 PM
@FrankerZ ever thought of joining the mod team? you know, improve the system from within :)
 
Sadly I think I have a bit of some black marks on my record
Not to mention my ideas in the meta community haven't been always welcomed with good arms
 
[ SpotDetector ] Initializing nose, starting the hunt.
[ SpotDetector ] Initializing nose, starting the hunt.
[ SpotDetector ] Initializing nose, starting the hunt.
 
10:46 PM
[ SpotDetector ] SCORES: obscene: 0.9244438 attack_on_author: 0.49947563 spam: 0.5970076 Comment: Why do you have Account ID included in the [Key]?
[ SpotDetector ] SCORES: obscene: 0.7130147 spam: 0.76375175 Comment: see <a href="https://pastebin.com/ekPS5i80" rel="n
[ SpotDetector ] SCORES: obscene: 0.5930344 spam: 0.50666386 Comment: Though I totally get your point on this being too
[ SpotDetector ] SCORES: severe_toxicity: 0.5480481 toxicity: 0.8696625 Comment: @Mr. T: I am fed up of this unprofessional unethic
[ SpotDetector ] SCORES: severe_toxicity: 0.5480481 toxicity: 0.8696625 Comment: @Mr. T: I am fed up of this unprofessional unethic
[ SpotDetector ] SCORES: toxicity: 0.83785176 Comment: Thanks! I feel like a complete idiot for missing t
[ SpotDetector ] SCORES: severe_toxicity: 0.21561585 toxicity: 0.83785176 Comment: Thanks! I feel like a complete idiot for missing t
[ SpotDetector ] SCORES: severe_toxicity: 0.4067051 toxicity: 0.5063438 Comment: <i>&quot;Show ... how you call it&quot;</i> You&#3
[ SpotDetector ] SCORES: severe_toxicity: 0.554629 toxicity: 0.59479904 Comment: %s expects a string and your passing a DataFrame
[ SpotDetector ] SCORES: severe_toxicity: 0.37495005 toxicity: 0.5354132 Comment: A plea to instructors out there: if you must assig
 
11:15 PM
^ Please ignoreish the spam. I'm testing out googles new perspective API on the SO comments. Hoping it can prove useful in the future (Maybe as part of queen)
 
looks interesting
 
Not sure how it will fair against programming languages
"%s expects a string and your passing a DataFrame" isn't really toxic at all
 
[ SpotDetector ] SCORES: severe_toxicity: 0.24425924 toxicity: 0.531086 Comment: I have not. I&#39;ll see where that gets me, but I
 
probably because of expect
"I expect you to get this done, no questions asked"
 
That's toxic?
 
11:20 PM
lol
idk
 
I expect you to work your butt off on SO making it a better place. (Dontbanmeplz)
 
I guess 0.59 is borderline, need to find a suitable tolerance level to minimize the false positives as much as possible
 
Rob
It probably also has weighting towards '%s' due to people 'censoring' profanity
 
@SpotDetector tp
 
I have the score currently set on 0.5 for the toxicity and severe_toxicity, so I probably need to fiddle around and look for the more severe ones.
 
11:22 PM
but mostly False Positive City so far :)
 
I don't actually have it set to record feedback yet
 
np, wasn't expecting it to be recorded
 
Right now, it's more in the pre-alpha stages :P
 
Rob
If you're wanting to store the reports/feedback somewhere, we can get you setup pretty quickly on Higgs if you'd like
 
I built a reply system in ActionNeeded, and can copy over most of the code to record feedbacks if necessary. Right now, I'm just outputting stuff for mostly curiosity sakes. I think if anything comes from it, I'll likely pass it on to Petter to integrate into queen.
 
11:25 PM
"your passing a DataFrame" may be for crimes against English
 
This was more of an "I have a few hours, let's waste some time" project.
 
[ SpotDetector ] SCORES: severe_toxicity: 0.4049735 toxicity: 0.6216783 Comment: Thank&#39;s for your answer! This might be a stupi
 
on the site they rank that one as "Unsure if this will be perceived as toxic"
 
On what site?
 
[ SpotDetector ] SCORES: severe_toxicity: 0.6990604 toxicity: 0.73622173 Comment: <a href="http://codepad.org/2RXPG5pc" rel="nofollo
[ SpotDetector ] SCORES: severe_toxicity: 0.50501674 toxicity: 0.58612454 Comment: <a href="http://codepad.org/2RXPG5pc" rel="nofollo
[ SpotDetector ] SCORES: severe_toxicity: 0.4049735 toxicity: 0.6216783 Comment: Thank&#39;s for your answer! This might be a stupi
 
11:35 PM
the API's site
 
(Restarted, and stripping HTML now)
 
enter text and it rates toxicity
 
Yeah, but I'm confused
What's that one?
 
sorry, this: Thank's for your answer! This might be a stupid question but I'm pretty new to this topic... Where exactly do I put my imput X and Y in your solution?
it's been a long day :(
anyway, great work - looks really promising
 
Where are you seeing that tho?
Unsure if this will be perceived as toxic. 0.62 is 62% toxic
 
11:41 PM
here perspectiveapi.com/# then click experiments then scroll down to writing experiments
 
11:55 PM
@StephenKennedy That's cool. Didn't know they had a field you can type in like that
 

« first day (214 days earlier)      last day (2005 days later) »