last day (75 days later) » 

9:31 PM
8
A: How many old, accepted, high score link-only answers are there?

Shog9Laurel's query is a good start. Simply factoring out the length of the URL isn't enough though, since auto-linked URLs will repeat the URL in the link text... So you'll want to strip the entire link in these cases, but leave the link text in other situations where it actually contributes to the c...

 
On a bright note... We're down to only 215 link-only answers on Stack Overflow...
 
interesting, thank you! Setting minScore 10 shows 503 posts at length without URL under 29. That looks doable - I think at Programmers about 2K answers were cleaned up. Even min score 7 shows 995, still realistic. Your note about keeping skeptical eye makes sense: in my experience when reviewing such posts it was worth paying attention to things usually considered secondary. It was quite frequently that either link content turned out good and easy to digest (meaning easy fix with edit) or question itself was blatant request for off-site resource (meaning that fix was to delete question)
 
I wonder how many of those are answers to closed questions... I clicked one question that had at least 3 answers that fit all but the score criteria.
 
If you're operating on the Markdown, why are you looking for <a href= rather than [link](URL) ?
 
It's much, much faster to scan the rendered HTML first and then find the corresponding Markdown for matching posts, @Ben. Also more effective, since the raw Markdown might have raw URLs that are auto-linked, might have inline links, might have footnote-style links. However, the rendered HTML also pads out these short answers considerably, making it difficult to gauge the effective length of the answer without the link... Thus, I pull in the last revision and strip the URL to perform the length check. The internal check actually uses an HTML parser, which would be much nicer here.
I should note that a previous version of this operated entirely on HTML and was much faster (don't even bother trying to run this on all answers). However, accuracy suffered greatly. YMMV, but if the goal is to find old, overlooked answers in need of some love, churning through tens of thousands of false positives isn't going to help.
 
9:31 PM
@Shog Yes that's perfectly sensible, but then maybe your answer should say it uses both the HTML and the Markdown. Right now you have "if we ... operate on the original Markdown"
 
Yeah... @Ben, on the one hand I did kinda breeze through the details of that query; on the other, not entirely the point of this question. On the gripping hand, I'm not exactly a SQL wiz, so I'd defer to anyone willing to make this less of an abomination.
 
Shog, I would appreciate if you create chat room for this answer. At first I thought to discuss cleanup based on your script at SOCVR but after making list of points I wanted to clarify I figured that it would be hard to cover these without a dedicated room
 
so, what's up?
 
@Shog9 as far as I can tell script in your answer makes a fairly solid ground for cleanup. Here is a list of things I would want to better understand before going further. 1. What cut-off length to use (MaxBodyLengthWithoutUrl in the script)? Don't know how you arrived at 29 but after briefly checking some smaller and larger values it seems to be sort of sweet spot. I would want to use 29 but if someone can suggests reasons in favor of other value I would like to hear...
2. What cut-off score to pick? Those who read my request know that ideally I wanted to cleanup answers with score 5 and above and worst case - score 10 and above. Score 10 looks doable with ~500 answers, as for score 5 script makes me doubt it because at score 7 it shows almost 1000 posts, that already looks rather tough. One trick I can think of is to start with score 10 and after done, if it works well, try next round with 5...
 
1 sec, phone
 
9:35 PM
@Shog9 no problem, I'll just dump my list in the meantime. It's not urgent anyway :)
3. How to communicate that it's unusual? Again, recalling similar experience at Programmers, handling higher score link-only answers made me change my usual habits when first thing I did was to flag for deletion - and that was quite difficult. I had to teach myself to first look at the question which was more than usual a blatant resource request (in hindsight this looks natural, perfect match link to requested resource gets many upvotes, sure)...
...Second thing was still not deletion but checking the link. A reasonable question with bland link only answer sitting at strangely high +10 often meant that (idiot) author was too lazy to describe content worthy of +30...+50 so that it only got upvotes from readers who clicked the link...
4. What procedure? A meta post similar to burnination request? Frankly I don't understand how SOCVR folks keep such posts "burning" as long as needed, sometimes for few months. I think cleanup of few hundreds answers may easily take few weeks and I just don't understand how to maintain it for that long...
5. Who is in? I think that cleanup success very much depends on how many folks will be willing to actively participate. Editing any particular worthy link-only answer is easy - go to link, copy and quote the summary - but doing this to hundreds of them is a work for at least 5-10 editors (we don't want it take over a year like it was at Programmers, don't we)...
...I assume that this won't be backed by moderators which means we'd need 4-5 10Kers to handle deletions of questions (questions with answer at +10 or higher often require more than 3 votes to delete).
 
@gnat a length of 29 should suffice to capture old answers that would be blocked at submission today. It's not perfect, but it does seem to get pretty close to the results that the (much more robust) internal check enforces.
Note that this ignores a ton of recent answers that are just padded out, etc... But we've generally been far less tolerant of that sort of thing than we were in the early days, so if the aim is to clean up old, innocent-at-the-time submissions, I'd stick with 29.
@gnat Yeah, I would start high and work down. Figure that a lot of answers with extremely high scores are either gonna be on bad (poll-type) questions, or are worth editing; as the scores get lower, there's gonna be a lot more crap and a lot less that's worth spending time saving... So as volume increases, processing time should fall.
@gnat Not sure what you're asking here
@gnat I'd go with something like this: meta.stackexchange.com/questions/147100/…
IOW, a call to action with very specific guidance and a "next step"
 
10 min @Shog9, Skype :)
 
Much easier sell if you're only tackling a few hundred posts vs. thousands
@gnat I'd actually recommend getting a moderator involved here, if possible. Both because they're handy with announcements and also because it'd help to have someone kinda refereeing in case someone gets a bit too enthusiastic with flags or starts plagiarizing or whatever.
BTW, I'm off for the next few days - I might be keeping an eye on things, but will be massively distracted if so. Happy to help out with this, but it might be next week or even mid-September (if there's a lot of catch-up) before I get the kind of time that it'd deserve.
 
9:54 PM
@Shog9 "How to communicate that it's unusual" -- usual way when dealing with regular link-only answer is just flag or vote delete, ignoring the question and link content. I had to drop that habit when I dealt with high score link-only answers at Progs and that went rather painful. I want folks doing cleanup here had a smother transition to that different way, when you first look at the question, second at the link content and only after that consider answer deletion
 
@gnat You might consider dropping the term "link-only answer" for this then, to avoid the reflexive actions.
The query itself is focused primarily on finding very *short* answers, which simply happened to escape prior review due to score and because of how we handle links. Thus, the key features of these answers are,
1. They're very short
2. There's a significant signal indicating they may have been useful
So, focus on that: help flesh out old, terse answers.
flesh out / clean up / maintain / salvage
 
@Shog9 that's... ingenious. And really worth considering. Need some time to chew it, but at first glance looks like a neat trick and is likely do the job
 
with that, I gotta run. Will check in on this next week.
 
10:10 PM
@Shog9 thanks! I've got a good food for thought. Wrt moderator involvement, I see that I missed one thing at least in original plan, I was thinking only of their involvement in deletions. But at the very least they should be aware that cleanup is going on. It is likely be more about editing but even in best case there gonna be many deletions, and moderators better be aware of what's going on
 

  last day (75 days later) »