Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Meta

Welcome to Software Development on Codidact!

Will you help us build our independent community of developers helping developers? We're small and trying to grow. We welcome questions about all aspects of software development, from design to code to QA and more. Got questions? Got answers? Got code you'd like someone to review? Please join us.

Comments on Don't close questions for lack of detail/confusion

Parent

Don't close questions for lack of detail/confusion

+4
−8

tl;dr: When a question is unclear, don't close right away, especially if it's possible to discern what they are trying to ask. Instead, use comments and edit suggestions to work with the asker and help them improve the question. Only close if it is absolutely hopeless (if the asker disappears for weeks and/or refuses to take feedback).

It is inevitable that people will ask bad questions on a Q&A site. Questions can be bad in many ways, for this post I am focusing on those that are closed because:

These are often closed for being "too generic", "unclear", "too broad", "off topic" or whatever other euphemism is popular at the time for "stupid question, go away".

The root cause in many cases is that the asker is a newbie and does not even understand the subject matter enough to ground it in appropriate context, or lacks the foundational skills required to properly analyze their problem and identify the specific point they need help with. When they ask about thing X, they don't just need help with thing X. They also need help understanding what they even should ask about. IMO it is unfair, unreasonable, unrealistic, unproductive and unduly elitist to refuse to provide help with the latter.

Another thing I observed is that when I was a mediocre programmer, I began to notice many people ask "bad" questions that were hard to answer because they are unclear. After I became a good programmer, I noticed that many bad questions I previously thought were unanswerable became easily answerable, because thanks to my greater skill and knowledge I was able to easily discern what the person meant to ask. This echoed the experience I had as a novice programmer, when the better mentors and teachers seemed to have an uncanny ability to figure out what I'm trying to ask before I could figure out how to phrase it myself, and this sort of Q&A was a great help in my own learning. Naturally, I strongly prefer participating in an environment where experts are considered to have a duty to not just answer questions, but also help newbies ask the questions.

I've heard the retort of just using the process, editing, commenting, then flagging to reopen - I've tried this many times on Stack as well. It doesn't work because it introduces too much overhead. As an expert, I often want to use CD in short bursts. Maybe I'm on a coffee break and want to quickly answer a question or two. An expert can answer many newbie questions quickly in this way. But if I have to submit an edit, flag, wait for the mod to see it, follow up to make sure it got reopened... That is a whole chore that drags on, and it's much more boring than a quick post while I drink my coffee. Its natural consequence is to defuse excitement from people who want to help, and to discourage experts from answering newbie questions.

This is not me saying my time is too valuable for flags and so the process should change for me. I am obviously here investing my time into this post because I care about the site. But the reality is that if you want experts to help newbies, the friction must be minimal, because experts are usually too busy to invest much time in helping an individual newbie. This doesn't scale. If you're going to be an expert helping newbies you must do it in a way that maximizes # people helped per unit work/time. Otherwise the logical thing is to let other newbies and diletants to deal with newbie questions, a situation also described as "the blind leading the blind". But the dabblers can generally only help with a well-posed question, they cannot look past a badly phrased or confused question to figure out the real intent. And as I pointed out elsewhere in this post, newbies will tend to ask bad questions, because usually when you are a newbie to a domain you are also a newbie to asking questions in that domain.

Also, when you close a question for being unclear, you are creating more work for yourself. I often hear mods on QA sites complain that moderating is endless and thankless toil. So why create more of it? When you close the question, it is now likely that the question will be edited and flagged for reopen, so you have now generated 2+ mod chores. Instead, you could leave a comment, and in the best case the question will be improved and require 0 mod chores, while in the worst case the asker will fail to improve it and eventually the question can be closed, requiring 1 chore. Of course, this is assuming reopening is even a genuine process - my own experience on other sites has been that unfortunately mod teams like to dig their heels in, and even after a question is improved refuse to go back on the earlier decision.

When a question appears to be unclear, the mods should give sufficient opportunity for other users to answer it anyway. AFAIK we do not require our mods to be virtuosos of their field. It is very possible that the mods knowledge is lacking or they simply failed to understand the question themselves. A mod not understanding a question is not a litmus test for the question being unanswerable - many experts answer questions on QA sites without seeking mod status, so it could well be that the question is unclear to the mod, but not to other users. If an expert is able to answer an unclear question, the solution should be to allow them to post an answer, and then edit the question to read better for other users. This creates knowledge, helps people and promotes a healthy community. If we close the question and thereby block experts from answering, this alienates new users, annoys experts and stymies the community.

Example:

  • https://software.codidact.com/posts/291046 - the question is a very reasonable one and part of a basic Python skillset. The asker is confused, and misphrased it. However, if you know the answer, it's not hard to deduce what they're trying to ask. I submitted an edit suggestion to this effect if anyone is curious. I would like to also post an answer, and I think that it will be a good and useful answer to people trying to learn this aspect of Python, but now I cannot because the question was closed, and who knows when (if?) it will be reopened.
History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.
Why should this post be closed?

0 comment threads

Post
+6
−0

No.

Terms like "too generic", "unclear", "too broad", "off topic" are absolutely not euphemisms for "stupid question, go away". They mean what they say; and when they are used Somewhere Else, multiple of them exist simultaneously for a reason. They are explicitly not designed to be used to judge that a question is "lazy", that the person asking doesn't "deserve" an answer or anything else like that.

First off, we are judging questions, not the people asking them. But even then, some kinds of issues with a question can be fixed, and others can't. Closure is about signaling that there is an issue, so as to insist on fixing the issue if it's fixable. Finally, don't make up a close reason if the question is clear, well scoped, properly backed up by a specification or reproducible example as appropriate, etc. If you simply dislike the question - that is, if you feel that answering the question is not important (but please keep in mind that most people are beginners or near-beginners, in every discipline), that's what downvotes are for.

If we choose to make it our problem that beginners don't know what to ask (and I agree that they very often do not), here are the workable strategies I can think of:

  1. Have experts self-answer the necessary questions, using their expertise to determine what to ask. (One may think that answering would be trivial at this point, but even simple questions can be surprisingly nuanced when one tries to account for the fact that the reader doesn't already know the answer.)

  2. Use a separate section for the "plz point out the bug", "what are the steps to solve this", "what does this part of the assignment mean" etc. questions.

  3. Some kind of explicit staging or drafting system for questions (i.e. something that the Codidact Foundation is explicitly tasked to develop, with more technical support than just a separate category).


The objection you've raised fundamentally misunderstands the purpose of closing questions on a Q&A site. It is injunctive, not punitive; it is fundamentally temporary; and it is a judgement of current suitability, not potential value.

The consequence of closing a question is that it cannot be answered until reopened. Closing and reopening are both explicitly, deliberately designed features of the system; we may conclude that the purpose of closing questions is to prevent answers from being posted. Once problems are fixed, such that providing answers would be aligned with the goals of a Q&A site, the question can be reopened, and answers can be posted.

Why should this be necessary? Because well-meaning people on a "question and answer" site, who see a question and believe themselves able to say something useful in response, will be tempted to write an answer. Such answers, however, are inherently not useful to the general public. The value that the Q&A format has, which an ordinary discussion forum does not have, is that over time it accumulates a searchable reference library. As such, questions need to provide something to search for - by clearly introducing a properly-scoped problem that answers can address.

Otherwise, it wouldn't be necessary to describe problems caused by typos as "off topic", but we do. It would scarcely be necessary to close anything that's on topic, in fact. However, if we can agree that some programming questions merit deletion, then we must surely also agree that at least as many merit closure - since deletion also entails prevention of answers.

While I accept that this standard won't always be reached in practice: the gold standard for a question is that, as a curator, you should feel like you could close someone else's question as a duplicate of this one some day, and not feel like you've done the OP a disservice simply by trying to keep the answers to the same question in one place. (After all, that's another aspect of how to provide "searchable reference library" value: once you've found "the question", you shouldn't have to keep chasing links.)

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.

2 comment threads

Second section - disagree (8 comments)
First paragraph - theory vs. practice (3 comments)
Second section - disagree
matthewsnyder‭ wrote 8 months ago

I think the second section is a great description of the current state of things as I see it, maybe better than the one in my question. If indeed I fundamentally misunderstand closures, then it sufficiently rebuts my original post. I do disagree on 2 points.

  1. I understand the distinction you make with injunctive vs. punitive. However, to me it seems that closure are used punitively. In fact, it not only punishes the asker, but also people who want to answer, even though they did not nothing wrong (well, aside from your point that some answers to a bad question will be inherently not useful). I can see how perhaps it's not intended to be punitive, but I find it hard to see what will ensure that, on the whole, it is consistently not used that way.
  2. While your argument is well stated, I don't see the case for why it's good to prevent answers as a response to a bad questions. It doesn't really follow for me, and answers might even help improve the question.
Karl Knechtel‭ wrote 8 months ago

To understand "you don't get an answer, written for you, directly to your question" as punitive, one must first presume that the opposite is a privilege. But that's simply not how a Q&A site works. In fact, "your question" already betrays a misunderstanding - that's why there is content licensing. The entire point is that each question that is asked is contributed to a compendium of knowledge. Closure is a temporary rejection of that contribution.

Re preventing answers, the entire point of this model is that answers are collected into a place where they are useful, and the efforts of those who can answer questions are focused onto questions that usefully contribute to the compendium. I wrote more about this on Stack Overflow meta. In short, I disagree that an answer can "help improve the question", in principle.

matthewsnyder‭ wrote 8 months ago · edited 8 months ago

I do agree that in theory, what you say is correct, for exactly the reasons you describe.

However, I also suspect that new users of QA sites do not see it that way. I think a lot of new users do think "my question" and "helping me". I suspect most are unaware of the intellectual property implications, and I suspect that they do not initially consider the ramification of contributing to a compendium of knowledge.

The naive mindset is that perhaps answers contribute to it, but the questions are the person asking personally for help, similar to a forum. I think the majority of new users start with this naive mindset, and some gradually grow into the correct understanding you state.

So the question is really what to do with those naive newbies. Let them be naive, and work around them? Or have them go away and come back when they get it? I mean obviously you're saying the second, I'm saying the first, but the site collectively has to settle on one and make it clear.

matthewsnyder‭ wrote 8 months ago · edited 8 months ago

Oh, and, if it's really:

have them go away and come back when they get it

Then I think this is a bit too subtle in current site UX (well, until your question gets closed). It could be spelled out a lot more clearly, IMO.

Karl Knechtel‭ wrote 8 months ago

So the question is really what to do with those naive newbies. Let them be naive, and work around them? Or have them go away and come back when they get it? I mean obviously you're saying the second, I'm saying the first, but the site collectively has to settle on one and make it clear.

Ideally, in my view, they could post their questions in a separate section with fewer restrictions - still more stringent than what a typical discussion forum OP expects, and still subject to third-party editing, but without the expectation that everything is intended to contribute to the searchable Q&A.

Stack Overflow's attempt at this was called the Staging Ground, but the idea was barely worked on and then quietly shelved, with little feedback from staff about whether they ever intend to go back to it. This is also good material for future Meta discussion.

matthewsnyder‭ wrote 8 months ago

I didn't know about Staging Ground, but that seems like a great idea that would make everyone happy. I wonder, did it fail because it was somehow fundamentally flawed? Or they just lost interest?

Then again, isn't the staging ground equivalent to letting experienced users mark a question as "certified decent", and letting users who want quality hide the questions that are not certified? And isn't "certifying" the same as up/downvoting? So in the end, if we simply allow bad questions to remain with a low score, but have a convenient UX for people to hide low scoring questions (unless very new), isn't that the same thing?

I don't mind either way, like I said, with both options, my concern would be satisfied. It just seems like there's not an actual difference.

Karl Knechtel‭ wrote 8 months ago

My take is that it failed partly because they lost interest, but mostly because the staff are so far out of touch with the community that they didn't properly understand what they were proposing to implement nor why it would be helpful. So, the staff conception of the idea was fundamentally flawed, but the actual underlying idea was not.

The "certification" argument makes a certain amount of sense, but there are two major problems:

  1. A "certified decent" question merits a fundamentally different kind of response - one that can help build the library, rather than simply helping out a community member.

  2. Keeping the "merely acceptable" separate from the "certified decent" by voting, results in a ton of hurt feelings (plus, search engines don't care about this metadata); failing to keep it separate results in a compost heap with delicious meals buried in it here and there. My idea is that Codidact's feature of "site sections" is an ideal technical solution.

matthewsnyder‭ wrote 8 months ago · edited 8 months ago

Yeah, that makes sense. If you just label posts with status rather than segregating them, it has potential for a mess when you start getting non-certified answers to certified questions. I was just wondering if this is something that we already have without developing any additional UX.

But now that you mention it, I think it's a pretty good idea. Luckily we already have support for multiple sections in each site. So for example, here we could have Q&A, Staging, Code Review and Meta. And some mechanism for promoting questions from staging to Q&A (but that's just a special case of moving questions).

Moving questions from staging to Q&A could require a certain amount of rep, so that way you don't get newbies polluting it with questions that aren't aligned with site culture. Meanwhile staging provides a place for them to learn how to ask.