Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Meta

Welcome to Software Development on Codidact!

Will you help us build our independent community of developers helping developers? We're small and trying to grow. We welcome questions about all aspects of software development, from design to code to QA and more. Got questions? Got answers? Got code you'd like someone to review? Please join us.

Comments on Should we allow answers generated by ChatGPT?

Parent

Should we allow answers generated by ChatGPT?

+17
−0

We got our first (mostly) ChatGPT answer in our community. Also, a question includes an adapted ChatGPT code that does not seem to do the job.

StackOverflow has already banned ChatGPT answers and I am wondering how we should proceed in this case.

From my perspective, we should also ban ChatGPT answers because it is very likely to include subtle errors and lack any citations (ChatGPT actually had the option to answer the question of sources, but this was removed).

What do you think? Should we allow answers generated by ChatGPT?

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.
Why should this post be closed?

0 comment threads

Post
+0
−12

This may be a bit out of left-field, but I don't see anybody else taking the approach.

Let's face it, ChatGPT and AI and all its quandaries are not going away. If we put a ban in, some clever clogs will work out a way to bypass, just for the sake of it. If we allow ChatGPT open slather, the quality of answers becomes hopelessly variable.

I suggest we take the bull by the horns, and put some smarts into the question writing function that, once the question is completed, submits it to ChatGPT. Codidact then inserts ChatGPT's answer and the community are then allowed to try to reword the question so the AI provides a better (more accurate, more precise, etc) answer.

Heck you could even submit the question again to query if there's a better way to write it and get a positive feedback loop going with ChatGPT.

I know nothing about licensing, so this may be expensive. At the same time, the competitive advantage by exploring this niche (before others jump on the wagon - it will happen) may make the expense worth it.

An alternate idea (prompted from a comment) might be to have an official 'ChatGPT' community member, and give mods, or some group created for the purpose, privileges to use that account to write a response (including the text of the question used) as given by ChatGPT.

My reasoning for this approach is that an official use of the AI tech will reduce the noise - whether from the multiple ChatGPT answers given if it's allowed, or the attempts to sneak AI-assisted answers through if it's not - by providing a single AI focus point for each question.

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.

1 comment thread

Noise (2 comments)
Noise
Peter Taylor‭ wrote almost 2 years ago

Encouraging lots of minor edits to questions seems to me to be a great way to increase the noise-to-signal ratio in the "New content" flag, which is something to be discouraged. That aside, someone who is capable of judging whether an updated answer is more accurate or not could just write a more accurate answer and cut out the whack-a-mole submissions to the LLM.

mcalex‭ wrote almost 2 years ago

My apologies, I wasn't entirely clear on that point. I meant that, under the OP's actual question, we add a small ChatGPT box with the question as posted to ChatGPT, and its answer. All the community-based responses will still be responses to the original, unedited (except for human purposes) question. You are right, they could just write a more accurate answer. If they have the time and the inclination. My expectation is that if there is not an 'official' ChatGPT answer, those moles will be whacked either way. This idea at least funnels all that noise into one locus. Your response has prompted an alternate approach. :-) I'll add that to my answer.