Welcome to Software Development on Codidact!
Will you help us build our independent community of developers helping developers? We're small and trying to grow. We welcome questions about all aspects of software development, from design to code to QA and more. Got questions? Got answers? Got code you'd like someone to review? Please join us.
Post History
Stack Overflow has recently announced OverflowAI and I think this video summarises pretty well this. The main drawback is that the users are less incentivized to put effort into answering questions...
Question
discussion
#2: Post edited
by
Alexei
·
2023-08-01T07:59:21Z (over 1 year ago)
added link to ChatGPT bot as per suggestion in the comment
- Stack Overflow has recently announced OverflowAI and I think [this video](https://www.youtube.com/watch?v=Jll8p16gkmI&ab_channel=DecisionForest) summarises pretty well this. The main drawback is that the users are less incentivized to put effort into answering questions and have this effort being fed into SO's LLM.
I am wondering if it makes sense to start blocking known agents that feed LLMs. I am thinking specifically about ChatGPT-User. This seems to be very simple to do, as shown in [this article](https://geekflare.com/stop-chatgpt-plugins-from-scraping-website/): disallow ChatGPT-User user agent on the site in the robots.txt.- I know the community is small now, but it growing, especially due to SO's decline, and one day it might become interesting for ChatGPT and others.
- Stack Overflow has recently announced OverflowAI and I think [this video](https://www.youtube.com/watch?v=Jll8p16gkmI&ab_channel=DecisionForest) summarises pretty well this. The main drawback is that the users are less incentivized to put effort into answering questions and have this effort being fed into SO's LLM.
- I am wondering if it makes sense to start blocking known agents that feed LLMs. I am thinking specifically about [ChatGPT-User](https://platform.openai.com/docs/plugins/bot). This seems to be very simple to do, as shown in [this article](https://geekflare.com/stop-chatgpt-plugins-from-scraping-website/): disallow ChatGPT-User user agent on the site in the robots.txt.
- I know the community is small now, but it growing, especially due to SO's decline, and one day it might become interesting for ChatGPT and others.
#1: Initial revision
by
Alexei
·
2023-07-31T11:49:53Z (over 1 year ago)
Should we disallow ChatGPT-User crawler (and others) from scraping Software Codidact?
Stack Overflow has recently announced OverflowAI and I think [this video](https://www.youtube.com/watch?v=Jll8p16gkmI&ab_channel=DecisionForest) summarises pretty well this. The main drawback is that the users are less incentivized to put effort into answering questions and have this effort being fed into SO's LLM. I am wondering if it makes sense to start blocking known agents that feed LLMs. I am thinking specifically about ChatGPT-User. This seems to be very simple to do, as shown in [this article](https://geekflare.com/stop-chatgpt-plugins-from-scraping-website/): disallow ChatGPT-User user agent on the site in the robots.txt. I know the community is small now, but it growing, especially due to SO's decline, and one day it might become interesting for ChatGPT and others.