The Dangers of ChatGPT: Why Data from StackOverflow is Outdated and Unreliable

But that is the danger. ChatGPT gets its data from StackOverflow, nobody goes to StackOverflow anymore so there is no new data anymore.

One of the great advantages of StackOverflow is that some questions are added years later with solutions that work in newer versions of frameworks. You will soon lose that and ChatGPT will only give you solutions that used to work or were even wrong at the time.

I often see people say that ChatGPT gives them all the answers or writes complete code for them. My experience is that I have plenty of experience and only come to ChatGPT for exceptional situations and then 9/10 times I’m disappointed, but I’m continuing my research .

I also discovered that ChatGPT is as bad as I am at regular expression syntax. Just comes with a broken regex, including a broken Python example, even though I had put enough data in there with several examples of input and what the output should be to be In the end it wasn’t a complex regex at all.

And since people really want to close the feedback loop and ChatGPT continues to train on what is ultimately a lot of code created by ChatGPT itself, the quality will not improve until very fast