ChatGPT’s bug fixing performance is competitive to the common deep learning approaches.
ChatGPT can be used to solve coding problems isn’t new, but the researchers highlight that its unique capacity for dialogue with humans gives it a potential edge over other approaches and models.
ChatGPT solved 19 of the 40 Python bugs, putting it on par with CoCoNut (19) and Codex (21). But standard APR methods only solved seven of the issues.
The researchers found that ChatGPT’s success rate with follow-up interactions reached 77.5%.
This is definitely a great idea! Just that right now ChatGPT is sill evolving and perhaps it is too early to integrate. But still, will definitely watch this space as I believe AI will be integrated into everyone’s workflow somehow down the road.