2305.08360 (1).pdf

– Evaluating ChatGPT for code generation tasks
– Proposing prompt design and optimization methods

– Improved prompts for guiding ChatGPT in code generation.
– Evaluation of ChatGPT’s performance on CodeXGlue dataset.

– Evaluating ChatGPT on CodeXGlue dataset for code generation tasks.
– Proposing prompt design and optimization methods for better code generation.

– Prompts improved ChatGPT’s code generation performance substantially.
– Factors influencing prompt design for code generation tasks were analyzed.

– Experimental settings and results for four research questions were presented.
– Limited testing was conducted to improve prompt design for ChatGPT.
– Human evaluation of 100 randomly selected samples provided insights for further studies.