– Evaluating ChatGPT for code generation tasks
– Proposing prompt design and optimization methods
– Improved prompts for guiding ChatGPT in code generation.
– Evaluation of ChatGPT’s performance on CodeXGlue dataset.
– Evaluating ChatGPT on CodeXGlue dataset for code generation tasks.
– Proposing prompt design and optimization methods for better code generation.
– Prompts improved ChatGPT’s code generation performance substantially.
– Factors influencing prompt design for code generation tasks were analyzed.
– Experimental settings and results for four research questions were presented.
– Limited testing was conducted to improve prompt design for ChatGPT.
– Human evaluation of 100 randomly selected samples provided insights for further studies.
