earticle

영어

This study compares how Papago, Google Translate, and ChatGPT perform when translating police dialogues, using BLEU scores, manual assessment, and error analysis. The analysis results are as follows. All three tools showed low BLEU scores compared to reference translations. In manual evaluation, ChatGPT significantly outperformed others, scoring 8.6 out of 10, compared to Google Translate's 6.5 and Papago's 5.6. Error analysis confirmed ChatGPT's superiority, with only 41 errors, while Google Translate and Papago produced 123 and 152 errors respectively. Across all tools, substitution was the most common accuracy error, followed by omission and addition. These results suggest that ChatGPT is the most reliable tool for police communication with foreign nationals.