Can ChatGPT Be Served as the Sentiment Expert?An Evaluation of ChatGPT on Sentiment and Metaphor Analysis
To explore the potential for subjective understanding,the subjectivity and metaphorical nature of ChatGPT,this paper evaluates ChatGPT on five sentiment,humor,and metaphor benchmark datasets and discusses its strengths and limitations on different tasks by comparing it with the most cutting-edge models in the field.In addition,this paper also compares the performance of ChatGPT and humans in sentiment analysis,with gaps of 9.52%,16.64%and 6.69%in human results on sentiment,humor and metaphor tasks.The results suggest that although ChatGPT achieves the best performance in dialogue generation,it still has potential for improvement in sentiment understanding.Finally,this paper investigates ChatGPT's sensitivity to cueing templates in an emotion understanding scenario by improving the cueing templates.
万方数据
