Full Text:  <106>

CLC number: 

On-line Access: 2025-04-25

Received: 2024-10-12

Revision Accepted: 2025-01-24

Crosschecked: 0000-00-00

Cited: 0

Clicked: 175

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Frontiers of Information Technology & Electronic Engineering 

Accepted manuscript available online (unedited version)


Image generation evaluation: a comprehensive survey of human and automatic evaluations


Author(s):  Qi LIU1, Shuanglin YANG2, Zejian LI1, Lefan HOU3, Chenye MENG3, Ying ZHANG1, Lingyun SUN3

Affiliation(s):  1School of Software Technology, Zhejiang University, Ningbo 315100, China; more

Corresponding email(s):  zejianlee@zju.edu.cn

Key Words:  Image generation evaluation; Human evaluation; Automatic evaluation; Evaluation protocols; Evaluation aspects


Share this article to: More <<< Previous Paper|Next Paper >>>


Abstract: 
Image generation models have made remarkable progress, and image evaluation is crucial for explaining and driving the development of these models. Previous studies have extensively explored human and automatic evaluations of image generation. Herein, these studies are comprehensively surveyed, specifically for two main parts: evaluation protocols and evaluation methods. First, 10 image generation tasks are summarized by focusing on their differences in evaluation aspects. Based on this, a novel protocol is proposed to cover human and automatic evaluation aspects required for various image generation tasks. Second, the review of automatic evaluation methods in the past five years is highlighted. To our knowledge, this paper presents the first comprehensive summary of human evaluation, encompassing evaluation methods, tools, details, and data analysis methods. Finally, this the challenges and potential directions for image generation evaluation are discussed. We hope that this survey will help researchers to develop a systematic understanding of image generation evaluation, stay updated with the latest advancements in the field, and encourage further research.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2025 Journal of Zhejiang University-SCIENCE