This work was my final project for a graduate computer vision class. My partner was An Nguyen. Our goal was to create a system that would predict a personalized rating of image aesthetic. We used the Aesthetics and Attributes Database (AADB).
My contribution to the work was to extract useful features from the images. I fine-tuned a convolutional neural network, originally trained on ImageNet, using Caffe. I tried several network architectures (AlexNet, VGG-16, ResNet).
Abstract
Computing the aesthetic quality of an image has gained attention in recent years. One application is mining good quality images to show users. However, people have different opinions on image quality and aesthetic. We design a probabilistic graphical model that takes into account personal taste to predict personalized image aesthetic scores on a scale of 1 to 5. We experiment with different image features and evaluate the system using a large real-world dataset and find strong improvement over competitive baselines. We also show that our approach is particularly useful to users who annotate only a small number of image aesthetic scores.
See our full paper here.