Aesthetics are an important part of the symbolism of artistic works. Although subjective, humans categorize art based on the emotion evoked regardless of modality. What remains under-explored is how AI models form their own aesthetic categorization of human-produced media without explicit labels or cross-modal supervision. We present a self-supervised framework that projects four modalities (text, audio, image and video) into a shared 256-dimensional embedding space and applies iterative clustering to discover aesthetic structure. We discuss the divergence between AI-generated cluster assignments and human affective register labels on a weakly supervised multimodal dataset. This work has applications in understanding how AI structures cross-modal similarity, organizing heterogeneous media collections for Retrieval-Augmented Generation (RAG), and automated data labeling.
Facial attractiveness has been linked to statistical regularities such as symmetry and averageness, suggesting that beauty may depend on the ease with which a face is perceived. We empirically test this hypothesis by training variational autoencoders on four face datasets without attractiveness supervision and evaluating their representations on the 597 faces from the Chicago Face Database. Across models, human attractiveness ratings closely aligns with the direction defined by the VAE evidence lower bound (ELBO) in rate-distortion space. Independently learned latent spaces contain an attractiveness direction that transfers strongly across random initializations and training data. We also find that attractive faces are more prototypical in both shape and latent space. Our results connect classic accounts of aesthetics with learned generative models and provide empirical support for a variational interpretation of the processing fluency theory of aesthetic pleasure.
Lisa Koßmann, Ralf Bartho, Christoph Redies +1cs.CV cs.LG
With rapid growth in the fields of empirical and computational aesthetics we have seen a vast increase in large image datasets annotated for aesthetics. As the image databases differ widely in many respects (e.g., different standards for annotation), it can be tedious to find the dataset that fits one's research needs best. The absence of a centralized open-science search system causes additional problems. Currently, researchers typically share dataset links in papers or on diverse platforms like OSF, GitHub or Dropbox. Manually searching for details like image quality and content often requires downloading all datasets. Therefore, we present the Database Of Datasets for Aesthetics (DODA), an intuitive Web application in which researchers can browse all important datasets for aesthetics research. DODA provides general information about these datasets (size, resolution, type of annotation, number of annotators, etc.) and for many of them also precomputed quantitative image properties. We discuss relevant criteria for selecting a suitable dataset with DODA and illustrate the benefits of reusing datasets. Our approach facilitates collaboration across the fields of empirical and computational aesthetics. Keywords: empirical aesthetics, computational aesthetics, machine learning, image annotation, quantitative image properties, Open Science