Grounded Generation of Embellished Bar Chart Ensuring Chart Integrity

Keywords

Chart Embellishment, Grounded Image Generation

Abstract

Grounded image generation enables precise spatial control over pre-trained diffusion models, making it possible to use chart images as visual guides during the image generation process. This paper presents a novel approach that generates cohesive and natural illustrations of vertical bar charts by integrating real-world object images as visual embellishments. The proposed pipeline takes an object image and a reference bar chart as input and produces an embellished bar chart that follows the structure of the input chart. To preserve chart integrity by maintaining the count, position, size, and order of data values, we introduce a strategy that anchors the top and bottom parts of the object image to the top and bottom of each bar while allowing the middle section to be filled by the generation model. We demonstrate the efficacy of the pipeline through the generation of 4,725 chart images followed by evaluation based on three integrity metrics. The results show that generation success rate is affected by various factors. Finally, we discuss future directions for generalization and better usability of our pipeline, and limitations of evaluation used in our approach.