Application of AR virtual implantation technology based on deep learning and emotional technology in the creation of interactive picture books

In: 3C TIC: cuadernos de desarrollo aplicados a las TIC, Band 12, Heft 1, S. 176-198

Abstract

In recent years, the field of deep learning has flourished, not only breaking through many difficult problems that are difficult to be solved by traditional algorithms but also bursting with greater vitality when combined with other fields. For example, product emotional design based on deep learning can integrate users' emotional needs into the actual product design. In this paper, we aim to use deep learning and affective technology in the creation of AR interactive picture books to transform the reading process from static to dynamic, enrich visual stimulation, and increase the fun and interactivity of reading. In this paper, based on the three-level theoretical model of emotion, the emotion labeling results are input to a deep neural network for learning, to establish an emotion-based recognition model for picture book images. The results show that the model can well analyze the emotion of images in AR picture books, and the accuracy of prediction is a big improvement compared with traditional machine recognition algorithms. The application of AR virtual implantation technology in interactive picture books on the market is often just a marketing gimmick while combining deep learning and emotional technology can better create diverse interactive picture books to meet children's emotional reading needs, enhance reading engagement, and stimulate children's creativity.