Proceedings of the 11th Convention of the
European Acoustics Association
Forum Acusticum / EuroNoise 2025


Málaga, Spain
June 23 - 26, 2025





Session: A09.01 Machine learning and artificial intelligence in acoustics - General
Date: Tuesday 24 June 2025
Time: 11:20
Title: A model for improving the performance of large language models on soundscape description tasks
Author(s): Zhongju Yuan
Dick Botteldooren
Pages: 2137-2142
DOI: https://www.doi.org/10.61782/fa.2025.0019
PDF: https://dael.euracoustics.org/confs/fa2025/data/articles/000019.pdf
Conference proceedings
Abstract

Generative AI is increasingly used in acoustic scene analysis and environmental soundscape description. Audio Language Models (ALMs) are key in this field but have two main drawbacks: they don’t provide human-like survey responses and require significant computational resources, making real-time monitoring impractical. These issues stem from differences in how ALMs and humans assess and store sensory experiences. We propose a computationally efficient model with a three-layer architecture. The top layer features an advanced ALM for recognizing, grouping, and remembering audio events. The intermediate layer includes a local salient change detector based on sound feature embedding, which identifies meaningful changes in the auditory environment. When a change is detected, the ALM interprets and remembers the sound. The bottom layer has a memory cell mimicking echoic memory, retaining and reconstructing recent audio inputs. This reconstructed memory is passed to the ALM for recognition when triggered by the salient detector. Tested on the Urban Soundscapes of the World dataset, our model balances computational efficiency with real-time recognition accuracy, paving the way for scalable, intelligent acoustic monitoring solutions.