Automated Simulation Control through intelligent Speech and Text Models

The goal of the project is to further develop existing multimodal AI technologies so that simulations can be controlled via an interactive interface in the form of a chatbot.

Using Z88Aurora—the graphical user interface for the finite element (FE) program Z88—as an example, users should be able to build the finite element model and start the simulation via text and voice input. During the interactive process, users can not only issue instructions but also ask questions—for example, about the meaning and appropriate choice of certain model parameters. The final instructions for the simulation setup are then translated by a pretrained multimodal AI model into Z88Aurora-specific commands. To this end, a user-friendly Z88Aurora scripting interface must be developed. At the end of the simulation, users can obtain feedback from the AI model on the FE results as well as recommendations for improving the finite element model.

The Z88Aurora scripting interface can also be accessed independently of the multimodal AI model using pre-generated or manually authored scripts. In this way, simulation control can be automated and integrated into internal business processes. For example, it can help avoid repetitive steps in time-consuming parametric studies.