Brainstorm participates in the European Emerald project

Financed by the European Commission, this project in which you participate Brainstorm focuses on the development and demonstration of AI tools, machine learning (ML) and Big Data for the digital entertainment and media industries.

Brainstorm, specialized in real-time 3D graphics, virtual sets and augmented reality solutions, participate in the european project Emerald Process automation and AI for sustainable media and entertainment, funded by the European Commission under the program Europe horizon.

The interdisciplinary consortium of seven partners includes leading companies in live entertainment technology, streaming, streaming and film, como British Broadcasting Corporation, Brainstorm Multimedia, Disguise Systems, Filmlight y MOG Technologies, and supported by two european universities.

“Emerald strives to be a pioneer in Innovative tools for the digital entertainment and media sectors, harnessing the potential of artificial intelligence technologies, machine learning and Big Data -explains Francisco Ibanez, R&D project manager at Brainstorm-. The goal is to revolutionize processing, improve production efficiency, “minimize energy consumption and increase the quality of content with innovation”.

As this manager points out, “Currently there is amassive increase in the volume of video-based and extended reality content, with an unsustainable demand for trained human resources, data and energy processing. This project aims to address this challenge by development of process automation for the creation of sustainable media”.

Javier Montesa, R&D technical coordinator at Brainstorm, adds that, in collaboration with the Pompeu Fabra University (UPF), Deep learning-based methods and tools are being developed to separate video into two or more layers (matting).

“The main objective is to produce high quality results - underlines- for the Automatic real-time integration of remote presenters or artists into scenes and virtual sets for broadcast and streaming media using deep learning, without the need for a trimap. With the AI improvement of InfinitySet we will bring the quality of green screen methods to simpler configurations”.

Brainstorm has plans integrate InfinitySet with UPF deep learning systems for head and body pose estimation, which will allow the operator to activate content that will be automatically displayed in different parts of the scene, virtual screens, 3D graphics placeholders or, simply, in front of the presenter while moving.

Thanks to this “new ways will be explored to improve the insertion of the presenter, “change your silhouette and calculate your shadow with more precision and realism”, assures.

Besides, The company will participate in the creation of tools designed for automatic color balancing and the coincidence of shots. Color manipulations are necessary in post-production, in virtual productions and virtual studios.

“The integration of this automatic color correction in InfinitySet will simplify the use of the tool and improve presenter-scene integration when lighting conditions are not controlled or when the virtual scene is intended to vary during a program”, concludes.