Sony Edge Analytics brings hybrid learning to the University of Bamberg

Video technology based on artificial intelligence Sony Edge Analytics and SRG-X120 IP-4K PTZ cameras bring hybrid learning to larger classrooms and auditoriums.

A team of multimedia technicians and IT specialists has implemented a digital system to optimize hybrid learning operations in the University of Bamberg, ensuring that students can benefit from an in-person or remote system. The innovative artificial intelligence technology of Sony, Edge Analytics, It's part of the solution.

Founded in 1647 as the Academy of Bamberg, the University of Bamberg (Otto Friedrich University Bamberg) It is one of the oldest in Germany and currently attracts almost 13.000 students from all over the world. Like many other institutions, faces major digital transformation challenges, in addition to the uncertainties typical of this time of pandemic.

In the modern An der Weberei building of the University of Bamberg, specifically in the classroom in classroom WE5/00.022 a PTZ camera has been hung from the ceiling IP-4K SRG-X120 from Sony. This equipment captures in high resolution every corner of the room. 300 square meters. An element that has become fundamental for hybrid learning.

“At the moment, We have five large classrooms permanently equipped with these modern cameras. This technology is a fundamental element to be able to continue university teaching even during a pandemic”, comment Christoph Seeger, who works at the computer center at the University of Bamberg.

The project has been carried out with the Sony supplier MR data technology sales and service, based in Nuremberg.

However, It's not the ceiling-mounted PTZ cameras that create the hybrid learning system. That role falls to the small, even less conspicuous black boxes to which the cameras are connected..

The little cube, of little more than 10 centimeters in length, Edge Analytics, contains video technology based on artificial intelligence.

“That is where the intelligence behind our system lies”, explains Michael Fries, Account Manager de Professional Displays & Solutions Business Group en Sony, specialized in hybrid learning systems for the educational sector. “Edge Analytics detects the teacher and makes it possible for the PTZ camera to follow the class. Also detects gestures from participants and saves whiteboard notes, even if the teacher covers part of it”.

The Edge Analytics system is configured via a web-based user interface and operated with a standard multimedia control unit, Compatible with all common professional multimedia control units.

The five classrooms at the University of Bamberg that are equipped with Sony's Edge Analytics system use controls and touch panels from Extron.

“Edge Analytics generates engaging content in real time and automatically. You can stream video from the camera directly to a display or storage media, via IP, to any location in the world or, like at the University of Bamberg, to the video streaming server you use. This system works by itself, without teachers having to constantly check or adjust multimedia technology settings”, Fries adds..

Flexibility and mobility

The University of Bamberg has not yet modernized all the classrooms and seminaries in its various buildings throughout the city, so to offer hybrid learning in more rooms, has purchased two mobile units, in addition to the five permanently installed systems.

The mobile units also consist of a Sony PTZ camera and the Edge Analytics box. The system is compact, It is installed in a transport box and can be moved from one room to another.

“Teachers can connect the system themselves in a few simple steps, get it up and running and configure it for the class or course, For example, specify whether the class is to be streamed live or saved for later download”, Fries comments.. Installation is also easy, because the individual components are only connected to each other via network and HDMI cables, and then to the multimedia control unit.

Edge Analytics Features

The Edge Analytics system has a total of five functions that can be activated through a licensing model according to needs.

First of all, there is the PTZ auto tracking, which puts connected camera technology to work and ensures that cameras track a moving object fully automatically, especially in large classrooms like those in Bamberg. An algorithm enables automatic tracking of speakers so they always remain clear and focused.

Handwriting extraction feature uses augmented reality techniques to keep words and diagrams written on the whiteboard visible to students at all times. Edge Analytics automatically detects handwritten text, drawings and diagrams, extracts a real-time overlay from them and displays it in front of the speaker. Even if the speaker is positioned directly in front of the whiteboard, Students will always be able to see the ideas and reasoning. The extracted text can be downloaded to a laptop as a JPEG file.

Sony's Edge Analytics uses gestures to detect certain movements in the room. For example, If someone in the auditorium gets up, the camera automatically zooms in on that person and focuses on them while they are speaking. According to Fries, This is especially useful in classes or corporate presentations to capture questions or comments.

Screen cropping feature improves class dynamics, as it can be used to display adjustable image sections on additional screens. This means that multiple screen views can be achieved with one camera.

Finally, although no less important, The overlay feature can be used to display additional content on the screen that is visible to students, like the presentation window, fixed university logo or a completely different background.

As Seeger comments, and Bamberg, six of the seven Edge Analytics systems are equipped with the PTZ auto-tracking license. “One of our systems has all the licenses. For now, we are using it as a test system and testing the individual functions. Installation and setup was very easy and there were no compatibility issues with our current Extron system. We now have a modern hybrid learning system in our large classrooms and auditorium, where we are also using this solution”.