JVCKENWOOD Showcases Brainwave-Activated AI-Pushed Music Composition and Video Creation At CEATEC 2024

0
3



At CEATEC 2024, we visited the JVCKENWOOD sales space, which featured three areas themed round “Connecting individuals, time, and area to create the longer term.” This aligns with the corporate’s philosophy of “bringing pleasure and peace of thoughts to individuals all over the world” via cutting-edge know-how to complement lives. JVCKENWOOD showcased progressive video, audio, and wi-fi options designed to create new worth for the longer term. The primary space, labeled by the corporate “Impression – Leisure Space,” * featured tech demonstrations that engaged all 5 senses—imaginative and prescient, listening to, contact, scent, and style—offering a deeply immersive, multi-sensory expertise.JVCKENWOOD sales space 3D rendering for CEATEC 2024 – picture courtesy of JVCKENWOODAI Creates Music and Video Primarily based On Your Unconscious Emotional ResponseAt the JVCKENWOOD sales space’s “Impression Leisure Space,”* we skilled an progressive demo combining brainwave detection, human senses, and AI to create customized music and video. Contributors are uncovered to stimuli, comparable to pre-prepared movies, designed to evoke emotional responses. A brainwave headset then detects the feelings generated, and AI makes use of this information to compose music and challenge corresponding photographs in real-time. The consequence, described as “the music and video you created,” is performed again. The AI additional classifies the participant’s unconscious reactions, routinely producing music and visuals that mirror their emotional state, providing a novel interactive expertise.How Does The Know-how Behind the Emotion-driven AI-Generated Music And Video Creation Work?Suguru Goto, Affiliate Professor within the Division of Musical Creativity and the Surroundings at Tokyo College of the Arts, offered a demo developed by a crew of researchers with the assist of JVCKENWOOD. Suguru Goto, who can also be a composer and a media artist, showcased the progressive use of brain-computer interface know-how for artwork creation on the JVCKENWOOD sales space.How Did The Demo Work?The crew used an Emotiv Perception EEG headset designed to assist researchers and engineers develop progressive options for brain-computer interfaces in numerous fields. Having personally examined a number of Emotiv merchandise of their early days, I can vouch for the robustness of their brainwave-enabled {hardware} instruments, which have change into trusted options in neuroscience-based interface improvement.Once we arrived on the demo, the headset was already calibrated to the participant’s brainwaves. In line with Suguru Goto, the system requires just some minutes to calibrate for every new consumer. The method started with a short meditation session, adopted by the participant viewing a number of pre-prepared movies designed to set off particular emotional responses. The Emotiv Perception headset recorded the brainwaves throughout these actions whereas AI-driven software program interpreted the info.Suguru Goto defined that brainwaves are analyzed utilizing machine studying algorithms, which categorize the info into 28 emotional states. These states are organized on a Cartesian aircraft, with the X-axis (horizontal) starting from discomfort (unpleasure) to pleasure, and the Y-axis (vertical) starting from alertness (arousing) to sleepiness.He additionally confirmed me a pill displaying a graphic illustration of how the software program additional divides these 28 emotional states into 64 subdivisions, offering a extra detailed view of the participant’s emotional responses.28 emotional states, subdivided into 64 divisions, are organized on a Cartesian aircraft, with the X-axis (horizontal) starting from discomfort (unpleasure) to pleasure and the Y-axis (vertical) starting from alertness (arousing) to sleepiness.After the participant accomplished the video classes, the system routinely generated music and video based mostly on his emotional responses. This demonstration highlighted how brainwave information, mixed with synthetic intelligence, can create subconscious-based customized audio-visual content material, providing a glimpse into the potential of brain-computer interface applied sciences in inventive fields.For the demo at CEATEC, the sound was performed via  JVCKENWOOD wood audio system, and the AI-generated video was displayed on a big display screen. The creative idea of the challenge, shared with me in a non-public video, entails exhibiting emotion-triggering movies on a monitor going through the participant, whereas the AI-generated visuals are projected onto the ground in a darkish room the place the particular person is seated.Past AI-based Artwork: Unlock Limitless Potentialities For Human WellnessEven although that is a powerful creative analysis challenge, Affiliate Professor Suguru Goto indicated that it gives vital potential for health-related functions, significantly psychological well being care. I do know that Emotiv’s main objective is to offer high-quality EEG-based {hardware} and software program instruments to allow researchers to develop options that enhance cognitive and psychological well being. This consists of creating progressive approaches to music neurofeedback remedy.JVCKENWOOD Picket-made SP-WS02BT audio system – the audio playback was greatIn addition to video stimuli, different sensory inputs—comparable to sound, style, and scent—may additionally set off emotional responses in contributors. For instance, the participant may maintain a JVCKENWOOD “Hug Speaker” (see photograph), which vibrates in sync with the sound, or benefit from the scent of the wooden from audio system crafted from numerous kinds of pure wooden. These stimuli may complement the AI-generated video and music created from brainwave information.“Hug Speaker” – photograph courtesy of JVCKENWOODAlthough we didn’t expertise the demo for different sensory stimuli on the sales space, I’m assured they’d work seamlessly with the identical demo setup and AI-driven software program, creating photographs and music based mostly on the participant’s unconscious emotional response to this sensory stimulation.* Editor’s word: “Impression – Leisure Space” is an English translation by Google based mostly on JVCKENWOOD  Japanese Press Launch

Filed in Audio >Design >Photograph-Video. Learn extra about AI (Synthetic Intelligence), Brainwave, CEATEC, Ceatec 2024, Eeg, Emotiv and Japan.