MIKU EXPO 2021 Online

OVERVIEW

Virtual singer Hatsune Miku's world tour "MIKU EXPO" will be held as an online concert "MIKU EXPO 2021 Online" in 2021.
We were in charge of the AR live video production for the opening video and the main concert, and were involved in everything from planning to directing, producing, filming, and digital compositing.

IMAGES

Creating a cohesive stage with AR live performances

The best part of a Hatsune Miku concert is seeing the virtual singer Hatsune Miku appear right in front of you and performing together with the live band on stage. For "MIKU EXPO 2021 Online," we had to create the sense of unity with the stage that could previously be experienced at the venue using only video. Our biggest challenge was how to convincingly convey that "Hatsune Miku is now on stage."

This led to the adoption of an AR live performance, a first for "MIKU EXPO." This made it possible for virtual characters to seamlessly exist on stage alongside a live band. In addition, the opening video before the main feature featured Hatsune Miku and other virtual singers appearing in live footage of the city of Sapporo. These are visual expressions unique to AR that could not have been achieved in previous "MIKU EXPO" events.

Synchronize virtual and real lighting to give characters a sense of presence

In order to fuse the two worlds, virtual and real, in the same space, it was necessary to fine-tune the data requirements in detail. For example, it was important that the lighting on the stage was exactly the same for Hatsune Miku and the real band members.

So we created a system that synchronized the lighting program of the actual stage with Hatsune Miku's motion data, so that the lighting in the virtual space and the real space would be the same, without any discrepancies. This technology enhanced the character's sense of reality, making it possible for virtual characters and real people to coexist seamlessly.

Taking into account the creators' thoughts, each song is carefully produced

We have also been involved in the video direction of each song from the planning stage. Hatsune Miku songs are produced by various creators around the world, so each song has a completely different worldview and image. And each song is filled with the creator's passion for Hatsune Miku. We aimed to create the image of Hatsune Miku that fans want, while keeping in mind the intentions of these creators first.

They also responded to many performance requests from fans. "MIKU EXPO 2021 Online" was held through crowdfunding from fans, and in return they asked for things they wanted to see come true on stage. Flapper3 incorporated all of these requests into the video, devising images that fit the worldview of the song. For example, in response to a request to "feature an equalizer as a motif in the performance," they proposed a spatial expression using sound waveforms that change in sync with the rhythm. They are not just responding to requests, but are also devising ways to incorporate them as effective performance elements.

We also plan to utilize SNS to make the videos we distribute more persuasive.

Along with the production of the video for the distribution, we are also planning some features that will allow you to feel the "real presence of Hatsune Miku" even more. For example, in the scene introducing the band members, in addition to the video for the actual distribution that features each member's solo performance, we also produced a separate video of "Hatsune Miku dancing to the members' solo performance." This was later released as a surprise video on the official Twitter account, and received a great response from fans around the world.

CREDIT

INTERNAL

RELATED WORKS