Leading the Future of Performing Arts Production

Interview with Paweł Jabłoński, CTO of OnstageAI

In our latest interview, Paweł shares his perspective on the future of performing arts production, how AI can support creativity, and what it takes to build technology for one of the most demanding artistic environments.

"Paweł, is there actually an area in classical music that truly needs AI support?

Absolutely, but first we need to debunk the myth that AI in the classical music world means robots playing instruments or singing. Our goal isn't to replace the artists on stage, but to support the incredible work happening around it. Producing complex events like a symphonic concert or an opera requires deep musical knowledge and perfect timing. Unfortunately, for decades, professional video production has been so costly and complex that about 70% of classical performances go unrecorded.

By 2030, it is estimated that nearly 90% of online video content will be AI-generated. In a world flooded with synthetic media, audiences will crave authenticity and real human emotion more than ever. We use AI to bridge the production gap, making it possible for these authentic human moments to be captured and shared globally. We are removing the logistical and financial barriers so that the art itself can take center stage.

"You’ve mentioned that "Audio Intelligence" understands sound. But can it truly distinguish between instruments in a complex symphonic setting?"

Distinguishing individual instruments within a full symphonic orchestra is one of the greatest challenges in audio engineering. It’s incredibly difficult because of the way sounds overlap and blend. Because of this, we don't rely on a single method; our technology uses a multimodal approach.

While "stem separation" is one tool in our kit, we combine it with other vital sources of truth. Our system simultaneously analyzes the live video feed to confirm what is physically happening on stage. Furthermore, because our core technology performs real-time "Score Following," the system already knows exactly which instruments are supposed to be active according to the sheet music. By fusing audio analysis, visual confirmation, and the musical score, we achieve a level of instrument awareness that was previously impossible.

"What happens if the orchestra plays with a completely different dynamic or a much faster tempo than the reference score?"

This is where OnstageAI differs from traditional, rigid production scripts. Music is a living thing; it breathes, and every conductor brings a unique interpretation to the tempo and dynamics.

Our system doesn't follow a static clock. Instead, it "listens" and adapts to the performers in real-time. Because the technology is constantly aligning the live performance with the musical structure, it remains perfectly synchronized whether the orchestra decides to rush a passage or linger on a fermata. The video production essentially "breathes" with the musicians, ensuring the visual cuts always match the actual pulse of the performance.

"Technology can certainly serve as a tool to deliver video content faster—but what about the quality and the "soul" of the direction?"

This is why we developed the "Creative Copilot" concept. We believe that while AI is unmatched at execution, the artistic "soul" must come from a human.

In our workflow, the technology acts as a highly intelligent assistant. It proposes shots and handles the technical heavy lifting, but the human director maintains the artistic vision. However, the AI allows us to go beyond human limitations. It can execute complex sequences of cuts and camera movements with a level of precision and speed that a traditional camera crew simply cannot achieve. We are giving directors a "super-powered" tool to realize their vision without being held back by human reaction times or coordination errors.

"What kind of quality standards is OnstageAI aiming for?"

Our standard is to make every performance look like a world-class, multi-camera television broadcast. We currently deliver ready-to-publish 4K video immediately after a concert ends, completely bypassing the weeks of traditional post-production.

Looking ahead, we are pushing toward "Multi-production." From a single live event, our AI can simultaneously generate a cinematic cut for TV, a vertical version optimized for social media, and a specialized "focus" cut for educational purposes. We aren't just aiming for high resolution; we are aiming for a new standard of accessibility where world-class production is available to every stage, hall, and artist.

Any thoughts? Please share them at pp@onstage.pl

Ask a question