Dream On with grandMA3: Shakespeare becomes virtual

Dream Copyright Stuart Martin RSC 1  

“Dream” is an ingenious and engaging multi-layered mix of movement, music, visuals, cool technology and narrative magic, an immersive digital performance fusing the drama of Shakespeare with the dynamic worlds of gaming and theatre in a ground-breaking production by the UK’s Royal Shakespeare Company in collaboration with Manchester International Festival, Marshmallow Laser Feast, and the Philharmonia Orchestra.

Staged physically in the Studio at Portsmouth Guildhall and inspired by the classic A Midsummer Night’s Dream, the characters were played by six real actors utilising Vicon motion capture cameras, their avatars and effects appearing onscreen – centring around the antics of cocky and capricious mischief-maker Puck. They run amok in the virtual Midsummer forest, hellraising and spoofing four other sprites during a disruptive and chaotic journey!

Matt Peel was responsible for lighting design and show control. He utilised the power – and specifically the OSC (open sound control) and DMX remote triggering capabilities – of his grandMA3 system with the new grandMA3 software.

The highly acclaimed show was broadcast live for 10 evenings and enjoyed by thousands worldwide, who logged in, either paying for an interactive ticket – with the chance to shoot fireflies into the story to help illuminate Puck’s pathway through the forest – or simply watch the performance for free.

Dream was originally intended to be an in-person performance during 2020, but due to the pandemic, was adapted and re-worked as a live performance concept to be fully enjoyed remotely … from wherever the audience happen to be!

As part of the R&D phase of the project, Matt explains that working closely with the RSC’s Daniel Orchard, an Unreal Engine developer, they integrated known event technologies to communicate with the virtual and real-world show control systems.

Dream Copyright Stuart Martin RSC 2

An MVR (My Virtual Rig) importer developed for Unreal enabled the Vectorworks pipeline for real-world lighting to be received by both Unreal as well as natively in grandMA3; OSC was integrated into Arduino powered proximity sensors to communicate the status of the physical world; and a PosiStageNet (PSN) – 3D live positional data protocol – plugin for Unreal enabled the grandMA3 and Unreal (which already has inbuilt DMX and OSC) to communicate bi-directionally.

By building custom grandMA3 fixture-types, certain aspects in the game world could be controlled via DMX, e.g., the height and brightness of an object like the sun, or the colour of an avatar, etc. Using grandMA3, all these elements could be rapidly tweaked in real-time on the console.

“Using the grandMA3 in this way meant we could work really fast in this context to make adjustments to these game effects, rather than using game engine keyframing which is a lot more time consuming jumping Unreal in and out of ‘editor’ mode,” says Matt.

A project like Dream was a perfect opportunity to experiment with this bi-directional control and state awareness, merging game-based event logic to create a new style of live performance. It allowed the grandMA3 to be the master show controller sending and receiving unicast OSC between 16 different role machines.

Unreal Engine instances were used to create the rich and complex visual environments in which the action took place, and OBS instances allowed vision mixing the final output between Unreal and four broadcast cameras.

Matt explained that a small rig of traditional theatre lighting – in the form of eight moving lights – in the real studio motion capture volume (capture space), assisted in directing the actors to respond to interactions from the remote audience.

Dream Copyright Stuart Martin RSC 4
In addition to orchestral music by composer Jesper Nordin and Philharmonia Orchestra principal conductor and artistic advisor Esa Pekka-Salonen, at strategic points the actors’ movement was fed into Gestrument software (a Jesper Nordin project) allowing them to ‘play’ digital instruments and interact together via their motion. Another clever twist which created a stream of beautifully ethereal sonic moments.

The overall show was cued and run in traditional theatre style by a DSM – a synergetic mix of innovative technologies and well-respected techniques that pushed several boundaries.

Matt has been using grandMA3 for some time in his work. In addition to the possibilities of bidirectional communication, vital for a cutting-edge performance like this, he also likes having a large number of playbacks on one page offering all the major elements “at your fingertips”.
Dream Copyright Stuart Martin RSC 3

Like everyone, Matt was delighted to be back working on another show after the disruption of the pandemic, and especially being alongside “so many talented people with huge expertise in numerous highly specialised areas” to make Dream such a success.

Dream was directed by Robin McNicholas of Marshmallow Laser Feast, Sarah Perry was the movement director, and the project lead and executive producer was Sarah Ellis, director of digital development at the RSC. Ambersphere Solutions Ltd is the exclusive distributor of MA Lighting in the UK.

Photos: © Stuart Martin / RSC

Dream On with grandMA3: Shakespeare becomes virtual

   “Dream” is an ingenious and engaging multi-layered mix of movement, music, visuals, cool technology and narrative magic, an immersive digital … Read more…

Europe’s first L-Acoustics K3 system installed by Matrix Sales at Denmark’s Eksercerhuset

L-Acoustics newest system gets a workout at The Eksercerhuset   Fredericia, Denmark – April 2021. The Eksercerhuset, or exercise house, sits in the centre of Fredericia, home of the Royal Danish Army’s Signals Regiment. It was constructed in 1863 as part of the old Bülow Barracks and has been used as a temporary performance venue […]

Read more…

Robe for Melodifestivalen 2021

Enthusiasm for the 2021 Eurovision Song Contest is bursting every disco bubble this year, especially in the wake of last year’s first ever cancellation due to – we all know what – as competing countries ramp up the glorious glitz, glamour, drama and pop moments with gusto!   No country takes the ESC more seriously […]

Read more…

Astera Launches New AX2 PixelBar

Wireless LED lighting specialist Astera launches its new AX2 PixelBar product – a quality linear wash fixture with wireless control, onboard battery, individually addressable LEDs, ultra-high colour rendering, fabulous digital colour calibration and a 21-degree beam. As with all Astera products, the AX2 is fully wirelessly controlled, robustly engineered, stylish … and comes complete with […]

Read more…

Uncompromising determination by Durban freelancer, Melusi Shabane

“A family is like a forest, when you are outside it is dense, when you are inside you see that each tree has its place.” – African Proverb-   With love and encouragement from his sister, 26-year-old Melusi Shabane, a Durban based freelancer, discovered the live events industry in South Africa and his passion, determination […]

Read more…

Claypaky Lighting Fixtures Score with Shows for FIFA Club World Cup Qatar 2020

April  – Postponed until 2021 due to the coronavirus pandemic, the FIFA Club World Cup Qatar 2020 was recently held with Qatar Vision Production Company (Qvision) producing and delivering the infotainment for all matches played at Ahmad Bin Ali Stadium and Education City Stadium, as well as developing, producing and managing the coronation ceremony on […]

Read more…

Clear-Com releases Station-IC Virtual Desktop Client

  –  Agent-IC Functionality Is Now Available for Mac and Windows PCs –   ALAMEDA, USA – April 15, 2021 –Clear-Com® has released the new Station-IC™ Virtual Desktop Client, a Mac- and Windows-based software application that connects to Clear-Com’s Eclipse® Digital intercom Matrix and coming soon, the LQ® Series of IP interface devices. Station-IC users […]

Read more…

Unite180 deliver a professional broadcast for online services

  Unite180, a church based in Pretoria, recently invested in a DiGiCo SD12 Console for FOH, a Waves eMotion LV1 Mixer (64 Stereo Channel) for broadcast and was also the first in South Africa to purchase a DMI-Klang Card all from DWR Distribution.   Established in 2013 by Pastors David and Chanelle Grobler, Unite180 has […]

Read more…

Robe & Anolis Chosen for Award-Winning Cologne Cinedom Installation

  To light the impressive 30-metre-high glass atrium of the Cologne Cinedom multiplex cinema, architectural lighting specialists Kardorff Ingenieure Lichtplanung GmbH chose Robe moving lights and Anolis LED floods to be at the core of a new lighting scheme to upgrade this impressive public area. Cologne Cinedom was opened in 1991 and is one of […]

Read more…

L-Acoustics Conquers the “Perfect Storm for a PA System” at Passion City Church’s New Cumberland, Georgia Location

  Diversified installs a K2 and A15 system that provides a nearfield-like experience and consistent coverage in an acoustically and architecturally challenging space   CUMBERLAND, Georgia – April 2021 – Passion City Church (PCC) was born out of the Passion Movement, a decades old movement within the collegiate generation known for introducing songs that are sung […]

Read more…

Dream On with grandMA3: Shakespeare becomes virtual

   “Dream” is an ingenious and engaging multi-layered mix of movement, music, visuals, cool technology and narrative magic, an immersive digital … Read more…

Europe’s first L-Acoustics K3 system installed by Matrix Sales at Denmark’s Eksercerhuset

L-Acoustics newest system gets a workout at The Eksercerhuset   Fredericia, Denmark – April 2021. The Eksercerhuset, or exercise house, … Read more…

Robe for Melodifestivalen 2021

Enthusiasm for the 2021 Eurovision Song Contest is bursting every disco bubble this year, especially in the wake of last year’s first ever … Read more…

Astera Launches New AX2 PixelBar

Wireless LED lighting specialist Astera launches its new AX2 PixelBar product – a quality linear wash fixture with wireless control, onboard battery, … Read more…

Uncompromising determination by Durban freelancer, Melusi Shabane

“A family is like a forest, when you are outside it is dense, when you are inside you see that each tree has its place.” - African … Read more…

Claypaky Lighting Fixtures Score with Shows for FIFA Club World Cup Qatar 2020

April  – Postponed until 2021 due to the coronavirus pandemic, the FIFA Club World Cup Qatar 2020 was recently held with Qatar Vision Production … Read more…

Clear-Com releases Station-IC Virtual Desktop Client

  -  Agent-IC Functionality Is Now Available for Mac and Windows PCs -   ALAMEDA, USA – April 15, 2021 –Clear-Com® has released the new … Read more…

Unite180 deliver a professional broadcast for online services

  Unite180, a church based in Pretoria, recently invested in a DiGiCo SD12 Console for FOH, a Waves eMotion LV1 Mixer (64 Stereo Channel) for … Read more…

Robe & Anolis Chosen for Award-Winning Cologne Cinedom Installation

  To light the impressive 30-metre-high glass atrium of the Cologne Cinedom multiplex cinema, architectural lighting specialists Kardorff … Read more…

L-Acoustics Conquers the “Perfect Storm for a PA System” at Passion City Church’s New Cumberland, Georgia Location

  Diversified installs a K2 and A15 system that provides a nearfield-like experience and consistent coverage in an acoustically and … Read more…