Project Overview

Project Directors: Jeffrey Shaw and Dennis Del Favero
ARC Discovery Grant IDs: DP0345547; DP0556659

AVIE is the world’s first 360-degree stereoscopic immersive interactive visualisation system that includes a motion tracking system and a multi-channel audio system. Driven by an experimental framework, it uses a suite of cutting edge hardware and software resources enabling the development of applications in Virtual Reality, Artificial Intelligence, Motion Capture and Motion Tracking.

AVIE: exterior and interior views showing Eavesdrop

AVIE has been installed as core visualisation infrastructure at ZKM, Centre for Art and Media, Karlsruhe, Germany; City University of Hong Kong, Hong Kong; Rensselaer Polytechnic University, New York, USA; where it forms the centre piece of next generation research and teaching programs. Museum Victoria, Melbourne, has installed an AVIE for its current Dynamic Earth exhibition. It has been commercialised for the mine safety training industry by Mines Rescue Pty Ltd at its Newcastle, Wollongong, Lithgow and Singleton facilities and the Shenyang Research Institute of China Coal Technology & Engineering Group (CCTEG), one of China’s leading mine safety research centres, at its new training facility in Fushun. AVIE has been commissioned as a curated visualisation platform by numerous premier international venues for exhibitions and festivals, including:

  1. Art of Immersion: Virtual Frontiers, ZKM, Karlsruhe, 2017
  2. Sydney Film Festival, Sydney, 2016
  3. International Symposium of Electronic Art 2016 (ISEA16), Hong Kong, 2016
  4. Chronus Art Center, Shanghai, 2014-15
  5. Smithsonian Institution, Washington D.C., 2014
  6. Child, Nation and World Cinema Symposium, Sydney, 2014
  7. 20th International Conference on Virtual Systems and Multimedia, Hong Kong, 2014
  8. International Symposium of Electronic Art 2013 (ISEA13), Sydney, 2013
  9. 10th Shanghai Biennale, Power Station of Art, Shanghai, 2013
  10. SIGGRAPH Asia, Hong Kong, 2013
  11. Hong Kong Book Fair, Hong Kong, 2013
  12. Limited Knowledge, Hong Kong, 2013
  13. Festival d’Avignon, Avignon, 2013
  14. Kaladham Museum, Karnataka, (permanent installation) 2012-
  15. Business of Design Week, Hong Kong, 2012
  16. NODEM, Hong Kong, 2012
  17. Grand Opening of Run Run Shaw Creative Media Centre, Hong Kong, 2012
  18. le 360 in Matter-Light, Bethune, 2011
  19. Sydney Film Festival, Sydney, 2011
  20. ‘La dispersion du Fils’ in Festival of Avignon, Gymnase Paul Giera, Avignon, 2011
  21. National Institute of Experimental Arts double conference, Sydney, 2011
  22. Digitalife, La Pelanda, Rome, 2010
  23. STRP Art and Technology Festival, The Klokgebouw, Eindhoven, 2010
  24. ‘Rio Tinto Volcanic 3D’ in Dynamic Earth, Museum Victoria, Melbourne, 2010
  25. Cinema, Modernity and Modernism, FHAANZ conference, UNSW, 2010
  26. Voyage to the Planet’s TV series, ABC Television, 2010
  27. Inaugural Exhibition, ALiVE Applied Laboratory for Interactive Visualization and Embodiment, Hong Kong, 2010
  28. eArts Festival: eLANDSCAPES, Shanghai Science & Technology Museum, Shanghai, 2009
  29. Un Volcan Numérique, Le Volcan Scène Nationale du Havre, Le Harve, 2009
  30. Seconde Nature, Espace Vasarély, Aix-en-Provence, 2009
  31. ‘T_Visionarium OPEN CITY’ in ‘International Documentary Filmfestival Amsterdam’ and ‘Architecture Biennale Rotterdam’, Zuiderkerk, Amsterdam, 2009
  32. Imagining Media @ ZKM, Karlsruhe, 2009
  33. Sydney Festival, Sydney, 2008
  34. Biennale of Seville (BIACS3), Carlos V Alambra Palace, Granada, 2008
  35. YOUser: the Century of the Consumer & Panorama Festival, ZKM Media Museum, Karlsruhe, 2007-2009
  36. From Spark to Pixel, Martin-Gropius-Bau, Berlin, 2007
  37. There is still time… Brother by the Wooster Group, EMPAC, Rensselaer University, New York, 2007
  38. i.Future Festival, Singapore Science Centre, 2007
  39. Inhabiting the Cultural Imaginary, VSMM conference, UNSW, 2007

Video AVIE

Forming part of the iCASTS suite of technologies, it is exclusively licensed to Immersive Realisation, and has been commercialised for the mine safety training for Mines Rescue Pty Ltd at its Newcastle, Wollongong, Lithgow and Singleton facilities and the Shenyang Research Institute of China Coal Technology & Engineering Group (CCTEG), one of China’s leading mine safety research centres at its new training facility in Fushun.

AVIE provides a platform in which 3D audio-visual experiences are created by a combination of multiple projectors and multiple sound sources, driven by a cluster of computers, running a highly versatile real-time 3D VR engine.

AVIE visualisation forms:

  • High-resolution panoramic stereo images with augmented 3D graphics overlays
  • High-resolution panoramic videos, including stereo videos
  • Immersive multimedia data visualisation
  • Real-time interactive 3D environments supported by artificial intelligence systems

AVIE interaction platforms

AVIE utilises two types of interaction:

  1. a) remote device: a wireless tablet device allowing real-time selection and navigation within interactive applications
  1. b) motion tracking: system of infra-red cameras and real time software that detect, track and interpret human movement and gestures, allowing audience participation in the direct cinematic experience, interplay between users and digital characters and analysis of user behaviour

AVIE: interior view showing T_Visionarium II

AVIE: interior views showing Mining VR