In these projects we explore tools and topics around the quickly changing fields of virtual reality and augmented reality. We want to understand how these new tools fit into journalism and other kinds of storytelling, and the only way to learn is to try things.
This team is looking at how to accommodate image formats from a variety of popular 360-degree cameras, including iPhone panoramas. The goal is to make a tool not only for journalists but also for any storyteller looking to tell a story in VR.
Based on the outcomes of our a Exploring AR Visualizations project in the Winter, this project will take the unique forms of visualizations discovered and develop a tool that makes it easy for storytellers to build and embed augmented reality visualizations in their stories and projects.
Automated Photogrammetry. As AR and VR increasingly becomes the focus as we move away from smartphones, media organizations will have to find ways to produce content native to those mediums. These same organizations have a wealth of stories that continue to have value over time. Flat video and photo will become less desirable as we continue to move into these new spaces. Previous projects in the lab have surfaced an opportunity to take existing video and process it using photogrammetry software to produce a 3D model.
An experimental design project that explores visualizing data in three dimensions for augmented reality. Visualizations that can be examined and inspected by physically getting closer or understood by walking around them, open up exciting possibilities for how we communicate complex ideas and data that reveals hidden truths.
An experimental design project, in which we students are analyzing methods for communicating data visually and exploring how those principles might be transferred and transformed in a 360 environment.
An experimental design project that explores an emerging concept of information spaces. This concept is behind Microsoft’s pivot to create future Windows operating systems that exist in mixed reality headsets. Students will explore the concept of a news/information app that exists in AR and/or VR. For example, a political news feed might exist on a wall in your living room, and breaking news would appear on a coffee table, twitter reactions surround the coffee table on the floor. Students will also explore the same concept in a virtual environment.
Augmented Reality allows creators to tell stories in the places where they actually happened. For the purpose of this project, we’ll be working with the concept of physical accessibility on campus. We will use the Unity game engine and a framework developed at Knight Lab so that we can quickly experiment and refine our ideas. We’ll spend some time early in the quarter looking at AR experiences from museums and tourist attractions as well as games like Ingress and Pokemon Go. From there, we’ll build an app and start testing it with users, refining ideas as we go along. We’ll consider the differences between gamified apps that include scavenger hunts or challenges and AR applications that lay out information in a more traditional way.
Though many in journalism are excited about VR, few are addressing real issues with making it attractive and interactive for their audience. This story team will explore the idea of making multiple three-dimensional VR photos around a scene and linking them together so that the user can navigate it. They’ll be exploring complex VR design challenges, such as how to move around space without disorienting the user and how to easily author interactive environments.
Based on the outcomes of Oscillations project in Winter quarter, this project will continue exploring using the latest VR production techniques to create engaging VR experiences. Students will record performances using motion capture and use machine learning to teach a computer to improvise a performance.
Based on the outcomes of Oscillations project in Winter and Spring quarters, this project will continue exploring using the latest VR production techniques to create engaging VR experiences. Students will record performances using motion capture and use machine learning to teach a computer to improvise a performance.
Recent breakthroughs in neuroscience and immersive technologies provide mechanisms for engineering an entirely new mode of performance art — one that engages audiences to unprecedented degrees.
In this project, students will use modern approaches to making 3D images both with hardware and software processing.
Imagine that any wall, building floor or doorway could come alive and tell stories. Using projection mapping, many artists, advertisers and industries are already doing it. In this project, students will explore ways in which projection mapping is currently being used and adapt them for journalistic purposes. Students will build and prototype their adaptations.
In this project, students will film 360 video and explore the best ways to add on that additional layer; students will finish the quarter with two videos, and will document their findings to make their storytelling methods more accessible to others.
Faculty and Staff Leads
Technical Program Manager, Emerging Platforms
Story & Tech, sometimes VR. Retired bartender, lapsed theater-person