Rebecca Poulson

Engineer

Rebecca leads AR/VR projects at Knight Lab. In addition to being a software developer and playwright, Rebecca is an Oculus Launchpad Fellow and Mozilla Tech Speaker. She has taught WebVR workshops on three continents.

Projects

Projects Rebecca Poulson has worked on.

Augmented Reality Features with 3D Food Photography

As of 2020, consumers have already purchased more than 2 billion Augmented Reality (AR) capable smartphones. By 2022, that number will be 3.4 billion. This huge installed base presents news organizations with the best opportunity to explore spatial 3D media with their audiences.

In this project, Knight Lab students will make exploring mobile AR easier for small teams and individuals, by developing and publishing a series of guides on how to make AR features using open source and low cost software.

Students will learn by doing, developing skills along the whole production pipeline, from asset creation, to development and design, to deployment. We will produce at least three AR projects over the course of the quarter. Each project will contain at least one 3d model of a food item produced by photogrammetry, the process of constructing a 3d model from 2d photos.

We chose food as the theme because it taps into an existing culture of sharing tabletop photos on social media and requires a lot of detail in order to be captured in a compelling way. We’re also interested in the potential mobile AR has to bring food journalism into our audience’s homes in a much more literal way. Are you more likely to feel confident approaching a recipe if you see the ingredients laid out on your own countertop beforehand? Can a 3d model illustrate the difference between two kinds of tomatoes more effectively than a flat photograph? Would you try more unusual foods if you could inspect them close up in 3d on your phone first?

This is a great project for students with experience and interest in photography, 3D modeling, writing, graphic and interaction design. Students coming from a software background will have the opportunity to learn about graphics optimization, how AR technologies work, working with SDKs and deploying projects to the web. Tools we’ll explore will include Figma, Meshroom, Blender, Torch and the Spark AR Studio for creating Facebook and Instagram filters.

Exploring Data Visualization in VR

An experimental design project, in which we students are analyzing methods for communicating data visually and exploring how those principles might be transferred and transformed in a 360 environment.

Information Spaces in AR/VR

An experimental design project that explores an emerging concept of information spaces. This concept is behind Microsoft’s pivot to create future Windows operating systems that exist in mixed reality headsets. Students will explore the concept of a news/information app that exists in AR and/or VR. For example, a political news feed might exist on a wall in your living room, and breaking news would appear on a coffee table, twitter reactions surround the coffee table on the floor. Students will also explore the same concept in a virtual environment.

Contrasting Forms Of Interactive 3D Storytelling

3d technology gives us the opportunity to tell the story of an object from all angles. With 3d scans we can examine tiny butterfly wings, visit distant archaeological sites and get up close to objects too fragile to be examined in real life. While 3d gives the viewer the ability to see the whole story, it’s often difficult to know just what to look at and how to construct meaning from this wealth of information.

Storytelling with Augmented Reality

Augmented Reality allows creators to tell stories in the places where they actually happened. For the purpose of this project, we’ll be working with the concept of physical accessibility on campus. We will use the Unity game engine and a framework developed at Knight Lab so that we can quickly experiment and refine our ideas. We’ll spend some time early in the quarter looking at AR experiences from museums and tourist attractions as well as games like Ingress and Pokemon Go. From there, we’ll build an app and start testing it with users, refining ideas as we go along. We’ll consider the differences between gamified apps that include scavenger hunts or challenges and AR applications that lay out information in a more traditional way.

Podcast Discoverability

The podcasting landscape is overcrowded, with larger voices from legacy broadcast media sometimes drowning out new entrants. Browsing for new-to-you, quality podcasts is hard, with shows scattered across distribution platforms. This team will explore how we might provide users a better path to discovering new podcasts.