Brief

My research focuses on exploring the potential of mixed reality and large language models in in-car environments, leveraging new technologies to enhance user experiences.

Introduction

A solo road trip to Montreal inspired me to investigate how mixed reality and intelligent assistants could transform the in-car experience. This led me to conduct research on creating a personalized and engaging user experience within the car cockpit.

Motivation

During a long drive to Montreal, a friend made the journey much more enjoyable by playing local music, sharing cultural insights, and recommending regional food. This interactive experience kept me engaged and immersed in the trip. It made me realize how much I had been missing by simply focusing on reaching my destination rather than enjoying the journey itself.

Innovation and Design Interest

By developing a mixed reality intelligence system for cars, I aim to provide personalized recommendations and contribute to the future of the automotive industry. Advances in 5G and AI technologies have transformed the way people interact with machines, making it possible to create a seamless and personalized in-car experience.

Problems

There are four key challenges that prevent people from fully enjoying travel by car:

Research Questions

Based on these challenges, I formulated the following research question and sub-questions:

Literature Review

The literature review explores the definition and evolution of mixed reality in the automotive industry. It examines its applications, traveler behaviors, user needs in cars, and relevant industry advancements.

Related Work

To understand the current landscape, I analyzed market agents and categorized them based on their degree of virtual and physical presence as well as their level of intimacy with users.

Ideation

Large language models make conversations between humans and machines more natural, turning our ideal voice assistants into a possibility. Thus, I attempted to explore an intelligent agent for in-car systems that can accompany users during their journeys.