Design and Evaluation of Immersive and Advanced Technologies in the “Future of Tourism”

Design and Evaluation of Immersive and Advanced Technologies in the “Future of Tourism”

Design and Evaluation of Immersive and Advanced Technologies in the “Future of Tourism”

Case study

Project

Mobile app design

Mobile app design

Industry

AR tourism industry

AR tourism industry

Role

UX Designer

UX Designer

Contributions

Research, Market analyse, User flows, UI, Testing, Iterations

Research, Market analyse, User flows, UI, Testing, Iterations

GADAR is a handheld mobile application designed to enhance city tourism by integrating Augmented Reality (AR). The app guides users to important landmarks, overlays historical and informational content through AR, and enables capturing immersive photos with virtual elements.

Project Goal

Project Goal

Project Goal

  • The goal of GADAR is to provide an engaging and user-friendly augmented reality experience for people who would like to take quick tours around cities they visit.


  • Making city exploration more informative and engaging, by turning a typical sightseeing tour into a dynamic learning experience.

Design Process

Design Process

Key Findings

Key Findings

Key Findings

The UK’s outbound travel industry is growing fast, expected to reach US$ 90.46 billion in 2024 and more than double by 2034.

More people are traveling solo, especially ages 25–44, with 66% taking over two trips a year and enjoying activities like dining out, shopping, and sightseeing.

Market value

Target Group

User activities analysis

Market value

Target Group

User activities analysis

Market value

Target Group

User activities analysis

Information Flow

Information Flow

Top level architecture

Top level architecture

Top level architecture

  • Camera, GPS, sensors

  • Data processing, retrieval

  • AR overlays, visuals

  • Real-time adjustments

  • Camera, GPS, sensors

  • Data processing, retrieval

  • AR overlays, visuals

  • Real-time adjustments

Detection & Recognition

Software Processing

Digital Overlay

Real-Time Adjustments

Detection & Recognition

Software Processing

Digital Overlay

Real-Time Adjustments

Detection & Recognition

Software Processing

Digital Overlay

Real-Time Adjustments

Sketches & Storyboarding

Sketches & Storyboarding

Sketches & Storyboarding

User can build a conversation with the AI assistant and learn about the locations by asking questions.

User can build a conversation with the AI assistant and learn about the locations by asking questions.

Virtual tour guide will display: Nearest location, cafeterias, stays and next possible place can visit.

Virtual tour guide will display: Nearest location, cafeterias, stays and next possible place can visit.

Time travel feature: User can see the building or landmarks as how those were been in the past, by years. Can take photos using AR, according to the evolution.

Time travel feature: User can see the building or landmarks as how those were been in the past, by years. Can take photos using AR, according to the evolution.

User selecting a location to visit, Can personalize the tour guide as their own. (Map styles, conversation, Knowing the history, Question and answers)

User selecting a location to visit, Can personalize the tour guide as their own. (Map styles, conversation, Knowing the history, Question and answers)

Sketches & Storyboarding

Sketches & Storyboarding

Sketches & Storyboarding

We started by sketching how we wanted to onboard Okiki on the platform, hut what was important here which is supposed to be our “aha” moment for this user is the selection of avatar.

To go on the tour, we were focused on how immersive the experience will be, How Okiki would find a tour site, the features he be able to access while on the tour.

This flow is important to this persona, the idea was to have a simple two to three step process for the user to over the AR effect on the screen and take the picture which automatically gets saved to the user’s gallery.

Font Selection

Font Selection

Font Selection

SORA

Our design system leverages a purposeful set of color styles as the perfect mix. When it came to deciding the color, contrast was critical for ensuring text is legible.

Colour Palette

Colour Palette

Colour Palette

Our design system leverages a purposeful set of color styles as the perfect mix. When it came to deciding the color, contrast was critical for ensuring text is legible.

UI Components

UI Components

UI Components

We added elements for navigation, conversations between the virtual guide and user, 3d elements to visualize the AR experience.

Design process

Design process

Design process

Tour Site Details
Tour Site Details
  1. Here the user gets to learn a little written history about the build. By tapping on the “details” button, the user can see the the tabs to learn.

    The user can also scroll to see more text below.

  1. Here the users gets to learn about the evolution of the building.

    We used 3d buildings that would be projected on the screen for the user to swap from oldest to newest.

  1. This is another extra detail the user can learn about the building, to see different pictures of different views.

    With this the user can see the:
    Front view, Side view, Aerial view, Inside view and old photos if available.

Design process

Design process

Design process

The final platform resulted from several rounds of user feedback and design iteration.

Here are the core features of the final design:

Select Tour Guide
Select Tour Guide

Here, the user get to select who they would prefer as their virtual guide, we created a predetermined set of categories that include “Emojis”, “Animals”, “Aliens”, “Robots”, and “humans”.

  • The characters would be 3d and able to have conversations with the users as they go on the tours.

  • This also makes the experience fun, immersive and personal for the user.

Here, the user get to select who they would prefer as their virtual guide, we created a predetermined set of categories that include “Emojis”, “Animals”, “Aliens”, “Robots”, and “humans”.

  • The characters would be 3d and able to have conversations with the users as they go on the tours.

  • This also makes the experience fun, immersive and personal for the user.

Navigate to Location 1
Navigate to Location 1

The user can navigate to the location using the live view or the map view.

Either view still has the virtual tour guide helping the users navigate to the tour site.

The user can navigate to the location using the live view or the map view.

Either view still has the virtual tour guide helping the users navigate to the tour site.

Navigate to Location 2
Navigate to Location 2

Here, the user navigates from one location to the tour site, after previously selecting the tour site, the virtual tour guide converses with the user as it directs the user to the location.

There are also visual cues for the user like the arrow, texts of texts showing how long more, a beaming ball and downward arrow when the user gets to the location

Here, the user navigates from one location to the tour site, after previously selecting the tour site, the virtual tour guide converses with the user as it directs the user to the location.

There are also visual cues for the user like the arrow, texts of texts showing how long more, a beaming ball and downward arrow when the user gets to the location

Design process

Design process

Design process

The final platform resulted from several rounds of user feedback and design iteration.

Here are the core features of the final design:

Q&A with Virtual Tour Guide
Q&A with Virtual Tour Guide

After the user is done learning the details, the virtual assistant guide would prompt the user to engage in a Q&A.

The virtual tour guide asks the question, the users answers, the user then see all the questions gotten after the Q&A session and can decide to end the tour or start again.

After the user is done learning the details, the virtual assistant guide would prompt the user to engage in a Q&A.

The virtual tour guide asks the question, the users answers, the user then see all the questions gotten after the Q&A session and can decide to end the tour or start again.

AR Picture with Person Cloth
AR Picture with Person Cloth

One very important feature which was implemented for the second persona is the AR picture, which allows the user to project some specific category of AR element on the screen and interact or take pictures with this element.

Here the cloth change picture, which allows users to project 3d clothes on any human the system scans.

AR Picture with Weather Change
AR Picture with Weather Change

One very important feature which was implemented for the second persona is the AR picture, which allows the user to project some specific category of AR element on the screen and interact or take pictures with this element.

Here the weather change, the users can switch between different weather condition, by tapping on the icons on the side which overlays the condition like “rain” as shown.

AR Picture with Animals
AR Picture with Animals

This allows users project several animals on the screen and take pictures with these animals.

Users can select more than one animal, users can also tap and hold the animals to move . them around to their preferred position on screen.

User Testing & Evaluation

User Testing & Evaluation

User Testing & Evaluation

The next step was to carry out the testing of our prototype to see if our implementation is usable, we started by coming up with a test plan.

Participants
Participants

Pre-Test Survey Result

  • Prior to the testing, participants were asked if they knew about Augmented Reality, all participants were familiar with the concept.

  • The participants were between ages 18 and 45, it included 1 female and 4 males, and all 5 participants were students.

  • 60% of participants had used Handheld Augmented Reality Mobile Applications before.

Methodology
Methodology

A moderated usability study was conducted in person with participants using an iPhone provided to complete five tasks:

Task 1 - Create an account
Task 2 - Select a location, navigate to the location
Task 3 - Learn details about the location
Task 4 - Engage in questions and answer
Task 5 - Take AR-infused pictures with Avatar, specifically take pictures with animals.

A moderated usability study was conducted in person with participants using an iPhone provided to complete five tasks:

Task 1 - Create an account
Task 2 - Select a location, navigate to the location
Task 3 - Learn details about the location
Task 4 - Engage in questions and answer
Task 5 - Take AR-infused pictures with Avatar, specifically take pictures with animals.

  • During the usability study, after every task participants were asked questions to gather qualitative data.

  • After the moderated usability study, participants completed a Handheld Augmented Reality Usability Scale on a Microsoft form to gather quantitative data.

Key Insights

Key Insights

Key Insights

Insight 1
Insight 1

Task 1 - Create an account

  • Participants felt the task was simple and straight forward

  • Some participants like selecting their avatar, they found it fun and engaging.

“I like the social login, it’s straightforward”

Insight 2
Insight 2

Task 2 - Select a location, navigate to the location

  • Some participants wanted to see a preview of the location before starting the tour or navigating to the location.

  • Some participants were concerned about not noticing their environment while navigating to the location.

  • Participants liked the sound feedback from the virtual tour guide.

  • Some participants liked the arrow visual feedback while navigating to the location.

“Not seeing the preview of the location is concerning, I want to know what the place looks like before leaving”

Insight 3
Insight 3

Task 3 - Learn details about the location

  • Participants felt this task was easy and served it’s purpose

  • Some participants did not understand the “blueprint” aspect of the details.

“I don’t understand the blueprint, I did not learn anything from going through it”

Insight 4
Insight 4

Task 4 - Engage in questions and answer

  • Participants liked the question and answer section, they found it engaging and fun

  • Some participants were concerned about the avatar being distracting during the experience.

“I really like this feature, it’s fun!”

Insight 5
Insight 5

Task 5 - Take AR-infused pictures with Avatar,
specifically take pictures with animals.

  • Some participants found this confusing at first and needed some explaining on how to navigate this feature.

  • Some participants were confused on how to take the picture.

  • When they eventually got it, some participants liked the 3d elements on the screen.

“There’s no direction on how to take the picture, I don’t know the button to press to take the picture”

HARUS Analysis

HARUS Analysis

HARUS Analysis

Handheld Augmented Reality Usability Scale Result
Handheld Augmented Reality Usability Scale Result
  • The overall usability score reflects a very positive user experience and this show that the app performs well across usability metrics.

  • This score still shows there’s a lot of improvement to be done, specifically some tweaks on the picture taking feature, and navigation to the location.

The SUS was calculated from the data acquired. Below is a breakdown of it:

84

Overall Score

Updates to be made

Updates to be made

Updates to be made

  1. Add visual cues to help users understand the take picture flow better.

  2. Add preview before tour: This will allow users get a quick glimpse into what visiting the location would entail.

Iteration 1
Iteration 1

Adding tooltips to the picture section

  • Previously we assumed users would grasp this feature without and guide, the testing proved otherwise.

  • By adding the quick tooltip, the user becomes well aware of everything this feature offers and can continue the experience without confusion.

  • Previously we assumed users would grasp this feature without and guide, the testing proved otherwise.

  • By adding the quick tooltip, the user becomes well aware of everything this feature offers and can continue the experience without confusion.

Iteration 2
Iteration 2

Adding mini-preview before tour

  • With this the user learns a little about the location before kickstarting their journey.

  • The user sees the pictures, location, time and distance to get to destination and reviews.

  • With this the user learns a little about the location before kickstarting their journey.

  • The user sees the pictures, location, time and distance to get to destination and reviews.

Limitations

Limitations

Limitations

Small sample size

Prototype for testing

Testing environment

Small sample size

Prototype for testing

Testing environment

Small sample size

Prototype for testing

Testing environment

Future Considerations

Future Considerations

Helping solo travellers share their experience with other users to enhance their experience.

Helping solo travellers share their experience with other users to enhance their experience.

Community feature

AR
Community

Video
Recording

One of the participants mentioned they’d like to not just take pictures but take videos of the AR elements.

One of the participants mentioned they’d like to not just take pictures but take videos of the AR elements.

Adding video taking capability

An important future implementation is to not restrict the experience of users to just Handheld support

An important future implementation is to not restrict the experience of users to just Handheld support

Multiple AR device support

AR Devices

Future Considerations

Helping solo travellers share their experience with other users to enhance their experience.

Community feature

One of the participants mentioned they’d like to not just take pictures but take videos of the AR elements.

Adding video taking capability

An important future implementation is to not restrict the experience of users to just Handheld support

Multiple AR device support