XR Studio created virtual learning environment with Hololens for Perho Culinary, Tourism & Business College

Nora Nirhamo | 2019/02/07

XR Studio created virtual learning environment with Hololens Mixed Reality application for Perho Culinary, Tourism & Business College. The application guides and instructs user to complete different work stages in a kitchen and dining room. User controls the Hololens application with gaze and gestures and allows user to work hands-free.

Virtual learning environment application with Hololens

XR Studio created virtual learning environment with Hololens for Perho Culinary, Tourism & Business College. The application guides and instructs user to complete different work stages. Hololens´s control methods (gaze, gestures) allows user to work hands-free and the focus remains on a job. For example, with the application and Hololens smart glasses students can practice working in a kitchen or in a dining room and at the same time check work instructions. Hololens can store a lot of teaching material, which students can utilize at internships when help is not near – Hololens can show for an example virtual 3D model how to set a table right. Remote connection with two-way video and sound is also possible with Hololens, so student needing acute help can contact a teacher who is in a different place.

The Hololens application was created with Unity development environment and utilizes Microsoft Mixed Reality Toolkit (MRTK). The application builds the content from JSON file, which allows a flexible way to easily organize the content (menus. sub-menus etc). At the moment the application features include showing of text (menus, recipes), videos (e.g. cooking tutorials), showing pictures, and opening and browsing of PDF-files. Application can also display 3D objects (e.g. virtual table set ups). The user can also open a web content straight to Hololens´s browser Edge, for example iPerho online-learning environment.

Most of the content is currently loaded locally from Hololens memory, but in the future, everything will be loaded in directly from the Perho’s web servers. The user controls the Hololens application with gestures (air tap) and gaze, which allows user to work hands-free. Voice control is also possible for the application but in this case, it is not necessarily practical in a restaurant because of the background noise.

Perho is part of MR Amis-project

Being a pioneer is one of the Perho Culinary, Tourism & Business College’s values, which shows among the others that the educational institution is active in developing digitalization. Development usually happens through a variety of projects, and at the moment Perho is part of MR Amis-Mixed Reality project. The main objective of this educational technology development project is to find ways to integrate augmented and mixed reality into teaching and learning environments, including training placements. Perho´s activity towards developing digitalization shows in their virtual environments that are already in use, like 360 -virtual environment from Restaurant Perho, from the teaching kitchen, from the field of Perho Green City Farm and VR-kitchen from Restaurant Perho’s Perho kitchen.

Utilizing Microsoft Hololens in education

Technology´s development affects restaurant industry as it does other industries´ work environments and tasks. This projects goal was to find out how well Hololens smart glasses fit in to education. Hololens´s are especially hoped to support students’ training and remote communication opportunity to bring benefit to learning environments. One of the goals was also to find out what kind of teaching material and instructions can be shared via Hololens and what kind of communication smart glasses support.

“We surveyed smart glass options and contacted many companies both in Finland and internationally. We ended up with Microsoft Hololens smart glasses because they support the best Perho Culinary, Tourism & Business College´s online-campus functionalities, including other digital office software systems already in use in iPerho -online learning environment”, says Perho Culinary, Tourism & Business College´s Education Technology Development Manager and Lecturer Jarmo Åke.

“Cooperation with Softability Studio started naturally going forward with testing and brainstorming, which led us to build together pedagogic pilot environment in Microsoft Hololens smart glasses to service industry students.”

Perho Culinary, Tourism & Business College´s Career Coach and Lecturer Katja Winogradow notices also: “Because of the active cooperation the Hololens pilot environment is now ready to be tested by Perho´s staff, students and MR Amis Project´s college and business partners. Pilot observations and surveys gives us user-based information to further develop the environment. The most important in developing the learning environment functionalities is to actively involve the users (students, teachers, mentors) in user experience planning.”

 

More information:

Mikael Bowellan, Lead Artist, mikael.bowellan(at)softability.fi

Mikko Luukkonen, Sales Manager, mikko.luukkonen(at)softability.fi

 

More information about Perho Culinary, Tourism & Business College and MR Amis project:

https://perho.fi/ammatillinen-oppilaitos/hankkeet-kehittamistoiminta/
http://www.mramis.fi/

 

HoloLens application created for Perho has been developed closer to a daily education use. As a further development Softability created web based content editing tool for the HoloLens application, so Perho can change and add content into the application by themselves.

Read more about the content editing tool!

Share

Keywords:

You might be interested:

Sandvik implemented XReach remote support solution for global use!

Nora Nirhamo | 2021/01/21

Sandvik Mining and Rock Solutions implemented Softability´s XReach remote support solution for global use last fall. The solution allows front-line workers to receive company-wide support remotely even in challenging conditions. Now XReach is already in use in Australia, North America expanding to Europe, South America and Asia. Read more!

Read post

Utilization of data collected with a remote support solution in business development

Nora Nirhamo | 2021/01/18

Softability´s Mikko Luukkonen was speaking at the Data Business Forum 2020 virtual event on how data collected with a remote support solution can be utilized in business development. The studio interview can be viewed at the end of the article.

Read post

Softability is again this year a Great Place to Work® certified workplace!

Nora Nirhamo | 2021/01/14

Once again this year, we can proudly say that Softability is one of the best workplaces in Finland. For the fourth year in a row, we achieved the Great Place to Work® certification. Thanks for this achievement belongs to our wonderful employees!

Read post

Merry Christmas and a successful New Year 2021!

Nora Nirhamo | 2020/12/23

This year is soon coming to an end and we are excited to see what the next year brings along. Softability wants to thank you for the cooperation and wishes to everybody a Merry Christmas and a successful New Year 2021!

Read post

XReach customer experiences by Sandvik & VTT

Nora Nirhamo | 2020/12/18

Softability’s XReach is a remote support solution designed specifically for industry. In this video Sandvik Mining & Rock Technology and VTT tell about their customer experiences of XReach in the mining sector and smart grid.

Read post

Light into Darkness – Softability developed an augmented reality application for Valmont to showcase modern smart poles!

Nora Nirhamo | 2020/12/18

Softability developed an augmented reality sales and marketing application for Valmont Industries to showcase their modern smart poles. This AR application was created for Microsoft HoloLens 2 smart glasses as well as an iOS tablet. The AR experience was originally developed to be a part of Valmont’s booth at the Frankfurt Light + Building 2020 trade fair. Read more!

Read post
XRteknologioilla tehokkaampi pienemmillä kustannuksilla toteutettu palveluliiketoiminta

XR technologies enable a more efficient and lower-cost service business

Nora Nirhamo | 2020/10/08

XR technologies offer many benefits in different business areas. This means a great competitive advantage for those companies that understand the potential of these technologies and are utilizing or are starting to utilize X-Reality in their business.

Read post

During the corona, spare parts were also replaced remotely – “Now we have learned new ways to act”

Nora Nirhamo | 2020/08/26

Remote work also took a huge step forward in manufacturing. Wärtsilä and Kalmar have been developing remote maintenance services for years, but now they finally got a breakthrough.

Read post

There is a need for a remote support solution in boat industry

Nora Nirhamo | 2020/06/18

The XReach remote support solution developed by Softability is suitable for maintenance, installation and training needs. According to Blue Ocean Oy, a company specialized in the sale and brokerage of sailboats and motorboats, there is a need for a remote support solution in the boat industry. Read more!

Read post