Learn ARCore - Fundamentals of Google ARCore

3 (3)

Buy this Book

Learn ARCore - Fundamentals of Google ARCore

3 (3)

Buy this Book

Overview of this book

Are you a mobile developer or web developer who wants to create immersive and cool Augmented Reality apps with the latest Google ARCore platform? If so, this book will help you jump right into developing with ARCore and will help you create a step by step AR app easily. This book will teach you how to implement the core features of ARCore starting from the fundamentals of 3D rendering to more advanced concepts such as lighting, shaders, Machine Learning, and others. We’ll begin with the basics of building a project on three platforms: web, Android, and Unity. Next, we’ll go through the ARCore concepts of motion tracking, environmental understanding, and light estimation. For each core concept, you’ll work on a practical project to use and extend the ARCore feature, from learning the basics of 3D rendering and lighting to exploring more advanced concepts. You’ll write custom shaders to light virtual objects in AR, then build a neural network to recognize the environment and explore even grander applications by using ARCore in mixed reality. At the end of the book, you’ll see how to implement motion tracking and environment learning, create animations and sounds, generate virtual characters, and simulate them on your screen.

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

Getting Started

Immersive computing

AR and ARCore

The road ahead

Summary

ARCore on Android

Installing Android Studio

Installing ARCore

Build and deploy

Exploring the code

Summary

ARCore on Unity

Installing Unity and ARCore

Building and deploying to Android

Remote debugging

Exploring the code

Summary

ARCore on the Web

Installing WebARonARCore

Installing Node.js

Exploring the samples

Debugging web apps on Android

3D and three.js

Summary

Real-World Motion Tracking

Motion tracking in depth

3D sound

Resonance Audio

A tracking service with Firebase

Visualizing tracked motion

Exercises

Summary

Understanding the Environment

Tracking the point cloud

Meshing and the environment

Interacting with the environment

Drawing with OpenGL ES

Shader programming

Exercises

Summary

Light Estimation

3D rendering

3D lighting

Light estimation

Cg/HLSL shaders

Estimating light direction

Exercises

Summary

Recognizing the Environment

Introduction to ML

Deep learning

Programming a neural network

Training a neural network

TensorFlow

Summary

Blending Light for Architectural Design

Setting up the project

The environment and placing content

Building the UI

Interacting with the virtual

Lighting and shadows

Exercises

Summary

Mixing in Mixed Reality

Mixed reality and HoloKit

Introducing WRLD

Setting up WRLD for MR

Navigating the map

Mapping, GIS, and GPS

What's next?

Exercises

Summary

Performance Tips and Troubleshooting

Diagnosing performance

Tips for managing better performance

General troubleshooting

Exercises

Troubleshooting tips

Summary

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

3 (3)

5 star

33.3%

4 star

3 star

33.3%

2 star

1 star

33.3%

Real-World Motion Tracking

Now that we have all the fun stuff set up and ready to go, we can begin building some real-world AR apps. In order to do this, we will be picking and choosing various pieces we need from the samples. The samples are great examples, but, for the most part, they are nothing more than boilerplate code. This means that we have no reason to rewrite code sections that already work well. Instead, we will focus on adding new code to tackle AR problems. In this chapter, we will dive in and learn in depth how ARCore motion tracking works. We will learn the current limitations of motion tracking with ARCore and develop a technique for overcoming those limitations. Here are the main topics that we will cover in this chapter: