6. Understanding Text | Learning Microsoft Cognitive Services

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Learning Microsoft Cognitive Services

By : Leif Larsen Henning Larsen

Learning Microsoft Cognitive Services

By: Leif Larsen Henning Larsen

Overview of this book

Microsoft Cognitive Services is a set of APIs for integrating artificial intelligence in your applications to solve logical business problems. If you’re new to developing applications with AI, Learning Microsoft Cognitive Services will give you a comprehensive introduction to Microsoft’s AI stack and get you up-to-speed in no time. The book introduces you to 24 APIs, including Emotion, Language, Vision, Speech, Knowledge, and Search. Using Visual Studio, you can develop applications with enhanced capabilities for image processing, speech recognition, text processing, and much more. Moving forward, you will work with datasets that enable your applications to process various data in the form of image, video, or text. By the end of the book, you’ll be able to confidently explore Cognitive Services APIs for building intelligent applications that can be deployed for real-world business uses.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

1. Getting Started with Microsoft Cognitive Services

1. Getting Started with Microsoft Cognitive Services

Cognitive Services in action for fun and life-changing purposes

Setting up the boilerplate code

Detecting faces with the Face API

An overview of different APIs

Getting feedback on detected faces

Summary

2. Analyzing Images to Recognize a Face

2. Analyzing Images to Recognize a Face

Analyze an image using the Computer Vision API

Diving deep into the Face API

Adding identification to our smart-house application

Knowing your mood using the Face API

Automatically moderating user content

Building your own image classifiers

Summary

3. Analyzing Videos

3. Analyzing Videos

Diving into Video Indexer

Unlocking video insights using Video Indexer

Summary

4. Letting Applications Understand Commands

4. Letting Applications Understand Commands

Creating language-understanding models

Training a model

Summary

5. Speaking with Your Application

5. Speaking with Your Application

Converting text to audio and vice versa

Knowing who is speaking

Verifying a person through speech

Customizing speech recognition

Translating speech on the fly

Summary

6. Understanding Text

6. Understanding Text

Setting up a common core

Correcting spelling errors

Extracting information through textual analysis

Translating text on the fly

Summary

7. Building Recommendation Systems for Businesses

7. Building Recommendation Systems for Businesses

Providing personalized recommendations

Summary

8. Querying Structured Data in a Natural Way

8. Querying Structured Data in a Natural Way

Tapping into academic content using the academic API

Interpreting natural language queries

Finding academic entities in query expressions

Calculating the distribution of attributes from academic entities

Entity attributes

Creating the backend using the Knowledge Exploration Service

Defining attributes

Adding data

Building the index

Understanding natural language

Local hosting and testing

Going for scale

Answering FAQs using QnA Maker

Creating a knowledge base from frequently asked questions

Training the model

Publishing the model

Summary

9. Adding Specialized Searches

9. Adding Specialized Searches

Searching the web using the smart-house application

Getting the news

Searching for images and videos

Helping the user with autosuggestions

Search commonalities

Searching for visual content using Bing Visual Search

Adding a custom search

Summary

10. Connecting the Pieces

10. Connecting the Pieces

Completing our smart-house application

Real-life applications using Microsoft Cognitive Services

Where to go from here

Summary

A. LUIS Entities

A. LUIS Entities

LUIS prebuilt entities

B. License Information

B. License Information

Video Frame Analyzer

OpenCvSharp3

Newtonsoft.Json

NAudio

Index

Index

Customer Reviews

5 star

0

4 star

0

3 star

0

2 star

0

1 star

0

Setting up a common core

Before we get into the details, we want to set ourselves up for success. At the time of writing, none of the language APIs that we will be covering have NuGet client packages. As such, we will need to call directly to the REST endpoints. Because of this, we will do some work beforehand to make sure that we get away with writing less code.

New project

We will not be adding the APIs to our smart-house application. Using the following steps, create a new project using the MVVM template that we created in Chapter 1, Getting Started with Microsoft Cognitive Services:

Go into the NuGet package manager and install Newtonsoft.Json. This will help us deserialize API responses and serialize request bodies.
Right-click on References.
In the Assemblies tab, select System.Web and System.Runtime.Serialization.
Click OK.
In the MainView.xaml file, add a TabControl element. All our additional views will be added as TabItems in the MainView.

Web requests

All the APIs follow the same pattern...

Search

Your notes and bookmarks