Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Natural Language Processing with Java
  • Toc
  • feedback
Natural Language Processing with Java

Natural Language Processing with Java

By : Richard M. Reese
2 (3)
close
Natural Language Processing with Java

Natural Language Processing with Java

2 (3)
By: Richard M. Reese

Overview of this book

Natural Language Processing (NLP) allows you to take any sentence and identify patterns, special names, company names, and more. The second edition of Natural Language Processing with Java teaches you how to perform language analysis with the help of Java libraries, while constantly gaining insights from the outcomes. You’ll start by understanding how NLP and its various concepts work. Having got to grips with the basics, you’ll explore important tools and libraries in Java for NLP, such as CoreNLP, OpenNLP, Neuroph, and Mallet. You’ll then start performing NLP on different inputs and tasks, such as tokenization, model training, parts-of-speech and parsing trees. You’ll learn about statistical machine translation, summarization, dialog systems, complex searches, supervised and unsupervised NLP, and more. By the end of this book, you’ll have learned more about NLP, neural networks, and various other trained models in Java for enhancing the performance of NLP applications.
Table of Contents (14 chapters)
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Introduction to NLP
Introduction to NLP
What is NLP?
Why use NLP?
Why is NLP so hard?
Survey of NLP tools
Deep learning for Java
Overview of text-processing tasks
Understanding NLP models
Preparing data
Summary
2
Finding Parts of Text
Finding Parts of Text
Understanding the parts of text
What is tokenization?
Simple Java tokenizers
NLP tokenizer APIs
Understanding normalization
Summary
3
Finding Sentences
Finding Sentences
The SBD process
What makes SBD difficult?
Understanding the SBD rules of LingPipe's HeuristicSentenceModel class
Simple Java SBDs
Using NLP APIs
Training a sentence-detector model
Summary
4
Finding People and Things
Finding People and Things
Why is NER difficult?
Techniques for name recognition
Using regular expressions for NER
Using NLP APIs
Building a new dataset with the NER annotation tool
Training a model
Summary
5
Detecting Part of Speech
Detecting Part of Speech
The tagging process
Using the NLP APIs
Summary
6
Representing Text with Features
Representing Text with Features
N-grams
Word embedding
GloVe
Word2vec
Dimensionality reduction
Principle component analysis
Distributed stochastic neighbor embedding
Summary
7
Information Retrieval
Information Retrieval
Boolean retrieval
Dictionaries and tolerant retrieval
Vector space model
Scoring and term weighting
Inverse document frequency
TF-IDF weighting
Evaluation of information retrieval systems
Summary
8
Classifying Texts and Documents
Classifying Texts and Documents
How classification is used
Understanding sentiment analysis
Text-classifying techniques
Using APIs to classify text
Summary
9
Topic Modeling
chevron up
Topic Modeling
What is topic modeling?
The basics of LDA
Topic modeling with MALLET
Summary
10
Using Parsers to Extract Relationships
Using Parsers to Extract Relationships
Relationship types
Understanding parse trees
Using extracted relationships
Extracting relationships
Using NLP APIs
Extracting relationships for a question-answer system
Summary
11
Combined Pipeline
Combined Pipeline
Preparing data
Using boilerpipe to extract text from HTML
Using POI to extract text from Word documents
Using PDFBox to extract text from PDF documents
Using Apache Tika for content analysis and extraction
Pipelines
Using the Stanford pipeline
Using multiple cores with the Stanford pipeline
Creating a pipeline to search text
Summary
12
Creating a Chatbot
Creating a Chatbot
Chatbot architecture
Artificial Linguistic Internet Computer Entity
Summary
13
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

The basics of LDA

LDA is the most popular method among the different methods of topic modeling. It is a form of text data mining and machine learning, where backtracking is performed to figure out the topic for the document. It also involves the use of probability, as it is a generative probabilistic model.

LDA represents the documents as a mixture of topics that will give a topic based on probability.

Any given document has a greater or lesser chance of having a certain word as its underlying topic; for example, given a document about sports, the probability of the word "cricket" occurring is higher than the probability of the word "Android One Phone". If the document is about mobile technology, then the probability of the word "Android One Phone" will be higher than the word "cricket". Using a sampling method, some words are selected from a document as a topic using Dirichlet distribution in a semi random manner. These randomly selected topics may not be the best suited as the potential...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech
Start a 7-day FREE trial
End of Section 3
Next Section
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete