Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Solr Cookbook - Third Edition
  • Toc
  • feedback
Solr Cookbook - Third Edition

Solr Cookbook - Third Edition

By : Rafal Kuc
3.8 (6)
close
Solr Cookbook - Third Edition

Solr Cookbook - Third Edition

3.8 (6)
By: Rafal Kuc

Overview of this book

This book is for intermediate Solr Developers who are willing to learn and implement Pro-level practices, techniques, and solutions. This edition will specifically appeal to developers who wish to quickly get to grips with the changes and new features of Apache Solr 5.
Table of Contents (12 chapters)
close
close
Preface
Preface
What this book covers
What you need for this book
Who this book is for
Sections
Conventions
Reader feedback
Customer support
Free Chapter
1
1. Apache Solr Configuration
1. Apache Solr Configuration
Introduction
Running Solr on a standalone Jetty
Installing ZooKeeper for SolrCloud
Migrating configuration from master-slave to SolrCloud
Choosing the proper directory configuration
Configuring the Solr spellchecker
Using Solr in a schemaless mode
Limiting I/O usage
Using core discovery
Configuring SolrCloud for NRT use cases
Configuring SolrCloud for high-indexing use cases
Configuring SolrCloud for high-querying use cases
Configuring the Solr heartbeat mechanism
Changing similarity
2
2. Indexing Your Data
2. Indexing Your Data
Introduction
Indexing PDF files
Counting the number of fields
Using parsing update processors to parse data
Using scripting update processors to modify documents
Indexing data from a database using Data Import Handler
Incremental imports with DIH
Transforming data when using DIH
Indexing multiple geographical points
Updating document fields
Detecting the document language during indexation
Optimizing the primary key indexation
Handling multiple currencies
3
3. Analyzing Your Text Data
3. Analyzing Your Text Data
Introduction
Using the enumeration type
Removing HTML tags during indexing
Storing data outside of Solr index
Using synonyms
Stemming different languages
Using nonaggressive stemmers
Using the n-gram approach to do performant trailing wildcard searches
Using position increment to divide sentences
Using patterns to replace tokens
4
4. Querying Solr
4. Querying Solr
Introduction
Understanding and using the Lucene query language
Using position aware queries
Using boosting with autocomplete
Phrase queries with shingles
Handling user queries without errors
Handling hierarchies with nested documents
Sorting data on the basis of a function value
Controlling the number of terms needed to match
Affecting document score using function queries
Using simple nested queries
Using the Solr document query join functionality
Handling typos with n-grams
Rescoring query results
5
5. Faceting
5. Faceting
Introduction
Getting the number of documents with the same field value
Getting the number of documents with the same value range
Getting the number of documents matching the query and subquery
Removing filters from faceting results
Using decision tree faceting
Calculating faceting for relevant documents in groups
Improving faceting performance for low cardinality fields
6
6. Improving Solr Performance
6. Improving Solr Performance
Introduction
Handling deep paging efficiently
Configuring the document cache
Configuring the query result cache
Configuring the filter cache
Improving Solr query performance after the start and commit operations
Lowering the memory consumption of faceting and sorting
Speeding up indexing with Solr segment merge tuning
Avoiding caching of rare filters to improve the performance
Controlling the filter execution to improve expensive filter performance
Configuring numerical fields for high-performance sorting and range queries
7
7. In the Cloud
7. In the Cloud
Introduction
Creating a new SolrCloud cluster
Setting up multiple collections on a single cluster
Splitting shards
Having more than a single shard from a collection on a node
Creating a collection on defined nodes
Adding replicas after collection creation
Removing replicas
Moving shards between nodes
Using aliasing
Using routing
8
8. Using Additional Functionalities
8. Using Additional Functionalities
Introduction
Finding similar documents
Highlighting fragments found in documents
Efficient highlighting
Using versioning
Retrieving information about the index structure
Altering the index structure on a live collection
Grouping documents by the field value
Grouping documents by the query value
Grouping documents by the function value
Efficient documents grouping using the post filter
9
9. Dealing with Problems
chevron up
9. Dealing with Problems
Introduction
Dealing with the too many opened files exception
Diagnosing and dealing with memory problems
Configuring sorting for non-English languages
Migrating data to another collection
SolrCloud read-side fault tolerance
Using the check index functionality
Adjusting the Jetty configuration to avoid deadlocks
Tuning segment merging
Avoiding swapping
10
10. Real-life Situations
10. Real-life Situations
Introduction
Implementing the autocomplete functionality for products
Implementing the autocomplete functionality for categories
Handling time-sliced data using aliases
Boosting words closer to each other
Using the Solr spellchecking functionality
Using the Solr administration panel for monitoring
Automatically expiring Solr documents
Exporting whole query results
11
Index
Index

Tuning segment merging

As you might know, a Lucene index is built of one or more segments. In general, a segment is a write-once, read-many data structure, which means that once written it won't be updated (only some parts of it will be, such as information about a deleted document). Segment merging is a process of combining multiple segments to a new one to reduce the overall number of segments the index is built of. The reason Lucene does this is because of performance—the smaller the number of segments, the better the search performance is. On the other hand, segment merge is a resource-intensive process as it requires you to read the old segments and write the new ones. Because of all this, it is good to know how to tune segment merging for our own purposes and this recipe will show you how to do that.

How to do it...

  1. For the purpose of this recipe, I assume that we are starting with the basic Solr configuration, which looks as follows when it comes to segment merging (we...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech
Start a 7-day FREE trial
End of Section 10
Next Section
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete