-
Book Overview & Buying
-
Table Of Contents
-
Feedback & Rating

Neural Search - From Prototype to Production with Jina
By :

Now that we know how to work with multimodal data, we can describe cross-modal and multimodal searches. Before that, I would like to first describe the unimodal (single-modality) search. In general, unimodal search means processing a single modality of data at both index and query time. For example, in an image search retrieval, the returned search results are also images based on the given image query.
So far, we already know how to encode document content into feature vectors to create embeddings. In the index, each document with the content of an image, text, or audio can be represented as embedding vectors and stored in an indexe. In the query, the query document can also be represented as an embedding, which can then be used to identify similar documents via some similarity scores such as cosine, Euclidean distance, and so on. Figure 5.6 illustrates the unified matching view of the search problem:
Figure 5.6 –...