TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: How to build full text search at scale?

4 pointsby ratpikabout 5 years ago
Data Store - Elasticsearch Scale - 10 million writes&#x2F;day (500 GB&#x2F;day), about 100K search queries per day<p>Trying to figure out<p>1 - How to control access to data (multi-tenancy where there are ~100K tenants)<p>2 - Database design - Indexes and Shards and best practices around mixing different types of documents in a single index.

2 comments

itronitronabout 5 years ago
I recommend writing down what exactly scale means for your needs. Number of users? Number of queries? Number of sources? Number of &#x27;result-sets&#x27;? Number of documents? Number of text fields?<p>Elasticsearch is built on-top-of Lucene which is a Java API that you can use in pretty much any application. If you already have a system that can search the MySQL clusters then I would recommend hooking Lucene into that system instead of standing up another one.
评论 #22656770 未加载
bufferoverflowabout 5 years ago
I doubt you will get a useful answer in a comment. Each of your questions is very broad. And you didn&#x27;t even select a search engine yet. You didn&#x27;t specify the scale you&#x27;re dealing with. You didn&#x27;t specify the number of reads&#x2F;writes per second that you expect.<p>Choose one system and learn it well.
评论 #22656766 未加载