October 2026Offline RAG · Multi-Book
NekoHon
An offline EPUB reading companion that indexes books locally and answers with a fine-tuned 2B model.
Answers cite exact sentences you can jump to, or state plainly that it's not in the book.
PythonSQLiteNext.jsTypeScriptOllamanomic-embed-textQwen3.5 2BTailwind CSSZustand

My role
- 01Built the ingestion path: EPUB and PDF into sentence-bounded chunks, with tables and code kept whole.
- 02Combined dense search with a keyword leg that opens only for rare or named terms, and appended its best result after the dense five instead of replacing them.
- 03Wrote the citation gate: an answer must quote the source word for word, or the exact refusal replaces it.
- 04Tuned a 1.9B Qwen3.5 model at Q4 and measured retrieval recall and refusal behavior on a fixed query set.
- 05Built the reader: a library shelf, chapter contents, selection notes with sources, and follow-up questions.
Details
Asking “What is quantization?”: the note answers from the book's own sentence, and the source stays one click away.
Captured from the running reader at 390×844.
How it works
NekoHon answers from the indexed books with Wi-Fi off. This is the path one query takes, from the book being cut into pieces to the answer being checked against the source.
Once per book
The query
End
