October 2026Offline RAG · Multi-Book

NekoHon

An offline EPUB reading companion that indexes books locally and answers with a fine-tuned 2B model.

Answers cite exact sentences you can jump to, or state plainly that it's not in the book.

PythonSQLiteNext.jsTypeScriptOllamanomic-embed-textQwen3.5 2BTailwind CSSZustand
NekoHon overview
My role
  1. 01Built the ingestion path: EPUB and PDF into sentence-bounded chunks, with tables and code kept whole.
  2. 02Combined dense search with a keyword leg that opens only for rare or named terms, and appended its best result after the dense five instead of replacing them.
  3. 03Wrote the citation gate: an answer must quote the source word for word, or the exact refusal replaces it.
  4. 04Tuned a 1.9B Qwen3.5 model at Q4 and measured retrieval recall and refusal behavior on a fixed query set.
  5. 05Built the reader: a library shelf, chapter contents, selection notes with sources, and follow-up questions.
Details

Asking “What is quantization?”: the note answers from the book's own sentence, and the source stays one click away.

The shelf at 390 px.
Ask about the whole book from the composer.
One answer, its source, and follow-up questions.

Captured from the running reader at 390×844.

How it works

NekoHon answers from the indexed books with Wi-Fi off. This is the path one query takes, from the book being cut into pieces to the answer being checked against the source.

Once per book

The query

End