# Project Manifest

Every file in LatticeSearch and what it does — auto-generated by `gen_manifest.py`.

81 tracked files.

## Engine & core

| File | Purpose |
|---|---|
| `content.py` | LatticeSearch content tiers: DOCUMENTS (text of pdf/docx/xlsx/code/notes) and VIDEO (frames). |
| `server.py` | LatticeSearch POC server — instant search over the whole file system. |

## Index builders & enrichment

| File | Purpose |
|---|---|
| `BLINDSPOTS-NOTES.md` | BLINDSPOTS — integration guide (blindspots.py) |
| `audio.py` | audio.py — the AUDIO leg of LatticeSearch (CLAP: text<->audio, audio<->audio). |
| `backfill.py` | backfill.py — drain the tier caps: RESUMABLE, RECENCY-FIRST background indexing. |
| `bench_codesym.py` | bench_codesym.py — code-symbol tier bench against REAL code. |
| `blindspots.py` | blindspots.py — three LatticeSearch indexing blind spots, strictly dep-free. |
| `codesym.py` | codesym.py — CODE-SYMBOL tier: "where is the retry logic" -> file:line. |
| `colors.py` | colors.py — precompute average RGB per indexed image -> img_colors.json. |
| `condense.py` | condense.py — the EVAPORATION phase of the absorption pattern. |
| `drivescan.js` | drivescan.js — walk an entire drive, persist the name index, then benchmark instant queries. |
| `enrich.py` | enrich.py — deepen the index with SPEECH (Whisper) and IMAGE TEXT (OCR). |
| `enrich_formats.py` | enrich_formats.py — bounded incremental indexing of NEW text formats. |
| `face.py` | face.py — face detection + clustering (find all photos of the same person). |
| `genmeta.py` | genmeta.py — index AI-image GENERATION PROMPTS embedded in PNGs (ComfyUI / A1111). |
| `optimize.py` | LatticeSearch optimization pass: prefetch embed pipeline, int8 quantization, |
| `pdfocr.py` | pdfocr.py — SCANNED-PDF OCR tier: make image-only PDFs searchable. |
| `phash.py` | phash.py — TRUE pixel-level indexing via perceptual hash (dhash). |
| `scan3.js` | scan3.js — PARALLEL full-metadata snapshot with live progress + ETA. |
| `spike.py` | LatticeSearch v0 spike — snapshot a file tree, embed images with CLIP, search by meaning. |
| `tiles.py` | tiles.py — close the crop-search gap. For each image, embed not just the whole image but |

## AI substrate & tools

| File | Purpose |
|---|---|
| `Lattice Workspace.cmd` | title Lattice Workspace |
| `bench_workspace.py` | bench_workspace.py — HONEST build benchmark: raw rebuild vs lattice-workspace (lattice-make). |
| `lattice.py` | lattice — command-line interface for LatticeSearch (talks to the running engine). |
| `lattice_make.py` | lattice_make.py — LATTICE MAKE: builds that skip what the lattice knows didn't change. |
| `mcp_server.py` | LatticeSearch MCP server — exposes the local search engine as tools over MCP (stdio). |
| `memory_lattice.py` | memory_lattice.py — LATTICE MEMORY: the anti-amnesia layer for AI agents. |
| `model_host.py` | model_host.py — the WARM MODEL HOST (the lattice virtual environment's hot core). |
| `workspace.py` | workspace.py — the LATTICE WORKSPACE: a session where the whole lattice substrate is wired |

## Features

| File | Purpose |
|---|---|
| `DRIVES-NOTES.md` | DRIVES-NOTES — multi-drive wiring notes (2026-07-19) |
| `backup.py` | backup.py — LatticeSearch BACKUP module. |
| `bench_backup.py` | bench_backup.py — benchmark + smoke harness for backup.py. |
| `bench_transfer_sync.py` | bench_transfer_sync.py -- benchmarks + smoke tests for transfer.py / latticesync.py. |
| `clipwatch.py` | LATTICE CLIPBOARD — clipboard history you can search by meaning. |
| `compress.py` | compress.py — "compression of meaning": quantize the image index and prove |
| `compress_bench.py` | compress_bench.py — score whether native zstd compression is a NET POSITIVE, and run a |
| `drives.py` | drives.py — multi-drive support for LatticeSearch. Stdlib only, Windows-first with |
| `integrate_windows.py` | integrate_windows.py — TeraCopy-style Windows shell integration (v1, per-user, no admin). |
| `lattice_report.py` | LATTICE REPORT — the weekly digest. |
| `latticectx.py` | latticectx.py — Windows context-menu handler (TeraCopy-style integration, v1). |
| `latticesync.py` | latticesync.py -- manifest-based instant sync for LatticeSearch. |
| `recover.py` | recover.py — file history + recovery for LatticeSearch. |
| `recover_smoke.py` | recover_smoke.py — prove the recovery loop: protect -> snapshot -> delete -> detect |
| `test_clipwatch.py` | Automated tests for clipwatch.py (LATTICE CLIPBOARD). No human needed. |
| `transfer.py` | transfer.py -- instant / optimized move & copy for LatticeSearch. |
| `usb_demo\app\vault.py` | vault.py — searchable encrypted archive (LatticeSearch Vault mode). |
| `vault.py` | vault.py — searchable encrypted archive (LatticeSearch Vault mode). |
| `vault_smoke.py` | vault_smoke.py — rigorous vault correctness: seal, wrong-pass, unlock, search, |

## Dev & ops

| File | Purpose |
|---|---|
| `agent_bench.py` | agent_bench.py — prove the token+time savings of using LatticeSearch as an AI-agent substrate. |
| `bench_memory.py` | bench_memory.py — smoke test + benchmark for memory_lattice.py (LATTICE MEMORY). |
| `bench_prewarm.py` | bench_prewarm.py — tests the user's theory: does a pre-warmed dependency cache make the |
| `bench_soak.py` | bench_soak.py — honest benchmark: sequential per-tier ingestion (index_all.py style) |
| `dev_reload.py` | dev_reload.py — LATTICE DEV LOOP: auto-restart the engine when its source changes. |
| `diag_caption.py` | Test: what does Florence caption the union jack as, and does e5 then match 'union jack'? |
| `diag_chunk.py` | Does chunking the caption into short clauses make 'flag' queries match? |
| `diag_e5.py` | Does e5 rank 'union jack' / 'flag' / 'driving licence' against the detailed caption + OCR text? |
| `diag_unionjack.py` | Diagnose why the Union Jack source image isn't retrieved. |
| `gen_bell_test.py` | Bell-sound proof: can the engine index the DING of a bell and surface it for 'bell sound'? |
| `gen_manifest.py` | gen_manifest.py — regenerate docs/MANIFEST.md: every file in the project + its one-line |
| `mcp_cli_smoke.mjs` | mcp_cli_smoke.mjs — smoke-test the MCP server (stdio JSON-RPC) and the CLI. |
| `mltest.py` | mltest.py — multilingual proof: (1) name tier handles every script, (2) cross-lingual |
| `regen_cycle.py` | regen_cycle.py — the MOF-inspired REGENERATION CYCLE (from Yaghi's water harvester: |
| `smoke.mjs` | smoke.mjs — whole-system smoke test for the LatticeSearch POC server. |
| `watchdog.py` | watchdog.py — keep the LatticeSearch engine alive. |

## UI

| File | Purpose |
|---|---|
| `palette.html` | doctype html><html><head><meta charset="utf-8"><title>Lattice Search Bar</title><style> |
| `report.html` | doctype html> |
| `ui.html` | doctype html> |

## Other

| File | Purpose |
|---|---|
| `bookmarks_index.py` | bookmarks_index.py — index Chrome/Edge/Brave bookmarks into the doc index. |
| `bundle_models.py` | bundle_models.py — make LatticeSearch fully SELF-CONTAINED. |
| `chunkify_existing.py` | One-time: add clause-level chunks to caption/ocr entries already in the doc index, so images |
| `clap_probe.py` | clap_probe.py — verify CLAP text<->audio works on real files (speech vs music vs sfx). |
| `fswatch.py` | fswatch.py — INSTANT filesystem awareness, safely, in userspace. |
| `index_all.py` | index_all.py — the official first-run indexer, TIERED so the user gets instant search in |
| `mockfs.py` | mockfs.py — generate a multilingual mock file system for i18n testing. |
| `multiuser.py` | multiuser.py — PER-USER MULTI-TENANT launcher. |
| `soak.py` | soak.py — "multi-surface absorption" ingestion prototype for LatticeSearch. |
| `spectro.py` | spectro.py — PROOF of concept: index audio via its SPECTROGRAM IMAGE. |
| `usb_demo\app\content.py` | LatticeSearch content tiers: DOCUMENTS (text of pdf/docx/xlsx/code/notes) and VIDEO (frames). |
| `usb_demo\app\portable_search.py` | portable_search.py — runs FROM the USB. Unlocks the vault and offers interactive search. |
| `usb_pack.py` | usb_pack.py — build a portable Vault USB: an opaque encrypted lattice + a self-contained |
| `usnwatch.py` | usnwatch.py — RUNG 3: whole-volume instant awareness via the NTFS USN Change Journal. |
