Create a vector search subsystem for SciDEX that indexes ALL content types:
- Wiki pages (17K+), hypotheses, KG nodes/edges, papers, analyses, debates, skills
- Use a vector database (ChromaDB or FAISS) for semantic search via embeddings
- Generate embeddings for all existing content and set up incremental indexing
- Create /api/search endpoint that accepts queries and returns ranked results across all types
- Results should be grouped by type (wiki, hypothesis, graph node, paper, analysis, etc.)
- Support both semantic (vector) and keyword (full-text) search, combining scores
- Reference NeuroWiki search and wiki.js for inspiration on search UX patterns
- Ensure indexes are kept up to date as new content is added (post-analysis hook, etc.)
## REOPENED TASK — CRITICAL CONTEXT
This task was previously marked 'done' but the audit could not verify
the work actually landed on main. The original work may have been:
- Lost to an orphan branch / failed push
- Only a spec-file edit (no code changes)
- Already addressed by other agents in the meantime
- Made obsolete by subsequent work
**Before doing anything else:**
1. **Re-evaluate the task in light of CURRENT main state.** Read the
spec and the relevant files on origin/main NOW. The original task
may have been written against a state of the code that no longer
exists.
2. **Verify the task still advances SciDEX's aims.** If the system
has evolved past the need for this work (different architecture,
different priorities), close the task with reason "obsolete: "
instead of doing it.
3. **Check if it's already done.** Run `git log --grep=''`
and read the related commits. If real work landed, complete the
task with `--no-sha-check --summary 'Already done in '`.
4. **Make sure your changes don't regress recent functionality.** Many
agents have been working on this codebase. Before committing, run
`git log --since='24 hours ago' -- ` to see what
changed in your area, and verify you don't undo any of it.
5. **Stay scoped.** Only do what this specific task asks for. Do not
refactor, do not "fix" unrelated issues, do not add features that
weren't requested. Scope creep at this point is regression risk.
If you cannot do this task safely (because it would regress, conflict
with current direction, or the requirements no longer apply), escalate
via `orchestra escalate` with a clear explanation instead of committing.
Completion Notes
Auto-completed by supervisor after successful deploy to main
Git Commits (2)
[Search] Add /api/search/stats endpoint for index statistics [task:da200fbd-27ee-47f4-b4c6-9cd896785350]2026-04-14
[Search] Fix undefined 'sem_types' variable in /api/search - enables semantic search with type filters [task:da200fbd-27ee-47f4-b4c6-9cd896785350]2026-04-14