🌐 Track 05: AI for Public Internet Users ⏳ Not Yet Started (Planned Weekend R&D)
EXPERIMENT #24

AI Personal Search Engine ("Google for My Digital Life")

A private, self-hosted semantic search engine indexing personal notes, code snippets, documentation, browser history, and projects with natural language queries.

🎯

The Problem

What difficult challenge is this experiment tackling?

Keyword search (Ctrl+F) fails when you remember the concept ("that time I fixed the Safari ITP tracking cookie problem") but cannot recall the exact filename or phrase.

πŸ’‘

The Hypothesis

What do I believe autonomous AI & engineering can accomplish?

Dense vector embeddings paired with BM25 lexical search (hybrid retrieval) allows an engineer to retrieve exact code snippets and architectural notes using fuzzy conversational queries.

πŸ›οΈ

System Architecture & Workflow

End-to-end design, data pipelines, and component interaction
01 Local Filesystem Watcher
02 Text & Code Chunking
03 BGE / OpenAI Embeddings
04 Qdrant Hybrid Index
05 Local Fast API Server
06 Global Hotkey Spotlight UI.
πŸ“Š

Benchmark & Empirical Metrics

Accuracy β€’ Latency β€’ Cost β€’ Token Usage β€’ Human Intervention

Fuzzy natural language query returns exact target code file in top 3 results 94% of the time with sub-100ms latency.

πŸ›‘οΈ

Security, Privacy & Ethical Guardrails

Risk mitigation, strict boundaries, and sandbox controls

100% offline, local-first architecture; zero indexed data ever leaves the user’s local workstation.

πŸ“

Lessons Learned & Observations

Empirical findings from prototyping and testing

Combining AST-aware code chunking with prose chunking prevents broken function definitions in search results.

πŸš€

Next Experiment Iteration

Upcoming modifications, scaling factors, or new hypotheses

Index audio recordings of meeting notes with automatic speaker separation.