Personal / experimental
Local SLM
- Problem
- A personal experiment with a smaller language model running locally, so prompts stay off a hosted API.
- Architecture
- A Llama-based local model behind a thin application boundary. Retrieval, tools, and an evaluation loop are not specified.
- Technology
- Llama-based local model. TODO: runtime, hardware, and serving stack are not documented.
- What I learned
- TODO: what was learned is not documented.
Demo — TODO: a demo URL is not published.