Represent model ownership, isolated sessions, continuation state, cancellation, and disposal order explicitly.
Model lifetime
Load one verified model and keep it alive while any child session exists. The model is not process-global authority.
Session isolation
Create one LocalGgufSession per independent conversation or worker and assign a host-owned stable session identifier.
Reset and continuation
Use ResetSession=true for a new sequence. Continue with ResetSession=false only when the host deliberately constructs a valid continuation prompt for the same model state.
Disposal order
Cancel or finish active generation, dispose each session, then dispose the model. Surface disposal errors without hiding the earlier execution result.
Available now
- The public UAIX.LmRuntime package family and canonical package documentation.
- The host-facing workflow and evidence distinctions described on this page.
Host responsibilities
- Select and trust inputs, define policy and limits, integrate the UI or service, retain application evidence, and test the exact deployment.
Not claimed
- A session does not assemble chat history automatically.
- Multiple sessions do not imply unlimited safe concurrency.
Operational boundary
What this page covers: Represent model ownership, isolated sessions, continuation state, cancellation, and disposal order explicitly.
Available now: The documented package surfaces and this host-facing guidance are public.
Host responsibility: Own acquisition, trust, configuration, presentation, persistence, transport, policy, tests, and deployment.
Not claimed: Universal compatibility, production certification, safety certification, hidden fallbacks, or behavior beyond retained evidence.
Canonical sources: Canonical package documentation · Current release metadata
Last reviewed UTC:
Source and review record
Prerequisites
- Read Get Started
- Review host/runtime boundaries