Interface MockLlmHandle

A live model handle issued to one window.

const entry: MockLlmHandle = { handle: 'h-0123456789ab', connectionId: 'local-llama', epoch: 0 };

interface MockLlmHandle {
    connectionId: string;
    epoch: number;
    handle: string;
}

Properties

connectionId: string

Seeded connection id.

epoch: number

Handle epoch; handles from an older epoch are expired.

handle: string

Opaque wire handle.