Struct LocalAssistant 

pub struct LocalAssistant { /* private fields */ }

A model that answers on its own thread. Dropping it ends the thread and frees the memory.

Implementations

impl LocalAssistant

pub fn new(folder: ModelFolder, model: LocalModel) -> Self

An assistant over model. Nothing is loaded until the first question.

pub fn write( &self, system: String, user: String, text: Arc<Mutex<String>>, waker: UiWaker, if_it_fails: String, )

Asks it to answer user, following system, writing to text as it goes. if_it_fails is what text becomes if the model cannot answer.

pub fn answer( &self, system: String, user: String, text: Arc<Mutex<String>>, done: Arc<AtomicBool>, waker: UiWaker, )

Asks it to answer user, following system, and says when it is over: done is set after text has all of it, or stays empty if the model could not answer.

pub fn too_slow(&self) -> bool

Whether a question waited too long on this machine. From then on it answers nothing, at once, so nobody waits for it again until another assistant is made.

Trait Implementations

impl Clone for LocalAssistant

fn clone(&self) -> LocalAssistant

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LocalAssistant

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.