Class: OmniAI::Llama::Client

Inherits:
Client
  • Object
show all
Defined in:
lib/omniai/llama/client.rb

Overview

A Llama client implementation. Usage:

w/ ‘api_key“:

client = OmniAI::Llama::Client.new(api_key: '...')

w/ ENV:

ENV['LLAMA_API_KEY'] = '...'
client = OmniAI::Llama::Client.new

w/ config:

OmniAI::Llama.configure do |config|
  config.api_key = '...'
end

client = OmniAI::Llama::Client.new

Constant Summary collapse

VERSION = 
"v1"

Instance Method Summary collapse

Constructor Details

#initialize(api_key: OmniAI::Llama.config.api_key, host: OmniAI::Llama.config.host, logger: OmniAI::Llama.config.logger, timeout: OmniAI::Llama.config.timeout) ⇒ Client

Returns a new instance of Client.

Parameters:

  • api_key (String, nil) (defaults to: OmniAI::Llama.config.api_key) —

    optional - defaults to ‘OmniAI::Llama.config.api_key`

  • host (String) (defaults to: OmniAI::Llama.config.host) —

    optional - defaults to ‘OmniAI::Llama.config.host`

  • logger (Logger, nil) (defaults to: OmniAI::Llama.config.logger) —

    optional - defaults to ‘OmniAI::Llama.config.logger`

  • timeout (Integer, nil) (defaults to: OmniAI::Llama.config.timeout) —

    optional - defaults to ‘OmniAI::Llama.config.timeout`

Raises:

  • (ArgumentError) 


29
30
31
32
33
34
35
36
37
38
 
# File 'lib/omniai/llama/client.rb', line 29

def initialize(
  api_key: OmniAI::Llama.config.api_key,
  host: OmniAI::Llama.config.host,
  logger: OmniAI::Llama.config.logger,
  timeout: OmniAI::Llama.config.timeout
)
  raise(ArgumentError, %(ENV['LLAMA_API_KEY'] must be defined or `api_key` must be passed)) if api_key.nil?

  super
end

Instance Method Details

#chat(messages = nil, model: Chat::DEFAULT_MODEL, temperature: nil, format: nil, stream: nil, tools: nil) {|prompt| ... } ⇒ OmniAI::Chat::Completion

Parameters:

  • messages (String) (defaults to: nil) —

    optional

  • model (String) (defaults to: Chat::DEFAULT_MODEL) —

    optional

  • format (Symbol) (defaults to: nil) —

    optional :text or :json

  • temperature (Float, nil) (defaults to: nil) —

    optional

  • stream (Proc, nil) (defaults to: nil) —

    optional

  • tools (Array<OmniAI::Tool>, nil) (defaults to: nil) —

    optional

Yields:

  • (prompt)

Yield Parameters:

  • prompt (OmniAI::Chat::Prompt)

Returns:

  • (OmniAI::Chat::Completion)

Raises:

  • (OmniAI::Error) 


62
63
64
 
# File 'lib/omniai/llama/client.rb', line 62

def chat(messages = nil, model: Chat::DEFAULT_MODEL, temperature: nil, format: nil, stream: nil, tools: nil, &)
  Chat.process!(messages, model:, temperature:, format:, stream:, tools:, client: self, &)
end

#connection ⇒ HTTP::Client

Returns:

  • (HTTP::Client) 


41
42
43
44
45
46
47
 
# File 'lib/omniai/llama/client.rb', line 41

def connection
  @connection ||= begin
    http = super
    http = http.auth("Bearer #{@api_key}") if @api_key
    http
  end
end