Class: LLM::Bedrock::Models

Inherits:

Object

• Object
• LLM::Bedrock::Models

Defined in:

lib/llm/providers/bedrock/models.rb

Overview

The Models class provides a model object for interacting with AWS Bedrock's ListFoundationModels API.

Unlike the Converse API (which lives on bedrock-runtime.<region>.amazonaws.com), the models endpoint lives on the control plane at bedrock.<region>.amazonaws.com. This class builds a matching transport for the control-plane host from the provider's current transport class.

Examples:

llm = LLM.bedrock(
  access_key_id: ENV["AWS_ACCESS_KEY_ID"],
  secret_access_key: ENV["AWS_SECRET_ACCESS_KEY"],
  region: "us-east-1"
)
llm.models.all.each { |m| puts m.id }

Instance Method Summary

• #initialize(provider) ⇒ LLM::Bedrock::Models constructor
• #all(**params) ⇒ LLM::Response

  List all foundation models available in the configured region.

Constructor Details

#initialize(provider) ⇒ LLM::Bedrock::Models

Parameters:

• provider (LLM::Bedrock)

# File 'lib/llm/providers/bedrock/models.rb', line 26

def initialize(provider)
  @provider = provider
end

Instance Method Details

#all(**params) ⇒ LLM::Response

Note:

This calls AWS Bedrock's ListFoundationModels API which returns all models available in the region, not just the ones the current account is subscribed to.

List all foundation models available in the configured region.

Parameters:

• params (Hash) —

  Optional query parameters (e.g. byProvider: "Anthropic", byInferenceType: "ON_DEMAND")

Returns:

• (LLM::Response)

# File 'lib/llm/providers/bedrock/models.rb', line 41

def all(**params)
  host = credentials.host
  req = build_request(host, params)
  res = build_transport(host).request(req, owner: self)
  handle_response(res)
end