OpenAIClient

OpenAIClient(client: Union[OpenAI, AzureOpenAI], response_format: Union[BaseModel, dict[str, Any], None] = None)

Follows the Client protocol and wraps the OpenAI client.

Parameters:
NameDescription
clientType: Union[OpenAI, AzureOpenAI]
response_formatType: Union[BaseModel, dict[str, Any], None]

Default: None

Static Methods

get_usage

get_usage(response: Union[ChatCompletion, Completion]) -> dict
Parameters:
NameDescription
responseType: Union[ChatCompletion, Completion]

Instance Methods

cost

cost(self, response: Union[ChatCompletion, Completion]) -> float

Calculate the cost of the response.

Parameters:
NameDescription
responseType: Union[ChatCompletion, Completion]

create

create(self, params: dict[str, Any]) -> ChatCompletion

Create a completion for a given config using openai’s client.

Parameters:
NameDescription
paramsThe params for the completion.

Type: dict[str, Any]
Returns:
TypeDescription
openai.types.chat.chat_completion.ChatCompletionThe completion.

message_retrieval

message_retrieval(self, response: Union[ChatCompletion, Completion]) -> list[str] | list[ChatCompletionMessage]

Retrieve the messages from the response.

Parameters:
NameDescription
responseType: Union[ChatCompletion, Completion]