Dokumentasi

LangChain, Vercel AI SDK, LlamaIndex.

LangChain (Python)

python
from langchain_openai import ChatOpenAI

llm = ChatOpenAI(base_url="https://api.tokenbyte.biz.id/v1", api_key="sk-tkn-KEY_KAMU", model="smart-auto")
print(llm.invoke("Halo!").content)

Vercel AI SDK

ts
import { createOpenAICompatible } from "@ai-sdk/openai-compatible";
import { generateText } from "ai";

const tokenbyte = createOpenAICompatible({
  name: "tokenbyte",
  baseURL: "https://api.tokenbyte.biz.id/v1",
  apiKey: process.env.TOKENBYTE_API_KEY,
});

const { text } = await generateText({ model: tokenbyte("smart-auto"), prompt: "Halo!" });

LlamaIndex (Python)

python
from llama_index.llms.openai_like import OpenAILike

llm = OpenAILike(api_base="https://api.tokenbyte.biz.id/v1", api_key="sk-tkn-KEY_KAMU", model="smart-auto", is_chat_model=True)
print(llm.complete("Halo!"))