1
Get your API key.
To generate an API key, go to the API keys and URLs page. When generating API keys, be sure to save them securely, as they can’t be viewed again.
You can generate and use up to 25 API keys.
2
Pick a model.
SambaCloud developers can view the available models and details on the SambaCloud model page.SambaStack developers should consult with their system administrator to determine which models are available on their system. Model details can then be viewed on the SambaStack models page.
We’ll use
Meta-Llama-3.3-70B-Instruct
as an example for the remainder of this guide.3
Make an API request.
You can make an inference request in multiple ways. See two examples below:
- OpenAI client library – Use Javascript or Python for a more flexible integration.
- CURL command – Send a request directly from the command line.
OpenAI client library
To get started, select your preferred programming language. Then, open a terminal window and install the OpenAI library."your-sambanova-base-url"
and "your-sambanova-api-key"
with your base URL and API Key values. Then run the file with the command below in a terminal window.