Skip to main content

Using SambaNova With Roo Code

SambaNova specializes in providing high-speed inference for large language models, utilizing their Reconfigurable Dataflow Units (RDUs) through their SambaCloud portal. This delivers fast response times for supported models.

Website: https://cloud.sambanova.ai/


Getting an API Keyโ€‹

To use SambaNova with Roo Code, you'll need an API key from the SambaCloud. After signing up, navigate to the API Keys section in the left panel to create and copy your SambaCloud API key.


Available Modelsโ€‹

Roo Code automatically fetches all available models from the SambaNova API.

For the complete, up-to-date model list and capabilities, see SambaCloud's supported models documentation.


Configuration in Roo Codeโ€‹

  1. Open Roo Code Settings: Click the gear icon () in the Roo Code panel.
  2. Select Provider: Choose "SambaNova" from the "API Provider" dropdown.
  3. Enter API Key: Paste your SambaNova API key into the "SambaNova API Key" field.
  4. Select Model: Choose your desired model from the "Model" dropdown.
  5. (Optional) Custom Base URL: If using a private deployment, check "Use custom base URL" and enter your endpoint URL.