Xorbits Inference

Xorbits Inference lets Dify use locally or remotely served Xinference models.

Features

• Provides llm, text-embedding, rerank, speech2text, tts models in Dify.
• Supports customizable model configuration.

Setup

1. Install this plugin from the Dify Marketplace.
2. Get the required credentials from Xorbits Inference.
3. Add the credentials in the plugin settings.
4. Save the configuration.

Usage

Select Xorbits Inference as the model provider in Dify, choose an available model, and use it in applications, agents, or workflows.

Privacy

This plugin sends the inputs required by the selected operation to the upstream service. Review the upstream service's privacy policy before use.