AskSage Model Provider Plugin for Dify

A Dify plugin that integrates AskSage as a model provider, giving you access to 47+ AI models (GPT, Claude, Gemini, Llama, Groq, and more) through AskSage's FedRAMP-authorized API.

Features

• 47+ predefined models auto-generated from AskSage's model catalog
• Custom model support -- add any model your AskSage tenant provides
• Dynamic model discovery -- fetches available models from the API at runtime with 5-minute caching
• Token usage tracking -- reports prompt and completion tokens back to Dify
• Simulated streaming -- works with Dify's streaming UI even though AskSage uses synchronous responses
• Model generator script -- run to refresh model YAMLs when AskSage adds new models

Creating an AskSage Account

This plugin uses the AskSage commercial tenant at .

1. Go to chat.asksage.com/register
2. Fill in all required fields (first name, last name, company, email, phone, country)
3. Submit the form -- you will receive a verification code via email
   • If you do not receive the code, email [email protected] to force-validate your account
4. Log in at chat.asksage.com with your email and password
5. New accounts receive a free 30-day trial with 200,000 inference tokens and 200,000 training tokens

After Trial

Contact [email protected] for enterprise pricing and volume discounts.

Getting Your API Key

1. Sign in at chat.asksage.com
2. Click the Settings cog (bottom left)
3. Select the Account tab
4. Scroll to Manage your API Keys
5. Generate a new key -- save it securely (you will need it for the plugin)

For MFA setup, we recommend Microsoft Authenticator or Google Authenticator. Configure it in the same Account settings page.

Requirements

Important: The SDK version must match your Plugin Daemon version. If your daemon is , install . A version mismatch (e.g., SDK 0.7.x with daemon 0.5.x) will cause silent connection failures.

Installation

Verify Your Daemon Version First

Dify 1.13.3 ships with by default, which has a bug that breaks installation. You must upgrade the daemon to 0.5.5+ before installing any local plugin package.

In your (e.g. ), find the service and update the image:

Then restart the daemon:

Option A: Install from .difypkg (recommended)

1. Download from the Releases page
2. In Dify, go to Plugins (top right)
3. Click Install Plugin
4. Upload the file
5. Configure credentials (see below)

Option B: Remote debugging (development)

1. Clone this repo:

2. Create a virtual environment:

3. Install dependencies:

4. Copy to and fill in your debug key:

   To find your debug key: Dify UI > Plugins > click the bug icon > copy Debug Key.

5. Run the plugin:

Credential Setup

After installing the plugin, configure it in Dify:

1. Go to Settings > Model Providers
2. Find AskSage and click it
3. Enter the following:

4. Click Save -- the plugin validates your credentials by calling AskSage's endpoint.

Refreshing Models

When AskSage adds new models to your tenant:

This calls , generates a YAML file for each model, and updates . Image-generation models are automatically filtered out. Restart the plugin or reinstall the to pick up the changes.

Project Structure

Plugin Update Procedures

When the plugin code is updated (new features, model changes, bug fixes), the update process depends on how you installed the plugin.

Packaged Install (.difypkg)

If you installed via a upload, you must repackage and reinstall:

1. Pull the latest code:

2. Bump the version in — the daemon rejects reinstalls at the same version:

3. Repackage — run from the parent directory, not from inside the plugin folder:

   This writes to . If you get "Access is denied", you are likely in a directory you don't have write access to (e.g. ).

4. Uninstall the old version in the Dify console: Plugins → find AskSage → delete/uninstall.

5. Upload the new : Plugins → Install Plugin → upload the new file.

6. Re-enter credentials — API key and base URL do not carry over between installs. Go to the AskSage provider settings and re-enter them.

Debug Mode

If you are running in debug mode (local Python process), updates are simpler:

1. Pull the latest code:

2. Restart the plugin — stop the running process (Ctrl+C) and relaunch:

   Dify picks up updated model YAMLs and code on reconnect. No version bump or repackaging required.

Tip: Use debug mode during active development. Switch to for production or team distribution.

Known Issues -- Daemon 0.5.3

Dify 1.13.3's default pins , which contains a bug in the handler. The Go struct uses a tag instead of a tag, so Gin cannot bind the query parameter. The result is a 400 error on immediately after a successful upload:

Fix: Upgrade to daemon 0.5.5+ (see installation instructions above).

References:

• dify-plugin-daemon PR #593 -- daemon-side fix (included in 0.5.5)
• dify PR #34720 -- API-side backward-compatible fix (merged to main, not yet released)
• dify issue #34274 -- original bug report

Known Limitations

• No native streaming -- AskSage's returns complete responses. The plugin simulates streaming by yielding the full response as a single chunk.
• No stop sequences -- AskSage does not support stop sequence parameters.
• Token estimation -- Uses a 4-chars-per-token heuristic for pre-invocation estimates since AskSage does not expose a tokenizer endpoint. Actual usage from responses is reported accurately.
• No function/tool calling -- AskSage's tool calling support varies by underlying model and is not yet exposed through this plugin.

License

Apache 2.0

Links

• AskSage API Documentation
• Dify Plugin Development Docs
• Dify Plugin SDK