Price Plans

A Price Plan defines the per-second rates for each GPU instance type. All billing accounts are assigned to the active default price plan.

Understanding Rates

Each rate entry specifies:

Field Description
meter The billing meter (always gpu_instance_seconds)
unit second
unit_price Cost per second in USD
dimensions Instance type and region this rate applies to

Example Rate

An g5.xlarge at AWS on-demand pricing (~$1.006/hr) would have a per-second rate of approximately:

$1.006 / 3600 ≈ $0.000279 per second

GPU Instance Reference Pricing

The table below shows approximate on-demand hourly rates for common GPU instance types. Xinference uses these as a baseline for the default price plan.

Instance Type GPU VRAM Approx. $/hr
g4dn.xlarge T4 16 GB ~$0.526
g5.xlarge A10G 24 GB ~$1.006
g5.2xlarge A10G 24 GB ~$1.212
g5.12xlarge 4× A10G 96 GB ~$5.672
p3.2xlarge V100 16 GB ~$3.060
p4d.24xlarge 8× A100 40 GB 320 GB ~$32.77

Note

These are reference prices. Contact your account manager for current Xinference sell prices.

Default Plan

On first startup, Xinference seeds a default price plan (aws-ondemand-default) derived from AWS on-demand list prices. This is a placeholder — confirm sell prices should be loaded via the admin CLI before going live.

Changing Prices

Prices are immutable once published. To change rates:

  1. Create a new price plan with a new code (e.g. aws-ondemand-2025-q3).
  2. Import it via the CLI or admin API.
  3. All billing accounts are automatically pointed to the new plan.
  4. Already-rated usage retains its historical rate snapshot.

CLI (Self-Hosted)

python -m app.cli.import_price_plan path/to/prices.json

JSON format:

{
  "code": "aws-ondemand-2025-q3",
  "name": "AWS On-Demand Q3 2025",
  "currency": "USD",
  "rates": [
    {
      "meter": "gpu_instance_seconds",
      "unit": "second",
      "unit_price": "0.000280",
      "dimensions": {
        "instance_type": "g5.xlarge",
        "region": "us-east-1"
      }
    }
  ]
}

Pass --no-activate to import without switching accounts to the new plan immediately.

Viewing the Current Plan

Navigate to Billing → Price Plan in the dashboard to see the rates currently applied to your account.