Instructions to use IndexTeam/Index-1.9B-Character with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use IndexTeam/Index-1.9B-Character with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="IndexTeam/Index-1.9B-Character", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("IndexTeam/Index-1.9B-Character", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use IndexTeam/Index-1.9B-Character with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "IndexTeam/Index-1.9B-Character"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IndexTeam/Index-1.9B-Character",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/IndexTeam/Index-1.9B-Character

SGLang

How to use IndexTeam/Index-1.9B-Character with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "IndexTeam/Index-1.9B-Character" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IndexTeam/Index-1.9B-Character",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "IndexTeam/Index-1.9B-Character" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "IndexTeam/Index-1.9B-Character",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use IndexTeam/Index-1.9B-Character with Docker Model Runner:
```
docker model run hf.co/IndexTeam/Index-1.9B-Character
```

Add pipeline tag, library name, and paper link

by nielsr HF Staff - opened Aug 10

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

-1

Files changed (1) hide show

README.md +6 -1

README.md CHANGED Viewed

@@ -2,13 +2,18 @@
 license: other
 license_name: license
 license_link: LICENSE
 ---
 <div align="center">
 <h1>
   Index-1.9B
 </h1>
 </div>
 ## Model Introduction
 The Index-1.9B-Character model is a role-playing model with 1.9 billion parameters in the large language model series independently developed by the Index team. Users can customize the few shots role by uploading the role dialogue materials that meet the requirements.
@@ -38,4 +43,4 @@ The Index-1.9B-Character model is evaluated using the authoritative benchmark Ch
 |CharacterGLM|2.937|2.493|3.623|2.695|
 |ChatGLM3-6B|2.898|2.556|3.399|2.739|
 |Qwen-7B|2.849|2.54|3.327|2.679|
-|GPT-3.5|2.381|2.101|2.749|2.293|

 license: other
 license_name: license
 license_link: LICENSE
+library_name: transformers
+pipeline_tag: text-generation
 ---
 <div align="center">
 <h1>
   Index-1.9B
 </h1>
 </div>
+This model is part of the Index-1.9B series introduced in the [Index SLM Technical Report](https://huggingface.co/papers/2607.09885).
 ## Model Introduction
 The Index-1.9B-Character model is a role-playing model with 1.9 billion parameters in the large language model series independently developed by the Index team. Users can customize the few shots role by uploading the role dialogue materials that meet the requirements.
 |CharacterGLM|2.937|2.493|3.623|2.695|
 |ChatGLM3-6B|2.898|2.556|3.399|2.739|
 |Qwen-7B|2.849|2.54|3.327|2.679|
+|GPT-3.5|2.381|2.101|2.749|2.293|