模型可以加速吗？ #180

Open

opened

on Nov 12, 2025

Tesla V100S-PCIE-32GB
一个一分钟的完整回复大概要等待90s， 8.5 tokens/s
有什么办法可以加速吗？

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests