Skip to content

Releases: InftyAI/llmaz

First release v0.0.1

23 Jul 04:02
878203b
Compare
Choose a tag to compare

What's Changed

  • Add new core APIs, e.g. Model
  • Add new inference APIs, e.g.Playground, Inference
  • Support serving models from huggingface
  • Support sharing models weights on the same node
  • Integrate with vllm by default
  • Add webhooks for APIs
  • Add installation documents and examples

New Contributors