Skip to content
#

olmocr

Star

Here is 1 public repository matching this topic...

NetEase-Media / grps_trtllm

Star 122

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

openai multi-modal phi function-call qwq ai-agent llm llama-index chatglm internvideo tensorrt-llm qwen2 llama3 minicpm-v internvl2 qwen2-vl deepseek-r1 janus-pro olmocr
  • Updated Mar 22, 2025
  • Python

Improve this page

Add a description, image, and links to the olmocr topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the olmocr topic, visit your repo's landing page and select "manage topics."

Learn more