Skip to content

Lightweight OpenAI/OLLaMA/GenAI compatible caller, originally designed for DeepInfra.

License

Notifications You must be signed in to change notification settings

fumiama/deepinfra

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

deepinfra

Lightweight OpenAI/OLLaMA/GenAI compatible caller, originally designed for DeepInfra.

Quick Start

api := NewAPI(OpenAIDeepInfra, "PUT YOUR API KEY HERE")
txt, err := api.Request(model.NewOpenAI(model.ModelDeepDeek, model.SeparatorThink, 0.7, 0.9, 1024).
    System("Be a good assistant.").User("Hello"),
)
if err != nil {
    panic(err)
}
fmt.Println(txt)
// Hello! How can I assist you today?