Skip to content
This repository has been archived by the owner on Apr 3, 2024. It is now read-only.

KillianLucas/ooba

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Open In Colab

A headless Oobabooga wrapper.


pip install ooba
import ooba

path = ooba.download("https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF")

llm = ooba.llm(path)
messages = [{"role": "user", "content": "Hi Mistral."}]

for token in llm.chat(messages):
    print(token)

ooba.product.demo.mp4

About

Run language models on consumer hardware.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages