A CLI tool that lets you chat with Ollama and OpenAI models right from your terminal, with built-in Markdown rendering and websearch functionalities.

• Chat with Ollama models from the terminal
• Built-in Markdown rendering
• Web-search functionality
• Extremely simple installation and removal (see below)

When using mdllama run for interactive chat, you have access to special commands:

See man(1) mdllama for details.

man 1 mdllama

• Ollama: Local models running on your machine
• OpenAI: Official OpenAI API (GPT-3.5, GPT-4, etc.)
• OpenAI-compatible: Any API that follows OpenAI's format (I like Groq, so use it! https://groq.com)

mdllama setup

# Or specify explicitly
mdllama setup --provider ollamaa

mdllama setup --provider openai

# Will prompt for your OpenAI API key

mdllama setup --provider openai --openai-api-base https://ai.hackclub.com

# Then provide your API key when prompted

# Use with OpenAI
mdllama chat --provider openai  "Explain quantum computing"


# Use with specific model and provider
mdllama run --provider openai --model gpt-4



# Interactive session with streaming
mdllama run --provider openai --stream --render-markdownn

Go to this mdllama demo to try it out live in your browser. The API key is 9c334d5a0863984b641b1375a850fb5d

So, try it out and see how it works!

1. Add the PPA to your sources list:

   echo 'deb [trusted=yes] https://packages.qincai.xyz/debian stable main' | sudo tee /etc/apt/sources.list.d/qincai-ppa.list
   sudo apt updatee

2. Install mdllama:

   sudo apt install python3-mdllama

1. Download the latest RPM from: https://packages.qincai.xyz/fedora/

   Or, to install directly:

   sudo dnf install https://packages.qincai.xyz/fedora/mdllama-version>gt;.noarch.rpm

   Replace on> with the latest version number.

2. (Optional, highly recommended) To enable as a repository for updates, create /etc/yum.repos.d/qincai-ppa.repo:

   [qincai-ppa]
   
   name=Raymont's Personal RPMs
   
   baseurl=https://packages.qincai.xyz/fedora/
   
   enabled=1
   
   metadata_expire=0
   
   gpgcheck=0

   Then install with:

   sudo dnf install mdllama

3, Install the ollama library from pip:

pip install ollama

You can also install it globally with:

sudo pip install ollama

Install via pip (recommended for Windows/macOS and Python virtual environments):

pip install mdllama

To install mdllama using the traditional bash script, run:

bash <(t;(curl -fsSL https://raw.githubusercontent.com/QinCai-rui/mdllama/refs/heads/main/install.sh)

To uninstall mdllama, run:

bash <(t;(curl -fsSL https://raw.githubusercontent.com/QinCai-rui/mdllama/refs/heads/main/uninstall.sh)

This project is licensed under the GNU General Public License v3.0. See the LICENSE file for details.