AntonAntonov/ Chatnik

CLI scripts for conversing with persistent LLM personas

Contributed by: Anton Antonov

Command Line Interface (CLI) scripts to manage and interact with multiple, persistent Large Language Model (LLM) chat objects. Access to repository prompts is provided via automatic prompt expansion. Access to chat object elements (history, models, etc.) facilitates the creation of useful CLI pipelines.

Installation Instructions

To install this paclet in your Wolfram Language environment, evaluate this code:
PacletInstall["AntonAntonov/Chatnik"]

To load the code after installation, evaluate this code:
Needs["AntonAntonov`Chatnik`"]

Details

The paclet provides Command Line Interface (CLI) scripts for conversing with- and managing persistent Large Language Model (LLM) personas.

The script "LLMChat" is used to interact with the chat objects.

The script "LLMChatMeta" is used to mange the chat objects -- deletion, getting context, first- or last message, clearing of messages, etc.

The script "LLMPrompt" is used to get the texts of repository prompts in the shell environment.

"Chatnik" uses the Wolfram Language persistent values functionalities in order to maintain persistent interaction with multiple LLM chat objects.

"Chatnik" can be seen as a package that "moves" the LLM-chat objects interaction system of the paclet "Chatbook" into typical OS shell interaction. (I.e. an OS shell is used instead of a Wolfram notebook.)

There are several consequences of this approach: (1) Multiple LLMs and LLM providers can be used, (2) The chat messages can use the provided by Wolfram Language prompts collection and prompt spec DSL, (3) Easy access to OS shell functionalities.

Paclet Guide

Examples

Basic Examples (4)

The script "LLMChat" is used to interact with the chat objects. Create and chat with an LLM persona named "yoda1" (using the Yoda chat persona):

Continue the conversation with "yoda1":

Execute a chat object management command using the script LLMChatMeta -- view the whole interaction with "yoda1":

Clear the messages of "yoda1":

Scope (5)

Installation MacOSX & Linux (2)

Copy paclet's scripts to a directory that is already in shell's PATH variable. For example, "~/.local/bin":

On MacOSX if no directory is specified for ChatnikCopyScripts (i.e the directory is Automatic) then paclet's scripts are copied in the "~/Applications" directory: