This directory contains wrapper classes that abstract the LLMs into a single class called LLMKernel. Currently, the following models are supported:
In the future, greedy token generation and lm types other than casual will be supported.