Local semantic sentence embedding Reader-Answerer model for Retrieval Augmented Generation (RAG) of cited question answering from .pdf, .md, & .docx files using small language models.

Implementation of a LLaDA-inspired Masked Diffusion Model for Text using PURE BYTE-LEVEL TOKENIZATION (cuz why not) and Mixed Precision Training for speed.

A curated showcase of small, on-premise models with great utility, enabling privacy-centered deployment and easy adaptation to bio-inspired use cases.

Experiments with In Context Learning using small functions

Create a Small LLM using EleutherAI/gpt-neo-2.7B - Fine Tune It for a Specalized Purpouse and Leverage as a Co-Pilot