a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model

Experimental project for AI and NLP based on Transformer Architecture

This repository features a custom-built decoder-only language model (LLM) with a total of 37 million parameters 🔥. I train the model to be able to ask question from a given context

🚀 从零亲手训练大语言模型（LLM）——全流程实战教程！涵盖数据清洗与预处理、自定义Tokenizer训练、模型架构搭建、从头预训练，以及指令微调（SFT）。没有黑盒，不依赖现成API，保姆级手把手带你打造属于自己的LLM，深入理解大模型的每一处细节。

Implementation of the GPT-3 paper: Language Models are Few-Shot Learners

This repo represents my Nano-GPT speedrun playground, which started coding along Let's reproduce GPT-2 (124M), then moved into further improvements.

Generate caption on images using CNN Encoder- LSTM Decoder structure

Transformers Intuition

An explainable and simplified version of OLMo model

This project aims to simplify texts from research papers using advanced natural language processing (NLP) techniques, making them more accessible to a broader audience

Generative AI fine-tune and inference for sequence classification tasks

Code and dataset used to train dialect adapters for decoder models.

This project focuses on the implementation of inverting I-JEAP, a new architecture designed to simulate human intelligence through self-supervised learning. Our goal is to invert the embeddings to demonstrate that such architectures can be vulnerable to inversion attacks

a dna sequence generation/classification using transformers

On the Design and Performance of Machine Learning Based Error Correcting Decoders

An LLM based tool for generation of cheese advirtisements

Text Generation using RNN, LSTM, and Transformer

Clavier is a language model that generates sheet music and MIDI files in the style of classical composers

🖼️ Generate descriptive captions for images using a CNN-LSTM model, combining computer vision and NLP for effective storytelling.

Custom decoder Transformer that treats a patient's medical journey like a story told through diagnosis codes instead of words.