TransformersNotFound
Building an open-source GPT from scratch
An end-to-end project fine-tuning and serving an open-source language model for reasoning tasks.
- Fine-tuned LLaMA-3.2B with parameter-efficient LoRA adapters on a custom Chain-of-Thought dataset
- Implemented multi-GPU distributed training with HuggingFace Accelerate
- Optimized inference with vLLM for high-throughput serving and exposed FastAPI endpoints
Stack: Python · PyTorch · HuggingFace · LoRA · Accelerate · vLLM · FastAPI