← Live feed

AI Engineer Needed: Fix LLM Fine-Tuning Bug / Troubleshooting

Budget
$100.0
Contract
FIXED
Client
Pakistan · ★ 5.00 (2)
Live feed
Upwork

machine-learning, python, data-science, artificial-intelligence, lora

Preferred qualifications

  • Experience: Expert
We are looking for an experienced AI Engineer or Data Scientist for a quick, micro-project to debug and resolve a specific issue in our LLM fine-tuning pipeline. This is a straightforward troubleshooting task for an expert who knows training loops inside and out. We need you to look at our setup/logs, identify the bottleneck, and implement a clean fix so we can resume successful training. Common issues we might be facing (or similar): * Formatting/tokenization issues or train/serve mismatches. * Training loop anomalies (loss spikes, overfitting, catastrophic forgetting). * Hardware/memory optimization (CUDA OOM during validation/training). * PEFT/LoRA adapter loading or weight merging bugs. Requirements: * Hands-on experience fine-tuning open-source LLMs (Llama, Mistral, Qwen, etc.). * Deep familiarity with frameworks like Hugging Face (TRL/SFTTrainer), Unsloth, Axolotl, or native PyTorch. * Expert-level debugging skills in Python and CUDA environments. * Ability to deliver a working fix quickly.
Open job

AI proposal draft

Generate a short cover letter to copy into the offer. Says you are interested and ready to work.

Sign in to generate an AI proposal draft.

Log in