AI Engineer - Senior Staff

About the job

Key Responsibilities Responsibilities & Skills • Select, evaluate, and benchmark large foundation models; lead model distillation/quantization for efficiency. • Prepare high‑quality datasets; perform data curation, filtering, labeling, and quality analysis. • Tune task‑specific cost functions, hyperparameters, and training loops for optimal performance. • Build domain‑aware RAG systems with strong retrieval metrics, evaluation pipelines, and citations. • Architect and deploy model‑serving pipelines using vLLM / TGI / Triton, including batching, caching, and streaming. • Lead experimentation cycles: dataset → training → evaluation → deployment → monitoring. • Mentor junior engineers and influence model architecture decisions. Required Qualifications • 8–12 years total experience in software/ML engineering, with 3–5+ years hands‑on experience training or fine‑tuning LLMs or large models. • Strong expertise in LLM fine‑tuning techniques (LoRA, QLoRA, PEFT, SFT, RLHF). • Deep understanding of transformers, attention mechanisms, tokenization, embeddings, and model architecture trade‑offs. • Strong experience with PyTorch, HuggingFace ecosystem, DeepSpeed/FSDP, and vector DBs (FAISS, Milvus, Chroma). • Experience building and optimizing RAG pipelines, including embedding optimization, chunking strategies, and retrieval evaluation. • Hands‑on experience with model serving using vLLM/TGI/Triton, GPU utilization optimization, and inference‑time acceleration. • Practical experience with quantization (INT4/FP8), sparse/structured pruning, and distillation. • Strong Python engineering fundamentals and familiarity with MLOps tooling (Weights & Biases, MLflow, Ray, Airflow).

Requirements

• LLM fine-tuning
• transformers
• PyTorch
• data curation
• experiment design

Qualifications

• 8-12 years software/ML engineering experience
• Experience training/fine-tuning LLMs

Preferred Technologies

• LLM fine-tuning
• transformers
• PyTorch
• data curation
• experiment design

About the company

Lattice is a worldwide community of engineers, designers, and manufacturing operations specialists in partnership with world-class sales, marketing, and support teams, who are developing programmable logic solutions.