Research Engineer, Large Language Models
At Immiland Canada Inc. · Across Canada
- Engineering
- Full-time
Early applicant Posted 23 hours ago. Radar emails jobs like this within hours of us finding them. The free weekly email can take up to a week.
See how well you match Match me reads your CV and picks the jobs that suit you best.
Get jobs like this within hours Radar emails you new jobs open to you within hours of us finding them, before most people see them.
Where you can work from
Open to Canada
“Across Canada”
From the location.
Report a mistake
- Posted
- 23 hours ago
- First seen by us
- 18 November 2026
- Last checked
- 15 hours ago
Job description
From Immiland Canada Inc.’s job post, as they wrote it.
Key Responsibilities – What You'll Do
Design and run large-scale pre-training and fine-tuning experiments, from small ablations to full training runs.
Study scaling laws to choose model size, data mix, and hyperparameters under a fixed compute budget.
Improve training efficiency through parallelism strategies (data, tensor, pipeline, FSDP), mixed precision, and custom CUDA or Triton kernels.
Diagnose and fix training instabilities such as loss spikes, divergence, and hardware failures.
Read the full description
Build and improve data pipelines, including filtering, deduplication, quality scoring, and dataset mixing.
Implement ideas from recent research papers and test whether they hold at scale.
Build evaluations that measure real model capabilities and track results rigorously.
Work closely with the alignment, infrastructure, and product teams, and share findings through clear write-ups.
Required Qualifications – What We're Looking For
3+ years of hands-on experience training deep learning models, or a PhD in a related field (computer science, mathematics, or physics).
Strong Python skills and deep expertise in PyTorch or JAX.
Practical experience with Transformer architectures, including attention, tokenization, embeddings, and positional encodings.
Experience with distributed training on multi-node GPU clusters (FSDP, DeepSpeed, Megatron-LM, or similar).
Solid foundations in linear algebra, probability, statistics, and optimization.
Ability to read a research paper, implement it from scratch, and judge whether it works.
Rigorous experimental habits, including clean baselines, ablations, reproducible results, and experiment tracking.
Clear written and verbal communication skills, and comfort working in a fast-moving, ambiguous environment.
Preferred Qualifications – Nice to Have
Publications at top venues (NeurIPS, ICML, ICLR, ACL) or well-known open-source contributions.
Experience pre-training an LLM from scratch, at any scale.
Post-training experience, including supervised fine-tuning, RLHF, DPO, or other preference-optimization methods.
GPU performance work involving CUDA, Triton, FlashAttention-style kernels, and profiling.
Experience with efficient inference, including quantization, distillation, and optimized model serving.
Cluster and infrastructure experience with Slurm, Kubernetes, or cloud GPU platforms.
Large-scale data engineering experience (Spark, Ray, dataset curation for multilingual or domain-specific corpora).
Research Engineer, Large Language ModelsImmiland Canada Inc.
Apply on Immiland Canada Inc. (opens in a new tab)Get jobs like this by email
Once a week, we email the new remote jobs open where you live, each with the line that proves it. Every email has a one-click unsubscribe.