Senior Architect, Model Performance and Post-Training

Job Description:

  • Develop meticulous frameworks to measure and analyze coding model performance across code generation, debugging, code completion, repository-level reasoning, and multi-step software engineering tasks
  • Develop and optimize post-training pipelines for coding models, including supervised fine-tuning (SFT), preference optimization, reinforcement learning (RL), and outcome-based or process-based reward modeling
  • Analyze benchmark results, training dynamics, failure modes, and model behaviors to find opportunities for improvement
  • Improve model performance on sophisticated coding tasks through targeted training interventions, reward design, curriculum development, and iterative error analysis
  • Build scalable, reproducible infrastructure for training experiments, evaluation pipelines, and model performance analysis
  • Collaborate with research scientists, infrastructure engineers, and product teams to turn model insights into production-ready capabilities

Requirements:

  • Bachelor's degree (or equivalent experience) in Computer Science or AI
  • 12+ years of meaningful work experience
  • Excellent programming skills in Python
  • Strong understanding of large language models, transformer architectures, and training and evaluation of generative models
  • Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design
  • Deep understanding of software engineering fundamentals, code generation, automated testing, and program correctness
  • Proven track record to lead model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines
  • Experience training or post-training state-of-the-art coding models or models designed for software engineering agents
  • Experience with execution-based rewards, verifiable rewards, reward hacking mitigation, and automated code evaluation
  • Familiarity with coding benchmarks and evaluation environments such as SWE-bench

Benefits:

  • Highly competitive salaries
  • Comprehensive benefits package
  • Equity
  • Benefits for you and your family
Back to blog

Other Jobs To Apply

Equipment Coordinator (Fulfillment Center)

Inventory Attendant

Warehouse Associate (Part-Time)

Join Amazon in Columbus as a Fulfillment Center-Warehouse Packer

Fulfillment Center-Warehouse(Gig)-Fremont

Lead Ramp Agent — Ground Ops Leader (DailyPay)

Flexible Part-Time Fulfillment Center Order Picker in Phoenix

Salt Lake City-based 3rd Shift Weekend Operations Driver Opening

Part-Time Job at Amazon:Fulfillment Center

$21.25/hr Inventory Control Associate-Grand Rapids(PT)

Part-Time Fulfillment Center Logistics Associate(Austin)

Amazon Delivery Driver

Amazon Step Van Driver

2025 Field Engineering Trainee (Various Locations)

Now Hiring San Bernardino:Fulfillment Center-Outbound Ship Dock

Virginia Beach Hiring:Part-Time Fulfillment Center-Package Sorter

Kitchen Helper/Dishwasher (Full-Time)

[Remote] Member Contact Center Sales Associates (FT & PT)

Field Service Professional - Plainfield, NJ

Call Center Specialist [Work From Home - Night Shift - Full Time]

Remote BDR – Dental SaaS Outreach

Manager, Design Engineering - Optical

Customer Service Agent (PT or FT)

Remote Customer Service Contractor for Fortune 500 Companies

Join Today: Online Jobs for Teens: Content Creator & Virtual

Remote Data Entry Representative – Flexible Home‑Based Role for Male & Female Candidates, Customer Support & Survey Assistance – $20‑$25 per Hour

Medical Transcription Training and Work-From-Home Opportunity

Online Job for Student & Fresher (Data entry) – Job ID- 505 Job ID- 2688

Entry-Level Remote Chat Moderator – Flexible Part‑Time/Full‑Time, $25–$35/hr, No Phone Calls, Join arenaflex’s Growing Online Community

Teen Editorial Team Member for Girl-led International Magazine

Remote Coder II — Medical Coding & Denials Specialist

[Remote] Pharmacy Tech/CSR

Help Desk Specialist

Technical Support Engineer 2

YouTube Content Moderator $16/Hour (reputed company)

Work From Home

Apple Home Jobs: Stelle als Mitarbeiter von zu Hause aus

Watch Netflix (Tagger): $12-$46

Medical Review Nurse (RN)- Remote

National Account Executive/National Account Executive-Senior

Returns Processing Associate(Reverse Logistics)Vacancy in New York

Part-Time Job at Amazon:Fulfillment Center

Biller I at Monument Health Inc.: 100% Remote (FL, GA, KY, OH, SC, TN, TX, WY, SD)

Paid Focus Group Panelist - No Experience, Work From Home

Remote Part-Time and Full-Time Positions Available

Urgent Part-Time:Fulfillment Center-Order Picker(Knoxville)

Online Jobs That Are Legit - Trusted Live Chat Agent Roles, $25-$35/hr

Entry‑Level Remote Chat Support Specialist – Flexible Part‑Time Role with No Experience Required, Earn $35/hr, Grow Your Career at arenaflex

Remote Administrative Assistant-Behavioural Health

Benefits Account Specialist (Fully Remote)