Description

Applied Research Engineer (Evaluation) at Black Forest Labs, building and sharpening the evaluation stack every FLUX checkpoint, finetuning run, and competitor release passes through. Designs evaluation breadth across prompt adherence, editing fidelity, aesthetics, text rendering, consistency, and safety, spanning automated benchmarking, LLM-as-judge, and human panels. Evaluates the eval stack itself for stability and human agreement, and benchmarks FLUX against frontier models. Closes the loop with RL and finetuning researchers on target metrics.

Requirements

  • Meaningful contributions to evaluating generative models
  • Advanced degree (MS/PhD) or equivalent practical experience
  • Very strong Python and software engineering skills
  • Working knowledge of PyTorch and modern ML infrastructure
  • Strong grasp of statistics: sample sizes, inter-annotator agreement
  • Experience building and operating LLM-as-judge systems

Experience Level

InternEntry LevelMid-levelSeniorLeadExecutive

Benefits

Equity

💰 Net Salary Calculator

Tax class 1, no church tax
Gross Salary
€185,000/year
€15,416/month
Total Deductions
€80,657
44% effective rate
Net Salary (Take Home)
€8,695/mo
€104,343/year

Deduction Breakdown

🏛️ Income Tax€58,893
🏦 Pension Insurance€9,430
🏥 Health Insurance€6,103
🫶 Care Insurance€1,674
📋 Unemployment Insurance€1,318
⚖️ Solidarity Surcharge€3,239

🏠 Cost of Living in Freiburg

Monthly Essentials

Rent (1BR)
€1150
Groceries
€300
Transport
€75
Utilities
€220
Internet
€40

Lifestyle & Entertainment

Eating Out
€13
Gym/Month
€45
Coffee
€4
Beer (0.5L)
€4
Cinema
€12
Monthly Net Salary:€8,695
Comfortable Living:€1,836
Monthly Savings:€6,859 (79%)
💰

Strong savings potential: You could save €6,859 monthly, which is €82,308 per year.

💡 These estimates are based on average costs in Freiburg. Actual expenses vary based on lifestyle, neighborhood, and personal choices. "Comfortable living" includes rent, utilities, groceries, transport, and reasonable dining/entertainment.

Eligible for the EU Blue Card

A salary of €185,000 meets the EU Blue Card minimum of €45,300 (2026).

The EU Blue Card is a residence permit for highly qualified non-EU workers. It offers a fast track to permanent residency and allows family reunification.

Processing
4-12 weeks
Visa fee
€100
Requirements
University degree + Job offer

Also eligible: EU Blue Card (Shortage Occupation) (€41,042+)

Documents needed

Valid passport
Recognised university degree
Employment contract or binding job offer
Proof of salary meeting threshold
Health insurance coverage
Biometric passport photo
Explore visa & relocation guides

📍 Life in Freiburg

👥
Population
0.2M
⭐
Quality of Life
8.0
🇬🇧
English Friendly
7.0
💻
Tech Scene
7.0
🌍
International
7.0
🚇
Public Transport
7.0
🚴
Bikeability
10.0
🌬️
Air Quality
7.0
🌳
Green Spaces
7.0
🚗
Car Free
10.0
ℹ️

About Freiburg

  • •Diverse economy
  • •Growing opportunities
🌤️

Climate

  • •Temperate climate
  • •Moderate seasons
❄️Jan: 0°C☀️Jul: 19°C📅Avg: 10°C
☀️1800 sunshine hours/year
🛡️

Safety

  • •Generally safe
  • •Low crime rates
Overall:7.0
🏥

Healthcare

  • •Good hospitals
  • •Adequate coverage
Quality: 8.0Access: 8.0
🎭

Culture

  • •Cultural venues
  • •Local events
8.0
🎉

Nightlife

  • •Bars and venues
7.0
🏞️

Recreation

  • •Parks
  • •Sports facilities
8.0
💰

Cost of Living

  • •Moderate costs
  • •Good value
🏠 Rent (1BR center):€1150
⚡ Utilities:€220
🛒 Groceries:€300
🍽️ Dining out:€16

Salary & market

2026

Market rate for specialist roles in Deutschland · based on 90,337 roles

€6,525/mo gross · ≈ €78k / year
€4,956median €6,525€7,984
This role advertises €150,000–€220,000/yr gross.

Source: Agentur für Arbeit (Entgeltatlas), gross monthly pay for similar roles.

Freiburg-based frontier AI research lab behind the FLUX family of image-generation and editing models (FLUX.1, FLUX.1 Kontext, FLUX.2 and successors), founded in 2024 by the researchers who created latent diffusion and Stable Diffusion. BFL ships both open-weight models (84M+ Hugging Face downloads) and a commercial API, licenses its models to large platforms, and is extending into multimodal models trained jointly on images, video, audio and action. Raised $300M Series B at a $3.25B valuation in December 2025.

EU Blue Card eligible
€per year
€20kthis job posts €150k – €220k€330k

Your situation in Germany

The default for anyone single, divorced or widowed.

Only changes the church tax rate — 8% in Bavaria and Baden-Württemberg, 9% everywhere else.

Childless employees over 23 pay a higher Pflegeversicherung (care insurance) rate.