Sasvaai · Gemma
gemma-4-26b-jUnitTestGeneration
KNOWNTechnische Leistungsdaten sind für diese Variante noch nicht vollständig bestätigt.
—Kontext
—Max. Output
—Input
—Output
—Input / 1M
—Output / 1M
—Tools
—Reasoning
—Structured
Benchmarks
| Benchmark | Wert | Beleg |
|---|---|---|
| methods2test runnable test split, 332 harness-verified rows from 86 Maven projects (project-disjoint from training)Greedy compile rate (mvn test-compile succeeds with the method inserted) | 0.421687 | Quelle ↗abgerufen 2026-10-12 |
| methods2test runnable test split, 332 harness-verified rows from 86 Maven projects (project-disjoint from training)Greedy mean PIT kill fraction on the focal method's mutants | 0.206093 | Quelle ↗abgerufen 2026-10-12 |
| methods2test runnable test split, 332 harness-verified rows from 86 Maven projects (project-disjoint from training)pass@1, greedy (compiles, passes and kills a PIT mutant) | 0.246988 | Quelle ↗abgerufen 2026-10-12 |
| methods2test runnable test split, 332 harness-verified rows from 86 Maven projects (project-disjoint from training)pass@5 (greedy + 4 samples at T=0.8; any candidate compiles, passes and kills a PIT mutant) — the search metric | 0.503012 | Quelle ↗abgerufen 2026-10-12 |