What EMEP Is
EMEP is a model engineering platform. Its sole purpose is to discover, import, validate, merge, evaluate, and evolve combinations of existing open-weight language models into new models that outperform their ancestors on specified benchmarks. The platform treats models as artifacts with full provenance tracking. Every merge operation, every evaluation run, and every evolutionary step produces hashed artifacts stored in an ArtifactStore. The system never operates on opaque binaries. Every candidate model carries a complete lineage graph back to its base models. EMEP is built around these core abstractions:- ModelRegistry: catalogs all discovered, imported, validated, and evolved models
- ModelCompatibilityAnalyzer: determines whether two or more models can be merged
- MergeEngine: executes tensor-level merge operations using strategies such as Linear Merge, SLERP, TIES, DARE, and Task Arithmetic
- EvaluationEngine: runs benchmarks on the Optimization Set and Validation Set
- EvolutionEngine: drives the search for better candidates through mutation, crossover, and selection
- FitnessEngine: computes scalar or vector fitness scores from evaluation results
What EMEP Is Not
The following capabilities are explicitly outside EMEP scope. They may appear as downstream integrations or future work, but they are not part of the primary loop.The Primary Research Loop
The following diagram shows the closed loop that defines EMEP execution. No model reaches DEPLOYED status without traversing every step in this loop.The Hidden Test Set is never used by the EvolutionEngine or FitnessEngine. It is evaluated exactly once per promoted model, after the candidate has been selected. This prevents benchmark contamination and overfitting. See ADR-0003 for the architectural decision.
Model Lifecycle States
Models progress through a strict lifecycle. Each state transition is logged in the ExperimentTracker and stored in the ArtifactStore.Audience and Use Cases
Related Pages
- Vision and Scope for scientific hypothesis and commercial objectives
- Project Constitution for the 20 non-negotiable rules
- Glossary for term definitions
- Decisions for architecture decision records