Tasks
VEP-bench publishes transparent development tasks with exact model prompts, complete responses, and deterministic scores.
OpenSplice SNV
Predict signed changes in exon inclusion for quantile-balanced SNV panels in complete source-derived three-exon minigene cassettes.
- 20 exon-level questions from 20 distinct genes, with 50 SNVs each
- Complete cassette sequence, exact segment intervals, and HEK293T assay context
- Mean within-exon Spearman correlation, with Pearson and output-validity diagnostics
satMutMPRA
Predict signed reporter-activity effects for panels sampled across the measured effect distribution of 16 regulatory elements.
- 16 element-level questions with 50 variants each
- Full assayed element sequence, assay context, and compact VCF input
- Mean within-element Spearman correlation, with Pearson and output-validity diagnostics
Saturation genome editing
Predict continuous functional damage for panels sampled from endogenous-locus saturation genome editing assays.
- One eligible exon-level question per gene with 50 assayed SNVs
- Gene, assay mechanism, and exon sequence with exact 100 bp flanks
- Mean within-gene Spearman correlation, with Pearson and output-validity diagnostics