CDS-bench

CDS-bench: Task definitions

84 tasks total: 65 individual task types and 19 composition tasks.

Proposal for evaluating procedural reasoning and constrained design on coding DNA sequences. This document specifies task types, easy and hard prompt templates, scoring rules, and composition tasks.

Draft proposal · Version 0.3 · 26 October 2026

Six examples from the 84 tasks

Four individual tasks and two composition tasks. Each starts from supplied coding DNA and leads to one required answer. For RNA and protein tasks, input preparation is labeled separately. Task titles link to the full definitions.

1 · Individual task

Translate DNA to protein

CDSATG GCT TAA
Read consecutive codons · NCBI code 11
ATGM
GCTA
TAASTOP
Final answer · scalar
MA

The first in-frame stop ends translation and is omitted from the answer.

2 · Individual task

Disrupt a specified local hairpin

CDS · RNA view uses T → UATG GGA AAA TCC TAA

Expose/edit bases 10–11 only; preserve MGKS.

Supplied RNA stemSupplied RNA hairpin with three canonical stem pairsCDS ATG GGA AAA TCC TAA encodes MGKS. Coding RNA AUGGGAAAAUCCUAA has supplied pairs 4–12 G–C, 5–11 G–C, and 6–10 A–U. Positions 7–9 are an AAA loop. The target interval is RNA bases 10–11. AUG GGA CCU AAA UAA 456121110 3 canonical contacts
After TCC → AGCSynonymous rewrite breaks two of three supplied stem pairsEdited CDS ATG GGA AAA AGC TAA still encodes MGKS. In its coding RNA, pair 4–12 stays G–C, pair 5–11 becomes G–G, and pair 6–10 becomes A–A. The two pairs touching RNA interval 10–11 are broken. AUG GGA CGA AAA UAA 456121110 1 canonical contact
Final answer · scalar
ATGGGAAAAAGCTAA

Two targeted stem contacts break; protein MGKS remains unchanged.

3 · Individual task

Digest with trypsin rules

CDSATG GCT AAA CGT CCT GCT AAA TAA

Input preparation: translate to MAKRPAK.

Cut after K/R, except before P
1M2A3K4R5P6A7K

K3 │ cut   ·   R4–P5 stays intact

Final answer · json
[
 {"start":1,"end":3,"peptide":"MAK"},
 {"start":4,"end":7,"peptide":"RPAK"}
]

Return both fragments in protein order, with inclusive residue coordinates.

4 · Individual task

Remove specified DNA motifs

CDSATG GAA TTC TGA

Remove GAATTC; preserve protein MEF and fixed terminal codons.

Search synonymous encodings
Phenylalanine codonTTC TTT
Amino acidF F
Rewritten CDSATG GAA TTT TGA

GAATTC absent   ·   MEF unchanged

Final answer · scalar
ATGGAATTTTGA

Choose the first valid DNA string in A<C<G<T order; a valid rewrite alone is insufficient.

5 · Composition task

From CDS panel to a diagnostic peptide

Target CDS
Comparison CDS
ATG GCT AAA GCT GGT AAA TAAATG GCT AAA GGT GCT AAA TAA
Translate both
MAKAGKMAKGAK
Complete trypsin digestion
MAK │ AGKMAK │ GAK
Discard shared peptides; require length 3
Final answer · scalar
AGK

MAK is shared. AGK occurs only in the target digest; select by length, then alphabetical order.

6 · Composition task

From specified RNA edits to protein

CDSATG CAA GGT TAA
Transcribe
Coding RNAAUG CAA GGU UAA
Supplied edit: position 4, C → U
Edited RNAAUG UAA GGU UAA
Translate from the original start
Final answer · scalar
M

The new UAA stops translation before GGU. The unedited CDS would encode MQG.

Biological scope and supplied inputs

The starting sequence is a complete, spliced CDS with its coding strand and translation start supplied. Tasks do not require gene discovery, splice-site identification, or recognition of a protein family from learned sequence patterns.

What an instance can supply

  • A CDS, or a clearly identified panel of CDSs.
  • A requested edit, motif, guide, pairing map, or coding module.
  • Custom score tables, allowed edits, and numerical bounds.

What the benchmark does not ask for

  • Gene discovery, arbitrary genomic splicing, or isoform prediction.
  • Unannotated biological function, folding, expression, or guide efficacy.
  • Noncoding-RNA maturation or whole-transcript processing.

RNA and protein inputs are obtained by transcribing or translating the supplied CDS. Composition tasks explicitly combine the named operations and specify the final answer.

Shared sequence conventions

5′→3′ coding DNA; bases may be separated by spaces. All coordinates are 1-based inclusive unless a field explicitly says otherwise. Ordinary translation uses NCBI code 11. First in-frame stop terminates; no stop character appears in the protein.

Synonymous rewrites keep length, first codon, terminal stop, and translated protein fixed. Alternative codes can be separate future rule sets; v0.3 does not silently substitute one.

Easy and hard variants

Each instance has an easy prompt and a hard prompt. They differ only in the biological reference information supplied. The sequence, edits, constraints, correct answer, and scoring rules are the same in both. When the task rules already supply everything needed, the two prompts are identical.

Example: Calculate mean hydropathy (protein.mean_hydropathy). Both variants ask for the average hydropathy of the protein encoded by the same CDS. These illustrative excerpts abbreviate the reference tables and omit the shared answer-format instructions.

variant = easy

Reference supplied

The prompt supplies translation rules, all 64 codon assignments, and all 20 amino-acid hydropathy scores.

REFERENCE
Read the CDS in groups of three bases from base 1. The annotated initiator gives M. End at the first in-frame stop; omit it from the protein.

NCBI code 11 codons:
ATG=M, GCT=A, TAA=STOP, … [64 entries]

Kyte–Doolittle residue scores:
A=1.8, M=1.9, V=4.2, … [20 entries]

TASK
Translate the CDS and average the scores of its amino acids. Return one number with 4 decimal places.

cds: {{cds}}
variant = hard

Reference knowledge assumed

The model must know the codon assignments, initiator and stop rules, and numerical residue scores implied by the two reference names.

Translate this CDS using NCBI genetic code 11. Return its whole-protein mean Kyte–Doolittle hydropathy as one number with 4 decimal places.

cds: {{cds}}

A custom pairing-score table, edit budget, allowed mutation set, or host-specific codon weights must remain supplied in both variants. Those are instance data. Hard prompts should never require guessing an unpublished convention.

A hard prompt can name an established biological reference and expect the model to supply the underlying facts. For example, “use the Kyte–Doolittle scale” requires knowing the hydropathy score for each amino acid. “Translate using NCBI genetic code 11” requires knowing the codon-to-amino-acid assignments, stop codons, and how annotated initiator codons are translated. Easy prompts provide these tables and rules explicitly; hard prompts test whether the model already knows them.

Task schema and scoring

Each task defines its inputs, answer format, and one canonical answer. An instance supplies the actual sequences and conditions. All 84 tasks use the same scorer.

Individual task type
task_type names one of 65 individual operations. For example, cds.translate asks for the protein encoded by a CDS.
Composition task type
composition_type names one of 19 tasks that combine individual operations. For example, pipeline.motif_to_dna translates a CDS, finds a peptide motif, then maps its location back to DNA. Use this field instead of task_type for a composition task.
Variant
variant is easy or hard. It changes biological reference support; both variants share the answer format and correct answer.
Answer format
output_format is scalar for a direct value or simple list, or json for maps and records. output_rules defines every value’s meaning, ordering, precision, and failure form. Prompts show a compact output structure with typed placeholders. The full output_schema remains in the task metadata for automated validation.
Unique reference
objective and selection_rule determine one reference answer, including all tie-breaks. Reference solvers verify constraints, optimality, and any claim of impossibility before evaluation.
Scorer
scorer = exact_match for individual and composition tasks alike. It compares the complete parsed answer with the verified reference.

Each identifier has the form prefix.operation. The prefix indicates the task family or how component tasks are combined. These summaries explain the prefixes; the individual task catalogue and composition catalogue define the questions.

task_type · individual task families
Individual task prefix meanings
PrefixMeaning
dnaOperations on DNA bases, strand orientation, transcription, and DNA-pattern matches.
cdsInterpret complete coding sequences, including translation, validity, and equivalence of encoded proteins.
coordsConvert positions between DNA bases, aligned codons, and protein residues.
variantApply specified DNA edits or determine their effects on the reading frame and protein product.
ambiguityResolve possible codon meanings when observed DNA contains uncertain bases represented by IUPAC symbols.
statsMeasure nucleotide composition and codon usage, across a whole CDS or within local windows.
proteinAnalyze the protein encoded by a CDS, including sequence patterns, physical properties, and cleavage products.
rnaAnalyze CDS-derived coding RNA, including edits, translation, complementarity, secondary structure, and cleavage products.
designRewrite coding DNA under specified constraints while preserving its encoded protein.
constructCreate or process engineered coding constructs, including protein changes, fused modules, tags, deletions, and cleavage products.
libraryAnalyze or design mixtures of codons represented by IUPAC symbols. Here ambiguity specifies a designed mixture, rather than uncertainty about one observed sequence.
assaySelect CDS-based primers or probes under stated sequence-matching, specificity, and uniqueness rules.
overlapAnalyze or modify DNA read in two explicitly annotated coding windows, accounting for both encoded products.
composition_type · pipeline and joint
Composition prefix meanings
PrefixMeaning
pipelineSeveral operations connected by their results. An earlier step supplies the sequence, annotation, or measurement used by later steps. Workflows can branch and can include design followed by verification.

Example: Edit DNA → translate → digest.

jointOne design evaluated against several requirements at once. The same candidate CDS must meet every constraint and any stated optimization objective; solving the component requirements separately is insufficient.

Example: Remove restriction sites while enforcing GC bounds.

Evaluating a response

  1. Read and validate. The answer starts on the line after a standalone Final answer: marker and continues to the end of the response. JSON may span multiple lines. Parse the declared format and validate its fields and types against the task metadata.
  2. Compare the contents. Apply only the declared formatting normalizations. Compare JSON objects by their keys and values, and lists in their required order. Every requested field must match, including counts and rounded numbers.

Score 1 only when both steps pass; otherwise 0. Report format compliance separately from answer accuracy. Composition tasks receive one score for the complete answer.

For example, the codon-library task expects:

{"status":"ok","codon":"GAK","residue_counts":{"D":1,"E":1}}

Reordering object keys is harmless. Changing a count, omitting a field, or choosing a different codon fails.

Shared answer conventions

An optional explanation precedes the marker. The answer itself begins on the next line and is the final part of the response. JSON is one complete object or array; indentation and line breaks are optional. Ignore surrounding whitespace and declared sequence spacing. Object-key order and equivalent numeric spellings such as 1.8500 and 1.85 do not matter. Preserve list order, multiplicities, identifiers, and values. Malformed JSON, duplicate keys, unexpected fields, and changed sequences fail validation.

Round once at the task’s specified precision, with exact halfway cases rounded away from zero; rounded negative zero becomes zero. Use declared reference constants and unrounded intermediate values. CAI optimization on a fixed-length CDS compares exact products of supplied decimal weights before taking roots or rounding.

Empty lists are []. Empty standalone sequences use EMPTY_SEQUENCE; empty sequences inside JSON use "". NONE, INVALID, and IMPOSSIBLE have the meanings defined by their tasks. JSON tasks specify their exact failure objects and use null where required.

Individual tasks (65)

Each row states what is given and what the model must do. Select a row for a task outline followed by easy and hard example prompts with complete inputs and computed answers. Format and scoring details follow the examples. Data provenance appears below each expected answer. Most examples reuse the bacterial CDS documented in Example data sources; engineered changes are identified per example. Expand Template for the unfilled version. The copy icon copies its code block verbatim. Search or filter the table to compare related tasks.

Example data sources

Most examples reuse the complete Escherichia coli K-12 MG1655 trpL CDS, a 45-base gene encoding a 14-residue leader peptide. Source: NCBI Gene 945856; locus b1265; nucleotide accession NC_000913.3, bases 1,323,038–1,323,082 on the minus strand; protein accession NP_415781.1. Retrieved 26 October 2026.

Native CDS, coding strand 5′→3′
ATG AAA GCA ATT TTC GTA CTG AAA GGT TGG TGG CGC ACT TCC TGA
Protein: MKAIFVLKGWWRTS

Engineered minigene: native codons 1–7 + native stop
ATG AAA GCA ATT TTC GTA CTG TGA
Protein: MKAIFVL

The truncated minigene keeps exact synonymous searches small enough to verify exhaustively. Each example identifies any further mutations, ambiguous codons, fusion modules, or comparison variants in its Data provenance note. Supplied RNA contacts and edits are exercises, not claims about a natural trpL structure or editing event. Codon weights are illustrative instance data, not measured expression estimates.

/
01 /

CDS interpretation

Orientation, translation, coordinates, and validity.

6 tasks
sequence task definitions
TaskDescriptionExpand details
Reverse-complement a CDSdna.reverse_complementGiven a CDS written in one direction, write the complementary DNA strand in its own 5′→3′ direction.
Make the coding RNAdna.transcribeGiven coding-strand DNA, produce its coding RNA by replacing T with U while retaining the order of the bases.
Translate DNA to proteincds.translateGiven a CDS and an identified genetic code, return the protein it encodes, ending at the first in-frame stop.
Validate a complete CDScds.validateGiven a candidate complete CDS, identify specific problems with its length, initiation codon, or stop codons.
Map a nucleotide to its codoncoords.nt_to_codonGiven a nucleotide position in a CDS, identify its codon and its position within that codon.
Map residues back to DNAcoords.aa_to_ntGiven a range of protein residues, locate the DNA bases encoding that range in the original CDS.
02 /

Sequence variation

Edits, ambiguity, and equivalence.

6 tasks
variation task definitions
TaskDescriptionExpand details
Apply a DNA edit scriptvariant.applyGiven a CDS and a list of DNA replacements, insertions, or deletions, return the edited DNA sequence.
Classify a substitution effectvariant.protein_effectGiven an internal DNA substitution, determine whether it preserves the protein, changes residues, or introduces an early stop.
Determine frame preservationvariant.frame_statusGiven several insertions and deletions, track whether the downstream reading frame is shifted or restored after each edit.
Compare encoded proteinscds.protein_equivalenceGiven two CDSs, determine whether their complete translated protein sequences are identical.
Resolve an ambiguous codonambiguity.codon_setGiven an internal codon containing uncertain-base symbols, list every amino acid or stop it could encode.
Assess an ambiguous stopambiguity.stop_certaintyGiven an ambiguous internal codon, decide whether a stop is impossible, possible, or unavoidable.
03 /

Sequence statistics

Separate, reproducible counts and numerical objectives.

6 tasks
measure task definitions
TaskDescriptionExpand details
Count sense codonsstats.codon_countsGiven a CDS, count how often each DNA codon occurs in its translated region.
Calculate total GCstats.gc_fractionGiven a CDS, calculate the fraction of all its DNA bases that are G or C.
Calculate third-position GCstats.gc3_fractionGiven a CDS, calculate GC content using only the third base of each sense codon.
Locate GC-window violationsstats.gc_windowsGiven a window length and an allowed GC range, identify local parts of a CDS whose composition falls outside that range.
Calculate codon adaptation indexstats.caiGiven a CDS and codon-preference weights, calculate a codon adaptation index from those weights.
Find nucleotide patternsdna.motif_positionsGiven a DNA pattern, locate every matching interval in the CDS on the requested strand or strands.
04 /

Protein analysis

Patterns, properties, and peptide readouts derived from CDS.

9 tasks
protein task definitions
TaskDescriptionExpand details
Find a supplied peptide patternprotein.motif_positionsTranslate the CDS and find every protein segment matching a supplied amino-acid pattern.
Locate N-glycosylation sequonsprotein.nglyco_sequonsTranslate the CDS and identify protein positions matching the conventional N-glycosylation sequon pattern.
Count amino acidsprotein.residue_countsTranslate a CDS and count the number of each amino acid in its protein product.
Calculate peptide massprotein.monoisotopic_massTranslate a CDS and calculate the neutral monoisotopic mass of its unmodified protein product.
Calculate mean hydropathyprotein.mean_hydropathyTranslate a CDS and average the encoded residues’ scores on the Kyte–Doolittle hydropathy scale.
Digest with trypsin rulesprotein.trypsin_digestTranslate the CDS and list the peptide fragments produced by a specified complete trypsin-cleavage model.
Select a distinguishing peptideprotein.diagnostic_peptideFrom a target CDS and comparison CDSs, choose a digest peptide that occurs only in the target’s protein.
Calculate model charge at a pHprotein.charge_at_phTranslate a CDS and estimate its protein’s net charge at a specified pH using supplied ionization parameters.
Calculate the isoelectric point (pI)protein.isoelectric_pointTranslate a CDS, then find the pH where the protein’s calculated positive and negative charges cancel.
05 /

Coding RNA analysis

Editing, pairing, cleavage, and sequence targeting.

9 tasks
rna task definitions
TaskDescriptionExpand details
Apply specified RNA editsrna.apply_editsTranscribe a CDS, apply explicitly listed changes to its coding RNA, and return the edited RNA sequence.
Translate coding RNArna.translateTranslate coding RNA derived from a CDS, including RNA that has undergone supplied edits.
Check specified RNA pairsrna.pair_compatibilityGiven a CDS-derived RNA and specified paired positions, identify pairs whose bases cannot form an allowed pair.
Decode a pairing maprna.dotbracket_to_pairsConvert a supplied dot-bracket annotation for coding RNA into explicit pairs of nucleotide positions.
Digest coding RNA with RNase T1 rulesrna.t1_digestTranscribe a CDS and split its RNA into fragments using an RNase T1 rule, optionally restricted by a supplied pairing map.
Match an RNA guiderna.guide_hitsGiven an RNA guide and a CDS-derived RNA, find target intervals complementary to the guide within an allowed mismatch count.
Count coding-RNA patternsrna.motif_countsTranscribe the CDS and count occurrences of specified short RNA sequences, including overlapping occurrences.
Score a specified RNA structurerna.structure_scoreGiven a coding RNA, a pairing map, and numerical pair scores, calculate the score of that particular structure.
Find a maximum-pair RNA foldrna.max_pair_foldFind a noncrossing arrangement of complementary base pairs in a CDS-derived RNA, with as many pairs as possible.
06 /

Synonymous redesign

Synonymous design across DNA and RNA constraints.

15 tasks
redesign task definitions
TaskDescriptionExpand details
Rewrite with a specified number of DNA changesdesign.synonymous_distanceRewrite a CDS to encode the same protein while changing a requested number of DNA positions.
Rewrite using permitted codonsdesign.codon_allowlistReplace internal codons with synonymous alternatives drawn only from a supplied permitted list.
Optimize supplied codon preferencesdesign.codon_preferenceChoose synonymous internal codons to maximize a supplied codon-preference score while retaining the protein.
Match positional codon-preference rangesdesign.codon_profileRewrite internal codons so each position meets its own supplied codon-preference range, while preserving the protein.
Control local GC by recodingdesign.gc_windowsSynonymously rewrite a CDS so every local DNA window has GC content within a supplied range.
Remove specified DNA motifsdesign.remove_dna_motifsRemove every occurrence of specified DNA patterns using synonymous changes, preserving the encoded protein.
Introduce a DNA recognition sitedesign.insert_dna_motifCreate a specified DNA recognition sequence at a requested CDS position through synonymous changes.
Break homopolymers and repeatsdesign.break_repeatsUse synonymous substitutions to remove overly long runs of one base and excessive repeated DNA substrings.
Control coding-RNA motifsdesign.rna_motif_controlSynonymously rewrite DNA so its coding RNA contains specified numbers of supplied RNA patterns.
Control RNA dinucleotide countsdesign.dinucleotide_countsSynonymously rewrite a CDS to meet requested counts of adjacent RNA-base pairs such as CG or UA.
Repair pairing synonymouslydesign.pairing_repairUse synonymous CDS changes to make specified positions in its coding RNA form allowed base pairs.
Optimize a fixed RNA pairing scoredesign.structure_scoreChoose synonymous codons to maximize or minimize a supplied score for a fixed coding-RNA pairing map.
Disrupt a specified local hairpindesign.expose_rna_windowSynonymously change a CDS to break specified RNA stem pairs that involve a selected region.
Create a guide-escape controldesign.guide_escapeCreate a synonymous CDS whose coding RNA no longer closely matches a supplied RNA guide.
Build a controlled synonymous paneldesign.variant_panelGenerate several synonymous CDSs with different requested RNA CG counts but the same total number of G/C bases.
07 /

Protein and construct design

Mutations, libraries, tags, and coding modules.

9 tasks
construct task definitions
TaskDescriptionExpand details
Encode a requested amino-acid substitutionconstruct.minimal_aa_editChange one requested protein residue by replacing its DNA codon with as few base substitutions as possible.
Remove a protein motifconstruct.remove_peptide_motifModify permitted protein residues to remove a specified peptide pattern, then return DNA encoding the modified product.
Build a tagged protein CDSconstruct.tag_fusionAssemble a CDS encoding a supplied tag and linker at a specified end of the original protein.
Derive TEV-cleaved productsconstruct.tev_productsTranslate a constructed CDS and determine the protein fragments remaining after the specified TEV cleavage.
Enumerate a degenerate codon librarylibrary.codon_productsExpand an ambiguous internal DNA codon and count how many concrete codons encode each amino acid or stop.
Design a focused degenerate codonlibrary.design_codonChoose an ambiguous DNA codon that covers requested amino acids without encoding stops, while limiting unwanted alternatives.
Delete a protein intervalconstruct.inframe_deletionRemove a specified range of protein residues by deleting exactly the corresponding complete DNA codons.
Join coding modulesconstruct.join_modulesJoin two supplied CDSs with a coding linker to make one continuous fusion-protein CDS.
Design an RNA-editing-dependent productconstruct.edit_aware_encodingDesign a synonymous CDS whose coding RNA produces a requested different protein after explicitly specified RNA edits.
08 /

Assay design

CDS-targeted primers and discriminating probe panels.

3 tasks
assay task definitions
TaskDescriptionExpand details
Choose CDS-internal PCR primersassay.primer_pairChoose forward and reverse DNA primers for a specified interval entirely within a supplied CDS.
Select a CDS-specific RNA probeassay.select_rna_probeChoose a complementary RNA probe that matches the target CDS’s RNA but differs sufficiently from every supplied background RNA.
Distinguish CDSs with a probe panelassay.min_probe_panelSelect the smallest subset of supplied RNA probes whose match patterns distinguish every CDS in a supplied collection.
09 /

Overlapping reading frames

Explicitly annotated overlaps and coupled constraints.

2 tasks
overlap task definitions
TaskDescriptionExpand details
Evaluate a change in two framesoverlap.compare_productsGiven two annotated coding windows and a DNA substitution, compare the before-and-after peptide in each window.
Change one frame, preserve the otheroverlap.constrained_editChange DNA so one annotated coding window encodes a requested peptide while the overlapping window’s peptide stays unchanged.

Composition tasks (19)

Each composition task lists the tasks it combines and explains how one task’s output is used by another. Some run tasks in sequence, some use the same result for several calculations, and others require one sequence to satisfy several conditions at once.

Composition types

Pipeline: CDS → protein → peptide intervals → DNA intervals.
Branch: one protein → mass, charge, and composition.
Joint: one CDS must preserve protein, remove sites, and meet GC bounds simultaneously.

For a joint design, completing one rewrite and then another can undo earlier constraints. Every condition must be checked on the same final sequence.

Select a row to read the sequence of operations, an example, and the final success conditions. The component-task links open the corresponding task explanations. Each composition also includes paired prompt templates.
Composition tasks
TaskDescriptionExpand details
From peptide motif to encoding DNApipeline.motif_to_dnaFind a supplied pattern in the CDS’s encoded protein, then report the DNA intervals encoding those protein matches.
From CDS to defined protein measurementspipeline.protein_propertiesTranslate one CDS and calculate a fixed set of measurements from that same encoded protein.
From CDS panel to a diagnostic peptidepipeline.diagnostic_digestFrom target and comparison CDSs, identify a protein-digest peptide that distinguishes the target from the supplied panel.
From DNA edits to changed peptide readoutspipeline.variant_peptidesApply DNA edits and determine which tryptic peptide sequences are lost or gained relative to the original CDS.
From specified RNA edits to proteinpipeline.rna_edit_translationTranscribe a CDS, apply supplied RNA edits, and translate the edited RNA to obtain the final protein.
From specified RNA edits to RNA fragmentspipeline.rna_edit_digestApply specified edits to a CDS-derived RNA and determine the RNA fragments produced afterward by RNase T1.
From a pairing annotation to eligible cutspipeline.structure_gated_digestUse a supplied RNA-structure annotation to decide which RNase T1 cuts are allowed in coding RNA.
Remove cloning sites while controlling GCjoint.clone_ready_cdsFind one synonymous CDS that removes unwanted DNA sites and satisfies every supplied local GC requirement.
Repair RNA pairs and verify the proteinpipeline.repair_and_verifyRepair specified coding-RNA pairs through synonymous DNA edits, then verify both pairing and protein preservation.
Balance an RNA structural constraint and codon preferencejoint.structure_and_codonsWithin a changed-base budget, preserve the protein and meet an RNA pair-score threshold while maximizing codon preference.
Choose an RNA probe and a matched escape controlpipeline.target_and_escapeChoose a target-specific RNA probe, then make a synonymous version of the target that no longer closely matches that same probe.
Encode a protein change and remove cloning sitesjoint.protein_edit_and_cloningIntroduce one requested amino-acid change and remove forbidden DNA sites with the fewest total base substitutions.
Build a tagged construct, cleave it, measure productspipeline.tag_cleave_massAssemble a tagged CDS, translate it, simulate TEV cleavage, and calculate the mass of each resulting fragment.
Design a codon library and verify its coveragepipeline.library_and_verifyDesign a degenerate codon for requested amino acids, then expand it to verify coverage and absence of stops.
Assemble coding modules and locate junction motifspipeline.fusion_junctionJoin two CDS modules, find peptide-pattern matches in the fusion product, and map those matches to the fused DNA.
Design and verify an RNA-editing-dependent productpipeline.edit_dependent_productDesign a CDS that preserves the original protein before RNA editing and gives a specified protein after the supplied edits.
Edit one frame and audit both productspipeline.overlap_edit_verifyDesign a change for one annotated coding window while preserving the overlapping product, then report both before-and-after peptides.
Build and audit a controlled synonymous panelpipeline.controlled_panelGenerate matched synonymous CDSs with different CG targets, then report their measured RNA CG counts and DNA GC fractions.
From CDS collection to a minimal measurement panelpipeline.rna_probe_panelFrom a collection of CDSs, choose the smallest supplied RNA-probe set giving each coding RNA a distinct match signature.

Reference material

These definitions and lookup tables supply the biological information used by easy prompts. Each task links only to the entries it needs. Instance data and required benchmark conventions are given in both prompt variants.

DNA reverse complement

DNA complementary bases are A↔T and C↔G. Complement each base, then reverse the sequence to write the opposite strand 5′→3′.

Coding DNA to RNA

The supplied DNA is the coding strand, written 5′→3′. Copy its bases in the same order, replacing each T with U to obtain the coding RNA.

Codon length

A codon is a group of three consecutive nucleotides.

Residue-to-codon correspondence

Each amino-acid residue is encoded by one consecutive codon. The initiating residue is residue 1; a stop codon encodes no residue.

NCBI genetic code 11: internal DNA codons

Each internal DNA codon is an aligned group of three bases. The table gives its one-letter amino-acid assignment; STOP marks a stop signal.

TTT=F  TTC=F  TTA=L  TTG=L
TCT=S  TCC=S  TCA=S  TCG=S
TAT=Y  TAC=Y  TAA=STOP  TAG=STOP
TGT=C  TGC=C  TGA=STOP  TGG=W
CTT=L  CTC=L  CTA=L  CTG=L
CCT=P  CCC=P  CCA=P  CCG=P
CAT=H  CAC=H  CAA=Q  CAG=Q
CGT=R  CGC=R  CGA=R  CGG=R
ATT=I  ATC=I  ATA=I  ATG=M
ACT=T  ACC=T  ACA=T  ACG=T
AAT=N  AAC=N  AAA=K  AAG=K
AGT=S  AGC=S  AGA=R  AGG=R
GTT=V  GTC=V  GTA=V  GTG=V
GCT=A  GCC=A  GCA=A  GCG=A
GAT=D  GAC=D  GAA=E  GAG=E
GGT=G  GGC=G  GGA=G  GGG=G
Annotated CDS initiation

The annotated first codon of an intact CDS encodes initiating methionine (M), even when its internal-codon assignment is different.

NCBI genetic code 11: allowed DNA starts

The allowed annotated initiation codons are TTG, CTG, ATT, ATC, ATA, ATG, and GTG.

NCBI genetic code 11: DNA stop codons

The DNA stop codons are TAA, TAG, and TGA. All other unambiguous DNA codons are sense codons.

NCBI genetic code 11: internal RNA codons

Each internal RNA codon is an aligned group of three bases. The table gives its one-letter amino-acid assignment; STOP marks a stop signal.

UUU=F  UUC=F  UUA=L  UUG=L
UCU=S  UCC=S  UCA=S  UCG=S
UAU=Y  UAC=Y  UAA=STOP  UAG=STOP
UGU=C  UGC=C  UGA=STOP  UGG=W
CUU=L  CUC=L  CUA=L  CUG=L
CCU=P  CCC=P  CCA=P  CCG=P
CAU=H  CAC=H  CAA=Q  CAG=Q
CGU=R  CGC=R  CGA=R  CGG=R
AUU=I  AUC=I  AUA=I  AUG=M
ACU=T  ACC=T  ACA=T  ACG=T
AAU=N  AAC=N  AAA=K  AAG=K
AGU=S  AGC=S  AGA=R  AGG=R
GUU=V  GUC=V  GUA=V  GUG=V
GCU=A  GCC=A  GCA=A  GCG=A
GAU=D  GAC=D  GAA=E  GAG=E
GGU=G  GGC=G  GGA=G  GGG=G
Initiation after DNA editing

At the first DNA codon, TTG, CTG, ATT, ATC, ATA, ATG, and GTG encode initiating M under NCBI genetic code 11. If the first edited codon is not one of these initiators, use its ordinary internal assignment.

Initiation of coding RNA

At the first RNA codon, UUG, CUG, AUU, AUC, AUA, AUG, and GUG encode initiating M under NCBI genetic code 11. If that first codon is not an allowed initiator, use its ordinary internal assignment.

IUPAC DNA base sets

An IUPAC symbol permits any base in its listed set. Choices at different positions are independent.

A=A  C=C  G=G  T=T
R=AG  Y=CT  S=CG  W=AT  K=GT  M=AC
B=CGT  D=AGT  H=ACT  V=ACG  N=ACGT
Synonymous codons

Synonymous codons encode the same amino acid. Replacing a codon with a synonymous codon preserves that residue in the protein.

GC fraction

GC fraction is the number of G and C bases divided by the number of bases in the sequence being measured.

Codon adaptation index

For n included codons with supplied positive weights w₁,…,wₙ, CAI = (w₁ × … × wₙ)^(1/n), the geometric mean of those weights.

Canonical RNA base pairs

The canonical Watson–Crick RNA pairs are A–U, U–A, C–G, and G–C.

RNA reverse complement

RNA complementary bases are A↔U and C↔G. Complement each base, then reverse the sequence to write its complementary partner 5′→3′.

Dot-bracket notation

Matching parentheses mark paired RNA positions; a dot marks an unpaired position. Each closing parenthesis pairs with the most recent unmatched opening parenthesis.

Trypsin cleavage specificity

Trypsin cleaves after K or R, except when the next residue is P. The K or R remains on the upstream peptide.

RNase T1 cleavage specificity

RNase T1 cleaves RNA after G. That G remains on the upstream fragment.

N-glycosylation sequon

The conventional N-glycosylation sequon is N–X–S or N–X–T, where X is any amino-acid residue except P.

Monoisotopic isotope masses

Use these isotope masses in Da as exact decimal constants. For a neutral, unmodified linear peptide, sum neutral free-amino-acid molecular formulas and subtract one H2O per peptide bond. Equivalently, sum incorporated residue masses and add one H2O per complete peptide. Do not round intermediate values.

12C = 12.00000000000
1H = 1.00782503223
14N = 14.00307400443
16O = 15.99491461957
32S = 31.9720711744
Monoisotopic residue masses

Use these incorporated residue masses in Da as exact decimal constants. Each is the corresponding neutral free amino acid minus one H2O. A free linear peptide has the sum of its residue masses plus one H2O, 18.01056468403 Da. Round only the final peptide mass.

A=71.03711378515  C=103.00918495955  D=115.02694302429  E=129.04259308875
F=147.06841391407  G=57.02146372069  H=137.05891185847  I=113.08406397853
K=128.09496301519  L=113.08406397853  M=131.04048508847  N=114.04292744138
P=97.05276384961  Q=128.05857750584  R=156.10111102405  S=87.03202840472
T=101.04767846918  V=99.06841391407  W=186.07931295073  Y=163.06332853364

Source: NIST isotope masses, snapshot accessed 2 November 2026. The incorporated residue masses are derived from the neutral free-amino-acid molecular formulas minus H2O, using the listed central isotope values without rounding. Measurement uncertainties are not propagated; the displayed decimal values are exact benchmark constants. Source and retrieval notes are documentation and are not included in model prompts.

Kyte–Doolittle hydropathy scores

Use these Kyte–Doolittle residue scores. Whole-protein mean hydropathy is their arithmetic mean, counting every residue occurrence.

A=1.8  R=-4.5  N=-3.5  D=-3.5
C=2.5  Q=-3.5  E=-3.5  G=-0.4
H=-3.2  I=4.5  L=3.8  K=-3.9
M=1.9  F=2.8  P=-1.6  S=-0.8
T=-0.7  W=-0.9  Y=-1.3  V=4.2
Ionization and net charge

A basic site contributes +1/(1+10^(pH−pKa)); an acidic site contributes −1/(1+10^(pKa−pH)).

Basic sites: the N terminus and K, R, H side chains. Acidic sites: the C terminus and D, E, C, Y side chains. Count each terminus once and each listed side chain once per residue occurrence; sum their contributions.

Sources and practical precedents

Evaluation design

Paired prompts, separate score axes

Each underlying instance gets easy and hard prompts with one shared answer and validator. Track reference support separately from sequence length, number of edits, constraint density, or search-space size. Keep tool access and token budgets matched.

Report canonical final-answer accuracy and answer-format compliance separately. A correct answer must match the normalized reference, including every requested field. Intermediate results may also receive diagnostic scores; a plausible explanation cannot rescue a wrong final answer.

Prevent sequence leakage

Split related sequence families before deriving tasks. Keep parent CDSs, homologs, recodings, mutants, RNA products, protein products, and composed examples in the same partition.

Hold out selected task combinations as a separate composition-generalization test. Do not use the exact intermediate sequences from a held-out composition to train its individual tasks.

Certify reference answers

Generate one canonical reference answer per instance, including every tie-break. Independently verify protein preservation, all constraints, and the required selection rule. Keep exact-search instances small enough to certify the chosen feasible or optimal answer, not just one witness.

A reference may say IMPOSSIBLE only after an independent solver certifies infeasibility. NONE means no qualifying readout exists. A search timeout establishes neither result.

Status of this proposal

This document defines candidate task types, prompt templates, and scoring rules. It does not claim that a dataset, reference implementation, solver, or benchmark score already exists.

Before release: generate instances, implement reference solvers and independent validators, verify canonical-answer uniqueness and easy/hard equivalence, and pilot task lengths and search limits. The illustrative examples have been checked; they are not a released benchmark dataset.