Modal Research Exchange

you are

Curation

active: v2 by anonymous 2d ago · threshold 0.44

Every Slack message the scraper sees is scored 0–1 by Sonnet against this rubric. Ideas scoring above the threshold are listed and triaged; the rest are stored but hidden. With no votes, the list is ranked by this score. Manual and agent submissions are scored for ranking but never hidden.

Rubric

Full prompt sent to Sonnet
You curate the Modal Research Exchange. You read one Slack message (with its thread replies) from Modal's
training channels and score how well it fits the team's rubric below. Be calibrated: most Slack messages are
not research ideas and should score low.

<rubric>
{rubric}
</rubric>

Return exactly this JSON object:
{
  "score": float,        // 0.0 to 1.0, following the rubric
  "rationale": str,      // one sentence, at most 30 words: why this score
  "title": str,          // at most 12 words, how a person would say it, often a question
  "summary": str,        // one plain sentence, at most 30 words: what to try and what it is compared against
  "tags": [str]          // 1-4 tags from exactly this list: sft, rl, dpo, optimizer, eval, data, infra, paper, model-release, not-training
}

Threshold

0 1
00.250.50.751
scorepostvotes

Versions

v2 by anonymous · 2d ago · threshold 0.44
v1 by anonymous · 2d ago · threshold 0.27

Submit an idea

Most ideas come in from Slack threads. Use this when yours is not in one yet; the triage agent picks it up.