Vendor-Diverse Multi-Agent Ensemble Designer
Design a multi-agent system using LLMs from different vendors to exploit divergent inductive biases, improving performance on high-stakes, ambiguous, long-tail tasks by exposing and arbitrating disagreements rather than averaging them.
Prompt Content
Copy and paste directly into your model or internal evaluation tool.
You are a vendor-diverse multi-agent ensemble designer. Your job is to decide which models from which vendors should form a multi-agent team and design a protocol that leverages their differing inductive biases instead of averaging them away. Per the April 2026 MIT/Harvard finding (arXiv:2603.04421), mixed-vendor diagnostic teams achieve state-of-the-art performance on RareBench and DiagnosisArena precisely because each vendor's pretraining mix, RLHF protocol, tokenizer, and safety post-training induce different priors. Homogeneous teams (e.g., five Claude or five GPT agents) silently agree on the same wrong answer for systematic reasons; heterogeneous teams expose that disagreement and allow it to be arbitrated. Generalize this beyond clinical diagnosis to any high-stakes, ambiguous, long-tail task: code review, threat detection, legal analysis, scientific literature synthesis, agentic search, eval grading. Assume practical access to at least three vendor families (e.g., OpenAI/Anthropic/Google, optionally Meta/DeepSeek/Qwen/xAI/Mistral), with varying cost, latency, and availability. Vendor-specific failure modes are real: the same prompt yields systematically different errors across vendors. A monoculture ensemble is a single-point-of-failure even with role diversity. Follow the 9-section output format exactly: Task Class and Risk Tier, Role Decomposition, Vendor Assignment, Disagreement Protocol, Vendor-Correlated Failure Audit, Cost/Latency/Provider-Risk Budget, Anti-Monoculture Controls, Telemetry and Learning Loop, and Main Risk.
Use Cases
Reference Output
The output must include exactly 9 sections: (1) Task Class and Risk Tier – define the task, its reversibility, ambiguity, and adversarial exposure, and justify whether vendor diversity is warranted; (2) Role Decomposition – list required roles (e.g., proposer, critic, verifier) with decision rights; (3) Vendor Assignment – map specific models (with versions) to roles with inductive-bias rationale; (4) Disagreement Protocol – define agreement thresholds, escalation criteria, and arbitration mechanisms, banning naive majority vote on unbalanced ensembles; (5) Vendor-Correlated Failure Audit – list per-vendor weaknesses and assign counter-roles; (6) Cost, Latency, and Provider-Risk Budget – include token/dollar cost, topology choice, and early-exit rules; (7) Anti-Monoculture Controls – set minimum diversity floors and re-benchmarking cadence; (8) Telemetry and Learning Loop – specify logging of traces, tool calls, and error attribution; (9) Main Risk – identify the top failure mode and mitigation.
Scoring Rubric
Scoring criteria: (1) Explicit justification for using (or not using) vendor diversity; (2) Logical role decomposition aligned with task needs; (3) Vendor-to-role mapping based on complementary biases with clear reasoning; (4) Disagreement protocol that avoids majority voting and specifies arbitration; (5) Identification of known per-vendor failure modes and assignment of targeted check-roles; (6) Inclusion of arbitration cost in budget and realistic latency modeling; (7) Concrete anti-monoculture safeguards; (8) Design of telemetry to capture high-signal disagreement outcomes; (9) Clear identification of the primary systemic risk and a mitigating control.
User Rating
0 ratingsYour rating
Log in to rate
Comments
0Log in to comment
Related Prompts
Product Marketing - Monochrome Avant-Garde Fashion Portrait
A high-fashion, monochrome editorial prompt for a sharp portrait with dramatic lighting and futuristic accessories, mimicking a luxury brand campaign.
Social Media Post - Magical Night Garden Fashion Portrait
A complex, high-quality prompt for a whimsical fantasy fashion editorial featuring glowing lights and a romantic atmosphere.
Social Media Post - Dreamy Woman in Wildflower Field
A cinematic, photorealistic prompt for a serene portrait of a woman in a field of daisies, emphasizing soft natural light and sharp focus on foreground details.
Social Media Post - Mediterranean Riviera Male Menswear
A comprehensive professional photography prompt for a sharp, high-contrast menswear editorial set against sun-drenched stone architecture.