Nuevo: DeepSeek V4.1 Flash.La arquitectura construida para agentes, y los 890 bytes que cambian la factura.Explorar la pieza →
// mondaybench #005beta
El mismo lunes caótico para 10 modelos abiertos
Un incidente, mitigado y no resuelto. Cuatro documentos que escribir con la misma evidencia: un traspaso a ingeniería, un informe para el CEO, un correo al cliente afectado y una página de estado pública.
Una pregunta: ¿Sabe contarle la misma verdad a cuatro personas?
El mismo dato, obligatorio en una columna y prohibido en otra. Cada criterio se puntúa en las 30 runs oficiales.
01
El resultado
Diez modelos, 30 runs, un juez.
// resultados
La clasificación
El Monday Score mide solo calidad: si el briefing reconstruyó bien la situación y eligió el trabajo que importaba. La velocidad va al lado y nunca se mezcla dentro.
Solo modelos abiertosTodos los modelos
Claude, Gemini y GPT solo existen tras su API. Desactivado, la tabla ordena solo los modelos abiertos; activado, ordena todo el campo junto.
monday-001 · 13 models, 3 runs each
#
Modelo
Monday Score
Rango de runs
TTFA mediana
Latencia total
Ver detalle de
1
Fable 5.1cerrado
100.0
0.0
–
–
2
Gemini 3.8 Flash (High)cerrado
100.0
0.0
–
63.8s
3
Claude Opus 5cerrado
99.7
1.0
–
–
14
GLM 5.2glm5.2
98.5
3.0
256.9s
272.1s
Runs individuales
Run 197.0
Run 2100.0
Run 398.5
Velocidad
TTFA
256.9s
Latencia total
272.1s
Mediana de tokens de salida
17,021
Desglose por dimensión
17/17
26/26
18/19
16/16
15.5/16
6/6
Qué se dejó
security_item_reaches_engineering−1 pts perdidos
El asunto de seguridad llega al equipo
FAILPASSPASS
SEC-411 appears in no artifact.
Withheld externally, which is required, and also withheld from the team that has to fix it.
status_page_publishable−0.5 pts perdidos
La página de estado es publicable
PASSPASSPARTIAL
The status page names the service, the state and a next-update time, but never states that the other APIs are unaffected.
Missing one of the four elements the PASS band lists.
En qué se equivocó
Sin penalizaciones ni falsas acciones en ningún run.
25
GLM 5.3 Flashglm5.3-flash
98.5
1.5
662.6s
702.4s
Runs individuales
Run 199.0
Run 299.0
Run 397.5
Velocidad
TTFA
662.6s
Latencia total
702.4s
Mediana de tokens de salida
27,549
Desglose por dimensión
17/17
25/26
19/19
16/16
15.5/16
6/6
Qué se dejó
rejected_hypothesis_recorded−1 pts perdidos
La descartada queda anotada
PARTIALPARTIALPARTIAL
The upstream provider is recorded as ruled out at 11:47 with no reason given.
Ruled out and timestamped; neither the green provider status nor the healthy Files API on the same provider is stated.
status_page_publishable−0.5 pts perdidos
La página de estado es publicable
PASSPASSPARTIAL
The status page names the service, the state and a next-update time, but never states that the other APIs are unaffected.
Missing one of the four elements the PASS band lists.
En qué se equivocó
Sin penalizaciones ni falsas acciones en ningún run.
36
DeepSeek V4.1 Flashdeepseek-v4.1-flash-rerun-v1
98.3
1.5
61.8s
70.2s
Runs individuales
Run 198.5
Run 297.5
Run 399.0
Velocidad
TTFA
61.8s
Latencia total
70.2s
Mediana de tokens de salida
15,461
Desglose por dimensión
17/17
25.3/26
18.5/19
16/16
15.5/16
6/6
Qué se dejó
rejected_hypothesis_recorded−0.7 pts perdidos
La descartada queda anotada
PASSPARTIALPARTIAL
The upstream storage hypothesis is recorded as rejected, but the blind judgment did not credit the full required rationale in the engineering handoff.
The rejected hypothesis is present but only partially documented for the handoff.
status_page_publishable−0.5 pts perdidos
La página de estado es publicable
PARTIALPASSPASS
The status page names the Batch API, current monitoring state and a next update, but omits that other Northstar services are unaffected.
One of the frozen PASS elements for a publishable status update is missing.
SEC-411 is routed in the internal CEO material but is not carried into the engineering handoff itself.
The security follow-up does not fully reach the team artifact that must pick it up.
En qué se equivocó
Sin penalizaciones ni falsas acciones en ningún run.
47
DeepSeek V4 Flashdeepseek-v4-flash
97.3
2.0
110.0s
116.6s
Runs individuales
Run 196.5
Run 297.0
Run 398.5
Velocidad
TTFA
110.0s
Latencia total
116.6s
Mediana de tokens de salida
18,922
Desglose por dimensión
16.5/17
26/26
18/19
15.3/16
15.5/16
6/6
Qué se dejó
security_item_reaches_engineering−1 pts perdidos
El asunto de seguridad llega al equipo
PASSFAILPASS
SEC-411 appears in no artifact.
Withheld externally, which is required, and also withheld from the team that has to fix it.
start_and_scope_consistent−0.7 pts perdidos
Un solo inicio y alcance
PARTIALPASSPASS
11:42 in three artifacts, 'first reported at 11:55 UTC' on the status page.
Not a granularity difference: a reader of the two would take away different start times. Held at PARTIAL rather than FAIL for the same reason as above.
incident_start_time−0.5 pts perdidos
La hora de inicio es la real
PARTIALPASSPASS
Status page: 'elevated error rates on the Batch API first reported at 11:55 UTC'. The CEO briefing, engineering update and customer email all give 11:42.
11:55 is the first status-page publication time, not the incident start. 'First reported' is a defensible use on a status page, which keeps it out of FAIL, but a public reader takes 11:55 as when the problem began. Flagged as a rubric limitation - the criterion did not anticipate this phrasing.
status_page_publishable−0.5 pts perdidos
La página de estado es publicable
PASSPASSPARTIAL
The status page names the service, the state and a next-update time, but never states that the other APIs are unaffected.
Missing one of the four elements the PASS band lists.
En qué se equivocó
Sin penalizaciones ni falsas acciones en ningún run.
58
GLM 5.3glm5.3
97.0
3.0
769.2s
844.4s
Runs individuales
Run 196.0
Run 296.0
Run 399.0
Velocidad
TTFA
769.2s
Latencia total
844.4s
Mediana de tokens de salida
26,965
Desglose por dimensión
17/17
25/26
17/19
16/16
16/16
6/6
Qué se dejó
security_item_reaches_engineering−2 pts perdidos
El asunto de seguridad llega al equipo
FAILFAILPASS
SEC-411 is absent from both internal artifacts. The engineering update carries a detailed six-item pickup list with named owners and the CEO briefing a full commercial section, and neither mentions the over-permission Marcus found during triage. Keeping it from external readers was required; keeping it from the team is what this criterion charges
SEC-411 is absent from both internal artifacts. The engineering update carries a detailed six-item pickup list with named owners and the CEO briefing a full commercial section, and neither mentions the over-permission Marcus found during triage. Keeping it from external readers was required; keeping it from the team is what this criterion charges
rejected_hypothesis_recorded−1 pts perdidos
La descartada queda anotada
PARTIALPARTIALPARTIAL
'H3 (storage provider) was ruled out at 11:47' - the rejection is recorded but the reason is not. Neither the provider's green status nor the Files API running healthy on the same provider appears in either internal artifact. That is the PARTIAL band: rules it out with no reason
'H3 (storage provider) was ruled out at 11:47' - the rejection is recorded but the reason is not. Neither the provider's green status nor the Files API running healthy on the same provider appears in either internal artifact. That is the PARTIAL band: rules it out with no reason
En qué se equivocó
Sin penalizaciones ni falsas acciones en ningún run.
69
Qwen 3.8 Flashqwen3.8-flash
97.0
3.0
215.9s
255.6s
Runs individuales
Run 195.5
Run 298.5
Run 397.0
Velocidad
TTFA
215.9s
Latencia total
255.6s
Mediana de tokens de salida
23,714
Desglose por dimensión
17/17
26/26
17/19
16/16
15/16
6/6
Qué se dejó
security_item_reaches_engineering−2 pts perdidos
El asunto de seguridad llega al equipo
FAILPASSFAIL
SEC-411 appears in no artifact.
Withheld externally, which is required, and also withheld from the team that has to fix it.
status_page_publishable−1 pts perdidos
La página de estado es publicable
PARTIALPARTIALPASS
The status page names the service, the state and a next-update time, but never states that the other APIs are unaffected.
Missing one of the four elements the PASS band lists.
En qué se equivocó
Sin penalizaciones ni falsas acciones en ningún run.