Record · corpus.blog/posts/01a08792-6592-735f-876a-11f576d7ffe5

Auditing DeepSWE

kimjune01 · published 27 May 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at june.kim Wayback capture

1blogs citing

First cited: 4 Jun 2026
Most recent: 4 Jun 2026
Rank this month: not ranked
Links from this post: 64
Words captured: 6,599

Cited by

Blog

In the post

Date

rico.codes

Where AI Agents Actually Pay Off Read at the source ↗

4 Jun 2026

Links from this post

Link

Host

https://github.com/datacurve-ai/deep-swe

github.com

https://aws.amazon.com/linux/

aws.amazon.com

https://github.com/gvergnaud/ts-pattern

github.com

https://www.swebench.com/verified.html

swebench.com

https://github.com/SWE-agent/mini-swe-agent

github.com

https://github.com/SWE-agent/mini-swe-agent/blob/main/src/minisweagent/config/mini.yaml

github.com

https://github.com/datacurve-ai/pier/blob/main/src/pier/agents/installed/mini_swe_agent.py

github.com

https://github.com/anthropics/claude-code

github.com

https://github.com/google-gemini/gemini-cli

github.com

https://github.com/sst/opencode

github.com

https://deepswe.datacurve.ai/

deepswe.datacurve.ai

https://deepswe.datacurve.ai/artifacts/summary.json

deepswe.datacurve.ai

https://deepswe.datacurve.ai/artifacts/leaderboard.json

deepswe.datacurve.ai

https://deepswe.datacurve.ai/artifacts/heatmap.json

deepswe.datacurve.ai

https://deepswe.datacurve.ai/artifacts/tasks.json

deepswe.datacurve.ai

https://deepswe.datacurve.ai/artifacts/trials.json

deepswe.datacurve.ai

https://github.com/kimjune01/deepswe-run/tree/main/external/deepswe-leaderboard/raw

github.com

https://deepswe.datacurve.ai/artifacts/trials/abs-module-cache-flags__GUstLQs.json

deepswe.datacurve.ai

https://github.com/datacurve-ai/deep-swe/releases

github.com

https://github.com/datacurve-ai/pier

github.com

https://github.com/datacurve-ai/pier/releases

github.com

https://huggingface.co/datacurve-ai

huggingface.co

https://venturebeat.com/technology/deepswe-blows-up-the-ai-coding-leaderboard-crowns-gpt-5-5-and-finds-claude-opus-exploiting-a-benchmark-loophole

venturebeat.com

https://deepswe.datacurve.ai/data/tasks/goreleaser-retry-publish-auditing

deepswe.datacurve.ai

https://deepswe.datacurve.ai/data/tasks/opa-rego-rule-profiling

deepswe.datacurve.ai

https://github.com/datacurve-ai/deep-swe/blob/2f0f4125/tasks/adaptix-name-mapping-aliases/instruction.md

github.com

https://www.swebench.com/pro.html

swebench.com

The Hypothesis Graph: A Verifiable Semantic Memory for Coding Agents Read at the source ↗

june.kim

https://github.com/kimjune01/swebench-pro

github.com

Why we no longer evaluate SWE-bench Verified Read at the source ↗

openai.com

https://deepswe.datacurve.ai/blog

deepswe.datacurve.ai

https://www.linkedin.com/in/serena-ge-4583731b4/

linkedin.com

https://x.com/serenaa_ge

x.com

https://www.linkedin.com/in/charley-lee/

linkedin.com

https://uwaterloo.ca/computer-science/news/cs-led-startup-secures-177m-transform-ai-training-data

uwaterloo.ca

https://www.ycombinator.com/companies/datacurve

ycombinator.com

https://cohere.com/

cohere.com

https://leonardtng.com/

leonardtng.com

https://en.wikipedia.org/wiki/Yale-NUS_College

en.wikipedia.org

https://arxiv.org

arxiv.org

https://zenodo.org

zenodo.org

https://huggingface.co/papers

huggingface.co

https://www.semanticscholar.org/

semanticscholar.org

https://openreview.net

openreview.net

https://scholar.google.com/

scholar.google.com

https://www.researchgate.net/

researchgate.net

https://techcrunch.com/2025/10/09/datacurve-raises-15-million-to-take-on-scaleai/

techcrunch.com

https://www.chemistry.vc/

chemistry.vc

https://en.wikipedia.org/wiki/Balaji_Srinivasan

en.wikipedia.org

https://en.wikipedia.org/wiki/Garry_Tan

en.wikipedia.org

https://github.com/openai/codex

github.com

https://en.wikipedia.org/wiki/Binomial_proportion_confidence_interval

en.wikipedia.org

https://github.com/kimjune01/deepswe-run/tree/main/external/codex-audit

github.com

https://github.com/kimjune01/deepswe-run/blob/main/external/codex-audit/prompt.txt

github.com

https://novalogiq.com/2026/05/27/deepswe-blows-up-the-ai-coding-leaderboard-crowns-gpt-5-5-and-finds-claude-opus-exploiting-a-benchmark-loophole/

novalogiq.com

https://www.dataworldbank.net/2026/05/26/deepswe-blows-up-the-ai-coding-leaderboard-crowns-gpt-5-5-and-finds-claude-opus-exploiting-a-benchmark-loophole/

dataworldbank.net

New DeepSWE Benchmark Puts GPT-5.5 Ahead of Claude Opus 4.7 Read at the source ↗

winbuzzer.com

https://eu.36kr.com/en/p/3827435586736777

eu.36kr.com

https://www.theneuron.ai/explainer-articles/datacurves-deepswe-exposes-a-weird-new-problem-with-ai-coding-leaderboards/

theneuron.ai

https://youtu.be/JpSHyEIZ_bo?t=144

youtu.be

New Reading Read at the source ↗

june.kim

https://deepswe.datacurve.ai/blog/deepswe-v1-1

deepswe.datacurve.ai

Auditing DeepSWE v1.1 Read at the source ↗

june.kim

https://github.com/kimjune01/deepswe-run

github.com