corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a087aa-e8b1-72c5-8d94-276048f1276b

Per-query energy consumption of LLMs

asb · published 7 January 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at muxup.com Wayback capture
4blogs citing
First cited
10 Jan 2026
Most recent
17 Feb 2026
Rank this month
not ranked
Links from this post
53
Words captured
5,021

Cited by

Blog
In the post
Date
Jamie Brandon
0057: consulting, zest progress, reads that lasted, books, links Read at the source ↗
17 Feb 2026
simonpcouch.com
Electricity use of AI coding agents Read at the source ↗
20 Jan 2026
anil.recoil.org
.plan-26-02: Back from India and straight into the conservation conference Read at the source ↗
11 Jan 2026
Home
Musings on AI Read at the source ↗
10 Jan 2026

Links from this post

Link
Host
https://inferencemax.semianalysis.com/
inferencemax.semianalysis.com
https://openrouter.ai/
openrouter.ai
https://www.perplexity.ai/hub/blog/lower-latency-and-higher-throughput-with-multi-node-deepseek-deployment
perplexity.ai
https://arxiv.org/pdf/2508.15734
arxiv.org
Our contribution to a global environmental standard for AI Read at the source ↗
mistral.ai
https://newsletter.semianalysis.com/p/inferencemax-open-source-inference
newsletter.semianalysis.com
https://huggingface.co/deepseek-ai/DeepSeek-R1-0528
huggingface.co
https://huggingface.co/openai/gpt-oss-120b
huggingface.co
https://github.com/SemiAnalysisAI/InferenceX/issues/315
github.com
https://github.com/kimbochen/bench_serving
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/338
github.com
https://github.com/SemiAnalysisAI/InferenceX
github.com
https://github.com/SemiAnalysisAI/InferenceX/actions/runs/20216709902/job/58149531774
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/benchmarks/benchmark_lib.sh
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/utils/process_result.py
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/.github/workflows/benchmark-tmpl.yml
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/.github/workflows/benchmark-multinode-tmpl.yml
github.com
https://github.com/kimbochen/bench_serving/blob/499c0b171b499b02a1fd546fb2326d2175a5d66e/benchmark_serving.py
github.com
https://github.com/kimbochen/bench_serving/blob/499c0b171b499b02a1fd546fb2326d2175a5d66e/backend_request_func.py
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/benchmarks/gptoss_fp4_b200_docker.sh
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/benchmarks/gptoss_fp4_b200_trt_docker.sh
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/utils/matrix_logic/generate_sweep_configs.py
github.com
https://docs.vllm.ai/en/latest/cli/serve/
docs.vllm.ai
https://nvidia.github.io/TensorRT-LLM/1.0.0rc2/commands/trtllm-serve.html
nvidia.github.io
https://github.com/SemiAnalysisAI/InferenceX/blob/84320a0aadacae1114265b553830f48b56231817/benchmarks/gptoss_fp4_h100_slurm.sh
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/123
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/393
github.com
https://www.linkedin.com/feed/update/urn:li:activity:7414767337058242562?commentUrn=urn%3Ali%3Acomment%3A%28activity%3A7414767337058242562%2C7415321431900905472%29&dashCommentUrn=urn%3Ali%3Afsd_comment%3A%287415321431900905472%2Curn%3Ali%3Aactivity%3A7414767337058242562%29
linkedin.com
https://github.com/SemiAnalysisAI/InferenceX/issues/293
github.com
https://www.youtube.com/watch?v=yYha_OtxA14
youtube.com
https://github.com/SemiAnalysisAI/InferenceX/issues/299
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/300
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/349
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/350
github.com
https://docs.github.com/en/organizations/managing-organization-settings/configuring-the-retention-period-for-github-actions-artifacts-and-logs-in-your-organization
docs.github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/365
github.com
https://github.com/SemiAnalysisAI/InferenceX/blob/ff7dfc7365034aa84245f41c517c38618860d484/runners/launch_gb200-nv.sh
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/359
github.com
https://openrouter.ai/deepseek/deepseek-r1-0528
openrouter.ai
https://github.com/SemiAnalysisAI/InferenceX/issues/357
github.com
https://github.com/SemiAnalysisAI/InferenceX/issues/356
github.com
https://github.com/SemiAnalysisAI/InferenceX/pull/339
github.com
https://gist.github.com/asb/44fe17f4f5b7abed7836481be45c5a38
gist.github.com
https://github.com/SemiAnalysisAI/InferenceX/pull/381
github.com
https://www.playstation.com/en-gb/legal/ecodesign/
playstation.com
https://github.com/SemiAnalysisAI/InferenceX/commit/c040b5cf23ced2c7e23d1da03e1abae89e6426aa
github.com
https://github.com/ai-dynamo/dynamo/blob/b7107d008/examples/backends/sglang/slurm_jobs/scripts/gb200-fp8/disagg/8k1k-max-tpt.sh
github.com
https://huggingface.co/moonshotai/Kimi-K2-Thinking
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V3.2
huggingface.co
https://huggingface.co/deepseek-ai/DeepSeek-V3.2/resolve/main/assets/paper.pdf
huggingface.co
https://github.com/MoonshotAI/Kimi-Linear
github.com
https://qwen.ai/blog?id=4074cca80393150c248e508aa62983f9cb7d27cd
qwen.ai
https://chutes.ai/app/chute/398651e1-5f85-5e50-a513-7c5324e8e839?tab=source
chutes.ai