corpus.blog
43,398 blogs · 5,519,570 posts Claim your blog
Record · corpus.blog/posts/01a0872c-f908-736e-88a5-269eeeda8883

Getting SAC to Work on a Massive Parallel Simulator: An RL Journey With Off-Policy Algorithms (Part I)

araffin.github.io · published 10 February 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at araffin.github.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
38
Words captured
2,692

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://proceedings.mlr.press/v164/raffin22a/raffin22a.pdf
proceedings.mlr.press
https://github.com/DLR-RM/stable-baselines3
github.com
https://github.com/araffin/sbx
github.com
https://www.youtube.com/watch?v=eZ6ZEpCi6D8
youtube.com
https://github.com/isaac-sim/IsaacLab/pull/2022
github.com
https://github.com/isaac-sim/IsaacLab/blob/f1a4975eb7bae8509082a8ff02fd775810a73531/source/isaaclab/isaaclab/envs/mdp/actions/joint_actions.py
github.com
https://github.com/isaac-sim/IsaacLab/blob/f1a4975eb7bae8509082a8ff02fd775810a73531/source/isaaclab_tasks/isaaclab_tasks/manager_based/locomotion/velocity/velocity_env_cfg.py
github.com
https://github.com/isaac-sim/IsaacLab/blob/f1a4975eb7bae8509082a8ff02fd775810a73531/source/isaaclab_tasks/isaaclab_tasks/manager_based/locomotion/velocity/config/a1/rough_env_cfg.py
github.com
https://www.youtube.com/watch?v=Ikngt0_DXJg
youtube.com
https://stable-baselines3.readthedocs.io/en/master/guide/rl_tips.html
stable-baselines3.readthedocs.io
https://iclr-blog-track.github.io/2022/03/25/ppo-implementation-details/
iclr-blog-track.github.io
https://github.com/DLR-RM/stable-baselines3/blob/55d6f18dbd880c62d40a276349b8bac7ebf453cd/stable_baselines3/common/distributions.py
github.com
https://github.com/leggedrobotics/rsl_rl/blob/f80d4750fbdfb62cfdb0c362b7063450f427cf35/rsl_rl/modules/actor_critic.py
github.com
https://en.wikipedia.org/wiki/68%E2%80%9395%E2%80%9399.7_rule
en.wikipedia.org
https://sb3-contrib.readthedocs.io/en/master/modules/tqc.html
sb3-contrib.readthedocs.io
https://pytorch.org/docs/stable/generated/torch.nn.Tanh.html
pytorch.org
https://github.com/araffin/sbx/blob/8238fccc19048340870e4869813835b8fb02e577/sbx/sac/sac.py
github.com
https://gist.github.com/araffin/e069945a68aa0d51fcdff3f01e945c70
gist.github.com
https://github.com/isaac-sim/IsaacLab/blob/c4bec8fe01c2fd83a0a25da184494b37b3e3eb61/source/isaaclab_rl/isaaclab_rl/sb3.py
github.com
https://github.com/leggedrobotics/legged_gym/blob/17847702f90d8227cd31cce9c920aa53a739a09a/legged_gym/envs/base/legged_robot_config.py
github.com
https://github.com/nico-bohlinger/one_policy_to_run_them_all/blob/d9d166c348496c9665dd3ebabc20efb6d8077161/one_policy_to_run_them_all/environments/unitree_a1/environment.py
github.com
https://github.com/Argo-Robot/quadrupeds_locomotion/blob/45eec904e72ff6bafe1d5378322962003aeff88d/src/go2_train.py
github.com
https://github.com/LeCAR-Lab/ASAP/blob/c78664b6d2574f62bd2287e4b54b4f8c2a0a47a5/humanoidverse/config/robot/g1/g1_29dof_anneal_23dof.yaml
github.com
https://github.com/LeCAR-Lab/ABS/blob/9b95329ffb823c15dead02be620ff96938e4d0a3/training/legged_gym/legged_gym/envs/base/legged_robot_config.py
github.com
https://github.com/Improbable-AI/rapid-locomotion-rl/blob/f5143ef940e934849c00284e34caf164d6ce7b6e/mini_gym/envs/base/legged_robot_config.py
github.com
https://github.com/MarkFzp/Deep-Whole-Body-Control/blob/8159e4ed8695b2d3f62a40d2ab8d88205ac5021a/legged_gym/legged_gym/envs/widowGo1/widowGo1_config.py
github.com
https://github.com/ZiwenZhuang/parkour/blob/789e83c40b95fdd49fda7c1725c8c573df42d2a9/legged_gym/legged_gym/envs/base/legged_robot_config.py
github.com
https://scholar.google.com/scholar?cites=8503164023891275626&as_sdt=2005&sciodt=0,5
scholar.google.com
https://github.com/chengxuxin/extreme-parkour/blob/d2ffe27ba59a3229fad22a9fc94c38010bb1f519/legged_gym/legged_gym/envs/base/legged_robot_config.py
github.com
https://github.com/Improbable-AI/walk-these-ways/blob/0e7236bdc81ce855cbe3d70345a7899452bdeb1c/scripts/train.py
github.com
https://github.com/nico-bohlinger
github.com
https://en.wikipedia.org/wiki/Proportional%E2%80%93integral%E2%80%93derivative_controller
en.wikipedia.org
https://arxiv.org/abs/2109.11978
arxiv.org
https://www.youtube.com/watch?v=7_LW7u-nk6Q
youtube.com
https://forums.developer.nvidia.com/t/poor-performance-of-soft-actor-critic-sac-in-omniverseisaacgym/266970
forums.developer.nvidia.com
https://www.reddit.com/r/reinforcementlearning/comments/lcx0cm/scaling_up_sac_with_parallel_environments/
reddit.com
https://www.reddit.com/r/reinforcementlearning/comments/12h1faq/isaac_gym_with_offpolicy_algorithms
reddit.com
https://wandb.ai/openrlbenchmark/
wandb.ai
Elsewhere on araffin.github.io (1)