lejurobot/LET-Dex-Dataset
数据集数据集查看器文件和版本Pull Requests讨论
下载使用量0

LET-Dex: 全尺寸人形机器人灵巧手力觉触觉数据集

Full-Size Humanoid Robot Dexterous Hand Tactile Dataset

简体中文 | English


Highlights

  • 3,800+ 条 灵巧手遥操作轨迹,涵盖触觉阵列与六维力数据
  • 16 个子任务 覆盖汽车制造、物流快递、工业质检、桌面整理、快消品上料等场景
  • 14 种原子技能 标注,包含抓取 (capture)、放置 (placement)、按压 (press)、扫描 (scanning) 等
  • 累计时长 ~21.7 小时 已标注操作数据
  • 指尖触觉阵列 6×12×5 传感器,360 触觉单元实时感知
  • 完整工具链 从 rosbag 转换、模型训练到推理部署,开箱即用

硬件平台

Kuavo 4 Pro Linker Hand L6

基于 Kuavo 4 Pro 人形机器人 + Linker Hand L6 灵巧手采集:

参数规格
身高 / 体重1.66m / 55kg
自由度40 DoF
灵巧手Linker Hand L6(6主动+5被动关节)
触觉传感器6×12×5 指尖阵列,360 单元
力觉传感器六维力/力矩(Fxyz + Mxyz)
视觉三视角 RGB-D(头部/左腕/右腕)

数据概览

数据规模

维度数量
已标注任务目录16
轨迹条目3,805
累计标注时长~21.7 小时
原子技能种类14
数据格式ROSbag + JSON 标注
末端类型Linker Hand L6 灵巧手

任务详情

任务目录中文名称场景条目数时长
Clean-up_desktop_items-P4-Linker_Hand_L6灵心巧手桌面物品整理家庭服务8770.7 min
Express_Delivery_Scanning_01-P4-Linker_Hand_L6L6机械臂-快递扫描物流485152.6 min
Express_Delivery_Scanning_02-P4-Linker_Hand_L6L6机械臂-快递扫描物流34173.1 min
Load_it_up-P4-Linker_Hand_L6汽车钣金上料汽车工厂28231.2 min
Package_scan-P4-Linker_Hand_L6顺丰快递扫码物流276106.1 min
Push_The_Cardboard_Box_To_The_Position_With_Resistance-P4-Linker_Hand_L6基于6维力的推纸箱到有阻力位置汽车工厂272--
SF_Express_Parcel_Sorting-P4-Linker_Hand_L6灵心巧手顺丰包裹分拣物流19877.7 min
Smart_postal_packages-P4-Linker_Hand_L6灵心巧手邮政包裹分拣物流12132.4 min
Smartandfast-forward-P4-Linker_Hand_L6灵心巧手快消品标准上料快消品6967.2 min
Task_mass_check-P4-Linker_Hand_L6舍弗勒产品质检工业质检9553.9 min
Toothpaste_Box_Feeding-P4-Linker_Hand_L6L6机械臂-牙膏盒上料快消品29871.2 min
Toothpaste_Box_Storage_01-P4-Linker_Hand_L6L6机械臂-牙膏盒收纳快消品21427.7 min
Toothpaste_Box_Storage_02-P4-Linker_Hand_L6L6机械臂-牙膏盒收纳快消品25021.5 min
Unilever_FMCG_Standard_Feeding-P4-Linker_Hand_L6快消品标准上料(联合利华)快消品288487.8 min
Water_Bottle_Delivery-P4-Linker_Hand_L6L6机械臂-递水瓶家庭服务279--
Wipe_The_Blackboard-P4-Linker_Hand_L6L6机械臂-擦黑板生活服务25030.9 min

注:部分任务 JSON 标注中未包含 marks 时长信息,故显示为 --。

场景覆盖

场景领域代表任务
汽车工厂钣金上料、推纸箱
物流快递快递扫描、包裹分拣、邮政分拣
快消品牙膏盒上料/收纳、快消品上料、联合利华上料
工业质检舍弗勒产品质检
家庭服务桌面整理、递水瓶
生活服务擦黑板

原子技能分布

原子技能出现次数说明
capture4,320抓取/捕获
placement3,749放置操作
press1,124按压
pick up649拾取
fall back449回退
peace291平稳操作
wipe251擦拭
wait216等待
plot198轨迹规划
scanning121扫描
catch82接取
initial69初始位姿
adjustment49调整/校准
set36就位设置

语义标注

每条轨迹数据的 JSON 标注主要由轨迹级元信息和步骤级 marks 数组组成,常见语义样例如下:

  • 场景样例 — 家庭生活、工业制造;清洁整理、生产物流;餐桌清洁、流水线上料
  • 任务样例 — 灵心巧手桌面物品整理、汽车钣金上料、顺丰快递扫码、舍弗勒产品质检、快消品标准上料(联合利华)
  • 技能样例 — placement、capture、press、pick up、fall back、wipe、wait、scanning

标注 JSON 示例(节选自 Clean-up_desktop_items-P4-Linker_Hand_L6/A10-A12-H-C-05-TQ_02_01-p4_353-dex_hand-20251219103848-v001.json):

{
  "location": "北京训练场-A10",
  "primaryScene": "家庭生活-H",
  "primarySceneCode": "FAMILY LIFE - H",
  "secondaryScene": "清洁整理-C",
  "secondarySceneCode": "CLEANING - C",
  "tertiaryScene": "餐桌清洁-05",
  "tertiarySceneCode": "Table cleaning-05",
  "initSceneText": "餐桌清洁",
  "englishInitSceneText": "Table cleaning",
  "taskGroupName": "",
  "taskGroupCode": "",
  "taskName": "灵心巧手桌面物品整理",
  "taskCode": "Clean-up desktop items",
  "deviceSn": "p4-353",
  "taskPrompt": "",
  "marks": [
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:38:48.719",
      "markEnd": "2025-12-19 10:38:58.802",
      "duration": 10.083,
      "startPosition": "0.0017753813694877166",
      "endPosition": "0.18258613462251694",
      "skillAtomic": "pick up",
      "skillDetail": "初始双手置于胸前。右手将桌面的抹布拿起",
      "enSkillDetail": "initial hands on the chest. right hand picks up the rag of the desktop",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:38:58.802",
      "markEnd": "2025-12-19 10:39:01.808",
      "duration": 3.006,
      "startPosition": "0.18258613462251694",
      "endPosition": "0.23649765320502625",
      "skillAtomic": "placement",
      "skillDetail": "根据物品种类将抹布放置在右手边的收纳箱中",
      "enSkillDetail": "place the rag in the box on the right side according to the type of item",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:01.808",
      "markEnd": "2025-12-19 10:39:07.892",
      "duration": 6.084,
      "startPosition": "0.23649765320502625",
      "endPosition": "0.34559571995346183",
      "skillAtomic": "pick up",
      "skillDetail": "右手将桌面的圆形海绵球物品拿起",
      "enSkillDetail": "right hand picks up the table's spongeball articles",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:07.892",
      "markEnd": "2025-12-19 10:39:11.002",
      "duration": 3.11,
      "startPosition": "0.34559571995346183",
      "endPosition": "0.4013777582532286",
      "skillAtomic": "placement",
      "skillDetail": "根据物品种类将圆形海绵球放置在右手边的收纳箱中",
      "enSkillDetail": "place a circular sponge ball in the box on the right hand according to the type of object",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:11.002",
      "markEnd": "2025-12-19 10:39:20.818",
      "duration": 9.816,
      "startPosition": "0.4013777582532286",
      "endPosition": "0.5774127670053398",
      "skillAtomic": "pick up",
      "skillDetail": "左手将桌面的香蕉拿起",
      "enSkillDetail": "take the bananas from the desktop in the left hand",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:20.818",
      "markEnd": "2025-12-19 10:39:27.123",
      "duration": 6.305,
      "startPosition": "0.5774127670053398",
      "endPosition": "0.6904757476850609",
      "skillAtomic": "placement",
      "skillDetail": "根据物品种类将香蕉放置在左手边的收纳箱中",
      "enSkillDetail": "bananas placed in the box on the left side according to the type of item",
      "markType": "step"
    }
  ]
}

目录结构

LET-Dex-Dataset/
├── datasets/
│   └── rosbag/
│       └── tactile/
│           └── real/
│               └── Labelled/           # 16 个灵巧手任务
│                   ├── Clean-up_desktop_items-P4-Linker_Hand_L6/
│                   ├── Express_Delivery_Scanning_01-P4-Linker_Hand_L6/
│                   ├── Express_Delivery_Scanning_02-P4-Linker_Hand_L6/
│                   ├── Load_it_up-P4-Linker_Hand_L6/
│                   ├── Package_scan-P4-Linker_Hand_L6/
│                   ├── Push_The_Cardboard_Box_To_The_Position_With_Resistance-P4-Linker_Hand_L6/
│                   ├── SF_Express_Parcel_Sorting-P4-Linker_Hand_L6/
│                   ├── Smart_postal_packages-P4-Linker_Hand_L6/
│                   ├── Smartandfast-forward-P4-Linker_Hand_L6/
│                   ├── Task_mass_check-P4-Linker_Hand_L6/
│                   ├── Toothpaste_Box_Feeding-P4-Linker_Hand_L6/
│                   ├── Toothpaste_Box_Storage_01-P4-Linker_Hand_L6/
│                   ├── Toothpaste_Box_Storage_02-P4-Linker_Hand_L6/
│                   ├── Unilever_FMCG_Standard_Feeding-P4-Linker_Hand_L6/
│                   ├── Water_Bottle_Delivery-P4-Linker_Hand_L6/
│                   └── Wipe_The_Blackboard-P4-Linker_Hand_L6/
└── docs/

命名规范:<英文任务名>-<机器人型号>-<末端类型>

每个任务目录下包含成对的 .bag(ROSbag 数据)和 .json(语义标注)文件。


数据格式

ROSbag Topics

触觉 (Tactile)

Topic类型说明
/cb_$pos_hand_control_cmdJointState手部控制指令(6关节)
/cb_$pos_hand_stateJointState手部状态返回
/cb_$pos_hand_matrix_touch_pc2PointCloud2触觉矩阵(360单元)
/force6d_$pos_hand_force_torqueWrenchStamped六维力/力矩

通用 (Touch)

Topic类型说明
/cam_{h,l,r}/color/image_raw/compressedCompressedImage头/左腕/右腕 RGB
/cam_{h,l,r}/depth/image_rect_raw/compressedCompressedImage头/左腕/右腕 深度
/kuavo_arm_trajJointState手臂轨迹 (14 DoF)
/sensors_data_rawsensorsData全关节状态 + IMU
/control_robot_hand_positionrobotHandPosition灵巧手位置
/dexhand/stateJointState灵巧手状态(12 DoF)

快速上手

工具仓库

我们提供完整的开源工具链 kuavo_data_challenge:

  • rosbag2lerobot — ROSbag → LeRobot 格式转换
  • Diffusion Policy / ACT — 两种模仿学习基线
  • 训练脚本 — 开箱即用的训练 pipeline
  • 部署工具 — 真机与仿真环境推理

数据获取

平台链接
Atomgitlejurobot/LET-Dex-Dataset
ModelScopelejurobot/LET-Dex-Dataset
邮件申请wangsong@lejurobot.com

社区

QQ 交流群:1043359345


引用

如在研究中使用本数据集,请根据所使用的平台选择以下对应引用方式:

Atomgit 引用

@misc{LET_Dex2025,
    title={LET:Full-size humanoid robot real machine force and tactile dataset},
    author={LejuRobotics},
    year={2025},
    howpublished={\url{https://ai.atomgit.com/lejurobot/LET-Dex-Dataset}}
}

魔搭社区(ModelScope)引用

@misc{LET_Dex2025,
    title={LET:Full-size humanoid robot real machine force and tactile dataset},
    author={LejuRobotics},
    year={2025},
    howpublished={\url{https://www.modelscope.cn/datasets/lejurobot/LET-Dex-Dataset}}
}

许可证

CC BY-NC-SA 4.0