JZUS - Journal of Zhejiang University SCIENCE

ENGINEERING Information Technology & Electronic Engineering

Accepted manuscript available online (unedited version)

Sora for foundation robots with parallel intelligence: three world models, three robotic systems

Author(s): Lili FAN, Chao GUO, Yonglin TIAN, Hui ZHANG, Jun ZHANG, Fei-Yue WANG
Affiliation(s): School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China; more
Corresponding email(s): lilifan@bit.edu.cn, feiyue.wang@ia.ac.cn
Key Words:

Share this article to： More <<< Previous Paper \|Next Paper >>>

Lili FAN, Chao GUO, Yonglin TIAN, Hui ZHANG, Jun ZHANG, Fei-Yue WANG. Sora for foundation robots with parallel intelligence: three world models, three robotic systems[J]. Frontiers of Information Technology & Electronic Engineering,in press.https://doi.org/10.1631/FITEE.2400144

@article{title="Sora for foundation robots with parallel intelligence: three world models, three robotic systems",
author="Lili FAN, Chao GUO, Yonglin TIAN, Hui ZHANG, Jun ZHANG, Fei-Yue WANG",
journal="Frontiers of Information Technology & Electronic Engineering",
year="in press",
publisher="Zhejiang University Press & Springer",
doi="https://doi.org/10.1631/FITEE.2400144"
}

%0 Journal Article
%T Sora for foundation robots with parallel intelligence: three world models, three robotic systems
%A Lili FAN
%A Chao GUO
%A Yonglin TIAN
%A Hui ZHANG
%A Jun ZHANG
%A Fei-Yue WANG
%J Frontiers of Information Technology & Electronic Engineering
%P 917-923
%@ 2095-9184
%D in press
%I Zhejiang University Press & Springer
doi="https://doi.org/10.1631/FITEE.2400144"

TY - JOUR
T1 - Sora for foundation robots with parallel intelligence: three world models, three robotic systems
A1 - Lili FAN
A1 - Chao GUO
A1 - Yonglin TIAN
A1 - Hui ZHANG
A1 - Jun ZHANG
A1 - Fei-Yue WANG
J0 - Frontiers of Information Technology & Electronic Engineering
SP - 917
EP - 923
%@ 2095-9184
Y1 - in press
PB - Zhejiang University Press & Springer
ER -
doi="https://doi.org/10.1631/FITEE.2400144"

Abstract
Chinese Summary
Academic Network
Reviewer Comment

Abstract: This paper outlines the initial steps and basic framework for developing foundation/infrastructure robots/robotics based on foundation models and parallel intelligence, as well as the potential applications of new artificial intelligence (AI) techniques such as AlphaGO, ChatGPT, and Sora.

基于Sora的平行智能基础机器人：三个世界模型，三种机器人系统

范丽丽¹，郭超²，田永林²，张慧³，张俊⁴，王飞跃²
¹北京理工大学信息与电子学院，中国北京市，100081
²中国科学院自动化研究所复杂系统管理与控制国家重点实验室，中国北京市，100190
³北京交通大学计算机与信息技术学院，中国北京市，100044
⁴武汉大学电气工程学院，中国武汉市，430072
摘要：本文概述了基于基础模型和并行智能开发基础、基础设施机器人、机器人技术的初始步骤和基本框架，以及新型人工智能技术（如AlphaGO、ChatGPT和Sora）的潜在应用。

关键词组：Sora；平行智能；基础模型；平行机器人

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Bai TX, Wang S, Shen Z, et al., 2017. Parallel robotics and parallel unmanned systems: framework, structure, process, platform and applications. Acta Autom Sin, 43(2):161-175 (in Chinese).

[2]Fan LL, Cao DP, Zeng CX, et al., 2023a. Cognitive-based crack detection for road maintenance: an integrated system in cyber-physical-social systems. IEEE Trans Syst Man Cybern Syst, 53(6):3485-3500.

[3]Fan LL, Zeng CX, Li YJ, et al., 2023b. GRC-Net: Fusing GAT-based 4D Radar and Camera for 3D Object Detection. SAE Technical Paper 2023-01-7088.

[4]Fan LL, Zeng CX, Meng ZL, et al., 2024a. A secured vehicle brain: DAO-based collaborative perception and decision-making systems for intelligent vehicles in CPSS. IEEE Trans Intell Veh, 9(1):52-54.

[5]Fan LL, Wang JH, Chang YM, et al., 2024b. 4D mmWave radar for autonomous driving perception: a comprehensive survey. IEEE Trans Intell Veh, early access.

[6]Fan LL, Zeng CX, Wang YT, et al., 2024c. Social radars: finding targets in cyberspace for cybersecurity. IEEE/CAA J Autom Sin, 11(2):279-282.

[7]Guo C, Bai TX, Wang X, et al., 2022. ShadowPainter: active learning enabled robotic painting through visual measurement and reproduction of the artistic creation process. J Intell Robot Syst, 105(3):61.

[8]Guo C, Dou Y, Bai TX, et al., 2023a. ArtVerse: a paradigm for parallel human-machine collaborative painting creation in metaverses. IEEE Trans Syst Man Cybern Syst, 53(4):2200-2208.

[9]Guo C, Lu Y, Dou Y, et al., 2023b. Can ChatGPT boost artistic creation: the need of imaginative intelligence for parallel art. IEEE/CAA J Autom Sin, 10(4):835-838.

[10]Hobbes T, 2017. Leviathan. Penguin Classics. Available from https://www.penguin.co.uk/books/263235/leviathanby-hobbes-thomas/9780141395098 [Accessed on Jan. 20, 2024].

[11]Li L, Lin YL, Zheng NN, et al., 2017. Parallel learning: a perspective and a framework. IEEE/CAA J Autom Sin, 4(3):389-395.

[12]Li X, Tian YL, Ye PJ, et al., 2023. A novel scenarios engineering methodology for foundation models in metaverse. IEEE Trans Syst Man Cybern Syst, 53(4):2148-2159.

[13]Li X, Miao QH, Li LX, et al., 2024. Sora for senarios engineering of intelligent vehicles: V&V, C&C, and beyonds. IEEE Trans Intell Veh, early press.

[14]Malik AA, Brem A, 2021. Digital twins for collaborative robots: a case study in human-robot interaction. Robot Comput Integr Manuf, 68:102092.

[15]Miao QH, Lv YS, Huang M, et al., 2023. Parallel learning: overview and perspective for computational learning across Syn2Real and Sim2Real. IEEE/CAA J Autom Sin, 10(3):603-631.

[16]Qin R, Wang FY, Zheng XL, et al., 2024. Sora for computational social systems: from counterfactual experiments to artificiofactual experiments with parallel intelligence. IEEE Trans Comput Soc Syst, 11(2):1531-1550.

[17]Shen ZP, Zhou GZ, Huang HL, et al., 2024. Convex optimization-based trajectory planning for quadrotors landing on aerial vehicle carriers. IEEE Trans Intell Veh, 9(1):138-150.

[18]Tian YL, Wang JG, Wang YT, et al., 2022. Federated vehicular Transformers and their federations: privacy-preserving computing and cooperation for autonomous driving. IEEE Trans Intell Veh, 7(3):456-465.

[19]Tian YL, Li X, Zhang H, et al., 2023a. VistaGPT: generative parallel transformers for vehicles with intelligent systems for transport automation. IEEE Trans Intell Veh, 8(9):4198-4207.

[20]Tian YL, Zhang XJ, Wang X, et al., 2023b. ACF-Net: asymmetric cascade fusion for 3D detection with LiDAR point clouds and images. IEEE Trans Intell Veh, early access.

[21]Wang FY, 2004. Artificial societies, computational experiments, and parallel systems: a discussion on computational theory of complex social-economic systems. Compl Syst Compl Sci, 1(4):25-35 (in Chinese).

[22]Wang FY, 2007. Toward a paradigm shift in social computing: the ACP approach. IEEE Intell Syst, 22(5):65-67.

[23]Wang FY, 2021. Parallel philosophy: origin and goal of intelligent industries and smart economics. Bull Chin Acad Sci, 36(3):308-318 (in Chinese).

[24]Wang FY, 2022. Parallel management: the DAO to smart ecological technology for complexity management intelligence. Acta Autom Sin, 48(11):2655-2669 (in Chinese).

[25]Wang FY, 2023a. Infrastructural vehicles: the TAO from infrastructural intelligence to foundational mobility and services. IEEE Trans Intell Veh, 8(12):4667-4670.

[26]Wang FY, 2023b. New control paradigm for Industry 5.0: from big models to foundation control and management. IEEE/CAA J Autom Sin, 10(8):1643-1646.

[27]Wang FY, Lv C, 2023. Foundation vehicles: from foundation intelligence to foundation transportation for future mobility. IEEE Trans Intell Veh, 8(10):4287-4291.

[28]Wang FY, Wang YT, 2024. Digital scientists and parallel sciences: the origin and goal of AI for science and science for AI. Bull Chin Acad Sci, 39(1):27-33 (in Chinese).

[29]Wang FY, Qin R, Chen YZ, et al., 2021. Federated ecology: steps toward confederated intelligence. IEEE Trans Comput Soc Syst, 8(2):271-278.

[30]Wang FY, Miao QH, Li X, et al., 2023. What does ChatGPT say: the DAO from algorithmic intelligence to linguistic intelligence. IEEE/CAA J Autom Sin, 10(3):575-579.

[31]Wang FY, Miao QH, Li LX, et al., 2024. When does Sora show: the beginning of TAO to imaginative intelligence and scenarios engineering. IEEE/CAA J Autom Sin, 11(4):809-815.

[32]Wang JC, Tang Y, Hare R, et al., 2023. Parallel intelligent education with ChatGPT. Front Inform Technol Electron Eng, early access.

[33]Wang X, Chen YD, Zhu WW, 2022. A survey on curriculum learning. IEEE Trans Patt Anal Mach Intell, 44(9):4555-4576.

[34]Wang XX, Yang J, Wang YT, et al., 2023. Steps toward Industry 5.0: building “6S” parallel industries with cyber-physical-social intelligence. IEEE/CAA J Autom Sin, 10(8):1692-1703.

[35]Yang J, Wang X, Tian YL, et al., 2023. Parallel intelligence in CPSSs: being, becoming, and believing. IEEE Intell Syst, 38(6):75-80.

[36]Ye PJ, Wang FY, 2022. Parallel population and parallel human—a cyber-physical social approach. IEEE Intell Syst, 37(5):19-27.

[37]Ye PJ, Wang X, Zheng WB, et al., 2022. Parallel cognition: hybrid intelligence for human-machine interaction and management. Front Inform Technol Electron Eng, 23(12):1765-1779.

[38]Yu HK, Liu XY, Tian YL, et al., 2024. Sora-based parallel vision for smart sensing of intelligent vehicles: from foundation models to foundation intelligence. IEEE Trans Intell Veh, early access.

[39]Zhou J, Ke P, Qiu XP, et al., 2023. ChatGPT: potential, prospects, and limitations. Front Inform Technol Electron Eng, early access.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

- Go to

基于Sora的平行智能基础机器人：三个世界模型，三种机器人系统

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference