- Hardware accelerated ROS 2 pipelines
- Towards the Robotic Processing Unit (RPU)
- Arm sees support path to heterogeneous compute
- Researchers From Tsinghua University Propose ‘Stochastic Scheduled SAM’ (SS-SAM): A Novel And Cost-Efficient Training Scheme For Deep Neural Networks
- Hardware Mitigation on Intel, Arm, and AMD CPUs Shown Ineffective against Spectre v2
- A new approach to tackle optimization problems using Boltzmann machines
- New Platform Lets GPUs and FPGAs Use Intel Optane Memory Modules
ROS 2 Hardware Acceleration Working Group
Source: ROS Discourse, March 31, 2022 
We discuss the group's progress during the last month showing how ROS 2 perception pipelines can run in GPUs and FPGAs, contributing firmware layers for NVIDIA boards and comparing results with other hardware accelerators. We also review the methodology for ROS 2 Hardware Acceleration and REP-2008 and then discuss a new subproject of the group: the Robotic Processing Unit (RPU). The session will also includes a guest talk provided by Hyunjong Choi who tells us about how although ROS 2 claims to enhance the real-time capability, ensuring predictable end-to-end chain latency still remains a challenging problem. To address it, their group proposes a new priority-driven chain-aware scheduler for the ROS 2 wherein callbacks are prioritized based on the given timing requirements of the corresponding chains so that the end-to-end latency of critical chains can be improved with a predictable bound.
Source: ROS Discourse, March 29, 2022 
The ROS2 Hardware Acceleration WG has been driving the creation of open hardware acceleration solutions for ROS2. We proposed an open architecture and conventions for hardware acceleration extending ROS2 core layers, demonstrated 5-10x speedups for individual ROS Nodes and Components, and recently showed how to accelerate ROS2 perception pipelines by increasing the perception throughput with simple graphs.
Source: ROS Discourse, March 29, 2022 [3:1]
The Robotic Processing Unit (RPU) are robot-specific processors that map ROS computational graphs efficiently to CPUs, FPGAs and GPUs to obtain best peformance. The vision is that RPUs will empower robots with the ability to react faster, consume less power, and deliver additional real-time capabilities.
Source: The Register, March 29, 2022 
Arm says heterogeneous compute architectures – those with a mix of CPUs, GPUs, DPUs, and other processor types – pose a challenge for software developers, and greater multi-architecture support is needed to address this.
Researchers From Tsinghua University Propose ‘Stochastic Scheduled SAM’ (SS-SAM): A Novel And Cost-Efficient Training Scheme For Deep Neural Networks
Source: MarkTechPost, March 27, 2022 
Deep Neural Networks (DNNs) have excelled at solving complex real-world problems. Tsinghua University's research team proposes novel and effective DNN training strategy. Optimizers would run a Bernoulli trial using a scheduling function at each step in the SS-SAM method.
Source: InfoQ, March 28, 2022 
Security researchers from Vrije Universiteit Amsterdam showed the hardware mitigations to Spectre v2 attacks implemented in both Intel and Arm processors have fundamental flaws that make them vulnerable to branch history injection.
Source: Tech Xplore, March 28, 2022 
Ising machines are promising tools for solving combinatorial optimization problems and creating artificial models of the brain. A team of researchers from the University of California, Berkeley has explored potential of Ising machines in great depth. Their most recent paper introduced a new Ising machine comprised of many restricted Boltzmann machines (RBMs). Ising machines could be used to solve a wide range of complex real-world problems more rapidly and efficiently.
Source: Tom's Hardware, March 24, 2022 
Intel, Liqid, MemVerge, and others have developed a platform solution. It allows to pool system memory and storage-class memory (SCM) like Intel Optane Persistent Memory. System memory can be used by CPUs, FPGAs, and other accelerators. Composable big memory solutions are an important part of an overall CDI architecture.
Source: Robohub, March 23, 2022 
Machine Learning at the edge is gaining steam. BrainChip is accelerating this with their Akida architecture, which is mimicking the human brain by incorporating the 5 human senses on a machine learning-enabled chip.
Their chips will let roboticists and IoT developers run ML on device for low latency, low power, and low-cost machine learning-enabled products. This opens up a new product category where everyday devices can affordably become smart devices.
Hardware Acceleration in Robotics Newsletters
- Hardware Acceleration in Robotics #2 - Nvidia Isaac ROS GEMs, Nvidia H100, updates to CUDA-X Libraries and more
- Hardware Acceleration in Robotics #1 - ROS2 for Self-Driving Cars, Intel world fastest FPGAs, Nvidia GTC and more
ROS 2 Hardware Acceleration Working Group meetings
- Hardware Acceleration WG, meeting #6
- Hardware Acceleration WG, meeting #5
- Hardware Acceleration WG, meeting #4
- Hardware Acceleration WG, meeting #3
- Hardware Acceleration WG, meeting #2
- Hardware Acceleration WG, meeting #1
Hardware Acceleration WG, meeting #7. https://discourse.ros.org/t/hardware-acceleration-wg-meeting-7/24603 ↩︎
Acceleration Robotics. Hardware accelerated ROS 2 pipelines. https://news.accelerationrobotics.com/hardware-accelerated-ros2-pipelines#hardware-accelerated-ros-2-pipelines ↩︎
Mayoral, V. (2022, March 29). Hardware accelerated ROS 2 pipelines and towards the robotic processing unit (RPU). ROS Discourse. https://discourse.ros.org/t/hardware-accelerated-ros-2-pipelines-and-towards-the-robotic-processing-unit-rpu/24889 ↩︎ ↩︎
Acceleration Robotics. Robotic Processing Unit (RPU). https://news.accelerationrobotics.com/hardware-accelerated-ros2-pipelines/#new-subproject-robotic-processing-unit-rpu ↩︎
Robinson, D. (2022, March 29). Arm says devs need better multi-architecture support. The Register: Enterprise Technology News and Analysis. https://www.theregister.com/2022/03/29/arm_heterogeneous_compute/ ↩︎
Kumari, A. (2022, March 27). Researchers from Tsinghua University propose 'Stochastic scheduled Sam' (SS-Sam): A novel and cost-efficient training scheme for deep neural networks. MarkTechPost. https://www.marktechpost.com/2022/03/27/researchers-from-tsinghua-university-propose-stochastic-scheduled-sam-ss-sam-a-novel-and-cost-efficient-training-scheme-for-deep-neural-networks/ ↩︎
Simone, S. (2022, March 28). Hardware mitigation on Intel, arm, and AMD CPUs shown ineffective against spectre v2. InfoQ. https://www.infoq.com/news/2022/03/branch-history-injection-spectre/?topicPageSponsorship=765d2b7a-eb7d-4ecd-a9fa-dc3b1997e662 ↩︎
Fadelli, I. (2022, March 28). A new approach to tackle optimization problems using Boltzmann machines. Tech Xplore - Technology and Engineering news. https://techxplore.com/news/2022-03-approach-tackle-optimization-problems-boltzmann.html ↩︎
Shilov, A. (2022, March 24). New platform lets GPUs and FPGAs use Intel Optane memory modules Video. Tom's Hardware. https://www.tomshardware.com/news/new-platform-lets-gpus-fpgas-use-intel-optane-memory-modules ↩︎
Mey, A. (2022, March 23). Mimicking the five senses, on chip. Robohub - Connecting the robotics community to the world. https://robohub.org/mimicking-the-five-senses-on-chip/ ↩︎