ep15 - Davide Scaramuzza: Vision-Based Navigation, Agile Drone Racing, Perception-Aware Control, and Event Cameras
Description
In this episode, we dive into the world of flying robots with Davide Scaramuzza (University of Zürich), a leading expert in vision-based navigation, agile drone racing, perception-aware control, and the cutting-edge neuromorphic technology of event cameras. We explore the challenges of autonomous navigation in GPS-denied environments, the excitement of drone racing, the future of robotics, and the revolutionary potential of event-based cameras.
Outline
00:58 - Magic
02:58 - Visual SLAM and autonomous driving
05:32 - Flying without a GPS
11:01 - sFly project - Vision-based autonomous flight
18:14 - Next steps
22:30 - Drone racing and agile flying
51:30 - Perception-aware control
58:47 - On robustness
1:02:46 - Risk-aware control and illumination
1:07:52 - Event-based cameras
1:15:37 - Agile flying with event-based cameras
1:19:28 - Event-based control and neuromorphic technology
1:25:42 - Future of robotics
1:30:55 - Advice to future students
Links
- Davide’s website: https://rpg.ifi.uzh.ch/people_scaramuzza.html
- Copperfield at Niagara Falls: https://tinyurl.com/4wydc2s3
- Ambitious card: https://tinyurl.com/5723kf8s
- R. Siegwart: https://tinyurl.com/mr3sn472
- sFly project: https://tinyurl.com/43hrffcx
- DARPA challenge: https://tinyurl.com/5n7dnkmz
- PTAM: https://tinyurl.com/epypbbmz
- ROS: https://www.ros.org/
- Acado: https://acado.github.io/
- Drone racer - Nature paper: https://tinyurl.com/2rws2pjm
- Drone racing - video: https://t.co/g9ckjV3O3N
- Drone racing league: https://www.drl.io/
- Time-optimal MPCC: https://tinyurl.com/3udn5raf
- Event-based vision: https://rpg.ifi.uzh.ch/research_dvs.html
- T. Delbruck: https://tinyurl.com/4acymkxf
- Event-based vision: a survey: https://tinyurl.com/2hwcmk9t
- Event based vision and control paper:
Support the showPodcast info
Podcast website: https://www.incontrolpodcast.com/
Apple Podcasts: https://tinyurl.com/5n84j85j
Spotify: https://tinyurl.com/4rwztj3c
RSS: https://tinyurl.com/yc2fcv4y
Youtube: https://tinyurl.com/bdbvhsj6
Facebook: https://tinyurl.com/3z24yr43
Twitter: https://twitter.com/IncontrolP
Instagram: https://tinyurl.com/35cu4kr4
Acknowledgments and sponsors
This episode was supported by the National Centre of Competence in Research on «Dependable, ubiquitous automation» and the IFAC Activity fund. The podcast benefits from the help of an incredibly talented and passionate team. Special thanks to L. Seward, E. Cahard, F. Banis, F. Dörfler, J. Lygeros, ETH studio and mirrorlake . Music was composed by A New Element.
Outline00:00 - Intro02:14 - Early steps in control05:36 - L1 control17:09 - Relay feedback systems24:32 - Agile robotic maneuvers29:31 - Abstractions and models41:59 - Causality49:35 - Markets and power grids1:00:20 - Role of network structure1:05:03 - Data, systems, and society1:16:17 - On...
Published 10/17/24
Outline00:00 - Intro00:49 - Early education and PhD in control10:35 - Non-negative linear algebra & modelling uncertainty principle22:50 - Influence of Willems & the Frisch scheme34:27 - Subspace identification & stochastic behavioural system theory38:39 - Stanford experience with...
Published 08/21/24