kxzk/r2-drone

🚁 turning a drone into a pokemon

R2

AI droid, à la R2D2.

TODO

• arduino chatgpt chatbot w/ speaker
• replace voice sensor with arduino 33 ble sense w/ TinyML
• add opencv using C++ from macbook for drone camera feed
• image segmentation via SAM or FastSAM
• add chatGPT instruction generation using C++ Tello API

drone

• tello drone

papers

• ChatGPT for Robotics: Design Principles and Model Abilities
• Unifying Foundation Models with Quadrotor Control for Visual Tracking Beyond Object Categories
• VOYAGER: An Open-Ended Embodied Agent with Large Language Models
• HABITAT 3.0: A CO-HABITAT FOR HUMANS, AVATARS AND ROBOTS
• EUREKA: HUMAN-LEVEL REWARD DESIGN VIA CODING LARGE LANGUAGE MODELS
• SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understanding

arduino reference

• arduino nano esp32 cheatsheet
• arduino nano esp32 datasheet
• arduino libraries documentation
• gravity: voice sensor github
• gravity: voice sensor docs

quadcopter math/physics

• quadcopter dynamics and simulation
• 3D quadcopter, derivation, simulation, animation

c++ libraries

• opencv
• ftxui
• imtui

references

• prompcraft robotics
• djitellopy lib
• tello sdk v1.3
• tello python lib
• tello async lib
• tello python examples
• tello arduino
• tello cpp lib