Home Creators Posts Import Register Favorites Logout
haven't archived this post yet. have a subscription? use the importer!

Content

Yes it's another transfer-learning trained deep-learning model, but this time it a little more complicated. It works pretty well with a bit of tuning, but some mechanical issues have emerged with the dog. 

I'm considering having the new pulleys made in metal somewhere and then re-tensioning the knee pulleys and seeing how the motor giving me some trouble looks. Ideally I think it could be time to consider openDog 2.5 with bigger motors and higher reduction ratios, although I'd like to keep this one in one piece and in a working state.  Having more stability in its legs is going to be a big help toward getting any navigation working, otherwise any estimates of travel are going to be tricky.

Files

Previews only

openDog V2 #8 Hand Gesture Recognition

Get complete digital privacy for less than $3 a month AND 3 extra months for free! http://www.privateinternetaccess.com/JamesBruton I thought it would be nice if openDog could respond to hand gesture signals instead of driving with the remote control. I really wanted to try to train a deep learning model to do this also so I can see how well it can distinguish between hand gestures. I used an NVIDIA Jetson Nano and used transfer learning with the tools provided by NVIDIA to retrain an existing vision detection model. For now I'm using digital pins to convey the five signals from the python code to the Teensy which controls the robot, eventually I'll wrap the machine vision script in a ROS wrapper to control the robot. You can support me on Patreon or buy my Merchandise: *************************** Patreon: https://www.patreon.com/xrobots Merchandise: https://teespring.com/stores/james-bruton *************************** Affiliate links - I will get some money of you use them to sign up or buy something: *************************** Matterhackers 3D printing supplies: http://www.matterhackers.com?aff=7500 Music for your YouTube videos: http://share.epidemicsound.com/xrobots *************************** Other socials: *************************** Instagram: https://www.instagram.com/xrobotsuk Facebook: https://www.facebook.com/xrobotsuk/ Twitter: https://twitter.com/xrobotsuk *************************** CAD and Code for my projects: https://github.com/XRobots Huge thanks to my Patrons, without whom my standard of living would drastically decline. Like, inside out-Farm Foods bag decline. Plus a very special shoutout to Lulzbot, Inc who keep me in LulzBot 3D printers and support me via Patreon. HARDWARE/SOFTWARE Below you can also find a lot of the typical tools, equipment and supplies used in my projects: Filament from: https://www.3dfuel.com/ Lulzbot 3D Printers: http://bit.ly/2Sj6nil Lincoln Electric Welder: https://bit.ly/2Rqhqos CNC Router: https://bit.ly/2QdsNjt Ryobi Tools: http://bit.ly/2RhArcD Axminster Micro Lathe: http://bit.ly/2Sj6eeN 3D Printer Filament: http://bit.ly/2PdcdUu Soldering Iron: http://bit.ly/2DrNWDR Vectric CNC Software: http://bit.ly/2zxpZqv Why not join my community, who are mostly made up of actual geniuses. There’s a Facebook group and everything: https://www.facebook.com/groups/287089964833488/ XROBOTS Former toy designer, current YouTube maker and general robotics, electrical and mechanical engineer, I’m a fan of doing it yourself and innovation by trial and error. My channel is where I share some of my useful and not-so-useful inventions, designs and maker advice. Iron Man is my go-to cosplay, and 3D printing can solve most issues - broken bolts, missing parts, world hunger, you name it. XRobots is the community around my content where you can get in touch, share tips and advice, and more build FAQs, schematics and designs are also available.

Comments

Richard Jelbert

The gesture control works really well and from just a few training images. Very cool.

Karl Machen

Could it be worth having subscribers submit images of gestures to an email address or such for additional data? Open dog is the most exciting thing happening on the maker channels at the moment. Excellent work James!

XRobots

I was wondering if there is an image library used in AI research somewhere - the original NVIDIA models are trained on some image sets published by Google. For now it's only me operating it, but it's easy enough for anyone to train their own.

Scott Cress

Love the paint job in the studio.

Scott Cress

The one skill that the dog needs is a simple follow command. Needs to be able just match pace with you and walk behind, not get hung up on objects. Verbal commands as well as visual, will make any robot infinitely more usable. But I'm loving these steps. Hopefully the hardware bugs can get worked out.

XRobots

Pretty reliable - as long as you can align your hand with the camera view properly. More training data from more people would make the results even better of course.