Hi everyone,
I am new in this forum but I am a Open Plotter happy user , on my sailor, from several years.
I am an open source fanatic and play a lot with Arduino, ESP32, Raspbnerry ecc.
Recently I got an Nvidia Jetson Nano board and I was impressed by the potential of this board. Right away I wonder about a marine application and of course someone had just already done it :
https://sea.ai/?utm_source=google&utm_me...gHEALw_wcB
They use a more powerful Nvidia board (1000 Euros) but I believe that it could be possible do something nice also with Jetson Nano ( 200 Euros).
I am looking for people interested in a AI marine open souce project , better if more AI skilled (sorry I am studing, but at this moment an AI newbie)
thanks, best regards
Hi robybart,
I'm actually planning to put something like this on my boat. I have 4 Jetson Orin NX on Waveshare Jetson-IO boards, that I put in a wooden Box, alongside the motor controller and the pypilot. I'm still in the hardware phase, but I'm going to go with the nvidia jetson containers and building a custom dataset, once I'm on the boat.
Here is a nice video, outlining the process of training custom models on the jetson nano, so this certainly seems doable. What I'm unsure about, is how I can then take action in pypilot, since it will probably only relate to steering, not motor speed.
https://www.youtube.com/watch?v=2XMkPW_sIGg
This repo is also a good starting point for ML on Jetson:
https://github.com/dusty-nv/jetson-containers
(2024-05-17, 11:51 AM)hoinzy Wrote: [ -> ]Hi robybart,
I'm actually planning to put something like this on my boat. I have 4 Jetson Orin NX on Waveshare Jetson-IO boards, that I put in a wooden Box, alongside the motor controller and the pypilot. I'm still in the hardware phase, but I'm going to go with the nvidia jetson containers and building a custom dataset, once I'm on the boat.
Here is a nice video, outlining the process of training custom models on the jetson nano, so this certainly seems doable. What I'm unsure about, is how I can then take action in pypilot, since it will probably only relate to steering, not motor speed.
https://www.youtube.com/watch?v=2XMkPW_sIGg
This repo is also a good starting point for ML on Jetson:
https://github.com/dusty-nv/jetson-containers
Hi hoinzy,
nice to meet you and thanks for info and links. Actually I thought to a system that send alarms seeing an obstacle but you are right to head toward to a system that can react autonomously.
I am at very beginning and I am starting with basic nvidia sample (like xnxpylot) and try to adapt to sea environment, but it is a long way (at least for me)
There is some preliminary code in pypilot for tensorflow control... but nothing really proven and I have so many distractions I have not managed to develop it further.
Detecting obstacles is a completely different problem and not really one of the autopilot at least at this stage, but using machine learning to dynamically fine-tune control is definitely something i would like to see in pypilot.