gStreamer and Mission Planner HUD

flyingw

Just saw in the ArduPilot Ground Control site for Mission Planner that Mr. Oborne has made it possible now to stream UDP video directly into the Mission Planner HUD!

Configure the Pi to send the video on UDP port 5600 as this is where MP listens. Update gstreamer in your GCS PC to version 1.9.2 (I used the 32-bit version and it worked; I did not try the 64-bit version).

Turn on Mission Planner, then boot the Pi with the video pre-configured to come on when it boots. After a few seconds the video comes up in the HUD.

Brilliant! Thanks Michael Oborne.

Sinamics

flyingw Before I got the parameters sorted I activated the Pi and the Mission Planner PC and I got a still picture from the picam superimposed directly within the Mission Planner HUD.

Interesting.
I havent seen the last updates Michael Oborne has implemented into Mission planner. It might be that MP support gstreamer directly, that would be awesome.

EDIT#1
See this thread flyingw for further post about mission planner HUD with gStreamer

mocart

flyingw Which Windows version have you got?

Sinamics

flyingw
That is just awesome. Did you test this yourself?

PS! I moved this post to a seperated thread.

flyingw

It worked with Windows 10.

mocart

32 / 64 bit ?

flyingw

Windows 10 64-bit, with gstreamer 1.9.2 32-bit.

flyingw

Details here:

http://discuss.ardupilot.org/t/udp-video-stream-in-mp-hud/16003/4

mocart

Thanks ! I did downgrade gstreamer to ver.1.9.2/64bit and it works also for me 🙂

Artem_Bulashev

mocart how do you set it up? Your ground station has to have static up for that... so if you take your laptop out to the field and use your iPhone for internet as hot spot, how can you have UDP video stream?

Am I wrong that UDP steam is always reversed (so Pi streams to one exact IP, which has to be your ground station)...

What I like right now, I can access my video stream from multiple devises without reconfiguring Pi for new ip.

mocart

Artem_Bulashev hello Artem. Could you let me know if you can record HUD when gstreamer pipline is alive?
this option is available when you click right mouse buton over video preview frame. It does not work for me but I would like double chcek it with someone else
thanks
Adam

mocart

Hey Artem. First of all IP address on ground station side is dymamic but it does not change so often. If connection is dropped you can expect to get a new IP and you can setup IP on drone side before flight. From the other hand I own auto-connect modem with hot-spot option. I was looking for this modem for a long of time and now I can have LTE connection and WiFi hotspot at the same time. In this case I can access copter anytime if my mobile GS is in the range.

I agree with you that better option would be to have possibility to access to the PI pipeline without static IP form any other device. But Im little afraid that with 4G/LTE networks you wont find more effective solution that allow you to transfer so many data to end device in such sort time. Before this config I was using video cloud solution where latency was huge camparing UDP but cloud allowed me to access drone video feed from any devide.

If you are able to send pipeline as quickly as udp in different way please let me know. I agree with you that solution base on UDP is hard to be configured by end user out WF-FI range. I will have this problem probably If i deceide to migrate to huawei modem without Wi-Fi. \Right now its fine form me and I `m happy to have digital preview from copter

mocart

Finally I have all working connections at once available in mission planner: gstreamer video in HUD panel , UDP telemetry + joystick. Sample there:

https://youtu.be/Jz98rlhAyy8.

The only one problem that I found is related missing joystick configuration after MP restart. I need to setup joystick everytime when I launch MP.
Overall It`s looks like Mission Planner has been fixed and support all those functions.

bernardino

mocart

Hi mocart did you manage to record from mission planner and if yes how did you do it.

Thanks,
B

mocart

hello.
Recording fuction (directly from HUD panel) is available currently in mission planner under right mouse button menu. ... is available but quality is very poor.
To record HUD with telemetry on screen just click right mouse button on HUD panel then select /video/record HUD as a avi. Its works but as I noted quality is not acceptable. You can record only with 10 frames/secound avi file and this is limitation defined by autor mission planner.
I asked how to remove this limitation some time ago on ardupilot forum and answer from MP author you can find under following topic:
link to Michael Oborne answer
So I think better solution can be the latest XBOX application in Windows 10 that allows you record HD movies in very easy way or other 3th parity tool.

bernardino

mocart
Thank you once again 😉
ill try windows 10 HD rec...
😉
Best regards

AntonioPolicicchio

I'm struggling to let the config work.
I'm using raspivid and RPI cam to stream (using gstreamer) form drone to Mission Planner (drone acts as Access Point via RPi) using TCP and UDP.
I succesfully tested TCP on laptop but it does not work on MP:
on drone (e.g. RPi3): raspivid -n -w 1280 -h 720 -rot 180 -b 10000000 -fps 30 -t 0 -ex antishake -awb auto -o - | gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=10 pt=96 ! gdppay ! tcpserversink host=0.0.0.0 port=9010

on laptop: gst-launch-1.0 -v tcpclientsrc host=10.0.1.1 port=9010 ! gdpdepay ! rtph264depay ! h264parse ! queue ! avdec_h264 ! videoconvert ! autovideosink sync=false

but on MP it does not work. Please may you share the script both on RPi side and MP side? I'm using gstreamer 1.9.2 and MP 1.3.52

thanks

mocart

AntonioPolicicchio Hello Sir. In my case I do not have 2 sim cards with public IP so I decided to run setup base on UDP connection only, not TCP.

on drone side you can type:

raspivid -n -w 864 -h 480 -b 750000 -fps 25 -t 0 -o - | \
gst-launch-1.0 --gst-debug-level=0 -v \
fdsrc ! \
h264parse ! \
rtph264pay config-interval=10 pt=96 ! \
udpsink host=xxx.xxx.xxx.xxx port=5600

where xxx.xxx.xxx.xxx should be address of your MP

on laptop (MP side) you can test pipleline using following script:

c:/gstreamer/1.0/x86_64/bin/gst-launch-1.0.exe -e -v udpsrc port=5600 ! application/x-rtp, payload=96 ! rtpjitterbuffer ! rtph264depay ! avdec_h264 ! fpsdisplaysink sync=false text-overlay=false

change path if you are using 32bit version.