Add an Iridescence live viewer alongside RVIZ with support for performance metrics. - #461
Open
DethCubeHax wants to merge 2 commits into
Open
Add an Iridescence live viewer alongside RVIZ with support for performance metrics.#461DethCubeHax wants to merge 2 commits into
DethCubeHax wants to merge 2 commits into
Conversation
The mapping node is unchanged. LIO and VIO timings are published on /fast_livo/diagnostics for the HUD.
Author
|
Please feel free to suggest anything :)) I just added a few things in the diagnostics that I thought would help analyze things like potential drift, timings and performance. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
This PR adds an optional Iridescence live viewer (
fastlivo_viewer) besides the vanilla RVIZ viewer.The viewer shows the registered cloud in RGB or as an XYZ heatmap, places the camera image in the HUD, and plots LIO/VIO timings, residual, and EKF 1-sigma from quantities the estimator already produces. On a GTX 1650 Ti, over 180 s on the provided HKisland03 dataset, visualizer CPU was about 55% lower and RAM about 65% lower than stock RViz.
Install steps are in README section 2.3.
Changes
viewer:=truestartsfastlivo_viewer. The viewer draws/cloud_registeredin 50k-point chunks, which keeps draw cost bounded as the map grows. Colour is RGB when the cloud carries colour, or a turbo heatmap on X, Y, or Z whose range is set by Tukey inliers, so the scale follows the bulk of the samples. Green/pathand pose axes can follow the vehicle, with orbit as left drag to rotate, middle or right to pan, and scroll to zoom./rgb_imgsits in the HUD under the host stats, with a scale slider. CPU, GPU, GPU memory, host memory, and FPS are shown as numbers, and a plots window holds LIO/VIO time, residual, feature counts, and position / rotation / velocity 1-sigma. Those series are published on/fast_livo/diagnosticsafter every LIO and VIO update.roslaunchviewer:=truerviz:=falseScreenshots
RGB:
Heatmap:
Comparison
viewer:=true)nice rviz -dofficial.rvizfastlivo_viewerrviz:=true(default)viewer:=truerviz:=falserviz:=falseBelow is a comparison between the two visualizers, and both used the same bag and hover skip (
rosbag play --clock -s 72 --duration 180). Both runs were Docker--gpus allon a GTX 1650 Ti (driver 595.84), one run each after the bag cache was already warm.System Specifications
Results
Please note that although the FPS dropped by 18% in case of Iridescence, chances are it's because my laptop is about 6 years old and running at 87°C lol, it's barely holding up these days. The results should be reproduceable on any system to validate.