MRPT
2.0.4
|
Declares a class derived from "CObservation" that encapsules an omnidirectional RGBD measurement from a set of RGBD sensors.
This kind of observations can carry one or more of these data fields:
The coordinates of the 3D point cloud are in millimeters with respect to the RGB camera origin of coordinates
The 2D images and matrices are stored as common images, with an up->down rows order and left->right, as usual. Optionally, the intensity and confidence channels can be set to delayed-load images for off-rawlog storage so it saves memory by having loaded in memory just the needed images. See the methods load() and unload(). Due to the intensive storage requirements of this kind of observations, this observation is the only one in MRPT for which it's recommended to always call "load()" and "unload()" before and after using the observation, ONLY when the observation was read from a rawlog dataset, in order to make sure that all the externally stored data fields are loaded and ready in memory.
Classes that grab observations of this type are:
3D point clouds can be generated at any moment after grabbing with CObservationRGBD360::unprojectInto() and CObservationRGBD360::unprojectInto(), provided the correct calibration parameters.
Definition at line 83 of file CObservationRGBD360.h.
#include <mrpt/obs/CObservationRGBD360.h>
Public Member Functions | |
CObservationRGBD360 () | |
Default constructor. More... | |
~CObservationRGBD360 () override | |
Destructor. More... | |
void | rangeImage_setSize (const int HEIGHT, const int WIDTH, const unsigned sensor_id) |
Similar to calling "rangeImage.setSize(H,W)" but this method provides memory pooling to speed-up the memory allocation. More... | |
void | getSensorPose (mrpt::poses::CPose3D &out_sensorPose) const override |
A general method to retrieve the sensor pose on the robot. More... | |
void | setSensorPose (const mrpt::poses::CPose3D &newSensorPose) override |
A general method to change the sensor pose on the robot. More... | |
void | getDescriptionAsText (std::ostream &o) const override |
Build a detailed, multi-line textual description of the observation contents and dump it to the output stream. More... | |
template<class METRICMAP > | |
bool | insertObservationInto (METRICMAP *theMap, const mrpt::poses::CPose3D *robotPose=nullptr) const |
This method is equivalent to: More... | |
void | getSensorPose (mrpt::math::TPose3D &out_sensorPose) const |
A general method to retrieve the sensor pose on the robot. More... | |
void | setSensorPose (const mrpt::math::TPose3D &newSensorPose) |
A general method to change the sensor pose on the robot. More... | |
std::string | getDescriptionAsTextValue () const |
Return by value version of getDescriptionAsText(std::ostream&) More... | |
virtual mxArray * | writeToMatlab () const |
Introduces a pure virtual method responsible for writing to a mxArray Matlab object, typically a MATLAB struct whose contents are documented in each derived class. More... | |
Delayed-load manual control methods. | |
virtual void | load () const |
Makes sure all images and other fields which may be externally stored are loaded in memory. More... | |
virtual void | unload () |
Unload all images, for the case they being delayed-load images stored in external files (othewise, has no effect). More... | |
RTTI classes and functions for polymorphic hierarchies | |
mrpt::rtti::CObject::Ptr | duplicateGetSmartPtr () const |
Makes a deep copy of the object and returns a smart pointer to it. More... | |
Public Attributes | |
mrpt::system::TTimeStamp | timestamps [NUM_SENSORS] |
bool | hasRangeImage {false} |
true means the field rangeImage contains valid data More... | |
mrpt::math::CMatrix_u16 | rangeImages [NUM_SENSORS] |
If hasRangeImage=true, a matrix of floats with the range data as captured by the camera (in meters) More... | |
float | rangeUnits = 0.001f |
Units for integer depth values in rangeImages. More... | |
bool | hasIntensityImage {false} |
true means the field intensityImage contains valid data More... | |
mrpt::img::CImage | intensityImages [NUM_SENSORS] |
If hasIntensityImage=true, a color or gray-level intensity image of the same size than "rangeImage". More... | |
mrpt::img::TCamera | sensorParamss [NUM_SENSORS] |
Projection parameters of the 8 RGBD sensor. More... | |
float | maxRange {10.0f} |
The maximum range allowed by the device, in meters (e.g. More... | |
mrpt::poses::CPose3D | sensorPose |
The 6D pose of the sensor on the robot. More... | |
float | stdError {0.01f} |
The "sigma" error of the device in meters, used while inserting the scan in an occupancy grid. More... | |
Static Public Attributes | |
static const unsigned int | NUM_SENSORS = 2 |
Protected Member Functions | |
void | swap (CObservation &o) |
Swap with another observation, ONLY the data defined here in the base class CObservation. More... | |
CSerializable virtual methods | |
uint8_t | serializeGetVersion () const override |
Must return the current versioning number of the object. More... | |
void | serializeTo (mrpt::serialization::CArchive &out) const override |
Pure virtual method for writing (serializing) to an abstract archive. More... | |
void | serializeFrom (mrpt::serialization::CArchive &in, uint8_t serial_version) override |
Pure virtual method for reading (deserializing) from an abstract archive. More... | |
CSerializable virtual methods | |
virtual void | serializeTo (CSchemeArchiveBase &out) const |
Virtual method for writing (serializing) to an abstract schema based archive. More... | |
virtual void | serializeFrom (CSchemeArchiveBase &in) |
Virtual method for reading (deserializing) from an abstract schema based archive. More... | |
Protected Attributes | |
bool | m_points3D_external_stored {false} |
If set to true, m_points3D_external_file is valid. More... | |
std::string | m_points3D_external_file |
3D points are in CImage::getImagesPathBase()+<this_file_name> More... | |
bool | m_rangeImage_external_stored {false} |
If set to true, m_rangeImage_external_file is valid. More... | |
std::string | m_rangeImage_external_file |
rangeImage is in CImage::getImagesPathBase()+<this_file_name> More... | |
Data common to any observation | |
mrpt::system::TTimeStamp | timestamp {mrpt::system::now()} |
The associated UTC time-stamp. More... | |
std::string | sensorLabel |
An arbitrary label that can be used to identify the sensor. More... | |
mrpt::system::TTimeStamp | getTimeStamp () const |
Returns CObservation::timestamp for all kind of observations. More... | |
virtual mrpt::system::TTimeStamp | getOriginalReceivedTimeStamp () const |
By default, returns CObservation::timestamp but in sensors capable of satellite (or otherwise) accurate UTC timing of readings, this contains the computer-based timestamp of reception, which may be slightly different than timestamp. More... | |
RTTI stuff | |
using | Ptr = std::shared_ptr< mrpt::obs ::CObservationRGBD360 > |
using | ConstPtr = std::shared_ptr< const mrpt::obs ::CObservationRGBD360 > |
using | UniquePtr = std::unique_ptr< mrpt::obs ::CObservationRGBD360 > |
using | ConstUniquePtr = std::unique_ptr< const mrpt::obs ::CObservationRGBD360 > |
static const mrpt::rtti::TRuntimeClassId | runtimeClassId |
static constexpr const char * | className = "mrpt::obs" "::" "CObservationRGBD360" |
static const mrpt::rtti::TRuntimeClassId * | _GetBaseClass () |
static constexpr auto | getClassName () |
static const mrpt::rtti::TRuntimeClassId & | GetRuntimeClassIdStatic () |
static std::shared_ptr< CObject > | CreateObject () |
template<typename... Args> | |
static Ptr | Create (Args &&... args) |
template<typename Alloc , typename... Args> | |
static Ptr | CreateAlloc (const Alloc &alloc, Args &&... args) |
template<typename... Args> | |
static UniquePtr | CreateUnique (Args &&... args) |
virtual const mrpt::rtti::TRuntimeClassId * | GetRuntimeClass () const override |
Returns information about the class of an object in runtime. More... | |
virtual mrpt::rtti::CObject * | clone () const override |
Returns a deep copy (clone) of the object, indepently of its class. More... | |
using mrpt::obs::CObservationRGBD360::ConstPtr = std::shared_ptr<const mrpt::obs :: CObservationRGBD360 > |
Definition at line 85 of file CObservationRGBD360.h.
using mrpt::obs::CObservationRGBD360::ConstUniquePtr = std::unique_ptr<const mrpt::obs :: CObservationRGBD360 > |
Definition at line 85 of file CObservationRGBD360.h.
using mrpt::obs::CObservationRGBD360::Ptr = std::shared_ptr< mrpt::obs :: CObservationRGBD360 > |
A type for the associated smart pointer
Definition at line 85 of file CObservationRGBD360.h.
using mrpt::obs::CObservationRGBD360::UniquePtr = std::unique_ptr< mrpt::obs :: CObservationRGBD360 > |
Definition at line 85 of file CObservationRGBD360.h.
CObservationRGBD360::CObservationRGBD360 | ( | ) |
Default constructor.
Definition at line 30 of file CObservationRGBD360.cpp.
|
override |
Destructor.
Definition at line 34 of file CObservationRGBD360.cpp.
|
staticprotected |
|
overridevirtual |
Returns a deep copy (clone) of the object, indepently of its class.
Implements mrpt::rtti::CObject.
|
inlinestatic |
Definition at line 85 of file CObservationRGBD360.h.
|
inlinestatic |
Definition at line 85 of file CObservationRGBD360.h.
|
static |
|
inlinestatic |
Definition at line 85 of file CObservationRGBD360.h.
|
inlineinherited |
Makes a deep copy of the object and returns a smart pointer to it.
Definition at line 204 of file CObject.h.
References mrpt::rtti::CObject::clone().
Referenced by mrpt::obs::CRawlog::insert().
|
inlinestatic |
Definition at line 85 of file CObservationRGBD360.h.
|
overridevirtual |
Build a detailed, multi-line textual description of the observation contents and dump it to the output stream.
Reimplemented from mrpt::obs::CObservation.
Definition at line 117 of file CObservationRGBD360.cpp.
|
inherited |
Return by value version of getDescriptionAsText(std::ostream&)
Definition at line 59 of file CObservation.cpp.
|
inlinevirtualinherited |
By default, returns CObservation::timestamp but in sensors capable of satellite (or otherwise) accurate UTC timing of readings, this contains the computer-based timestamp of reception, which may be slightly different than timestamp.
Reimplemented in mrpt::obs::CObservationVelodyneScan, mrpt::obs::CObservationGPS, and mrpt::obs::CObservationRotatingScan.
Definition at line 71 of file CObservation.h.
References mrpt::obs::CObservation::timestamp.
|
overridevirtual |
Returns information about the class of an object in runtime.
Reimplemented from mrpt::obs::CObservation.
|
static |
|
inherited |
A general method to retrieve the sensor pose on the robot.
Note that most sensors will return a full (6D) CPose3D, but see the derived classes for more details or special cases.
Definition at line 24 of file CObservation.cpp.
References mrpt::poses::CPose3D::asTPose().
|
inlineoverridevirtual |
A general method to retrieve the sensor pose on the robot.
Note that most sensors will return a full (6D) CPose3D, but see the derived classes for more details or special cases.
Implements mrpt::obs::CObservation.
Definition at line 140 of file CObservationRGBD360.h.
References sensorPose.
|
inlineinherited |
Returns CObservation::timestamp for all kind of observations.
Definition at line 66 of file CObservation.h.
References mrpt::obs::CObservation::timestamp.
|
inlineinherited |
This method is equivalent to:
theMap | The map where this observation is to be inserted: the map will be updated. |
robotPose | The pose of the robot base for this observation, relative to the target metric map. Set to nullptr (default) to use (0,0,0deg) |
See: Maps and observations compatibility matrix
Definition at line 99 of file CObservation.h.
|
inlinevirtualinherited |
Makes sure all images and other fields which may be externally stored are loaded in memory.
Note that for all CImages, calling load() is not required since the images will be automatically loaded upon first access, so load() shouldn't be needed to be called in normal cases by the user. If all the data were alredy loaded or this object has no externally stored data fields, calling this method has no effects.
Reimplemented in mrpt::obs::CObservation3DRangeScan, mrpt::obs::CObservationStereoImages, mrpt::obs::CObservationImage, and mrpt::obs::CObservationPointCloud.
Definition at line 157 of file CObservation.h.
Referenced by mrpt::maps::COctoMapBase< octomap::OcTree, octomap::OcTreeNode >::internal_build_PointCloud_for_observation().
void CObservationRGBD360::rangeImage_setSize | ( | const int | HEIGHT, |
const int | WIDTH, | ||
const unsigned | sensor_id | ||
) |
Similar to calling "rangeImage.setSize(H,W)" but this method provides memory pooling to speed-up the memory allocation.
Definition at line 110 of file CObservationRGBD360.cpp.
|
inlineprotectedvirtualinherited |
Virtual method for reading (deserializing) from an abstract schema based archive.
Definition at line 74 of file CSerializable.h.
References mrpt::serialization::CSerializable::GetRuntimeClass(), and THROW_EXCEPTION.
|
overrideprotectedvirtual |
Pure virtual method for reading (deserializing) from an abstract archive.
Users don't call this method directly. Instead, use stream >> object;
.
in | The input binary stream where the object data must read from. |
version | The version of the object stored in the stream: use this version number in your code to know how to read the incoming data. |
std::exception | On any I/O error |
Implements mrpt::serialization::CSerializable.
Definition at line 67 of file CObservationRGBD360.cpp.
References MRPT_THROW_UNKNOWN_SERIALIZATION_VERSION, mrpt::serialization::CArchive::ReadAs(), mrpt::serialization::CArchive::ReadBufferFixEndianness(), and THROW_EXCEPTION.
|
overrideprotectedvirtual |
Must return the current versioning number of the object.
Start in zero for new classes, and increments each time there is a change in the stored format.
Implements mrpt::serialization::CSerializable.
Definition at line 36 of file CObservationRGBD360.cpp.
|
inlineprotectedvirtualinherited |
Virtual method for writing (serializing) to an abstract schema based archive.
Definition at line 64 of file CSerializable.h.
References mrpt::serialization::CSerializable::GetRuntimeClass(), and THROW_EXCEPTION.
|
overrideprotectedvirtual |
Pure virtual method for writing (serializing) to an abstract archive.
Users don't call this method directly. Instead, use stream << object;
.
std::exception | On any I/O error |
Implements mrpt::serialization::CSerializable.
Definition at line 37 of file CObservationRGBD360.cpp.
References out.
|
inherited |
A general method to change the sensor pose on the robot.
Note that most sensors will use the full (6D) CPose3D, but see the derived classes for more details or special cases.
Definition at line 31 of file CObservation.cpp.
|
inlineoverridevirtual |
A general method to change the sensor pose on the robot.
Note that most sensors will use the full (6D) CPose3D, but see the derived classes for more details or special cases.
Implements mrpt::obs::CObservation.
Definition at line 144 of file CObservationRGBD360.h.
References sensorPose.
|
protectedinherited |
Swap with another observation, ONLY the data defined here in the base class CObservation.
It's protected since it'll be only called from child classes that should know what else to swap appart from these common data.
Definition at line 36 of file CObservation.cpp.
References mrpt::obs::CObservation::sensorLabel, and mrpt::obs::CObservation::timestamp.
Referenced by mrpt::obs::CObservationStereoImages::swap().
|
inlinevirtualinherited |
Unload all images, for the case they being delayed-load images stored in external files (othewise, has no effect).
Reimplemented in mrpt::obs::CObservation3DRangeScan, and mrpt::obs::CObservationPointCloud.
Definition at line 164 of file CObservation.h.
|
inlinevirtualinherited |
Introduces a pure virtual method responsible for writing to a mxArray
Matlab object, typically a MATLAB struct
whose contents are documented in each derived class.
mxArray
(caller is responsible of memory freeing) or nullptr is class does not support conversion to MATLAB. Definition at line 90 of file CSerializable.h.
|
static |
Definition at line 85 of file CObservationRGBD360.h.
bool mrpt::obs::CObservationRGBD360::hasIntensityImage {false} |
true means the field intensityImage contains valid data
Definition at line 123 of file CObservationRGBD360.h.
Referenced by mrpt::hwdrivers::COpenNI2_RGBD360::getNextObservation().
bool mrpt::obs::CObservationRGBD360::hasRangeImage {false} |
true means the field rangeImage contains valid data
Definition at line 109 of file CObservationRGBD360.h.
Referenced by mrpt::hwdrivers::COpenNI2_RGBD360::getNextObservation().
mrpt::img::CImage mrpt::obs::CObservationRGBD360::intensityImages[NUM_SENSORS] |
If hasIntensityImage=true, a color or gray-level intensity image of the same size than "rangeImage".
Definition at line 126 of file CObservationRGBD360.h.
Referenced by mrpt::hwdrivers::COpenNI2_RGBD360::getNextObservation().
|
protected |
3D points are in CImage::getImagesPathBase()+<this_file_name>
Definition at line 91 of file CObservationRGBD360.h.
|
protected |
If set to true, m_points3D_external_file is valid.
Definition at line 89 of file CObservationRGBD360.h.
|
protected |
rangeImage is in CImage::getImagesPathBase()+<this_file_name>
Definition at line 96 of file CObservationRGBD360.h.
|
protected |
If set to true, m_rangeImage_external_file is valid.
Definition at line 94 of file CObservationRGBD360.h.
float mrpt::obs::CObservationRGBD360::maxRange {10.0f} |
The maximum range allowed by the device, in meters (e.g.
8.0m, 5.0m,...)
Definition at line 132 of file CObservationRGBD360.h.
|
static |
Definition at line 104 of file CObservationRGBD360.h.
mrpt::math::CMatrix_u16 mrpt::obs::CObservationRGBD360::rangeImages[NUM_SENSORS] |
If hasRangeImage=true, a matrix of floats with the range data as captured by the camera (in meters)
Definition at line 112 of file CObservationRGBD360.h.
Referenced by mrpt::hwdrivers::COpenNI2_RGBD360::getNextObservation().
float mrpt::obs::CObservationRGBD360::rangeUnits = 0.001f |
Units for integer depth values in rangeImages.
Definition at line 115 of file CObservationRGBD360.h.
|
staticprotected |
Definition at line 85 of file CObservationRGBD360.h.
|
inherited |
An arbitrary label that can be used to identify the sensor.
Definition at line 62 of file CObservation.h.
Referenced by mrpt::ros1bridge::convert(), mrpt::obs::CObservation3DRangeScan::convertTo2DScan(), mrpt::hwdrivers::CSICKTim561Eth::decodeScan(), mrpt::hwdrivers::CLMS100Eth::decodeScan(), mrpt::hwdrivers::CRaePID::doProcess(), mrpt::hwdrivers::CRoboPeakLidar::doProcessSimple(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::apps::RawlogGrabberApp::dump_GPS_mode_info(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::obs::CObservationRotatingScan::fromScan2D(), mrpt::obs::CObservationRotatingScan::fromVelodyne(), mrpt::hwdrivers::CRaePID::getFullInfo(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::CKinect::getNextObservation(), mrpt::hwdrivers::CBoardSonars::getObservation(), mrpt::hwdrivers::CWirelessPower::getObservation(), mrpt::hwdrivers::CImpinjRFID::getObservation(), mrpt::hwdrivers::CEnoseModular::getObservation(), mrpt::hwdrivers::CBoardENoses::getObservation(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::obs::CObservation6DFeatures::serializeFrom(), mrpt::obs::CObservationPointCloud::serializeFrom(), mrpt::obs::CObservation6DFeatures::serializeTo(), mrpt::obs::CObservationPointCloud::serializeTo(), mrpt::obs::CObservation::swap(), and mrpt::ros1bridge::toROS().
mrpt::img::TCamera mrpt::obs::CObservationRGBD360::sensorParamss[NUM_SENSORS] |
Projection parameters of the 8 RGBD sensor.
Definition at line 128 of file CObservationRGBD360.h.
mrpt::poses::CPose3D mrpt::obs::CObservationRGBD360::sensorPose |
The 6D pose of the sensor on the robot.
Definition at line 134 of file CObservationRGBD360.h.
Referenced by getSensorPose(), and setSensorPose().
float mrpt::obs::CObservationRGBD360::stdError {0.01f} |
The "sigma" error of the device in meters, used while inserting the scan in an occupancy grid.
Definition at line 137 of file CObservationRGBD360.h.
|
inherited |
The associated UTC time-stamp.
Where available, this should contain the accurate satellite-based timestamp of the sensor reading.
Definition at line 60 of file CObservation.h.
Referenced by mrpt::ros1bridge::convert(), mrpt::obs::CObservation3DRangeScan::convertTo2DScan(), mrpt::hwdrivers::CSICKTim561Eth::decodeScan(), mrpt::hwdrivers::CLMS100Eth::decodeScan(), mrpt::detectors::CObjectDetection::detectObjects(), mrpt::hwdrivers::CRaePID::doProcess(), mrpt::hwdrivers::CGPSInterface::doProcess(), mrpt::hwdrivers::CRoboPeakLidar::doProcessSimple(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::ros1bridge::fromROS(), mrpt::obs::CObservationRotatingScan::fromScan2D(), mrpt::obs::CObservationRotatingScan::fromVelodyne(), mrpt::hwdrivers::CRaePID::getFullInfo(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::COpenNI2_RGBD360::getNextObservation(), mrpt::hwdrivers::CKinect::getNextObservation(), mrpt::hwdrivers::CBoardSonars::getObservation(), mrpt::hwdrivers::CWirelessPower::getObservation(), mrpt::hwdrivers::CImageGrabber_OpenCV::getObservation(), mrpt::hwdrivers::CEnoseModular::getObservation(), mrpt::hwdrivers::CBoardENoses::getObservation(), mrpt::hwdrivers::CImageGrabber_dc1394::getObservation(), mrpt::hwdrivers::CImageGrabber_FlyCapture2::getObservation(), mrpt::hwdrivers::CDUO3DCamera::getObservations(), mrpt::obs::CObservation::getOriginalReceivedTimeStamp(), mrpt::obs::CObservation::getTimeStamp(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::maps::CLandmarksMap::loadOccupancyFeaturesFrom2DRangeScan(), mrpt::maps::CLandmarksMap::loadSiftFeaturesFromImageObservation(), mrpt::maps::CLandmarksMap::loadSiftFeaturesFromStereoImageObservation(), mrpt::hwdrivers::CGPSInterface::parse_NMEA(), mrpt::apps::KFSLAMApp::Run_KF_SLAM(), mrpt::obs::CObservation6DFeatures::serializeFrom(), mrpt::obs::CObservationPointCloud::serializeFrom(), mrpt::obs::CObservation6DFeatures::serializeTo(), mrpt::obs::CObservationPointCloud::serializeTo(), mrpt::maps::CLandmarksMap::simulateBeaconReadings(), mrpt::maps::CLandmarksMap::simulateRangeBearingReadings(), mrpt::obs::CObservation::swap(), mrpt::ros1bridge::toROS(), and velodyne_scan_to_pointcloud().
mrpt::system::TTimeStamp mrpt::obs::CObservationRGBD360::timestamps[NUM_SENSORS] |
Definition at line 106 of file CObservationRGBD360.h.
Referenced by mrpt::hwdrivers::COpenNI2_RGBD360::getNextObservation().
Page generated by Doxygen 1.8.14 for MRPT 2.0.4 Git: 33de1d0ad Sat Jun 20 11:02:42 2020 +0200 at sáb jun 20 17:35:17 CEST 2020 |