mrpt::obs::CObservationImage Class Reference

Detailed Description

Declares a class derived from "CObservation" that encapsules an image from a camera, whose relative pose to robot is also stored.

The next figure illustrate the coordinates reference systems involved in this class:

See also

CObservation, CObservationStereoImages

Definition at line 35 of file CObservationImage.h.

#include <mrpt/obs/CObservationImage.h>

Inheritance diagram for mrpt::obs::CObservationImage:

Public Member Functions
void *	operator new (size_t size)
void *	operator new[] (size_t size)
void	operator delete (void *ptr) noexcept
void	operator delete[] (void *ptr) noexcept
void	operator delete (void *memory, void *ptr) noexcept
void *	operator new (size_t size, const std::nothrow_t &) noexcept
void	operator delete (void *ptr, const std::nothrow_t &) noexcept
	CObservationImage (void *iplImage=nullptr)
	Constructor. More...
void	getRectifiedImage (mrpt::img::CImage &out_img) const
	Computes the rectified (un-distorted) image, using the embeded distortion parameters. More...
void	getSensorPose (mrpt::poses::CPose3D &out_sensorPose) const override
	A general method to retrieve the sensor pose on the robot. More...
void	setSensorPose (const mrpt::poses::CPose3D &newSensorPose) override
	A general method to change the sensor pose on the robot. More...
void	getDescriptionAsText (std::ostream &o) const override
	Build a detailed, multi-line textual description of the observation contents and dump it to the output stream. More...
template<class METRICMAP >
bool	insertObservationInto (METRICMAP *theMap, const mrpt::poses::CPose3D *robotPose=nullptr) const
	This method is equivalent to: More...
void	getSensorPose (mrpt::math::TPose3D &out_sensorPose) const
	A general method to retrieve the sensor pose on the robot. More...
void	setSensorPose (const mrpt::math::TPose3D &newSensorPose)
	A general method to change the sensor pose on the robot. More...
virtual mxArray *	writeToMatlab () const
	Introduces a pure virtual method responsible for writing to a mxArray Matlab object, typically a MATLAB struct whose contents are documented in each derived class. More...

Static Public Member Functions
static void *	operator new (size_t size, void *ptr)

Public Attributes
mrpt::poses::CPose3D	cameraPose
	The pose of the camera on the robot. More...
mrpt::img::TCamera	cameraParams
	Intrinsic and distortion parameters of the camera. More...
mrpt::img::CImage	image
	The image captured by the camera, that is, the main piece of information of this observation. More...

Protected Member Functions
void	swap (CObservation &o)
	Swap with another observation, ONLY the data defined here in the base class CObservation. More...
CSerializable virtual methods
uint8_t	serializeGetVersion () const override
	Must return the current versioning number of the object. More...
void	serializeTo (mrpt::serialization::CArchive &out) const override
	Pure virtual method for writing (serializing) to an abstract archive. More...
void	serializeFrom (mrpt::serialization::CArchive &in, uint8_t serial_version) override
	Pure virtual method for reading (deserializing) from an abstract archive. More...

Data common to any observation
mrpt::system::TTimeStamp	timestamp {mrpt::system::now()}
	The associated UTC time-stamp. More...
std::string	sensorLabel
	An arbitrary label that can be used to identify the sensor. More...
mrpt::system::TTimeStamp	getTimeStamp () const
	Returns CObservation::timestamp for all kind of observations. More...
virtual mrpt::system::TTimeStamp	getOriginalReceivedTimeStamp () const
	By default, returns CObservation::timestamp but in sensors capable of satellite (or otherwise) accurate UTC timing of readings, this contains the computer-based timestamp of reception, which may be slightly different than timestamp. More...

RTTI stuff
using	Ptr = std::shared_ptr< CObservationImage >
using	ConstPtr = std::shared_ptr< const CObservationImage >
using	UniquePtr = std::unique_ptr< CObservationImage >
using	ConstUniquePtr = std::unique_ptr< const CObservationImage >
static mrpt::rtti::CLASSINIT	_init_CObservationImage
static const mrpt::rtti::TRuntimeClassId	runtimeClassId
static constexpr const char *	className = "CObservationImage"
static const mrpt::rtti::TRuntimeClassId *	_GetBaseClass ()
static constexpr auto	getClassName ()
static const mrpt::rtti::TRuntimeClassId &	GetRuntimeClassIdStatic ()
static mrpt::rtti::CObject *	CreateObject ()
template<typename... Args>
static Ptr	Create (Args &&... args)
template<typename... Args>
static UniquePtr	CreateUnique (Args &&... args)
virtual const mrpt::rtti::TRuntimeClassId *	GetRuntimeClass () const override
	Returns information about the class of an object in runtime. More...
virtual mrpt::rtti::CObject *	clone () const override
	Returns a deep copy (clone) of the object, indepently of its class. More...

Member Typedef Documentation

ConstPtr

using mrpt::obs::CObservationImage::ConstPtr = std::shared_ptr<const CObservationImage >

Definition at line 37 of file CObservationImage.h.

ConstUniquePtr

using mrpt::obs::CObservationImage::ConstUniquePtr = std::unique_ptr<const CObservationImage >

Definition at line 37 of file CObservationImage.h.

Ptr

using mrpt::obs::CObservationImage::Ptr = std::shared_ptr< CObservationImage >

A type for the associated smart pointer

Definition at line 37 of file CObservationImage.h.

UniquePtr

using mrpt::obs::CObservationImage::UniquePtr = std::unique_ptr< CObservationImage >

Definition at line 37 of file CObservationImage.h.

Constructor & Destructor Documentation

CObservationImage()

CObservationImage::CObservationImage

(

void *

iplImage = nullptr

)

Constructor.

Parameters

iplImage

An OpenCV "IplImage*" object with the image to be loaded in the member "image", or nullptr (default) for an empty image.

Definition at line 30 of file CObservationImage.cpp.

Member Function Documentation

_GetBaseClass()

static const mrpt::rtti::TRuntimeClassId* mrpt::obs::CObservationImage::_GetBaseClass ( )

staticprotected

clone()

virtual mrpt::rtti::CObject* mrpt::obs::CObservationImage::clone ( ) const

overridevirtual

Returns a deep copy (clone) of the object, indepently of its class.

Implements mrpt::rtti::CObject.

Create()

template<typename... Args>

static Ptr mrpt::obs::CObservationImage::Create ( Args &&...  args )

inlinestatic

Definition at line 37 of file CObservationImage.h.

CreateObject()

static mrpt::rtti::CObject* mrpt::obs::CObservationImage::CreateObject ( )

static

CreateUnique()

template<typename... Args>

static UniquePtr mrpt::obs::CObservationImage::CreateUnique ( Args &&...  args )

inlinestatic

Definition at line 37 of file CObservationImage.h.

duplicateGetSmartPtr()

mrpt::rtti::CObject::Ptr CObject::duplicateGetSmartPtr ( ) const

inlineinherited

Returns a copy of the object, indepently of its class, as a smart pointer (the newly created object will exist as long as any copy of this smart pointer).

Definition at line 169 of file CObject.h.

References mrpt::rtti::CObject::clone().

Referenced by mrpt::obs::CRawlog::addActions(), and mrpt::obs::CRawlog::addObservations().

getClassName()

static constexpr auto mrpt::obs::CObservationImage::getClassName ( )

inlinestaticconstexpr

Definition at line 37 of file CObservationImage.h.

getDescriptionAsText()

void CObservationImage::getDescriptionAsText ( std::ostream &  o ) const

overridevirtual

Build a detailed, multi-line textual description of the observation contents and dump it to the output stream.

Note

If overried by derived classes, call base CObservation::getDescriptionAsText() first to show common information.

This is the text that appears in RawLogViewer when selecting an object in the dataset

Reimplemented from mrpt::obs::CObservation.

Definition at line 131 of file CObservationImage.cpp.

References mrpt::format(), and mrpt::obs::CObservation::getDescriptionAsText().

getOriginalReceivedTimeStamp()

virtual mrpt::system::TTimeStamp mrpt::obs::CObservation::getOriginalReceivedTimeStamp ( ) const

inlinevirtualinherited

By default, returns CObservation::timestamp but in sensors capable of satellite (or otherwise) accurate UTC timing of readings, this contains the computer-based timestamp of reception, which may be slightly different than timestamp.

See also

getTimeStamp()

Reimplemented in mrpt::obs::CObservationGPS, and mrpt::obs::CObservationVelodyneScan.

Definition at line 71 of file CObservation.h.

References mrpt::obs::CObservation::timestamp.

getRectifiedImage()

void CObservationImage::getRectifiedImage

(

mrpt::img::CImage &

out_img

)

const

Computes the rectified (un-distorted) image, using the embeded distortion parameters.

Definition at line 126 of file CObservationImage.cpp.

GetRuntimeClass()

virtual const mrpt::rtti::TRuntimeClassId* mrpt::obs::CObservationImage::GetRuntimeClass ( ) const

overridevirtual

Returns information about the class of an object in runtime.

Reimplemented from mrpt::obs::CObservation.

GetRuntimeClassIdStatic()

static const mrpt::rtti::TRuntimeClassId& mrpt::obs::CObservationImage::GetRuntimeClassIdStatic ( )

static

getSensorPose() [1/2]

void CObservation::getSensorPose ( mrpt::math::TPose3D &  out_sensorPose ) const

inherited

A general method to retrieve the sensor pose on the robot.

Note that most sensors will return a full (6D) CPose3D, but see the derived classes for more details or special cases.

See also

setSensorPose

Definition at line 26 of file CObservation.cpp.

getSensorPose() [2/2]

void mrpt::obs::CObservationImage::getSensorPose ( mrpt::poses::CPose3D &  out_sensorPose ) const

inlineoverridevirtual

A general method to retrieve the sensor pose on the robot.

Note that most sensors will return a full (6D) CPose3D, but see the derived classes for more details or special cases.

See also

setSensorPose

Implements mrpt::obs::CObservation.

Definition at line 69 of file CObservationImage.h.

References cameraPose.

Referenced by mrpt::maps::CColouredPointsMap::colourFromObservation().

getTimeStamp()

mrpt::system::TTimeStamp mrpt::obs::CObservation::getTimeStamp ( ) const

inlineinherited

Returns CObservation::timestamp for all kind of observations.

See also

getOriginalReceivedTimeStamp()

Definition at line 66 of file CObservation.h.

References mrpt::obs::CObservation::timestamp.

insertObservationInto()

template<class METRICMAP >

bool mrpt::obs::CObservation::insertObservationInto ( METRICMAP *  theMap, const mrpt::poses::CPose3D *  robotPose = nullptr  ) const

inlineinherited

This method is equivalent to:

map->insertObservation(this, robotPose)

Parameters

theMap	The map where this observation is to be inserted: the map will be updated.
robotPose	The pose of the robot base for this observation, relative to the target metric map. Set to nullptr (default) to use (0,0,0deg)

Returns

Returns true if the map has been updated, or false if this observations has nothing to do with a metric map (for example, a sound observation).

See: Maps and observations compatibility matrix

See also

CMetricMap, CMetricMap::insertObservation

Definition at line 99 of file CObservation.h.

Referenced by mrpt::maps::COccupancyGridMap2D::computeObservationLikelihood_CellsDifference().

load()

virtual void mrpt::obs::CObservation::load ( ) const

inlinevirtualinherited

Makes sure all images and other fields which may be externally stored are loaded in memory.

Note that for all CImages, calling load() is not required since the images will be automatically loaded upon first access, so load() shouldn't be needed to be called in normal cases by the user. If all the data were alredy loaded or this object has no externally stored data fields, calling this method has no effects.

See also

unload

Reimplemented in mrpt::obs::CObservation3DRangeScan.

Definition at line 154 of file CObservation.h.

operator delete() [1/3]

void mrpt::obs::CObservationImage::operator delete ( void *  memory, void *  ptr  )

inlinenoexcept

Definition at line 37 of file CObservationImage.h.

operator delete() [2/3]

void mrpt::obs::CObservationImage::operator delete ( void *  ptr )

inlinenoexcept

Definition at line 37 of file CObservationImage.h.

operator delete() [3/3]

void mrpt::obs::CObservationImage::operator delete ( void *  ptr, const std::nothrow_t &    )

inlinenoexcept

Definition at line 37 of file CObservationImage.h.

operator delete[]()

void mrpt::obs::CObservationImage::operator delete[] ( void *  ptr )

inlinenoexcept

Definition at line 37 of file CObservationImage.h.

operator new() [1/3]

void* mrpt::obs::CObservationImage::operator new ( size_t  size )

inline

Definition at line 37 of file CObservationImage.h.

operator new() [2/3]

void* mrpt::obs::CObservationImage::operator new ( size_t  size, const std::nothrow_t &    )

inlinenoexcept

Definition at line 37 of file CObservationImage.h.

operator new() [3/3]

static void* mrpt::obs::CObservationImage::operator new ( size_t  size, void *  ptr  )

inlinestatic

Definition at line 37 of file CObservationImage.h.

operator new[]()

void* mrpt::obs::CObservationImage::operator new[] ( size_t  size )

inline

Definition at line 37 of file CObservationImage.h.

serializeFrom()

void CObservationImage::serializeFrom ( mrpt::serialization::CArchive &  in, uint8_t  serial_version  )

overrideprotectedvirtual

Pure virtual method for reading (deserializing) from an abstract archive.

Users don't call this method directly. Instead, use stream >> object;.

Parameters

in	The input binary stream where the object data must read from.
version	The version of the object stored in the stream: use this version number in your code to know how to read the incoming data.

Exceptions

std::exception

On any I/O error

Implements mrpt::serialization::CSerializable.

Definition at line 41 of file CObservationImage.cpp.

References MRPT_THROW_UNKNOWN_SERIALIZATION_VERSION.

serializeGetVersion()

uint8_t CObservationImage::serializeGetVersion ( ) const

overrideprotectedvirtual

Must return the current versioning number of the object.

Start in zero for new classes, and increments each time there is a change in the stored format.

Implements mrpt::serialization::CSerializable.

Definition at line 35 of file CObservationImage.cpp.

serializeTo()

void CObservationImage::serializeTo ( mrpt::serialization::CArchive &  out ) const

overrideprotectedvirtual

Pure virtual method for writing (serializing) to an abstract archive.

Users don't call this method directly. Instead, use stream << object;.

Exceptions

std::exception

On any I/O error

Implements mrpt::serialization::CSerializable.

Definition at line 36 of file CObservationImage.cpp.

setSensorPose() [1/2]

void CObservation::setSensorPose ( const mrpt::math::TPose3D &  newSensorPose )

inherited

A general method to change the sensor pose on the robot.

Note that most sensors will use the full (6D) CPose3D, but see the derived classes for more details or special cases.

See also

getSensorPose

Definition at line 33 of file CObservation.cpp.

setSensorPose() [2/2]

void mrpt::obs::CObservationImage::setSensorPose ( const mrpt::poses::CPose3D &  newSensorPose )

inlineoverridevirtual

A general method to change the sensor pose on the robot.

Note that most sensors will use the full (6D) CPose3D, but see the derived classes for more details or special cases.

See also

getSensorPose

Implements mrpt::obs::CObservation.

Definition at line 73 of file CObservationImage.h.

References cameraPose.

swap()

void CObservation::swap ( CObservation &  o )

protectedinherited

Swap with another observation, ONLY the data defined here in the base class CObservation.

It's protected since it'll be only called from child classes that should know what else to swap appart from these common data.

Definition at line 38 of file CObservation.cpp.

References mrpt::obs::CObservation::sensorLabel, and mrpt::obs::CObservation::timestamp.

Referenced by mrpt::obs::CObservationStereoImages::swap(), and mrpt::obs::CObservation3DRangeScan::swap().

unload()

virtual void mrpt::obs::CObservation::unload ( )

inlinevirtualinherited

Unload all images, for the case they being delayed-load images stored in external files (othewise, has no effect).

See also

load

Reimplemented in mrpt::obs::CObservation3DRangeScan.

Definition at line 161 of file CObservation.h.

writeToMatlab()

virtual mxArray* mrpt::serialization::CSerializable::writeToMatlab ( ) const

inlinevirtualinherited

Introduces a pure virtual method responsible for writing to a mxArray Matlab object, typically a MATLAB struct whose contents are documented in each derived class.

Returns

A new mxArray (caller is responsible of memory freeing) or nullptr is class does not support conversion to MATLAB.

Definition at line 70 of file CSerializable.h.

Member Data Documentation

_init_CObservationImage

mrpt::rtti::CLASSINIT mrpt::obs::CObservationImage::_init_CObservationImage

staticprotected

Definition at line 37 of file CObservationImage.h.

cameraParams

mrpt::img::TCamera mrpt::obs::CObservationImage::cameraParams

Intrinsic and distortion parameters of the camera.

See the tutorial for a discussion of these parameters.

Definition at line 57 of file CObservationImage.h.

Referenced by mrpt::maps::CColouredPointsMap::colourFromObservation(), and mrpt::maps::CLandmarksMap::loadSiftFeaturesFromImageObservation().

cameraPose

mrpt::poses::CPose3D mrpt::obs::CObservationImage::cameraPose

The pose of the camera on the robot.

Definition at line 51 of file CObservationImage.h.

Referenced by getSensorPose(), and setSensorPose().

className

constexpr const char* mrpt::obs::CObservationImage::className = "CObservationImage"

staticconstexpr

Definition at line 37 of file CObservationImage.h.

image

mrpt::img::CImage mrpt::obs::CObservationImage::image

The image captured by the camera, that is, the main piece of information of this observation.

Definition at line 61 of file CObservationImage.h.

Referenced by mrpt::maps::CColouredPointsMap::colourFromObservation(), mrpt::detectors::CObjectDetection::detectObjects(), mrpt::detectors::CCascadeClassifierDetection::detectObjects_Impl(), mrpt::hwdrivers::CCameraSensor::getNextFrame(), mrpt::hwdrivers::CImageGrabber_OpenCV::getObservation(), mrpt::hwdrivers::CImageGrabber_dc1394::getObservation(), mrpt::hwdrivers::CImageGrabber_FlyCapture2::getObservation(), and mrpt::maps::CLandmarksMap::loadSiftFeaturesFromImageObservation().

runtimeClassId

const mrpt::rtti::TRuntimeClassId mrpt::obs::CObservationImage::runtimeClassId

staticprotected

Definition at line 37 of file CObservationImage.h.

sensorLabel

std::string mrpt::obs::CObservation::sensorLabel

inherited

An arbitrary label that can be used to identify the sensor.

Definition at line 62 of file CObservation.h.

Referenced by mrpt::obs::carmen_log_parse_line(), mrpt::obs::CObservation3DRangeScan::convertTo2DScan(), mrpt::hwdrivers::CSICKTim561Eth::decodeScan(), mrpt::hwdrivers::CLMS100Eth::decodeScan(), mrpt::hwdrivers::CRaePID::doProcess(), mrpt::hwdrivers::CRoboPeakLidar::doProcessSimple(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::hwdrivers::CRaePID::getFullInfo(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::COpenNI2Sensor::getNextObservation(), mrpt::hwdrivers::CKinect::getNextObservation(), mrpt::hwdrivers::CBoardSonars::getObservation(), mrpt::hwdrivers::CWirelessPower::getObservation(), mrpt::hwdrivers::CImpinjRFID::getObservation(), mrpt::hwdrivers::CEnoseModular::getObservation(), mrpt::hwdrivers::CBoardENoses::getObservation(), mrpt::hwdrivers::CPhidgetInterfaceKitProximitySensors::getObservation(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::maps::CGasConcentrationGridMap2D::internal_insertObservation(), mrpt::obs::CObservation6DFeatures::serializeFrom(), mrpt::obs::CObservation3DRangeScan::serializeFrom(), mrpt::obs::CObservation6DFeatures::serializeTo(), mrpt::obs::CObservation3DRangeScan::serializeTo(), and mrpt::obs::CObservation::swap().

timestamp

mrpt::system::TTimeStamp mrpt::obs::CObservation::timestamp {mrpt::system::now()}

inherited

The associated UTC time-stamp.

Where available, this should contain the accurate satellite-based timestamp of the sensor reading.

See also

getOriginalReceivedTimeStamp(), getTimeStamp()

Definition at line 60 of file CObservation.h.

Referenced by mrpt::obs::carmen_log_parse_line(), mrpt::obs::CObservation3DRangeScan::convertTo2DScan(), mrpt::hwdrivers::CSICKTim561Eth::decodeScan(), mrpt::hwdrivers::CLMS100Eth::decodeScan(), mrpt::detectors::CObjectDetection::detectObjects(), mrpt::hwdrivers::CRaePID::doProcess(), mrpt::hwdrivers::CGPSInterface::doProcess(), mrpt::hwdrivers::CRoboPeakLidar::doProcessSimple(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::hwdrivers::CRaePID::getFullInfo(), mrpt::hwdrivers::CCameraSensor::getNextFrame(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::COpenNI2_RGBD360::getNextObservation(), mrpt::hwdrivers::CKinect::getNextObservation(), mrpt::hwdrivers::CBoardSonars::getObservation(), mrpt::hwdrivers::CWirelessPower::getObservation(), mrpt::hwdrivers::CEnoseModular::getObservation(), mrpt::hwdrivers::CImageGrabber_OpenCV::getObservation(), mrpt::hwdrivers::CBoardENoses::getObservation(), mrpt::hwdrivers::CPhidgetInterfaceKitProximitySensors::getObservation(), mrpt::hwdrivers::CImageGrabber_dc1394::getObservation(), mrpt::hwdrivers::CImageGrabber_FlyCapture2::getObservation(), mrpt::hwdrivers::CDUO3DCamera::getObservations(), mrpt::obs::CObservation::getOriginalReceivedTimeStamp(), mrpt::obs::CObservation::getTimeStamp(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::maps::CLandmarksMap::loadOccupancyFeaturesFrom2DRangeScan(), mrpt::maps::CLandmarksMap::loadSiftFeaturesFromImageObservation(), mrpt::maps::CLandmarksMap::loadSiftFeaturesFromStereoImageObservation(), mrpt::hwdrivers::CGPSInterface::parse_NMEA(), mrpt::obs::CObservation6DFeatures::serializeFrom(), mrpt::obs::CObservation3DRangeScan::serializeFrom(), mrpt::obs::CObservation6DFeatures::serializeTo(), mrpt::obs::CObservation3DRangeScan::serializeTo(), mrpt::maps::CLandmarksMap::simulateBeaconReadings(), mrpt::maps::CLandmarksMap::simulateRangeBearingReadings(), mrpt::obs::CObservation::swap(), and velodyne_scan_to_pointcloud().