mrpt::hwdrivers::CKinect Class Reference

Detailed Description

A class for grabing "range images", intensity images (either RGB or IR) and other information from an Xbox Kinect sensor.

To use Kinect for Windows or ASUS/Primesense RGBD cameras, use the class COpenNI2.

Configuration and usage:

---

Data is returned as observations of type mrpt::obs::CObservation3DRangeScan (and mrpt::obs::CObservationIMU for accelerometers data). See those classes for documentation on their fields.

As with any other CGenericSensor class, the normal sequence of methods to be called is:

• CGenericSensor::loadConfig() - Or calls to the individual setXXX() to configure the sensor parameters.
• CKinect::initialize() - to start the communication with the sensor.
• call CKinect::getNextObservation() for getting the data.

Calibration parameters

---

For an accurate transformation of depth images to 3D points, you'll have to calibrate your Kinect, and supply the following threee pieces of information (default calibration data will be used otherwise, but they'll be not optimal for all sensors!):

• Camera parameters for the RGB camera. See CKinect::setCameraParamsIntensity()
• Camera parameters for the depth camera. See CKinect::setCameraParamsDepth()
• The 3D relative pose of the two cameras. See CKinect::setRelativePoseIntensityWrtDepth()

See https://www.mrpt.org/Kinect_calibration for a procedure to calibrate Kinect sensors with an interactive GUI program.

Coordinates convention

---

The origin of coordinates is the focal point of the depth camera, with the axes oriented as in the diagram shown in mrpt::obs::CObservation3DRangeScan. Notice in that picture that the RGB camera is assumed to have axes as usual in computer vision, which differ from those for the depth camera.

The X,Y,Z axes used to report the data from accelerometers coincide with those of the depth camera (e.g. the camera standing on a table would have an ACC_Z=-9.8m/s2).

Notice however that, for consistency with stereo cameras, when loading the calibration parameters from a configuration file, the left-to-right pose increment is expected as if both RGB & IR cameras had their +Z axes pointing forward, +X to the right, +Y downwards (just like it's the standard in stereo cameras and in computer vision literature). In other words: the pose stored in this class uses a different axes convention for the depth camera than in a stereo camera, so when a pose L2R is loaded from a calibration file it's actually converted like:

L2R(this class convention) = CPose3D(0,0,0,-90deg,0deg,-90deg) (+) L2R(in the config file)

Some general comments

---

• Depth is grabbed in 10bit depth, and a range N it's converted to meters as: range(m) = 0.1236 * tan(N/2842.5 + 1.1863)
• This sensor can be also used from within rawlog-grabber to grab datasets within a robot with more sensors.
• There is no built-in threading support, so if you use this class manually (not with-in rawlog-grabber), the ideal would be to create a thread and continuously request data from that thread (see mrpt::system::createThread ).
• The intensity channel default to the RGB images, but it can be changed with setVideoChannel() to read the IR camera images (useful for calibrating).
• There is a built-in support for an optional preview of the data on a window, so you don't need to even worry on creating a window to show them.
• This class relies on an embedded version of libfreenect (you do NOT need to install it in your system). Thanks guys for the great job!

Converting to 3D point cloud

---

You can convert the 3D observation into a 3D point cloud with this piece of code:

mrpt::obs::CObservation3DRangeScan  obs3D;
mrpt::maps::CColouredPointsMap       pntsMap;
pntsMap.colorScheme.scheme = CColouredPointsMap::cmFromIntensityImage;
pntsMap.loadFromRangeScan(obs3D);

Then the point cloud mrpt::maps::CColouredPointsMap can be converted into an OpenGL object for rendering with mrpt::maps::CMetricMap::getAs3DObject() or alternatively with:

     mrpt::opengl::CPointCloudColoured::Ptr gl_points =
*mrpt::opengl::CPointCloudColoured::Create();
     gl_points->loadFromPointsMap(&pntsMap);

Raw depth to range conversion

---

At construction, this class builds an internal array for converting raw 10 or 11bit depths into ranges in meters. Users can read that array or modify it (if you have a better calibration, for example) by calling CKinect::getRawDepth2RangeConversion(). If you replace it, remember to set the first and last entries (index 0 and KINECT_RANGES_TABLE_LEN-1) to zero, to indicate that those are invalid ranges.

R(d) = k3 * tan(d/k2 + k1); k1 = 1.1863, k2 = 2842.5, k3 = 0.1236

Platform-specific comments

---

For more details, refer to libfreenect documentation:

• Linux: You'll need root privileges to access Kinect. Or, install MRPT/scripts/51-kinect.rules in /etc/udev/rules.d/ to allow access to all users.
• Windows:
  • Since MRPT 0.9.4 you'll only need to install libusb-win32: download and extract the latest libusb-win32-bin-x.x.x.x.zip
  • To install the drivers, read this: http://openkinect.org/wiki/Getting_Started#Windows
• MacOS: (write me!)

Format of parameters for loading from a .ini file

---

   PARAMETERS IN THE ".INI"-LIKE CONFIGURATION STRINGS:
  -------------------------------------------------------
    [supplied_section_name]
     sensorLabel     = KINECT       // A text description
     preview_window  = false        // Show a window with a preview of the
*grabbed data in real-time
 
     device_number   = 0           // Device index to open (0:first Kinect,
 1:second Kinect,...)
 
     grab_image      = true        // Grab the RGB image channel?
*(Default=true)
     grab_depth      = true        // Grab the depth channel? (Default=true)
     grab_3D_points  = true        // Grab the 3D point cloud? (Default=true)
*If disabled, points can be generated later on.
     grab_IMU        = true        // Grab the accelerometers? (Default=true)
 
     video_channel   = VIDEO_CHANNEL_RGB // Optional. Can be:
*VIDEO_CHANNEL_RGB (default) or VIDEO_CHANNEL_IR
 
     pose_x=0   // Camera position in the robot (meters)
     pose_y=0
     pose_z=0
     pose_yaw=0 // Angles in degrees
     pose_pitch=0
     pose_roll=0
 
     // Optional: Set the initial tilt angle of Kinect: upon initialization,
*the motor is sent a command to
     //            rotate to this angle (in degrees). Note: You must be aware
*of the tilt when interpreting the sensor readings.
     //           If not present or set to "360", no motor command will be
*sent at start up.
     initial_tilt_angle = 0
 
     // Kinect sensor calibration:
     // See https://www.mrpt.org/Kinect_and_MRPT
 
     // Left/Depth camera
     [supplied_section_name_LEFT]
     rawlog-grabber-ignore = true // Instructs rawlog-grabber to ignore this
*section (it is not a separate device!)
 
     resolution = [640 488]
     cx         = 314.649173
     cy         = 240.160459
     fx         = 572.882768
     fy         = 542.739980
     dist       = [-4.747169e-03 -4.357976e-03 0.000000e+00 0.000000e+00
 0.000000e+00]    // The order is: [K1 K2 T1 T2 K3]
 
     // Right/RGB camera
     [supplied_section_name_RIGHT]
     rawlog-grabber-ignore = true // Instructs rawlog-grabber to ignore this
*section (it is not a separate device!)
 
     resolution = [640 480]
     cx         = 322.515987
     cy         = 259.055966
     fx         = 521.179233
     fy         = 493.033034
     dist       = [5.858325e-02 3.856792e-02 0.000000e+00 0.000000e+00
 0.000000e+00]    // The order is: [K1 K2 T1 T2 K3]
 
     // Relative pose of the right camera wrt to the left camera:
     // This assumes that both camera frames are such that +Z points
     // forwards, and +X and +Y to the right and downwards.
     // For the actual coordinates employed in 3D observations, see figure in
*mrpt::obs::CObservation3DRangeScan
     [supplied_section_name_LEFT2RIGHT_POSE]
     rawlog-grabber-ignore = true // Instructs rawlog-grabber to ignore this
*section (it is not a separate device!)
 
     pose_quaternion      = [0.025575 -0.000609 -0.001462 0.999987 0.002038
 0.004335 -0.001693]

More references to read:

• http://openkinect.org/wiki/Imaging_Information
• http://nicolas.burrus.name/index.php/Research/KinectCalibration

Definition at line 265 of file CKinect.h.

#include <mrpt/hwdrivers/CKinect.h>

Inheritance diagram for mrpt::hwdrivers::CKinect:

Public Types
enum	TVideoChannel { VIDEO_CHANNEL_RGB = 0, VIDEO_CHANNEL_IR }
	RGB or IR video channel identifiers. More...
using	TDepth2RangeArray = uint16_t[KINECT_RANGES_TABLE_LEN]
	A type for an array that converts raw depth to ranges in millimeters. More...
enum	TSensorState { ssInitializing = 0, ssWorking, ssError, ssUninitialized }
	The current state of the sensor. More...
using	Ptr = std::shared_ptr< CGenericSensor >
using	TListObservations = std::multimap< mrpt::system::TTimeStamp, mrpt::serialization::CSerializable::Ptr >
using	TListObsPair = std::pair< mrpt::system::TTimeStamp, mrpt::serialization::CSerializable::Ptr >

Public Member Functions
	CKinect ()
	Default ctor. More...
	~CKinect () override
	Default ctor. More...
void	initialize () override
	Initializes the 3D camera - should be invoked after calling loadConfig() or setting the different parameters with the set*() methods. More...
void	doProcess () override
	To be called at a high rate (>XX Hz), this method populates the internal buffer of received observations. More...
void	getNextObservation (mrpt::obs::CObservation3DRangeScan &out_obs, bool &there_is_obs, bool &hardware_error)
	The main data retrieving function, to be called after calling loadConfig() and initialize(). More...
void	getNextObservation (mrpt::obs::CObservation3DRangeScan &out_obs, mrpt::obs::CObservationIMU &out_obs_imu, bool &there_is_obs, bool &hardware_error)
	This is an overloaded member function, provided for convenience. It differs from the above function only in what argument(s) it accepts. More...
void	setPathForExternalImages (const std::string &directory) override
	Set the path where to save off-rawlog image files (this class DOES take into account this path). More...
virtual const mrpt::hwdrivers::TSensorClassId *	GetRuntimeClass () const =0
TSensorState	getState () const
	The current state of the sensor. More...
double	getProcessRate () const
std::string	getSensorLabel () const
void	setSensorLabel (const std::string &sensorLabel)
void	enableVerbose (bool enabled=true)
	Enable or disable extra debug info dumped to std::cout during sensor operation. More...
bool	isVerboseEnabled () const
void	loadConfig (const mrpt::config::CConfigFileBase &configSource, const std::string &section)
	Loads the generic settings common to any sensor (See CGenericSensor), then call to "loadConfig_sensorSpecific". More...
void	getObservations (TListObservations &lstObjects)
	Returns a list of enqueued objects, emptying it (thread-safe). More...
virtual void	setPathForExternalImages ([[maybe_unused]] const std::string &directory)
	Set the path where to save off-rawlog image files (will be ignored in those sensors where this is not applicable). More...
void	setExternalImageFormat (const std::string &ext)
	Set the extension ("jpg","gif","png",...) that determines the format of images saved externally The default is "jpg". More...
void	setExternalImageJPEGQuality (const unsigned int quality)
	The quality of JPEG compression, when external images is enabled and the format is "jpg". More...
unsigned int	getExternalImageJPEGQuality () const
Sensor parameters (alternative to \a loadConfig ) and manual
control
void	open ()
	Try to open the camera (set all the parameters before calling this) - users may also call initialize(), which in turn calls this method. More...
bool	isOpen () const
	Whether there is a working connection to the sensor. More...
void	close ()
	Close the Connection to the sensor (not need to call it manually unless desired for some reason, since it's called at destructor) More...
void	setVideoChannel (const TVideoChannel vch)
	Changes the video channel to open (RGB or IR) - you can call this method before start grabbing or in the middle of streaming and the video source will change on the fly. More...
TVideoChannel	getVideoChannel () const
	Return the current video channel (RGB or IR) More...
void	setDeviceIndexToOpen (int index)
	Set the sensor index to open (if there're several sensors attached to the computer); default=0 -> the first one. More...
int	getDeviceIndexToOpen () const
void	setTiltAngleDegrees (double angle)
	Change tilt angle. More...
double	getTiltAngleDegrees ()
void	enablePreviewRGB (bool enable=true)
	Default: disabled. More...
void	disablePreviewRGB ()
bool	isPreviewRGBEnabled () const
void	setPreviewDecimation (size_t decimation_factor)
	If preview is enabled, show only one image out of N (default: 1=show all) More...
size_t	getPreviewDecimation () const
double	getMaxRange () const
	Get the maximum range (meters) that can be read in the observation field "rangeImage". More...
size_t	rows () const
	Get the row count in the camera images, loaded automatically upon camera open(). More...
size_t	cols () const
	Get the col count in the camera images, loaded automatically upon camera open(). More...
const mrpt::img::TCamera &	getCameraParamsIntensity () const
	Get a const reference to the depth camera calibration parameters. More...
void	setCameraParamsIntensity (const mrpt::img::TCamera &p)
const mrpt::img::TCamera &	getCameraParamsDepth () const
	Get a const reference to the depth camera calibration parameters. More...
void	setCameraParamsDepth (const mrpt::img::TCamera &p)
void	setRelativePoseIntensityWrtDepth (const mrpt::poses::CPose3D &p)
	Set the pose of the intensity camera wrt the depth camera. More...
const mrpt::poses::CPose3D &	getRelativePoseIntensityWrtDepth () const
TDepth2RangeArray &	getRawDepth2RangeConversion ()
	Get a reference to the array that convert raw depth values (10 or 11 bit) into ranges in mm, so it can be read or replaced by the user. More...
const TDepth2RangeArray &	getRawDepth2RangeConversion () const
void	enableGrabRGB (bool enable=true)
	Enable/disable the grabbing of the RGB channel. More...
bool	isGrabRGBEnabled () const
void	enableGrabDepth (bool enable=true)
	Enable/disable the grabbing of the depth channel. More...
bool	isGrabDepthEnabled () const
void	enableGrabAccelerometers (bool enable=true)
	Enable/disable the grabbing of the inertial data. More...
bool	isGrabAccelerometersEnabled () const
void	enableGrab3DPoints (bool enable=true)
	Enable/disable the grabbing of the 3D point clouds. More...
bool	isGrab3DPointsEnabled () const

Static Public Member Functions
static void	registerClass (const TSensorClassId *pNewClass)
	Register a class into the internal list of "CGenericSensor" descendents. More...
static CGenericSensor *	createSensor (const std::string &className)
	Creates a sensor by a name of the class. More...
static Ptr	createSensorPtr (const std::string &className)
	Just like createSensor, but returning a smart pointer to the newly created sensor object. More...

Protected Member Functions
void	loadConfig_sensorSpecific (const mrpt::config::CConfigFileBase &configSource, const std::string &section) override
	See the class documentation at the top for expected parameters. More...
void	appendObservations (const std::vector< mrpt::serialization::CSerializable::Ptr > &obj)
	This method must be called by derived classes to enqueue a new observation in the list to be returned by getObservations. More...
void	appendObservation (const mrpt::serialization::CSerializable::Ptr &obj)
	Like appendObservations() but for just one observation. More...

Protected Attributes
mrpt::poses::CPose3D	m_sensorPoseOnRobot
bool	m_preview_window {false}
	Show preview window while grabbing. More...
size_t	m_preview_window_decimation {1}
	If preview is enabled, only show 1 out of N images. More...
size_t	m_preview_decim_counter_range {0}
size_t	m_preview_decim_counter_rgb {0}
mrpt::gui::CDisplayWindow::Ptr	m_win_range
mrpt::gui::CDisplayWindow::Ptr	m_win_int
mrpt::img::TCamera	m_cameraParamsRGB
	Params for the RGB camera. More...
mrpt::img::TCamera	m_cameraParamsDepth
	Params for the Depth camera. More...
mrpt::poses::CPose3D	m_relativePoseIntensityWRTDepth
	See mrpt::obs::CObservation3DRangeScan for a diagram of this pose. More...
int	m_initial_tilt_angle {360}
	Set Kinect tilt to an initial deegre (it should be take in account in the sensor pose by the user) More...
double	m_maxRange
	Sensor max range (meters) More...
int	m_user_device_number {0}
	Number of device to open (0:first,...) More...
bool	m_grab_image {true}
	Default: all true. More...
bool	m_grab_depth {true}
bool	m_grab_3D_points {true}
bool	m_grab_IMU {true}
TVideoChannel	m_video_channel
	The video channel to open: RGB or IR. More...
size_t	m_grab_decimation_counter {0}
	Used when "m_grab_decimation" is enabled. More...
TSensorState	m_state {ssInitializing}
bool	m_verbose {false}
std::string	m_path_for_external_images
	The path where to save off-rawlog images: empty means save images embedded in the rawlog. More...
std::string	m_external_images_format
	The extension ("jpg","gif","png",...) that determines the format of images saved externally. More...
unsigned int	m_external_images_jpeg_quality {95}
	For JPEG images, the quality (default=95%). More...
Common settings to any sensor, loaded in "loadConfig"
double	m_process_rate {0}
	See CGenericSensor. More...
size_t	m_max_queue_len {200}
	See CGenericSensor. More...
size_t	m_grab_decimation {0}
	If set to N>=2, only 1 out of N observations will be saved to m_objList. More...
std::string	m_sensorLabel
	See CGenericSensor. More...

Private Member Functions
void	calculate_range2meters ()
	Compute m_range2meters at construction. More...

Private Attributes
std::vector< uint8_t >	m_buf_depth
	Temporary buffers for image grabbing. More...
std::vector< uint8_t >	m_buf_rgb
TDepth2RangeArray	m_range2meters
	The table raw depth -> range in meters. More...

Member Typedef Documentation

Ptr

using mrpt::hwdrivers::CGenericSensor::Ptr = std::shared_ptr<CGenericSensor>

inherited

Definition at line 73 of file CGenericSensor.h.

TDepth2RangeArray

using mrpt::hwdrivers::CKinect::TDepth2RangeArray = uint16_t[KINECT_RANGES_TABLE_LEN]

A type for an array that converts raw depth to ranges in millimeters.

Definition at line 271 of file CKinect.h.

TListObservations

using mrpt::hwdrivers::CGenericSensor::TListObservations = std::multimap< mrpt::system::TTimeStamp, mrpt::serialization::CSerializable::Ptr>

inherited

Definition at line 77 of file CGenericSensor.h.

TListObsPair

using mrpt::hwdrivers::CGenericSensor::TListObsPair = std::pair< mrpt::system::TTimeStamp, mrpt::serialization::CSerializable::Ptr>

inherited

Definition at line 79 of file CGenericSensor.h.

Member Enumeration Documentation

TSensorState

enum mrpt::hwdrivers::CGenericSensor::TSensorState

inherited

The current state of the sensor.

See also

CGenericSensor::getState

Enumerator
ssInitializing
ssWorking
ssError
ssUninitialized

Definition at line 84 of file CGenericSensor.h.

TVideoChannel

enum mrpt::hwdrivers::CKinect::TVideoChannel

RGB or IR video channel identifiers.

See also

setVideoChannel

Enumerator
VIDEO_CHANNEL_RGB
VIDEO_CHANNEL_IR

Definition at line 274 of file CKinect.h.

Constructor & Destructor Documentation

CKinect()

CKinect::CKinect

(

)

Default ctor.

Definition at line 82 of file CKinect.cpp.

References calculate_range2meters(), mrpt::img::TCamera::cx(), mrpt::img::TCamera::cy(), mrpt::img::TCamera::dist, mrpt::img::TCamera::fx(), mrpt::img::TCamera::fy(), KINECT_RANGES_TABLE_LEN, m_cameraParamsDepth, m_cameraParamsRGB, m_maxRange, m_range2meters, mrpt::hwdrivers::CGenericSensor::m_sensorLabel, mrpt::img::TCamera::ncols, mrpt::img::TCamera::nrows, and THROW_EXCEPTION.

Here is the call graph for this function:

~CKinect()

CKinect::~CKinect ( )

override

Default ctor.

Definition at line 129 of file CKinect.cpp.

References close().

Here is the call graph for this function:

Member Function Documentation

appendObservation()

void mrpt::hwdrivers::CGenericSensor::appendObservation ( const mrpt::serialization::CSerializable::Ptr &  obj )

inlineprotectedinherited

Like appendObservations() but for just one observation.

Definition at line 180 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::appendObservations().

Referenced by mrpt::hwdrivers::CGyroKVHDSP3000::doProcess(), mrpt::hwdrivers::CSkeletonTracker::doProcess(), mrpt::hwdrivers::CSwissRanger3DCamera::doProcess(), mrpt::hwdrivers::C2DRangeFinderAbstract::doProcess(), mrpt::hwdrivers::CCANBusReader::doProcess(), mrpt::hwdrivers::CVelodyneScanner::doProcess(), and mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow().

Here is the call graph for this function:

Here is the caller graph for this function:

appendObservations()

void CGenericSensor::appendObservations ( const std::vector< mrpt::serialization::CSerializable::Ptr > &  obj )

protectedinherited

This method must be called by derived classes to enqueue a new observation in the list to be returned by getObservations.

Passed objects must be created in dynamic memory and a smart pointer passed. Example of creation:

  mrpt::obs::CObservationGPS::Ptr  o = CObservationGPS::Ptr( new
CObservationGPS() );
  o-> .... // Set data
  appendObservation(o);

If several observations are passed at once in the vector, they'll be considered as a block regarding the grabbing decimation factor.

Definition at line 48 of file CGenericSensor.cpp.

References CLASS_ID, mrpt::hwdrivers::CGenericSensor::m_csObjList, mrpt::hwdrivers::CGenericSensor::m_grab_decimation, mrpt::hwdrivers::CGenericSensor::m_grab_decimation_counter, mrpt::hwdrivers::CGenericSensor::m_objList, and THROW_EXCEPTION.

Referenced by mrpt::hwdrivers::CGenericSensor::appendObservation(), mrpt::hwdrivers::CNationalInstrumentsDAQ::doProcess(), and doProcess().

Here is the caller graph for this function:

calculate_range2meters()

void CKinect::calculate_range2meters ( )

private

Compute m_range2meters at construction.

Definition at line 57 of file CKinect.cpp.

References KINECT_RANGES_TABLE_LEN.

Referenced by CKinect().

Here is the caller graph for this function:

close()

void CKinect::close

(

)

Close the Connection to the sensor (not need to call it manually unless desired for some reason, since it's called at destructor)

Definition at line 447 of file CKinect.cpp.

Referenced by open(), and ~CKinect().

Here is the caller graph for this function:

cols()

size_t mrpt::hwdrivers::CKinect::cols ( ) const

inline

Get the col count in the camera images, loaded automatically upon camera open().

Definition at line 397 of file CKinect.h.

References m_cameraParamsRGB, and mrpt::img::TCamera::ncols.

createSensor()

CGenericSensor * CGenericSensor::createSensor ( const std::string &  className )

staticinherited

Creates a sensor by a name of the class.

Typically the user may want to create a smart pointer around the returned pointer, whis is made with:

  CGenericSensor::Ptr sensor = CGenericSensor::Ptr(
CGenericSensor::createSensor("XXX") );

Returns

A pointer to a new class, or nullptr if class name is unknown.

Definition at line 97 of file CGenericSensor.cpp.

References mrpt::hwdrivers::CGenericSensor::get_registered_sensor_classes().

Referenced by mrpt::hwdrivers::CGenericSensor::createSensorPtr().

Here is the call graph for this function:

Here is the caller graph for this function:

createSensorPtr()

static Ptr mrpt::hwdrivers::CGenericSensor::createSensorPtr ( const std::string &  className )

inlinestaticinherited

Just like createSensor, but returning a smart pointer to the newly created sensor object.

Definition at line 210 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::createSensor().

Referenced by mrpt::apps::RawlogGrabberApp::SensorThread().

Here is the call graph for this function:

Here is the caller graph for this function:

disablePreviewRGB()

void mrpt::hwdrivers::CKinect::disablePreviewRGB ( )

inline

Definition at line 376 of file CKinect.h.

References m_preview_window.

doProcess()

void CKinect::doProcess ( )

overridevirtual

To be called at a high rate (>XX Hz), this method populates the internal buffer of received observations.

This method will be invoked at a minimum rate of "process_rate" (Hz)

This method is mainly intended for usage within rawlog-grabber or similar programs. For an alternative, see getNextObservation()

Exceptions

This	method must throw an exception with a descriptive message if some critical error is found.

See also

getNextObservation

Exceptions

This	method must throw an exception with a descriptive message if some critical error is found.

Implements mrpt::hwdrivers::CGenericSensor.

Definition at line 140 of file CKinect.cpp.

References mrpt::hwdrivers::CGenericSensor::appendObservations(), getNextObservation(), m_grab_3D_points, m_grab_depth, m_grab_image, m_grab_IMU, mrpt::hwdrivers::CGenericSensor::m_state, mrpt::hwdrivers::CGenericSensor::ssError, mrpt::hwdrivers::CGenericSensor::ssWorking, and THROW_EXCEPTION.

Here is the call graph for this function:

enableGrab3DPoints()

void mrpt::hwdrivers::CKinect::enableGrab3DPoints ( bool  enable = true )

inline

Enable/disable the grabbing of the 3D point clouds.

Definition at line 457 of file CKinect.h.

References m_grab_3D_points.

enableGrabAccelerometers()

void mrpt::hwdrivers::CKinect::enableGrabAccelerometers ( bool  enable = true )

inline

Enable/disable the grabbing of the inertial data.

Definition at line 451 of file CKinect.h.

References m_grab_IMU.

enableGrabDepth()

void mrpt::hwdrivers::CKinect::enableGrabDepth ( bool  enable = true )

inline

Enable/disable the grabbing of the depth channel.

Definition at line 448 of file CKinect.h.

References m_grab_depth.

enableGrabRGB()

void mrpt::hwdrivers::CKinect::enableGrabRGB ( bool  enable = true )

inline

Enable/disable the grabbing of the RGB channel.

Definition at line 445 of file CKinect.h.

References m_grab_image.

enablePreviewRGB()

void mrpt::hwdrivers::CKinect::enablePreviewRGB ( bool  enable = true )

inline

Default: disabled.

Definition at line 372 of file CKinect.h.

References m_preview_window.

enableVerbose()

void mrpt::hwdrivers::CGenericSensor::enableVerbose ( bool  enabled = true )

inlineinherited

Enable or disable extra debug info dumped to std::cout during sensor operation.

Default: disabled unless the environment variable "MRPT_HWDRIVERS_VERBOSE" is set to "1" during object creation.

Definition at line 106 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_verbose.

getCameraParamsDepth()

const mrpt::img::TCamera& mrpt::hwdrivers::CKinect::getCameraParamsDepth ( ) const

inline

Get a const reference to the depth camera calibration parameters.

Definition at line 409 of file CKinect.h.

References m_cameraParamsDepth.

getCameraParamsIntensity()

const mrpt::img::TCamera& mrpt::hwdrivers::CKinect::getCameraParamsIntensity ( ) const

inline

Get a const reference to the depth camera calibration parameters.

Definition at line 399 of file CKinect.h.

References m_cameraParamsRGB.

getDeviceIndexToOpen()

int mrpt::hwdrivers::CKinect::getDeviceIndexToOpen ( ) const

inline

Definition at line 366 of file CKinect.h.

References m_user_device_number.

getExternalImageJPEGQuality()

unsigned int mrpt::hwdrivers::CGenericSensor::getExternalImageJPEGQuality ( ) const

inlineinherited

Definition at line 279 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_external_images_jpeg_quality.

getMaxRange()

double mrpt::hwdrivers::CKinect::getMaxRange ( ) const

inline

Get the maximum range (meters) that can be read in the observation field "rangeImage".

Definition at line 391 of file CKinect.h.

References m_maxRange.

getNextObservation() [1/2]

void CKinect::getNextObservation	(	mrpt::obs::CObservation3DRangeScan &	m_out_obs,
		bool &	there_is_obs,
		bool &	hardware_error
	)

The main data retrieving function, to be called after calling loadConfig() and initialize().

Parameters

out_obs	The output retrieved observation (only if there_is_obs=true).
there_is_obs	If set to false, there was no new observation.
hardware_error	True on hardware/comms error.

See also

doProcess

Definition at line 504 of file CKinect.cpp.

References mrpt::obs::CObservation3DRangeScan::cameraParams, mrpt::obs::CObservation3DRangeScan::cameraParamsIntensity, mrpt::gui::CDisplayWindow::Create(), mrpt::obs::CObservation3DRangeScan::hasIntensityImage, mrpt::obs::CObservation3DRangeScan::hasRangeImage, mrpt::obs::CObservation3DRangeScan::intensityImage, m_cameraParamsDepth, m_cameraParamsRGB, m_grab_3D_points, m_grab_depth, m_grab_image, m_preview_decim_counter_range, m_preview_decim_counter_rgb, m_preview_window, m_preview_window_decimation, m_relativePoseIntensityWRTDepth, mrpt::hwdrivers::CGenericSensor::m_sensorLabel, m_sensorPoseOnRobot, m_win_int, m_win_range, mrpt::img::TCamera::ncols, mrpt::system::now(), mrpt::img::TCamera::nrows, mrpt::obs::CObservation3DRangeScan::rangeImage, mrpt::obs::CObservation3DRangeScan::rangeImage_getAsImage(), mrpt::obs::CObservation3DRangeScan::relativePoseIntensityWRTDepth, mrpt::math::CMatrixDynamic< T >::resize(), mrpt::obs::CObservation::sensorLabel, mrpt::obs::CObservation3DRangeScan::sensorPose, mrpt::obs::CObservation3DRangeScan::swap(), mrpt::obs::CObservation::timestamp, and mrpt::obs::CObservation3DRangeScan::unprojectInto().

Referenced by doProcess(), and getNextObservation().

Here is the call graph for this function:

Here is the caller graph for this function:

getNextObservation() [2/2]

void CKinect::getNextObservation	(	mrpt::obs::CObservation3DRangeScan &	out_obs,
		mrpt::obs::CObservationIMU &	out_obs_imu,
		bool &	there_is_obs,
		bool &	hardware_error
	)

This is an overloaded member function, provided for convenience. It differs from the above function only in what argument(s) it accepts.

Note

This method also grabs data from the accelerometers, returning them in out_obs_imu

Definition at line 648 of file CKinect.cpp.

References mrpt::obs::CObservationIMU::dataIsPresent, getNextObservation(), mrpt::obs::IMU_X_ACC, mrpt::obs::IMU_Y_ACC, mrpt::obs::IMU_Z_ACC, m_grab_IMU, mrpt::obs::CObservationIMU::rawMeasurements, mrpt::obs::CObservation::sensorLabel, mrpt::obs::CObservationIMU::sensorPose, mrpt::obs::CObservation3DRangeScan::sensorPose, and mrpt::obs::CObservation::timestamp.

Here is the call graph for this function:

getObservations()

void CGenericSensor::getObservations ( TListObservations &  lstObjects )

inherited

Returns a list of enqueued objects, emptying it (thread-safe).

The objects must be freed by the invoker.

Definition at line 85 of file CGenericSensor.cpp.

References mrpt::hwdrivers::CGenericSensor::m_csObjList, and mrpt::hwdrivers::CGenericSensor::m_objList.

Referenced by TEST().

Here is the caller graph for this function:

getPreviewDecimation()

size_t mrpt::hwdrivers::CKinect::getPreviewDecimation ( ) const

inline

Definition at line 384 of file CKinect.h.

References m_preview_window_decimation.

getProcessRate()

double mrpt::hwdrivers::CGenericSensor::getProcessRate ( ) const

inlineinherited

Definition at line 94 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_process_rate.

getRawDepth2RangeConversion() [1/2]

TDepth2RangeArray& mrpt::hwdrivers::CKinect::getRawDepth2RangeConversion ( )

inline

Get a reference to the array that convert raw depth values (10 or 11 bit) into ranges in mm, so it can be read or replaced by the user.

If you replace it, remember to set the first and last entries (index 0 and KINECT_RANGES_TABLE_LEN-1) to zero, to indicate that those are invalid ranges.

Definition at line 435 of file CKinect.h.

References m_range2meters.

getRawDepth2RangeConversion() [2/2]

const TDepth2RangeArray& mrpt::hwdrivers::CKinect::getRawDepth2RangeConversion ( ) const

inline

Definition at line 439 of file CKinect.h.

References m_range2meters.

getRelativePoseIntensityWrtDepth()

const mrpt::poses::CPose3D& mrpt::hwdrivers::CKinect::getRelativePoseIntensityWrtDepth ( ) const

inline

Definition at line 424 of file CKinect.h.

References m_relativePoseIntensityWRTDepth.

GetRuntimeClass()

virtual const mrpt::hwdrivers::TSensorClassId* mrpt::hwdrivers::CGenericSensor::GetRuntimeClass ( ) const

pure virtualinherited

getSensorLabel()

std::string mrpt::hwdrivers::CGenericSensor::getSensorLabel ( ) const

inlineinherited

Definition at line 95 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_sensorLabel.

getState()

TSensorState mrpt::hwdrivers::CGenericSensor::getState ( ) const

inlineinherited

The current state of the sensor.

Definition at line 93 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_state.

getTiltAngleDegrees()

double CKinect::getTiltAngleDegrees

(

)

Definition at line 733 of file CKinect.cpp.

References ASSERTMSG_, and isOpen().

Here is the call graph for this function:

getVideoChannel()

TVideoChannel mrpt::hwdrivers::CKinect::getVideoChannel ( ) const

inline

Return the current video channel (RGB or IR)

See also

setVideoChannel

Definition at line 359 of file CKinect.h.

References m_video_channel.

initialize()

void CKinect::initialize ( )

overridevirtual

Initializes the 3D camera - should be invoked after calling loadConfig() or setting the different parameters with the set*() methods.

This method can or cannot be implemented in the derived class, depending on the need for it.

Exceptions

This	method must throw an exception with a descriptive message if some critical error is found.

Reimplemented from mrpt::hwdrivers::CGenericSensor.

Definition at line 135 of file CKinect.cpp.

References open().

Here is the call graph for this function:

isGrab3DPointsEnabled()

bool mrpt::hwdrivers::CKinect::isGrab3DPointsEnabled ( ) const

inline

Definition at line 461 of file CKinect.h.

References m_grab_3D_points.

isGrabAccelerometersEnabled()

bool mrpt::hwdrivers::CKinect::isGrabAccelerometersEnabled ( ) const

inline

Definition at line 455 of file CKinect.h.

References m_grab_IMU.

isGrabDepthEnabled()

bool mrpt::hwdrivers::CKinect::isGrabDepthEnabled ( ) const

inline

Definition at line 449 of file CKinect.h.

References m_grab_depth.

isGrabRGBEnabled()

bool mrpt::hwdrivers::CKinect::isGrabRGBEnabled ( ) const

inline

Definition at line 446 of file CKinect.h.

References m_grab_image.

isOpen()

bool CKinect::isOpen

(

)

const

Whether there is a working connection to the sensor.

Definition at line 249 of file CKinect.cpp.

Referenced by getTiltAngleDegrees(), open(), setTiltAngleDegrees(), and setVideoChannel().

Here is the caller graph for this function:

isPreviewRGBEnabled()

bool mrpt::hwdrivers::CKinect::isPreviewRGBEnabled ( ) const

inline

Definition at line 377 of file CKinect.h.

References m_preview_window.

isVerboseEnabled()

bool mrpt::hwdrivers::CGenericSensor::isVerboseEnabled ( ) const

inlineinherited

Definition at line 107 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_verbose.

loadConfig()

void CGenericSensor::loadConfig ( const mrpt::config::CConfigFileBase &  cfg, const std::string &  sect  )

inherited

Loads the generic settings common to any sensor (See CGenericSensor), then call to "loadConfig_sensorSpecific".

Exceptions

This	method throws an exception with a descriptive message if some critical parameter is missing or has an invalid value.

Definition at line 126 of file CGenericSensor.cpp.

References mrpt::hwdrivers::CGenericSensor::loadConfig_sensorSpecific(), mrpt::hwdrivers::CGenericSensor::m_grab_decimation, mrpt::hwdrivers::CGenericSensor::m_grab_decimation_counter, mrpt::hwdrivers::CGenericSensor::m_max_queue_len, mrpt::hwdrivers::CGenericSensor::m_process_rate, mrpt::hwdrivers::CGenericSensor::m_sensorLabel, MRPT_END, MRPT_START, mrpt::config::CConfigFileBase::read_double(), mrpt::config::CConfigFileBase::read_int(), mrpt::config::CConfigFileBase::read_string(), and sect.

Here is the call graph for this function:

loadConfig_sensorSpecific()

void CKinect::loadConfig_sensorSpecific ( const mrpt::config::CConfigFileBase &  configSource, const std::string &  iniSection  )

overrideprotectedvirtual

See the class documentation at the top for expected parameters.

Loads specific configuration for the device from a given source of configuration parameters, for example, an ".ini" file, loading from the section "[iniSection]" (see config::CConfigFileBase and derived classes)

Exceptions

This	method must throw an exception with a descriptive message if some critical parameter is missing or has an invalid value.

Implements mrpt::hwdrivers::CGenericSensor.

Definition at line 175 of file CKinect.cpp.

References mrpt::poses::CPose3DQuat::asTPose(), mrpt::DEG2RAD(), mrpt::poses::CPose3D::fromString(), mrpt::img::TStereoCamera::leftCamera, mrpt::img::TStereoCamera::loadFromConfigFile(), m_cameraParamsDepth, m_cameraParamsRGB, m_grab_3D_points, m_grab_depth, m_grab_image, m_grab_IMU, m_initial_tilt_angle, m_preview_window, m_relativePoseIntensityWRTDepth, m_sensorPoseOnRobot, m_user_device_number, m_video_channel, mrpt::config::CConfigFileBase::read_bool(), mrpt::config::CConfigFileBase::read_enum(), mrpt::config::CConfigFileBase::read_float(), mrpt::config::CConfigFileBase::read_int(), mrpt::config::CConfigFileBase::read_string(), mrpt::img::TStereoCamera::rightCamera, mrpt::img::TStereoCamera::rightCameraPose, mrpt::poses::CPose3D::setFromValues(), and twist().

Here is the call graph for this function:

open()

void CKinect::open

(

)

Try to open the camera (set all the parameters before calling this) - users may also call initialize(), which in turn calls this method.

Raises an exception upon error.

Exceptions

std::exception

A textual description of the error.

Definition at line 362 of file CKinect.cpp.

References close(), isOpen(), m_buf_depth, m_buf_rgb, m_cameraParamsDepth, m_cameraParamsRGB, m_initial_tilt_angle, m_user_device_number, m_video_channel, mrpt::img::TCamera::ncols, mrpt::img::TCamera::nrows, setTiltAngleDegrees(), THROW_EXCEPTION, THROW_EXCEPTION_FMT, and VIDEO_CHANNEL_IR.

Referenced by initialize().

Here is the call graph for this function:

Here is the caller graph for this function:

registerClass()

void CGenericSensor::registerClass ( const TSensorClassId *  pNewClass )

staticinherited

Register a class into the internal list of "CGenericSensor" descendents.

Used internally in the macros DEFINE_GENERIC_SENSOR, etc...

Can be used as "CGenericSensor::registerClass( SENSOR_CLASS_ID(CMySensor) );" if building custom sensors outside mrpt libraries in user code.

Definition at line 115 of file CGenericSensor.cpp.

References mrpt::hwdrivers::TSensorClassId::className, and mrpt::hwdrivers::CGenericSensor::get_registered_sensor_classes().

Here is the call graph for this function:

rows()

size_t mrpt::hwdrivers::CKinect::rows ( ) const

inline

Get the row count in the camera images, loaded automatically upon camera open().

Definition at line 394 of file CKinect.h.

References m_cameraParamsRGB, and mrpt::img::TCamera::nrows.

setCameraParamsDepth()

void mrpt::hwdrivers::CKinect::setCameraParamsDepth ( const mrpt::img::TCamera &  p )

inline

Definition at line 413 of file CKinect.h.

References m_cameraParamsDepth.

setCameraParamsIntensity()

void mrpt::hwdrivers::CKinect::setCameraParamsIntensity ( const mrpt::img::TCamera &  p )

inline

Definition at line 403 of file CKinect.h.

References m_cameraParamsRGB.

setDeviceIndexToOpen()

void mrpt::hwdrivers::CKinect::setDeviceIndexToOpen ( int  index )

inline

Set the sensor index to open (if there're several sensors attached to the computer); default=0 -> the first one.

Definition at line 362 of file CKinect.h.

References m_user_device_number.

setExternalImageFormat()

void mrpt::hwdrivers::CGenericSensor::setExternalImageFormat ( const std::string &  ext )

inlineinherited

Set the extension ("jpg","gif","png",...) that determines the format of images saved externally The default is "jpg".

See also

setPathForExternalImages, setExternalImageJPEGQuality

Definition at line 268 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_external_images_format.

setExternalImageJPEGQuality()

void mrpt::hwdrivers::CGenericSensor::setExternalImageJPEGQuality ( const unsigned int  quality )

inlineinherited

The quality of JPEG compression, when external images is enabled and the format is "jpg".

See also

setExternalImageFormat

Definition at line 275 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_external_images_jpeg_quality.

setPathForExternalImages() [1/2]

virtual void mrpt::hwdrivers::CGenericSensor::setPathForExternalImages ( [ [maybe_unused] ] const std::string &  directory )

inlinevirtualinherited

Set the path where to save off-rawlog image files (will be ignored in those sensors where this is not applicable).

An empty string (the default value at construction) means to save images embedded in the rawlog, instead of on separate files.

Exceptions

std::exception

If the directory doesn't exists and cannot be created.

Definition at line 257 of file CGenericSensor.h.

setPathForExternalImages() [2/2]

void CKinect::setPathForExternalImages ( const std::string &  directory )

override

Set the path where to save off-rawlog image files (this class DOES take into account this path).

An empty string (the default value at construction) means to save images embedded in the rawlog, instead of on separate files.

Exceptions

std::exception

If the directory doesn't exists and cannot be created.

Definition at line 706 of file CKinect.cpp.

setPreviewDecimation()

void mrpt::hwdrivers::CKinect::setPreviewDecimation ( size_t  decimation_factor )

inline

If preview is enabled, show only one image out of N (default: 1=show all)

Definition at line 380 of file CKinect.h.

References m_preview_window_decimation.

setRelativePoseIntensityWrtDepth()

void mrpt::hwdrivers::CKinect::setRelativePoseIntensityWrtDepth ( const mrpt::poses::CPose3D &  p )

inline

Set the pose of the intensity camera wrt the depth camera.

See also

See mrpt::obs::CObservation3DRangeScan for a 3D diagram of this pose

Definition at line 420 of file CKinect.h.

References m_relativePoseIntensityWRTDepth.

setSensorLabel()

void mrpt::hwdrivers::CGenericSensor::setSensorLabel ( const std::string &  sensorLabel )

inlineinherited

Definition at line 96 of file CGenericSensor.h.

References mrpt::hwdrivers::CGenericSensor::m_sensorLabel.

setTiltAngleDegrees()

void CKinect::setTiltAngleDegrees

(

double

angle

)

Change tilt angle.

Note

Sensor must be open first.

Definition at line 724 of file CKinect.cpp.

References ASSERTMSG_, and isOpen().

Referenced by open().

Here is the call graph for this function:

Here is the caller graph for this function:

setVideoChannel()

void CKinect::setVideoChannel

(

const TVideoChannel

vch

)

Changes the video channel to open (RGB or IR) - you can call this method before start grabbing or in the middle of streaming and the video source will change on the fly.

Default is RGB channel.

Definition at line 468 of file CKinect.cpp.

References isOpen(), m_video_channel, THROW_EXCEPTION, and VIDEO_CHANNEL_IR.

Here is the call graph for this function:

Member Data Documentation

m_buf_depth

std::vector<uint8_t> mrpt::hwdrivers::CKinect::m_buf_depth

private

Temporary buffers for image grabbing.

Definition at line 537 of file CKinect.h.

Referenced by open().

m_buf_rgb

std::vector<uint8_t> mrpt::hwdrivers::CKinect::m_buf_rgb

private

Definition at line 537 of file CKinect.h.

Referenced by open().

m_cameraParamsDepth

mrpt::img::TCamera mrpt::hwdrivers::CKinect::m_cameraParamsDepth

protected

Params for the Depth camera.

Definition at line 514 of file CKinect.h.

Referenced by CKinect(), getCameraParamsDepth(), getNextObservation(), loadConfig_sensorSpecific(), open(), and setCameraParamsDepth().

m_cameraParamsRGB

mrpt::img::TCamera mrpt::hwdrivers::CKinect::m_cameraParamsRGB

protected

Params for the RGB camera.

Definition at line 512 of file CKinect.h.

Referenced by CKinect(), cols(), getCameraParamsIntensity(), getNextObservation(), loadConfig_sensorSpecific(), open(), rows(), and setCameraParamsIntensity().

m_external_images_format

std::string mrpt::hwdrivers::CGenericSensor::m_external_images_format

protectedinherited

The extension ("jpg","gif","png",...) that determines the format of images saved externally.

See also

setPathForExternalImages

Definition at line 158 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::CSwissRanger3DCamera::loadConfig_sensorSpecific(), and mrpt::hwdrivers::CGenericSensor::setExternalImageFormat().

m_external_images_jpeg_quality

unsigned int mrpt::hwdrivers::CGenericSensor::m_external_images_jpeg_quality {95}

protectedinherited

For JPEG images, the quality (default=95%).

Definition at line 160 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CGenericSensor::getExternalImageJPEGQuality(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::CSwissRanger3DCamera::loadConfig_sensorSpecific(), and mrpt::hwdrivers::CGenericSensor::setExternalImageJPEGQuality().

m_grab_3D_points

bool mrpt::hwdrivers::CKinect::m_grab_3D_points {true}

protected

Definition at line 529 of file CKinect.h.

Referenced by doProcess(), enableGrab3DPoints(), getNextObservation(), isGrab3DPointsEnabled(), and loadConfig_sensorSpecific().

m_grab_decimation

size_t mrpt::hwdrivers::CGenericSensor::m_grab_decimation {0}

protectedinherited

If set to N>=2, only 1 out of N observations will be saved to m_objList.

Definition at line 139 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CGenericSensor::appendObservations(), and mrpt::hwdrivers::CGenericSensor::loadConfig().

m_grab_decimation_counter

size_t mrpt::hwdrivers::CGenericSensor::m_grab_decimation_counter {0}

protectedinherited

Used when "m_grab_decimation" is enabled.

Definition at line 146 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CGenericSensor::appendObservations(), and mrpt::hwdrivers::CGenericSensor::loadConfig().

m_grab_depth

bool mrpt::hwdrivers::CKinect::m_grab_depth {true}

protected

Definition at line 529 of file CKinect.h.

Referenced by doProcess(), enableGrabDepth(), getNextObservation(), isGrabDepthEnabled(), and loadConfig_sensorSpecific().

m_grab_image

bool mrpt::hwdrivers::CKinect::m_grab_image {true}

protected

Default: all true.

Definition at line 529 of file CKinect.h.

Referenced by doProcess(), enableGrabRGB(), getNextObservation(), isGrabRGBEnabled(), and loadConfig_sensorSpecific().

m_grab_IMU

bool mrpt::hwdrivers::CKinect::m_grab_IMU {true}

protected

Definition at line 530 of file CKinect.h.

Referenced by doProcess(), enableGrabAccelerometers(), getNextObservation(), isGrabAccelerometersEnabled(), and loadConfig_sensorSpecific().

m_initial_tilt_angle

int mrpt::hwdrivers::CKinect::m_initial_tilt_angle {360}

protected

Set Kinect tilt to an initial deegre (it should be take in account in the sensor pose by the user)

Definition at line 520 of file CKinect.h.

Referenced by loadConfig_sensorSpecific(), and open().

m_max_queue_len

size_t mrpt::hwdrivers::CGenericSensor::m_max_queue_len {200}

protectedinherited

See CGenericSensor.

Definition at line 136 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CGenericSensor::loadConfig().

m_maxRange

double mrpt::hwdrivers::CKinect::m_maxRange

protected

Sensor max range (meters)

Definition at line 523 of file CKinect.h.

Referenced by CKinect(), and getMaxRange().

m_path_for_external_images

std::string mrpt::hwdrivers::CGenericSensor::m_path_for_external_images

protectedinherited

The path where to save off-rawlog images: empty means save images embedded in the rawlog.

Definition at line 155 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), and mrpt::hwdrivers::CSwissRanger3DCamera::setPathForExternalImages().

m_preview_decim_counter_range

size_t mrpt::hwdrivers::CKinect::m_preview_decim_counter_range {0}

protected

Definition at line 495 of file CKinect.h.

Referenced by getNextObservation().

m_preview_decim_counter_rgb

size_t mrpt::hwdrivers::CKinect::m_preview_decim_counter_rgb {0}

protected

Definition at line 495 of file CKinect.h.

Referenced by getNextObservation().

m_preview_window

bool mrpt::hwdrivers::CKinect::m_preview_window {false}

protected

Show preview window while grabbing.

Definition at line 492 of file CKinect.h.

Referenced by disablePreviewRGB(), enablePreviewRGB(), getNextObservation(), isPreviewRGBEnabled(), and loadConfig_sensorSpecific().

m_preview_window_decimation

size_t mrpt::hwdrivers::CKinect::m_preview_window_decimation {1}

protected

If preview is enabled, only show 1 out of N images.

Definition at line 494 of file CKinect.h.

Referenced by getNextObservation(), getPreviewDecimation(), and setPreviewDecimation().

m_process_rate

double mrpt::hwdrivers::CGenericSensor::m_process_rate {0}

protectedinherited

See CGenericSensor.

Definition at line 134 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CGenericSensor::getProcessRate(), mrpt::hwdrivers::CGyroKVHDSP3000::initialize(), and mrpt::hwdrivers::CGenericSensor::loadConfig().

m_range2meters

TDepth2RangeArray mrpt::hwdrivers::CKinect::m_range2meters

private

The table raw depth -> range in meters.

Definition at line 539 of file CKinect.h.

Referenced by CKinect(), and getRawDepth2RangeConversion().

m_relativePoseIntensityWRTDepth

mrpt::poses::CPose3D mrpt::hwdrivers::CKinect::m_relativePoseIntensityWRTDepth

protected

See mrpt::obs::CObservation3DRangeScan for a diagram of this pose.

Definition at line 516 of file CKinect.h.

Referenced by getNextObservation(), getRelativePoseIntensityWrtDepth(), loadConfig_sensorSpecific(), and setRelativePoseIntensityWrtDepth().

m_sensorLabel

std::string mrpt::hwdrivers::CGenericSensor::m_sensorLabel

protectedinherited

See CGenericSensor.

Definition at line 141 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CCANBusReader::CCANBusReader(), mrpt::hwdrivers::CGPSInterface::CGPSInterface(), mrpt::hwdrivers::CGyroKVHDSP3000::CGyroKVHDSP3000(), mrpt::hwdrivers::CHokuyoURG::CHokuyoURG(), mrpt::hwdrivers::CIMUXSens_MT4::CIMUXSens_MT4(), CKinect(), mrpt::hwdrivers::CNationalInstrumentsDAQ::CNationalInstrumentsDAQ(), mrpt::hwdrivers::CRoboPeakLidar::CRoboPeakLidar(), mrpt::hwdrivers::CSickLaserSerial::CSickLaserSerial(), mrpt::hwdrivers::CSickLaserUSB::CSickLaserUSB(), mrpt::hwdrivers::CSkeletonTracker::CSkeletonTracker(), mrpt::hwdrivers::CSwissRanger3DCamera::CSwissRanger3DCamera(), mrpt::hwdrivers::CVelodyneScanner::CVelodyneScanner(), mrpt::hwdrivers::CGyroKVHDSP3000::doProcess(), mrpt::hwdrivers::CSkeletonTracker::doProcess(), mrpt::hwdrivers::CRoboPeakLidar::doProcessSimple(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), getNextObservation(), mrpt::hwdrivers::CVelodyneScanner::getNextObservation(), mrpt::hwdrivers::CGenericSensor::getSensorLabel(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::hwdrivers::CGenericSensor::loadConfig(), mrpt::hwdrivers::CSkeletonTracker::processPreview(), mrpt::hwdrivers::C2DRangeFinderAbstract::processPreview(), mrpt::hwdrivers::CSkeletonTracker::processPreviewNone(), and mrpt::hwdrivers::CGenericSensor::setSensorLabel().

m_sensorPoseOnRobot

mrpt::poses::CPose3D mrpt::hwdrivers::CKinect::m_sensorPoseOnRobot

protected

Definition at line 489 of file CKinect.h.

Referenced by getNextObservation(), and loadConfig_sensorSpecific().

m_state

TSensorState mrpt::hwdrivers::CGenericSensor::m_state {ssInitializing}

protectedinherited

Definition at line 148 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CGyroKVHDSP3000::CGyroKVHDSP3000(), mrpt::hwdrivers::CIMUXSens_MT4::doProcess(), mrpt::hwdrivers::CGyroKVHDSP3000::doProcess(), mrpt::hwdrivers::CSkeletonTracker::doProcess(), mrpt::hwdrivers::CSwissRanger3DCamera::doProcess(), mrpt::hwdrivers::C2DRangeFinderAbstract::doProcess(), mrpt::hwdrivers::CGPSInterface::doProcess(), mrpt::hwdrivers::CNationalInstrumentsDAQ::doProcess(), doProcess(), mrpt::hwdrivers::CVelodyneScanner::doProcess(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::hwdrivers::CVelodyneScanner::getNextObservation(), mrpt::hwdrivers::CGenericSensor::getState(), mrpt::hwdrivers::CIMUXSens_MT4::initialize(), mrpt::hwdrivers::CGyroKVHDSP3000::initialize(), mrpt::hwdrivers::CSkeletonTracker::initialize(), mrpt::hwdrivers::CVelodyneScanner::initialize(), and mrpt::hwdrivers::CNationalInstrumentsDAQ::readFromDAQ().

m_user_device_number

int mrpt::hwdrivers::CKinect::m_user_device_number {0}

protected

Number of device to open (0:first,...)

Definition at line 526 of file CKinect.h.

Referenced by getDeviceIndexToOpen(), loadConfig_sensorSpecific(), open(), and setDeviceIndexToOpen().

m_verbose

bool mrpt::hwdrivers::CGenericSensor::m_verbose {false}

protectedinherited

Definition at line 149 of file CGenericSensor.h.

Referenced by mrpt::hwdrivers::CGenericSensor::CGenericSensor(), mrpt::hwdrivers::CRoboPeakLidar::checkCOMMs(), mrpt::hwdrivers::CNTRIPEmitter::doProcess(), mrpt::hwdrivers::CGPSInterface::doProcess(), mrpt::hwdrivers::CGenericSensor::enableVerbose(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::hwdrivers::CIMUXSens_MT4::initialize(), mrpt::hwdrivers::CHokuyoURG::initialize(), mrpt::hwdrivers::CVelodyneScanner::internal_read_PCAP_packet(), mrpt::hwdrivers::CGenericSensor::isVerboseEnabled(), mrpt::hwdrivers::CGPSInterface::JAVAD_sendMessage(), mrpt::hwdrivers::CGPSInterface::legacy_topcon_setup_commands(), mrpt::hwdrivers::CSickLaserSerial::LMS_setupBaudrate(), mrpt::hwdrivers::CSickLaserSerial::LMS_setupSerialComms(), mrpt::hwdrivers::CSickLaserSerial::LMS_waitIncomingFrame(), mrpt::hwdrivers::CGPSInterface::OnConnectionEstablished(), mrpt::hwdrivers::CGPSInterface::OnConnectionShutdown(), mrpt::hwdrivers::CSickLaserSerial::SendCommandToSICK(), mrpt::hwdrivers::CNationalInstrumentsDAQ::stop(), and mrpt::hwdrivers::CGPSInterface::tryToOpenTheCOM().

m_video_channel

TVideoChannel mrpt::hwdrivers::CKinect::m_video_channel

protected

The video channel to open: RGB or IR.

Definition at line 533 of file CKinect.h.

Referenced by getVideoChannel(), loadConfig_sensorSpecific(), open(), and setVideoChannel().

m_win_int

mrpt::gui::CDisplayWindow::Ptr mrpt::hwdrivers::CKinect::m_win_int

protected

Definition at line 496 of file CKinect.h.

Referenced by getNextObservation().

m_win_range

mrpt::gui::CDisplayWindow::Ptr mrpt::hwdrivers::CKinect::m_win_range

protected

Definition at line 496 of file CKinect.h.

Referenced by getNextObservation().