A class for grabing "range images", intensity images (either RGB or IR) and other information from an Xbox Kinect sensor.
To use Kinect for Windows or ASUS/Primesense RGBD cameras, use the class COpenNI2.
Data is returned as observations of type mrpt::obs::CObservation3DRangeScan (and mrpt::obs::CObservationIMU for accelerometers data). See those classes for documentation on their fields.
As with any other CGenericSensor class, the normal sequence of methods to be called is:
For an accurate transformation of depth images to 3D points, you'll have to calibrate your Kinect, and supply the following threee pieces of information (default calibration data will be used otherwise, but they'll be not optimal for all sensors!):
See http://www.mrpt.org/Kinect_calibration for a procedure to calibrate Kinect sensors with an interactive GUI program.
The origin of coordinates is the focal point of the depth camera, with the axes oriented as in the diagram shown in mrpt::obs::CObservation3DRangeScan. Notice in that picture that the RGB camera is assumed to have axes as usual in computer vision, which differ from those for the depth camera.
The X,Y,Z axes used to report the data from accelerometers coincide with those of the depth camera (e.g. the camera standing on a table would have an ACC_Z=-9.8m/s2).
Notice however that, for consistency with stereo cameras, when loading the calibration parameters from a configuration file, the left-to-right pose increment is expected as if both RGB & IR cameras had their +Z axes pointing forward, +X to the right, +Y downwards (just like it's the standard in stereo cameras and in computer vision literature). In other words: the pose stored in this class uses a different axes convention for the depth camera than in a stereo camera, so when a pose L2R is loaded from a calibration file it's actually converted like:
L2R(this class convention) = CPose3D(0,0,0,-90deg,0deg,-90deg) (+) L2R(in the config file)
You can convert the 3D observation into a 3D point cloud with this piece of code:
Then the point cloud mrpt::maps::CColouredPointsMap can be converted into an OpenGL object for rendering with mrpt::maps::CMetricMap::getAs3DObject() or alternatively with:
At construction, this class builds an internal array for converting raw 10 or 11bit depths into ranges in meters. Users can read that array or modify it (if you have a better calibration, for example) by calling CKinect::getRawDepth2RangeConversion(). If you replace it, remember to set the first and last entries (index 0 and KINECT_RANGES_TABLE_LEN-1) to zero, to indicate that those are invalid ranges.
R(d) = k3 * tan(d/k2 + k1); k1 = 1.1863, k2 = 2842.5, k3 = 0.1236 |
For more details, refer to libfreenect documentation:
MRPT/scripts/51-kinect.rules
in /etc/udev/rules.d/
to allow access to all users.More references to read:
#include <mrpt/hwdrivers/CKinect.h>
Public Types | |
enum | TVideoChannel { VIDEO_CHANNEL_RGB = 0, VIDEO_CHANNEL_IR } |
RGB or IR video channel identifiers. More... | |
typedef float | TDepth2RangeArray[KINECT_RANGES_TABLE_LEN] |
A typedef for an array that converts raw depth to ranges in meters. More... | |
enum | TSensorState { ssInitializing = 0, ssWorking, ssError } |
The current state of the sensor. More... | |
using | Ptr = std::shared_ptr< CGenericSensor > |
typedef std::multimap< mrpt::system::TTimeStamp, mrpt::utils::CSerializable::Ptr > | TListObservations |
typedef std::pair< mrpt::system::TTimeStamp, mrpt::utils::CSerializable::Ptr > | TListObsPair |
Public Member Functions | |
CKinect () | |
Default ctor. More... | |
~CKinect () | |
Default ctor. More... | |
virtual void | initialize () |
Initializes the 3D camera - should be invoked after calling loadConfig() or setting the different parameters with the set*() methods. More... | |
virtual void | doProcess () |
To be called at a high rate (>XX Hz), this method populates the internal buffer of received observations. More... | |
void | getNextObservation (mrpt::obs::CObservation3DRangeScan &out_obs, bool &there_is_obs, bool &hardware_error) |
The main data retrieving function, to be called after calling loadConfig() and initialize(). More... | |
void | getNextObservation (mrpt::obs::CObservation3DRangeScan &out_obs, mrpt::obs::CObservationIMU &out_obs_imu, bool &there_is_obs, bool &hardware_error) |
This is an overloaded member function, provided for convenience. It differs from the above function only in what argument(s) it accepts. More... | |
virtual void | setPathForExternalImages (const std::string &directory) |
Set the path where to save off-rawlog image files (this class DOES take into account this path). More... | |
virtual const mrpt::hwdrivers::TSensorClassId * | GetRuntimeClass () const =0 |
TSensorState | getState () const |
The current state of the sensor. More... | |
double | getProcessRate () const |
std::string | getSensorLabel () const |
void | setSensorLabel (const std::string &sensorLabel) |
void | enableVerbose (bool enabled=true) |
Enable or disable extra debug info dumped to std::cout during sensor operation. More... | |
bool | isVerboseEnabled () const |
void | loadConfig (const mrpt::utils::CConfigFileBase &configSource, const std::string §ion) |
Loads the generic settings common to any sensor (See CGenericSensor), then call to "loadConfig_sensorSpecific". More... | |
void | getObservations (TListObservations &lstObjects) |
Returns a list of enqueued objects, emptying it (thread-safe). More... | |
void | setExternalImageFormat (const std::string &ext) |
Set the extension ("jpg","gif","png",...) that determines the format of images saved externally The default is "jpg". More... | |
void | setExternalImageJPEGQuality (const unsigned int quality) |
The quality of JPEG compression, when external images is enabled and the format is "jpg". More... | |
unsigned int | getExternalImageJPEGQuality () const |
Sensor parameters (alternative to \a loadConfig ) and manual | |
control | |
void | open () |
Try to open the camera (set all the parameters before calling this) - users may also call initialize(), which in turn calls this method. More... | |
bool | isOpen () const |
Whether there is a working connection to the sensor. More... | |
void | close () |
Close the Connection to the sensor (not need to call it manually unless desired for some reason, since it's called at destructor) More... | |
void | setVideoChannel (const TVideoChannel vch) |
Changes the video channel to open (RGB or IR) - you can call this method before start grabbing or in the middle of streaming and the video source will change on the fly. More... | |
TVideoChannel | getVideoChannel () const |
Return the current video channel (RGB or IR) More... | |
void | setDeviceIndexToOpen (int index) |
Set the sensor index to open (if there're several sensors attached to the computer); default=0 -> the first one. More... | |
int | getDeviceIndexToOpen () const |
void | setTiltAngleDegrees (double angle) |
Change tilt angle. More... | |
double | getTiltAngleDegrees () |
void | enablePreviewRGB (bool enable=true) |
Default: disabled. More... | |
void | disablePreviewRGB () |
bool | isPreviewRGBEnabled () const |
void | setPreviewDecimation (size_t decimation_factor) |
If preview is enabled, show only one image out of N (default: 1=show all) More... | |
size_t | getPreviewDecimation () const |
double | getMaxRange () const |
Get the maximum range (meters) that can be read in the observation field "rangeImage". More... | |
size_t | getRowCount () const |
Get the row count in the camera images, loaded automatically upon camera open(). More... | |
size_t | getColCount () const |
Get the col count in the camera images, loaded automatically upon camera open(). More... | |
const mrpt::utils::TCamera & | getCameraParamsIntensity () const |
Get a const reference to the depth camera calibration parameters. More... | |
void | setCameraParamsIntensity (const mrpt::utils::TCamera &p) |
const mrpt::utils::TCamera & | getCameraParamsDepth () const |
Get a const reference to the depth camera calibration parameters. More... | |
void | setCameraParamsDepth (const mrpt::utils::TCamera &p) |
void | setRelativePoseIntensityWrtDepth (const mrpt::poses::CPose3D &p) |
Set the pose of the intensity camera wrt the depth camera. More... | |
const mrpt::poses::CPose3D & | getRelativePoseIntensityWrtDepth () const |
TDepth2RangeArray & | getRawDepth2RangeConversion () |
Get a reference to the array that convert raw depth values (10 or 11 bit) into ranges in meters, so it can be read or replaced by the user. More... | |
const TDepth2RangeArray & | getRawDepth2RangeConversion () const |
void | enableGrabRGB (bool enable=true) |
Enable/disable the grabbing of the RGB channel. More... | |
bool | isGrabRGBEnabled () const |
void | enableGrabDepth (bool enable=true) |
Enable/disable the grabbing of the depth channel. More... | |
bool | isGrabDepthEnabled () const |
void | enableGrabAccelerometers (bool enable=true) |
Enable/disable the grabbing of the inertial data. More... | |
bool | isGrabAccelerometersEnabled () const |
void | enableGrab3DPoints (bool enable=true) |
Enable/disable the grabbing of the 3D point clouds. More... | |
bool | isGrab3DPointsEnabled () const |
Static Public Member Functions | |
static void | registerClass (const TSensorClassId *pNewClass) |
Register a class into the internal list of "CGenericSensor" descendents. More... | |
static CGenericSensor * | createSensor (const std::string &className) |
Creates a sensor by a name of the class. More... | |
static CGenericSensor::Ptr | createSensorPtr (const std::string &className) |
Just like createSensor, but returning a smart pointer to the newly created sensor object. More... | |
Protected Member Functions | |
virtual void | loadConfig_sensorSpecific (const mrpt::utils::CConfigFileBase &configSource, const std::string §ion) |
See the class documentation at the top for expected parameters. More... | |
void | appendObservations (const std::vector< mrpt::utils::CSerializable::Ptr > &obj) |
This method must be called by derived classes to enqueue a new observation in the list to be returned by getObservations. More... | |
void | appendObservation (const mrpt::utils::CSerializable::Ptr &obj) |
Like appendObservations() but for just one observation. More... | |
Protected Attributes | |
mrpt::poses::CPose3D | m_sensorPoseOnRobot |
bool | m_preview_window |
Show preview window while grabbing. More... | |
size_t | m_preview_window_decimation |
If preview is enabled, only show 1 out of N images. More... | |
size_t | m_preview_decim_counter_range |
size_t | m_preview_decim_counter_rgb |
mrpt::gui::CDisplayWindow::Ptr | m_win_range |
mrpt::gui::CDisplayWindow::Ptr | m_win_int |
mrpt::utils::TCamera | m_cameraParamsRGB |
Params for the RGB camera. More... | |
mrpt::utils::TCamera | m_cameraParamsDepth |
Params for the Depth camera. More... | |
mrpt::poses::CPose3D | m_relativePoseIntensityWRTDepth |
See mrpt::obs::CObservation3DRangeScan for a diagram of this pose. More... | |
int | m_initial_tilt_angle |
Set Kinect tilt to an initial deegre (it should be take in account in the sensor pose by the user) More... | |
double | m_maxRange |
Sensor max range (meters) More... | |
int | m_user_device_number |
Number of device to open (0:first,...) More... | |
bool | m_grab_image |
Default: all true. More... | |
bool | m_grab_depth |
bool | m_grab_3D_points |
bool | m_grab_IMU |
TVideoChannel | m_video_channel |
The video channel to open: RGB or IR. More... | |
size_t | m_grab_decimation_counter |
Used when "m_grab_decimation" is enabled. More... | |
TSensorState | m_state |
bool | m_verbose |
std::string | m_path_for_external_images |
The path where to save off-rawlog images: empty means save images embedded in the rawlog. More... | |
std::string | m_external_images_format |
The extension ("jpg","gif","png",...) that determines the format of images saved externally. More... | |
unsigned int | m_external_images_jpeg_quality |
For JPEG images, the quality (default=95%). More... | |
Common settings to any sensor, loaded in "loadConfig" | |
double | m_process_rate |
See CGenericSensor. More... | |
size_t | m_max_queue_len |
See CGenericSensor. More... | |
size_t | m_grab_decimation |
If set to N>=2, only 1 out of N observations will be saved to m_objList. More... | |
std::string | m_sensorLabel |
See CGenericSensor. More... | |
Private Member Functions | |
void | calculate_range2meters () |
Compute m_range2meters at construction. More... | |
Private Attributes | |
std::vector< uint8_t > | m_buf_depth |
Temporary buffers for image grabbing. More... | |
std::vector< uint8_t > | m_buf_rgb |
TDepth2RangeArray | m_range2meters |
The table raw depth -> range in meters. More... | |
|
inherited |
Definition at line 73 of file CGenericSensor.h.
typedef float mrpt::hwdrivers::CKinect::TDepth2RangeArray[KINECT_RANGES_TABLE_LEN] |
|
inherited |
Definition at line 78 of file CGenericSensor.h.
|
inherited |
Definition at line 80 of file CGenericSensor.h.
|
inherited |
The current state of the sensor.
Enumerator | |
---|---|
ssInitializing | |
ssWorking | |
ssError |
Definition at line 85 of file CGenericSensor.h.
RGB or IR video channel identifiers.
Enumerator | |
---|---|
VIDEO_CHANNEL_RGB | |
VIDEO_CHANNEL_IR |
CKinect::CKinect | ( | ) |
Default ctor.
Definition at line 79 of file CKinect.cpp.
References calculate_range2meters(), mrpt::utils::TCamera::cx(), mrpt::utils::TCamera::cy(), mrpt::utils::TCamera::dist, mrpt::utils::TCamera::fx(), mrpt::utils::TCamera::fy(), KINECT_RANGES_TABLE_LEN, m_cameraParamsDepth, m_cameraParamsRGB, m_maxRange, m_range2meters, mrpt::hwdrivers::CGenericSensor::m_sensorLabel, mrpt::utils::TCamera::ncols, mrpt::utils::TCamera::nrows, and THROW_EXCEPTION.
CKinect::~CKinect | ( | ) |
Default ctor.
Definition at line 143 of file CKinect.cpp.
References close().
|
inlineprotectedinherited |
Like appendObservations() but for just one observation.
Definition at line 180 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::appendObservations().
Referenced by mrpt::hwdrivers::CIMUXSens_MT4::doProcess(), mrpt::hwdrivers::CIMUXSens::doProcess(), mrpt::hwdrivers::CGyroKVHDSP3000::doProcess(), mrpt::hwdrivers::CIMUIntersense::doProcess(), mrpt::hwdrivers::CSkeletonTracker::doProcess(), mrpt::hwdrivers::CSwissRanger3DCamera::doProcess(), mrpt::hwdrivers::C2DRangeFinderAbstract::doProcess(), mrpt::hwdrivers::CCANBusReader::doProcess(), mrpt::hwdrivers::CVelodyneScanner::doProcess(), and mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow().
|
protectedinherited |
This method must be called by derived classes to enqueue a new observation in the list to be returned by getObservations.
Passed objects must be created in dynamic memory and a smart pointer passed. Example of creation:
If several observations are passed at once in the vector, they'll be considered as a block regarding the grabbing decimation factor.
Definition at line 53 of file CGenericSensor.cpp.
References CLASS_ID, mrpt::hwdrivers::CGenericSensor::m_csObjList, mrpt::hwdrivers::CGenericSensor::m_grab_decimation, mrpt::hwdrivers::CGenericSensor::m_grab_decimation_counter, mrpt::hwdrivers::CGenericSensor::m_objList, and THROW_EXCEPTION.
Referenced by mrpt::hwdrivers::CGenericSensor::appendObservation(), mrpt::hwdrivers::CNationalInstrumentsDAQ::doProcess(), and doProcess().
|
private |
Compute m_range2meters at construction.
Definition at line 56 of file CKinect.cpp.
References KINECT_RANGES_TABLE_LEN.
Referenced by CKinect().
void CKinect::close | ( | ) |
Close the Connection to the sensor (not need to call it manually unless desired for some reason, since it's called at destructor)
Definition at line 478 of file CKinect.cpp.
Referenced by open(), and ~CKinect().
|
staticinherited |
Creates a sensor by a name of the class.
Typically the user may want to create a smart pointer around the returned pointer, whis is made with:
Definition at line 103 of file CGenericSensor.cpp.
References mrpt::hwdrivers::CGenericSensor::get_registered_sensor_classes().
Referenced by mrpt::hwdrivers::CGenericSensor::createSensorPtr().
|
inlinestaticinherited |
Just like createSensor, but returning a smart pointer to the newly created sensor object.
Definition at line 220 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::createSensor().
|
inline |
Definition at line 379 of file CKinect.h.
References m_preview_window.
|
virtual |
To be called at a high rate (>XX Hz), this method populates the internal buffer of received observations.
This method will be invoked at a minimum rate of "process_rate" (Hz)
This method is mainly intended for usage within rawlog-grabber or similar programs. For an alternative, see getNextObservation()
This | method must throw an exception with a descriptive message if some critical error is found. |
This | method must throw an exception with a descriptive message if some critical error is found. |
Implements mrpt::hwdrivers::CGenericSensor.
Definition at line 154 of file CKinect.cpp.
References mrpt::hwdrivers::CGenericSensor::appendObservations(), getNextObservation(), m_grab_3D_points, m_grab_depth, m_grab_image, m_grab_IMU, mrpt::hwdrivers::CGenericSensor::m_state, mrpt::hwdrivers::CGenericSensor::ssError, mrpt::hwdrivers::CGenericSensor::ssWorking, and THROW_EXCEPTION.
|
inline |
Enable/disable the grabbing of the 3D point clouds.
Definition at line 460 of file CKinect.h.
References m_grab_3D_points.
|
inline |
Enable/disable the grabbing of the inertial data.
Definition at line 454 of file CKinect.h.
References m_grab_IMU.
|
inline |
Enable/disable the grabbing of the depth channel.
Definition at line 451 of file CKinect.h.
References m_grab_depth.
|
inline |
Enable/disable the grabbing of the RGB channel.
Definition at line 448 of file CKinect.h.
References m_grab_image.
|
inline |
|
inlineinherited |
Enable or disable extra debug info dumped to std::cout during sensor operation.
Default: disabled unless the environment variable "MRPT_HWDRIVERS_VERBOSE" is set to "1" during object creation.
Definition at line 106 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_verbose.
|
inline |
Get a const reference to the depth camera calibration parameters.
Definition at line 412 of file CKinect.h.
References m_cameraParamsDepth.
|
inline |
Get a const reference to the depth camera calibration parameters.
Definition at line 402 of file CKinect.h.
References m_cameraParamsRGB.
|
inline |
Get the col count in the camera images, loaded automatically upon camera open().
Definition at line 400 of file CKinect.h.
References m_cameraParamsRGB, and mrpt::utils::TCamera::ncols.
|
inline |
Definition at line 369 of file CKinect.h.
References m_user_device_number.
|
inlineinherited |
Definition at line 290 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_external_images_jpeg_quality.
|
inline |
Get the maximum range (meters) that can be read in the observation field "rangeImage".
Definition at line 394 of file CKinect.h.
References m_maxRange.
void CKinect::getNextObservation | ( | mrpt::obs::CObservation3DRangeScan & | _out_obs, |
bool & | there_is_obs, | ||
bool & | hardware_error | ||
) |
The main data retrieving function, to be called after calling loadConfig() and initialize().
out_obs | The output retrieved observation (only if there_is_obs=true). |
there_is_obs | If set to false, there was no new observation. |
hardware_error | True on hardware/comms error. |
Definition at line 537 of file CKinect.cpp.
References mrpt::obs::CObservation3DRangeScan::cameraParams, mrpt::obs::CObservation3DRangeScan::cameraParamsIntensity, mrpt::obs::CObservation3DRangeScan::hasIntensityImage, mrpt::obs::CObservation3DRangeScan::hasRangeImage, mrpt::obs::CObservation3DRangeScan::intensityImage, m_cameraParamsDepth, m_cameraParamsRGB, m_grab_3D_points, m_grab_depth, m_grab_image, m_maxRange, m_preview_decim_counter_range, m_preview_decim_counter_rgb, m_preview_window, m_preview_window_decimation, m_relativePoseIntensityWRTDepth, mrpt::hwdrivers::CGenericSensor::m_sensorLabel, m_sensorPoseOnRobot, m_win_int, m_win_range, mrpt::utils::TCamera::ncols, mrpt::system::now(), mrpt::utils::TCamera::nrows, mrpt::obs::CObservation3DRangeScan::project3DPointsFromDepthImage(), mrpt::obs::CObservation3DRangeScan::rangeImage, mrpt::obs::CObservation3DRangeScan::relativePoseIntensityWRTDepth, mrpt::system::secondsToTimestamp(), mrpt::obs::CObservation::sensorLabel, mrpt::obs::CObservation3DRangeScan::sensorPose, mrpt::obs::CObservation3DRangeScan::swap(), and mrpt::obs::CObservation::timestamp.
Referenced by doProcess(), and getNextObservation().
void CKinect::getNextObservation | ( | mrpt::obs::CObservation3DRangeScan & | out_obs, |
mrpt::obs::CObservationIMU & | out_obs_imu, | ||
bool & | there_is_obs, | ||
bool & | hardware_error | ||
) |
This is an overloaded member function, provided for convenience. It differs from the above function only in what argument(s) it accepts.
Definition at line 687 of file CKinect.cpp.
References mrpt::obs::CObservationIMU::dataIsPresent, getNextObservation(), mrpt::obs::IMU_X_ACC, mrpt::obs::IMU_Y_ACC, mrpt::obs::IMU_Z_ACC, m_grab_IMU, mrpt::obs::CObservationIMU::rawMeasurements, mrpt::obs::CObservation::sensorLabel, mrpt::obs::CObservationIMU::sensorPose, mrpt::obs::CObservation3DRangeScan::sensorPose, and mrpt::obs::CObservation::timestamp.
|
inherited |
Returns a list of enqueued objects, emptying it (thread-safe).
The objects must be freed by the invoker.
Definition at line 91 of file CGenericSensor.cpp.
References mrpt::hwdrivers::CGenericSensor::m_csObjList, and mrpt::hwdrivers::CGenericSensor::m_objList.
|
inline |
Definition at line 387 of file CKinect.h.
References m_preview_window_decimation.
|
inlineinherited |
Definition at line 94 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_process_rate.
|
inline |
Get a reference to the array that convert raw depth values (10 or 11 bit) into ranges in meters, so it can be read or replaced by the user.
If you replace it, remember to set the first and last entries (index 0 and KINECT_RANGES_TABLE_LEN-1) to zero, to indicate that those are invalid ranges.
Definition at line 438 of file CKinect.h.
References m_range2meters.
|
inline |
Definition at line 442 of file CKinect.h.
References m_range2meters.
|
inline |
Definition at line 427 of file CKinect.h.
References m_relativePoseIntensityWRTDepth.
|
inline |
Get the row count in the camera images, loaded automatically upon camera open().
Definition at line 397 of file CKinect.h.
References m_cameraParamsRGB, and mrpt::utils::TCamera::nrows.
|
pure virtualinherited |
|
inlineinherited |
Definition at line 95 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_sensorLabel.
|
inlineinherited |
The current state of the sensor.
Definition at line 93 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_state.
double CKinect::getTiltAngleDegrees | ( | ) |
Definition at line 775 of file CKinect.cpp.
References ASSERTMSG_, and isOpen().
|
inline |
Return the current video channel (RGB or IR)
Definition at line 362 of file CKinect.h.
References m_video_channel.
Initializes the 3D camera - should be invoked after calling loadConfig() or setting the different parameters with the set*() methods.
This method can or cannot be implemented in the derived class, depending on the need for it.
This | method must throw an exception with a descriptive message if some critical error is found. |
Reimplemented from mrpt::hwdrivers::CGenericSensor.
Definition at line 149 of file CKinect.cpp.
References open().
|
inline |
Definition at line 464 of file CKinect.h.
References m_grab_3D_points.
|
inline |
Definition at line 458 of file CKinect.h.
References m_grab_IMU.
|
inline |
Definition at line 452 of file CKinect.h.
References m_grab_depth.
|
inline |
Definition at line 449 of file CKinect.h.
References m_grab_image.
bool CKinect::isOpen | ( | ) | const |
Whether there is a working connection to the sensor.
Definition at line 264 of file CKinect.cpp.
Referenced by getTiltAngleDegrees(), open(), setTiltAngleDegrees(), and setVideoChannel().
|
inline |
Definition at line 380 of file CKinect.h.
References m_preview_window.
|
inlineinherited |
Definition at line 107 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_verbose.
|
inherited |
Loads the generic settings common to any sensor (See CGenericSensor), then call to "loadConfig_sensorSpecific".
This | method throws an exception with a descriptive message if some critical parameter is missing or has an invalid value. |
Definition at line 132 of file CGenericSensor.cpp.
References mrpt::hwdrivers::CGenericSensor::loadConfig_sensorSpecific(), mrpt::hwdrivers::CGenericSensor::m_grab_decimation, mrpt::hwdrivers::CGenericSensor::m_grab_decimation_counter, mrpt::hwdrivers::CGenericSensor::m_max_queue_len, mrpt::hwdrivers::CGenericSensor::m_process_rate, mrpt::hwdrivers::CGenericSensor::m_sensorLabel, MRPT_END, MRPT_START, mrpt::utils::CConfigFileBase::read_double(), mrpt::utils::CConfigFileBase::read_int(), and mrpt::utils::CConfigFileBase::read_string().
|
protectedvirtual |
See the class documentation at the top for expected parameters.
Loads specific configuration for the device from a given source of configuration parameters, for example, an ".ini" file, loading from the section "[iniSection]" (see utils::CConfigFileBase and derived classes)
This | method must throw an exception with a descriptive message if some critical parameter is missing or has an invalid value. |
Implements mrpt::hwdrivers::CGenericSensor.
Definition at line 190 of file CKinect.cpp.
References DEG2RAD, mrpt::poses::CPose3D::fromString(), mrpt::utils::TStereoCamera::leftCamera, mrpt::utils::TStereoCamera::loadFromConfigFile(), m_cameraParamsDepth, m_cameraParamsRGB, m_grab_3D_points, m_grab_depth, m_grab_image, m_grab_IMU, m_initial_tilt_angle, m_preview_window, m_relativePoseIntensityWRTDepth, m_sensorPoseOnRobot, m_user_device_number, m_video_channel, mrpt::utils::CConfigFileBase::read_bool(), mrpt::utils::CConfigFileBase::read_enum(), mrpt::utils::CConfigFileBase::read_float(), mrpt::utils::CConfigFileBase::read_int(), mrpt::utils::CConfigFileBase::read_string(), mrpt::utils::TStereoCamera::rightCamera, mrpt::utils::TStereoCamera::rightCameraPose, and mrpt::poses::CPose3D::setFromValues().
void CKinect::open | ( | ) |
Try to open the camera (set all the parameters before calling this) - users may also call initialize(), which in turn calls this method.
Raises an exception upon error.
std::exception | A textual description of the error. |
Definition at line 393 of file CKinect.cpp.
References close(), isOpen(), m_buf_depth, m_buf_rgb, m_cameraParamsDepth, m_cameraParamsRGB, m_initial_tilt_angle, m_user_device_number, m_video_channel, mrpt::utils::TCamera::ncols, mrpt::utils::TCamera::nrows, setTiltAngleDegrees(), THROW_EXCEPTION, THROW_EXCEPTION_FMT, and VIDEO_CHANNEL_IR.
Referenced by initialize().
|
staticinherited |
Register a class into the internal list of "CGenericSensor" descendents.
Used internally in the macros DEFINE_GENERIC_SENSOR, etc...
Can be used as "CGenericSensor::registerClass( SENSOR_CLASS_ID(CMySensor) );" if building custom sensors outside mrpt libraries in user code.
Definition at line 121 of file CGenericSensor.cpp.
References mrpt::hwdrivers::TSensorClassId::className, and mrpt::hwdrivers::CGenericSensor::get_registered_sensor_classes().
Referenced by mrpt::hwdrivers::CGenericSensor::CLASSINIT_GENERIC_SENSOR::CLASSINIT_GENERIC_SENSOR().
|
inline |
Definition at line 416 of file CKinect.h.
References m_cameraParamsDepth.
|
inline |
Definition at line 406 of file CKinect.h.
References m_cameraParamsRGB.
|
inline |
Set the sensor index to open (if there're several sensors attached to the computer); default=0 -> the first one.
Definition at line 365 of file CKinect.h.
References m_user_device_number.
|
inlineinherited |
Set the extension ("jpg","gif","png",...) that determines the format of images saved externally The default is "jpg".
Definition at line 279 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_external_images_format.
|
inlineinherited |
The quality of JPEG compression, when external images is enabled and the format is "jpg".
Definition at line 286 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_external_images_jpeg_quality.
|
virtual |
Set the path where to save off-rawlog image files (this class DOES take into account this path).
An empty string (the default value at construction) means to save images embedded in the rawlog, instead of on separate files.
std::exception | If the directory doesn't exists and cannot be created. |
Reimplemented from mrpt::hwdrivers::CGenericSensor.
Definition at line 746 of file CKinect.cpp.
References MRPT_UNUSED_PARAM.
|
inline |
If preview is enabled, show only one image out of N (default: 1=show all)
Definition at line 383 of file CKinect.h.
References m_preview_window_decimation.
|
inline |
Set the pose of the intensity camera wrt the depth camera.
Definition at line 423 of file CKinect.h.
References m_relativePoseIntensityWRTDepth.
|
inlineinherited |
Definition at line 96 of file CGenericSensor.h.
References mrpt::hwdrivers::CGenericSensor::m_sensorLabel.
void CKinect::setTiltAngleDegrees | ( | double | angle | ) |
Change tilt angle.
Definition at line 764 of file CKinect.cpp.
References ASSERTMSG_, isOpen(), and MRPT_UNUSED_PARAM.
Referenced by open().
void CKinect::setVideoChannel | ( | const TVideoChannel | vch | ) |
Changes the video channel to open (RGB or IR) - you can call this method before start grabbing or in the middle of streaming and the video source will change on the fly.
Default is RGB channel.
Definition at line 499 of file CKinect.cpp.
References isOpen(), m_video_channel, MRPT_UNUSED_PARAM, THROW_EXCEPTION, and VIDEO_CHANNEL_IR.
|
private |
|
private |
|
protected |
Params for the Depth camera.
Definition at line 516 of file CKinect.h.
Referenced by CKinect(), getCameraParamsDepth(), getNextObservation(), loadConfig_sensorSpecific(), open(), and setCameraParamsDepth().
|
protected |
Params for the RGB camera.
Definition at line 514 of file CKinect.h.
Referenced by CKinect(), getCameraParamsIntensity(), getColCount(), getNextObservation(), getRowCount(), loadConfig_sensorSpecific(), open(), and setCameraParamsIntensity().
|
protectedinherited |
The extension ("jpg","gif","png",...) that determines the format of images saved externally.
Definition at line 158 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::CSwissRanger3DCamera::loadConfig_sensorSpecific(), and mrpt::hwdrivers::CGenericSensor::setExternalImageFormat().
|
protectedinherited |
For JPEG images, the quality (default=95%).
Definition at line 160 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CGenericSensor::getExternalImageJPEGQuality(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), mrpt::hwdrivers::CSwissRanger3DCamera::loadConfig_sensorSpecific(), and mrpt::hwdrivers::CGenericSensor::setExternalImageJPEGQuality().
|
protected |
Definition at line 531 of file CKinect.h.
Referenced by doProcess(), enableGrab3DPoints(), getNextObservation(), isGrab3DPointsEnabled(), and loadConfig_sensorSpecific().
|
protectedinherited |
If set to N>=2, only 1 out of N observations will be saved to m_objList.
Definition at line 139 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CGenericSensor::appendObservations(), and mrpt::hwdrivers::CGenericSensor::loadConfig().
|
protectedinherited |
Used when "m_grab_decimation" is enabled.
Definition at line 146 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CGenericSensor::appendObservations(), and mrpt::hwdrivers::CGenericSensor::loadConfig().
|
protected |
Definition at line 531 of file CKinect.h.
Referenced by doProcess(), enableGrabDepth(), getNextObservation(), isGrabDepthEnabled(), and loadConfig_sensorSpecific().
|
protected |
Default: all true.
Definition at line 531 of file CKinect.h.
Referenced by doProcess(), enableGrabRGB(), getNextObservation(), isGrabRGBEnabled(), and loadConfig_sensorSpecific().
|
protected |
Definition at line 531 of file CKinect.h.
Referenced by doProcess(), enableGrabAccelerometers(), getNextObservation(), isGrabAccelerometersEnabled(), and loadConfig_sensorSpecific().
|
protected |
Set Kinect tilt to an initial deegre (it should be take in account in the sensor pose by the user)
Definition at line 522 of file CKinect.h.
Referenced by loadConfig_sensorSpecific(), and open().
|
protectedinherited |
See CGenericSensor.
Definition at line 136 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CGenericSensor::loadConfig().
|
protected |
Sensor max range (meters)
Definition at line 525 of file CKinect.h.
Referenced by CKinect(), getMaxRange(), and getNextObservation().
|
protectedinherited |
The path where to save off-rawlog images: empty means save images embedded in the rawlog.
Definition at line 155 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), and mrpt::hwdrivers::CSwissRanger3DCamera::setPathForExternalImages().
|
protected |
Definition at line 498 of file CKinect.h.
Referenced by getNextObservation().
|
protected |
Definition at line 498 of file CKinect.h.
Referenced by getNextObservation().
|
protected |
Show preview window while grabbing.
Definition at line 495 of file CKinect.h.
Referenced by disablePreviewRGB(), enablePreviewRGB(), getNextObservation(), isPreviewRGBEnabled(), and loadConfig_sensorSpecific().
|
protected |
If preview is enabled, only show 1 out of N images.
Definition at line 497 of file CKinect.h.
Referenced by getNextObservation(), getPreviewDecimation(), and setPreviewDecimation().
|
protectedinherited |
See CGenericSensor.
Definition at line 134 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CGenericSensor::getProcessRate(), mrpt::hwdrivers::CGyroKVHDSP3000::initialize(), and mrpt::hwdrivers::CGenericSensor::loadConfig().
|
private |
The table raw depth -> range in meters.
Definition at line 540 of file CKinect.h.
Referenced by CKinect(), and getRawDepth2RangeConversion().
|
protected |
See mrpt::obs::CObservation3DRangeScan for a diagram of this pose.
Definition at line 518 of file CKinect.h.
Referenced by getNextObservation(), getRelativePoseIntensityWrtDepth(), loadConfig_sensorSpecific(), and setRelativePoseIntensityWrtDepth().
|
protectedinherited |
See CGenericSensor.
Definition at line 141 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CCANBusReader::CCANBusReader(), mrpt::hwdrivers::CGPSInterface::CGPSInterface(), mrpt::hwdrivers::CGyroKVHDSP3000::CGyroKVHDSP3000(), mrpt::hwdrivers::CHokuyoURG::CHokuyoURG(), mrpt::hwdrivers::CIMUIntersense::CIMUIntersense(), mrpt::hwdrivers::CIMUXSens::CIMUXSens(), mrpt::hwdrivers::CIMUXSens_MT4::CIMUXSens_MT4(), CKinect(), mrpt::hwdrivers::CNationalInstrumentsDAQ::CNationalInstrumentsDAQ(), mrpt::hwdrivers::CRoboPeakLidar::CRoboPeakLidar(), mrpt::hwdrivers::CSickLaserSerial::CSickLaserSerial(), mrpt::hwdrivers::CSickLaserUSB::CSickLaserUSB(), mrpt::hwdrivers::CSkeletonTracker::CSkeletonTracker(), mrpt::hwdrivers::CSwissRanger3DCamera::CSwissRanger3DCamera(), mrpt::hwdrivers::CVelodyneScanner::CVelodyneScanner(), mrpt::hwdrivers::CIMUXSens_MT4::doProcess(), mrpt::hwdrivers::CIMUXSens::doProcess(), mrpt::hwdrivers::CGyroKVHDSP3000::doProcess(), mrpt::hwdrivers::CIMUIntersense::doProcess(), mrpt::hwdrivers::CSkeletonTracker::doProcess(), mrpt::hwdrivers::CRoboPeakLidar::doProcessSimple(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::hwdrivers::CSwissRanger3DCamera::getNextObservation(), getNextObservation(), mrpt::hwdrivers::CVelodyneScanner::getNextObservation(), mrpt::hwdrivers::CGenericSensor::getSensorLabel(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::hwdrivers::CGenericSensor::loadConfig(), mrpt::hwdrivers::CSkeletonTracker::processPreview(), mrpt::hwdrivers::C2DRangeFinderAbstract::processPreview(), mrpt::hwdrivers::CSkeletonTracker::processPreviewNone(), and mrpt::hwdrivers::CGenericSensor::setSensorLabel().
|
protected |
Definition at line 492 of file CKinect.h.
Referenced by getNextObservation(), and loadConfig_sensorSpecific().
|
protectedinherited |
Definition at line 148 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CGyroKVHDSP3000::CGyroKVHDSP3000(), mrpt::hwdrivers::CIMUXSens_MT4::doProcess(), mrpt::hwdrivers::CIMUXSens::doProcess(), mrpt::hwdrivers::CGyroKVHDSP3000::doProcess(), mrpt::hwdrivers::CIMUIntersense::doProcess(), mrpt::hwdrivers::CSkeletonTracker::doProcess(), mrpt::hwdrivers::CSwissRanger3DCamera::doProcess(), mrpt::hwdrivers::C2DRangeFinderAbstract::doProcess(), mrpt::hwdrivers::CGPSInterface::doProcess(), mrpt::hwdrivers::CNationalInstrumentsDAQ::doProcess(), doProcess(), mrpt::hwdrivers::CVelodyneScanner::doProcess(), mrpt::hwdrivers::CSickLaserUSB::doProcessSimple(), mrpt::hwdrivers::CCANBusReader::doProcessSimple(), mrpt::hwdrivers::CHokuyoURG::doProcessSimple(), mrpt::hwdrivers::CSickLaserSerial::doProcessSimple(), mrpt::hwdrivers::CGPSInterface::flushParsedMessagesNow(), mrpt::hwdrivers::CVelodyneScanner::getNextObservation(), mrpt::hwdrivers::CGenericSensor::getState(), mrpt::hwdrivers::CIMUXSens_MT4::initialize(), mrpt::hwdrivers::CIMUXSens::initialize(), mrpt::hwdrivers::CIMUIntersense::initialize(), mrpt::hwdrivers::CGyroKVHDSP3000::initialize(), mrpt::hwdrivers::CSkeletonTracker::initialize(), mrpt::hwdrivers::CVelodyneScanner::initialize(), mrpt::hwdrivers::CNationalInstrumentsDAQ::readFromDAQ(), and mrpt::hwdrivers::CIMUXSens::searchPortAndConnect().
|
protected |
Number of device to open (0:first,...)
Definition at line 528 of file CKinect.h.
Referenced by getDeviceIndexToOpen(), loadConfig_sensorSpecific(), open(), and setDeviceIndexToOpen().
|
protectedinherited |
Definition at line 149 of file CGenericSensor.h.
Referenced by mrpt::hwdrivers::CGenericSensor::CGenericSensor(), mrpt::hwdrivers::CRoboPeakLidar::checkCOMMs(), mrpt::hwdrivers::CNTRIPEmitter::doProcess(), mrpt::hwdrivers::CGPSInterface::doProcess(), mrpt::hwdrivers::CGenericSensor::enableVerbose(), mrpt::hwdrivers::CNationalInstrumentsDAQ::grabbing_thread(), mrpt::hwdrivers::CIMUXSens_MT4::initialize(), mrpt::hwdrivers::CVelodyneScanner::internal_read_PCAP_packet(), mrpt::hwdrivers::CGenericSensor::isVerboseEnabled(), mrpt::hwdrivers::CGPSInterface::JAVAD_sendMessage(), mrpt::hwdrivers::CGPSInterface::legacy_topcon_setup_commands(), mrpt::hwdrivers::CGPSInterface::OnConnectionEstablished(), mrpt::hwdrivers::CGPSInterface::OnConnectionShutdown(), mrpt::hwdrivers::CNationalInstrumentsDAQ::stop(), and mrpt::hwdrivers::CGPSInterface::tryToOpenTheCOM().
|
protected |
The video channel to open: RGB or IR.
Definition at line 534 of file CKinect.h.
Referenced by getVideoChannel(), loadConfig_sensorSpecific(), open(), and setVideoChannel().
|
protected |
Definition at line 499 of file CKinect.h.
Referenced by getNextObservation().
|
protected |
Definition at line 499 of file CKinect.h.
Referenced by getNextObservation().
Page generated by Doxygen 1.8.14 for MRPT 1.9.9 Git: ae4571287 Thu Nov 23 00:06:53 2017 +0100 at dom oct 27 23:51:55 CET 2019 |