Non-Overlapping-Camera Calibration
Overview: Non-Overlapping-Camera Calibration App is a software tool that makes the process of calibration of Non-Overlapping-Camera simple and quick.
- 1.Calibration List Page
This page contains the list of calibrations. You can launch an existing dataset, delete and even manage your access to these datasets.
2.Non-Overlapping-Camera Calibration Launch
You can select an existing Non-Overlapping-camera calibration from the list page, or click on the “New Calibration” button on the top-right of the calibration list page and select the Non-Overlapping-calibration in the window that pops.
3. Start Page
The page lists the important instructions and requirements that you need to follow in order to complete the calibration process.
- Start the app by clicking on the “Get Started” button
- Choose calibration method (Calibration target/ Targetless). 'Calibration target' method requires checkerboard images in the Overlapping field of view. 'Targetless' approach does not require a checkerboard.
- Input the name you wish to give this calibration. This name will be shown on the calibration-list page. And then click on “Set Details”
4. Setup Support-Camera details
You can fill in the basic details for the Non-Overlapping-Camera and also specifically for the left and right camera of the Non-Overlapping-camera.
- Camera name: Input the name for the support camera sensor
- Camera lens model: Select the lens model of your support camera
- Fill Camera intrinsic parameter: Import the intrinsics from a profile or type them manually
- Import from JSON: You can use JSON files to import the intrinsics parameters as well.
- Once all the details are filled in, click the “Continue” button on the bottom right.
5. Setup Camera 1 details
The process is similar to setting up the support camera details
- Distance between support camera and camera 1 (m): Input the distance between the support camera and camera 1 in meters. (Applicable for targetless approach)
6. Add image pairs
You need to add the images taken from camera 1 and the support camera. This page allows you to pair them manually. Also, it has an “Auto Pair” button to pair the files automatically, based on their filename order. It is recommended to follow the file naming guidelines from the Non-Overlapping-Calibration Data collection doc.
- Upload the images for camera 1
- Upload the images for the support camera
- Files are automatically paired based on the file name order.
- Verify if the pairing is correct or not. If not, select the correct file pair on left and right, and pair them up using the “Add Pair” button on the bottom.
- Delete any unpaired files, with the delete button that appears when hovered over a file.
- Click on the “Continue” button.
Checkerboard image pairs
Targetless images
6. Set details
Checkerboard: Set checkerboard details
You need to fill in the checkerboard details like Horizontal Corners, Vertical Corners and Dimensions i.e. square size for the checkerboard and click on “Set Config”. Then click on Continue.
Square dimension should be in meters. And the horizontal and the vertical corners are inner corners of the checkerboard.
Targetless: Detect feature points
Click the "Detect" button to identify important point matches in the image pair. You can visualize the matches by following along the corresponding lines (Hover to highlight).
Go through the detected points and choose the best-detected matching point results from the dropdown. (If only one result set, then no action to take).
7. Detect Checkerboard corners in the images
On this page, you just have to click “Run Detect corners” to get the checkerboard corners for all images. This is to make sure that the calibration identifies all checkerboard corners for all images for the best results. If all checkerboard corners are detected, click on “Continue” calibration results.
8. Camera-2 Setup
Repeat the above 3 steps for camera 2 and for camera 2 and support camera images
9. Calibrate
Checkerboard
In this step, you simply have to click on the “Run calibration” button. Once clicked, the images are processed and once done, the calibration results are shown on the right side of the page. Also, the Visualise button becomes enabled and allows you to visualise the calibration results.
Targetless
On this page, you just have to click “Run Calibration” to get the calibration results. Once clicked, the images are processed and once done, the calibration results are shown on the right side of the page. Also, the 'Visualise' button and the 'Display Epilines' checkbox becomes enabled and allow you to visualise the calibration results.
10. Error stats
You can toggle the error stats and select individual errors or average errors. Individual Errors show the errors related to an image pair selected on the left pane. The error stats are shown separately for the two camera pairs present
Checkerboard
- Left Reprojection Error: The pixel error when the detected corners from the right image are projected onto the left image using the calibration results
- Right Reprojection Error: The pixel error when the detected corners from the left image are projected onto the right image using the calibration results
- Translation Error: The distance between the means of the 3d projections of the checkerboard in a 3d scene from the left images and right images
- Rotation Error: The angle between the planes of the 3d projections in a 3d scene of the checkerboard from the left images and right images
Targetless
- Epiline Point Distance: Average pixel distance of each point to its corresponding projected epiline.
- Epipolar Error: Proportional to the distance of a point from its epiline. Does not have a physical meaning. It is the residual error from minimizing the epipolar constraints while calculating the fundamental/essential matrix
11. Visualise
Clicking on the visualise button takes you to the visualisation screen. You can see the cameras and the selected image-pair checkerboard on the screen. You can move around in the 3d scene using the mouse left (for pan) or right (for orbit) button click-drag, to have a better sense of the view. Also, on the top-right, in the options dropdown, you have the option to show/hide all the checkerboards from all the image pairs at once.
Only frustums are visible for Targetless method.
12. Export
You can export the results of the calibration using the “Export” button on the top-right of the page. Fill in the name of the output file and click on Export.