Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the kitti evaluation code #47

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Conversation

CarkusL
Copy link

@CarkusL CarkusL commented Aug 22, 2021

I add some code to do evaluation on kitti dataset.
The evaluation code is from https://github.com/traveller59/kitti-object-eval-python.

Evaluation result

Car AP(Average Precision)@0.70, 0.70, 0.70:
bbox AP:96.57, 89.17, 89.41
bev  AP:97.52, 89.62, 89.78
3d   AP:88.09, 87.86, 88.09
aos  AP:60.28, 55.63, 55.04
Car AP(Average Precision)@0.70, 0.50, 0.50:
bbox AP:96.57, 89.17, 89.41
bev  AP:98.03, 89.94, 90.09
3d   AP:98.01, 89.94, 90.09
aos  AP:60.28, 55.63, 55.04
Pedestrian AP(Average Precision)@0.50, 0.50, 0.50:
bbox AP:65.38, 64.95, 63.96
bev  AP:68.14, 69.36, 65.41
3d   AP:66.44, 62.36, 62.77
aos  AP:32.13, 30.95, 30.21
Pedestrian AP(Average Precision)@0.50, 0.25, 0.25:
bbox AP:65.38, 64.95, 63.96
bev  AP:88.43, 88.61, 88.59
3d   AP:88.29, 88.45, 88.48
aos  AP:32.13, 30.95, 30.21
Cyclist AP(Average Precision)@0.50, 0.50, 0.50:
bbox AP:89.62, 87.64, 87.70
bev  AP:82.11, 75.41, 75.64
3d   AP:80.09, 74.31, 74.45
aos  AP:54.37, 52.01, 51.44
Cyclist AP(Average Precision)@0.50, 0.25, 0.25:
bbox AP:89.62, 87.64, 87.70
bev  AP:96.04, 88.67, 88.78
3d   AP:96.04, 88.67, 88.78
aos  AP:54.37, 52.01, 51.44

@maudzung
Copy link
Owner

Thanks for your PR

@reddittoob
Copy link

I was using only lidar data and label data.
So, I can't achieve evaluation because I don't have calibration and 2d coordinate data.
Can you help me?

@mouawiya
Copy link

mouawiya commented Sep 3, 2022

Hello, can you please tell me how can I display the Precision and Recall values, I need them for my paper, thank you.

@CarkusL
Copy link
Author

CarkusL commented Sep 4, 2022

Hello, can you please tell me how can I display the Precision and Recall values, I need them for my paper, thank you.
You can use my branch
https://github.com/CarkusL/SFA3D

@mouawiya
Copy link

mouawiya commented Sep 4, 2022

Hello, can you please tell me how can I display the Precision and Recall values, I need them for my paper, thank you.
You can use my branch
https://github.com/CarkusL/SFA3D
I am using your branch, but it still only display the AP in the results, I want to display the Precision and the Recall values with the Average precision (AP)

@Xi-Gong
Copy link

Xi-Gong commented Mar 30, 2024

@maudzung Hello, I found that your ImageSets files are not following the conventions in KITTI 3D, which often use 3712 pointcloud bin as train-split and 3769 as val-split. The split file can refer from OpenPCDet repo https://github.com/open-mmlab/OpenPCDet/tree/master/data/kitti/ImageSets.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants