Duckietown Challenges Home Challenges Submissions

Submission 17490

Submission17490
Competingyes
Challengeaido-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 107723 sim-1of4: 107756 sim-2of4: 107752 sim-3of4: 107751
Next
User labelbaseline-dagger-pytorch
Admin priority50
Blessingn/a
User priority50

107756

Click the images to see detailed statistics about the episode.

4way-000

107723

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job ID
step
status
up to date
date started
date completed
duration
message
107756sim-1of4successyes0:13:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.259508908261962
deviation-center-line_median4.402679233622204


other stats
deviation-center-line_max8.000927817536642
deviation-center-line_mean4.623762351521611
deviation-center-line_min1.6887631213053955
deviation-heading_max30.865781556438403
deviation-heading_mean17.057138880551587
deviation-heading_median15.10739957410598
deviation-heading_min7.147974817555986
distance-from-start_max1.0846279101493697
distance-from-start_mean1.0204871507237545
distance-from-start_median1.03911467853146
distance-from-start_min0.9190913356827284
driven_any_max10.124692333974426
driven_any_mean4.587213617406463
driven_any_median3.4664697061253587
driven_any_min1.2912227234007094
driven_lanedir_consec_max9.77752972735843
driven_lanedir_consec_mean4.384304660902259
driven_lanedir_consec_min1.2406710997266823
driven_lanedir_max9.77752972735843
driven_lanedir_mean4.416218418469685
driven_lanedir_median3.323336423396814
driven_lanedir_min1.2406710997266823
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 10.124692333974426, "survival_time": 59.99999999999873, "driven_lanedir": 9.77752972735843, "in-drivable-lane": 0.0, "deviation-heading": 14.201458339222512, "distance-from-start": 1.0267031677208047, "deviation-center-line": 2.961561084491468, "driven_lanedir_consec": 9.77752972735843}, "4way-000-ego1": {"driven_any": 1.2912227234007094, "survival_time": 59.99999999999873, "driven_lanedir": 1.2406710997266823, "in-drivable-lane": 0.0, "deviation-heading": 30.865781556438403, "distance-from-start": 0.9190913356827284, "deviation-center-line": 5.84379738275294, "driven_lanedir_consec": 1.2406710997266823}, "4way-000-ego2": {"driven_any": 2.8286667564289765, "survival_time": 59.99999999999873, "driven_lanedir": 2.732717047354916, "in-drivable-lane": 0.0, "deviation-heading": 7.147974817555986, "distance-from-start": 1.0846279101493697, "deviation-center-line": 1.6887631213053955, "driven_lanedir_consec": 2.732717047354916}, "4way-000-ego3": {"driven_any": 4.104272655821741, "survival_time": 59.99999999999873, "driven_lanedir": 3.913955799438712, "in-drivable-lane": 0.0, "deviation-heading": 16.01334080898945, "distance-from-start": 1.0515261893421155, "deviation-center-line": 8.000927817536642, "driven_lanedir_consec": 3.7863007691690074}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107752sim-2of4successyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
107751sim-3of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
107747sim-3of4successyes0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107744sim-2of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107741sim-3of4successyes0:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107740sim-2of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107735sim-2of4successyes0:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107734sim-3of4failedyes0:01:01
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107728sim-2of4failedyes0:00:56
The container "solut [...]
The container "solution-ego2" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107725sim-3of4successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107723sim-0of4successyes0:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.650000000000286
in-drivable-lane_median0.30000000000000426
driven_lanedir_consec_median3.143408366401763
deviation-center-line_median1.8161773627719993


other stats
deviation-center-line_max2.9083396420863
deviation-center-line_mean1.924488960021934
deviation-center-line_min1.1572614724574382
deviation-heading_max15.22724480113207
deviation-heading_mean10.188318556068818
deviation-heading_median9.573777877266384
deviation-heading_min6.37847366861044
distance-from-start_max2.2923858196430595
distance-from-start_mean1.2170845340757597
distance-from-start_median1.0419713010400402
distance-from-start_min0.492009714579899
driven_any_max4.822394331146045
driven_any_mean3.052706578008862
driven_any_median3.44431193370781
driven_any_min0.4998081134737825
driven_lanedir_consec_max4.532358114568147
driven_lanedir_consec_mean2.8257878732640354
driven_lanedir_consec_min0.4839766456844665
driven_lanedir_max4.532358114568147
driven_lanedir_mean2.8260561876875054
driven_lanedir_median3.143944995248704
driven_lanedir_min0.4839766456844665
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.4625000000000066
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 4.822394331146045, "survival_time": 29.650000000000286, "driven_lanedir": 4.532358114568147, "in-drivable-lane": 0.6000000000000085, "deviation-heading": 6.37847366861044, "distance-from-start": 2.2923858196430595, "deviation-center-line": 1.1572614724574382, "driven_lanedir_consec": 4.532358114568147}, "udem-000-ego1": {"driven_any": 3.8431924054500737, "survival_time": 29.650000000000286, "driven_lanedir": 3.374784605367511, "in-drivable-lane": 1.2500000000000178, "deviation-heading": 7.273966640056808, "distance-from-start": 1.0089883544308598, "deviation-center-line": 1.5533750897838476, "driven_lanedir_consec": 3.373720631743976}, "udem-000-ego2": {"driven_any": 0.4998081134737825, "survival_time": 29.650000000000286, "driven_lanedir": 0.4839766456844665, "in-drivable-lane": 0.0, "deviation-heading": 15.22724480113207, "distance-from-start": 0.492009714579899, "deviation-center-line": 2.9083396420863, "driven_lanedir_consec": 0.4839766456844665}, "udem-000-ego3": {"driven_any": 3.0454314619655465, "survival_time": 29.650000000000286, "driven_lanedir": 2.9131053851298976, "in-drivable-lane": 0.0, "deviation-heading": 11.873589114475958, "distance-from-start": 1.0749542476492204, "deviation-center-line": 2.0789796357601507, "driven_lanedir_consec": 2.9130961010595504}}
simulation-passed1
survival_time_max29.650000000000286
survival_time_mean29.650000000000286
survival_time_min29.650000000000286
No reset possible
107719sim-3of4timeoutyes0:00:09
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107717sim-2of4successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107714sim-2of4successyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107713sim-3of4failedyes0:00:59
The container "solut [...]
The container "solution-ego2" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107711sim-0of4successyes0:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible