Duckietown Challenges Home Challenges Submissions

Submission 17584

Submission17584
Competingyes
Challengeaido-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 107059 sim-1of4: 107057 sim-2of4: 107064 sim-3of4: 107053
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

107064

Click the images to see detailed statistics about the episode.

loop-000

107059

Click the images to see detailed statistics about the episode.

loop2-000

107057

Click the images to see detailed statistics about the episode.

autolab-000

107053

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
107064sim-2of4successyes0:14:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median47.474999999998744
driven_lanedir_consec_median1.0217036273752105
deviation-center-line_median0.8736275907220395


other stats
deviation-center-line_max2.085101933868593
deviation-center-line_mean0.9781344053340124
deviation-center-line_min0.08018050602337769
deviation-heading_max21.540626346489407
deviation-heading_mean10.479777552433111
deviation-heading_median9.884261146458655
deviation-heading_min0.6099615703257323
distance-from-start_max0.9489006676149568
distance-from-start_mean0.5689280944825689
distance-from-start_median0.5185230168936995
distance-from-start_min0.28976567652791974
driven_any_max7.700994380686054
driven_any_mean4.012181529350941
driven_any_median3.6597420257543143
driven_any_min1.0282476852090805
driven_lanedir_consec_max1.7932118527360648
driven_lanedir_consec_mean1.024945245067869
driven_lanedir_consec_min0.2631618727849905
driven_lanedir_max1.7944223641228936
driven_lanedir_mean1.0252478729145762
driven_lanedir_median1.0217036273752105
driven_lanedir_min0.2631618727849905
in-drivable-lane_max58.54999999999873
in-drivable-lane_mean46.22499999999887
in-drivable-lane_min31.399999999999277
per-episodes
details{"loop-000-ego0": {"driven_any": 7.700994380686054, "survival_time": 59.99999999999873, "driven_lanedir": 1.7944223641228936, "in-drivable-lane": 39.74999999999877, "deviation-heading": 15.828261506632172, "distance-from-start": 0.7365870589906458, "deviation-center-line": 1.3879379345636569, "driven_lanedir_consec": 1.7932118527360648}, "loop-000-ego1": {"driven_any": 1.8073959770536776, "survival_time": 59.99999999999873, "driven_lanedir": 0.2631618727849905, "in-drivable-lane": 55.19999999999872, "deviation-heading": 3.9402607862851378, "distance-from-start": 0.3004589747967532, "deviation-center-line": 0.35931724688042244, "driven_lanedir_consec": 0.2631618727849905}, "loop-000-ego2": {"driven_any": 1.0282476852090805, "survival_time": 59.99999999999873, "driven_lanedir": 0.2804363986559639, "in-drivable-lane": 58.54999999999873, "deviation-heading": 0.6099615703257323, "distance-from-start": 0.9489006676149568, "deviation-center-line": 0.08018050602337769, "driven_lanedir_consec": 0.2804363986559639}, "loop-000-ego3": {"driven_any": 5.512088074454952, "survival_time": 59.99999999999873, "driven_lanedir": 1.762970856094457, "in-drivable-lane": 31.399999999999277, "deviation-heading": 21.540626346489407, "distance-from-start": 0.28976567652791974, "deviation-center-line": 2.085101933868593, "driven_lanedir_consec": 1.762970856094457}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107059sim-0of4successyes0:08:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median48.09999999999889
driven_lanedir_consec_median0.9137634331659892
deviation-center-line_median1.2141237490811605


other stats
deviation-center-line_max1.895399778013487
deviation-center-line_mean1.2141237490811605
deviation-center-line_min0.5328477201488341
deviation-heading_max19.125165069459232
deviation-heading_mean10.9114791318959
deviation-heading_median10.9114791318959
deviation-heading_min2.697793194332568
distance-from-start_max0.9034363183110228
distance-from-start_mean0.5519155226466921
distance-from-start_median0.5519155226466921
distance-from-start_min0.2003947269823616
driven_any_max9.75403194952289
driven_any_mean9.025058438581954
driven_any_median9.025058438581954
driven_any_min8.29608492764102
driven_lanedir_consec_max1.4304730441936735
driven_lanedir_consec_mean0.9137634331659892
driven_lanedir_consec_min0.39705382213830487
driven_lanedir_max1.4304730441936735
driven_lanedir_mean0.9137634331659892
driven_lanedir_median0.9137634331659892
driven_lanedir_min0.39705382213830487
in-drivable-lane_max55.79999999999872
in-drivable-lane_mean48.09999999999889
in-drivable-lane_min40.39999999999907
per-episodes
details{"loop2-000-ego0": {"driven_any": 8.29608492764102, "survival_time": 59.99999999999873, "driven_lanedir": 1.4304730441936735, "in-drivable-lane": 40.39999999999907, "deviation-heading": 19.125165069459232, "distance-from-start": 0.2003947269823616, "deviation-center-line": 1.895399778013487, "driven_lanedir_consec": 1.4304730441936735}, "loop2-000-ego1": {"driven_any": 9.75403194952289, "survival_time": 59.99999999999873, "driven_lanedir": 0.39705382213830487, "in-drivable-lane": 55.79999999999872, "deviation-heading": 2.697793194332568, "distance-from-start": 0.9034363183110228, "deviation-center-line": 0.5328477201488341, "driven_lanedir_consec": 0.39705382213830487}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107057sim-1of4successyes0:15:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median45.54999999999882
driven_lanedir_consec_median0.5403861727573336
deviation-center-line_median1.3417247838792865


other stats
deviation-center-line_max2.2959055992990467
deviation-center-line_mean1.2623629964277692
deviation-center-line_min0.07009681865345672
deviation-heading_max20.62297008240966
deviation-heading_mean10.041124766560085
deviation-heading_median9.364828665217352
deviation-heading_min0.8118716533959731
distance-from-start_max0.967809313202791
distance-from-start_mean0.5640624213586323
distance-from-start_median0.618290361041949
distance-from-start_min0.05185965014783974
driven_any_max10.324264679159365
driven_any_mean4.240918075177098
driven_any_median3.1218795705366853
driven_any_min0.3956484804756564
driven_lanedir_consec_max2.7932447055197036
driven_lanedir_consec_mean0.968732329898771
driven_lanedir_consec_min0.0009122685607132476
driven_lanedir_max2.7932447055197036
driven_lanedir_mean0.968732329898771
driven_lanedir_median0.5403861727573336
driven_lanedir_min0.0009122685607132476
in-drivable-lane_max59.04999999999873
in-drivable-lane_mean39.89999999999911
in-drivable-lane_min9.45000000000007
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.149393145702906, "survival_time": 59.99999999999873, "driven_lanedir": 1.0339696649855794, "in-drivable-lane": 52.8999999999987, "deviation-heading": 4.6428172668387475, "distance-from-start": 0.6387576800549956, "deviation-center-line": 0.6143563238371121, "driven_lanedir_consec": 1.0339696649855794}, "autolab-000-ego1": {"driven_any": 2.0943659953704654, "survival_time": 59.99999999999873, "driven_lanedir": 0.04680268052908776, "in-drivable-lane": 59.04999999999873, "deviation-heading": 0.8118716533959731, "distance-from-start": 0.5978230420289025, "deviation-center-line": 0.07009681865345672, "driven_lanedir_consec": 0.04680268052908776}, "autolab-000-ego2": {"driven_any": 10.324264679159365, "survival_time": 59.99999999999873, "driven_lanedir": 2.7932447055197036, "in-drivable-lane": 38.19999999999894, "deviation-heading": 14.086840063595956, "distance-from-start": 0.967809313202791, "deviation-center-line": 2.0690932439214604, "driven_lanedir_consec": 2.7932447055197036}, "autolab-000-ego3": {"driven_any": 0.3956484804756564, "survival_time": 59.99999999999873, "driven_lanedir": 0.0009122685607132476, "in-drivable-lane": 9.45000000000007, "deviation-heading": 20.62297008240966, "distance-from-start": 0.05185965014783974, "deviation-center-line": 2.2959055992990467, "driven_lanedir_consec": 0.0009122685607132476}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107053sim-3of4successyes0:17:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median48.87499999999877
driven_lanedir_consec_median0.6874024636197884
deviation-center-line_median0.900233600287427


other stats
deviation-center-line_max1.3819172199586598
deviation-center-line_mean0.9100802579902
deviation-center-line_min0.4579366114272855
deviation-heading_max10.838305765567991
deviation-heading_mean8.920517863886232
deviation-heading_median9.756074740976052
deviation-heading_min5.331616208024832
distance-from-start_max0.7605127671070834
distance-from-start_mean0.4832614847440904
distance-from-start_median0.4230804703992042
distance-from-start_min0.3263722310708699
driven_any_max7.980752475489997
driven_any_mean4.990252060274232
driven_any_median4.773444136503562
driven_any_min2.433367492599805
driven_lanedir_consec_max1.4742894876945418
driven_lanedir_consec_mean0.8266634169309899
driven_lanedir_consec_min0.4575592527898408
driven_lanedir_max1.4742894876945418
driven_lanedir_mean0.8691336583221486
driven_lanedir_median0.7541797757193593
driven_lanedir_min0.4938855941553339
in-drivable-lane_max54.0999999999987
in-drivable-lane_mean48.574999999998695
in-drivable-lane_min42.449999999998575
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.433367492599805, "survival_time": 59.99999999999873, "driven_lanedir": 0.8870284481130501, "in-drivable-lane": 48.49999999999864, "deviation-heading": 8.688166163704784, "distance-from-start": 0.3263722310708699, "deviation-center-line": 0.4579366114272855, "driven_lanedir_consec": 0.8870284481130501}, "zigzag-000-ego1": {"driven_any": 7.980752475489997, "survival_time": 59.99999999999873, "driven_lanedir": 0.6213311033256685, "in-drivable-lane": 49.24999999999888, "deviation-heading": 10.838305765567991, "distance-from-start": 0.33481879730820374, "deviation-center-line": 1.3819172199586598, "driven_lanedir_consec": 0.4575592527898408}, "zigzag-000-ego2": {"driven_any": 4.088148043116907, "survival_time": 59.99999999999873, "driven_lanedir": 0.4938855941553339, "in-drivable-lane": 54.0999999999987, "deviation-heading": 5.331616208024832, "distance-from-start": 0.7605127671070834, "deviation-center-line": 0.6407130392928171, "driven_lanedir_consec": 0.48777647912652666}, "zigzag-000-ego3": {"driven_any": 5.458740229890216, "survival_time": 59.99999999999873, "driven_lanedir": 1.4742894876945418, "in-drivable-lane": 42.449999999998575, "deviation-heading": 10.82398331824732, "distance-from-start": 0.5113421434902047, "deviation-center-line": 1.159754161282037, "driven_lanedir_consec": 1.4742894876945418}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible