Duckietown Challenges Home Challenges Submissions

Job 33260

Job ID33260
submission6753
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:05:05
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48754379678213766
survival_time_median1.8000000000000005
deviation-center-line_median0.06245226975741305
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.12046778643572773
agent_compute-ego0_mean0.11321526721671776
agent_compute-ego0_median0.11321526721671776
agent_compute-ego0_min0.1059627479977078
agent_compute-ego1_max0.12367862242239493
agent_compute-ego1_mean0.11499743285002532
agent_compute-ego1_median0.11499743285002532
agent_compute-ego1_min0.10631624327765572
agent_compute-ego2_max0.1235879173985234
agent_compute-ego2_mean0.11564228623001664
agent_compute-ego2_median0.11564228623001664
agent_compute-ego2_min0.10769665506150988
complete-iteration_max1.3731550022407817
complete-iteration_mean1.3464504807083693
complete-iteration_median1.3464504807083697
complete-iteration_min1.3197459591759575
deviation-center-line_max0.1364929929892348
deviation-center-line_mean0.0735324409181777
deviation-center-line_min0.03749836134933205
deviation-heading_max0.4824961018568489
deviation-heading_mean0.24763107308352664
deviation-heading_median0.19685478795028813
deviation-heading_min0.12147401365277044
driven_any_max0.790313747596692
driven_any_mean0.547686269381221
driven_any_median0.49114576189977144
driven_any_min0.3678194207518232
driven_lanedir_consec_max0.7437120996444373
driven_lanedir_consec_mean0.5349627204898018
driven_lanedir_consec_min0.35169852728801443
driven_lanedir_max0.7600010640095247
driven_lanedir_mean0.537677547883983
driven_lanedir_median0.48754379678213766
driven_lanedir_min0.35169852728801443
get_state_dump_max0.04776861932542589
get_state_dump_mean0.04754844771491157
get_state_dump_median0.04754844771491157
get_state_dump_min0.04732827610439724
get_ui_image_max0.09957154591878256
get_ui_image_mean0.09938645097944472
get_ui_image_median0.09938645097944472
get_ui_image_min0.09920135604010688
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.3678194207518232, "get_ui_image": 0.09957154591878256, "step_physics": 0.631311646214238, "survival_time": 1.3500000000000003, "driven_lanedir": 0.35169852728801443, "get_state_dump": 0.04776861932542589, "sim_render-ego0": 0.00701619960643627, "sim_render-ego1": 0.007201071138735171, "sim_render-ego2": 0.007412866309837059, "in-drivable-lane": 0.0, "deviation-heading": 0.3383711452730716, "agent_compute-ego0": 0.12046778643572773, "agent_compute-ego1": 0.12367862242239493, "agent_compute-ego2": 0.1235879173985234, "complete-iteration": 1.3731550022407817, "set_robot_commands": 0.006075594160291884, "deviation-center-line": 0.10051072056882342, "driven_lanedir_consec": 0.35169852728801443, "sim_compute_sim_state": 0.07856335463347258, "sim_compute_performance-ego0": 0.005689877050894278, "sim_compute_performance-ego1": 0.005629486507839627, "sim_compute_performance-ego2": 0.005855162938435872, "sim_compute_robot_state-ego0": 0.00996763617904098, "sim_compute_robot_state-ego1": 0.00982158272354691, "sim_compute_robot_state-ego2": 0.01023260752360026, "sim_compute_robot_state-parked0": 0.009669339215313946, "sim_compute_robot_state-parked1": 0.00990062289767795, "sim_compute_robot_state-parked2": 0.009685745945683232, "sim_compute_robot_state-parked3": 0.010039232395313404, "sim_compute_robot_state-parked4": 0.010269500591136791, "sim_compute_robot_state-parked5": 0.010148534068354854}, "udem1-0-0-ego1": {"driven_any": 0.4434128872732647, "get_ui_image": 0.09957154591878256, "step_physics": 0.631311646214238, "survival_time": 1.3500000000000003, "driven_lanedir": 0.43937397013186263, "get_state_dump": 0.04776861932542589, "sim_render-ego0": 0.00701619960643627, "sim_render-ego1": 0.007201071138735171, "sim_render-ego2": 0.007412866309837059, "in-drivable-lane": 0.0, "deviation-heading": 0.12147401365277044, "agent_compute-ego0": 0.12046778643572773, "agent_compute-ego1": 0.12367862242239493, "agent_compute-ego2": 0.1235879173985234, "complete-iteration": 1.3731550022407817, "set_robot_commands": 0.006075594160291884, "deviation-center-line": 0.041788031086849885, "driven_lanedir_consec": 0.43937397013186263, "sim_compute_sim_state": 0.07856335463347258, "sim_compute_performance-ego0": 0.005689877050894278, "sim_compute_performance-ego1": 0.005629486507839627, "sim_compute_performance-ego2": 0.005855162938435872, "sim_compute_robot_state-ego0": 0.00996763617904098, "sim_compute_robot_state-ego1": 0.00982158272354691, "sim_compute_robot_state-ego2": 0.01023260752360026, "sim_compute_robot_state-parked0": 0.009669339215313946, "sim_compute_robot_state-parked1": 0.00990062289767795, "sim_compute_robot_state-parked2": 0.009685745945683232, "sim_compute_robot_state-parked3": 0.010039232395313404, "sim_compute_robot_state-parked4": 0.010269500591136791, "sim_compute_robot_state-parked5": 0.010148534068354854}, "udem1-0-0-ego2": {"driven_any": 0.4131503688899397, "get_ui_image": 0.09957154591878256, "step_physics": 0.631311646214238, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4114499766784721, "get_state_dump": 0.04776861932542589, "sim_render-ego0": 0.00701619960643627, "sim_render-ego1": 0.007201071138735171, "sim_render-ego2": 0.007412866309837059, "in-drivable-lane": 0.0, "deviation-heading": 0.1497356018178925, "agent_compute-ego0": 0.12046778643572773, "agent_compute-ego1": 0.12367862242239493, "agent_compute-ego2": 0.1235879173985234, "complete-iteration": 1.3731550022407817, "set_robot_commands": 0.006075594160291884, "deviation-center-line": 0.03749836134933205, "driven_lanedir_consec": 0.4114499766784721, "sim_compute_sim_state": 0.07856335463347258, "sim_compute_performance-ego0": 0.005689877050894278, "sim_compute_performance-ego1": 0.005629486507839627, "sim_compute_performance-ego2": 0.005855162938435872, "sim_compute_robot_state-ego0": 0.00996763617904098, "sim_compute_robot_state-ego1": 0.00982158272354691, "sim_compute_robot_state-ego2": 0.01023260752360026, "sim_compute_robot_state-parked0": 0.009669339215313946, "sim_compute_robot_state-parked1": 0.00990062289767795, "sim_compute_robot_state-parked2": 0.009685745945683232, "sim_compute_robot_state-parked3": 0.010039232395313404, "sim_compute_robot_state-parked4": 0.010269500591136791, "sim_compute_robot_state-parked5": 0.010148534068354854}, "udem1-0-1-ego0": {"driven_any": 0.5388786365262782, "get_ui_image": 0.09920135604010688, "step_physics": 0.591905419031779, "survival_time": 2.25, "driven_lanedir": 0.5357136234324127, "get_state_dump": 0.04732827610439724, "sim_render-ego0": 0.007268900341457791, "sim_render-ego1": 0.006989463170369466, "sim_render-ego2": 0.007201788160536024, "in-drivable-lane": 0.0, "deviation-heading": 0.21836815061992348, "agent_compute-ego0": 0.1059627479977078, "agent_compute-ego1": 0.10631624327765572, "agent_compute-ego2": 0.10769665506150988, "complete-iteration": 1.3197459591759575, "set_robot_commands": 0.006581237581041124, "deviation-center-line": 0.1364929929892348, "driven_lanedir_consec": 0.5357136234324127, "sim_compute_sim_state": 0.10563583374023436, "sim_compute_performance-ego0": 0.005849557452731662, "sim_compute_performance-ego1": 0.005734629101223416, "sim_compute_performance-ego2": 0.0059520297580295135, "sim_compute_robot_state-ego0": 0.010489961836073132, "sim_compute_robot_state-ego1": 0.010856617821587457, "sim_compute_robot_state-ego2": 0.010762802759806315, "sim_compute_robot_state-parked0": 0.010693878597683375, "sim_compute_robot_state-parked1": 0.01056062380472819, "sim_compute_robot_state-parked2": 0.010333485073513456, "sim_compute_robot_state-parked3": 0.011004659864637587, "sim_compute_robot_state-parked4": 0.011049053404066296, "sim_compute_robot_state-parked5": 0.01048537360297309}, "udem1-0-1-ego1": {"driven_any": 0.7325425552493282, "get_ui_image": 0.09920135604010688, "step_physics": 0.591905419031779, "survival_time": 2.25, "driven_lanedir": 0.7278281257636117, "get_state_dump": 0.04732827610439724, "sim_render-ego0": 0.007268900341457791, "sim_render-ego1": 0.006989463170369466, "sim_render-ego2": 0.007201788160536024, "in-drivable-lane": 0.0, "deviation-heading": 0.17534142528065275, "agent_compute-ego0": 0.1059627479977078, "agent_compute-ego1": 0.10631624327765572, "agent_compute-ego2": 0.10769665506150988, "complete-iteration": 1.3197459591759575, "set_robot_commands": 0.006581237581041124, "deviation-center-line": 0.042585621718128394, "driven_lanedir_consec": 0.7278281257636117, "sim_compute_sim_state": 0.10563583374023436, "sim_compute_performance-ego0": 0.005849557452731662, "sim_compute_performance-ego1": 0.005734629101223416, "sim_compute_performance-ego2": 0.0059520297580295135, "sim_compute_robot_state-ego0": 0.010489961836073132, "sim_compute_robot_state-ego1": 0.010856617821587457, "sim_compute_robot_state-ego2": 0.010762802759806315, "sim_compute_robot_state-parked0": 0.010693878597683375, "sim_compute_robot_state-parked1": 0.01056062380472819, "sim_compute_robot_state-parked2": 0.010333485073513456, "sim_compute_robot_state-parked3": 0.011004659864637587, "sim_compute_robot_state-parked4": 0.011049053404066296, "sim_compute_robot_state-parked5": 0.01048537360297309}, "udem1-0-1-ego2": {"driven_any": 0.790313747596692, "get_ui_image": 0.09920135604010688, "step_physics": 0.591905419031779, "survival_time": 2.25, "driven_lanedir": 0.7600010640095247, "get_state_dump": 0.04732827610439724, "sim_render-ego0": 0.007268900341457791, "sim_render-ego1": 0.006989463170369466, "sim_render-ego2": 0.007201788160536024, "in-drivable-lane": 0.0, "deviation-heading": 0.4824961018568489, "agent_compute-ego0": 0.1059627479977078, "agent_compute-ego1": 0.10631624327765572, "agent_compute-ego2": 0.10769665506150988, "complete-iteration": 1.3197459591759575, "set_robot_commands": 0.006581237581041124, "deviation-center-line": 0.0823189177966977, "driven_lanedir_consec": 0.7437120996444373, "sim_compute_sim_state": 0.10563583374023436, "sim_compute_performance-ego0": 0.005849557452731662, "sim_compute_performance-ego1": 0.005734629101223416, "sim_compute_performance-ego2": 0.0059520297580295135, "sim_compute_robot_state-ego0": 0.010489961836073132, "sim_compute_robot_state-ego1": 0.010856617821587457, "sim_compute_robot_state-ego2": 0.010762802759806315, "sim_compute_robot_state-parked0": 0.010693878597683375, "sim_compute_robot_state-parked1": 0.01056062380472819, "sim_compute_robot_state-parked2": 0.010333485073513456, "sim_compute_robot_state-parked3": 0.011004659864637587, "sim_compute_robot_state-parked4": 0.011049053404066296, "sim_compute_robot_state-parked5": 0.01048537360297309}}
set_robot_commands_max0.006581237581041124
set_robot_commands_mean0.006328415870666504
set_robot_commands_median0.006328415870666505
set_robot_commands_min0.006075594160291884
sim_compute_performance-ego0_max0.005849557452731662
sim_compute_performance-ego0_mean0.00576971725181297
sim_compute_performance-ego0_median0.00576971725181297
sim_compute_performance-ego0_min0.005689877050894278
sim_compute_performance-ego1_max0.005734629101223416
sim_compute_performance-ego1_mean0.005682057804531521
sim_compute_performance-ego1_median0.005682057804531521
sim_compute_performance-ego1_min0.005629486507839627
sim_compute_performance-ego2_max0.0059520297580295135
sim_compute_performance-ego2_mean0.005903596348232692
sim_compute_performance-ego2_median0.005903596348232693
sim_compute_performance-ego2_min0.005855162938435872
sim_compute_robot_state-ego0_max0.010489961836073132
sim_compute_robot_state-ego0_mean0.010228799007557058
sim_compute_robot_state-ego0_median0.010228799007557056
sim_compute_robot_state-ego0_min0.00996763617904098
sim_compute_robot_state-ego1_max0.010856617821587457
sim_compute_robot_state-ego1_mean0.010339100272567184
sim_compute_robot_state-ego1_median0.010339100272567184
sim_compute_robot_state-ego1_min0.00982158272354691
sim_compute_robot_state-ego2_max0.010762802759806315
sim_compute_robot_state-ego2_mean0.01049770514170329
sim_compute_robot_state-ego2_median0.010497705141703288
sim_compute_robot_state-ego2_min0.01023260752360026
sim_compute_robot_state-parked0_max0.010693878597683375
sim_compute_robot_state-parked0_mean0.010181608906498664
sim_compute_robot_state-parked0_median0.010181608906498664
sim_compute_robot_state-parked0_min0.009669339215313946
sim_compute_robot_state-parked1_max0.01056062380472819
sim_compute_robot_state-parked1_mean0.010230623351203071
sim_compute_robot_state-parked1_median0.010230623351203071
sim_compute_robot_state-parked1_min0.00990062289767795
sim_compute_robot_state-parked2_max0.010333485073513456
sim_compute_robot_state-parked2_mean0.010009615509598344
sim_compute_robot_state-parked2_median0.010009615509598344
sim_compute_robot_state-parked2_min0.009685745945683232
sim_compute_robot_state-parked3_max0.011004659864637587
sim_compute_robot_state-parked3_mean0.010521946129975496
sim_compute_robot_state-parked3_median0.010521946129975496
sim_compute_robot_state-parked3_min0.010039232395313404
sim_compute_robot_state-parked4_max0.011049053404066296
sim_compute_robot_state-parked4_mean0.010659276997601544
sim_compute_robot_state-parked4_median0.010659276997601544
sim_compute_robot_state-parked4_min0.010269500591136791
sim_compute_robot_state-parked5_max0.01048537360297309
sim_compute_robot_state-parked5_mean0.010316953835663972
sim_compute_robot_state-parked5_median0.010316953835663972
sim_compute_robot_state-parked5_min0.010148534068354854
sim_compute_sim_state_max0.10563583374023436
sim_compute_sim_state_mean0.09209959418685348
sim_compute_sim_state_median0.09209959418685348
sim_compute_sim_state_min0.07856335463347258
sim_render-ego0_max0.007268900341457791
sim_render-ego0_mean0.00714254997394703
sim_render-ego0_median0.0071425499739470304
sim_render-ego0_min0.00701619960643627
sim_render-ego1_max0.007201071138735171
sim_render-ego1_mean0.007095267154552318
sim_render-ego1_median0.007095267154552319
sim_render-ego1_min0.006989463170369466
sim_render-ego2_max0.007412866309837059
sim_render-ego2_mean0.00730732723518654
sim_render-ego2_median0.007307327235186541
sim_render-ego2_min0.007201788160536024
simulation-passed1
step_physics_max0.631311646214238
step_physics_mean0.6116085326230084
step_physics_median0.6116085326230085
step_physics_min0.591905419031779
survival_time_max2.25
survival_time_mean1.8
survival_time_min1.3500000000000003

Highlights

33260

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.