Duckietown Challenges Home Challenges Submissions

Job 33242

Job ID33242
submission6750
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:13:50
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6307910027254964
survival_time_median3.7499999999999942
deviation-center-line_median0.26256359680920854
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11208412170410156
agent_compute-ego0_mean0.10909269740542704
agent_compute-ego0_median0.10796207379383646
agent_compute-ego0_min0.1072318967183431
agent_compute-ego1_max0.11110692977905272
agent_compute-ego1_mean0.10890789729183815
agent_compute-ego1_median0.10841141064961753
agent_compute-ego1_min0.1072053514468442
agent_compute-ego2_max0.1127598222096761
agent_compute-ego2_mean0.10870751180466572
agent_compute-ego2_median0.10705347696940104
agent_compute-ego2_min0.10630923623492004
complete-iteration_max1.2626102593294375
complete-iteration_mean1.2399108903524474
complete-iteration_median1.229196049372355
complete-iteration_min1.22792636235555
deviation-center-line_max0.6358831058768697
deviation-center-line_mean0.29778789287200524
deviation-center-line_min0.09874774981680254
deviation-heading_max1.1971630816661625
deviation-heading_mean0.6611973463784364
deviation-heading_median0.6316027400222535
deviation-heading_min0.24274693938747463
driven_any_max3.3918706153491867
driven_any_mean2.1281459448867333
driven_any_median1.6424762656088765
driven_any_min1.4878558769275383
driven_lanedir_consec_max3.3500390581406503
driven_lanedir_consec_mean2.100481031963638
driven_lanedir_consec_min1.46259450538951
driven_lanedir_max3.3500390581406503
driven_lanedir_mean2.100481031963638
driven_lanedir_median1.6307910027254964
driven_lanedir_min1.46259450538951
get_state_dump_max0.04906320571899414
get_state_dump_mean0.048084253957738965
get_state_dump_median0.04869242986043294
get_state_dump_min0.04649712629378981
get_ui_image_max0.1317004914496355
get_ui_image_mean0.1286250584461296
get_ui_image_median0.12724752426147462
get_ui_image_min0.12692715962727866
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 3.178600294109155, "get_ui_image": 0.1317004914496355, "step_physics": 0.51861291174676, "survival_time": 7.84999999999998, "driven_lanedir": 3.115548519540313, "get_state_dump": 0.04649712629378981, "sim_render-ego0": 0.007237697103220946, "sim_render-ego1": 0.007248327230951588, "sim_render-ego2": 0.007199452940825444, "in-drivable-lane": 0.0, "deviation-heading": 1.1799720067617274, "agent_compute-ego0": 0.10796207379383646, "agent_compute-ego1": 0.1072053514468442, "agent_compute-ego2": 0.10630923623492004, "complete-iteration": 1.2626102593294375, "set_robot_commands": 0.006834125822516763, "deviation-center-line": 0.3348160391620637, "driven_lanedir_consec": 3.115548519540313, "sim_compute_sim_state": 0.0859996027247921, "sim_compute_performance-ego0": 0.006159537916730164, "sim_compute_performance-ego1": 0.006184662982916376, "sim_compute_performance-ego2": 0.006319740015989656, "sim_compute_robot_state-ego0": 0.010972360137161937, "sim_compute_robot_state-ego1": 0.010979413986206056, "sim_compute_robot_state-ego2": 0.010524502225742218, "sim_compute_robot_state-parked0": 0.010919469177343284, "sim_compute_robot_state-parked1": 0.010516693637629224, "sim_compute_robot_state-parked2": 0.0106377799040193, "sim_compute_robot_state-parked3": 0.010828827596773768, "sim_compute_robot_state-parked4": 0.010739806351388336, "sim_compute_robot_state-parked5": 0.010690939654210573}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 3.270487421156167, "get_ui_image": 0.1317004914496355, "step_physics": 0.51861291174676, "survival_time": 7.84999999999998, "driven_lanedir": 3.2120240939842892, "get_state_dump": 0.04649712629378981, "sim_render-ego0": 0.007237697103220946, "sim_render-ego1": 0.007248327230951588, "sim_render-ego2": 0.007199452940825444, "in-drivable-lane": 0.0, "deviation-heading": 1.1971630816661625, "agent_compute-ego0": 0.10796207379383646, "agent_compute-ego1": 0.1072053514468442, "agent_compute-ego2": 0.10630923623492004, "complete-iteration": 1.2626102593294375, "set_robot_commands": 0.006834125822516763, "deviation-center-line": 0.6358831058768697, "driven_lanedir_consec": 3.2120240939842892, "sim_compute_sim_state": 0.0859996027247921, "sim_compute_performance-ego0": 0.006159537916730164, "sim_compute_performance-ego1": 0.006184662982916376, "sim_compute_performance-ego2": 0.006319740015989656, "sim_compute_robot_state-ego0": 0.010972360137161937, "sim_compute_robot_state-ego1": 0.010979413986206056, "sim_compute_robot_state-ego2": 0.010524502225742218, "sim_compute_robot_state-parked0": 0.010919469177343284, "sim_compute_robot_state-parked1": 0.010516693637629224, "sim_compute_robot_state-parked2": 0.0106377799040193, "sim_compute_robot_state-parked3": 0.010828827596773768, "sim_compute_robot_state-parked4": 0.010739806351388336, "sim_compute_robot_state-parked5": 0.010690939654210573}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 3.3918706153491867, "get_ui_image": 0.1317004914496355, "step_physics": 0.51861291174676, "survival_time": 7.84999999999998, "driven_lanedir": 3.3500390581406503, "get_state_dump": 0.04649712629378981, "sim_render-ego0": 0.007237697103220946, "sim_render-ego1": 0.007248327230951588, "sim_render-ego2": 0.007199452940825444, "in-drivable-lane": 0.0, "deviation-heading": 0.9869718123737524, "agent_compute-ego0": 0.10796207379383646, "agent_compute-ego1": 0.1072053514468442, "agent_compute-ego2": 0.10630923623492004, "complete-iteration": 1.2626102593294375, "set_robot_commands": 0.006834125822516763, "deviation-center-line": 0.4947724492744605, "driven_lanedir_consec": 3.3500390581406503, "sim_compute_sim_state": 0.0859996027247921, "sim_compute_performance-ego0": 0.006159537916730164, "sim_compute_performance-ego1": 0.006184662982916376, "sim_compute_performance-ego2": 0.006319740015989656, "sim_compute_robot_state-ego0": 0.010972360137161937, "sim_compute_robot_state-ego1": 0.010979413986206056, "sim_compute_robot_state-ego2": 0.010524502225742218, "sim_compute_robot_state-parked0": 0.010919469177343284, "sim_compute_robot_state-parked1": 0.010516693637629224, "sim_compute_robot_state-parked2": 0.0106377799040193, "sim_compute_robot_state-parked3": 0.010828827596773768, "sim_compute_robot_state-parked4": 0.010739806351388336, "sim_compute_robot_state-parked5": 0.010690939654210573}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.12724752426147462, "step_physics": 0.4820422108968099, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.04869242986043294, "sim_render-ego0": 0.007921778361002604, "sim_render-ego1": 0.007655951182047526, "sim_render-ego2": 0.007614723841349284, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.1072318967183431, "agent_compute-ego1": 0.10841141064961753, "agent_compute-ego2": 0.10705347696940104, "complete-iteration": 1.229196049372355, "set_robot_commands": 0.006959323883056641, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.07967010180155436, "sim_compute_performance-ego0": 0.006636136372884114, "sim_compute_performance-ego1": 0.006808541615804037, "sim_compute_performance-ego2": 0.006647475560506185, "sim_compute_robot_state-ego0": 0.011980311075846354, "sim_compute_robot_state-ego1": 0.011571184794108073, "sim_compute_robot_state-ego2": 0.011535568237304688, "sim_compute_robot_state-parked0": 0.01163662592569987, "sim_compute_robot_state-parked1": 0.01146717389424642, "sim_compute_robot_state-parked2": 0.011519778569539387, "sim_compute_robot_state-parked3": 0.01126665433247884, "sim_compute_robot_state-parked4": 0.011534077326456706, "sim_compute_robot_state-parked5": 0.01076199213663737}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.12724752426147462, "step_physics": 0.4820422108968099, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.04869242986043294, "sim_render-ego0": 0.007921778361002604, "sim_render-ego1": 0.007655951182047526, "sim_render-ego2": 0.007614723841349284, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.1072318967183431, "agent_compute-ego1": 0.10841141064961753, "agent_compute-ego2": 0.10705347696940104, "complete-iteration": 1.229196049372355, "set_robot_commands": 0.006959323883056641, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.07967010180155436, "sim_compute_performance-ego0": 0.006636136372884114, "sim_compute_performance-ego1": 0.006808541615804037, "sim_compute_performance-ego2": 0.006647475560506185, "sim_compute_robot_state-ego0": 0.011980311075846354, "sim_compute_robot_state-ego1": 0.011571184794108073, "sim_compute_robot_state-ego2": 0.011535568237304688, "sim_compute_robot_state-parked0": 0.01163662592569987, "sim_compute_robot_state-parked1": 0.01146717389424642, "sim_compute_robot_state-parked2": 0.011519778569539387, "sim_compute_robot_state-parked3": 0.01126665433247884, "sim_compute_robot_state-parked4": 0.011534077326456706, "sim_compute_robot_state-parked5": 0.01076199213663737}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.12724752426147462, "step_physics": 0.4820422108968099, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.04869242986043294, "sim_render-ego0": 0.007921778361002604, "sim_render-ego1": 0.007655951182047526, "sim_render-ego2": 0.007614723841349284, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.1072318967183431, "agent_compute-ego1": 0.10841141064961753, "agent_compute-ego2": 0.10705347696940104, "complete-iteration": 1.229196049372355, "set_robot_commands": 0.006959323883056641, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.07967010180155436, "sim_compute_performance-ego0": 0.006636136372884114, "sim_compute_performance-ego1": 0.006808541615804037, "sim_compute_performance-ego2": 0.006647475560506185, "sim_compute_robot_state-ego0": 0.011980311075846354, "sim_compute_robot_state-ego1": 0.011571184794108073, "sim_compute_robot_state-ego2": 0.011535568237304688, "sim_compute_robot_state-parked0": 0.01163662592569987, "sim_compute_robot_state-parked1": 0.01146717389424642, "sim_compute_robot_state-parked2": 0.011519778569539387, "sim_compute_robot_state-parked3": 0.01126665433247884, "sim_compute_robot_state-parked4": 0.011534077326456706, "sim_compute_robot_state-parked5": 0.01076199213663737}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.12692715962727866, "step_physics": 0.46721630414326987, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.04906320571899414, "sim_render-ego0": 0.007638648351033528, "sim_render-ego1": 0.007757339477539062, "sim_render-ego2": 0.007806313832600912, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.11208412170410156, "agent_compute-ego1": 0.11110692977905272, "agent_compute-ego2": 0.1127598222096761, "complete-iteration": 1.22792636235555, "set_robot_commands": 0.00734982172648112, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.07922417958577474, "sim_compute_performance-ego0": 0.006426331202189128, "sim_compute_performance-ego1": 0.00656347910563151, "sim_compute_performance-ego2": 0.006466398239135742, "sim_compute_robot_state-ego0": 0.011694409052530923, "sim_compute_robot_state-ego1": 0.011814320882161458, "sim_compute_robot_state-ego2": 0.011279732386271158, "sim_compute_robot_state-parked0": 0.011884746551513671, "sim_compute_robot_state-parked1": 0.011510664621988931, "sim_compute_robot_state-parked2": 0.011752084096272786, "sim_compute_robot_state-parked3": 0.011818424860636391, "sim_compute_robot_state-parked4": 0.011575969060262044, "sim_compute_robot_state-parked5": 0.011112101872762044}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.12692715962727866, "step_physics": 0.46721630414326987, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.04906320571899414, "sim_render-ego0": 0.007638648351033528, "sim_render-ego1": 0.007757339477539062, "sim_render-ego2": 0.007806313832600912, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.11208412170410156, "agent_compute-ego1": 0.11110692977905272, "agent_compute-ego2": 0.1127598222096761, "complete-iteration": 1.22792636235555, "set_robot_commands": 0.00734982172648112, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.07922417958577474, "sim_compute_performance-ego0": 0.006426331202189128, "sim_compute_performance-ego1": 0.00656347910563151, "sim_compute_performance-ego2": 0.006466398239135742, "sim_compute_robot_state-ego0": 0.011694409052530923, "sim_compute_robot_state-ego1": 0.011814320882161458, "sim_compute_robot_state-ego2": 0.011279732386271158, "sim_compute_robot_state-parked0": 0.011884746551513671, "sim_compute_robot_state-parked1": 0.011510664621988931, "sim_compute_robot_state-parked2": 0.011752084096272786, "sim_compute_robot_state-parked3": 0.011818424860636391, "sim_compute_robot_state-parked4": 0.011575969060262044, "sim_compute_robot_state-parked5": 0.011112101872762044}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.12692715962727866, "step_physics": 0.46721630414326987, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.04906320571899414, "sim_render-ego0": 0.007638648351033528, "sim_render-ego1": 0.007757339477539062, "sim_render-ego2": 0.007806313832600912, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.11208412170410156, "agent_compute-ego1": 0.11110692977905272, "agent_compute-ego2": 0.1127598222096761, "complete-iteration": 1.22792636235555, "set_robot_commands": 0.00734982172648112, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.07922417958577474, "sim_compute_performance-ego0": 0.006426331202189128, "sim_compute_performance-ego1": 0.00656347910563151, "sim_compute_performance-ego2": 0.006466398239135742, "sim_compute_robot_state-ego0": 0.011694409052530923, "sim_compute_robot_state-ego1": 0.011814320882161458, "sim_compute_robot_state-ego2": 0.011279732386271158, "sim_compute_robot_state-parked0": 0.011884746551513671, "sim_compute_robot_state-parked1": 0.011510664621988931, "sim_compute_robot_state-parked2": 0.011752084096272786, "sim_compute_robot_state-parked3": 0.011818424860636391, "sim_compute_robot_state-parked4": 0.011575969060262044, "sim_compute_robot_state-parked5": 0.011112101872762044}}
set_robot_commands_max0.00734982172648112
set_robot_commands_mean0.007047757144018174
set_robot_commands_median0.006959323883056641
set_robot_commands_min0.006834125822516763
sim_compute_performance-ego0_max0.006636136372884114
sim_compute_performance-ego0_mean0.0064073351639344685
sim_compute_performance-ego0_median0.006426331202189128
sim_compute_performance-ego0_min0.006159537916730164
sim_compute_performance-ego1_max0.006808541615804037
sim_compute_performance-ego1_mean0.0065188945681173074
sim_compute_performance-ego1_median0.00656347910563151
sim_compute_performance-ego1_min0.006184662982916376
sim_compute_performance-ego2_max0.006647475560506185
sim_compute_performance-ego2_mean0.006477871271877194
sim_compute_performance-ego2_median0.006466398239135742
sim_compute_performance-ego2_min0.006319740015989656
sim_compute_robot_state-ego0_max0.011980311075846354
sim_compute_robot_state-ego0_mean0.011549026755179735
sim_compute_robot_state-ego0_median0.011694409052530923
sim_compute_robot_state-ego0_min0.010972360137161937
sim_compute_robot_state-ego1_max0.011814320882161458
sim_compute_robot_state-ego1_mean0.011454973220825192
sim_compute_robot_state-ego1_median0.011571184794108073
sim_compute_robot_state-ego1_min0.010979413986206056
sim_compute_robot_state-ego2_max0.011535568237304688
sim_compute_robot_state-ego2_mean0.011113267616439356
sim_compute_robot_state-ego2_median0.011279732386271158
sim_compute_robot_state-ego2_min0.010524502225742218
sim_compute_robot_state-parked0_max0.011884746551513671
sim_compute_robot_state-parked0_mean0.011480280551518942
sim_compute_robot_state-parked0_median0.01163662592569987
sim_compute_robot_state-parked0_min0.010919469177343284
sim_compute_robot_state-parked1_max0.011510664621988931
sim_compute_robot_state-parked1_mean0.011164844051288194
sim_compute_robot_state-parked1_median0.01146717389424642
sim_compute_robot_state-parked1_min0.010516693637629224
sim_compute_robot_state-parked2_max0.011752084096272786
sim_compute_robot_state-parked2_mean0.011303214189943823
sim_compute_robot_state-parked2_median0.011519778569539387
sim_compute_robot_state-parked2_min0.0106377799040193
sim_compute_robot_state-parked3_max0.011818424860636391
sim_compute_robot_state-parked3_mean0.011304635596629666
sim_compute_robot_state-parked3_median0.01126665433247884
sim_compute_robot_state-parked3_min0.010828827596773768
sim_compute_robot_state-parked4_max0.011575969060262044
sim_compute_robot_state-parked4_mean0.011283284246035696
sim_compute_robot_state-parked4_median0.011534077326456706
sim_compute_robot_state-parked4_min0.010739806351388336
sim_compute_robot_state-parked5_max0.011112101872762044
sim_compute_robot_state-parked5_mean0.010855011221203328
sim_compute_robot_state-parked5_median0.01076199213663737
sim_compute_robot_state-parked5_min0.010690939654210573
sim_compute_sim_state_max0.0859996027247921
sim_compute_sim_state_mean0.0816312947040404
sim_compute_sim_state_median0.07967010180155436
sim_compute_sim_state_min0.07922417958577474
sim_render-ego0_max0.007921778361002604
sim_render-ego0_mean0.007599374605085692
sim_render-ego0_median0.007638648351033528
sim_render-ego0_min0.007237697103220946
sim_render-ego1_max0.007757339477539062
sim_render-ego1_mean0.007553872630179392
sim_render-ego1_median0.007655951182047526
sim_render-ego1_min0.007248327230951588
sim_render-ego2_max0.007806313832600912
sim_render-ego2_mean0.007540163538258547
sim_render-ego2_median0.007614723841349284
sim_render-ego2_min0.007199452940825444
simulation-passed1
step_physics_max0.51861291174676
step_physics_mean0.48929047559561334
step_physics_median0.4820422108968099
step_physics_min0.46721630414326987
survival_time_max7.84999999999998
survival_time_mean5.1166666666666565
survival_time_min3.7499999999999942

Highlights

33242

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.