Duckietown Challenges Home Challenges Submissions

Job 33212

Job ID33212
submission6706
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:07:59
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4206363264054991
survival_time_median2.8999999999999977
deviation-center-line_median0.14452290085345834
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.046159565448760986
agent_compute-ego0_mean0.04581475942984395
agent_compute-ego0_median0.04583074717686094
agent_compute-ego0_min0.04545396566390991
agent_compute-ego1_max0.046313981215159096
agent_compute-ego1_mean0.0455929244810855
agent_compute-ego1_median0.04530894345250623
agent_compute-ego1_min0.045155848775591166
agent_compute-ego2_max0.0459505836168925
agent_compute-ego2_mean0.04533015809949134
agent_compute-ego2_median0.04573968361163962
agent_compute-ego2_min0.04430020706994193
complete-iteration_max1.0153839053778813
complete-iteration_mean1.0069303460276444
complete-iteration_median1.0066528995831807
complete-iteration_min0.998754233121872
deviation-center-line_max0.2638448353623343
deviation-center-line_mean0.17741263874182037
deviation-center-line_min0.12210869555527595
deviation-heading_max0.7352695890794493
deviation-heading_mean0.3678670010580451
deviation-heading_median0.3267517743150319
deviation-heading_min0.02056006962655303
driven_any_max0.4394246161178098
driven_any_mean0.4226251669916168
driven_any_median0.42336326752251646
driven_any_min0.4050876173345276
driven_lanedir_consec_max0.4392581117839218
driven_lanedir_consec_mean0.4172063256636963
driven_lanedir_consec_min0.3910784225602359
driven_lanedir_max0.4392581117839218
driven_lanedir_mean0.4172063256636963
driven_lanedir_median0.4206363264054991
driven_lanedir_min0.3910784225602359
get_state_dump_max0.04850576321283976
get_state_dump_mean0.04765437358249128
get_state_dump_median0.04824818824899608
get_state_dump_min0.046209169285637994
get_ui_image_max0.12914355458884402
get_ui_image_mean0.1285898593846213
get_ui_image_median0.12867930105754308
get_ui_image_min0.1279467225074768
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 0.42336326752251024, "get_ui_image": 0.12914355458884402, "step_physics": 0.47761909303994016, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4206363264054991, "get_state_dump": 0.04824818824899608, "sim_render-ego0": 0.007176958281418373, "sim_render-ego1": 0.0070004380982497645, "sim_render-ego2": 0.007137154710703883, "in-drivable-lane": 0.0, "deviation-heading": 0.3267517743150319, "agent_compute-ego0": 0.04583074717686094, "agent_compute-ego1": 0.04530894345250623, "agent_compute-ego2": 0.04573968361163962, "complete-iteration": 1.0153839053778813, "set_robot_commands": 0.0071465599125829235, "deviation-center-line": 0.14452290085345834, "driven_lanedir_consec": 0.4206363264054991, "sim_compute_sim_state": 0.0652368685294842, "sim_compute_performance-ego0": 0.006128882539683375, "sim_compute_performance-ego1": 0.005849131222428946, "sim_compute_performance-ego2": 0.006057928348409718, "sim_compute_robot_state-ego0": 0.0112599175551842, "sim_compute_robot_state-ego1": 0.010696526231436894, "sim_compute_robot_state-ego2": 0.01038610524144666, "sim_compute_robot_state-parked0": 0.011491878279324236, "sim_compute_robot_state-parked1": 0.010911061845976733, "sim_compute_robot_state-parked2": 0.010799338077676707, "sim_compute_robot_state-parked3": 0.011115838741434032, "sim_compute_robot_state-parked4": 0.010705919101320464, "sim_compute_robot_state-parked5": 0.01039950600985823}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 0.42336326752251646, "get_ui_image": 0.12914355458884402, "step_physics": 0.47761909303994016, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4233114877582156, "get_state_dump": 0.04824818824899608, "sim_render-ego0": 0.007176958281418373, "sim_render-ego1": 0.0070004380982497645, "sim_render-ego2": 0.007137154710703883, "in-drivable-lane": 0.0, "deviation-heading": 0.04359171553787195, "agent_compute-ego0": 0.04583074717686094, "agent_compute-ego1": 0.04530894345250623, "agent_compute-ego2": 0.04573968361163962, "complete-iteration": 1.0153839053778813, "set_robot_commands": 0.0071465599125829235, "deviation-center-line": 0.13205951395569177, "driven_lanedir_consec": 0.4233114877582156, "sim_compute_sim_state": 0.0652368685294842, "sim_compute_performance-ego0": 0.006128882539683375, "sim_compute_performance-ego1": 0.005849131222428946, "sim_compute_performance-ego2": 0.006057928348409718, "sim_compute_robot_state-ego0": 0.0112599175551842, "sim_compute_robot_state-ego1": 0.010696526231436894, "sim_compute_robot_state-ego2": 0.01038610524144666, "sim_compute_robot_state-parked0": 0.011491878279324236, "sim_compute_robot_state-parked1": 0.010911061845976733, "sim_compute_robot_state-parked2": 0.010799338077676707, "sim_compute_robot_state-parked3": 0.011115838741434032, "sim_compute_robot_state-parked4": 0.010705919101320464, "sim_compute_robot_state-parked5": 0.01039950600985823}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 0.42336326752251646, "get_ui_image": 0.12914355458884402, "step_physics": 0.47761909303994016, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4097509793208185, "get_state_dump": 0.04824818824899608, "sim_render-ego0": 0.007176958281418373, "sim_render-ego1": 0.0070004380982497645, "sim_render-ego2": 0.007137154710703883, "in-drivable-lane": 0.0, "deviation-heading": 0.7352695890794493, "agent_compute-ego0": 0.04583074717686094, "agent_compute-ego1": 0.04530894345250623, "agent_compute-ego2": 0.04573968361163962, "complete-iteration": 1.0153839053778813, "set_robot_commands": 0.0071465599125829235, "deviation-center-line": 0.2574637225826533, "driven_lanedir_consec": 0.4097509793208185, "sim_compute_sim_state": 0.0652368685294842, "sim_compute_performance-ego0": 0.006128882539683375, "sim_compute_performance-ego1": 0.005849131222428946, "sim_compute_performance-ego2": 0.006057928348409718, "sim_compute_robot_state-ego0": 0.0112599175551842, "sim_compute_robot_state-ego1": 0.010696526231436894, "sim_compute_robot_state-ego2": 0.01038610524144666, "sim_compute_robot_state-parked0": 0.011491878279324236, "sim_compute_robot_state-parked1": 0.010911061845976733, "sim_compute_robot_state-parked2": 0.010799338077676707, "sim_compute_robot_state-parked3": 0.011115838741434032, "sim_compute_robot_state-parked4": 0.010705919101320464, "sim_compute_robot_state-parked5": 0.01039950600985823}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 0.4050876173345316, "get_ui_image": 0.12867930105754308, "step_physics": 0.4731175558907645, "survival_time": 2.799999999999998, "driven_lanedir": 0.402025463741015, "get_state_dump": 0.046209169285637994, "sim_render-ego0": 0.00683350648198809, "sim_render-ego1": 0.007034587008612496, "sim_render-ego2": 0.006837619202477592, "in-drivable-lane": 0.0, "deviation-heading": 0.3390265196562397, "agent_compute-ego0": 0.04545396566390991, "agent_compute-ego1": 0.045155848775591166, "agent_compute-ego2": 0.04430020706994193, "complete-iteration": 0.998754233121872, "set_robot_commands": 0.006913836513246808, "deviation-center-line": 0.14035880895450595, "driven_lanedir_consec": 0.402025463741015, "sim_compute_sim_state": 0.06532855544771467, "sim_compute_performance-ego0": 0.005688884428569249, "sim_compute_performance-ego1": 0.0059841956411089215, "sim_compute_performance-ego2": 0.005575128964015416, "sim_compute_robot_state-ego0": 0.010493014539991106, "sim_compute_robot_state-ego1": 0.010125053780419486, "sim_compute_robot_state-ego2": 0.009892740419932777, "sim_compute_robot_state-parked0": 0.010409925665174211, "sim_compute_robot_state-parked1": 0.010201658521379744, "sim_compute_robot_state-parked2": 0.010523076568331038, "sim_compute_robot_state-parked3": 0.010043416704450334, "sim_compute_robot_state-parked4": 0.010118416377476284, "sim_compute_robot_state-parked5": 0.010201211486543928}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 0.4050876173345276, "get_ui_image": 0.12867930105754308, "step_physics": 0.4731175558907645, "survival_time": 2.799999999999998, "driven_lanedir": 0.40507567398952427, "get_state_dump": 0.046209169285637994, "sim_render-ego0": 0.00683350648198809, "sim_render-ego1": 0.007034587008612496, "sim_render-ego2": 0.006837619202477592, "in-drivable-lane": 0.0, "deviation-heading": 0.02056006962655303, "agent_compute-ego0": 0.04545396566390991, "agent_compute-ego1": 0.045155848775591166, "agent_compute-ego2": 0.04430020706994193, "complete-iteration": 0.998754233121872, "set_robot_commands": 0.006913836513246808, "deviation-center-line": 0.12210869555527595, "driven_lanedir_consec": 0.40507567398952427, "sim_compute_sim_state": 0.06532855544771467, "sim_compute_performance-ego0": 0.005688884428569249, "sim_compute_performance-ego1": 0.0059841956411089215, "sim_compute_performance-ego2": 0.005575128964015416, "sim_compute_robot_state-ego0": 0.010493014539991106, "sim_compute_robot_state-ego1": 0.010125053780419486, "sim_compute_robot_state-ego2": 0.009892740419932777, "sim_compute_robot_state-parked0": 0.010409925665174211, "sim_compute_robot_state-parked1": 0.010201658521379744, "sim_compute_robot_state-parked2": 0.010523076568331038, "sim_compute_robot_state-parked3": 0.010043416704450334, "sim_compute_robot_state-parked4": 0.010118416377476284, "sim_compute_robot_state-parked5": 0.010201211486543928}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 0.40508761733452814, "get_ui_image": 0.12867930105754308, "step_physics": 0.4731175558907645, "survival_time": 2.799999999999998, "driven_lanedir": 0.3910784225602359, "get_state_dump": 0.046209169285637994, "sim_render-ego0": 0.00683350648198809, "sim_render-ego1": 0.007034587008612496, "sim_render-ego2": 0.006837619202477592, "in-drivable-lane": 0.0, "deviation-heading": 0.7334575132218849, "agent_compute-ego0": 0.04545396566390991, "agent_compute-ego1": 0.045155848775591166, "agent_compute-ego2": 0.04430020706994193, "complete-iteration": 0.998754233121872, "set_robot_commands": 0.006913836513246808, "deviation-center-line": 0.24434318921423517, "driven_lanedir_consec": 0.3910784225602359, "sim_compute_sim_state": 0.06532855544771467, "sim_compute_performance-ego0": 0.005688884428569249, "sim_compute_performance-ego1": 0.0059841956411089215, "sim_compute_performance-ego2": 0.005575128964015416, "sim_compute_robot_state-ego0": 0.010493014539991106, "sim_compute_robot_state-ego1": 0.010125053780419486, "sim_compute_robot_state-ego2": 0.009892740419932777, "sim_compute_robot_state-parked0": 0.010409925665174211, "sim_compute_robot_state-parked1": 0.010201658521379744, "sim_compute_robot_state-parked2": 0.010523076568331038, "sim_compute_robot_state-parked3": 0.010043416704450334, "sim_compute_robot_state-parked4": 0.010118416377476284, "sim_compute_robot_state-parked5": 0.010201211486543928}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 0.4394246161178098, "get_ui_image": 0.1279467225074768, "step_physics": 0.4589173158009847, "survival_time": 2.9999999999999973, "driven_lanedir": 0.4371471549185302, "get_state_dump": 0.04850576321283976, "sim_render-ego0": 0.007380719979604085, "sim_render-ego1": 0.007456743717193603, "sim_render-ego2": 0.007556458314259847, "in-drivable-lane": 0.0, "deviation-heading": 0.3064272371019385, "agent_compute-ego0": 0.046159565448760986, "agent_compute-ego1": 0.046313981215159096, "agent_compute-ego2": 0.0459505836168925, "complete-iteration": 1.0066528995831807, "set_robot_commands": 0.007323571046193441, "deviation-center-line": 0.14034054351485595, "driven_lanedir_consec": 0.4371471549185302, "sim_compute_sim_state": 0.06576783259709676, "sim_compute_performance-ego0": 0.006477749347686768, "sim_compute_performance-ego1": 0.006319204966227214, "sim_compute_performance-ego2": 0.006323401133219401, "sim_compute_robot_state-ego0": 0.011788094043731687, "sim_compute_robot_state-ego1": 0.011220324039459228, "sim_compute_robot_state-ego2": 0.011171340942382812, "sim_compute_robot_state-parked0": 0.011785686016082764, "sim_compute_robot_state-parked1": 0.011676299571990966, "sim_compute_robot_state-parked2": 0.011447707811991371, "sim_compute_robot_state-parked3": 0.011367170015970866, "sim_compute_robot_state-parked4": 0.011408376693725584, "sim_compute_robot_state-parked5": 0.011598201592763265}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 0.4394246161178009, "get_ui_image": 0.1279467225074768, "step_physics": 0.4589173158009847, "survival_time": 2.9999999999999973, "driven_lanedir": 0.4392581117839218, "get_state_dump": 0.04850576321283976, "sim_render-ego0": 0.007380719979604085, "sim_render-ego1": 0.007456743717193603, "sim_render-ego2": 0.007556458314259847, "in-drivable-lane": 0.0, "deviation-heading": 0.07668671791830647, "agent_compute-ego0": 0.046159565448760986, "agent_compute-ego1": 0.046313981215159096, "agent_compute-ego2": 0.0459505836168925, "complete-iteration": 1.0066528995831807, "set_robot_commands": 0.007323571046193441, "deviation-center-line": 0.15167153868337285, "driven_lanedir_consec": 0.4392581117839218, "sim_compute_sim_state": 0.06576783259709676, "sim_compute_performance-ego0": 0.006477749347686768, "sim_compute_performance-ego1": 0.006319204966227214, "sim_compute_performance-ego2": 0.006323401133219401, "sim_compute_robot_state-ego0": 0.011788094043731687, "sim_compute_robot_state-ego1": 0.011220324039459228, "sim_compute_robot_state-ego2": 0.011171340942382812, "sim_compute_robot_state-parked0": 0.011785686016082764, "sim_compute_robot_state-parked1": 0.011676299571990966, "sim_compute_robot_state-parked2": 0.011447707811991371, "sim_compute_robot_state-parked3": 0.011367170015970866, "sim_compute_robot_state-parked4": 0.011408376693725584, "sim_compute_robot_state-parked5": 0.011598201592763265}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 0.4394246161178098, "get_ui_image": 0.1279467225074768, "step_physics": 0.4589173158009847, "survival_time": 2.9999999999999973, "driven_lanedir": 0.42657331049550606, "get_state_dump": 0.04850576321283976, "sim_render-ego0": 0.007380719979604085, "sim_render-ego1": 0.007456743717193603, "sim_render-ego2": 0.007556458314259847, "in-drivable-lane": 0.0, "deviation-heading": 0.7290318730651308, "agent_compute-ego0": 0.046159565448760986, "agent_compute-ego1": 0.046313981215159096, "agent_compute-ego2": 0.0459505836168925, "complete-iteration": 1.0066528995831807, "set_robot_commands": 0.007323571046193441, "deviation-center-line": 0.2638448353623343, "driven_lanedir_consec": 0.42657331049550606, "sim_compute_sim_state": 0.06576783259709676, "sim_compute_performance-ego0": 0.006477749347686768, "sim_compute_performance-ego1": 0.006319204966227214, "sim_compute_performance-ego2": 0.006323401133219401, "sim_compute_robot_state-ego0": 0.011788094043731687, "sim_compute_robot_state-ego1": 0.011220324039459228, "sim_compute_robot_state-ego2": 0.011171340942382812, "sim_compute_robot_state-parked0": 0.011785686016082764, "sim_compute_robot_state-parked1": 0.011676299571990966, "sim_compute_robot_state-parked2": 0.011447707811991371, "sim_compute_robot_state-parked3": 0.011367170015970866, "sim_compute_robot_state-parked4": 0.011408376693725584, "sim_compute_robot_state-parked5": 0.011598201592763265}}
set_robot_commands_max0.007323571046193441
set_robot_commands_mean0.007127989157341058
set_robot_commands_median0.0071465599125829235
set_robot_commands_min0.006913836513246808
sim_compute_performance-ego0_max0.006477749347686768
sim_compute_performance-ego0_mean0.0060985054386464635
sim_compute_performance-ego0_median0.006128882539683375
sim_compute_performance-ego0_min0.005688884428569249
sim_compute_performance-ego1_max0.006319204966227214
sim_compute_performance-ego1_mean0.006050843943255026
sim_compute_performance-ego1_median0.0059841956411089215
sim_compute_performance-ego1_min0.005849131222428946
sim_compute_performance-ego2_max0.006323401133219401
sim_compute_performance-ego2_mean0.005985486148548178
sim_compute_performance-ego2_median0.006057928348409718
sim_compute_performance-ego2_min0.005575128964015416
sim_compute_robot_state-ego0_max0.011788094043731687
sim_compute_robot_state-ego0_mean0.011180342046302333
sim_compute_robot_state-ego0_median0.0112599175551842
sim_compute_robot_state-ego0_min0.010493014539991106
sim_compute_robot_state-ego1_max0.011220324039459228
sim_compute_robot_state-ego1_mean0.010680634683771869
sim_compute_robot_state-ego1_median0.010696526231436894
sim_compute_robot_state-ego1_min0.010125053780419486
sim_compute_robot_state-ego2_max0.011171340942382812
sim_compute_robot_state-ego2_mean0.010483395534587416
sim_compute_robot_state-ego2_median0.01038610524144666
sim_compute_robot_state-ego2_min0.009892740419932777
sim_compute_robot_state-parked0_max0.011785686016082764
sim_compute_robot_state-parked0_mean0.011229163320193738
sim_compute_robot_state-parked0_median0.011491878279324236
sim_compute_robot_state-parked0_min0.010409925665174211
sim_compute_robot_state-parked1_max0.011676299571990966
sim_compute_robot_state-parked1_mean0.010929673313115814
sim_compute_robot_state-parked1_median0.010911061845976733
sim_compute_robot_state-parked1_min0.010201658521379744
sim_compute_robot_state-parked2_max0.011447707811991371
sim_compute_robot_state-parked2_mean0.010923374152666372
sim_compute_robot_state-parked2_median0.010799338077676707
sim_compute_robot_state-parked2_min0.010523076568331038
sim_compute_robot_state-parked3_max0.011367170015970866
sim_compute_robot_state-parked3_mean0.010842141820618411
sim_compute_robot_state-parked3_median0.011115838741434032
sim_compute_robot_state-parked3_min0.010043416704450334
sim_compute_robot_state-parked4_max0.011408376693725584
sim_compute_robot_state-parked4_mean0.010744237390840777
sim_compute_robot_state-parked4_median0.010705919101320464
sim_compute_robot_state-parked4_min0.010118416377476284
sim_compute_robot_state-parked5_max0.011598201592763265
sim_compute_robot_state-parked5_mean0.010732973029721806
sim_compute_robot_state-parked5_median0.01039950600985823
sim_compute_robot_state-parked5_min0.010201211486543928
sim_compute_sim_state_max0.06576783259709676
sim_compute_sim_state_mean0.06544441885809854
sim_compute_sim_state_median0.06532855544771467
sim_compute_sim_state_min0.0652368685294842
sim_render-ego0_max0.007380719979604085
sim_render-ego0_mean0.007130394914336848
sim_render-ego0_median0.007176958281418373
sim_render-ego0_min0.00683350648198809
sim_render-ego1_max0.007456743717193603
sim_render-ego1_mean0.007163922941351954
sim_render-ego1_median0.007034587008612496
sim_render-ego1_min0.0070004380982497645
sim_render-ego2_max0.007556458314259847
sim_render-ego2_mean0.007177077409147107
sim_render-ego2_median0.007137154710703883
sim_render-ego2_min0.006837619202477592
simulation-passed1
step_physics_max0.47761909303994016
step_physics_mean0.46988465491056314
step_physics_median0.4731175558907645
step_physics_min0.4589173158009847
survival_time_max2.9999999999999973
survival_time_mean2.8999999999999972
survival_time_min2.799999999999998

Highlights

33212

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.