Duckietown Challenges Home Challenges Submissions

Job 33207

Job ID33207
submission6706
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:08:29
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4206363264054991
survival_time_median2.8999999999999977
deviation-center-line_median0.14452290085345834
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.04669564962387085
agent_compute-ego0_mean0.04598728155071904
agent_compute-ego0_median0.04568668348448617
agent_compute-ego0_min0.04557951154380009
agent_compute-ego1_max0.045681087176005046
agent_compute-ego1_mean0.04488301313699891
agent_compute-ego1_median0.04479399631763327
agent_compute-ego1_min0.0441739559173584
agent_compute-ego2_max0.0460843284924825
agent_compute-ego2_mean0.04496101992144634
agent_compute-ego2_median0.04479921686238256
agent_compute-ego2_min0.043999514409473965
complete-iteration_max1.0161031155750668
complete-iteration_mean1.0035397770043335
complete-iteration_median1.0031211631638663
complete-iteration_min0.9913950522740682
deviation-center-line_max0.2638448353623343
deviation-center-line_mean0.17741263874182037
deviation-center-line_min0.12210869555527595
deviation-heading_max0.7352695890794493
deviation-heading_mean0.3678670010580451
deviation-heading_median0.3267517743150319
deviation-heading_min0.02056006962655303
driven_any_max0.4394246161178098
driven_any_mean0.4226251669916168
driven_any_median0.42336326752251646
driven_any_min0.4050876173345276
driven_lanedir_consec_max0.4392581117839218
driven_lanedir_consec_mean0.4172063256636963
driven_lanedir_consec_min0.3910784225602359
driven_lanedir_max0.4392581117839218
driven_lanedir_mean0.4172063256636963
driven_lanedir_median0.4206363264054991
driven_lanedir_min0.3910784225602359
get_state_dump_max0.04884186188379923
get_state_dump_mean0.04814894379783865
get_state_dump_median0.04794393325674123
get_state_dump_min0.047661036252975464
get_ui_image_max0.1301726954323905
get_ui_image_mean0.1294572995279288
get_ui_image_median0.1291478713353475
get_ui_image_min0.12905133181604847
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 0.42336326752251024, "get_ui_image": 0.12905133181604847, "step_physics": 0.47366833686828613, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4206363264054991, "get_state_dump": 0.04794393325674123, "sim_render-ego0": 0.007649372363912648, "sim_render-ego1": 0.007412606272204169, "sim_render-ego2": 0.007401523918941103, "in-drivable-lane": 0.0, "deviation-heading": 0.3267517743150319, "agent_compute-ego0": 0.04557951154380009, "agent_compute-ego1": 0.04479399631763327, "agent_compute-ego2": 0.04479921686238256, "complete-iteration": 1.0161031155750668, "set_robot_commands": 0.007051007501010237, "deviation-center-line": 0.14452290085345834, "driven_lanedir_consec": 0.4206363264054991, "sim_compute_sim_state": 0.06870030534678492, "sim_compute_performance-ego0": 0.0066499134589885845, "sim_compute_performance-ego1": 0.006333910185715248, "sim_compute_performance-ego2": 0.00621789077232624, "sim_compute_robot_state-ego0": 0.011385851892931708, "sim_compute_robot_state-ego1": 0.011101097896181304, "sim_compute_robot_state-ego2": 0.01042257917338404, "sim_compute_robot_state-parked0": 0.01109506343973094, "sim_compute_robot_state-parked1": 0.010233599564124798, "sim_compute_robot_state-parked2": 0.01085529245179275, "sim_compute_robot_state-parked3": 0.011005364615341712, "sim_compute_robot_state-parked4": 0.010881880234027731, "sim_compute_robot_state-parked5": 0.01100142659812138}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 0.42336326752251646, "get_ui_image": 0.12905133181604847, "step_physics": 0.47366833686828613, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4233114877582156, "get_state_dump": 0.04794393325674123, "sim_render-ego0": 0.007649372363912648, "sim_render-ego1": 0.007412606272204169, "sim_render-ego2": 0.007401523918941103, "in-drivable-lane": 0.0, "deviation-heading": 0.04359171553787195, "agent_compute-ego0": 0.04557951154380009, "agent_compute-ego1": 0.04479399631763327, "agent_compute-ego2": 0.04479921686238256, "complete-iteration": 1.0161031155750668, "set_robot_commands": 0.007051007501010237, "deviation-center-line": 0.13205951395569177, "driven_lanedir_consec": 0.4233114877582156, "sim_compute_sim_state": 0.06870030534678492, "sim_compute_performance-ego0": 0.0066499134589885845, "sim_compute_performance-ego1": 0.006333910185715248, "sim_compute_performance-ego2": 0.00621789077232624, "sim_compute_robot_state-ego0": 0.011385851892931708, "sim_compute_robot_state-ego1": 0.011101097896181304, "sim_compute_robot_state-ego2": 0.01042257917338404, "sim_compute_robot_state-parked0": 0.01109506343973094, "sim_compute_robot_state-parked1": 0.010233599564124798, "sim_compute_robot_state-parked2": 0.01085529245179275, "sim_compute_robot_state-parked3": 0.011005364615341712, "sim_compute_robot_state-parked4": 0.010881880234027731, "sim_compute_robot_state-parked5": 0.01100142659812138}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 0.42336326752251646, "get_ui_image": 0.12905133181604847, "step_physics": 0.47366833686828613, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4097509793208185, "get_state_dump": 0.04794393325674123, "sim_render-ego0": 0.007649372363912648, "sim_render-ego1": 0.007412606272204169, "sim_render-ego2": 0.007401523918941103, "in-drivable-lane": 0.0, "deviation-heading": 0.7352695890794493, "agent_compute-ego0": 0.04557951154380009, "agent_compute-ego1": 0.04479399631763327, "agent_compute-ego2": 0.04479921686238256, "complete-iteration": 1.0161031155750668, "set_robot_commands": 0.007051007501010237, "deviation-center-line": 0.2574637225826533, "driven_lanedir_consec": 0.4097509793208185, "sim_compute_sim_state": 0.06870030534678492, "sim_compute_performance-ego0": 0.0066499134589885845, "sim_compute_performance-ego1": 0.006333910185715248, "sim_compute_performance-ego2": 0.00621789077232624, "sim_compute_robot_state-ego0": 0.011385851892931708, "sim_compute_robot_state-ego1": 0.011101097896181304, "sim_compute_robot_state-ego2": 0.01042257917338404, "sim_compute_robot_state-parked0": 0.01109506343973094, "sim_compute_robot_state-parked1": 0.010233599564124798, "sim_compute_robot_state-parked2": 0.01085529245179275, "sim_compute_robot_state-parked3": 0.011005364615341712, "sim_compute_robot_state-parked4": 0.010881880234027731, "sim_compute_robot_state-parked5": 0.01100142659812138}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 0.4050876173345316, "get_ui_image": 0.1301726954323905, "step_physics": 0.469833561352321, "survival_time": 2.799999999999998, "driven_lanedir": 0.402025463741015, "get_state_dump": 0.047661036252975464, "sim_render-ego0": 0.0070625415870121545, "sim_render-ego1": 0.00709957310131618, "sim_render-ego2": 0.007231801748275757, "in-drivable-lane": 0.0, "deviation-heading": 0.3390265196562397, "agent_compute-ego0": 0.04568668348448617, "agent_compute-ego1": 0.0441739559173584, "agent_compute-ego2": 0.043999514409473965, "complete-iteration": 1.0031211631638663, "set_robot_commands": 0.006582604987280709, "deviation-center-line": 0.14035880895450595, "driven_lanedir_consec": 0.402025463741015, "sim_compute_sim_state": 0.06721461670739311, "sim_compute_performance-ego0": 0.005930628095354352, "sim_compute_performance-ego1": 0.006002788032804217, "sim_compute_performance-ego2": 0.005973036800112043, "sim_compute_robot_state-ego0": 0.011055588722229004, "sim_compute_robot_state-ego1": 0.010364460093634467, "sim_compute_robot_state-ego2": 0.010541571038109916, "sim_compute_robot_state-parked0": 0.010358495371682304, "sim_compute_robot_state-parked1": 0.010509290865489416, "sim_compute_robot_state-parked2": 0.010547782693590435, "sim_compute_robot_state-parked3": 0.010729074478149414, "sim_compute_robot_state-parked4": 0.01052514570099967, "sim_compute_robot_state-parked5": 0.0103334869657244}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 0.4050876173345276, "get_ui_image": 0.1301726954323905, "step_physics": 0.469833561352321, "survival_time": 2.799999999999998, "driven_lanedir": 0.40507567398952427, "get_state_dump": 0.047661036252975464, "sim_render-ego0": 0.0070625415870121545, "sim_render-ego1": 0.00709957310131618, "sim_render-ego2": 0.007231801748275757, "in-drivable-lane": 0.0, "deviation-heading": 0.02056006962655303, "agent_compute-ego0": 0.04568668348448617, "agent_compute-ego1": 0.0441739559173584, "agent_compute-ego2": 0.043999514409473965, "complete-iteration": 1.0031211631638663, "set_robot_commands": 0.006582604987280709, "deviation-center-line": 0.12210869555527595, "driven_lanedir_consec": 0.40507567398952427, "sim_compute_sim_state": 0.06721461670739311, "sim_compute_performance-ego0": 0.005930628095354352, "sim_compute_performance-ego1": 0.006002788032804217, "sim_compute_performance-ego2": 0.005973036800112043, "sim_compute_robot_state-ego0": 0.011055588722229004, "sim_compute_robot_state-ego1": 0.010364460093634467, "sim_compute_robot_state-ego2": 0.010541571038109916, "sim_compute_robot_state-parked0": 0.010358495371682304, "sim_compute_robot_state-parked1": 0.010509290865489416, "sim_compute_robot_state-parked2": 0.010547782693590435, "sim_compute_robot_state-parked3": 0.010729074478149414, "sim_compute_robot_state-parked4": 0.01052514570099967, "sim_compute_robot_state-parked5": 0.0103334869657244}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 0.40508761733452814, "get_ui_image": 0.1301726954323905, "step_physics": 0.469833561352321, "survival_time": 2.799999999999998, "driven_lanedir": 0.3910784225602359, "get_state_dump": 0.047661036252975464, "sim_render-ego0": 0.0070625415870121545, "sim_render-ego1": 0.00709957310131618, "sim_render-ego2": 0.007231801748275757, "in-drivable-lane": 0.0, "deviation-heading": 0.7334575132218849, "agent_compute-ego0": 0.04568668348448617, "agent_compute-ego1": 0.0441739559173584, "agent_compute-ego2": 0.043999514409473965, "complete-iteration": 1.0031211631638663, "set_robot_commands": 0.006582604987280709, "deviation-center-line": 0.24434318921423517, "driven_lanedir_consec": 0.3910784225602359, "sim_compute_sim_state": 0.06721461670739311, "sim_compute_performance-ego0": 0.005930628095354352, "sim_compute_performance-ego1": 0.006002788032804217, "sim_compute_performance-ego2": 0.005973036800112043, "sim_compute_robot_state-ego0": 0.011055588722229004, "sim_compute_robot_state-ego1": 0.010364460093634467, "sim_compute_robot_state-ego2": 0.010541571038109916, "sim_compute_robot_state-parked0": 0.010358495371682304, "sim_compute_robot_state-parked1": 0.010509290865489416, "sim_compute_robot_state-parked2": 0.010547782693590435, "sim_compute_robot_state-parked3": 0.010729074478149414, "sim_compute_robot_state-parked4": 0.01052514570099967, "sim_compute_robot_state-parked5": 0.0103334869657244}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 0.4394246161178098, "get_ui_image": 0.1291478713353475, "step_physics": 0.454988960425059, "survival_time": 2.9999999999999973, "driven_lanedir": 0.4371471549185302, "get_state_dump": 0.04884186188379923, "sim_render-ego0": 0.007619722684224447, "sim_render-ego1": 0.007311137517293295, "sim_render-ego2": 0.00715331236521403, "in-drivable-lane": 0.0, "deviation-heading": 0.3064272371019385, "agent_compute-ego0": 0.04669564962387085, "agent_compute-ego1": 0.045681087176005046, "agent_compute-ego2": 0.0460843284924825, "complete-iteration": 0.9913950522740682, "set_robot_commands": 0.006163330872853597, "deviation-center-line": 0.14034054351485595, "driven_lanedir_consec": 0.4371471549185302, "sim_compute_sim_state": 0.06702063878377279, "sim_compute_performance-ego0": 0.006302766005198161, "sim_compute_performance-ego1": 0.006166156133015951, "sim_compute_performance-ego2": 0.005911131699879964, "sim_compute_robot_state-ego0": 0.010239990552266438, "sim_compute_robot_state-ego1": 0.010610620180765787, "sim_compute_robot_state-ego2": 0.01023660898208618, "sim_compute_robot_state-parked0": 0.01049024264017741, "sim_compute_robot_state-parked1": 0.010363741715749103, "sim_compute_robot_state-parked2": 0.010341636339823403, "sim_compute_robot_state-parked3": 0.010231781005859374, "sim_compute_robot_state-parked4": 0.010104203224182129, "sim_compute_robot_state-parked5": 0.01021656592686971}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 0.4394246161178009, "get_ui_image": 0.1291478713353475, "step_physics": 0.454988960425059, "survival_time": 2.9999999999999973, "driven_lanedir": 0.4392581117839218, "get_state_dump": 0.04884186188379923, "sim_render-ego0": 0.007619722684224447, "sim_render-ego1": 0.007311137517293295, "sim_render-ego2": 0.00715331236521403, "in-drivable-lane": 0.0, "deviation-heading": 0.07668671791830647, "agent_compute-ego0": 0.04669564962387085, "agent_compute-ego1": 0.045681087176005046, "agent_compute-ego2": 0.0460843284924825, "complete-iteration": 0.9913950522740682, "set_robot_commands": 0.006163330872853597, "deviation-center-line": 0.15167153868337285, "driven_lanedir_consec": 0.4392581117839218, "sim_compute_sim_state": 0.06702063878377279, "sim_compute_performance-ego0": 0.006302766005198161, "sim_compute_performance-ego1": 0.006166156133015951, "sim_compute_performance-ego2": 0.005911131699879964, "sim_compute_robot_state-ego0": 0.010239990552266438, "sim_compute_robot_state-ego1": 0.010610620180765787, "sim_compute_robot_state-ego2": 0.01023660898208618, "sim_compute_robot_state-parked0": 0.01049024264017741, "sim_compute_robot_state-parked1": 0.010363741715749103, "sim_compute_robot_state-parked2": 0.010341636339823403, "sim_compute_robot_state-parked3": 0.010231781005859374, "sim_compute_robot_state-parked4": 0.010104203224182129, "sim_compute_robot_state-parked5": 0.01021656592686971}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 0.4394246161178098, "get_ui_image": 0.1291478713353475, "step_physics": 0.454988960425059, "survival_time": 2.9999999999999973, "driven_lanedir": 0.42657331049550606, "get_state_dump": 0.04884186188379923, "sim_render-ego0": 0.007619722684224447, "sim_render-ego1": 0.007311137517293295, "sim_render-ego2": 0.00715331236521403, "in-drivable-lane": 0.0, "deviation-heading": 0.7290318730651308, "agent_compute-ego0": 0.04669564962387085, "agent_compute-ego1": 0.045681087176005046, "agent_compute-ego2": 0.0460843284924825, "complete-iteration": 0.9913950522740682, "set_robot_commands": 0.006163330872853597, "deviation-center-line": 0.2638448353623343, "driven_lanedir_consec": 0.42657331049550606, "sim_compute_sim_state": 0.06702063878377279, "sim_compute_performance-ego0": 0.006302766005198161, "sim_compute_performance-ego1": 0.006166156133015951, "sim_compute_performance-ego2": 0.005911131699879964, "sim_compute_robot_state-ego0": 0.010239990552266438, "sim_compute_robot_state-ego1": 0.010610620180765787, "sim_compute_robot_state-ego2": 0.01023660898208618, "sim_compute_robot_state-parked0": 0.01049024264017741, "sim_compute_robot_state-parked1": 0.010363741715749103, "sim_compute_robot_state-parked2": 0.010341636339823403, "sim_compute_robot_state-parked3": 0.010231781005859374, "sim_compute_robot_state-parked4": 0.010104203224182129, "sim_compute_robot_state-parked5": 0.01021656592686971}}
set_robot_commands_max0.007051007501010237
set_robot_commands_mean0.006598981120381515
set_robot_commands_median0.006582604987280709
set_robot_commands_min0.006163330872853597
sim_compute_performance-ego0_max0.0066499134589885845
sim_compute_performance-ego0_mean0.006294435853180366
sim_compute_performance-ego0_median0.006302766005198161
sim_compute_performance-ego0_min0.005930628095354352
sim_compute_performance-ego1_max0.006333910185715248
sim_compute_performance-ego1_mean0.0061676181171784715
sim_compute_performance-ego1_median0.006166156133015951
sim_compute_performance-ego1_min0.006002788032804217
sim_compute_performance-ego2_max0.00621789077232624
sim_compute_performance-ego2_mean0.006034019757439416
sim_compute_performance-ego2_median0.005973036800112043
sim_compute_performance-ego2_min0.005911131699879964
sim_compute_robot_state-ego0_max0.011385851892931708
sim_compute_robot_state-ego0_mean0.010893810389142382
sim_compute_robot_state-ego0_median0.011055588722229004
sim_compute_robot_state-ego0_min0.010239990552266438
sim_compute_robot_state-ego1_max0.011101097896181304
sim_compute_robot_state-ego1_mean0.010692059390193857
sim_compute_robot_state-ego1_median0.010610620180765787
sim_compute_robot_state-ego1_min0.010364460093634467
sim_compute_robot_state-ego2_max0.010541571038109916
sim_compute_robot_state-ego2_mean0.010400253064526712
sim_compute_robot_state-ego2_median0.01042257917338404
sim_compute_robot_state-ego2_min0.01023660898208618
sim_compute_robot_state-parked0_max0.01109506343973094
sim_compute_robot_state-parked0_mean0.010647933817196885
sim_compute_robot_state-parked0_median0.01049024264017741
sim_compute_robot_state-parked0_min0.010358495371682304
sim_compute_robot_state-parked1_max0.010509290865489416
sim_compute_robot_state-parked1_mean0.010368877381787774
sim_compute_robot_state-parked1_median0.010363741715749103
sim_compute_robot_state-parked1_min0.010233599564124798
sim_compute_robot_state-parked2_max0.01085529245179275
sim_compute_robot_state-parked2_mean0.010581570495068865
sim_compute_robot_state-parked2_median0.010547782693590435
sim_compute_robot_state-parked2_min0.010341636339823403
sim_compute_robot_state-parked3_max0.011005364615341712
sim_compute_robot_state-parked3_mean0.0106554066997835
sim_compute_robot_state-parked3_median0.010729074478149414
sim_compute_robot_state-parked3_min0.010231781005859374
sim_compute_robot_state-parked4_max0.010881880234027731
sim_compute_robot_state-parked4_mean0.010503743053069845
sim_compute_robot_state-parked4_median0.01052514570099967
sim_compute_robot_state-parked4_min0.010104203224182129
sim_compute_robot_state-parked5_max0.01100142659812138
sim_compute_robot_state-parked5_mean0.010517159830238496
sim_compute_robot_state-parked5_median0.0103334869657244
sim_compute_robot_state-parked5_min0.01021656592686971
sim_compute_sim_state_max0.06870030534678492
sim_compute_sim_state_mean0.0676451869459836
sim_compute_sim_state_median0.06721461670739311
sim_compute_sim_state_min0.06702063878377279
sim_render-ego0_max0.007649372363912648
sim_render-ego0_mean0.007443878878383083
sim_render-ego0_median0.007619722684224447
sim_render-ego0_min0.0070625415870121545
sim_render-ego1_max0.007412606272204169
sim_render-ego1_mean0.007274438963604548
sim_render-ego1_median0.007311137517293295
sim_render-ego1_min0.00709957310131618
sim_render-ego2_max0.007401523918941103
sim_render-ego2_mean0.007262212677476964
sim_render-ego2_median0.007231801748275757
sim_render-ego2_min0.00715331236521403
simulation-passed1
step_physics_max0.47366833686828613
step_physics_mean0.46616361954855534
step_physics_median0.469833561352321
step_physics_min0.454988960425059
survival_time_max2.9999999999999973
survival_time_mean2.8999999999999972
survival_time_min2.799999999999998

Highlights

33207

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.