Duckietown Challenges Home Challenges Submissions

Job 37094

Job ID37094
submission10402
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg02-2e50246280f2-1
date started
date completed
duration0:11:42
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6385178968717619
survival_time_median6.749999999999984
deviation-center-line_median0.4259311057885399
in-drivable-lane_median0.6999999999999975


other stats
agent_compute-ego0_max0.025108207517595432
agent_compute-ego0_mean0.02503230745717265
agent_compute-ego0_median0.025026911276358144
agent_compute-ego0_min0.02496180357756438
agent_compute-ego1_max0.024522799164501587
agent_compute-ego1_mean0.024412616137885385
agent_compute-ego1_median0.024393788090458623
agent_compute-ego1_min0.024321261158695928
agent_compute-npc0_max0.060752026240030926
agent_compute-npc0_mean0.05925896059682581
agent_compute-npc0_median0.05854491127861871
agent_compute-npc0_min0.05847994427182781
agent_compute-npc1_max0.06212603074532968
agent_compute-npc1_mean0.0602076534761872
agent_compute-npc1_median0.05935924800474252
agent_compute-npc1_min0.0591376816784894
complete-iteration_max0.9832835091484916
complete-iteration_mean0.9620065295632556
complete-iteration_median0.961123505635048
complete-iteration_min0.9416125739062274
deviation-center-line_max0.677230978621922
deviation-center-line_mean0.44347935325554005
deviation-center-line_min0.2503843892983658
deviation-heading_max0.9953037956539208
deviation-heading_mean0.8569511506653901
deviation-heading_median0.8375033703096426
deviation-heading_min0.7317059790306417
driven_any_max1.0597494879386689
driven_any_mean0.7833791939073204
driven_any_median0.7848160980483199
driven_any_min0.50414541487072
driven_lanedir_consec_max0.79268631270049
driven_lanedir_consec_mean0.6446101846282898
driven_lanedir_consec_min0.5009572878393345
driven_lanedir_max0.79268631270049
driven_lanedir_mean0.6446101846282898
driven_lanedir_median0.6385178968717619
driven_lanedir_min0.5009572878393345
get_duckie_state_max4.798394662362558e-06
get_duckie_state_mean4.355543244493498e-06
get_duckie_state_median4.227481671233675e-06
get_duckie_state_min4.04075339988426e-06
get_robot_state_max0.06573928727044
get_robot_state_mean0.06047000761121726
get_robot_state_median0.0637027968221636
get_robot_state_min0.05196793874104818
get_state_dump_max0.034417334309330694
get_state_dump_mean0.03425663730068851
get_state_dump_median0.03421554388823333
get_state_dump_min0.03413703370450148
get_ui_image_max0.07043111589219835
get_ui_image_mean0.06999617043792684
get_ui_image_median0.07011604132475677
get_ui_image_min0.06944135409682545
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.7249999999999974
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego0": {"driven_any": 0.50414541487072, "get_ui_image": 0.07043111589219835, "step_physics": 0.4880710460521557, "survival_time": 6.749999999999984, "driven_lanedir": 0.5009572878393345, "get_state_dump": 0.03421554388823333, "get_robot_state": 0.06573928727044, "sim_render-ego0": 0.010131293755990489, "sim_render-ego1": 0.010190658216123229, "sim_render-npc0": 0.010029291223596644, "sim_render-npc1": 0.010218832227918835, "get_duckie_state": 4.798394662362558e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.7317059790306417, "agent_compute-ego0": 0.025026911276358144, "agent_compute-ego1": 0.024393788090458623, "agent_compute-npc0": 0.060752026240030926, "agent_compute-npc1": 0.06212603074532968, "complete-iteration": 0.9832835091484916, "set_robot_commands": 0.008814765788890698, "deviation-center-line": 0.5655045692315256, "driven_lanedir_consec": 0.5009572878393345, "sim_compute_sim_state": 0.04775287486888744, "sim_compute_performance-ego0": 0.007075177298651801, "sim_compute_performance-ego1": 0.007219360492847584, "sim_compute_performance-npc0": 0.007020120267514829, "sim_compute_performance-npc1": 0.007225188502558956}, "ETHZ_autolab_technical_track-sc0-0-ego1": {"driven_any": 1.0597494879386689, "get_ui_image": 0.07043111589219835, "step_physics": 0.4880710460521557, "survival_time": 6.749999999999984, "driven_lanedir": 0.7923704750254537, "get_state_dump": 0.03421554388823333, "get_robot_state": 0.06573928727044, "sim_render-ego0": 0.010131293755990489, "sim_render-ego1": 0.010190658216123229, "sim_render-npc0": 0.010029291223596644, "sim_render-npc1": 0.010218832227918835, "get_duckie_state": 4.798394662362558e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.916954216178206, "agent_compute-ego0": 0.025026911276358144, "agent_compute-ego1": 0.024393788090458623, "agent_compute-npc0": 0.060752026240030926, "agent_compute-npc1": 0.06212603074532968, "complete-iteration": 0.9832835091484916, "set_robot_commands": 0.008814765788890698, "deviation-center-line": 0.2863576423455541, "driven_lanedir_consec": 0.7923704750254537, "sim_compute_sim_state": 0.04775287486888744, "sim_compute_performance-ego0": 0.007075177298651801, "sim_compute_performance-ego1": 0.007219360492847584, "sim_compute_performance-npc0": 0.007020120267514829, "sim_compute_performance-npc1": 0.007225188502558956}, "ETHZ_autolab_technical_track-sc0-1-ego0": {"driven_any": 0.5084858950153767, "get_ui_image": 0.07011604132475677, "step_physics": 0.4844323758725767, "survival_time": 6.749999999999984, "driven_lanedir": 0.5046112384609371, "get_state_dump": 0.034417334309330694, "get_robot_state": 0.05196793874104818, "sim_render-ego0": 0.008538140190972222, "sim_render-ego1": 0.008979115662751374, "sim_render-npc0": 0.008825471666124131, "sim_render-npc1": 0.009053011293764467, "get_duckie_state": 4.04075339988426e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.8227361725102867, "agent_compute-ego0": 0.02496180357756438, "agent_compute-ego1": 0.024321261158695928, "agent_compute-npc0": 0.05854491127861871, "agent_compute-npc1": 0.0591376816784894, "complete-iteration": 0.9416125739062274, "set_robot_commands": 0.007121156763147425, "deviation-center-line": 0.6135005519857025, "driven_lanedir_consec": 0.5046112384609371, "sim_compute_sim_state": 0.04583916310910825, "sim_compute_performance-ego0": 0.006427176793416341, "sim_compute_performance-ego1": 0.0061389357955367475, "sim_compute_performance-npc0": 0.00576001626473886, "sim_compute_performance-npc1": 0.00600205350805212}, "ETHZ_autolab_technical_track-sc0-1-ego1": {"driven_any": 1.0582621695225167, "get_ui_image": 0.07011604132475677, "step_physics": 0.4844323758725767, "survival_time": 6.749999999999984, "driven_lanedir": 0.79268631270049, "get_state_dump": 0.034417334309330694, "get_robot_state": 0.05196793874104818, "sim_render-ego0": 0.008538140190972222, "sim_render-ego1": 0.008979115662751374, "sim_render-npc0": 0.008825471666124131, "sim_render-npc1": 0.009053011293764467, "get_duckie_state": 4.04075339988426e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.8418073950192356, "agent_compute-ego0": 0.02496180357756438, "agent_compute-ego1": 0.024321261158695928, "agent_compute-npc0": 0.05854491127861871, "agent_compute-npc1": 0.0591376816784894, "complete-iteration": 0.9416125739062274, "set_robot_commands": 0.007121156763147425, "deviation-center-line": 0.2678979880501701, "driven_lanedir_consec": 0.79268631270049, "sim_compute_sim_state": 0.04583916310910825, "sim_compute_performance-ego0": 0.006427176793416341, "sim_compute_performance-ego1": 0.0061389357955367475, "sim_compute_performance-npc0": 0.00576001626473886, "sim_compute_performance-npc1": 0.00600205350805212}, "ETHZ_autolab_technical_track-sc0-2-ego0": {"driven_any": 0.5137852612203508, "get_ui_image": 0.06944135409682545, "step_physics": 0.47735393759030015, "survival_time": 6.699999999999984, "driven_lanedir": 0.5085231376799231, "get_state_dump": 0.03413703370450148, "get_robot_state": 0.0637027968221636, "sim_render-ego0": 0.009780983426677646, "sim_render-ego1": 0.009800918066679544, "sim_render-npc0": 0.009868598696011217, "sim_render-npc1": 0.010110237705173776, "get_duckie_state": 4.227481671233675e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9953037956539208, "agent_compute-ego0": 0.025108207517595432, "agent_compute-ego1": 0.024522799164501587, "agent_compute-npc0": 0.05847994427182781, "agent_compute-npc1": 0.05935924800474252, "complete-iteration": 0.961123505635048, "set_robot_commands": 0.008731799339180562, "deviation-center-line": 0.677230978621922, "driven_lanedir_consec": 0.5085231376799231, "sim_compute_sim_state": 0.047542228627560745, "sim_compute_performance-ego0": 0.006846047159451157, "sim_compute_performance-ego1": 0.006790315926964603, "sim_compute_performance-npc0": 0.0066456100833949755, "sim_compute_performance-npc1": 0.006883729749651097}, "ETHZ_autolab_technical_track-sc0-2-ego1": {"driven_any": 1.055846934876289, "get_ui_image": 0.06944135409682545, "step_physics": 0.47735393759030015, "survival_time": 6.699999999999984, "driven_lanedir": 0.7685126560636006, "get_state_dump": 0.03413703370450148, "get_robot_state": 0.0637027968221636, "sim_render-ego0": 0.009780983426677646, "sim_render-ego1": 0.009800918066679544, "sim_render-npc0": 0.009868598696011217, "sim_render-npc1": 0.010110237705173776, "get_duckie_state": 4.227481671233675e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 0.8331993456000497, "agent_compute-ego0": 0.025108207517595432, "agent_compute-ego1": 0.024522799164501587, "agent_compute-npc0": 0.05847994427182781, "agent_compute-npc1": 0.05935924800474252, "complete-iteration": 0.961123505635048, "set_robot_commands": 0.008731799339180562, "deviation-center-line": 0.2503843892983658, "driven_lanedir_consec": 0.7685126560636006, "sim_compute_sim_state": 0.047542228627560745, "sim_compute_performance-ego0": 0.006846047159451157, "sim_compute_performance-ego1": 0.006790315926964603, "sim_compute_performance-npc0": 0.0066456100833949755, "sim_compute_performance-npc1": 0.006883729749651097}}
set_robot_commands_max0.008814765788890698
set_robot_commands_mean0.008222573963739562
set_robot_commands_median0.008731799339180562
set_robot_commands_min0.007121156763147425
sim_compute_performance-ego0_max0.007075177298651801
sim_compute_performance-ego0_mean0.006782800417173099
sim_compute_performance-ego0_median0.006846047159451157
sim_compute_performance-ego0_min0.006427176793416341
sim_compute_performance-ego1_max0.007219360492847584
sim_compute_performance-ego1_mean0.006716204071782978
sim_compute_performance-ego1_median0.006790315926964603
sim_compute_performance-ego1_min0.0061389357955367475
sim_compute_performance-npc0_max0.007020120267514829
sim_compute_performance-npc0_mean0.006475248871882888
sim_compute_performance-npc0_median0.0066456100833949755
sim_compute_performance-npc0_min0.00576001626473886
sim_compute_performance-npc1_max0.007225188502558956
sim_compute_performance-npc1_mean0.006703657253420724
sim_compute_performance-npc1_median0.006883729749651097
sim_compute_performance-npc1_min0.00600205350805212
sim_compute_sim_state_max0.04775287486888744
sim_compute_sim_state_mean0.04704475553518548
sim_compute_sim_state_median0.047542228627560745
sim_compute_sim_state_min0.04583916310910825
sim_render-ego0_max0.010131293755990489
sim_render-ego0_mean0.009483472457880116
sim_render-ego0_median0.009780983426677646
sim_render-ego0_min0.008538140190972222
sim_render-ego1_max0.010190658216123229
sim_render-ego1_mean0.009656897315184714
sim_render-ego1_median0.009800918066679544
sim_render-ego1_min0.008979115662751374
sim_render-npc0_max0.010029291223596644
sim_render-npc0_mean0.009574453861910664
sim_render-npc0_median0.009868598696011217
sim_render-npc0_min0.008825471666124131
sim_render-npc1_max0.010218832227918835
sim_render-npc1_mean0.009794027075619029
sim_render-npc1_median0.010110237705173776
sim_render-npc1_min0.009053011293764467
simulation-passed1
step_physics_max0.4880710460521557
step_physics_mean0.4832857865050108
step_physics_median0.4844323758725767
step_physics_min0.47735393759030015
survival_time_max6.749999999999984
survival_time_mean6.7333333333333165
survival_time_min6.699999999999984

Highlights

37094

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-sc0-0

ETHZ_autolab_technical_track-sc0-1

ETHZ_autolab_technical_track-sc0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.