Duckietown Challenges Home Challenges Submissions

Job 34369

Job ID34369
submission9214
userBea Baselines 🐤
user labeltemplate-ros
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg01-43ac583c2714-1
date started
date completed
duration0:20:53
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4396648281765136
survival_time_median10.825000000000031
deviation-center-line_median0.3017152936762324
in-drivable-lane_median5.400000000000021


other stats
agent_compute-ego0_max0.06878569761912028
agent_compute-ego0_mean0.0664655610459361
agent_compute-ego0_median0.0664655610459361
agent_compute-ego0_min0.0641454244727519
agent_compute-ego1_max0.06821359983131067
agent_compute-ego1_mean0.06770655488493431
agent_compute-ego1_median0.06770655488493431
agent_compute-ego1_min0.06719950993855794
agent_compute-ego2_max0.06552256425221761
agent_compute-ego2_mean0.06498070452343764
agent_compute-ego2_median0.06498070452343765
agent_compute-ego2_min0.0644388447946577
complete-iteration_max1.5481326330953569
complete-iteration_mean1.4656200936065975
complete-iteration_median1.4656200936065975
complete-iteration_min1.3831075541178386
deviation-center-line_max0.788955466422604
deviation-center-line_mean0.356526076088133
deviation-center-line_min0.14141790382607317
deviation-heading_max5.8048343676050145
deviation-heading_mean2.774853318645898
deviation-heading_median2.411582807529861
deviation-heading_min1.2569436660133269
driven_any_max1.939708195171492
driven_any_mean1.3886903418144925
driven_any_median1.388593907845601
driven_any_min0.8378161922563233
driven_lanedir_consec_max0.5986525334558506
driven_lanedir_consec_mean0.4644085123872741
driven_lanedir_consec_min0.35158519113017617
driven_lanedir_max0.5986525334558506
driven_lanedir_mean0.4644085123872741
driven_lanedir_median0.4396648281765136
driven_lanedir_min0.35158519113017617
get_state_dump_max0.04932990358836616
get_state_dump_mean0.04913494172974013
get_state_dump_median0.04913494172974013
get_state_dump_min0.04893997987111409
get_ui_image_max0.1487301748190353
get_ui_image_mean0.14256156251798222
get_ui_image_median0.14256156251798222
get_ui_image_min0.13639295021692913
in-drivable-lane_max11.600000000000051
in-drivable-lane_mean5.783333333333356
in-drivable-lane_min1.3499999999999952
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.8379143184730705, "get_ui_image": 0.1487301748190353, "step_physics": 0.9279810350332688, "survival_time": 6.699999999999984, "driven_lanedir": 0.4139340105249931, "get_state_dump": 0.04932990358836616, "sim_render-ego0": 0.00811510655417371, "sim_render-ego1": 0.007687504611798187, "sim_render-ego2": 0.006986769277658036, "in-drivable-lane": 2.099999999999996, "deviation-heading": 2.6987718350348215, "agent_compute-ego0": 0.0641454244727519, "agent_compute-ego1": 0.06821359983131067, "agent_compute-ego2": 0.0644388447946577, "complete-iteration": 1.5481326330953569, "set_robot_commands": 0.0061920365290855294, "deviation-center-line": 0.20289818941979396, "driven_lanedir_consec": 0.4139340105249931, "sim_compute_sim_state": 0.07641846920127299, "sim_compute_performance-ego0": 0.006145662336207148, "sim_compute_performance-ego1": 0.005795971671147133, "sim_compute_performance-ego2": 0.005828691952264131, "sim_compute_robot_state-ego0": 0.009999534977016163, "sim_compute_robot_state-ego1": 0.00952210533085154, "sim_compute_robot_state-ego2": 0.00963422611578187, "sim_compute_robot_state-parked0": 0.010052643605132602, "sim_compute_robot_state-parked1": 0.009651203653705654, "sim_compute_robot_state-parked2": 0.010293951675073423, "sim_compute_robot_state-parked3": 0.010343240268194854, "sim_compute_robot_state-parked4": 0.009749914283183085, "sim_compute_robot_state-parked5": 0.009909562210538497}, "udem1-0-0-ego1": {"driven_any": 0.8380607823235352, "get_ui_image": 0.1487301748190353, "step_physics": 0.9279810350332688, "survival_time": 6.699999999999984, "driven_lanedir": 0.5632967220557572, "get_state_dump": 0.04932990358836616, "sim_render-ego0": 0.00811510655417371, "sim_render-ego1": 0.007687504611798187, "sim_render-ego2": 0.006986769277658036, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 1.95900554211857, "agent_compute-ego0": 0.0641454244727519, "agent_compute-ego1": 0.06821359983131067, "agent_compute-ego2": 0.0644388447946577, "complete-iteration": 1.5481326330953569, "set_robot_commands": 0.0061920365290855294, "deviation-center-line": 0.2158248972246153, "driven_lanedir_consec": 0.5632967220557572, "sim_compute_sim_state": 0.07641846920127299, "sim_compute_performance-ego0": 0.006145662336207148, "sim_compute_performance-ego1": 0.005795971671147133, "sim_compute_performance-ego2": 0.005828691952264131, "sim_compute_robot_state-ego0": 0.009999534977016163, "sim_compute_robot_state-ego1": 0.00952210533085154, "sim_compute_robot_state-ego2": 0.00963422611578187, "sim_compute_robot_state-parked0": 0.010052643605132602, "sim_compute_robot_state-parked1": 0.009651203653705654, "sim_compute_robot_state-parked2": 0.010293951675073423, "sim_compute_robot_state-parked3": 0.010343240268194854, "sim_compute_robot_state-parked4": 0.009749914283183085, "sim_compute_robot_state-parked5": 0.009909562210538497}, "udem1-0-0-ego2": {"driven_any": 0.8378161922563233, "get_ui_image": 0.1487301748190353, "step_physics": 0.9279810350332688, "survival_time": 6.699999999999984, "driven_lanedir": 0.39358697132883336, "get_state_dump": 0.04932990358836616, "sim_render-ego0": 0.00811510655417371, "sim_render-ego1": 0.007687504611798187, "sim_render-ego2": 0.006986769277658036, "in-drivable-lane": 2.499999999999991, "deviation-heading": 2.1243937800249, "agent_compute-ego0": 0.0641454244727519, "agent_compute-ego1": 0.06821359983131067, "agent_compute-ego2": 0.0644388447946577, "complete-iteration": 1.5481326330953569, "set_robot_commands": 0.0061920365290855294, "deviation-center-line": 0.14141790382607317, "driven_lanedir_consec": 0.39358697132883336, "sim_compute_sim_state": 0.07641846920127299, "sim_compute_performance-ego0": 0.006145662336207148, "sim_compute_performance-ego1": 0.005795971671147133, "sim_compute_performance-ego2": 0.005828691952264131, "sim_compute_robot_state-ego0": 0.009999534977016163, "sim_compute_robot_state-ego1": 0.00952210533085154, "sim_compute_robot_state-ego2": 0.00963422611578187, "sim_compute_robot_state-parked0": 0.010052643605132602, "sim_compute_robot_state-parked1": 0.009651203653705654, "sim_compute_robot_state-parked2": 0.010293951675073423, "sim_compute_robot_state-parked3": 0.010343240268194854, "sim_compute_robot_state-parked4": 0.009749914283183085, "sim_compute_robot_state-parked5": 0.009909562210538497}, "udem1-0-1-ego0": {"driven_any": 1.939708195171492, "get_ui_image": 0.13639295021692913, "step_physics": 0.7716024025281271, "survival_time": 14.950000000000076, "driven_lanedir": 0.35158519113017617, "get_state_dump": 0.04893997987111409, "sim_render-ego0": 0.008098531564076741, "sim_render-ego1": 0.0076285394032796225, "sim_render-ego2": 0.00743123451868693, "in-drivable-lane": 11.600000000000051, "deviation-heading": 1.2569436660133269, "agent_compute-ego0": 0.06878569761912028, "agent_compute-ego1": 0.06719950993855794, "agent_compute-ego2": 0.06552256425221761, "complete-iteration": 1.3831075541178386, "set_robot_commands": 0.006496942043304444, "deviation-center-line": 0.3876056901278495, "driven_lanedir_consec": 0.35158519113017617, "sim_compute_sim_state": 0.0725371249516805, "sim_compute_performance-ego0": 0.006066722869873047, "sim_compute_performance-ego1": 0.006090805530548095, "sim_compute_performance-ego2": 0.005899879137674967, "sim_compute_robot_state-ego0": 0.010275696913401286, "sim_compute_robot_state-ego1": 0.010098755359649658, "sim_compute_robot_state-ego2": 0.010082263151804606, "sim_compute_robot_state-parked0": 0.00998501698176066, "sim_compute_robot_state-parked1": 0.010373610655466716, "sim_compute_robot_state-parked2": 0.010056122144063314, "sim_compute_robot_state-parked3": 0.010063931941986085, "sim_compute_robot_state-parked4": 0.01024113098780314, "sim_compute_robot_state-parked5": 0.010090364615122476}, "udem1-0-1-ego1": {"driven_any": 1.9391270333676676, "get_ui_image": 0.13639295021692913, "step_physics": 0.7716024025281271, "survival_time": 14.950000000000076, "driven_lanedir": 0.46539564582803417, "get_state_dump": 0.04893997987111409, "sim_render-ego0": 0.008098531564076741, "sim_render-ego1": 0.0076285394032796225, "sim_render-ego2": 0.00743123451868693, "in-drivable-lane": 8.30000000000005, "deviation-heading": 5.8048343676050145, "agent_compute-ego0": 0.06878569761912028, "agent_compute-ego1": 0.06719950993855794, "agent_compute-ego2": 0.06552256425221761, "complete-iteration": 1.3831075541178386, "set_robot_commands": 0.006496942043304444, "deviation-center-line": 0.788955466422604, "driven_lanedir_consec": 0.46539564582803417, "sim_compute_sim_state": 0.0725371249516805, "sim_compute_performance-ego0": 0.006066722869873047, "sim_compute_performance-ego1": 0.006090805530548095, "sim_compute_performance-ego2": 0.005899879137674967, "sim_compute_robot_state-ego0": 0.010275696913401286, "sim_compute_robot_state-ego1": 0.010098755359649658, "sim_compute_robot_state-ego2": 0.010082263151804606, "sim_compute_robot_state-parked0": 0.00998501698176066, "sim_compute_robot_state-parked1": 0.010373610655466716, "sim_compute_robot_state-parked2": 0.010056122144063314, "sim_compute_robot_state-parked3": 0.010063931941986085, "sim_compute_robot_state-parked4": 0.01024113098780314, "sim_compute_robot_state-parked5": 0.010090364615122476}, "udem1-0-1-ego2": {"driven_any": 1.9395155292948656, "get_ui_image": 0.13639295021692913, "step_physics": 0.7716024025281271, "survival_time": 14.950000000000076, "driven_lanedir": 0.5986525334558506, "get_state_dump": 0.04893997987111409, "sim_render-ego0": 0.008098531564076741, "sim_render-ego1": 0.0076285394032796225, "sim_render-ego2": 0.00743123451868693, "in-drivable-lane": 8.850000000000055, "deviation-heading": 2.805170721078756, "agent_compute-ego0": 0.06878569761912028, "agent_compute-ego1": 0.06719950993855794, "agent_compute-ego2": 0.06552256425221761, "complete-iteration": 1.3831075541178386, "set_robot_commands": 0.006496942043304444, "deviation-center-line": 0.4024543095078622, "driven_lanedir_consec": 0.5986525334558506, "sim_compute_sim_state": 0.0725371249516805, "sim_compute_performance-ego0": 0.006066722869873047, "sim_compute_performance-ego1": 0.006090805530548095, "sim_compute_performance-ego2": 0.005899879137674967, "sim_compute_robot_state-ego0": 0.010275696913401286, "sim_compute_robot_state-ego1": 0.010098755359649658, "sim_compute_robot_state-ego2": 0.010082263151804606, "sim_compute_robot_state-parked0": 0.00998501698176066, "sim_compute_robot_state-parked1": 0.010373610655466716, "sim_compute_robot_state-parked2": 0.010056122144063314, "sim_compute_robot_state-parked3": 0.010063931941986085, "sim_compute_robot_state-parked4": 0.01024113098780314, "sim_compute_robot_state-parked5": 0.010090364615122476}}
set_robot_commands_max0.006496942043304444
set_robot_commands_mean0.006344489286194986
set_robot_commands_median0.006344489286194986
set_robot_commands_min0.0061920365290855294
sim_compute_performance-ego0_max0.006145662336207148
sim_compute_performance-ego0_mean0.006106192603040097
sim_compute_performance-ego0_median0.006106192603040097
sim_compute_performance-ego0_min0.006066722869873047
sim_compute_performance-ego1_max0.006090805530548095
sim_compute_performance-ego1_mean0.005943388600847615
sim_compute_performance-ego1_median0.005943388600847614
sim_compute_performance-ego1_min0.005795971671147133
sim_compute_performance-ego2_max0.005899879137674967
sim_compute_performance-ego2_mean0.005864285544969548
sim_compute_performance-ego2_median0.005864285544969549
sim_compute_performance-ego2_min0.005828691952264131
sim_compute_robot_state-ego0_max0.010275696913401286
sim_compute_robot_state-ego0_mean0.010137615945208725
sim_compute_robot_state-ego0_median0.010137615945208726
sim_compute_robot_state-ego0_min0.009999534977016163
sim_compute_robot_state-ego1_max0.010098755359649658
sim_compute_robot_state-ego1_mean0.0098104303452506
sim_compute_robot_state-ego1_median0.0098104303452506
sim_compute_robot_state-ego1_min0.00952210533085154
sim_compute_robot_state-ego2_max0.010082263151804606
sim_compute_robot_state-ego2_mean0.009858244633793235
sim_compute_robot_state-ego2_median0.00985824463379324
sim_compute_robot_state-ego2_min0.00963422611578187
sim_compute_robot_state-parked0_max0.010052643605132602
sim_compute_robot_state-parked0_mean0.01001883029344663
sim_compute_robot_state-parked0_median0.010018830293446633
sim_compute_robot_state-parked0_min0.00998501698176066
sim_compute_robot_state-parked1_max0.010373610655466716
sim_compute_robot_state-parked1_mean0.010012407154586183
sim_compute_robot_state-parked1_median0.010012407154586183
sim_compute_robot_state-parked1_min0.009651203653705654
sim_compute_robot_state-parked2_max0.010293951675073423
sim_compute_robot_state-parked2_mean0.01017503690956837
sim_compute_robot_state-parked2_median0.01017503690956837
sim_compute_robot_state-parked2_min0.010056122144063314
sim_compute_robot_state-parked3_max0.010343240268194854
sim_compute_robot_state-parked3_mean0.01020358610509047
sim_compute_robot_state-parked3_median0.010203586105090468
sim_compute_robot_state-parked3_min0.010063931941986085
sim_compute_robot_state-parked4_max0.01024113098780314
sim_compute_robot_state-parked4_mean0.009995522635493113
sim_compute_robot_state-parked4_median0.009995522635493113
sim_compute_robot_state-parked4_min0.009749914283183085
sim_compute_robot_state-parked5_max0.010090364615122476
sim_compute_robot_state-parked5_mean0.009999963412830487
sim_compute_robot_state-parked5_median0.009999963412830486
sim_compute_robot_state-parked5_min0.009909562210538497
sim_compute_sim_state_max0.07641846920127299
sim_compute_sim_state_mean0.07447779707647675
sim_compute_sim_state_median0.07447779707647675
sim_compute_sim_state_min0.0725371249516805
sim_render-ego0_max0.00811510655417371
sim_render-ego0_mean0.008106819059125227
sim_render-ego0_median0.008106819059125227
sim_render-ego0_min0.008098531564076741
sim_render-ego1_max0.007687504611798187
sim_render-ego1_mean0.007658022007538905
sim_render-ego1_median0.007658022007538905
sim_render-ego1_min0.0076285394032796225
sim_render-ego2_max0.00743123451868693
sim_render-ego2_mean0.007209001898172483
sim_render-ego2_median0.007209001898172483
sim_render-ego2_min0.006986769277658036
simulation-passed1
step_physics_max0.9279810350332688
step_physics_mean0.8497917187806978
step_physics_median0.8497917187806978
step_physics_min0.7716024025281271
survival_time_max14.950000000000076
survival_time_mean10.82500000000003
survival_time_min6.699999999999984

Highlights

34369

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.