Duckietown Challenges Home Challenges Submissions

Job 33259

Job ID33259
submission6753
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:06:21
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7357701127040245
survival_time_median2.6249999999999987
deviation-center-line_median0.12079370155727932
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11285976966222128
agent_compute-ego0_mean0.1111823989285363
agent_compute-ego0_median0.11118239892853632
agent_compute-ego0_min0.10950502819485136
agent_compute-ego1_max0.1145607034365336
agent_compute-ego1_mean0.11169147690137228
agent_compute-ego1_median0.11169147690137228
agent_compute-ego1_min0.10882225036621092
agent_compute-ego2_max0.11142793099085488
agent_compute-ego2_mean0.10940504007869296
agent_compute-ego2_median0.10940504007869296
agent_compute-ego2_min0.10738214916653104
complete-iteration_max1.3348926146825155
complete-iteration_mean1.331590153111352
complete-iteration_median1.331590153111352
complete-iteration_min1.3282876915401882
deviation-center-line_max0.2646673768731106
deviation-center-line_mean0.14579002955437834
deviation-center-line_min0.042585621718128394
deviation-heading_max0.9252490988483189
deviation-heading_mean0.41714142475344507
deviation-heading_median0.35069688595746307
deviation-heading_min0.17534142528065275
driven_any_max1.1014237584274726
driven_any_mean0.8274783454524403
driven_any_median0.800208706905346
driven_any_min0.5388786365262782
driven_lanedir_consec_max0.9793582805382548
driven_lanedir_consec_mean0.7376999574121097
driven_lanedir_consec_min0.5357136234324127
driven_lanedir_max1.0938509378522343
driven_lanedir_mean0.8082592114925758
driven_lanedir_median0.7564021506844709
driven_lanedir_min0.5357136234324127
get_state_dump_max0.0477410078048706
get_state_dump_mean0.047520781887902146
get_state_dump_median0.04752078188790215
get_state_dump_min0.0473005559709337
get_ui_image_max0.1017901102701823
get_ui_image_mean0.1009909709294637
get_ui_image_median0.10099097092946371
get_ui_image_min0.10019183158874512
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.8101036662139999, "get_ui_image": 0.1017901102701823, "step_physics": 0.5759799003601074, "survival_time": 2.9999999999999973, "driven_lanedir": 0.7528032373594171, "get_state_dump": 0.0477410078048706, "sim_render-ego0": 0.007822370529174805, "sim_render-ego1": 0.007608326276143392, "sim_render-ego2": 0.007820324103037516, "in-drivable-lane": 0.0, "deviation-heading": 0.9252490988483189, "agent_compute-ego0": 0.11285976966222128, "agent_compute-ego1": 0.1145607034365336, "agent_compute-ego2": 0.11142793099085488, "complete-iteration": 1.3348926146825155, "set_robot_commands": 0.0072058161099751794, "deviation-center-line": 0.2646673768731106, "driven_lanedir_consec": 0.7528032373594171, "sim_compute_sim_state": 0.10584549903869628, "sim_compute_performance-ego0": 0.006932274500528971, "sim_compute_performance-ego1": 0.006275077660878499, "sim_compute_performance-ego2": 0.006439093748728434, "sim_compute_robot_state-ego0": 0.011338647206624348, "sim_compute_robot_state-ego1": 0.010910487174987792, "sim_compute_robot_state-ego2": 0.01147018273671468, "sim_compute_robot_state-parked0": 0.011468776067097982, "sim_compute_robot_state-parked1": 0.011192238330841065, "sim_compute_robot_state-parked2": 0.011149772008260093, "sim_compute_robot_state-parked3": 0.011083547274271648, "sim_compute_robot_state-parked4": 0.01030863126118978, "sim_compute_robot_state-parked5": 0.010597594579060872}, "udem1-0-0-ego1": {"driven_any": 0.9916077087008708, "get_ui_image": 0.1017901102701823, "step_physics": 0.5759799003601074, "survival_time": 2.9999999999999973, "driven_lanedir": 0.9793582805382548, "get_state_dump": 0.0477410078048706, "sim_render-ego0": 0.007822370529174805, "sim_render-ego1": 0.007608326276143392, "sim_render-ego2": 0.007820324103037516, "in-drivable-lane": 0.0, "deviation-heading": 0.3789901599693678, "agent_compute-ego0": 0.11285976966222128, "agent_compute-ego1": 0.1145607034365336, "agent_compute-ego2": 0.11142793099085488, "complete-iteration": 1.3348926146825155, "set_robot_commands": 0.0072058161099751794, "deviation-center-line": 0.2435808578237747, "driven_lanedir_consec": 0.9793582805382548, "sim_compute_sim_state": 0.10584549903869628, "sim_compute_performance-ego0": 0.006932274500528971, "sim_compute_performance-ego1": 0.006275077660878499, "sim_compute_performance-ego2": 0.006439093748728434, "sim_compute_robot_state-ego0": 0.011338647206624348, "sim_compute_robot_state-ego1": 0.010910487174987792, "sim_compute_robot_state-ego2": 0.01147018273671468, "sim_compute_robot_state-parked0": 0.011468776067097982, "sim_compute_robot_state-parked1": 0.011192238330841065, "sim_compute_robot_state-parked2": 0.011149772008260093, "sim_compute_robot_state-parked3": 0.011083547274271648, "sim_compute_robot_state-parked4": 0.01030863126118978, "sim_compute_robot_state-parked5": 0.010597594579060872}, "udem1-0-0-ego2": {"driven_any": 1.1014237584274726, "get_ui_image": 0.1017901102701823, "step_physics": 0.5759799003601074, "survival_time": 2.9999999999999973, "driven_lanedir": 1.0938509378522343, "get_state_dump": 0.0477410078048706, "sim_render-ego0": 0.007822370529174805, "sim_render-ego1": 0.007608326276143392, "sim_render-ego2": 0.007820324103037516, "in-drivable-lane": 0.0, "deviation-heading": 0.3224036119455584, "agent_compute-ego0": 0.11285976966222128, "agent_compute-ego1": 0.1145607034365336, "agent_compute-ego2": 0.11142793099085488, "complete-iteration": 1.3348926146825155, "set_robot_commands": 0.0072058161099751794, "deviation-center-line": 0.1050944101253238, "driven_lanedir_consec": 0.6867843777345245, "sim_compute_sim_state": 0.10584549903869628, "sim_compute_performance-ego0": 0.006932274500528971, "sim_compute_performance-ego1": 0.006275077660878499, "sim_compute_performance-ego2": 0.006439093748728434, "sim_compute_robot_state-ego0": 0.011338647206624348, "sim_compute_robot_state-ego1": 0.010910487174987792, "sim_compute_robot_state-ego2": 0.01147018273671468, "sim_compute_robot_state-parked0": 0.011468776067097982, "sim_compute_robot_state-parked1": 0.011192238330841065, "sim_compute_robot_state-parked2": 0.011149772008260093, "sim_compute_robot_state-parked3": 0.011083547274271648, "sim_compute_robot_state-parked4": 0.01030863126118978, "sim_compute_robot_state-parked5": 0.010597594579060872}, "udem1-0-1-ego0": {"driven_any": 0.5388786365262782, "get_ui_image": 0.10019183158874512, "step_physics": 0.5901872528923883, "survival_time": 2.25, "driven_lanedir": 0.5357136234324127, "get_state_dump": 0.0473005559709337, "sim_render-ego0": 0.0073999034033881295, "sim_render-ego1": 0.007563230726453993, "sim_render-ego2": 0.007124174965752496, "in-drivable-lane": 0.0, "deviation-heading": 0.21836815061992348, "agent_compute-ego0": 0.10950502819485136, "agent_compute-ego1": 0.10882225036621092, "agent_compute-ego2": 0.10738214916653104, "complete-iteration": 1.3282876915401882, "set_robot_commands": 0.0068209860059950085, "deviation-center-line": 0.1364929929892348, "driven_lanedir_consec": 0.5357136234324127, "sim_compute_sim_state": 0.10547466807895237, "sim_compute_performance-ego0": 0.006497351328531901, "sim_compute_performance-ego1": 0.006389252344767253, "sim_compute_performance-ego2": 0.006178161833021376, "sim_compute_robot_state-ego0": 0.011362165874905057, "sim_compute_robot_state-ego1": 0.010938877529568142, "sim_compute_robot_state-ego2": 0.010995817184448245, "sim_compute_robot_state-parked0": 0.011353688769870337, "sim_compute_robot_state-parked1": 0.01054321395026313, "sim_compute_robot_state-parked2": 0.010512219534979926, "sim_compute_robot_state-parked3": 0.010449547237820095, "sim_compute_robot_state-parked4": 0.010625531938340928, "sim_compute_robot_state-parked5": 0.010467057757907443}, "udem1-0-1-ego1": {"driven_any": 0.7325425552493282, "get_ui_image": 0.10019183158874512, "step_physics": 0.5901872528923883, "survival_time": 2.25, "driven_lanedir": 0.7278281257636117, "get_state_dump": 0.0473005559709337, "sim_render-ego0": 0.0073999034033881295, "sim_render-ego1": 0.007563230726453993, "sim_render-ego2": 0.007124174965752496, "in-drivable-lane": 0.0, "deviation-heading": 0.17534142528065275, "agent_compute-ego0": 0.10950502819485136, "agent_compute-ego1": 0.10882225036621092, "agent_compute-ego2": 0.10738214916653104, "complete-iteration": 1.3282876915401882, "set_robot_commands": 0.0068209860059950085, "deviation-center-line": 0.042585621718128394, "driven_lanedir_consec": 0.7278281257636117, "sim_compute_sim_state": 0.10547466807895237, "sim_compute_performance-ego0": 0.006497351328531901, "sim_compute_performance-ego1": 0.006389252344767253, "sim_compute_performance-ego2": 0.006178161833021376, "sim_compute_robot_state-ego0": 0.011362165874905057, "sim_compute_robot_state-ego1": 0.010938877529568142, "sim_compute_robot_state-ego2": 0.010995817184448245, "sim_compute_robot_state-parked0": 0.011353688769870337, "sim_compute_robot_state-parked1": 0.01054321395026313, "sim_compute_robot_state-parked2": 0.010512219534979926, "sim_compute_robot_state-parked3": 0.010449547237820095, "sim_compute_robot_state-parked4": 0.010625531938340928, "sim_compute_robot_state-parked5": 0.010467057757907443}, "udem1-0-1-ego2": {"driven_any": 0.790313747596692, "get_ui_image": 0.10019183158874512, "step_physics": 0.5901872528923883, "survival_time": 2.25, "driven_lanedir": 0.7600010640095247, "get_state_dump": 0.0473005559709337, "sim_render-ego0": 0.0073999034033881295, "sim_render-ego1": 0.007563230726453993, "sim_render-ego2": 0.007124174965752496, "in-drivable-lane": 0.0, "deviation-heading": 0.4824961018568489, "agent_compute-ego0": 0.10950502819485136, "agent_compute-ego1": 0.10882225036621092, "agent_compute-ego2": 0.10738214916653104, "complete-iteration": 1.3282876915401882, "set_robot_commands": 0.0068209860059950085, "deviation-center-line": 0.0823189177966977, "driven_lanedir_consec": 0.7437120996444373, "sim_compute_sim_state": 0.10547466807895237, "sim_compute_performance-ego0": 0.006497351328531901, "sim_compute_performance-ego1": 0.006389252344767253, "sim_compute_performance-ego2": 0.006178161833021376, "sim_compute_robot_state-ego0": 0.011362165874905057, "sim_compute_robot_state-ego1": 0.010938877529568142, "sim_compute_robot_state-ego2": 0.010995817184448245, "sim_compute_robot_state-parked0": 0.011353688769870337, "sim_compute_robot_state-parked1": 0.01054321395026313, "sim_compute_robot_state-parked2": 0.010512219534979926, "sim_compute_robot_state-parked3": 0.010449547237820095, "sim_compute_robot_state-parked4": 0.010625531938340928, "sim_compute_robot_state-parked5": 0.010467057757907443}}
set_robot_commands_max0.0072058161099751794
set_robot_commands_mean0.007013401057985095
set_robot_commands_median0.007013401057985094
set_robot_commands_min0.0068209860059950085
sim_compute_performance-ego0_max0.006932274500528971
sim_compute_performance-ego0_mean0.0067148129145304354
sim_compute_performance-ego0_median0.006714812914530436
sim_compute_performance-ego0_min0.006497351328531901
sim_compute_performance-ego1_max0.006389252344767253
sim_compute_performance-ego1_mean0.006332165002822877
sim_compute_performance-ego1_median0.006332165002822876
sim_compute_performance-ego1_min0.006275077660878499
sim_compute_performance-ego2_max0.006439093748728434
sim_compute_performance-ego2_mean0.006308627790874904
sim_compute_performance-ego2_median0.006308627790874904
sim_compute_performance-ego2_min0.006178161833021376
sim_compute_robot_state-ego0_max0.011362165874905057
sim_compute_robot_state-ego0_mean0.011350406540764702
sim_compute_robot_state-ego0_median0.011350406540764702
sim_compute_robot_state-ego0_min0.011338647206624348
sim_compute_robot_state-ego1_max0.010938877529568142
sim_compute_robot_state-ego1_mean0.010924682352277969
sim_compute_robot_state-ego1_median0.010924682352277969
sim_compute_robot_state-ego1_min0.010910487174987792
sim_compute_robot_state-ego2_max0.01147018273671468
sim_compute_robot_state-ego2_mean0.01123299996058146
sim_compute_robot_state-ego2_median0.011232999960581462
sim_compute_robot_state-ego2_min0.010995817184448245
sim_compute_robot_state-parked0_max0.011468776067097982
sim_compute_robot_state-parked0_mean0.011411232418484156
sim_compute_robot_state-parked0_median0.011411232418484156
sim_compute_robot_state-parked0_min0.011353688769870337
sim_compute_robot_state-parked1_max0.011192238330841065
sim_compute_robot_state-parked1_mean0.010867726140552095
sim_compute_robot_state-parked1_median0.010867726140552095
sim_compute_robot_state-parked1_min0.01054321395026313
sim_compute_robot_state-parked2_max0.011149772008260093
sim_compute_robot_state-parked2_mean0.010830995771620009
sim_compute_robot_state-parked2_median0.010830995771620009
sim_compute_robot_state-parked2_min0.010512219534979926
sim_compute_robot_state-parked3_max0.011083547274271648
sim_compute_robot_state-parked3_mean0.010766547256045872
sim_compute_robot_state-parked3_median0.010766547256045872
sim_compute_robot_state-parked3_min0.010449547237820095
sim_compute_robot_state-parked4_max0.010625531938340928
sim_compute_robot_state-parked4_mean0.010467081599765352
sim_compute_robot_state-parked4_median0.010467081599765352
sim_compute_robot_state-parked4_min0.01030863126118978
sim_compute_robot_state-parked5_max0.010597594579060872
sim_compute_robot_state-parked5_mean0.01053232616848416
sim_compute_robot_state-parked5_median0.01053232616848416
sim_compute_robot_state-parked5_min0.010467057757907443
sim_compute_sim_state_max0.10584549903869628
sim_compute_sim_state_mean0.10566008355882432
sim_compute_sim_state_median0.10566008355882434
sim_compute_sim_state_min0.10547466807895237
sim_render-ego0_max0.007822370529174805
sim_render-ego0_mean0.007611136966281466
sim_render-ego0_median0.007611136966281467
sim_render-ego0_min0.0073999034033881295
sim_render-ego1_max0.007608326276143392
sim_render-ego1_mean0.007585778501298692
sim_render-ego1_median0.007585778501298693
sim_render-ego1_min0.007563230726453993
sim_render-ego2_max0.007820324103037516
sim_render-ego2_mean0.007472249534395007
sim_render-ego2_median0.007472249534395006
sim_render-ego2_min0.007124174965752496
simulation-passed1
step_physics_max0.5901872528923883
step_physics_mean0.5830835766262478
step_physics_median0.5830835766262479
step_physics_min0.5759799003601074
survival_time_max2.9999999999999973
survival_time_mean2.6249999999999987
survival_time_min2.25

Highlights

33259

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.