Duckietown Challenges Home Challenges Submissions

Job 58813

Job ID58813
submission12863
userKaiyi ChenΒ πŸ‡ΊπŸ‡Έ
user labelKK Net
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration1:39:28
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.330915167904255
survival_time_median59.99999999999873
deviation-center-line_median1.4319331227830778
in-drivable-lane_median13.549999999999407


other stats
agent_compute-ego0_max0.03454644435847629
agent_compute-ego0_mean0.03325573381425747
agent_compute-ego0_median0.03352657285558493
agent_compute-ego0_min0.032141276377781185
agent_compute-ego1_max0.03825162101712861
agent_compute-ego1_mean0.03441307108804999
agent_compute-ego1_median0.03329914912494593
agent_compute-ego1_min0.031219734507761183
agent_compute-ego2_max0.03386652003120721
agent_compute-ego2_mean0.03280047507306818
agent_compute-ego2_median0.032609989601408415
agent_compute-ego2_min0.031924915586588894
agent_compute-ego3_max0.03350755336580427
agent_compute-ego3_mean0.03257259520638991
agent_compute-ego3_median0.03228747675956834
agent_compute-ego3_min0.03192275549379712
complete-iteration_max1.0305501938263244
complete-iteration_mean0.8304467982849061
complete-iteration_median0.9395789607776194
complete-iteration_min0.30435621146183867
deviation-center-line_max2.7886387936453687
deviation-center-line_mean1.4995742848276854
deviation-center-line_min0.3986212695339228
deviation-heading_max13.70039019308038
deviation-heading_mean7.147254961315099
deviation-heading_median6.011305324980524
deviation-heading_min2.4532959752511188
driven_any_max14.591453149065298
driven_any_mean8.995016236079156
driven_any_median8.807216025907337
driven_any_min4.08690267050939
driven_lanedir_consec_max12.467451682760174
driven_lanedir_consec_mean6.873141084262841
driven_lanedir_consec_min1.0685930834874322
driven_lanedir_max12.467451682760174
driven_lanedir_mean7.074419414464197
driven_lanedir_median7.75519687645312
driven_lanedir_min1.0685930834874322
get_duckie_state_max1.3534869877722342e-06
get_duckie_state_mean1.2640798835896347e-06
get_duckie_state_median1.261333198165348e-06
get_duckie_state_min1.1747809732036226e-06
get_robot_state_max0.014209031860199102
get_robot_state_mean0.013016943417049568
get_robot_state_median0.013937814723439142
get_robot_state_min0.00704468283683631
get_state_dump_max0.009568512390098604
get_state_dump_mean0.008971734475452608
get_state_dump_median0.009432670896145409
get_state_dump_min0.006123386978343794
get_ui_image_max0.04936475956271233
get_ui_image_mean0.04383236873167207
get_ui_image_median0.046726682402509934
get_ui_image_min0.02964411814501331
in-drivable-lane_max54.24999999999872
in-drivable-lane_mean18.860714285713765
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 4.08690267050939, "get_ui_image": 0.04249978952312333, "step_physics": 0.5264194496029265, "survival_time": 34.900000000000155, "driven_lanedir": 3.187290211183171, "get_state_dump": 0.009432670896145409, "get_robot_state": 0.013937814723439142, "sim_render-ego0": 0.003655598740038783, "sim_render-ego1": 0.003655706864058204, "sim_render-ego2": 0.0036492463686264975, "sim_render-ego3": 0.00362028618568344, "get_duckie_state": 1.261333198165348e-06, "in-drivable-lane": 21.050000000000093, "deviation-heading": 2.4532959752511188, "agent_compute-ego0": 0.03225141294694936, "agent_compute-ego1": 0.03825162101712861, "agent_compute-ego2": 0.031924915586588894, "agent_compute-ego3": 0.03192275549379712, "complete-iteration": 0.7842565336623076, "set_robot_commands": 0.0020890385978382204, "deviation-center-line": 0.5465248053759569, "driven_lanedir_consec": 3.187290211183171, "sim_compute_sim_state": 0.026608515536154117, "sim_compute_performance-ego0": 0.0019201359182638843, "sim_compute_performance-ego1": 0.00192711520433767, "sim_compute_performance-ego2": 0.0019247190805634375, "sim_compute_performance-ego3": 0.001889636417656327}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 6.361486409559513, "get_ui_image": 0.04249978952312333, "step_physics": 0.5264194496029265, "survival_time": 34.900000000000155, "driven_lanedir": 5.617251464384097, "get_state_dump": 0.009432670896145409, "get_robot_state": 0.013937814723439142, "sim_render-ego0": 0.003655598740038783, "sim_render-ego1": 0.003655706864058204, "sim_render-ego2": 0.0036492463686264975, "sim_render-ego3": 0.00362028618568344, "get_duckie_state": 1.261333198165348e-06, "in-drivable-lane": 10.899999999999949, "deviation-heading": 3.8969614211789905, "agent_compute-ego0": 0.03225141294694936, "agent_compute-ego1": 0.03825162101712861, "agent_compute-ego2": 0.031924915586588894, "agent_compute-ego3": 0.03192275549379712, "complete-iteration": 0.7842565336623076, "set_robot_commands": 0.0020890385978382204, "deviation-center-line": 0.9305678567281928, "driven_lanedir_consec": 5.616230785708858, "sim_compute_sim_state": 0.026608515536154117, "sim_compute_performance-ego0": 0.0019201359182638843, "sim_compute_performance-ego1": 0.00192711520433767, "sim_compute_performance-ego2": 0.0019247190805634375, "sim_compute_performance-ego3": 0.001889636417656327}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.281372238418186, "get_ui_image": 0.04249978952312333, "step_physics": 0.5264194496029265, "survival_time": 34.900000000000155, "driven_lanedir": 6.992582246354919, "get_state_dump": 0.009432670896145409, "get_robot_state": 0.013937814723439142, "sim_render-ego0": 0.003655598740038783, "sim_render-ego1": 0.003655706864058204, "sim_render-ego2": 0.0036492463686264975, "sim_render-ego3": 0.00362028618568344, "get_duckie_state": 1.261333198165348e-06, "in-drivable-lane": 4.699999999999963, "deviation-heading": 6.32089359076711, "agent_compute-ego0": 0.03225141294694936, "agent_compute-ego1": 0.03825162101712861, "agent_compute-ego2": 0.031924915586588894, "agent_compute-ego3": 0.03192275549379712, "complete-iteration": 0.7842565336623076, "set_robot_commands": 0.0020890385978382204, "deviation-center-line": 1.4246449383337243, "driven_lanedir_consec": 6.992582246354919, "sim_compute_sim_state": 0.026608515536154117, "sim_compute_performance-ego0": 0.0019201359182638843, "sim_compute_performance-ego1": 0.00192711520433767, "sim_compute_performance-ego2": 0.0019247190805634375, "sim_compute_performance-ego3": 0.001889636417656327}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.28144743224194, "get_ui_image": 0.04249978952312333, "step_physics": 0.5264194496029265, "survival_time": 34.900000000000155, "driven_lanedir": 8.190995850849895, "get_state_dump": 0.009432670896145409, "get_robot_state": 0.013937814723439142, "sim_render-ego0": 0.003655598740038783, "sim_render-ego1": 0.003655706864058204, "sim_render-ego2": 0.0036492463686264975, "sim_render-ego3": 0.00362028618568344, "get_duckie_state": 1.261333198165348e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.93830235160684, "agent_compute-ego0": 0.03225141294694936, "agent_compute-ego1": 0.03825162101712861, "agent_compute-ego2": 0.031924915586588894, "agent_compute-ego3": 0.03192275549379712, "complete-iteration": 0.7842565336623076, "set_robot_commands": 0.0020890385978382204, "deviation-center-line": 1.0807959978953623, "driven_lanedir_consec": 8.190995850849895, "sim_compute_sim_state": 0.026608515536154117, "sim_compute_performance-ego0": 0.0019201359182638843, "sim_compute_performance-ego1": 0.00192711520433767, "sim_compute_performance-ego2": 0.0019247190805634375, "sim_compute_performance-ego3": 0.001889636417656327}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 12.989472337788218, "get_ui_image": 0.04936475956271233, "step_physics": 0.7578907945968031, "survival_time": 59.99999999999873, "driven_lanedir": 10.601175664705938, "get_state_dump": 0.009338193888668215, "get_robot_state": 0.013890113957617106, "sim_render-ego0": 0.003662439111269682, "sim_render-ego1": 0.003615467871952613, "sim_render-ego2": 0.003674869037091385, "sim_render-ego3": 0.0036311626037292734, "get_duckie_state": 1.2220689200243287e-06, "in-drivable-lane": 13.99999999999944, "deviation-heading": 10.924006409152923, "agent_compute-ego0": 0.03454644435847629, "agent_compute-ego1": 0.03329914912494593, "agent_compute-ego2": 0.03386652003120721, "agent_compute-ego3": 0.03350755336580427, "complete-iteration": 1.0305501938263244, "set_robot_commands": 0.002181538137964762, "deviation-center-line": 2.280073717908943, "driven_lanedir_consec": 10.601175664705938, "sim_compute_sim_state": 0.033934267236231566, "sim_compute_performance-ego0": 0.0019044344073826825, "sim_compute_performance-ego1": 0.0018892371585029649, "sim_compute_performance-ego2": 0.0018839746788082072, "sim_compute_performance-ego3": 0.001909470578018176}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 14.591406134807366, "get_ui_image": 0.04936475956271233, "step_physics": 0.7578907945968031, "survival_time": 59.99999999999873, "driven_lanedir": 12.467451682760174, "get_state_dump": 0.009338193888668215, "get_robot_state": 0.013890113957617106, "sim_render-ego0": 0.003662439111269682, "sim_render-ego1": 0.003615467871952613, "sim_render-ego2": 0.003674869037091385, "sim_render-ego3": 0.0036311626037292734, "get_duckie_state": 1.2220689200243287e-06, "in-drivable-lane": 5.949999999999859, "deviation-heading": 13.31777757440222, "agent_compute-ego0": 0.03454644435847629, "agent_compute-ego1": 0.03329914912494593, "agent_compute-ego2": 0.03386652003120721, "agent_compute-ego3": 0.03350755336580427, "complete-iteration": 1.0305501938263244, "set_robot_commands": 0.002181538137964762, "deviation-center-line": 2.7886387936453687, "driven_lanedir_consec": 12.467451682760174, "sim_compute_sim_state": 0.033934267236231566, "sim_compute_performance-ego0": 0.0019044344073826825, "sim_compute_performance-ego1": 0.0018892371585029649, "sim_compute_performance-ego2": 0.0018839746788082072, "sim_compute_performance-ego3": 0.001909470578018176}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 5.737761338860572, "get_ui_image": 0.04936475956271233, "step_physics": 0.7578907945968031, "survival_time": 59.99999999999873, "driven_lanedir": 4.280122985915687, "get_state_dump": 0.009338193888668215, "get_robot_state": 0.013890113957617106, "sim_render-ego0": 0.003662439111269682, "sim_render-ego1": 0.003615467871952613, "sim_render-ego2": 0.003674869037091385, "sim_render-ego3": 0.0036311626037292734, "get_duckie_state": 1.2220689200243287e-06, "in-drivable-lane": 40.999999999998565, "deviation-heading": 4.691399824633196, "agent_compute-ego0": 0.03454644435847629, "agent_compute-ego1": 0.03329914912494593, "agent_compute-ego2": 0.03386652003120721, "agent_compute-ego3": 0.03350755336580427, "complete-iteration": 1.0305501938263244, "set_robot_commands": 0.002181538137964762, "deviation-center-line": 1.0816362143423237, "driven_lanedir_consec": 4.280122985915687, "sim_compute_sim_state": 0.033934267236231566, "sim_compute_performance-ego0": 0.0019044344073826825, "sim_compute_performance-ego1": 0.0018892371585029649, "sim_compute_performance-ego2": 0.0018839746788082072, "sim_compute_performance-ego3": 0.001909470578018176}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 5.162998790942284, "get_ui_image": 0.04936475956271233, "step_physics": 0.7578907945968031, "survival_time": 59.99999999999873, "driven_lanedir": 1.0685930834874322, "get_state_dump": 0.009338193888668215, "get_robot_state": 0.013890113957617106, "sim_render-ego0": 0.003662439111269682, "sim_render-ego1": 0.003615467871952613, "sim_render-ego2": 0.003674869037091385, "sim_render-ego3": 0.0036311626037292734, "get_duckie_state": 1.2220689200243287e-06, "in-drivable-lane": 54.24999999999872, "deviation-heading": 2.8312922222442456, "agent_compute-ego0": 0.03454644435847629, "agent_compute-ego1": 0.03329914912494593, "agent_compute-ego2": 0.03386652003120721, "agent_compute-ego3": 0.03350755336580427, "complete-iteration": 1.0305501938263244, "set_robot_commands": 0.002181538137964762, "deviation-center-line": 0.3986212695339228, "driven_lanedir_consec": 1.0685930834874322, "sim_compute_sim_state": 0.033934267236231566, "sim_compute_performance-ego0": 0.0019044344073826825, "sim_compute_performance-ego1": 0.0018892371585029649, "sim_compute_performance-ego2": 0.0018839746788082072, "sim_compute_performance-ego3": 0.001909470578018176}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.32358941420936, "get_ui_image": 0.046726682402509934, "step_physics": 0.6717381985558757, "survival_time": 59.99999999999873, "driven_lanedir": 7.84114566345265, "get_state_dump": 0.009568512390098604, "get_robot_state": 0.014209031860199102, "sim_render-ego0": 0.003805287970194313, "sim_render-ego1": 0.003891105953600881, "sim_render-ego2": 0.003779063911660327, "sim_render-ego3": 0.0036893270097108407, "get_duckie_state": 1.3534869877722342e-06, "in-drivable-lane": 25.749999999998774, "deviation-heading": 7.834499827898537, "agent_compute-ego0": 0.03352657285558493, "agent_compute-ego1": 0.03328511141221986, "agent_compute-ego2": 0.032609989601408415, "agent_compute-ego3": 0.03228747675956834, "complete-iteration": 0.9395789607776194, "set_robot_commands": 0.002209121837504798, "deviation-center-line": 1.4891007555966824, "driven_lanedir_consec": 7.832960254981366, "sim_compute_sim_state": 0.03317341796563726, "sim_compute_performance-ego0": 0.0020192642196032724, "sim_compute_performance-ego1": 0.0020112260791483173, "sim_compute_performance-ego2": 0.0020503608709965815, "sim_compute_performance-ego3": 0.0019656823735550778}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 4.148039842381711, "get_ui_image": 0.046726682402509934, "step_physics": 0.6717381985558757, "survival_time": 59.99999999999873, "driven_lanedir": 2.499767096641544, "get_state_dump": 0.009568512390098604, "get_robot_state": 0.014209031860199102, "sim_render-ego0": 0.003805287970194313, "sim_render-ego1": 0.003891105953600881, "sim_render-ego2": 0.003779063911660327, "sim_render-ego3": 0.0036893270097108407, "get_duckie_state": 1.3534869877722342e-06, "in-drivable-lane": 48.44999999999867, "deviation-heading": 3.3670363458123296, "agent_compute-ego0": 0.03352657285558493, "agent_compute-ego1": 0.03328511141221986, "agent_compute-ego2": 0.032609989601408415, "agent_compute-ego3": 0.03228747675956834, "complete-iteration": 0.9395789607776194, "set_robot_commands": 0.002209121837504798, "deviation-center-line": 0.657778121293173, "driven_lanedir_consec": 2.499767096641544, "sim_compute_sim_state": 0.03317341796563726, "sim_compute_performance-ego0": 0.0020192642196032724, "sim_compute_performance-ego1": 0.0020112260791483173, "sim_compute_performance-ego2": 0.0020503608709965815, "sim_compute_performance-ego3": 0.0019656823735550778}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 14.591453149065298, "get_ui_image": 0.046726682402509934, "step_physics": 0.6717381985558757, "survival_time": 59.99999999999873, "driven_lanedir": 8.519445494311064, "get_state_dump": 0.009568512390098604, "get_robot_state": 0.014209031860199102, "sim_render-ego0": 0.003805287970194313, "sim_render-ego1": 0.003891105953600881, "sim_render-ego2": 0.003779063911660327, "sim_render-ego3": 0.0036893270097108407, "get_duckie_state": 1.3534869877722342e-06, "in-drivable-lane": 20.199999999999328, "deviation-heading": 13.70039019308038, "agent_compute-ego0": 0.03352657285558493, "agent_compute-ego1": 0.03328511141221986, "agent_compute-ego2": 0.032609989601408415, "agent_compute-ego3": 0.03228747675956834, "complete-iteration": 0.9395789607776194, "set_robot_commands": 0.002209121837504798, "deviation-center-line": 2.4503081746533044, "driven_lanedir_consec": 5.729104848006655, "sim_compute_sim_state": 0.03317341796563726, "sim_compute_performance-ego0": 0.0020192642196032724, "sim_compute_performance-ego1": 0.0020112260791483173, "sim_compute_performance-ego2": 0.0020503608709965815, "sim_compute_performance-ego3": 0.0019656823735550778}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.708261792812127, "get_ui_image": 0.046726682402509934, "step_physics": 0.6717381985558757, "survival_time": 59.99999999999873, "driven_lanedir": 10.912794597528928, "get_state_dump": 0.009568512390098604, "get_robot_state": 0.014209031860199102, "sim_render-ego0": 0.003805287970194313, "sim_render-ego1": 0.003891105953600881, "sim_render-ego2": 0.003779063911660327, "sim_render-ego3": 0.0036893270097108407, "get_duckie_state": 1.3534869877722342e-06, "in-drivable-lane": 13.099999999999376, "deviation-heading": 8.87948055013236, "agent_compute-ego0": 0.03352657285558493, "agent_compute-ego1": 0.03328511141221986, "agent_compute-ego2": 0.032609989601408415, "agent_compute-ego3": 0.03228747675956834, "complete-iteration": 0.9395789607776194, "set_robot_commands": 0.002209121837504798, "deviation-center-line": 1.9250979616807031, "driven_lanedir_consec": 10.89444470816088, "sim_compute_sim_state": 0.03317341796563726, "sim_compute_performance-ego0": 0.0020192642196032724, "sim_compute_performance-ego1": 0.0020112260791483173, "sim_compute_performance-ego2": 0.0020503608709965815, "sim_compute_performance-ego3": 0.0019656823735550778}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 9.333051133939476, "get_ui_image": 0.02964411814501331, "step_physics": 0.1728600975814139, "survival_time": 39.19999999999991, "driven_lanedir": 9.194007671469668, "get_state_dump": 0.006123386978343794, "get_robot_state": 0.00704468283683631, "sim_render-ego0": 0.003632716160670967, "sim_render-ego1": 0.003566470723243276, "get_duckie_state": 1.1747809732036226e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.701717059193938, "agent_compute-ego0": 0.032141276377781185, "agent_compute-ego1": 0.031219734507761183, "complete-iteration": 0.30435621146183867, "set_robot_commands": 0.002091783778682636, "deviation-center-line": 1.439221307232431, "driven_lanedir_consec": 9.194007671469668, "sim_compute_sim_state": 0.010078519772572122, "sim_compute_performance-ego0": 0.0018634774882322663, "sim_compute_performance-ego1": 0.0018831523360720104}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 9.332984619572732, "get_ui_image": 0.02964411814501331, "step_physics": 0.1728600975814139, "survival_time": 39.19999999999991, "driven_lanedir": 7.669248089453591, "get_state_dump": 0.006123386978343794, "get_robot_state": 0.00704468283683631, "sim_render-ego0": 0.003632716160670967, "sim_render-ego1": 0.003566470723243276, "get_duckie_state": 1.1747809732036226e-06, "in-drivable-lane": 4.699999999999988, "deviation-heading": 12.2045161130572, "agent_compute-ego0": 0.032141276377781185, "agent_compute-ego1": 0.031219734507761183, "complete-iteration": 0.30435621146183867, "set_robot_commands": 0.002091783778682636, "deviation-center-line": 2.5010300733675046, "driven_lanedir_consec": 7.669248089453591, "sim_compute_sim_state": 0.010078519772572122, "sim_compute_performance-ego0": 0.0018634774882322663, "sim_compute_performance-ego1": 0.0018831523360720104}}
set_robot_commands_max0.002209121837504798
set_robot_commands_mean0.002150168703614028
set_robot_commands_median0.002181538137964762
set_robot_commands_min0.0020890385978382204
sim_compute_performance-ego0_max0.0020192642196032724
sim_compute_performance-ego0_mean0.0019358780826759924
sim_compute_performance-ego0_median0.0019201359182638843
sim_compute_performance-ego0_min0.0018634774882322663
sim_compute_performance-ego1_max0.0020112260791483173
sim_compute_performance-ego1_mean0.001934044174292845
sim_compute_performance-ego1_median0.00192711520433767
sim_compute_performance-ego1_min0.0018831523360720104
sim_compute_performance-ego2_max0.0020503608709965815
sim_compute_performance-ego2_mean0.001953018210122742
sim_compute_performance-ego2_median0.0019247190805634375
sim_compute_performance-ego2_min0.0018839746788082072
sim_compute_performance-ego3_max0.0019656823735550778
sim_compute_performance-ego3_mean0.0019215964564098609
sim_compute_performance-ego3_median0.001909470578018176
sim_compute_performance-ego3_min0.001889636417656327
sim_compute_sim_state_max0.033934267236231566
sim_compute_sim_state_mean0.02821584589265972
sim_compute_sim_state_median0.03317341796563726
sim_compute_sim_state_min0.010078519772572122
sim_render-ego0_max0.003805287970194313
sim_render-ego0_mean0.00369705254338236
sim_render-ego0_median0.003662439111269682
sim_render-ego0_min0.003632716160670967
sim_render-ego1_max0.003891105953600881
sim_render-ego1_mean0.0036987188717809536
sim_render-ego1_median0.003655706864058204
sim_render-ego1_min0.003566470723243276
sim_render-ego2_max0.003779063911660327
sim_render-ego2_mean0.003701059772459404
sim_render-ego2_median0.003674869037091385
sim_render-ego2_min0.0036492463686264975
sim_render-ego3_max0.0036893270097108407
sim_render-ego3_mean0.0036469252663745184
sim_render-ego3_median0.0036311626037292734
sim_render-ego3_min0.00362028618568344
simulation-passed1
step_physics_max0.7578907945968031
step_physics_mean0.5835652832989462
step_physics_median0.6717381985558757
step_physics_min0.1728600975814139
survival_time_max59.99999999999873
survival_time_mean49.857142857142165
survival_time_min34.900000000000155

Highlights

58813

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.