Duckietown Challenges Home Challenges Submissions

Job 33219

Job ID33219
submission6707
userBea Baselines 🐤
user labelstraight
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:12:35
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6468539965646568
survival_time_median4.874999999999991
deviation-center-line_median0.3140120407422947
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03929322106497629
agent_compute-ego_mean0.03824845239267188
agent_compute-ego_median0.038064188518608606
agent_compute-ego_min0.037539047064240445
complete-iteration_max0.482677479179538
complete-iteration_mean0.45623255576325983
complete-iteration_median0.4545791261873645
complete-iteration_min0.4290536804632707
deviation-center-line_max0.3972243289598026
deviation-center-line_mean0.3057703533784745
deviation-center-line_min0.2063584830749243
deviation-heading_max2.0317977913198466
deviation-heading_mean1.0398021808032112
deviation-heading_median0.7843507289776401
deviation-heading_min0.5442280312830121
driven_any_max0.8306434336578873
driven_any_mean0.6066363606966733
driven_any_median0.7496893214183404
driven_any_min0.3082988362758285
driven_lanedir_consec_max0.8046228150716828
driven_lanedir_consec_mean0.556082354922922
driven_lanedir_consec_min0.29881004532623745
driven_lanedir_max0.8046228150716828
driven_lanedir_mean0.5629220220436338
driven_lanedir_median0.6585446975456014
driven_lanedir_min0.29881004532623745
get_state_dump_max0.039716950484684536
get_state_dump_mean0.03851219512183475
get_state_dump_median0.03899684025294925
get_state_dump_min0.03641935722115114
get_ui_image_max0.08436006474717755
get_ui_image_mean0.07998176804729742
get_ui_image_median0.07977540264225969
get_ui_image_min0.0772836370901628
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.7478014487211424, "get_ui_image": 0.08090310244216133, "step_physics": 0.18246450375035864, "survival_time": 4.849999999999991, "driven_lanedir": 0.6766318008772938, "get_state_dump": 0.03641935722115114, "sim_render-ego": 0.0075993242952012525, "in-drivable-lane": 0.0, "agent_compute-ego": 0.037539047064240445, "deviation-heading": 1.3516281792896734, "complete-iteration": 0.4755840719360666, "set_robot_commands": 0.007345359349988171, "deviation-center-line": 0.38492257857602347, "driven_lanedir_consec": 0.6513468578527846, "sim_compute_sim_state": 0.047702865502268994, "sim_compute_performance-ego": 0.006520841539520579, "sim_compute_robot_state-ego": 0.011753674634953136, "sim_compute_robot_state-npc0": 0.011607111114816568, "sim_compute_robot_state-npc1": 0.011217191047275189, "sim_compute_robot_state-npc2": 0.011483484936743667, "sim_compute_robot_state-npc3": 0.011348785813321771, "sim_compute_robot_state-parked0": 0.011355768773973604}, "udem1-0-1-ego": {"driven_any": 0.7515771941155386, "get_ui_image": 0.08125474258345, "step_physics": 0.184890374845388, "survival_time": 4.899999999999991, "driven_lanedir": 0.6742302336749346, "get_state_dump": 0.03688511799792854, "sim_render-ego": 0.008026470943373077, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03929322106497629, "deviation-heading": 1.4389736612840751, "complete-iteration": 0.482677479179538, "set_robot_commands": 0.007531222032040966, "deviation-center-line": 0.3972243289598026, "driven_lanedir_consec": 0.648852613771786, "sim_compute_sim_state": 0.04675844737461635, "sim_compute_performance-ego": 0.006809896352339764, "sim_compute_robot_state-ego": 0.012159174802351971, "sim_compute_robot_state-npc0": 0.011723182639297176, "sim_compute_robot_state-npc1": 0.011987795635145538, "sim_compute_robot_state-npc2": 0.0115776962163497, "sim_compute_robot_state-npc3": 0.011673956501240632, "sim_compute_robot_state-parked0": 0.01178225935721884}, "udem1-1-0-ego": {"driven_any": 0.8306434336578873, "get_ui_image": 0.08436006474717755, "step_physics": 0.16373765357186862, "survival_time": 5.349999999999989, "driven_lanedir": 0.8046228150716828, "get_state_dump": 0.03760378605851503, "sim_render-ego": 0.008232626959542248, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0381584991918546, "deviation-heading": 0.8687988156679041, "complete-iteration": 0.4599423586765182, "set_robot_commands": 0.007908843388067228, "deviation-center-line": 0.2063584830749243, "driven_lanedir_consec": 0.8046228150716828, "sim_compute_sim_state": 0.04089900934807608, "sim_compute_performance-ego": 0.006803690830123759, "sim_compute_robot_state-ego": 0.01223240166066963, "sim_compute_robot_state-npc0": 0.012325583217299986, "sim_compute_robot_state-npc1": 0.011522088095406504, "sim_compute_robot_state-npc2": 0.011935677483817127, "sim_compute_robot_state-npc3": 0.01193044564434301, "sim_compute_robot_state-parked0": 0.011927366256713867}, "udem1-1-1-ego": {"driven_any": 0.7822537947794993, "get_ui_image": 0.08031507057718712, "step_physics": 0.15661136466677827, "survival_time": 5.04999999999999, "driven_lanedir": 0.7619055397403779, "get_state_dump": 0.038775514848161455, "sim_render-ego": 0.008404375302909625, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03762340781712296, "deviation-heading": 0.6999026422873762, "complete-iteration": 0.44921589369821074, "set_robot_commands": 0.007647894396640286, "deviation-center-line": 0.2514073186364099, "driven_lanedir_consec": 0.7619055397403779, "sim_compute_sim_state": 0.03969185895258837, "sim_compute_performance-ego": 0.007108730844932028, "sim_compute_robot_state-ego": 0.012651403351585464, "sim_compute_robot_state-npc0": 0.011980800345392511, "sim_compute_robot_state-npc1": 0.01214317756124062, "sim_compute_robot_state-npc2": 0.011941182731401802, "sim_compute_robot_state-npc3": 0.011989277188140569, "sim_compute_robot_state-parked0": 0.01198842973992376}, "udem1-2-0-ego": {"driven_any": 0.40175648744283554, "get_ui_image": 0.07899171539715358, "step_physics": 0.171120285987854, "survival_time": 2.799999999999998, "driven_lanedir": 0.3939393582196631, "get_state_dump": 0.039716950484684536, "sim_render-ego": 0.007276794740131923, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03791436553001404, "deviation-heading": 0.5456015321326615, "complete-iteration": 0.4458336744989668, "set_robot_commands": 0.006567610161645072, "deviation-center-line": 0.30961827938479597, "driven_lanedir_consec": 0.3939393582196631, "sim_compute_sim_state": 0.03400963544845581, "sim_compute_performance-ego": 0.0061352550983428955, "sim_compute_robot_state-ego": 0.010147865329469954, "sim_compute_robot_state-npc0": 0.010626746075493947, "sim_compute_robot_state-npc1": 0.010985974754605974, "sim_compute_robot_state-npc2": 0.01063287683895656, "sim_compute_robot_state-npc3": 0.010738730430603027, "sim_compute_robot_state-parked0": 0.0106181800365448}, "udem1-2-1-ego": {"driven_any": 0.41052442104768067, "get_ui_image": 0.07904217117711117, "step_physics": 0.16998892081411263, "survival_time": 2.849999999999998, "driven_lanedir": 0.4028538643924746, "get_state_dump": 0.03924585643567537, "sim_render-ego": 0.007522009966666238, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03796987784536261, "deviation-heading": 0.5466812998450088, "complete-iteration": 0.44274116398995383, "set_robot_commands": 0.006839279542889511, "deviation-center-line": 0.3184058020997934, "driven_lanedir_consec": 0.4028538643924746, "sim_compute_sim_state": 0.032050559395237974, "sim_compute_performance-ego": 0.00615884546647992, "sim_compute_robot_state-ego": 0.01026681849831029, "sim_compute_robot_state-npc0": 0.01091346824378298, "sim_compute_robot_state-npc1": 0.010453717750415467, "sim_compute_robot_state-npc2": 0.01062572629828202, "sim_compute_robot_state-npc3": 0.010628650062962585, "sim_compute_robot_state-parked0": 0.010674853073923213}, "udem1-3-0-ego": {"driven_any": 0.7634890213450584, "get_ui_image": 0.0800680439881604, "step_physics": 0.17516042487789887, "survival_time": 4.94999999999999, "driven_lanedir": 0.6504246240467327, "get_state_dump": 0.039229961356731374, "sim_render-ego": 0.007727707275236496, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03896068322538125, "deviation-heading": 2.0317977913198466, "complete-iteration": 0.4660450978712602, "set_robot_commands": 0.006434811486138238, "deviation-center-line": 0.3519081554221302, "driven_lanedir_consec": 0.6448553793575276, "sim_compute_sim_state": 0.04678469474869545, "sim_compute_performance-ego": 0.006245646813903192, "sim_compute_robot_state-ego": 0.010596207898072522, "sim_compute_robot_state-npc0": 0.011175389241690589, "sim_compute_robot_state-npc1": 0.0107778443230523, "sim_compute_robot_state-npc2": 0.010800549478241892, "sim_compute_robot_state-npc3": 0.010903129673967456, "sim_compute_robot_state-parked0": 0.010818019057765152}, "udem1-3-1-ego": {"driven_any": 0.7616575664442786, "get_ui_image": 0.0781163711740513, "step_physics": 0.17299042807685006, "survival_time": 4.94999999999999, "driven_lanedir": 0.6666647710444701, "get_state_dump": 0.03934343655904134, "sim_render-ego": 0.008312047129929667, "in-drivable-lane": 0.0, "agent_compute-ego": 0.037732952772968946, "deviation-heading": 1.8200177623839324, "complete-iteration": 0.47266044038714783, "set_robot_commands": 0.008097831649009627, "deviation-center-line": 0.33234357124050284, "driven_lanedir_consec": 0.6544999074542139, "sim_compute_sim_state": 0.04619766004157789, "sim_compute_performance-ego": 0.0070335118457524465, "sim_compute_robot_state-ego": 0.012784218547320123, "sim_compute_robot_state-npc0": 0.012365160566387754, "sim_compute_robot_state-npc1": 0.012214877388694067, "sim_compute_robot_state-npc2": 0.012166020846126056, "sim_compute_robot_state-npc3": 0.01260545759490042, "sim_compute_robot_state-parked0": 0.012337540135239107}, "udem1-4-0-ego": {"driven_any": 0.3082988362758285, "get_ui_image": 0.0772836370901628, "step_physics": 0.14914910359816116, "survival_time": 2.2, "driven_lanedir": 0.29881004532623745, "get_state_dump": 0.03868380459872159, "sim_render-ego": 0.008674540302970192, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03856424309990623, "deviation-heading": 0.5503920925386224, "complete-iteration": 0.4385716969316656, "set_robot_commands": 0.008377465334805574, "deviation-center-line": 0.25234083448948735, "driven_lanedir_consec": 0.29881004532623745, "sim_compute_sim_state": 0.032400228760459206, "sim_compute_performance-ego": 0.007355646653608842, "sim_compute_robot_state-ego": 0.013604023239829325, "sim_compute_robot_state-npc0": 0.012974511493336073, "sim_compute_robot_state-npc1": 0.01291080496527932, "sim_compute_robot_state-npc2": 0.01290650801225142, "sim_compute_robot_state-npc3": 0.0128797401081432, "sim_compute_robot_state-parked0": 0.012457099827853115}, "udem1-4-1-ego": {"driven_any": 0.3083614031369832, "get_ui_image": 0.07948276129635898, "step_physics": 0.1546733487736095, "survival_time": 2.2, "driven_lanedir": 0.29913716804247237, "get_state_dump": 0.03921816565773704, "sim_render-ego": 0.00777115063233809, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03872822631489147, "deviation-heading": 0.5442280312830121, "complete-iteration": 0.4290536804632707, "set_robot_commands": 0.006507055325941606, "deviation-center-line": 0.25317418190087515, "driven_lanedir_consec": 0.29913716804247237, "sim_compute_sim_state": 0.03254349123347889, "sim_compute_performance-ego": 0.006166718222878196, "sim_compute_robot_state-ego": 0.010267447341572157, "sim_compute_robot_state-npc0": 0.011489467187361284, "sim_compute_robot_state-npc1": 0.010752406987276943, "sim_compute_robot_state-npc2": 0.01017783988605846, "sim_compute_robot_state-npc3": 0.010404478419910778, "sim_compute_robot_state-parked0": 0.010512102733958853}}
set_robot_commands_max0.008377465334805574
set_robot_commands_mean0.0073257372667166285
set_robot_commands_median0.007438290691014569
set_robot_commands_min0.006434811486138238
sim_compute_performance-ego_max0.007355646653608842
sim_compute_performance-ego_mean0.006633878366788161
sim_compute_performance-ego_median0.006662266184822169
sim_compute_performance-ego_min0.0061352550983428955
sim_compute_robot_state-ego_max0.013604023239829325
sim_compute_robot_state-ego_mean0.011646323530413456
sim_compute_robot_state-ego_median0.011956424718652554
sim_compute_robot_state-ego_min0.010147865329469954
sim_compute_robot_state-npc0_max0.012974511493336073
sim_compute_robot_state-npc0_mean0.011718142012485886
sim_compute_robot_state-npc0_median0.011665146877056873
sim_compute_robot_state-npc0_min0.010626746075493947
sim_compute_robot_state-npc1_max0.01291080496527932
sim_compute_robot_state-npc1_mean0.011496587850839192
sim_compute_robot_state-npc1_median0.011369639571340849
sim_compute_robot_state-npc1_min0.010453717750415467
sim_compute_robot_state-npc2_max0.01290650801225142
sim_compute_robot_state-npc2_mean0.01142475627282287
sim_compute_robot_state-npc2_median0.011530590576546682
sim_compute_robot_state-npc2_min0.01017783988605846
sim_compute_robot_state-npc3_max0.0128797401081432
sim_compute_robot_state-npc3_mean0.011510265143753345
sim_compute_robot_state-npc3_median0.011511371157281205
sim_compute_robot_state-npc3_min0.010404478419910778
sim_compute_robot_state-parked0_max0.012457099827853115
sim_compute_robot_state-parked0_mean0.011447161899311432
sim_compute_robot_state-parked0_median0.011569014065596222
sim_compute_robot_state-parked0_min0.010512102733958853
sim_compute_sim_state_max0.047702865502268994
sim_compute_sim_state_mean0.0399038450805455
sim_compute_sim_state_median0.040295434150332224
sim_compute_sim_state_min0.032050559395237974
sim_render-ego_max0.008674540302970192
sim_render-ego_mean0.007954704754829883
sim_render-ego_median0.007898810787855584
sim_render-ego_min0.007276794740131923
simulation-passed1
step_physics_max0.184890374845388
step_physics_mean0.168078640896288
step_physics_median0.17055460340098333
step_physics_min0.14914910359816116
survival_time_max5.349999999999989
survival_time_mean4.0099999999999945
survival_time_min2.2

Highlights

33219

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.