Duckietown Challenges Home Challenges Submissions

Job 34367

Job ID34367
submission9212
userBea Baselines 🐤
user labeltemplate-ros
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg05-e09f63c9a256-1
date started
date completed
duration0:40:29
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34733616573615644
survival_time_median14.950000000000076
deviation-center-line_median0.2455213592340523
in-drivable-lane_median10.000000000000073


other stats
agent_compute-ego_max0.06621726671854655
agent_compute-ego_mean0.06246518245298569
agent_compute-ego_median0.06234293475542983
agent_compute-ego_min0.060140708287556965
complete-iteration_max0.6399287192026774
complete-iteration_mean0.5984100711547076
complete-iteration_median0.6035808602968852
complete-iteration_min0.5393014053503672
deviation-center-line_max1.0311208583130704
deviation-center-line_mean0.3439914026430185
deviation-center-line_min0.06448189386981787
deviation-heading_max4.735837439797086
deviation-heading_mean1.9359671973927743
deviation-heading_median1.0573568192256684
deviation-heading_min0.5415782836554353
driven_any_max1.9397634134318271
driven_any_mean1.6381338165768775
driven_any_median1.939322285171015
driven_any_min0.432975164583919
driven_lanedir_consec_max1.2983825716717954
driven_lanedir_consec_mean0.43713064005855296
driven_lanedir_consec_min0.05712295245297461
driven_lanedir_max1.2983825716717954
driven_lanedir_mean0.4486943293187764
driven_lanedir_median0.34733616573615644
driven_lanedir_min0.05712295245297461
get_state_dump_max0.03517072836558024
get_state_dump_mean0.03433924110458321
get_state_dump_median0.034213137016993134
get_state_dump_min0.033923842906951905
get_ui_image_max0.11949013392130534
get_ui_image_mean0.1126989382656016
get_ui_image_median0.11371063470840452
get_ui_image_min0.10200763410992092
in-drivable-lane_max13.650000000000077
in-drivable-lane_mean8.185000000000048
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 1.9324039596601603, "get_ui_image": 0.11949013392130534, "step_physics": 0.31709665060043335, "survival_time": 14.950000000000076, "driven_lanedir": 0.5253865896581811, "get_state_dump": 0.03471258242925008, "sim_render-ego": 0.007600617408752441, "in-drivable-lane": 8.400000000000059, "agent_compute-ego": 0.060140708287556965, "deviation-heading": 4.735837439797086, "complete-iteration": 0.6376363714536031, "set_robot_commands": 0.006237982114156087, "deviation-center-line": 0.2769360730673628, "driven_lanedir_consec": 0.4343455617374597, "sim_compute_sim_state": 0.027104791005452475, "sim_compute_performance-ego": 0.0058632334073384605, "sim_compute_robot_state-ego": 0.009925532341003416, "sim_compute_robot_state-npc0": 0.009617316722869872, "sim_compute_robot_state-npc1": 0.00982036828994751, "sim_compute_robot_state-npc2": 0.01008432944615682, "sim_compute_robot_state-npc3": 0.009785664876302084, "sim_compute_robot_state-parked0": 0.00986140727996826}, "udem1-0-1-ego": {"driven_any": 1.9393135791096103, "get_ui_image": 0.11921258290608724, "step_physics": 0.31643445094426476, "survival_time": 14.950000000000076, "driven_lanedir": 0.3033604647484216, "get_state_dump": 0.03407230456670125, "sim_render-ego": 0.007630917231241862, "in-drivable-lane": 11.60000000000008, "agent_compute-ego": 0.06332739988962809, "deviation-heading": 1.8000893177398083, "complete-iteration": 0.6399287192026774, "set_robot_commands": 0.006442875862121582, "deviation-center-line": 0.28594590115308743, "driven_lanedir_consec": 0.3033604647484216, "sim_compute_sim_state": 0.026239806016286213, "sim_compute_performance-ego": 0.006024256547292073, "sim_compute_robot_state-ego": 0.009742918014526368, "sim_compute_robot_state-npc0": 0.01015844186147054, "sim_compute_robot_state-npc1": 0.00998924732208252, "sim_compute_robot_state-npc2": 0.010027798016866048, "sim_compute_robot_state-npc3": 0.010031329790751138, "sim_compute_robot_state-parked0": 0.010281487305959066}, "udem1-1-0-ego": {"driven_any": 1.93929621655631, "get_ui_image": 0.11463658412297568, "step_physics": 0.2858108655611674, "survival_time": 14.950000000000076, "driven_lanedir": 0.1449423907308054, "get_state_dump": 0.034179159800211585, "sim_render-ego": 0.00755224068959554, "in-drivable-lane": 13.300000000000075, "agent_compute-ego": 0.06238788843154907, "deviation-heading": 0.6917426205492871, "complete-iteration": 0.6052212047576905, "set_robot_commands": 0.006290740172068278, "deviation-center-line": 0.14300192545968388, "driven_lanedir_consec": 0.1449423907308054, "sim_compute_sim_state": 0.028277109464009603, "sim_compute_performance-ego": 0.005795563062032064, "sim_compute_robot_state-ego": 0.00980804443359375, "sim_compute_robot_state-npc0": 0.010162285168965658, "sim_compute_robot_state-npc1": 0.01011239449183146, "sim_compute_robot_state-npc2": 0.010079046885172529, "sim_compute_robot_state-npc3": 0.009862367312113445, "sim_compute_robot_state-parked0": 0.009942146142323811}, "udem1-1-1-ego": {"driven_any": 1.939349215257565, "get_ui_image": 0.11919208447138468, "step_physics": 0.296522007783254, "survival_time": 14.950000000000076, "driven_lanedir": 0.11064474670261326, "get_state_dump": 0.034575397173563636, "sim_render-ego": 0.007942535877227784, "in-drivable-lane": 13.550000000000075, "agent_compute-ego": 0.06111721595128377, "deviation-heading": 0.5415782836554353, "complete-iteration": 0.621901208559672, "set_robot_commands": 0.006375861962636312, "deviation-center-line": 0.069009906111366, "driven_lanedir_consec": 0.11064474670261326, "sim_compute_sim_state": 0.030513858795166018, "sim_compute_performance-ego": 0.005627402464548747, "sim_compute_robot_state-ego": 0.01011351982752482, "sim_compute_robot_state-npc0": 0.009514106909434, "sim_compute_robot_state-npc1": 0.010293924808502195, "sim_compute_robot_state-npc2": 0.010014038880666097, "sim_compute_robot_state-npc3": 0.01012173096338908, "sim_compute_robot_state-parked0": 0.009670015176137288}, "udem1-2-0-ego": {"driven_any": 1.9397590573854404, "get_ui_image": 0.11658335208892824, "step_physics": 0.2958883198102315, "survival_time": 14.950000000000076, "driven_lanedir": 0.05712295245297461, "get_state_dump": 0.034410343170166016, "sim_render-ego": 0.00716288963953654, "in-drivable-lane": 13.650000000000077, "agent_compute-ego": 0.06621726671854655, "deviation-heading": 1.0779898691981011, "complete-iteration": 0.6121058996518453, "set_robot_commands": 0.0063941303888956705, "deviation-center-line": 0.11561588243941094, "driven_lanedir_consec": 0.05712295245297461, "sim_compute_sim_state": 0.020310895442962648, "sim_compute_performance-ego": 0.005697720050811768, "sim_compute_robot_state-ego": 0.00946842114130656, "sim_compute_robot_state-npc0": 0.0097177251180013, "sim_compute_robot_state-npc1": 0.010146419207255043, "sim_compute_robot_state-npc2": 0.009822786649068197, "sim_compute_robot_state-npc3": 0.010073379675547282, "sim_compute_robot_state-parked0": 0.009774560928344727}, "udem1-2-1-ego": {"driven_any": 1.9393309912324197, "get_ui_image": 0.1127846852938334, "step_physics": 0.26609416166941324, "survival_time": 14.950000000000076, "driven_lanedir": 0.10084505609406302, "get_state_dump": 0.03517072836558024, "sim_render-ego": 0.007807984352111817, "in-drivable-lane": 13.600000000000076, "agent_compute-ego": 0.06297207434972127, "deviation-heading": 0.6069306890773039, "complete-iteration": 0.5772340162595113, "set_robot_commands": 0.006567285060882568, "deviation-center-line": 0.06448189386981787, "driven_lanedir_consec": 0.10084505609406302, "sim_compute_sim_state": 0.019254772663116457, "sim_compute_performance-ego": 0.006035483678181966, "sim_compute_robot_state-ego": 0.010127816994984945, "sim_compute_robot_state-npc0": 0.009756171703338624, "sim_compute_robot_state-npc1": 0.01006292740503947, "sim_compute_robot_state-npc2": 0.01029589811960856, "sim_compute_robot_state-npc3": 0.010004688103993731, "sim_compute_robot_state-parked0": 0.009974193572998048}, "udem1-3-0-ego": {"driven_any": 1.939546361533051, "get_ui_image": 0.10952098846435548, "step_physics": 0.27837170521418253, "survival_time": 14.950000000000076, "driven_lanedir": 1.1501741584738094, "get_state_dump": 0.03402068138122558, "sim_render-ego": 0.0075085147221883135, "in-drivable-lane": 4.550000000000031, "agent_compute-ego": 0.06208861986796061, "deviation-heading": 3.796185297129804, "complete-iteration": 0.5961253150304159, "set_robot_commands": 0.0064940992991129555, "deviation-center-line": 0.9627588675482804, "driven_lanedir_consec": 1.1255782937922958, "sim_compute_sim_state": 0.03169857263565064, "sim_compute_performance-ego": 0.006018126805623372, "sim_compute_robot_state-ego": 0.009802591800689698, "sim_compute_robot_state-npc0": 0.009998525778452555, "sim_compute_robot_state-npc1": 0.010170141061147052, "sim_compute_robot_state-npc2": 0.01012147029240926, "sim_compute_robot_state-npc3": 0.009917565981547038, "sim_compute_robot_state-parked0": 0.01006446917851766}, "udem1-3-1-ego": {"driven_any": 1.9397634134318271, "get_ui_image": 0.10862812439600626, "step_physics": 0.28118584950764974, "survival_time": 14.950000000000076, "driven_lanedir": 1.2983825716717954, "get_state_dump": 0.033923842906951905, "sim_render-ego": 0.007332523663838704, "in-drivable-lane": 3.1999999999999993, "agent_compute-ego": 0.06336795091629029, "deviation-heading": 4.224645872662239, "complete-iteration": 0.6019405158360799, "set_robot_commands": 0.00650335152943929, "deviation-center-line": 1.0311208583130704, "driven_lanedir_consec": 1.2983825716717954, "sim_compute_sim_state": 0.034551705519358315, "sim_compute_performance-ego": 0.006007318496704102, "sim_compute_robot_state-ego": 0.009836328029632567, "sim_compute_robot_state-npc0": 0.010204236507415773, "sim_compute_robot_state-npc1": 0.010141375064849854, "sim_compute_robot_state-npc2": 0.009901750882466634, "sim_compute_robot_state-npc3": 0.009931694666544595, "sim_compute_robot_state-parked0": 0.0101066788037618}, "udem1-4-0-ego": {"driven_any": 0.4396002070184733, "get_ui_image": 0.1049332128812189, "step_physics": 0.24859749780942317, "survival_time": 3.649999999999995, "driven_lanedir": 0.40477249593120934, "get_state_dump": 0.03424711423377468, "sim_render-ego": 0.007885707567815911, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06229798107931059, "deviation-heading": 1.0367237692532356, "complete-iteration": 0.5527060554452139, "set_robot_commands": 0.006526816381167059, "deviation-center-line": 0.2611771296096261, "driven_lanedir_consec": 0.40477249593120934, "sim_compute_sim_state": 0.021681841105630952, "sim_compute_performance-ego": 0.005750953334651581, "sim_compute_robot_state-ego": 0.010318938999959868, "sim_compute_robot_state-npc0": 0.009861061017807217, "sim_compute_robot_state-npc1": 0.010136836195645269, "sim_compute_robot_state-npc2": 0.01016154354565764, "sim_compute_robot_state-npc3": 0.009926351782393782, "sim_compute_robot_state-parked0": 0.009992021403900564}, "udem1-4-1-ego": {"driven_any": 0.432975164583919, "get_ui_image": 0.10200763410992092, "step_physics": 0.24051806330680847, "survival_time": 3.599999999999995, "driven_lanedir": 0.3913118667238913, "get_state_dump": 0.03408025701840719, "sim_render-ego": 0.00751762588818868, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06073471903800965, "deviation-heading": 0.8479488148654443, "complete-iteration": 0.5393014053503672, "set_robot_commands": 0.006324715084499783, "deviation-center-line": 0.22986558885847852, "driven_lanedir_consec": 0.3913118667238913, "sim_compute_sim_state": 0.02154878444141812, "sim_compute_performance-ego": 0.006065133545133803, "sim_compute_robot_state-ego": 0.010656899876064723, "sim_compute_robot_state-npc0": 0.00995701551437378, "sim_compute_robot_state-npc1": 0.009934147198994957, "sim_compute_robot_state-npc2": 0.009522335396872628, "sim_compute_robot_state-npc3": 0.010251290268368192, "sim_compute_robot_state-parked0": 0.009867224428388808}}
set_robot_commands_max0.006567285060882568
set_robot_commands_mean0.006415785785497959
set_robot_commands_median0.006418503125508627
set_robot_commands_min0.006237982114156087
sim_compute_performance-ego_max0.006065133545133803
sim_compute_performance-ego_mean0.005888519139231793
sim_compute_performance-ego_median0.0059352759520212815
sim_compute_performance-ego_min0.005627402464548747
sim_compute_robot_state-ego_max0.010656899876064723
sim_compute_robot_state-ego_mean0.009980101145928672
sim_compute_robot_state-ego_median0.009880930185317991
sim_compute_robot_state-ego_min0.00946842114130656
sim_compute_robot_state-npc0_max0.010204236507415773
sim_compute_robot_state-npc0_mean0.009894688630212933
sim_compute_robot_state-npc0_median0.0099090382660905
sim_compute_robot_state-npc0_min0.009514106909434
sim_compute_robot_state-npc1_max0.010293924808502195
sim_compute_robot_state-npc1_mean0.010080778104529531
sim_compute_robot_state-npc1_median0.010124615343738364
sim_compute_robot_state-npc1_min0.00982036828994751
sim_compute_robot_state-npc2_max0.01029589811960856
sim_compute_robot_state-npc2_mean0.01000309981149444
sim_compute_robot_state-npc2_median0.010053422451019287
sim_compute_robot_state-npc2_min0.009522335396872628
sim_compute_robot_state-npc3_max0.010251290268368192
sim_compute_robot_state-npc3_mean0.009990606342095035
sim_compute_robot_state-npc3_median0.009968191385269163
sim_compute_robot_state-npc3_min0.009785664876302084
sim_compute_robot_state-parked0_max0.010281487305959066
sim_compute_robot_state-parked0_mean0.009953420422030004
sim_compute_robot_state-parked0_median0.00995816985766093
sim_compute_robot_state-parked0_min0.009670015176137288
sim_compute_sim_state_max0.034551705519358315
sim_compute_sim_state_mean0.026118213708905148
sim_compute_sim_state_median0.026672298510869344
sim_compute_sim_state_min0.019254772663116457
sim_render-ego_max0.007942535877227784
sim_render-ego_mean0.007594155704049759
sim_render-ego_median0.00757642904917399
sim_render-ego_min0.00716288963953654
simulation-passed1
step_physics_max0.31709665060043335
step_physics_mean0.2826519572206828
step_physics_median0.28349835753440855
step_physics_min0.24051806330680847
survival_time_max14.950000000000076
survival_time_mean12.68500000000006
survival_time_min3.599999999999995

Highlights

34367

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.