Duckietown Challenges Home Challenges Submissions

Job 62057

Job ID62057
submission13654
userJean-Sébastien Grondin 🇨🇦
user labelexercise_ros_template
challengeaido-LFV_multi-sim-validation
step356
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg04
date started
date completed
duration1:51:42
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median26.55000000000024
in-drivable-lane_median0.6750000000000012
driven_lanedir_consec_median7.596814132199247
deviation-center-line_median1.636953142207207


other stats
agent_compute-ego0_max0.22912304181171708
agent_compute-ego0_mean0.12540029289992718
agent_compute-ego0_median0.06490817097799664
agent_compute-ego0_min0.03700362360754678
agent_compute-ego1_max0.2196626328081491
agent_compute-ego1_mean0.15727533251167816
agent_compute-ego1_median0.18609459136149767
agent_compute-ego1_min0.03631946486096049
complete-iteration_max1.9608898740962035
complete-iteration_mean1.6361077066910286
complete-iteration_median1.9542572277967976
complete-iteration_min0.9749073359860952
deviation-center-line_max4.321721687084041
deviation-center-line_mean1.9906834971164105
deviation-center-line_min0.7193208145985529
deviation-heading_max12.674289513775047
deviation-heading_mean5.689500506182431
deviation-heading_median4.35874372926401
deviation-heading_min1.9119491818272292
driven_any_max26.476882204496135
driven_any_mean10.061802647225358
driven_any_median7.920452655741956
driven_any_min3.4561662557485464
driven_lanedir_consec_max22.29784671632516
driven_lanedir_consec_mean8.980072513838135
driven_lanedir_consec_min3.221774434329333
driven_lanedir_max22.29784671632516
driven_lanedir_mean8.980072513838135
driven_lanedir_median7.596814132199247
driven_lanedir_min3.221774434329333
get_duckie_state_max3.309582555016806e-06
get_duckie_state_mean3.2532092999754143e-06
get_duckie_state_median3.256666769493033e-06
get_duckie_state_min3.1578492926785265e-06
get_robot_state_max0.05179546754822743
get_robot_state_mean0.044485985548880426
get_robot_state_median0.047270276044544424
get_robot_state_min0.02194273998459659
get_state_dump_max0.03336823165864873
get_state_dump_mean0.030755832850740857
get_state_dump_median0.032343460260878795
get_state_dump_min0.026908135318373105
get_ui_image_max0.09029301179636529
get_ui_image_mean0.07931752360684609
get_ui_image_median0.08333425772817511
get_ui_image_min0.05778165514689373
in-drivable-lane_max25.099999999998687
in-drivable-lane_mean4.264285714285548
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 6.9638163595029985, "get_ui_image": 0.07509323552597401, "step_physics": 0.7597455229870108, "survival_time": 21.45000000000017, "driven_lanedir": 6.8192854500987625, "get_state_dump": 0.02847965539887894, "get_robot_state": 0.04566383583601131, "sim_render-ego0": 0.010611775864002316, "sim_render-ego1": 0.009307673365570776, "sim_render-ego2": 0.00963049988413966, "sim_render-ego3": 0.009668930741243585, "get_duckie_state": 3.309582555016806e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.595472491607971, "agent_compute-ego0": 0.03700362360754678, "agent_compute-ego1": 0.03631946486096049, "agent_compute-ego2": 0.1701096701067547, "agent_compute-ego3": 0.03659275520679563, "complete-iteration": 1.3237762035325515, "set_robot_commands": 0.007236587169558503, "deviation-center-line": 1.1298948776045223, "driven_lanedir_consec": 6.8192854500987625, "sim_compute_sim_state": 0.041718768519024514, "sim_compute_performance-ego0": 0.006321548861126567, "sim_compute_performance-ego1": 0.005519598029380621, "sim_compute_performance-ego2": 0.0059316607408745345, "sim_compute_performance-ego3": 0.0065122632093207785}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 9.018144168425492, "get_ui_image": 0.07509323552597401, "step_physics": 0.7597455229870108, "survival_time": 21.45000000000017, "driven_lanedir": 8.383681758632642, "get_state_dump": 0.02847965539887894, "get_robot_state": 0.04566383583601131, "sim_render-ego0": 0.010611775864002316, "sim_render-ego1": 0.009307673365570776, "sim_render-ego2": 0.00963049988413966, "sim_render-ego3": 0.009668930741243585, "get_duckie_state": 3.309582555016806e-06, "in-drivable-lane": 0.7000000000000046, "deviation-heading": 4.358743980234512, "agent_compute-ego0": 0.03700362360754678, "agent_compute-ego1": 0.03631946486096049, "agent_compute-ego2": 0.1701096701067547, "agent_compute-ego3": 0.03659275520679563, "complete-iteration": 1.3237762035325515, "set_robot_commands": 0.007236587169558503, "deviation-center-line": 1.1807418620894865, "driven_lanedir_consec": 8.383681758632642, "sim_compute_sim_state": 0.041718768519024514, "sim_compute_performance-ego0": 0.006321548861126567, "sim_compute_performance-ego1": 0.005519598029380621, "sim_compute_performance-ego2": 0.0059316607408745345, "sim_compute_performance-ego3": 0.0065122632093207785}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.830785982661968, "get_ui_image": 0.07509323552597401, "step_physics": 0.7597455229870108, "survival_time": 21.45000000000017, "driven_lanedir": 3.617694164220428, "get_state_dump": 0.02847965539887894, "get_robot_state": 0.04566383583601131, "sim_render-ego0": 0.010611775864002316, "sim_render-ego1": 0.009307673365570776, "sim_render-ego2": 0.00963049988413966, "sim_render-ego3": 0.009668930741243585, "get_duckie_state": 3.309582555016806e-06, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 3.0862964896831557, "agent_compute-ego0": 0.03700362360754678, "agent_compute-ego1": 0.03631946486096049, "agent_compute-ego2": 0.1701096701067547, "agent_compute-ego3": 0.03659275520679563, "complete-iteration": 1.3237762035325515, "set_robot_commands": 0.007236587169558503, "deviation-center-line": 1.7228271784254388, "driven_lanedir_consec": 3.617694164220428, "sim_compute_sim_state": 0.041718768519024514, "sim_compute_performance-ego0": 0.006321548861126567, "sim_compute_performance-ego1": 0.005519598029380621, "sim_compute_performance-ego2": 0.0059316607408745345, "sim_compute_performance-ego3": 0.0065122632093207785}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.789220092854849, "get_ui_image": 0.07509323552597401, "step_physics": 0.7597455229870108, "survival_time": 21.45000000000017, "driven_lanedir": 3.7081848513186113, "get_state_dump": 0.02847965539887894, "get_robot_state": 0.04566383583601131, "sim_render-ego0": 0.010611775864002316, "sim_render-ego1": 0.009307673365570776, "sim_render-ego2": 0.00963049988413966, "sim_render-ego3": 0.009668930741243585, "get_duckie_state": 3.309582555016806e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9903885303390725, "agent_compute-ego0": 0.03700362360754678, "agent_compute-ego1": 0.03631946486096049, "agent_compute-ego2": 0.1701096701067547, "agent_compute-ego3": 0.03659275520679563, "complete-iteration": 1.3237762035325515, "set_robot_commands": 0.007236587169558503, "deviation-center-line": 2.017267817695153, "driven_lanedir_consec": 3.7081848513186113, "sim_compute_sim_state": 0.041718768519024514, "sim_compute_performance-ego0": 0.006321548861126567, "sim_compute_performance-ego1": 0.005519598029380621, "sim_compute_performance-ego2": 0.0059316607408745345, "sim_compute_performance-ego3": 0.0065122632093207785}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 26.476882204496135, "get_ui_image": 0.09029301179636529, "step_physics": 1.0179421246597709, "survival_time": 59.99999999999873, "driven_lanedir": 22.29784671632516, "get_state_dump": 0.032343460260878795, "get_robot_state": 0.05179546754822743, "sim_render-ego0": 0.010480405686796953, "sim_render-ego1": 0.011362405740450462, "sim_render-ego2": 0.010870033656429192, "sim_render-ego3": 0.010790702206804592, "get_duckie_state": 3.256666769493033e-06, "in-drivable-lane": 6.899999999999911, "deviation-heading": 12.674289513775047, "agent_compute-ego0": 0.06490817097799664, "agent_compute-ego1": 0.18609459136149767, "agent_compute-ego2": 0.2254644716709083, "agent_compute-ego3": 0.10795589787676174, "complete-iteration": 1.9542572277967976, "set_robot_commands": 0.00814864260270931, "deviation-center-line": 4.321721687084041, "driven_lanedir_consec": 22.29784671632516, "sim_compute_sim_state": 0.07269511870003859, "sim_compute_performance-ego0": 0.007085721558277851, "sim_compute_performance-ego1": 0.006680824873747178, "sim_compute_performance-ego2": 0.006572708896951413, "sim_compute_performance-ego3": 0.006767080388001657}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 16.771263922444422, "get_ui_image": 0.09029301179636529, "step_physics": 1.0179421246597709, "survival_time": 59.99999999999873, "driven_lanedir": 14.74294211175825, "get_state_dump": 0.032343460260878795, "get_robot_state": 0.05179546754822743, "sim_render-ego0": 0.010480405686796953, "sim_render-ego1": 0.011362405740450462, "sim_render-ego2": 0.010870033656429192, "sim_render-ego3": 0.010790702206804592, "get_duckie_state": 3.256666769493033e-06, "in-drivable-lane": 25.099999999998687, "deviation-heading": 8.447676754203089, "agent_compute-ego0": 0.06490817097799664, "agent_compute-ego1": 0.18609459136149767, "agent_compute-ego2": 0.2254644716709083, "agent_compute-ego3": 0.10795589787676174, "complete-iteration": 1.9542572277967976, "set_robot_commands": 0.00814864260270931, "deviation-center-line": 2.5620098911644993, "driven_lanedir_consec": 14.74294211175825, "sim_compute_sim_state": 0.07269511870003859, "sim_compute_performance-ego0": 0.007085721558277851, "sim_compute_performance-ego1": 0.006680824873747178, "sim_compute_performance-ego2": 0.006572708896951413, "sim_compute_performance-ego3": 0.006767080388001657}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 19.585565682918475, "get_ui_image": 0.09029301179636529, "step_physics": 1.0179421246597709, "survival_time": 59.99999999999873, "driven_lanedir": 17.091782014363456, "get_state_dump": 0.032343460260878795, "get_robot_state": 0.05179546754822743, "sim_render-ego0": 0.010480405686796953, "sim_render-ego1": 0.011362405740450462, "sim_render-ego2": 0.010870033656429192, "sim_render-ego3": 0.010790702206804592, "get_duckie_state": 3.256666769493033e-06, "in-drivable-lane": 19.699999999999022, "deviation-heading": 9.447265023905905, "agent_compute-ego0": 0.06490817097799664, "agent_compute-ego1": 0.18609459136149767, "agent_compute-ego2": 0.2254644716709083, "agent_compute-ego3": 0.10795589787676174, "complete-iteration": 1.9542572277967976, "set_robot_commands": 0.00814864260270931, "deviation-center-line": 2.9421741550614207, "driven_lanedir_consec": 17.091782014363456, "sim_compute_sim_state": 0.07269511870003859, "sim_compute_performance-ego0": 0.007085721558277851, "sim_compute_performance-ego1": 0.006680824873747178, "sim_compute_performance-ego2": 0.006572708896951413, "sim_compute_performance-ego3": 0.006767080388001657}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 16.622206711668884, "get_ui_image": 0.09029301179636529, "step_physics": 1.0179421246597709, "survival_time": 59.99999999999873, "driven_lanedir": 14.772695074484144, "get_state_dump": 0.032343460260878795, "get_robot_state": 0.05179546754822743, "sim_render-ego0": 0.010480405686796953, "sim_render-ego1": 0.011362405740450462, "sim_render-ego2": 0.010870033656429192, "sim_render-ego3": 0.010790702206804592, "get_duckie_state": 3.256666769493033e-06, "in-drivable-lane": 1.8000000000000114, "deviation-heading": 12.56524906869153, "agent_compute-ego0": 0.06490817097799664, "agent_compute-ego1": 0.18609459136149767, "agent_compute-ego2": 0.2254644716709083, "agent_compute-ego3": 0.10795589787676174, "complete-iteration": 1.9542572277967976, "set_robot_commands": 0.00814864260270931, "deviation-center-line": 3.0189469150698716, "driven_lanedir_consec": 14.772695074484144, "sim_compute_sim_state": 0.07269511870003859, "sim_compute_performance-ego0": 0.007085721558277851, "sim_compute_performance-ego1": 0.006680824873747178, "sim_compute_performance-ego2": 0.006572708896951413, "sim_compute_performance-ego3": 0.006767080388001657}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 8.877088951980914, "get_ui_image": 0.08333425772817511, "step_physics": 0.7638482711368934, "survival_time": 26.55000000000024, "driven_lanedir": 8.374342814299732, "get_state_dump": 0.03336823165864873, "get_robot_state": 0.047270276044544424, "sim_render-ego0": 0.010320375288339486, "sim_render-ego1": 0.01023698659767782, "sim_render-ego2": 0.010554482166032143, "sim_render-ego3": 0.010349725422106291, "get_duckie_state": 3.2410585790648497e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 5.122044420462816, "agent_compute-ego0": 0.2224277096583431, "agent_compute-ego1": 0.21821829116434083, "agent_compute-ego2": 0.2149147579544469, "agent_compute-ego3": 0.22061878890919503, "complete-iteration": 1.9608898740962035, "set_robot_commands": 0.009131237528377906, "deviation-center-line": 1.4579170269021091, "driven_lanedir_consec": 8.374342814299732, "sim_compute_sim_state": 0.05424973211790386, "sim_compute_performance-ego0": 0.006610864535310215, "sim_compute_performance-ego1": 0.006100755436976153, "sim_compute_performance-ego2": 0.00664534604639039, "sim_compute_performance-ego3": 0.007046451245931755}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.4561662557485464, "get_ui_image": 0.08333425772817511, "step_physics": 0.7638482711368934, "survival_time": 26.55000000000024, "driven_lanedir": 3.221774434329333, "get_state_dump": 0.03336823165864873, "get_robot_state": 0.047270276044544424, "sim_render-ego0": 0.010320375288339486, "sim_render-ego1": 0.01023698659767782, "sim_render-ego2": 0.010554482166032143, "sim_render-ego3": 0.010349725422106291, "get_duckie_state": 3.2410585790648497e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.358743478293508, "agent_compute-ego0": 0.2224277096583431, "agent_compute-ego1": 0.21821829116434083, "agent_compute-ego2": 0.2149147579544469, "agent_compute-ego3": 0.22061878890919503, "complete-iteration": 1.9608898740962035, "set_robot_commands": 0.009131237528377906, "deviation-center-line": 0.9900581027826624, "driven_lanedir_consec": 3.221774434329333, "sim_compute_sim_state": 0.05424973211790386, "sim_compute_performance-ego0": 0.006610864535310215, "sim_compute_performance-ego1": 0.006100755436976153, "sim_compute_performance-ego2": 0.00664534604639039, "sim_compute_performance-ego3": 0.007046451245931755}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.5413075534198413, "get_ui_image": 0.08333425772817511, "step_physics": 0.7638482711368934, "survival_time": 26.55000000000024, "driven_lanedir": 3.252661373641115, "get_state_dump": 0.03336823165864873, "get_robot_state": 0.047270276044544424, "sim_render-ego0": 0.010320375288339486, "sim_render-ego1": 0.01023698659767782, "sim_render-ego2": 0.010554482166032143, "sim_render-ego3": 0.010349725422106291, "get_duckie_state": 3.2410585790648497e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 3.8067370778528824, "agent_compute-ego0": 0.2224277096583431, "agent_compute-ego1": 0.21821829116434083, "agent_compute-ego2": 0.2149147579544469, "agent_compute-ego3": 0.22061878890919503, "complete-iteration": 1.9608898740962035, "set_robot_commands": 0.009131237528377906, "deviation-center-line": 3.3919194128214656, "driven_lanedir_consec": 3.252661373641115, "sim_compute_sim_state": 0.05424973211790386, "sim_compute_performance-ego0": 0.006610864535310215, "sim_compute_performance-ego1": 0.006100755436976153, "sim_compute_performance-ego2": 0.00664534604639039, "sim_compute_performance-ego3": 0.007046451245931755}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 11.724735982091554, "get_ui_image": 0.08333425772817511, "step_physics": 0.7638482711368934, "survival_time": 26.55000000000024, "driven_lanedir": 10.38857764767704, "get_state_dump": 0.03336823165864873, "get_robot_state": 0.047270276044544424, "sim_render-ego0": 0.010320375288339486, "sim_render-ego1": 0.01023698659767782, "sim_render-ego2": 0.010554482166032143, "sim_render-ego3": 0.010349725422106291, "get_duckie_state": 3.2410585790648497e-06, "in-drivable-lane": 2.5000000000000275, "deviation-heading": 5.297714224423115, "agent_compute-ego0": 0.2224277096583431, "agent_compute-ego1": 0.21821829116434083, "agent_compute-ego2": 0.2149147579544469, "agent_compute-ego3": 0.22061878890919503, "complete-iteration": 1.9608898740962035, "set_robot_commands": 0.009131237528377906, "deviation-center-line": 1.5510791059889757, "driven_lanedir_consec": 10.38857764767704, "sim_compute_sim_state": 0.05424973211790386, "sim_compute_performance-ego0": 0.006610864535310215, "sim_compute_performance-ego1": 0.006100755436976153, "sim_compute_performance-ego2": 0.00664534604639039, "sim_compute_performance-ego3": 0.007046451245931755}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.193932097116401, "get_ui_image": 0.05778165514689373, "step_physics": 0.3432142341950811, "survival_time": 12.40000000000004, "driven_lanedir": 4.789074234590814, "get_state_dump": 0.026908135318373105, "get_robot_state": 0.02194273998459659, "sim_render-ego0": 0.01181964414665498, "sim_render-ego1": 0.010937896598295036, "get_duckie_state": 3.1578492926785265e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 1.9119491818272292, "agent_compute-ego0": 0.22912304181171708, "agent_compute-ego1": 0.2196626328081491, "complete-iteration": 0.9749073359860952, "set_robot_commands": 0.007918895966556656, "deviation-center-line": 0.8636901123415456, "driven_lanedir_consec": 4.789074234590814, "sim_compute_sim_state": 0.024275216711572855, "sim_compute_performance-ego0": 0.007358010992946395, "sim_compute_performance-ego1": 0.005690161961628251}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 5.014121095824561, "get_ui_image": 0.05778165514689373, "step_physics": 0.3432142341950811, "survival_time": 12.40000000000004, "driven_lanedir": 4.26047254799439, "get_state_dump": 0.026908135318373105, "get_robot_state": 0.02194273998459659, "sim_render-ego0": 0.01181964414665498, "sim_render-ego1": 0.010937896598295036, "get_duckie_state": 3.1578492926785265e-06, "in-drivable-lane": 1.250000000000013, "deviation-heading": 2.9904368512541915, "agent_compute-ego0": 0.22912304181171708, "agent_compute-ego1": 0.2196626328081491, "complete-iteration": 0.9749073359860952, "set_robot_commands": 0.007918895966556656, "deviation-center-line": 0.7193208145985529, "driven_lanedir_consec": 4.26047254799439, "sim_compute_sim_state": 0.024275216711572855, "sim_compute_performance-ego0": 0.007358010992946395, "sim_compute_performance-ego1": 0.005690161961628251}}
set_robot_commands_max0.009131237528377906
set_robot_commands_mean0.00813597579540687
set_robot_commands_median0.00814864260270931
set_robot_commands_min0.007236587169558503
sim_compute_performance-ego0_max0.007358010992946395
sim_compute_performance-ego0_mean0.006770611557482238
sim_compute_performance-ego0_median0.006610864535310215
sim_compute_performance-ego0_min0.006321548861126567
sim_compute_performance-ego1_max0.006680824873747178
sim_compute_performance-ego1_mean0.006041788377405165
sim_compute_performance-ego1_median0.006100755436976153
sim_compute_performance-ego1_min0.005519598029380621
sim_compute_sim_state_max0.07269511870003859
sim_compute_sim_state_mean0.05165749362650096
sim_compute_sim_state_median0.05424973211790386
sim_compute_sim_state_min0.024275216711572855
sim_render-ego0_max0.01181964414665498
sim_render-ego0_mean0.010663536832133213
sim_render-ego0_median0.010480405686796953
sim_render-ego0_min0.010320375288339486
sim_render-ego1_max0.011362405740450462
sim_render-ego1_mean0.010393146857956162
sim_render-ego1_median0.01023698659767782
sim_render-ego1_min0.009307673365570776
simulation-passed1
step_physics_max1.0179421246597709
step_physics_mean0.7751837245374903
step_physics_median0.7638482711368934
step_physics_min0.3432142341950811
survival_time_max59.99999999999873
survival_time_mean32.628571428571185
survival_time_min12.40000000000004

Highlights

62057

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.