Duckietown Challenges Home Challenges Submissions

Job 62320

Job ID62320
submission13654
userJean-Sébastien Grondin 🇨🇦
user labelexercise_ros_template
challengeaido-LFV_multi-sim-validation
step356
statussuccess
up to dateyes
evaluatorreg04
date started
date completed
duration2:07:52
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2447422081657378
deviation-center-line_median2.908092643257337


other stats
agent_compute-ego0_max0.24000412062102672
agent_compute-ego0_mean0.21914922891921987
agent_compute-ego0_median0.22294257106034585
agent_compute-ego0_min0.18932225225767824
agent_compute-ego1_max0.03910100847160092
agent_compute-ego1_mean0.03811586098008825
agent_compute-ego1_median0.03766481028706902
agent_compute-ego1_min0.03741137868260265
complete-iteration_max1.5142723018047857
complete-iteration_mean1.2370969252015982
complete-iteration_median1.256145015148001
complete-iteration_min0.7180212868143379
deviation-center-line_max7.500187226965744
deviation-center-line_mean2.8438778637347624
deviation-center-line_min0.08530737033241198
deviation-heading_max38.80490591250653
deviation-heading_mean12.134881898854136
deviation-heading_median11.817456961858843
deviation-heading_min0.7146887731741705
driven_any_max27.395737872430356
driven_any_mean5.673000394820904
driven_any_median1.4888907762595005
driven_any_min0.0
driven_lanedir_consec_max25.69035075075112
driven_lanedir_consec_mean5.265534191994591
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max25.69035075075112
driven_lanedir_mean5.265534191994591
driven_lanedir_median1.2447422081657378
driven_lanedir_min-0.000286102294921875
get_duckie_state_max3.4623300900169457e-06
get_duckie_state_mean3.284194309932322e-06
get_duckie_state_median3.28363156786152e-06
get_duckie_state_min3.0849498078586854e-06
get_robot_state_max0.05464455380159266
get_robot_state_mean0.04869745165787969
get_robot_state_median0.05283902586747169
get_robot_state_min0.025394165545677166
get_state_dump_max0.04026377621818991
get_state_dump_mean0.033057056125830396
get_state_dump_median0.0331699083885682
get_state_dump_min0.023407183916344432
get_ui_image_max0.08471412821475116
get_ui_image_mean0.07728273706271982
get_ui_image_median0.08187986729191798
get_ui_image_min0.05725063511374392
in-drivable-lane_max5.1000000000000645
in-drivable-lane_mean0.8785714285714337
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 3.100214401833175, "get_ui_image": 0.07527026665597832, "step_physics": 0.4654380389792437, "survival_time": 59.99999999999873, "driven_lanedir": 3.0057440605646595, "get_state_dump": 0.0331699083885682, "get_robot_state": 0.05283902586747169, "sim_render-ego0": 0.01133028454427219, "sim_render-ego1": 0.010984775128709982, "sim_render-ego2": 0.011178724573216371, "sim_render-ego3": 0.011090302646011236, "get_duckie_state": 3.2062435229553172e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.337406074545438, "agent_compute-ego0": 0.18932225225767824, "agent_compute-ego1": 0.03741137868260265, "agent_compute-ego2": 0.1591370868047608, "agent_compute-ego3": 0.03831398040428447, "complete-iteration": 1.2004112778456384, "set_robot_commands": 0.008294758054239368, "deviation-center-line": 4.95048938977962, "driven_lanedir_consec": 3.0057440605646595, "sim_compute_sim_state": 0.04235972433066388, "sim_compute_performance-ego0": 0.00686232731999406, "sim_compute_performance-ego1": 0.006694337112718975, "sim_compute_performance-ego2": 0.006850428624911471, "sim_compute_performance-ego3": 0.006641216818041647}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.07527026665597832, "step_physics": 0.4654380389792437, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0331699083885682, "get_robot_state": 0.05283902586747169, "sim_render-ego0": 0.01133028454427219, "sim_render-ego1": 0.010984775128709982, "sim_render-ego2": 0.011178724573216371, "sim_render-ego3": 0.011090302646011236, "get_duckie_state": 3.2062435229553172e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.593019675144898, "agent_compute-ego0": 0.18932225225767824, "agent_compute-ego1": 0.03741137868260265, "agent_compute-ego2": 0.1591370868047608, "agent_compute-ego3": 0.03831398040428447, "complete-iteration": 1.2004112778456384, "set_robot_commands": 0.008294758054239368, "deviation-center-line": 3.3845294562094597, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.04235972433066388, "sim_compute_performance-ego0": 0.00686232731999406, "sim_compute_performance-ego1": 0.006694337112718975, "sim_compute_performance-ego2": 0.006850428624911471, "sim_compute_performance-ego3": 0.006641216818041647}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 27.2220689350919, "get_ui_image": 0.07527026665597832, "step_physics": 0.4654380389792437, "survival_time": 59.99999999999873, "driven_lanedir": 25.390273829794175, "get_state_dump": 0.0331699083885682, "get_robot_state": 0.05283902586747169, "sim_render-ego0": 0.01133028454427219, "sim_render-ego1": 0.010984775128709982, "sim_render-ego2": 0.011178724573216371, "sim_render-ego3": 0.011090302646011236, "get_duckie_state": 3.2062435229553172e-06, "in-drivable-lane": 2.400000000000023, "deviation-heading": 10.444172463375253, "agent_compute-ego0": 0.18932225225767824, "agent_compute-ego1": 0.03741137868260265, "agent_compute-ego2": 0.1591370868047608, "agent_compute-ego3": 0.03831398040428447, "complete-iteration": 1.2004112778456384, "set_robot_commands": 0.008294758054239368, "deviation-center-line": 3.3845975163889115, "driven_lanedir_consec": 25.390273829794175, "sim_compute_sim_state": 0.04235972433066388, "sim_compute_performance-ego0": 0.00686232731999406, "sim_compute_performance-ego1": 0.006694337112718975, "sim_compute_performance-ego2": 0.006850428624911471, "sim_compute_performance-ego3": 0.006641216818041647}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.0, "get_ui_image": 0.07527026665597832, "step_physics": 0.4654380389792437, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0331699083885682, "get_robot_state": 0.05283902586747169, "sim_render-ego0": 0.01133028454427219, "sim_render-ego1": 0.010984775128709982, "sim_render-ego2": 0.011178724573216371, "sim_render-ego3": 0.011090302646011236, "get_duckie_state": 3.2062435229553172e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.190741460342435, "agent_compute-ego0": 0.18932225225767824, "agent_compute-ego1": 0.03741137868260265, "agent_compute-ego2": 0.1591370868047608, "agent_compute-ego3": 0.03831398040428447, "complete-iteration": 1.2004112778456384, "set_robot_commands": 0.008294758054239368, "deviation-center-line": 2.21270469070099, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.04235972433066388, "sim_compute_performance-ego0": 0.00686232731999406, "sim_compute_performance-ego1": 0.006694337112718975, "sim_compute_performance-ego2": 0.006850428624911471, "sim_compute_performance-ego3": 0.006641216818041647}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 9.72626589964062, "get_ui_image": 0.08471412821475116, "step_physics": 0.4272566685370859, "survival_time": 59.99999999999873, "driven_lanedir": 9.353054935299856, "get_state_dump": 0.030562419875476084, "get_robot_state": 0.050260418360676, "sim_render-ego0": 0.010204705270899029, "sim_render-ego1": 0.010462489949972007, "sim_render-ego2": 0.01070188523132934, "sim_render-ego3": 0.010642502131211968, "get_duckie_state": 3.4623300900169457e-06, "in-drivable-lane": 0.0, "deviation-heading": 16.26552061207155, "agent_compute-ego0": 0.22294257106034585, "agent_compute-ego1": 0.03766481028706902, "agent_compute-ego2": 0.21234967011793965, "agent_compute-ego3": 0.0381146489730187, "complete-iteration": 1.256145015148001, "set_robot_commands": 0.007659921439660777, "deviation-center-line": 4.9619007120249305, "driven_lanedir_consec": 9.353054935299856, "sim_compute_sim_state": 0.04972165212543878, "sim_compute_performance-ego0": 0.006418228943480937, "sim_compute_performance-ego1": 0.00654880768254238, "sim_compute_performance-ego2": 0.006588091163412915, "sim_compute_performance-ego3": 0.006337830665010299}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.329070518200751e-13, "get_ui_image": 0.08471412821475116, "step_physics": 0.4272566685370859, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "get_state_dump": 0.030562419875476084, "get_robot_state": 0.050260418360676, "sim_render-ego0": 0.010204705270899029, "sim_render-ego1": 0.010462489949972007, "sim_render-ego2": 0.01070188523132934, "sim_render-ego3": 0.010642502131211968, "get_duckie_state": 3.4623300900169457e-06, "in-drivable-lane": 0.0, "deviation-heading": 38.80490591250653, "agent_compute-ego0": 0.22294257106034585, "agent_compute-ego1": 0.03766481028706902, "agent_compute-ego2": 0.21234967011793965, "agent_compute-ego3": 0.0381146489730187, "complete-iteration": 1.256145015148001, "set_robot_commands": 0.007659921439660777, "deviation-center-line": 2.606383566640205, "driven_lanedir_consec": -0.000286102294921875, "sim_compute_sim_state": 0.04972165212543878, "sim_compute_performance-ego0": 0.006418228943480937, "sim_compute_performance-ego1": 0.00654880768254238, "sim_compute_performance-ego2": 0.006588091163412915, "sim_compute_performance-ego3": 0.006337830665010299}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.9777815525184677, "get_ui_image": 0.08471412821475116, "step_physics": 0.4272566685370859, "survival_time": 59.99999999999873, "driven_lanedir": 2.489423858012384, "get_state_dump": 0.030562419875476084, "get_robot_state": 0.050260418360676, "sim_render-ego0": 0.010204705270899029, "sim_render-ego1": 0.010462489949972007, "sim_render-ego2": 0.01070188523132934, "sim_render-ego3": 0.010642502131211968, "get_duckie_state": 3.4623300900169457e-06, "in-drivable-lane": 0.849999999999997, "deviation-heading": 19.73812547292887, "agent_compute-ego0": 0.22294257106034585, "agent_compute-ego1": 0.03766481028706902, "agent_compute-ego2": 0.21234967011793965, "agent_compute-ego3": 0.0381146489730187, "complete-iteration": 1.256145015148001, "set_robot_commands": 0.007659921439660777, "deviation-center-line": 7.500187226965744, "driven_lanedir_consec": 2.489423858012384, "sim_compute_sim_state": 0.04972165212543878, "sim_compute_performance-ego0": 0.006418228943480937, "sim_compute_performance-ego1": 0.00654880768254238, "sim_compute_performance-ego2": 0.006588091163412915, "sim_compute_performance-ego3": 0.006337830665010299}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.9790409838966753e-13, "get_ui_image": 0.08471412821475116, "step_physics": 0.4272566685370859, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.030562419875476084, "get_robot_state": 0.050260418360676, "sim_render-ego0": 0.010204705270899029, "sim_render-ego1": 0.010462489949972007, "sim_render-ego2": 0.01070188523132934, "sim_render-ego3": 0.010642502131211968, "get_duckie_state": 3.4623300900169457e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.964796853103255, "agent_compute-ego0": 0.22294257106034585, "agent_compute-ego1": 0.03766481028706902, "agent_compute-ego2": 0.21234967011793965, "agent_compute-ego3": 0.0381146489730187, "complete-iteration": 1.256145015148001, "set_robot_commands": 0.007659921439660777, "deviation-center-line": 3.2098017198744695, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.04972165212543878, "sim_compute_performance-ego0": 0.006418228943480937, "sim_compute_performance-ego1": 0.00654880768254238, "sim_compute_performance-ego2": 0.006588091163412915, "sim_compute_performance-ego3": 0.006337830665010299}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 5.270704234944433, "get_ui_image": 0.08187986729191798, "step_physics": 0.5950813704845952, "survival_time": 12.700000000000044, "driven_lanedir": 4.49464611723147, "get_state_dump": 0.04026377621818991, "get_robot_state": 0.05464455380159266, "sim_render-ego0": 0.012552086512247722, "sim_render-ego1": 0.010468915864533067, "sim_render-ego2": 0.010650297239714978, "sim_render-ego3": 0.010674629024430816, "get_duckie_state": 3.28363156786152e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 2.28731331140795, "agent_compute-ego0": 0.24000412062102672, "agent_compute-ego1": 0.03877882022483676, "agent_compute-ego2": 0.23498543758018345, "agent_compute-ego3": 0.04302086456149232, "complete-iteration": 1.5142723018047857, "set_robot_commands": 0.007952696669335459, "deviation-center-line": 0.8043026222351887, "driven_lanedir_consec": 4.49464611723147, "sim_compute_sim_state": 0.07334350978626925, "sim_compute_performance-ego0": 0.007152248831356273, "sim_compute_performance-ego1": 0.006575618070714614, "sim_compute_performance-ego2": 0.00842273095074822, "sim_compute_performance-ego3": 0.007263811896829044}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 5.639932965095795e-14, "get_ui_image": 0.08187986729191798, "step_physics": 0.5950813704845952, "survival_time": 12.700000000000044, "driven_lanedir": 0.0, "get_state_dump": 0.04026377621818991, "get_robot_state": 0.05464455380159266, "sim_render-ego0": 0.012552086512247722, "sim_render-ego1": 0.010468915864533067, "sim_render-ego2": 0.010650297239714978, "sim_render-ego3": 0.010674629024430816, "get_duckie_state": 3.28363156786152e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.7146887731741705, "agent_compute-ego0": 0.24000412062102672, "agent_compute-ego1": 0.03877882022483676, "agent_compute-ego2": 0.23498543758018345, "agent_compute-ego3": 0.04302086456149232, "complete-iteration": 1.5142723018047857, "set_robot_commands": 0.007952696669335459, "deviation-center-line": 0.08530737033241198, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.07334350978626925, "sim_compute_performance-ego0": 0.007152248831356273, "sim_compute_performance-ego1": 0.006575618070714614, "sim_compute_performance-ego2": 0.00842273095074822, "sim_compute_performance-ego3": 0.007263811896829044}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.729232631032232, "get_ui_image": 0.08187986729191798, "step_physics": 0.5950813704845952, "survival_time": 12.700000000000044, "driven_lanedir": 3.294210680246434, "get_state_dump": 0.04026377621818991, "get_robot_state": 0.05464455380159266, "sim_render-ego0": 0.012552086512247722, "sim_render-ego1": 0.010468915864533067, "sim_render-ego2": 0.010650297239714978, "sim_render-ego3": 0.010674629024430816, "get_duckie_state": 3.28363156786152e-06, "in-drivable-lane": 5.1000000000000645, "deviation-heading": 1.3688503493485529, "agent_compute-ego0": 0.24000412062102672, "agent_compute-ego1": 0.03877882022483676, "agent_compute-ego2": 0.23498543758018345, "agent_compute-ego3": 0.04302086456149232, "complete-iteration": 1.5142723018047857, "set_robot_commands": 0.007952696669335459, "deviation-center-line": 0.34765936820348353, "driven_lanedir_consec": 3.294210680246434, "sim_compute_sim_state": 0.07334350978626925, "sim_compute_performance-ego0": 0.007152248831356273, "sim_compute_performance-ego1": 0.006575618070714614, "sim_compute_performance-ego2": 0.00842273095074822, "sim_compute_performance-ego3": 0.007263811896829044}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.639932965095795e-14, "get_ui_image": 0.08187986729191798, "step_physics": 0.5950813704845952, "survival_time": 12.700000000000044, "driven_lanedir": 6.0558319091796875e-05, "get_state_dump": 0.04026377621818991, "get_robot_state": 0.05464455380159266, "sim_render-ego0": 0.012552086512247722, "sim_render-ego1": 0.010468915864533067, "sim_render-ego2": 0.010650297239714978, "sim_render-ego3": 0.010674629024430816, "get_duckie_state": 3.28363156786152e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.4338929306734527, "agent_compute-ego0": 0.24000412062102672, "agent_compute-ego1": 0.03877882022483676, "agent_compute-ego2": 0.23498543758018345, "agent_compute-ego3": 0.04302086456149232, "complete-iteration": 1.5142723018047857, "set_robot_commands": 0.007952696669335459, "deviation-center-line": 0.6023114928512062, "driven_lanedir_consec": 6.0558319091796875e-05, "sim_compute_sim_state": 0.07334350978626925, "sim_compute_performance-ego0": 0.007152248831356273, "sim_compute_performance-ego1": 0.006575618070714614, "sim_compute_performance-ego2": 0.00842273095074822, "sim_compute_performance-ego3": 0.007263811896829044}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 27.395737872430356, "get_ui_image": 0.05725063511374392, "step_physics": 0.2629595777573534, "survival_time": 59.99999999999873, "driven_lanedir": 25.69035075075112, "get_state_dump": 0.023407183916344432, "get_robot_state": 0.025394165545677166, "sim_render-ego0": 0.010754347840117771, "sim_render-ego1": 0.0108787503270285, "get_duckie_state": 3.0849498078586854e-06, "in-drivable-lane": 2.499999999999967, "deviation-heading": 9.106857624698092, "agent_compute-ego0": 0.2295067145564375, "agent_compute-ego1": 0.03910100847160092, "complete-iteration": 0.7180212868143379, "set_robot_commands": 0.007769006376560284, "deviation-center-line": 4.357815853410368, "driven_lanedir_consec": 25.69035075075112, "sim_compute_sim_state": 0.02810478905257734, "sim_compute_performance-ego0": 0.0070916746776368, "sim_compute_performance-ego1": 0.006243799052369485}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.05725063511374392, "step_physics": 0.2629595777573534, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.023407183916344432, "get_robot_state": 0.025394165545677166, "sim_render-ego0": 0.010754347840117771, "sim_render-ego1": 0.0108787503270285, "get_duckie_state": 3.0849498078586854e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.638055070637492, "agent_compute-ego0": 0.2295067145564375, "agent_compute-ego1": 0.03910100847160092, "complete-iteration": 0.7180212868143379, "set_robot_commands": 0.007769006376560284, "deviation-center-line": 1.4062991066696908, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02810478905257734, "sim_compute_performance-ego0": 0.0070916746776368, "sim_compute_performance-ego1": 0.006243799052369485}}
set_robot_commands_max0.008294758054239368
set_robot_commands_mean0.007940536957575925
set_robot_commands_median0.007952696669335459
set_robot_commands_min0.007659921439660777
sim_compute_performance-ego0_max0.007152248831356273
sim_compute_performance-ego0_mean0.006851040695328478
sim_compute_performance-ego0_median0.00686232731999406
sim_compute_performance-ego0_min0.006418228943480937
sim_compute_performance-ego1_max0.006694337112718975
sim_compute_performance-ego1_mean0.0065544749691887755
sim_compute_performance-ego1_median0.006575618070714614
sim_compute_performance-ego1_min0.006243799052369485
sim_compute_sim_state_max0.07334350978626925
sim_compute_sim_state_mean0.05127922307676015
sim_compute_sim_state_median0.04972165212543878
sim_compute_sim_state_min0.02810478905257734
sim_render-ego0_max0.012552086512247722
sim_render-ego0_mean0.01127550007070795
sim_render-ego0_median0.01133028454427219
sim_render-ego0_min0.010204705270899029
sim_render-ego1_max0.010984775128709982
sim_render-ego1_mean0.010673016030494089
sim_render-ego1_median0.010468915864533067
sim_render-ego1_min0.010462489949972007
simulation-passed1
step_physics_max0.5950813704845952
step_physics_mean0.46264453339417194
step_physics_median0.4654380389792437
step_physics_min0.2629595777573534
survival_time_max59.99999999999873
survival_time_mean46.48571428571339
survival_time_min12.700000000000044

Highlights

62320

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.