Duckietown Challenges Home Challenges Submissions

Submission 12718

Submission12718
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53684
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

53684

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53684LFVmultibodyv-simsuccessyes0:12:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6824877811914045
survival_time_median5.899999999999987
deviation-center-line_median0.12472377253302876
in-drivable-lane_median3.4999999999999876


other stats
agent_compute-ego0_max0.012178316116333007
agent_compute-ego0_mean0.011000330345112594
agent_compute-ego0_median0.011033596311296736
agent_compute-ego0_min0.01017746003735967
agent_compute-ego1_max0.012078871045793806
agent_compute-ego1_mean0.0108216133753077
agent_compute-ego1_median0.011034883771623883
agent_compute-ego1_min0.009664413928985595
complete-iteration_max0.7972103232429141
complete-iteration_mean0.658188720929618
complete-iteration_median0.7624323667798724
complete-iteration_min0.23830008268356323
deviation-center-line_max0.3720891524232108
deviation-center-line_mean0.14685622741377286
deviation-center-line_min0.05518112651933551
deviation-heading_max0.867080540349331
deviation-heading_mean0.5357711264887624
deviation-heading_median0.5079772825538268
deviation-heading_min0.26252044590060647
driven_any_max3.446854510378138
driven_any_mean1.820198672632691
driven_any_median1.6714945309441915
driven_any_min0.8190735567943087
driven_lanedir_consec_max1.3675792451083173
driven_lanedir_consec_mean0.7011373480211068
driven_lanedir_consec_min0.11975322687645118
driven_lanedir_max1.3675792451083173
driven_lanedir_mean0.7011373480211068
driven_lanedir_median0.6824877811914045
driven_lanedir_min0.11975322687645118
get_duckie_state_max1.7656598772321429e-06
get_duckie_state_mean1.6927556926701345e-06
get_duckie_state_median1.7075311569940477e-06
get_duckie_state_min1.633167266845703e-06
get_robot_state_max0.01467992878761612
get_robot_state_mean0.013493883787226131
get_robot_state_median0.014638430731637135
get_robot_state_min0.006981604099273682
get_state_dump_max0.0097919612371621
get_state_dump_mean0.009184248288090871
get_state_dump_median0.00963651248386928
get_state_dump_min0.006214036941528321
get_ui_image_max0.04678606305803571
get_ui_image_mean0.04267156967882062
get_ui_image_median0.04539528982979911
get_ui_image_min0.02907893657684326
in-drivable-lane_max7.7499999999999885
in-drivable-lane_mean4.346428571428561
in-drivable-lane_min2.499999999999991
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.6675608627969534, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 0.7346281785949911, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.469738838674098, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.09483029131067588, "driven_lanedir_consec": 0.7346281785949911, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.2509378169054304, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 1.3675792451083173, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 2.499999999999991, "deviation-heading": 0.6629283611959488, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.3720891524232108, "driven_lanedir_consec": 1.3675792451083173, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.6203586225454043, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 1.2561576430034282, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.5462157264335555, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.14039104003872624, "driven_lanedir_consec": 1.2561576430034282, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.667560862796993, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 0.719009961023402, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 3.899999999999986, "deviation-heading": 0.4254966176967258, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.07109220477049745, "driven_lanedir_consec": 0.719009961023402, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.3478761906085373, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7173980024822183, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 3.0499999999999914, "deviation-heading": 0.867080540349331, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.18524260463403516, "driven_lanedir_consec": 0.7173980024822183, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.413599166315601, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.11975322687645118, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 4.54999999999999, "deviation-heading": 0.41633267011024633, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.05518112651933551, "driven_lanedir_consec": 0.11975322687645118, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.8859035020838468, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9084889312577556, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.7560294458114469, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.2274030062822905, "driven_lanedir_consec": 0.9084889312577556, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.3478761906085472, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6255720679354082, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.7506184812162171, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.1970464118524351, "driven_lanedir_consec": 0.6255720679354082, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8190735567943087, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.204271039946744, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 7.7499999999999885, "deviation-heading": 0.5956547684236475, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.06316401342706499, "driven_lanedir_consec": 0.204271039946744, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.9291785515511695, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.6475775599005906, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 6.849999999999988, "deviation-heading": 0.26252044590060647, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.0775485848193056, "driven_lanedir_consec": 0.6475775599005906, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.446854510378138, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.5656387472941029, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 7.049999999999987, "deviation-heading": 0.2665393864559088, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.1858875809975676, "driven_lanedir_consec": 0.5656387472941029, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.6754281990913904, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.531623736296337, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 7.099999999999988, "deviation-heading": 0.3765924624405937, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.09654869044461176, "driven_lanedir_consec": 0.531623736296337, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7160571722130875, "get_ui_image": 0.02907893657684326, "step_physics": 0.1525096869468689, "survival_time": 4.94999999999999, "driven_lanedir": 0.7912652802573135, "get_state_dump": 0.006214036941528321, "get_robot_state": 0.006981604099273682, "sim_render-ego0": 0.003619782924652099, "sim_render-ego1": 0.003495771884918213, "get_duckie_state": 1.633167266845703e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.27730149789233977, "agent_compute-ego0": 0.010223567485809326, "agent_compute-ego1": 0.009664413928985595, "complete-iteration": 0.23830008268356323, "set_robot_commands": 0.0020589613914489746, "deviation-center-line": 0.1090565050273313, "driven_lanedir_consec": 0.7912652802573135, "sim_compute_sim_state": 0.008478713035583497, "sim_compute_performance-ego0": 0.0019676351547241212, "sim_compute_performance-ego1": 0.001837451457977295}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.694516212168272, "get_ui_image": 0.02907893657684326, "step_physics": 0.1525096869468689, "survival_time": 4.94999999999999, "driven_lanedir": 0.6269592523184353, "get_state_dump": 0.006214036941528321, "get_robot_state": 0.006981604099273682, "sim_render-ego0": 0.003619782924652099, "sim_render-ego1": 0.003495771884918213, "get_duckie_state": 1.633167266845703e-06, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 0.8277465282420078, "agent_compute-ego0": 0.010223567485809326, "agent_compute-ego1": 0.009664413928985595, "complete-iteration": 0.23830008268356323, "set_robot_commands": 0.0020589613914489746, "deviation-center-line": 0.18050597124573223, "driven_lanedir_consec": 0.6269592523184353, "sim_compute_sim_state": 0.008478713035583497, "sim_compute_performance-ego0": 0.0019676351547241212, "sim_compute_performance-ego1": 0.001837451457977295}}
set_robot_commands_max0.0022724537622360957
set_robot_commands_mean0.0022216239277006583
set_robot_commands_median0.002266080439591608
set_robot_commands_min0.0020589613914489746
sim_compute_performance-ego0_max0.0021678061712355843
sim_compute_performance-ego0_mean0.0021104896788885228
sim_compute_performance-ego0_median0.0021259985050233474
sim_compute_performance-ego0_min0.0019676351547241212
sim_compute_performance-ego1_max0.002007209687005906
sim_compute_performance-ego1_mean0.0019239361384431092
sim_compute_performance-ego1_median0.0019320399821305472
sim_compute_performance-ego1_min0.001837451457977295
sim_compute_sim_state_max0.03326393990289597
sim_compute_sim_state_mean0.02431572754796194
sim_compute_sim_state_median0.024229334182098133
sim_compute_sim_state_min0.008478713035583497
sim_render-ego0_max0.003981871831984747
sim_render-ego0_mean0.0038195989560298607
sim_render-ego0_median0.003831393378121512
sim_render-ego0_min0.003619782924652099
sim_render-ego1_max0.003835691724504743
sim_render-ego1_mean0.003744608772044279
sim_render-ego1_median0.003771884100777762
sim_render-ego1_min0.003495771884918213
simulation-passed1
step_physics_max0.6163659345536004
step_physics_mean0.49843920488555976
step_physics_median0.5911154447283063
step_physics_min0.1525096869468689
survival_time_max8.699999999999989
survival_time_mean6.364285714285702
survival_time_min4.94999999999999
No reset possible
53673LFVmultibodyv-simsuccessyes0:13:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible