Duckietown Challenges Home Challenges Submissions

Submission 12901

Submission12901
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59120
Next
User labelJetBrains Research
Admin priority50
Blessingn/a
User priority50

59120

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59120LFVmultibodyv-simsuccessyes1:49:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median18.231029679272407
survival_time_median59.99999999999873
deviation-center-line_median3.262719753236106
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01485653939989584
agent_compute-ego0_mean0.0146761517080277
agent_compute-ego0_median0.01469494004134433
agent_compute-ego0_min0.014444788925653693
agent_compute-ego1_max0.01473009933738486
agent_compute-ego1_mean0.01417932062309217
agent_compute-ego1_median0.013956247618752256
agent_compute-ego1_min0.013914326644757703
agent_compute-ego2_max0.014431229241186136
agent_compute-ego2_mean0.014179262690103415
agent_compute-ego2_median0.014405250350799688
agent_compute-ego2_min0.01370130847832444
agent_compute-ego3_max0.014239861506605824
agent_compute-ego3_mean0.014157176249364072
agent_compute-ego3_median0.014190028450272662
agent_compute-ego3_min0.014041638791213722
complete-iteration_max0.9586235355278732
complete-iteration_mean0.7928968226474213
complete-iteration_median0.8903303543395742
complete-iteration_min0.31455488162664513
deviation-center-line_max4.0861451827988144
deviation-center-line_mean3.0544551570589156
deviation-center-line_min0.9882263833241054
deviation-heading_max15.03745750166381
deviation-heading_mean11.133157757554557
deviation-heading_median12.172857530513324
deviation-heading_min4.09281972770327
driven_any_max22.18462349141272
driven_any_mean17.902375478940467
driven_any_median18.96590038086088
driven_any_min6.720508212568929
driven_lanedir_consec_max21.646711979450107
driven_lanedir_consec_mean17.157979356464562
driven_lanedir_consec_min6.43814216447139
driven_lanedir_max21.646711979450107
driven_lanedir_mean17.17979440387723
driven_lanedir_median18.231029679272407
driven_lanedir_min6.43814216447139
get_duckie_state_max1.2550226953206313e-06
get_duckie_state_mean1.1798265493487228e-06
get_duckie_state_median1.1504043845908032e-06
get_duckie_state_min1.137699314597048e-06
get_robot_state_max0.013876392283507132
get_robot_state_mean0.012821402776744404
get_robot_state_median0.013776776991120782
get_robot_state_min0.007100006429160513
get_state_dump_max0.009254363851682232
get_state_dump_mean0.008768681082215183
get_state_dump_median0.009223567953117682
get_state_dump_min0.006086679889991913
get_ui_image_max0.04854827816539958
get_ui_image_mean0.043618974278280195
get_ui_image_median0.04604786242374671
get_ui_image_min0.029814961215609195
in-drivable-lane_max9.999999999999432
in-drivable-lane_mean1.2928571428570803
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 21.628754146190506, "get_ui_image": 0.04316278877702978, "step_physics": 0.5877848670047884, "survival_time": 59.99999999999873, "driven_lanedir": 21.091657592114053, "get_state_dump": 0.009223567953117682, "get_robot_state": 0.013776776991120782, "sim_render-ego0": 0.003647700237493333, "sim_render-ego1": 0.0035904470232503796, "sim_render-ego2": 0.003575718670860119, "sim_render-ego3": 0.0035721624423621793, "get_duckie_state": 1.137699314597048e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.406957677836644, "agent_compute-ego0": 0.01469494004134433, "agent_compute-ego1": 0.013956247618752256, "agent_compute-ego2": 0.01370130847832444, "agent_compute-ego3": 0.014041638791213722, "complete-iteration": 0.768907548585204, "set_robot_commands": 0.002081387644504925, "deviation-center-line": 2.940594615315696, "driven_lanedir_consec": 21.091657592114053, "sim_compute_sim_state": 0.02829277326820494, "sim_compute_performance-ego0": 0.0018673743137610545, "sim_compute_performance-ego1": 0.0018318971924539608, "sim_compute_performance-ego2": 0.0018292888812875864, "sim_compute_performance-ego3": 0.0018228807616094864}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 22.004630999864705, "get_ui_image": 0.04316278877702978, "step_physics": 0.5877848670047884, "survival_time": 59.99999999999873, "driven_lanedir": 21.54986679479069, "get_state_dump": 0.009223567953117682, "get_robot_state": 0.013776776991120782, "sim_render-ego0": 0.003647700237493333, "sim_render-ego1": 0.0035904470232503796, "sim_render-ego2": 0.003575718670860119, "sim_render-ego3": 0.0035721624423621793, "get_duckie_state": 1.137699314597048e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.065439189162383, "agent_compute-ego0": 0.01469494004134433, "agent_compute-ego1": 0.013956247618752256, "agent_compute-ego2": 0.01370130847832444, "agent_compute-ego3": 0.014041638791213722, "complete-iteration": 0.768907548585204, "set_robot_commands": 0.002081387644504925, "deviation-center-line": 3.049256466116436, "driven_lanedir_consec": 21.54986679479069, "sim_compute_sim_state": 0.02829277326820494, "sim_compute_performance-ego0": 0.0018673743137610545, "sim_compute_performance-ego1": 0.0018318971924539608, "sim_compute_performance-ego2": 0.0018292888812875864, "sim_compute_performance-ego3": 0.0018228807616094864}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 16.226065845751247, "get_ui_image": 0.04316278877702978, "step_physics": 0.5877848670047884, "survival_time": 59.99999999999873, "driven_lanedir": 15.63568280846358, "get_state_dump": 0.009223567953117682, "get_robot_state": 0.013776776991120782, "sim_render-ego0": 0.003647700237493333, "sim_render-ego1": 0.0035904470232503796, "sim_render-ego2": 0.003575718670860119, "sim_render-ego3": 0.0035721624423621793, "get_duckie_state": 1.137699314597048e-06, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 13.268901522269068, "agent_compute-ego0": 0.01469494004134433, "agent_compute-ego1": 0.013956247618752256, "agent_compute-ego2": 0.01370130847832444, "agent_compute-ego3": 0.014041638791213722, "complete-iteration": 0.768907548585204, "set_robot_commands": 0.002081387644504925, "deviation-center-line": 3.942028170102242, "driven_lanedir_consec": 15.63568280846358, "sim_compute_sim_state": 0.02829277326820494, "sim_compute_performance-ego0": 0.0018673743137610545, "sim_compute_performance-ego1": 0.0018318971924539608, "sim_compute_performance-ego2": 0.0018292888812875864, "sim_compute_performance-ego3": 0.0018228807616094864}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 18.57331452543916, "get_ui_image": 0.04316278877702978, "step_physics": 0.5877848670047884, "survival_time": 59.99999999999873, "driven_lanedir": 18.226350633810434, "get_state_dump": 0.009223567953117682, "get_robot_state": 0.013776776991120782, "sim_render-ego0": 0.003647700237493333, "sim_render-ego1": 0.0035904470232503796, "sim_render-ego2": 0.003575718670860119, "sim_render-ego3": 0.0035721624423621793, "get_duckie_state": 1.137699314597048e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.257919211272801, "agent_compute-ego0": 0.01469494004134433, "agent_compute-ego1": 0.013956247618752256, "agent_compute-ego2": 0.01370130847832444, "agent_compute-ego3": 0.014041638791213722, "complete-iteration": 0.768907548585204, "set_robot_commands": 0.002081387644504925, "deviation-center-line": 2.617156626281965, "driven_lanedir_consec": 18.226350633810434, "sim_compute_sim_state": 0.02829277326820494, "sim_compute_performance-ego0": 0.0018673743137610545, "sim_compute_performance-ego1": 0.0018318971924539608, "sim_compute_performance-ego2": 0.0018292888812875864, "sim_compute_performance-ego3": 0.0018228807616094864}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 19.3584862362826, "get_ui_image": 0.04854827816539958, "step_physics": 0.7515844401471522, "survival_time": 59.99999999999873, "driven_lanedir": 18.23570872473438, "get_state_dump": 0.00916911203795726, "get_robot_state": 0.013876392283507132, "sim_render-ego0": 0.003635214528473688, "sim_render-ego1": 0.003586827070885753, "sim_render-ego2": 0.003557891273974975, "sim_render-ego3": 0.003545787709638737, "get_duckie_state": 1.1504043845908032e-06, "in-drivable-lane": 1.900000000000027, "deviation-heading": 13.636561523377546, "agent_compute-ego0": 0.014444788925653693, "agent_compute-ego1": 0.013914326644757703, "agent_compute-ego2": 0.014431229241186136, "agent_compute-ego3": 0.014190028450272662, "complete-iteration": 0.9586235355278732, "set_robot_commands": 0.0020675835859567102, "deviation-center-line": 4.0861451827988144, "driven_lanedir_consec": 18.23570872473438, "sim_compute_sim_state": 0.048293224480825105, "sim_compute_performance-ego0": 0.001869813290166418, "sim_compute_performance-ego1": 0.0018387416518796593, "sim_compute_performance-ego2": 0.001834382820288208, "sim_compute_performance-ego3": 0.0018284402223153475}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 20.036106812889916, "get_ui_image": 0.04854827816539958, "step_physics": 0.7515844401471522, "survival_time": 59.99999999999873, "driven_lanedir": 19.40098891234983, "get_state_dump": 0.00916911203795726, "get_robot_state": 0.013876392283507132, "sim_render-ego0": 0.003635214528473688, "sim_render-ego1": 0.003586827070885753, "sim_render-ego2": 0.003557891273974975, "sim_render-ego3": 0.003545787709638737, "get_duckie_state": 1.1504043845908032e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.04422541019026, "agent_compute-ego0": 0.014444788925653693, "agent_compute-ego1": 0.013914326644757703, "agent_compute-ego2": 0.014431229241186136, "agent_compute-ego3": 0.014190028450272662, "complete-iteration": 0.9586235355278732, "set_robot_commands": 0.0020675835859567102, "deviation-center-line": 3.821191282070484, "driven_lanedir_consec": 19.40098891234983, "sim_compute_sim_state": 0.048293224480825105, "sim_compute_performance-ego0": 0.001869813290166418, "sim_compute_performance-ego1": 0.0018387416518796593, "sim_compute_performance-ego2": 0.001834382820288208, "sim_compute_performance-ego3": 0.0018284402223153475}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 20.525970796867217, "get_ui_image": 0.04854827816539958, "step_physics": 0.7515844401471522, "survival_time": 59.99999999999873, "driven_lanedir": 19.926045135400987, "get_state_dump": 0.00916911203795726, "get_robot_state": 0.013876392283507132, "sim_render-ego0": 0.003635214528473688, "sim_render-ego1": 0.003586827070885753, "sim_render-ego2": 0.003557891273974975, "sim_render-ego3": 0.003545787709638737, "get_duckie_state": 1.1504043845908032e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.32159992800908, "agent_compute-ego0": 0.014444788925653693, "agent_compute-ego1": 0.013914326644757703, "agent_compute-ego2": 0.014431229241186136, "agent_compute-ego3": 0.014190028450272662, "complete-iteration": 0.9586235355278732, "set_robot_commands": 0.0020675835859567102, "deviation-center-line": 3.422808862344144, "driven_lanedir_consec": 19.926045135400987, "sim_compute_sim_state": 0.048293224480825105, "sim_compute_performance-ego0": 0.001869813290166418, "sim_compute_performance-ego1": 0.0018387416518796593, "sim_compute_performance-ego2": 0.001834382820288208, "sim_compute_performance-ego3": 0.0018284402223153475}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 17.896502240911992, "get_ui_image": 0.04854827816539958, "step_physics": 0.7515844401471522, "survival_time": 59.99999999999873, "driven_lanedir": 16.373044060037763, "get_state_dump": 0.00916911203795726, "get_robot_state": 0.013876392283507132, "sim_render-ego0": 0.003635214528473688, "sim_render-ego1": 0.003586827070885753, "sim_render-ego2": 0.003557891273974975, "sim_render-ego3": 0.003545787709638737, "get_duckie_state": 1.1504043845908032e-06, "in-drivable-lane": 5.499999999999687, "deviation-heading": 13.46418840180008, "agent_compute-ego0": 0.014444788925653693, "agent_compute-ego1": 0.013914326644757703, "agent_compute-ego2": 0.014431229241186136, "agent_compute-ego3": 0.014190028450272662, "complete-iteration": 0.9586235355278732, "set_robot_commands": 0.0020675835859567102, "deviation-center-line": 3.035379965224357, "driven_lanedir_consec": 16.067633396260383, "sim_compute_sim_state": 0.048293224480825105, "sim_compute_performance-ego0": 0.001869813290166418, "sim_compute_performance-ego1": 0.0018387416518796593, "sim_compute_performance-ego2": 0.001834382820288208, "sim_compute_performance-ego3": 0.0018284402223153475}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 21.039677885560543, "get_ui_image": 0.04604786242374671, "step_physics": 0.6879572213241997, "survival_time": 59.99999999999873, "driven_lanedir": 20.37388201325621, "get_state_dump": 0.009254363851682232, "get_robot_state": 0.013671737229397254, "sim_render-ego0": 0.003618221497357041, "sim_render-ego1": 0.003583819145564731, "sim_render-ego2": 0.0035493091977109124, "sim_render-ego3": 0.003548874843130501, "get_duckie_state": 1.2550226953206313e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.659416933302316, "agent_compute-ego0": 0.01485653939989584, "agent_compute-ego1": 0.01473009933738486, "agent_compute-ego2": 0.014405250350799688, "agent_compute-ego3": 0.014239861506605824, "complete-iteration": 0.8903303543395742, "set_robot_commands": 0.002058274342952223, "deviation-center-line": 3.484435726425748, "driven_lanedir_consec": 20.37388201325621, "sim_compute_sim_state": 0.04514815904615722, "sim_compute_performance-ego0": 0.0018507314661361095, "sim_compute_performance-ego1": 0.00182289644443026, "sim_compute_performance-ego2": 0.0018185532956595824, "sim_compute_performance-ego3": 0.001824573315152717}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 17.596645375669954, "get_ui_image": 0.04604786242374671, "step_physics": 0.6879572213241997, "survival_time": 59.99999999999873, "driven_lanedir": 15.759108596564388, "get_state_dump": 0.009254363851682232, "get_robot_state": 0.013671737229397254, "sim_render-ego0": 0.003618221497357041, "sim_render-ego1": 0.003583819145564731, "sim_render-ego2": 0.0035493091977109124, "sim_render-ego3": 0.003548874843130501, "get_duckie_state": 1.2550226953206313e-06, "in-drivable-lane": 9.999999999999432, "deviation-heading": 12.024115133017563, "agent_compute-ego0": 0.01485653939989584, "agent_compute-ego1": 0.01473009933738486, "agent_compute-ego2": 0.014405250350799688, "agent_compute-ego3": 0.014239861506605824, "complete-iteration": 0.8903303543395742, "set_robot_commands": 0.002058274342952223, "deviation-center-line": 3.1313518801503433, "driven_lanedir_consec": 15.759108596564388, "sim_compute_sim_state": 0.04514815904615722, "sim_compute_performance-ego0": 0.0018507314661361095, "sim_compute_performance-ego1": 0.00182289644443026, "sim_compute_performance-ego2": 0.0018185532956595824, "sim_compute_performance-ego3": 0.001824573315152717}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 18.34313246739112, "get_ui_image": 0.04604786242374671, "step_physics": 0.6879572213241997, "survival_time": 59.99999999999873, "driven_lanedir": 17.54174595006654, "get_state_dump": 0.009254363851682232, "get_robot_state": 0.013671737229397254, "sim_render-ego0": 0.003618221497357041, "sim_render-ego1": 0.003583819145564731, "sim_render-ego2": 0.0035493091977109124, "sim_render-ego3": 0.003548874843130501, "get_duckie_state": 1.2550226953206313e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.03745750166381, "agent_compute-ego0": 0.01485653939989584, "agent_compute-ego1": 0.01473009933738486, "agent_compute-ego2": 0.014405250350799688, "agent_compute-ego3": 0.014239861506605824, "complete-iteration": 0.8903303543395742, "set_robot_commands": 0.002058274342952223, "deviation-center-line": 3.394087626321869, "driven_lanedir_consec": 17.54174595006654, "sim_compute_sim_state": 0.04514815904615722, "sim_compute_performance-ego0": 0.0018507314661361095, "sim_compute_performance-ego1": 0.00182289644443026, "sim_compute_performance-ego2": 0.0018185532956595824, "sim_compute_performance-ego3": 0.001824573315152717}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 22.18462349141272, "get_ui_image": 0.04604786242374671, "step_physics": 0.6879572213241997, "survival_time": 59.99999999999873, "driven_lanedir": 21.646711979450107, "get_state_dump": 0.009254363851682232, "get_robot_state": 0.013671737229397254, "sim_render-ego0": 0.003618221497357041, "sim_render-ego1": 0.003583819145564731, "sim_render-ego2": 0.0035493091977109124, "sim_render-ego3": 0.003548874843130501, "get_duckie_state": 1.2550226953206313e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 10.69226511619574, "agent_compute-ego0": 0.01485653939989584, "agent_compute-ego1": 0.01473009933738486, "agent_compute-ego2": 0.014405250350799688, "agent_compute-ego3": 0.014239861506605824, "complete-iteration": 0.8903303543395742, "set_robot_commands": 0.002058274342952223, "deviation-center-line": 3.623512936399656, "driven_lanedir_consec": 21.646711979450107, "sim_compute_sim_state": 0.04514815904615722, "sim_compute_performance-ego0": 0.0018507314661361095, "sim_compute_performance-ego1": 0.00182289644443026, "sim_compute_performance-ego2": 0.0018185532956595824, "sim_compute_performance-ego3": 0.001824573315152717}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 8.49883766836592, "get_ui_image": 0.029814961215609195, "step_physics": 0.217328764646915, "survival_time": 22.500000000000185, "driven_lanedir": 8.318186288770931, "get_state_dump": 0.006086679889991913, "get_robot_state": 0.007100006429160513, "sim_render-ego0": 0.003698196220820865, "sim_render-ego1": 0.0035972283314707008, "get_duckie_state": 1.1725330564240923e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.09281972770327, "agent_compute-ego0": 0.014740525222406157, "agent_compute-ego1": 0.01405389715985554, "complete-iteration": 0.31455488162664513, "set_robot_commands": 0.0021056362372015637, "deviation-center-line": 1.2261964759489643, "driven_lanedir_consec": 8.318186288770931, "sim_compute_sim_state": 0.010029942391981309, "sim_compute_performance-ego0": 0.001885518795106469, "sim_compute_performance-ego1": 0.0018640035007586764}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 6.720508212568929, "get_ui_image": 0.029814961215609195, "step_physics": 0.217328764646915, "survival_time": 22.500000000000185, "driven_lanedir": 6.43814216447139, "get_state_dump": 0.006086679889991913, "get_robot_state": 0.007100006429160513, "sim_render-ego0": 0.003698196220820865, "sim_render-ego1": 0.0035972283314707008, "get_duckie_state": 1.1725330564240923e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.892341329963219, "agent_compute-ego0": 0.014740525222406157, "agent_compute-ego1": 0.01405389715985554, "complete-iteration": 0.31455488162664513, "set_robot_commands": 0.0021056362372015637, "deviation-center-line": 0.9882263833241054, "driven_lanedir_consec": 6.43814216447139, "sim_compute_sim_state": 0.010029942391981309, "sim_compute_performance-ego0": 0.001885518795106469, "sim_compute_performance-ego1": 0.0018640035007586764}}
set_robot_commands_max0.0021056362372015637
set_robot_commands_mean0.0020743039120041835
set_robot_commands_median0.0020675835859567102
set_robot_commands_min0.002058274342952223
sim_compute_performance-ego0_max0.001885518795106469
sim_compute_performance-ego0_mean0.0018659081336048048
sim_compute_performance-ego0_median0.0018673743137610545
sim_compute_performance-ego0_min0.0018507314661361095
sim_compute_performance-ego1_max0.0018640035007586764
sim_compute_performance-ego1_mean0.0018358677254694913
sim_compute_performance-ego1_median0.0018318971924539608
sim_compute_performance-ego1_min0.00182289644443026
sim_compute_performance-ego2_max0.001834382820288208
sim_compute_performance-ego2_mean0.0018274083324117917
sim_compute_performance-ego2_median0.0018292888812875864
sim_compute_performance-ego2_min0.0018185532956595824
sim_compute_performance-ego3_max0.0018284402223153475
sim_compute_performance-ego3_mean0.0018252980996925168
sim_compute_performance-ego3_median0.001824573315152717
sim_compute_performance-ego3_min0.0018228807616094864
sim_compute_sim_state_max0.048293224480825105
sim_compute_sim_state_mean0.036214036568907974
sim_compute_sim_state_median0.04514815904615722
sim_compute_sim_state_min0.010029942391981309
sim_render-ego0_max0.003698196220820865
sim_render-ego0_mean0.003642924106781285
sim_render-ego0_median0.003635214528473688
sim_render-ego0_min0.003618221497357041
sim_render-ego1_max0.0035972283314707008
sim_render-ego1_mean0.0035884878301246314
sim_render-ego1_median0.003586827070885753
sim_render-ego1_min0.003583819145564731
sim_render-ego2_max0.003575718670860119
sim_render-ego2_mean0.0035609730475153352
sim_render-ego2_median0.003557891273974975
sim_render-ego2_min0.0035493091977109124
sim_render-ego3_max0.0035721624423621793
sim_render-ego3_mean0.003555608331710474
sim_render-ego3_median0.003548874843130501
sim_render-ego3_min0.003545787709638737
simulation-passed1
step_physics_max0.7515844401471522
step_physics_mean0.6102831173713136
step_physics_median0.6879572213241997
step_physics_min0.217328764646915
survival_time_max59.99999999999873
survival_time_mean54.64285714285609
survival_time_min22.500000000000185
No reset possible