Duckietown Challenges Home Challenges Submissions

Submission 13192

Submission13192
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserYury Belousov 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60453
Next
User labelJetBrains Research2 sim2real v0.1.1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
60453LFVmultibodyv-simsuccessyes1:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8655971598025256
survival_time_median19.600000000000144
deviation-center-line_median1.6268780558120226
in-drivable-lane_median0.274999999999999


other stats
agent_compute-ego0_max0.031087946952450977
agent_compute-ego0_mean0.023632983965674977
agent_compute-ego0_median0.021211659759901372
agent_compute-ego0_min0.020139879032932257
agent_compute-ego1_max0.03184674350359968
agent_compute-ego1_mean0.02361036726393863
agent_compute-ego1_median0.02100579768295605
agent_compute-ego1_min0.019625128232515776
agent_compute-ego2_max0.03145027039311921
agent_compute-ego2_mean0.023966830248785553
agent_compute-ego2_median0.020356014061765553
agent_compute-ego2_min0.020094206291471888
agent_compute-ego3_max0.03163672646190071
agent_compute-ego3_mean0.02429424830456297
agent_compute-ego3_median0.02093150902585865
agent_compute-ego3_min0.020314509425929543
complete-iteration_max1.3648296421720785
complete-iteration_mean1.0946438219823402
complete-iteration_median1.2935909369307494
complete-iteration_min0.339378729233375
deviation-center-line_max7.669195331334856
deviation-center-line_mean2.011293575922879
deviation-center-line_min0.1994196711657981
deviation-heading_max57.472093656187674
deviation-heading_mean9.146032122990372
deviation-heading_median4.084601984518216
deviation-heading_min0.9971502618699504
driven_any_max16.619944521051437
driven_any_mean3.4458861972897705
driven_any_median1.9726509275585828
driven_any_min0.4800341099354089
driven_lanedir_consec_max8.886580244340138
driven_lanedir_consec_mean2.648437117141889
driven_lanedir_consec_min0.4315496430621055
driven_lanedir_max14.637370721964256
driven_lanedir_mean3.059207865543612
driven_lanedir_median1.8655971598025256
driven_lanedir_min0.4315496430621055
get_duckie_state_max1.346185310499662e-06
get_duckie_state_mean1.2730565247254098e-06
get_duckie_state_median1.345432645552386e-06
get_duckie_state_min1.13523923433744e-06
get_robot_state_max0.014054991892264591
get_robot_state_mean0.012966557676903532
get_robot_state_median0.014018095783301588
get_robot_state_min0.006956900083101712
get_state_dump_max0.009753162930120572
get_state_dump_mean0.00906247808598588
get_state_dump_median0.00960184842272266
get_state_dump_min0.006014125163738544
get_ui_image_max0.05133145334763078
get_ui_image_mean0.044882795264845746
get_ui_image_median0.046866154690567007
get_ui_image_min0.029436248999375563
in-drivable-lane_max8.85000000000004
in-drivable-lane_mean1.5214285714285698
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1969052958765884, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 1.1884375098132778, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.813600619584083, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 1.0600154228972154, "driven_lanedir_consec": 1.1884375098132778, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3276488057208167, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 3.02611567471936, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 2.7358400201402033, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 0.9986870261204484, "driven_lanedir_consec": 3.02611567471936, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.7826677516035536, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 0.580655948776158, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 8.85000000000004, "deviation-heading": 1.7009696531195329, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 0.1994196711657981, "driven_lanedir_consec": 0.580655948776158, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.8647729745710084, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 0.8242529279238888, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.692950907965249, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 0.9329501466830484, "driven_lanedir_consec": 0.8242529279238888, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.9900106682619505, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 4.658069253267681, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 4.4762530610711835, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.6924220500417957, "driven_lanedir_consec": 4.658069253267681, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.136956076778972, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 3.4453600404121634, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 2.050000000000013, "deviation-heading": 6.527925561877326, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.6854959477934797, "driven_lanedir_consec": 3.4453600404121634, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.4800341099354089, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 0.4315496430621055, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.19573932620768, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.5682601638305655, "driven_lanedir_consec": 0.4315496430621055, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.6932446185132177, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 0.6822722504838361, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.999253463699411, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.769391839464724, "driven_lanedir_consec": 0.6822722504838361, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 2.3358291917241853, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 2.253916589184453, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.071124256493012, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 1.73072899454825, "driven_lanedir_consec": 2.253916589184453, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 16.619944521051437, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 14.637370721964256, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 7.2499999999999165, "deviation-heading": 13.903344527988876, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 4.567504387740789, "driven_lanedir_consec": 8.886580244340138, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 6.35356476338459, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 5.948914100706613, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 0.899999999999997, "deviation-heading": 12.640649083524758, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 7.669195331334856, "driven_lanedir_consec": 5.948914100706613, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.9540249352358856, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 1.7827492308250514, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 0.549999999999998, "deviation-heading": 57.472093656187674, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 3.181860765760205, "driven_lanedir_consec": 1.7827492308250514, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.99127691988128, "get_ui_image": 0.029436248999375563, "step_physics": 0.23245514172774095, "survival_time": 6.449999999999985, "driven_lanedir": 1.9484450887799991, "get_state_dump": 0.006014125163738544, "get_robot_state": 0.006956900083101712, "sim_render-ego0": 0.003605860930222731, "sim_render-ego1": 0.0035300676639263445, "get_duckie_state": 1.13523923433744e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9971502618699504, "agent_compute-ego0": 0.02055191626915565, "agent_compute-ego1": 0.019625128232515776, "complete-iteration": 0.339378729233375, "set_robot_commands": 0.002063740216768705, "deviation-center-line": 0.5604820721310846, "driven_lanedir_consec": 1.9484450887799991, "sim_compute_sim_state": 0.009259297297551082, "sim_compute_performance-ego0": 0.0018545040717491735, "sim_compute_performance-ego1": 0.001848453741807204}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.515526129517892, "get_ui_image": 0.029436248999375563, "step_physics": 0.23245514172774095, "survival_time": 6.449999999999985, "driven_lanedir": 1.420801137691721, "get_state_dump": 0.006014125163738544, "get_robot_state": 0.006956900083101712, "sim_render-ego0": 0.003605860930222731, "sim_render-ego1": 0.0035300676639263445, "get_duckie_state": 1.13523923433744e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.817555322136281, "agent_compute-ego0": 0.02055191626915565, "agent_compute-ego1": 0.019625128232515776, "complete-iteration": 0.339378729233375, "set_robot_commands": 0.002063740216768705, "deviation-center-line": 0.5416962434080459, "driven_lanedir_consec": 1.420801137691721, "sim_compute_sim_state": 0.009259297297551082, "sim_compute_performance-ego0": 0.0018545040717491735, "sim_compute_performance-ego1": 0.001848453741807204}}
set_robot_commands_max0.002257088902580293
set_robot_commands_mean0.0021911837942575176
set_robot_commands_median0.002228727170832588
set_robot_commands_min0.002063740216768705
sim_compute_performance-ego0_max0.001937751551620833
sim_compute_performance-ego0_mean0.0019050771889788953
sim_compute_performance-ego0_median0.001922916079952509
sim_compute_performance-ego0_min0.0018545040717491735
sim_compute_performance-ego1_max0.0019748863837531
sim_compute_performance-ego1_mean0.001917627878717391
sim_compute_performance-ego1_median0.001916097927336171
sim_compute_performance-ego1_min0.001848453741807204
sim_compute_performance-ego2_max0.0019118864724350943
sim_compute_performance-ego2_mean0.0018912914557414435
sim_compute_performance-ego2_median0.0019033568528677913
sim_compute_performance-ego2_min0.0018586310419214456
sim_compute_performance-ego3_max0.0019399209786917415
sim_compute_performance-ego3_mean0.0019164089941536252
sim_compute_performance-ego3_median0.001931591152650192
sim_compute_performance-ego3_min0.001877714851118941
sim_compute_sim_state_max0.024866452350567923
sim_compute_sim_state_mean0.019414898281130955
sim_compute_sim_state_median0.020830009700257415
sim_compute_sim_state_min0.009259297297551082
sim_render-ego0_max0.003790846504116454
sim_render-ego0_mean0.003716371046462878
sim_render-ego0_median0.0037879076319493102
sim_render-ego0_min0.003605860930222731
sim_render-ego1_max0.003724340870786866
sim_render-ego1_mean0.003652836510527538
sim_render-ego1_median0.003696635550977778
sim_render-ego1_min0.0035300676639263445
sim_render-ego2_max0.003716520984057555
sim_render-ego2_mean0.0036449975774080217
sim_render-ego2_median0.003626264477171838
sim_render-ego2_min0.0035922072709946708
sim_render-ego3_max0.003729668890292219
sim_render-ego3_mean0.003685028746427577
sim_render-ego3_median0.0037031907768346577
sim_render-ego3_min0.003622226572155853
simulation-passed1
step_physics_max1.1074145756301683
step_physics_mean0.8907296494082722
step_physics_median1.0915161392075334
step_physics_min0.23245514172774095
survival_time_max59.99999999999873
survival_time_mean27.092857142856833
survival_time_min6.449999999999985
No reset possible