Duckietown Challenges Home Challenges Submissions

Job 59118

Job ID59118
submission12895
userAleksei Shpilman 🇷🇺
user labelsim2real
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration2:12:03
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0793110952426876
survival_time_median59.99999999999873
deviation-center-line_median2.9968775530699503
in-drivable-lane_median17.624999999999588


other stats
agent_compute-ego0_max0.05255477950535249
agent_compute-ego0_mean0.05067772734518027
agent_compute-ego0_median0.05165053227858976
agent_compute-ego0_min0.0478476688895427
agent_compute-ego1_max0.052134643883431184
agent_compute-ego1_mean0.050437164714119145
agent_compute-ego1_median0.051342441477843066
agent_compute-ego1_min0.048550996256311374
agent_compute-ego2_max0.054331811044138735
agent_compute-ego2_mean0.05305206931170045
agent_compute-ego2_median0.052585538082773935
agent_compute-ego2_min0.05223885880818871
agent_compute-ego3_max0.05240626716296143
agent_compute-ego3_mean0.051524671554036054
agent_compute-ego3_median0.05155031210576168
agent_compute-ego3_min0.05061743539338505
complete-iteration_max1.4592994990495718
complete-iteration_mean1.1648178986851243
complete-iteration_median1.2802771668350763
complete-iteration_min0.39168601808413656
deviation-center-line_max10.24556664759864
deviation-center-line_mean3.404814634643923
deviation-center-line_min0.24297859927378695
deviation-heading_max31.533519092775283
deviation-heading_mean12.891441136254125
deviation-heading_median16.098718740560123
deviation-heading_min0.7277294155002664
driven_any_max11.010396919070487
driven_any_mean5.368658803561729
driven_any_median2.3022075219863467
driven_any_min0.6870486987762601
driven_lanedir_consec_max5.343591978584582
driven_lanedir_consec_mean1.992804288749336
driven_lanedir_consec_min0.29928197997933803
driven_lanedir_max7.720442213709134
driven_lanedir_mean2.9043542044582225
driven_lanedir_median1.3344812335493277
driven_lanedir_min0.29928197997933803
get_duckie_state_max2.4060226300673917e-06
get_duckie_state_mean2.0801132993825127e-06
get_duckie_state_median2.271031261383743e-06
get_duckie_state_min1.591695866114657e-06
get_robot_state_max0.014506296551694085
get_robot_state_mean0.0131734205277851
get_robot_state_median0.014079149517786693
get_robot_state_min0.006894547334859069
get_state_dump_max0.00984743433530682
get_state_dump_mean0.009133717789291748
get_state_dump_median0.009643748439817404
get_state_dump_min0.006001036771586243
get_ui_image_max0.04978481557942945
get_ui_image_mean0.04410708427621325
get_ui_image_median0.04733006761631898
get_ui_image_min0.029286207447589283
in-drivable-lane_max55.94999999999874
in-drivable-lane_mean22.37499999999943
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9337210466413064, "get_ui_image": 0.042616808047203296, "step_physics": 0.8234511565209229, "survival_time": 59.99999999999873, "driven_lanedir": 0.6816245684320954, "get_state_dump": 0.009643748439817404, "get_robot_state": 0.014079149517786693, "sim_render-ego0": 0.0037607586850333862, "sim_render-ego1": 0.0036076328141008383, "sim_render-ego2": 0.003624490059781928, "sim_render-ego3": 0.003791585949239485, "get_duckie_state": 1.8074947233303304e-06, "in-drivable-lane": 55.94999999999874, "deviation-heading": 0.7277294155002664, "agent_compute-ego0": 0.04924289947941738, "agent_compute-ego1": 0.048550996256311374, "agent_compute-ego2": 0.052585538082773935, "agent_compute-ego3": 0.05155031210576168, "complete-iteration": 1.1414429704712197, "set_robot_commands": 0.002255394893522366, "deviation-center-line": 0.4587402002467939, "driven_lanedir_consec": 0.6816245684320954, "sim_compute_sim_state": 0.018053172331467755, "sim_compute_performance-ego0": 0.0019535678907993135, "sim_compute_performance-ego1": 0.0019159047033864196, "sim_compute_performance-ego2": 0.0018365956861510263, "sim_compute_performance-ego3": 0.002063346445113793}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.010396919070487, "get_ui_image": 0.042616808047203296, "step_physics": 0.8234511565209229, "survival_time": 59.99999999999873, "driven_lanedir": 5.904523914252097, "get_state_dump": 0.009643748439817404, "get_robot_state": 0.014079149517786693, "sim_render-ego0": 0.0037607586850333862, "sim_render-ego1": 0.0036076328141008383, "sim_render-ego2": 0.003624490059781928, "sim_render-ego3": 0.003791585949239485, "get_duckie_state": 1.8074947233303304e-06, "in-drivable-lane": 25.599999999998637, "deviation-heading": 10.358870491221612, "agent_compute-ego0": 0.04924289947941738, "agent_compute-ego1": 0.048550996256311374, "agent_compute-ego2": 0.052585538082773935, "agent_compute-ego3": 0.05155031210576168, "complete-iteration": 1.1414429704712197, "set_robot_commands": 0.002255394893522366, "deviation-center-line": 3.6570715543793786, "driven_lanedir_consec": 3.6314276997403754, "sim_compute_sim_state": 0.018053172331467755, "sim_compute_performance-ego0": 0.0019535678907993135, "sim_compute_performance-ego1": 0.0019159047033864196, "sim_compute_performance-ego2": 0.0018365956861510263, "sim_compute_performance-ego3": 0.002063346445113793}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 0.9764856763697096, "get_ui_image": 0.042616808047203296, "step_physics": 0.8234511565209229, "survival_time": 59.99999999999873, "driven_lanedir": 0.9433614637559622, "get_state_dump": 0.009643748439817404, "get_robot_state": 0.014079149517786693, "sim_render-ego0": 0.0037607586850333862, "sim_render-ego1": 0.0036076328141008383, "sim_render-ego2": 0.003624490059781928, "sim_render-ego3": 0.003791585949239485, "get_duckie_state": 1.8074947233303304e-06, "in-drivable-lane": 54.54999999999874, "deviation-heading": 1.2940119053211818, "agent_compute-ego0": 0.04924289947941738, "agent_compute-ego1": 0.048550996256311374, "agent_compute-ego2": 0.052585538082773935, "agent_compute-ego3": 0.05155031210576168, "complete-iteration": 1.1414429704712197, "set_robot_commands": 0.002255394893522366, "deviation-center-line": 0.4203754322861776, "driven_lanedir_consec": 0.9433614637559622, "sim_compute_sim_state": 0.018053172331467755, "sim_compute_performance-ego0": 0.0019535678907993135, "sim_compute_performance-ego1": 0.0019159047033864196, "sim_compute_performance-ego2": 0.0018365956861510263, "sim_compute_performance-ego3": 0.002063346445113793}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.749223876382851, "get_ui_image": 0.042616808047203296, "step_physics": 0.8234511565209229, "survival_time": 59.99999999999873, "driven_lanedir": 5.4139631719724655, "get_state_dump": 0.009643748439817404, "get_robot_state": 0.014079149517786693, "sim_render-ego0": 0.0037607586850333862, "sim_render-ego1": 0.0036076328141008383, "sim_render-ego2": 0.003624490059781928, "sim_render-ego3": 0.003791585949239485, "get_duckie_state": 1.8074947233303304e-06, "in-drivable-lane": 21.799999999999457, "deviation-heading": 22.1408802013248, "agent_compute-ego0": 0.04924289947941738, "agent_compute-ego1": 0.048550996256311374, "agent_compute-ego2": 0.052585538082773935, "agent_compute-ego3": 0.05155031210576168, "complete-iteration": 1.1414429704712197, "set_robot_commands": 0.002255394893522366, "deviation-center-line": 3.86745467654936, "driven_lanedir_consec": 2.808473298574261, "sim_compute_sim_state": 0.018053172331467755, "sim_compute_performance-ego0": 0.0019535678907993135, "sim_compute_performance-ego1": 0.0019159047033864196, "sim_compute_performance-ego2": 0.0018365956861510263, "sim_compute_performance-ego3": 0.002063346445113793}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.5333254806117596, "get_ui_image": 0.04978481557942945, "step_physics": 0.935477634552218, "survival_time": 59.99999999999873, "driven_lanedir": 0.9252296844781304, "get_state_dump": 0.009476311101603766, "get_robot_state": 0.014074252110337537, "sim_render-ego0": 0.003734879053006263, "sim_render-ego1": 0.0037073551069985423, "sim_render-ego2": 0.0036243157621029514, "sim_render-ego3": 0.003777704667687714, "get_duckie_state": 2.271031261383743e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 16.931901511479634, "agent_compute-ego0": 0.05255477950535249, "agent_compute-ego1": 0.051342441477843066, "agent_compute-ego2": 0.054331811044138735, "agent_compute-ego3": 0.05240626716296143, "complete-iteration": 1.2802771668350763, "set_robot_commands": 0.00237261941292006, "deviation-center-line": 7.725172491497414, "driven_lanedir_consec": 0.9252296844781304, "sim_compute_sim_state": 0.02896753377858844, "sim_compute_performance-ego0": 0.001962172399452584, "sim_compute_performance-ego1": 0.0019828096019735343, "sim_compute_performance-ego2": 0.0018919526686974112, "sim_compute_performance-ego3": 0.001971840560684394}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 10.69434150041748, "get_ui_image": 0.04978481557942945, "step_physics": 0.935477634552218, "survival_time": 59.99999999999873, "driven_lanedir": 4.667913526668059, "get_state_dump": 0.009476311101603766, "get_robot_state": 0.014074252110337537, "sim_render-ego0": 0.003734879053006263, "sim_render-ego1": 0.0037073551069985423, "sim_render-ego2": 0.0036243157621029514, "sim_render-ego3": 0.003777704667687714, "get_duckie_state": 2.271031261383743e-06, "in-drivable-lane": 27.399999999999203, "deviation-heading": 18.37631127412946, "agent_compute-ego0": 0.05255477950535249, "agent_compute-ego1": 0.051342441477843066, "agent_compute-ego2": 0.054331811044138735, "agent_compute-ego3": 0.05240626716296143, "complete-iteration": 1.2802771668350763, "set_robot_commands": 0.00237261941292006, "deviation-center-line": 2.7774127393023607, "driven_lanedir_consec": 3.605057240369979, "sim_compute_sim_state": 0.02896753377858844, "sim_compute_performance-ego0": 0.001962172399452584, "sim_compute_performance-ego1": 0.0019828096019735343, "sim_compute_performance-ego2": 0.0018919526686974112, "sim_compute_performance-ego3": 0.001971840560684394}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 10.816147090320705, "get_ui_image": 0.04978481557942945, "step_physics": 0.935477634552218, "survival_time": 59.99999999999873, "driven_lanedir": 7.720442213709134, "get_state_dump": 0.009476311101603766, "get_robot_state": 0.014074252110337537, "sim_render-ego0": 0.003734879053006263, "sim_render-ego1": 0.0037073551069985423, "sim_render-ego2": 0.0036243157621029514, "sim_render-ego3": 0.003777704667687714, "get_duckie_state": 2.271031261383743e-06, "in-drivable-lane": 13.44999999999972, "deviation-heading": 15.265535969640617, "agent_compute-ego0": 0.05255477950535249, "agent_compute-ego1": 0.051342441477843066, "agent_compute-ego2": 0.054331811044138735, "agent_compute-ego3": 0.05240626716296143, "complete-iteration": 1.2802771668350763, "set_robot_commands": 0.00237261941292006, "deviation-center-line": 4.243734050006404, "driven_lanedir_consec": 5.343591978584582, "sim_compute_sim_state": 0.02896753377858844, "sim_compute_performance-ego0": 0.001962172399452584, "sim_compute_performance-ego1": 0.0019828096019735343, "sim_compute_performance-ego2": 0.0018919526686974112, "sim_compute_performance-ego3": 0.001971840560684394}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.4865397947300252, "get_ui_image": 0.04978481557942945, "step_physics": 0.935477634552218, "survival_time": 59.99999999999873, "driven_lanedir": 0.9436306997052626, "get_state_dump": 0.009476311101603766, "get_robot_state": 0.014074252110337537, "sim_render-ego0": 0.003734879053006263, "sim_render-ego1": 0.0037073551069985423, "sim_render-ego2": 0.0036243157621029514, "sim_render-ego3": 0.003777704667687714, "get_duckie_state": 2.271031261383743e-06, "in-drivable-lane": 54.099999999998744, "deviation-heading": 1.525264876522603, "agent_compute-ego0": 0.05255477950535249, "agent_compute-ego1": 0.051342441477843066, "agent_compute-ego2": 0.054331811044138735, "agent_compute-ego3": 0.05240626716296143, "complete-iteration": 1.2802771668350763, "set_robot_commands": 0.00237261941292006, "deviation-center-line": 0.2776049815543288, "driven_lanedir_consec": 0.9436306997052626, "sim_compute_sim_state": 0.02896753377858844, "sim_compute_performance-ego0": 0.001962172399452584, "sim_compute_performance-ego1": 0.0019828096019735343, "sim_compute_performance-ego2": 0.0018919526686974112, "sim_compute_performance-ego3": 0.001971840560684394}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.6870486987762601, "get_ui_image": 0.04733006761631898, "step_physics": 1.1210852167588488, "survival_time": 59.99999999999873, "driven_lanedir": 0.6668966154939593, "get_state_dump": 0.00984743433530682, "get_robot_state": 0.014506296551694085, "sim_render-ego0": 0.003968539583395165, "sim_render-ego1": 0.0039816462527107535, "sim_render-ego2": 0.003921355732672419, "sim_render-ego3": 0.003864795143260845, "get_duckie_state": 2.4060226300673917e-06, "in-drivable-lane": 0.0, "deviation-heading": 21.312297503894907, "agent_compute-ego0": 0.05165053227858976, "agent_compute-ego1": 0.052134643883431184, "agent_compute-ego2": 0.05223885880818871, "agent_compute-ego3": 0.05061743539338505, "complete-iteration": 1.4592994990495718, "set_robot_commands": 0.002232264321015141, "deviation-center-line": 10.24556664759864, "driven_lanedir_consec": 0.6668966154939593, "sim_compute_sim_state": 0.0257305169879745, "sim_compute_performance-ego0": 0.002132746897371087, "sim_compute_performance-ego1": 0.0021643668388347643, "sim_compute_performance-ego2": 0.002095481735979091, "sim_compute_performance-ego3": 0.002156350932252298}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 10.3654378804983, "get_ui_image": 0.04733006761631898, "step_physics": 1.1210852167588488, "survival_time": 59.99999999999873, "driven_lanedir": 6.270905019802407, "get_state_dump": 0.00984743433530682, "get_robot_state": 0.014506296551694085, "sim_render-ego0": 0.003968539583395165, "sim_render-ego1": 0.0039816462527107535, "sim_render-ego2": 0.003921355732672419, "sim_render-ego3": 0.003864795143260845, "get_duckie_state": 2.4060226300673917e-06, "in-drivable-lane": 11.449999999999736, "deviation-heading": 31.533519092775283, "agent_compute-ego0": 0.05165053227858976, "agent_compute-ego1": 0.052134643883431184, "agent_compute-ego2": 0.05223885880818871, "agent_compute-ego3": 0.05061743539338505, "complete-iteration": 1.4592994990495718, "set_robot_commands": 0.002232264321015141, "deviation-center-line": 3.0578422037283057, "driven_lanedir_consec": 3.684992203957401, "sim_compute_sim_state": 0.0257305169879745, "sim_compute_performance-ego0": 0.002132746897371087, "sim_compute_performance-ego1": 0.0021643668388347643, "sim_compute_performance-ego2": 0.002095481735979091, "sim_compute_performance-ego3": 0.002156350932252298}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.743749551543737, "get_ui_image": 0.04733006761631898, "step_physics": 1.1210852167588488, "survival_time": 59.99999999999873, "driven_lanedir": 0.7362623132412727, "get_state_dump": 0.00984743433530682, "get_robot_state": 0.014506296551694085, "sim_render-ego0": 0.003968539583395165, "sim_render-ego1": 0.0039816462527107535, "sim_render-ego2": 0.003921355732672419, "sim_render-ego3": 0.003864795143260845, "get_duckie_state": 2.4060226300673917e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.354016391784867, "agent_compute-ego0": 0.05165053227858976, "agent_compute-ego1": 0.052134643883431184, "agent_compute-ego2": 0.05223885880818871, "agent_compute-ego3": 0.05061743539338505, "complete-iteration": 1.4592994990495718, "set_robot_commands": 0.002232264321015141, "deviation-center-line": 6.75357945530495, "driven_lanedir_consec": 0.7362623132412727, "sim_compute_sim_state": 0.0257305169879745, "sim_compute_performance-ego0": 0.002132746897371087, "sim_compute_performance-ego1": 0.0021643668388347643, "sim_compute_performance-ego2": 0.002095481735979091, "sim_compute_performance-ego3": 0.002156350932252298}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 10.560390690528893, "get_ui_image": 0.04733006761631898, "step_physics": 1.1210852167588488, "survival_time": 59.99999999999873, "driven_lanedir": 3.76159192353154, "get_state_dump": 0.00984743433530682, "get_robot_state": 0.014506296551694085, "sim_render-ego0": 0.003968539583395165, "sim_render-ego1": 0.0039816462527107535, "sim_render-ego2": 0.003921355732672419, "sim_render-ego3": 0.003864795143260845, "get_duckie_state": 2.4060226300673917e-06, "in-drivable-lane": 31.799999999999073, "deviation-heading": 17.518428211521055, "agent_compute-ego0": 0.05165053227858976, "agent_compute-ego1": 0.052134643883431184, "agent_compute-ego2": 0.05223885880818871, "agent_compute-ego3": 0.05061743539338505, "complete-iteration": 1.4592994990495718, "set_robot_commands": 0.002232264321015141, "deviation-center-line": 2.935912902411595, "driven_lanedir_consec": 2.4144388053979746, "sim_compute_sim_state": 0.0257305169879745, "sim_compute_performance-ego0": 0.002132746897371087, "sim_compute_performance-ego1": 0.0021643668388347643, "sim_compute_performance-ego2": 0.002095481735979091, "sim_compute_performance-ego3": 0.002156350932252298}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 2.3547246576437764, "get_ui_image": 0.029286207447589283, "step_physics": 0.22769206594413435, "survival_time": 14.150000000000066, "driven_lanedir": 1.7253317673933928, "get_state_dump": 0.006001036771586243, "get_robot_state": 0.006894547334859069, "sim_render-ego0": 0.0035812695261458276, "sim_render-ego1": 0.003564121857495375, "get_duckie_state": 1.591695866114657e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 3.805332374238153, "agent_compute-ego0": 0.0478476688895427, "agent_compute-ego1": 0.049003989763662846, "complete-iteration": 0.39168601808413656, "set_robot_commands": 0.002030098941964163, "deviation-center-line": 1.003958950875432, "driven_lanedir_consec": 1.214991490780113, "sim_compute_sim_state": 0.00991145909672052, "sim_compute_performance-ego0": 0.0018362352545832244, "sim_compute_performance-ego1": 0.0018315441171887895}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.249690386328917, "get_ui_image": 0.029286207447589283, "step_physics": 0.22769206594413435, "survival_time": 14.150000000000066, "driven_lanedir": 0.29928197997933803, "get_state_dump": 0.006001036771586243, "get_robot_state": 0.006894547334859069, "sim_render-ego0": 0.0035812695261458276, "sim_render-ego1": 0.003564121857495375, "get_duckie_state": 1.591695866114657e-06, "in-drivable-lane": 11.450000000000047, "deviation-heading": 1.3360766882033086, "agent_compute-ego0": 0.0478476688895427, "agent_compute-ego1": 0.049003989763662846, "complete-iteration": 0.39168601808413656, "set_robot_commands": 0.002030098941964163, "deviation-center-line": 0.24297859927378695, "driven_lanedir_consec": 0.29928197997933803, "sim_compute_sim_state": 0.00991145909672052, "sim_compute_performance-ego0": 0.0018362352545832244, "sim_compute_performance-ego1": 0.0018315441171887895}}
set_robot_commands_max0.00237261941292006
set_robot_commands_mean0.0022500937424113285
set_robot_commands_median0.002255394893522366
set_robot_commands_min0.002030098941964163
sim_compute_performance-ego0_max0.002132746897371087
sim_compute_performance-ego0_mean0.001990458518547028
sim_compute_performance-ego0_median0.001962172399452584
sim_compute_performance-ego0_min0.0018362352545832244
sim_compute_performance-ego1_max0.0021643668388347643
sim_compute_performance-ego1_mean0.001993958057939746
sim_compute_performance-ego1_median0.0019828096019735343
sim_compute_performance-ego1_min0.0018315441171887895
sim_compute_performance-ego2_max0.002095481735979091
sim_compute_performance-ego2_mean0.001941343363609176
sim_compute_performance-ego2_median0.0018919526686974112
sim_compute_performance-ego2_min0.0018365956861510263
sim_compute_performance-ego3_max0.002156350932252298
sim_compute_performance-ego3_mean0.0020638459793501616
sim_compute_performance-ego3_median0.002063346445113793
sim_compute_performance-ego3_min0.001971840560684394
sim_compute_sim_state_max0.02896753377858844
sim_compute_sim_state_mean0.02220198647039742
sim_compute_sim_state_median0.0257305169879745
sim_compute_sim_state_min0.00991145909672052
sim_render-ego0_max0.003968539583395165
sim_render-ego0_mean0.003787089167002209
sim_render-ego0_median0.0037607586850333862
sim_render-ego0_min0.0035812695261458276
sim_render-ego1_max0.0039816462527107535
sim_render-ego1_mean0.003736770029302235
sim_render-ego1_median0.0037073551069985423
sim_render-ego1_min0.003564121857495375
sim_render-ego2_max0.003921355732672419
sim_render-ego2_mean0.003723387184852432
sim_render-ego2_median0.003624490059781928
sim_render-ego2_min0.0036243157621029514
sim_render-ego3_max0.003864795143260845
sim_render-ego3_mean0.003811361920062681
sim_render-ego3_median0.003791585949239485
sim_render-ego3_min0.003777704667687714
simulation-passed1
step_physics_max1.1210852167588488
step_physics_mean0.8553885830868732
step_physics_median0.935477634552218
step_physics_min0.22769206594413435
survival_time_max59.99999999999873
survival_time_mean53.44999999999892
survival_time_min14.150000000000066

Highlights

59118

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.