Duckietown Challenges Home Challenges Submissions

Submission 13250

Submission13250
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 61701
Next
User label202-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
61701LFVmultibodyv-simsuccessyes1:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.398907506434838
survival_time_median20.10000000000015
deviation-center-line_median1.5671049462018256
in-drivable-lane_median0.3749999999999989


other stats
agent_compute-ego0_max0.016065363903122253
agent_compute-ego0_mean0.015131835613164096
agent_compute-ego0_median0.014788037037273728
agent_compute-ego0_min0.014675845579237264
agent_compute-ego1_max0.015377384591772854
agent_compute-ego1_mean0.01483929354034117
agent_compute-ego1_median0.014802680122053652
agent_compute-ego1_min0.01445580680205562
agent_compute-ego2_max0.01587479181557774
agent_compute-ego2_mean0.014662307235029782
agent_compute-ego2_median0.01416067982429902
agent_compute-ego2_min0.013951450065212584
agent_compute-ego3_max0.01572377231705141
agent_compute-ego3_mean0.014866943691021137
agent_compute-ego3_median0.014586005381600842
agent_compute-ego3_min0.014291053374411156
complete-iteration_max1.2962204825926018
complete-iteration_mean0.9549186178212572
complete-iteration_median0.9852972207319528
complete-iteration_min0.3282095077302721
deviation-center-line_max4.182413368754524
deviation-center-line_mean2.1251365937942155
deviation-center-line_min0.357887996188914
deviation-heading_max9.627892435906524
deviation-heading_mean4.752917934745189
deviation-heading_median3.3060076887908445
deviation-heading_min1.89705676504107
driven_any_max28.39892337331051
driven_any_mean12.184313875550597
driven_any_median9.642692966448996
driven_any_min0.5132501693561905
driven_lanedir_consec_max26.72308232966128
driven_lanedir_consec_mean11.5414023255884
driven_lanedir_consec_min0.4933655047332506
driven_lanedir_max26.72308232966128
driven_lanedir_mean11.5414023255884
driven_lanedir_median9.398907506434838
driven_lanedir_min0.4933655047332506
get_duckie_state_max1.3050784068892758e-06
get_duckie_state_mean1.255119829910073e-06
get_duckie_state_median1.261970780473466e-06
get_duckie_state_min1.209576924641927e-06
get_robot_state_max0.01419495291499249
get_robot_state_mean0.012880892391256707
get_robot_state_median0.0139153174417005
get_robot_state_min0.006883590486314562
get_state_dump_max0.009271806502437975
get_state_dump_mean0.008716585330697023
get_state_dump_median0.00923153502458736
get_state_dump_min0.005874186091952853
get_ui_image_max0.04989568296685276
get_ui_image_mean0.044025812680681016
get_ui_image_median0.046877230930884216
get_ui_image_min0.02929230584038629
in-drivable-lane_max4.64999999999986
in-drivable-lane_mean1.1535714285714025
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.493517613916708, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 9.166617178482266, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.5500000000000007, "deviation-heading": 2.7405524093202556, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 1.3686085467289304, "driven_lanedir_consec": 9.166617178482266, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.2388008766824794, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 2.9194499038438773, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 2.5865430672266743, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 2.2369476251878697, "driven_lanedir_consec": 2.9194499038438773, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.4634410727910163, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 3.4141966865801687, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.104748324979441, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 2.2194255506254925, "driven_lanedir_consec": 3.4141966865801687, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.791868318981283, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 9.652664810782866, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.6764542927150776, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 1.2187613539963786, "driven_lanedir_consec": 9.652664810782866, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 5.2744148606514525, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 4.993356391273899, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.4499999999999989, "deviation-heading": 2.1886548795496132, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.7609525839948686, "driven_lanedir_consec": 4.993356391273899, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.2683724535747025, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 4.057498553336585, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 1.89705676504107, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.764810998767303, "driven_lanedir_consec": 4.057498553336585, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.5132501693561905, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 0.4933655047332506, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.008341826230814, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.357887996188914, "driven_lanedir_consec": 0.4933655047332506, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.6407977537520776, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 0.624954549718247, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.990371604431699, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 1.6061171092454496, "driven_lanedir_consec": 0.624954549718247, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 28.39892337331051, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.697153056659246, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 3.299999999999915, "deviation-heading": 9.233645184143096, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 3.9585946498045086, "driven_lanedir_consec": 26.697153056659246, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 28.11139009415567, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 25.914074013200757, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 4.64999999999986, "deviation-heading": 8.922783796519258, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.044790066759096, "driven_lanedir_consec": 25.914074013200757, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 28.35762199606153, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.662441724477063, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 3.2999999999999297, "deviation-heading": 8.95418148482855, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.182413368754524, "driven_lanedir_consec": 26.662441724477063, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 28.32396059392905, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.72308232966128, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 2.899999999999934, "deviation-heading": 9.627892435906524, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.086355625157938, "driven_lanedir_consec": 26.72308232966128, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.829211963265012, "get_ui_image": 0.02929230584038629, "step_physics": 0.23146332422892252, "survival_time": 22.450000000000184, "driven_lanedir": 10.629580021100676, "get_state_dump": 0.005874186091952853, "get_robot_state": 0.006883590486314562, "sim_render-ego0": 0.003619694179958767, "sim_render-ego1": 0.0035496679941813152, "get_duckie_state": 1.209576924641927e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.507267052602248, "agent_compute-ego0": 0.014864356252882216, "agent_compute-ego1": 0.014603311750623914, "complete-iteration": 0.3282095077302721, "set_robot_commands": 0.002174705399407281, "deviation-center-line": 1.5280927831582016, "driven_lanedir_consec": 10.629580021100676, "sim_compute_sim_state": 0.009862181345621744, "sim_compute_performance-ego0": 0.0018813716040717232, "sim_compute_performance-ego1": 0.0018753894170125325}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 9.87482311728065, "get_ui_image": 0.02929230584038629, "step_physics": 0.23146332422892252, "survival_time": 22.450000000000184, "driven_lanedir": 9.63119783438741, "get_state_dump": 0.005874186091952853, "get_robot_state": 0.006883590486314562, "sim_render-ego0": 0.003619694179958767, "sim_render-ego1": 0.0035496679941813152, "get_duckie_state": 1.209576924641927e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.102357962938321, "agent_compute-ego0": 0.014864356252882216, "agent_compute-ego1": 0.014603311750623914, "complete-iteration": 0.3282095077302721, "set_robot_commands": 0.002174705399407281, "deviation-center-line": 1.4181540547495373, "driven_lanedir_consec": 9.63119783438741, "sim_compute_sim_state": 0.009862181345621744, "sim_compute_performance-ego0": 0.0018813716040717232, "sim_compute_performance-ego1": 0.0018753894170125325}}
set_robot_commands_max0.002293376080003608
set_robot_commands_mean0.002217625054544921
set_robot_commands_median0.002206440075152522
set_robot_commands_min0.002174518836047454
sim_compute_performance-ego0_max0.002017482696288082
sim_compute_performance-ego0_mean0.0019307023474043864
sim_compute_performance-ego0_median0.001929421905276182
sim_compute_performance-ego0_min0.0018698678123152289
sim_compute_performance-ego1_max0.0019899573192060233
sim_compute_performance-ego1_mean0.001902177109149234
sim_compute_performance-ego1_median0.0018679643054488897
sim_compute_performance-ego1_min0.0018620035488611415
sim_compute_performance-ego2_max0.0019690214869487717
sim_compute_performance-ego2_mean0.0019037601896390048
sim_compute_performance-ego2_median0.0018850011801897148
sim_compute_performance-ego2_min0.0018572579017785268
sim_compute_performance-ego3_max0.002012623361794345
sim_compute_performance-ego3_mean0.0019151027122016472
sim_compute_performance-ego3_median0.0018717160000102989
sim_compute_performance-ego3_min0.0018609687748002968
sim_compute_sim_state_max0.043414650114251614
sim_compute_sim_state_mean0.026147954676086296
sim_compute_sim_state_median0.022657280466163977
sim_compute_sim_state_min0.009862181345621744
sim_render-ego0_max0.0037735169192394578
sim_render-ego0_mean0.003655944388505184
sim_render-ego0_median0.003631874087648924
sim_render-ego0_min0.0035805672629003783
sim_render-ego1_max0.0037148400961634622
sim_render-ego1_mean0.0036372072127619183
sim_render-ego1_median0.0036493164138226
sim_render-ego1_min0.0035496679941813152
sim_render-ego2_max0.003774793272516335
sim_render-ego2_mean0.003620347916262966
sim_render-ego2_median0.003564079109551593
sim_render-ego2_min0.0035221713667209697
sim_render-ego3_max0.003750002527811441
sim_render-ego3_mean0.003603141215959451
sim_render-ego3_median0.0035327599007201845
sim_render-ego3_min0.0035266612193467317
simulation-passed1
step_physics_max1.1047662874780984
step_physics_mean0.7788584835172674
step_physics_median0.7833969350857699
step_physics_min0.23146332422892252
survival_time_max59.99999999999873
survival_time_mean29.635714285714005
survival_time_min12.40000000000004
No reset possible