Duckietown Challenges Home Challenges Submissions

Submission 13053

Submission13053
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAndrás Kalapos 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60333
Next
User label3090
Admin priority50
Blessingn/a
User priority50

60333

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60333LFVmultibodyv-simsuccessyes2:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.49246730001809
survival_time_median59.99999999999873
deviation-center-line_median2.421784324477689
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01321976528278894
agent_compute-ego0_mean0.012840089211498524
agent_compute-ego0_median0.012659569961840068
agent_compute-ego0_min0.01258972225141565
agent_compute-ego1_max0.0131767758918146
agent_compute-ego1_mean0.012805029429053105
agent_compute-ego1_median0.01267704697671679
agent_compute-ego1_min0.01260064861161028
agent_compute-ego2_max0.012855647307053693
agent_compute-ego2_mean0.01251384684551831
agent_compute-ego2_median0.012368754681500666
agent_compute-ego2_min0.012317138548000569
agent_compute-ego3_max0.012969913728826749
agent_compute-ego3_mean0.012604073752901668
agent_compute-ego3_median0.012454080541961695
agent_compute-ego3_min0.012388226987916563
complete-iteration_max1.0810318809067776
complete-iteration_mean0.8708532503701366
complete-iteration_median0.982469272454712
complete-iteration_min0.33497997465776863
deviation-center-line_max2.8154998347673934
deviation-center-line_mean2.3876343697937905
deviation-center-line_min1.8245929266025156
deviation-heading_max12.077921997473142
deviation-heading_mean10.061673761451042
deviation-heading_median10.857734596465887
deviation-heading_min5.459066211908118
driven_any_max29.368401609346396
driven_any_mean28.06242585267999
driven_any_median28.089360122342136
driven_any_min26.837125320422544
driven_lanedir_consec_max29.05760231573928
driven_lanedir_consec_mean27.50776189164617
driven_lanedir_consec_min26.11772230618648
driven_lanedir_max29.05760231573928
driven_lanedir_mean27.50776189164617
driven_lanedir_median27.49246730001809
driven_lanedir_min26.11772230618648
get_duckie_state_max1.4090716689949132e-06
get_duckie_state_mean1.3470493741816485e-06
get_duckie_state_median1.395572532126548e-06
get_duckie_state_min1.2659411148465149e-06
get_robot_state_max0.014159618666725889
get_robot_state_mean0.0130501238134481
get_robot_state_median0.014148820151298072
get_robot_state_min0.00703916899072042
get_state_dump_max0.009536803910178408
get_state_dump_mean0.008993511238520135
get_state_dump_median0.009476861985498028
get_state_dump_min0.006201470126518103
get_ui_image_max0.049425027650361456
get_ui_image_mean0.0441358804390804
get_ui_image_median0.04729664653266697
get_ui_image_min0.029941461564698485
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 28.373967352755415, "get_ui_image": 0.042783176571403715, "step_physics": 0.6395239041905717, "survival_time": 59.99999999999873, "driven_lanedir": 27.708181193764528, "get_state_dump": 0.009476861985498028, "get_robot_state": 0.01384741003368419, "sim_render-ego0": 0.0036813486227882, "sim_render-ego1": 0.003607370573515499, "sim_render-ego2": 0.003570669795154632, "sim_render-ego3": 0.003574056688891561, "get_duckie_state": 1.4090716689949132e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.113455837944151, "agent_compute-ego0": 0.012659569961840068, "agent_compute-ego1": 0.01267704697671679, "agent_compute-ego2": 0.012317138548000569, "agent_compute-ego3": 0.012454080541961695, "complete-iteration": 0.8169952356051049, "set_robot_commands": 0.002042812272769823, "deviation-center-line": 2.3760483056585, "driven_lanedir_consec": 27.708181193764528, "sim_compute_sim_state": 0.030992457908357213, "sim_compute_performance-ego0": 0.0019004009446931024, "sim_compute_performance-ego1": 0.0018443644394187705, "sim_compute_performance-ego2": 0.0018420842763883288, "sim_compute_performance-ego3": 0.001831034637311416}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 28.3791509753673, "get_ui_image": 0.042783176571403715, "step_physics": 0.6395239041905717, "survival_time": 59.99999999999873, "driven_lanedir": 27.734528787723903, "get_state_dump": 0.009476861985498028, "get_robot_state": 0.01384741003368419, "sim_render-ego0": 0.0036813486227882, "sim_render-ego1": 0.003607370573515499, "sim_render-ego2": 0.003570669795154632, "sim_render-ego3": 0.003574056688891561, "get_duckie_state": 1.4090716689949132e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.907136345031423, "agent_compute-ego0": 0.012659569961840068, "agent_compute-ego1": 0.01267704697671679, "agent_compute-ego2": 0.012317138548000569, "agent_compute-ego3": 0.012454080541961695, "complete-iteration": 0.8169952356051049, "set_robot_commands": 0.002042812272769823, "deviation-center-line": 2.39946613007276, "driven_lanedir_consec": 27.734528787723903, "sim_compute_sim_state": 0.030992457908357213, "sim_compute_performance-ego0": 0.0019004009446931024, "sim_compute_performance-ego1": 0.0018443644394187705, "sim_compute_performance-ego2": 0.0018420842763883288, "sim_compute_performance-ego3": 0.001831034637311416}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 29.368401609346396, "get_ui_image": 0.042783176571403715, "step_physics": 0.6395239041905717, "survival_time": 59.99999999999873, "driven_lanedir": 29.05760231573928, "get_state_dump": 0.009476861985498028, "get_robot_state": 0.01384741003368419, "sim_render-ego0": 0.0036813486227882, "sim_render-ego1": 0.003607370573515499, "sim_render-ego2": 0.003570669795154632, "sim_render-ego3": 0.003574056688891561, "get_duckie_state": 1.4090716689949132e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.6590586119136255, "agent_compute-ego0": 0.012659569961840068, "agent_compute-ego1": 0.01267704697671679, "agent_compute-ego2": 0.012317138548000569, "agent_compute-ego3": 0.012454080541961695, "complete-iteration": 0.8169952356051049, "set_robot_commands": 0.002042812272769823, "deviation-center-line": 1.8269464362609529, "driven_lanedir_consec": 29.05760231573928, "sim_compute_sim_state": 0.030992457908357213, "sim_compute_performance-ego0": 0.0019004009446931024, "sim_compute_performance-ego1": 0.0018443644394187705, "sim_compute_performance-ego2": 0.0018420842763883288, "sim_compute_performance-ego3": 0.001831034637311416}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 28.586388286302885, "get_ui_image": 0.042783176571403715, "step_physics": 0.6395239041905717, "survival_time": 59.99999999999873, "driven_lanedir": 28.001718158127193, "get_state_dump": 0.009476861985498028, "get_robot_state": 0.01384741003368419, "sim_render-ego0": 0.0036813486227882, "sim_render-ego1": 0.003607370573515499, "sim_render-ego2": 0.003570669795154632, "sim_render-ego3": 0.003574056688891561, "get_duckie_state": 1.4090716689949132e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.524069247415214, "agent_compute-ego0": 0.012659569961840068, "agent_compute-ego1": 0.01267704697671679, "agent_compute-ego2": 0.012317138548000569, "agent_compute-ego3": 0.012454080541961695, "complete-iteration": 0.8169952356051049, "set_robot_commands": 0.002042812272769823, "deviation-center-line": 2.1989095056478263, "driven_lanedir_consec": 28.001718158127193, "sim_compute_sim_state": 0.030992457908357213, "sim_compute_performance-ego0": 0.0019004009446931024, "sim_compute_performance-ego1": 0.0018443644394187705, "sim_compute_performance-ego2": 0.0018420842763883288, "sim_compute_performance-ego3": 0.001831034637311416}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 27.2946884867754, "get_ui_image": 0.049425027650361456, "step_physics": 0.875762571800162, "survival_time": 59.99999999999873, "driven_lanedir": 26.655930067089223, "get_state_dump": 0.009362888375884984, "get_robot_state": 0.014159618666725889, "sim_render-ego0": 0.003732008699771268, "sim_render-ego1": 0.003700898350724372, "sim_render-ego2": 0.003648416088780793, "sim_render-ego3": 0.00365078975318572, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.80833284790035, "agent_compute-ego0": 0.01321976528278894, "agent_compute-ego1": 0.0131767758918146, "agent_compute-ego2": 0.012855647307053693, "agent_compute-ego3": 0.012969913728826749, "complete-iteration": 1.0810318809067776, "set_robot_commands": 0.002128069446446199, "deviation-center-line": 2.6420854469432813, "driven_lanedir_consec": 26.655930067089223, "sim_compute_sim_state": 0.048932829466985725, "sim_compute_performance-ego0": 0.001966319016671796, "sim_compute_performance-ego1": 0.0019035319503796883, "sim_compute_performance-ego2": 0.0019030977943159957, "sim_compute_performance-ego3": 0.0019144640675591588}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 26.837125320422544, "get_ui_image": 0.049425027650361456, "step_physics": 0.875762571800162, "survival_time": 59.99999999999873, "driven_lanedir": 26.11772230618648, "get_state_dump": 0.009362888375884984, "get_robot_state": 0.014159618666725889, "sim_render-ego0": 0.003732008699771268, "sim_render-ego1": 0.003700898350724372, "sim_render-ego2": 0.003648416088780793, "sim_render-ego3": 0.00365078975318572, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.077921997473142, "agent_compute-ego0": 0.01321976528278894, "agent_compute-ego1": 0.0131767758918146, "agent_compute-ego2": 0.012855647307053693, "agent_compute-ego3": 0.012969913728826749, "complete-iteration": 1.0810318809067776, "set_robot_commands": 0.002128069446446199, "deviation-center-line": 2.8154998347673934, "driven_lanedir_consec": 26.11772230618648, "sim_compute_sim_state": 0.048932829466985725, "sim_compute_performance-ego0": 0.001966319016671796, "sim_compute_performance-ego1": 0.0019035319503796883, "sim_compute_performance-ego2": 0.0019030977943159957, "sim_compute_performance-ego3": 0.0019144640675591588}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 27.54388331438272, "get_ui_image": 0.049425027650361456, "step_physics": 0.875762571800162, "survival_time": 59.99999999999873, "driven_lanedir": 26.993162926129393, "get_state_dump": 0.009362888375884984, "get_robot_state": 0.014159618666725889, "sim_render-ego0": 0.003732008699771268, "sim_render-ego1": 0.003700898350724372, "sim_render-ego2": 0.003648416088780793, "sim_render-ego3": 0.00365078975318572, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.190735109661915, "agent_compute-ego0": 0.01321976528278894, "agent_compute-ego1": 0.0131767758918146, "agent_compute-ego2": 0.012855647307053693, "agent_compute-ego3": 0.012969913728826749, "complete-iteration": 1.0810318809067776, "set_robot_commands": 0.002128069446446199, "deviation-center-line": 2.5227409949913513, "driven_lanedir_consec": 26.993162926129393, "sim_compute_sim_state": 0.048932829466985725, "sim_compute_performance-ego0": 0.001966319016671796, "sim_compute_performance-ego1": 0.0019035319503796883, "sim_compute_performance-ego2": 0.0019030977943159957, "sim_compute_performance-ego3": 0.0019144640675591588}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 28.225494628385444, "get_ui_image": 0.049425027650361456, "step_physics": 0.875762571800162, "survival_time": 59.99999999999873, "driven_lanedir": 27.89462489474387, "get_state_dump": 0.009362888375884984, "get_robot_state": 0.014159618666725889, "sim_render-ego0": 0.003732008699771268, "sim_render-ego1": 0.003700898350724372, "sim_render-ego2": 0.003648416088780793, "sim_render-ego3": 0.00365078975318572, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.520799107867426, "agent_compute-ego0": 0.01321976528278894, "agent_compute-ego1": 0.0131767758918146, "agent_compute-ego2": 0.012855647307053693, "agent_compute-ego3": 0.012969913728826749, "complete-iteration": 1.0810318809067776, "set_robot_commands": 0.002128069446446199, "deviation-center-line": 2.279676092681126, "driven_lanedir_consec": 27.89462489474387, "sim_compute_sim_state": 0.048932829466985725, "sim_compute_performance-ego0": 0.001966319016671796, "sim_compute_performance-ego1": 0.0019035319503796883, "sim_compute_performance-ego2": 0.0019030977943159957, "sim_compute_performance-ego3": 0.0019144640675591588}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 27.953225616298823, "get_ui_image": 0.04729664653266697, "step_physics": 0.7861254096130448, "survival_time": 59.99999999999873, "driven_lanedir": 27.27675340627166, "get_state_dump": 0.009536803910178408, "get_robot_state": 0.014148820151298072, "sim_render-ego0": 0.003729639402734151, "sim_render-ego1": 0.003670754182547157, "sim_render-ego2": 0.0036433519272879695, "sim_render-ego3": 0.003646035079257276, "get_duckie_state": 1.395572532126548e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.374858959302742, "agent_compute-ego0": 0.01258972225141565, "agent_compute-ego1": 0.01260064861161028, "agent_compute-ego2": 0.012368754681500666, "agent_compute-ego3": 0.012388226987916563, "complete-iteration": 0.982469272454712, "set_robot_commands": 0.002154695104302018, "deviation-center-line": 2.591141555160659, "driven_lanedir_consec": 27.27675340627166, "sim_compute_sim_state": 0.044309970242693265, "sim_compute_performance-ego0": 0.0019585859964134093, "sim_compute_performance-ego1": 0.001885250347242268, "sim_compute_performance-ego2": 0.001886126004488244, "sim_compute_performance-ego3": 0.0018965278835121936}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 27.733263190574434, "get_ui_image": 0.04729664653266697, "step_physics": 0.7861254096130448, "survival_time": 59.99999999999873, "driven_lanedir": 27.101905055863003, "get_state_dump": 0.009536803910178408, "get_robot_state": 0.014148820151298072, "sim_render-ego0": 0.003729639402734151, "sim_render-ego1": 0.003670754182547157, "sim_render-ego2": 0.0036433519272879695, "sim_render-ego3": 0.003646035079257276, "get_duckie_state": 1.395572532126548e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.954826441410525, "agent_compute-ego0": 0.01258972225141565, "agent_compute-ego1": 0.01260064861161028, "agent_compute-ego2": 0.012368754681500666, "agent_compute-ego3": 0.012388226987916563, "complete-iteration": 0.982469272454712, "set_robot_commands": 0.002154695104302018, "deviation-center-line": 2.643210572368355, "driven_lanedir_consec": 27.101905055863003, "sim_compute_sim_state": 0.044309970242693265, "sim_compute_performance-ego0": 0.0019585859964134093, "sim_compute_performance-ego1": 0.001885250347242268, "sim_compute_performance-ego2": 0.001886126004488244, "sim_compute_performance-ego3": 0.0018965278835121936}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 28.227604385098793, "get_ui_image": 0.04729664653266697, "step_physics": 0.7861254096130448, "survival_time": 59.99999999999873, "driven_lanedir": 27.7369693077812, "get_state_dump": 0.009536803910178408, "get_robot_state": 0.014148820151298072, "sim_render-ego0": 0.003729639402734151, "sim_render-ego1": 0.003670754182547157, "sim_render-ego2": 0.0036433519272879695, "sim_render-ego3": 0.003646035079257276, "get_duckie_state": 1.395572532126548e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.255361693725987, "agent_compute-ego0": 0.01258972225141565, "agent_compute-ego1": 0.01260064861161028, "agent_compute-ego2": 0.012368754681500666, "agent_compute-ego3": 0.012388226987916563, "complete-iteration": 0.982469272454712, "set_robot_commands": 0.002154695104302018, "deviation-center-line": 2.444102518882618, "driven_lanedir_consec": 27.7369693077812, "sim_compute_sim_state": 0.044309970242693265, "sim_compute_performance-ego0": 0.0019585859964134093, "sim_compute_performance-ego1": 0.001885250347242268, "sim_compute_performance-ego2": 0.001886126004488244, "sim_compute_performance-ego3": 0.0018965278835121936}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 27.81065505307543, "get_ui_image": 0.04729664653266697, "step_physics": 0.7861254096130448, "survival_time": 59.99999999999873, "driven_lanedir": 27.129922800703316, "get_state_dump": 0.009536803910178408, "get_robot_state": 0.014148820151298072, "sim_render-ego0": 0.003729639402734151, "sim_render-ego1": 0.003670754182547157, "sim_render-ego2": 0.0036433519272879695, "sim_render-ego3": 0.003646035079257276, "get_duckie_state": 1.395572532126548e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.401153309276252, "agent_compute-ego0": 0.01258972225141565, "agent_compute-ego1": 0.01260064861161028, "agent_compute-ego2": 0.012368754681500666, "agent_compute-ego3": 0.012388226987916563, "complete-iteration": 0.982469272454712, "set_robot_commands": 0.002154695104302018, "deviation-center-line": 2.5478664209620527, "driven_lanedir_consec": 27.129922800703316, "sim_compute_sim_state": 0.044309970242693265, "sim_compute_performance-ego0": 0.0019585859964134093, "sim_compute_performance-ego1": 0.001885250347242268, "sim_compute_performance-ego2": 0.001886126004488244, "sim_compute_performance-ego3": 0.0018965278835121936}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 27.824015318382106, "get_ui_image": 0.029941461564698485, "step_physics": 0.23981179325507143, "survival_time": 59.99999999999873, "driven_lanedir": 27.13296880744705, "get_state_dump": 0.006201470126518103, "get_robot_state": 0.00703916899072042, "sim_render-ego0": 0.003794348309379533, "sim_render-ego1": 0.003708645267153064, "get_duckie_state": 1.2659411148465149e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.61665693948371, "agent_compute-ego0": 0.012942509488400374, "agent_compute-ego1": 0.012726263043088382, "complete-iteration": 0.33497997465776863, "set_robot_commands": 0.002158047059096464, "deviation-center-line": 2.3145944361136697, "driven_lanedir_consec": 27.13296880744705, "sim_compute_sim_state": 0.01047271316394917, "sim_compute_performance-ego0": 0.001962158900315716, "sim_compute_performance-ego1": 0.0019296795799769923}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 28.71609840035218, "get_ui_image": 0.029941461564698485, "step_physics": 0.23981179325507143, "survival_time": 59.99999999999873, "driven_lanedir": 28.56667645547623, "get_state_dump": 0.006201470126518103, "get_robot_state": 0.00703916899072042, "sim_render-ego0": 0.003794348309379533, "sim_render-ego1": 0.003708645267153064, "get_duckie_state": 1.2659411148465149e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.459066211908118, "agent_compute-ego0": 0.012942509488400374, "agent_compute-ego1": 0.012726263043088382, "complete-iteration": 0.33497997465776863, "set_robot_commands": 0.002158047059096464, "deviation-center-line": 1.8245929266025156, "driven_lanedir_consec": 28.56667645547623, "sim_compute_sim_state": 0.01047271316394917, "sim_compute_performance-ego0": 0.001962158900315716, "sim_compute_performance-ego1": 0.0019296795799769923}}
set_robot_commands_max0.002158047059096464
set_robot_commands_mean0.002115600100876077
set_robot_commands_median0.002128069446446199
set_robot_commands_min0.002042812272769823
sim_compute_performance-ego0_max0.001966319016671796
sim_compute_performance-ego0_mean0.0019446815451246184
sim_compute_performance-ego0_median0.0019585859964134093
sim_compute_performance-ego0_min0.0019004009446931024
sim_compute_performance-ego1_max0.0019296795799769923
sim_compute_performance-ego1_mean0.001885139007722635
sim_compute_performance-ego1_median0.001885250347242268
sim_compute_performance-ego1_min0.0018443644394187705
sim_compute_performance-ego2_max0.0019030977943159957
sim_compute_performance-ego2_mean0.0018771026917308565
sim_compute_performance-ego2_median0.001886126004488244
sim_compute_performance-ego2_min0.0018420842763883288
sim_compute_performance-ego3_max0.0019144640675591588
sim_compute_performance-ego3_mean0.0018806755294609224
sim_compute_performance-ego3_median0.0018965278835121936
sim_compute_performance-ego3_min0.001831034637311416
sim_compute_sim_state_max0.048932829466985725
sim_compute_sim_state_mean0.036991889771431655
sim_compute_sim_state_median0.044309970242693265
sim_compute_sim_state_min0.01047271316394917
sim_render-ego0_max0.003794348309379533
sim_render-ego0_mean0.0037257631085666817
sim_render-ego0_median0.003729639402734151
sim_render-ego0_min0.0036813486227882
sim_render-ego1_max0.003708645267153064
sim_render-ego1_mean0.003666670211532445
sim_render-ego1_median0.003670754182547157
sim_render-ego1_min0.003607370573515499
sim_render-ego2_max0.003648416088780793
sim_render-ego2_mean0.003620812603741132
sim_render-ego2_median0.0036433519272879695
sim_render-ego2_min0.003570669795154632
sim_render-ego3_max0.00365078975318572
sim_render-ego3_mean0.003623627173778185
sim_render-ego3_median0.003646035079257276
sim_render-ego3_min0.003574056688891561
simulation-passed1
step_physics_max0.875762571800162
step_physics_mean0.6918050806375183
step_physics_median0.7861254096130448
step_physics_min0.23981179325507143
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible