Duckietown Challenges Home Challenges Submissions

Submission 13232

Submission13232
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 61780
Next
User label212-1-real
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
61780LFVmultibodyv-simsuccessyes1:08:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.92735964904527
survival_time_median30.450000000000298
deviation-center-line_median1.9195023163308944
in-drivable-lane_median2.349999999999985


other stats
agent_compute-ego0_max0.01678554465373357
agent_compute-ego0_mean0.015563005431859471
agent_compute-ego0_median0.015350019345518018
agent_compute-ego0_min0.014849396755820829
agent_compute-ego1_max0.01579221834739049
agent_compute-ego1_mean0.015046431495350688
agent_compute-ego1_median0.014747215647383792
agent_compute-ego1_min0.014706426370339316
agent_compute-ego2_max0.015617876003185907
agent_compute-ego2_mean0.014928874385796936
agent_compute-ego2_median0.01485955050734223
agent_compute-ego2_min0.01430919664686268
agent_compute-ego3_max0.01630827784538269
agent_compute-ego3_mean0.01570250186365165
agent_compute-ego3_median0.016019901963296678
agent_compute-ego3_min0.014779325782275593
complete-iteration_max1.302852382425402
complete-iteration_mean1.0778619223444006
complete-iteration_median1.190376052012046
complete-iteration_min0.36873028905768146
deviation-center-line_max4.854292303770947
deviation-center-line_mean2.2899969673279523
deviation-center-line_min0.08818801705197274
deviation-heading_max17.84137628645837
deviation-heading_mean7.557796872794539
deviation-heading_median5.587071954547271
deviation-heading_min0.47802636087670897
driven_any_max26.779255417316367
driven_any_mean11.539897235870944
driven_any_median8.536633404222396
driven_any_min0.9105640074134004
driven_lanedir_consec_max24.04662591700928
driven_lanedir_consec_mean10.038854808719837
driven_lanedir_consec_min0.5450087008662563
driven_lanedir_max24.04662591700928
driven_lanedir_mean10.038854808719837
driven_lanedir_median6.92735964904527
driven_lanedir_min0.5450087008662563
get_duckie_state_max1.2752910455067952e-06
get_duckie_state_mean1.1884211017345295e-06
get_duckie_state_median1.189909211602636e-06
get_duckie_state_min1.1170496706102716e-06
get_robot_state_max0.01405917356411616
get_robot_state_mean0.012986305466345452
get_robot_state_median0.014022704421496782
get_robot_state_min0.007057358089246248
get_state_dump_max0.00948420912027359
get_state_dump_mean0.008943774220978213
get_state_dump_median0.009334560691333208
get_state_dump_min0.006321573257446289
get_ui_image_max0.049550651331416895
get_ui_image_mean0.043785254681854235
get_ui_image_median0.04629869385623217
get_ui_image_min0.03010616804424085
in-drivable-lane_max15.000000000000174
in-drivable-lane_mean3.3428571428571416
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9890394598807024, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 0.9806087867658176, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.6782066977650665, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.95873303761048, "driven_lanedir_consec": 0.9806087867658176, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.8432856129446265, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 2.9343931119964126, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 1.699999999999994, "deviation-heading": 2.3883024690025487, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.6283735239320577, "driven_lanedir_consec": 2.9343931119964126, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.0759813919462804, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 2.436377933801141, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 1.099999999999996, "deviation-heading": 1.676832794435903, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.9358976721504254, "driven_lanedir_consec": 2.436377933801141, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.9105640074134004, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 0.5450087008662563, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 8.100000000000001, "deviation-heading": 0.47802636087670897, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.08818801705197274, "driven_lanedir_consec": 0.5450087008662563, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 13.220585014878942, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 11.5294445739515, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 2.300000000000021, "deviation-heading": 8.533098825738684, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 2.481580182409881, "driven_lanedir_consec": 11.5294445739515, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.278174162527764, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 9.936901602388136, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 4.200000000000028, "deviation-heading": 6.975422387134058, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 2.6971355247447075, "driven_lanedir_consec": 9.936901602388136, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 8.361725547389481, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 7.16988966921317, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 1.6500000000000137, "deviation-heading": 8.540359334484943, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 3.023775767123455, "driven_lanedir_consec": 7.16988966921317, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 8.71154126105531, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 6.68482962887737, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 15.000000000000174, "deviation-heading": 4.198721521960484, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 1.3574244502519075, "driven_lanedir_consec": 6.68482962887737, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 26.6684807295862, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 23.9094140434016, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 2.7499999999999467, "deviation-heading": 17.84137628645837, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.711397938266967, "driven_lanedir_consec": 23.9094140434016, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 26.609009595258836, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 23.88166040373982, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 2.799999999999934, "deviation-heading": 17.539201337098525, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.775805359748888, "driven_lanedir_consec": 23.88166040373982, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 26.640018408616022, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 24.04662591700928, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 2.399999999999949, "deviation-heading": 17.740984322174157, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.829730933896657, "driven_lanedir_consec": 24.04662591700928, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 26.779255417316367, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 23.63031467541972, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 3.7999999999999297, "deviation-heading": 17.358942398481144, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.854292303770947, "driven_lanedir_consec": 23.63031467541972, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.8192620875185, "get_ui_image": 0.03010616804424085, "step_physics": 0.2708438045100162, "survival_time": 4.699999999999991, "driven_lanedir": 1.3016763425212197, "get_state_dump": 0.006321573257446289, "get_robot_state": 0.007057358089246248, "sim_render-ego0": 0.003728916770533512, "sim_render-ego1": 0.003672481838025545, "get_duckie_state": 1.1544478567023026e-06, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 0.5876126470554748, "agent_compute-ego0": 0.014849396755820829, "agent_compute-ego1": 0.014833299737227593, "complete-iteration": 0.36873028905768146, "set_robot_commands": 0.0021628530401932564, "deviation-center-line": 0.3314565701696103, "driven_lanedir_consec": 1.3016763425212197, "sim_compute_sim_state": 0.009006058542351973, "sim_compute_performance-ego0": 0.0018974153619063527, "sim_compute_performance-ego1": 0.001891216478849712}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6516386058608057, "get_ui_image": 0.03010616804424085, "step_physics": 0.2708438045100162, "survival_time": 4.699999999999991, "driven_lanedir": 1.5568219321262962, "get_state_dump": 0.006321573257446289, "get_robot_state": 0.007057358089246248, "sim_render-ego0": 0.003728916770533512, "sim_render-ego1": 0.003672481838025545, "get_duckie_state": 1.1544478567023026e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.2720688364574708, "agent_compute-ego0": 0.014849396755820829, "agent_compute-ego1": 0.014833299737227593, "complete-iteration": 0.36873028905768146, "set_robot_commands": 0.0021628530401932564, "deviation-center-line": 0.38616626146337646, "driven_lanedir_consec": 1.5568219321262962, "sim_compute_sim_state": 0.009006058542351973, "sim_compute_performance-ego0": 0.0018974153619063527, "sim_compute_performance-ego1": 0.001891216478849712}}
set_robot_commands_max0.0023060540358225503
set_robot_commands_mean0.0022405835647671545
set_robot_commands_median0.002249415976102235
set_robot_commands_min0.0021628530401932564
sim_compute_performance-ego0_max0.0019205124651799437
sim_compute_performance-ego0_mean0.0019090557959764369
sim_compute_performance-ego0_median0.001920069257418315
sim_compute_performance-ego0_min0.001892405882366095
sim_compute_performance-ego1_max0.0019554197788238525
sim_compute_performance-ego1_mean0.0019076569546790235
sim_compute_performance-ego1_median0.0018937079632868532
sim_compute_performance-ego1_min0.001882063359841022
sim_compute_performance-ego2_max0.0019375644624233248
sim_compute_performance-ego2_mean0.0018950874145766095
sim_compute_performance-ego2_median0.001885319537803775
sim_compute_performance-ego2_min0.0018623782435027289
sim_compute_performance-ego3_max0.0019443556666374209
sim_compute_performance-ego3_mean0.0019161465577624416
sim_compute_performance-ego3_median0.0019219523570576651
sim_compute_performance-ego3_min0.0018821316495922385
sim_compute_sim_state_max0.043725351608365305
sim_compute_sim_state_mean0.029082378437273324
sim_compute_sim_state_median0.03757484467303167
sim_compute_sim_state_min0.009006058542351973
sim_render-ego0_max0.003731683434033003
sim_render-ego0_mean0.003708533649833849
sim_render-ego0_median0.0037246731420358023
sim_render-ego0_min0.0036590528130829086
sim_render-ego1_max0.003710103531678518
sim_render-ego1_mean0.003661157313521925
sim_render-ego1_median0.003659979632643403
sim_render-ego1_min0.003607726513992043
sim_render-ego2_max0.0036924046774705257
sim_render-ego2_mean0.003632554762511723
sim_render-ego2_median0.0036358821587484393
sim_render-ego2_min0.0035693774513162048
sim_render-ego3_max0.003686646620432536
sim_render-ego3_mean0.0036379254397155662
sim_render-ego3_median0.0036466926824851114
sim_render-ego3_min0.00358043701622905
simulation-passed1
step_physics_max1.10137550635416
step_physics_mean0.8971201734312453
step_physics_median1.0121659624079864
step_physics_min0.2708438045100162
survival_time_max59.99999999999873
survival_time_mean29.24285714285687
survival_time_min4.699999999999991
No reset possible