Duckietown Challenges Home Challenges Submissions

Submission 13232

Submission13232
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 61780
Next
User label212-1-real
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
61780LFVmultibodyv-simsuccessyes1:08:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.92735964904527
survival_time_median30.450000000000298
deviation-center-line_median1.9195023163308944
in-drivable-lane_median2.349999999999985


other stats
agent_compute-ego0_max0.01678554465373357
agent_compute-ego0_mean0.015563005431859471
agent_compute-ego0_median0.015350019345518018
agent_compute-ego0_min0.014849396755820829
agent_compute-ego1_max0.01579221834739049
agent_compute-ego1_mean0.015046431495350688
agent_compute-ego1_median0.014747215647383792
agent_compute-ego1_min0.014706426370339316
agent_compute-ego2_max0.015617876003185907
agent_compute-ego2_mean0.014928874385796936
agent_compute-ego2_median0.01485955050734223
agent_compute-ego2_min0.01430919664686268
agent_compute-ego3_max0.01630827784538269
agent_compute-ego3_mean0.01570250186365165
agent_compute-ego3_median0.016019901963296678
agent_compute-ego3_min0.014779325782275593
complete-iteration_max1.302852382425402
complete-iteration_mean1.0778619223444006
complete-iteration_median1.190376052012046
complete-iteration_min0.36873028905768146
deviation-center-line_max4.854292303770947
deviation-center-line_mean2.2899969673279523
deviation-center-line_min0.08818801705197274
deviation-heading_max17.84137628645837
deviation-heading_mean7.557796872794539
deviation-heading_median5.587071954547271
deviation-heading_min0.47802636087670897
driven_any_max26.779255417316367
driven_any_mean11.539897235870944
driven_any_median8.536633404222396
driven_any_min0.9105640074134004
driven_lanedir_consec_max24.04662591700928
driven_lanedir_consec_mean10.038854808719837
driven_lanedir_consec_min0.5450087008662563
driven_lanedir_max24.04662591700928
driven_lanedir_mean10.038854808719837
driven_lanedir_median6.92735964904527
driven_lanedir_min0.5450087008662563
get_duckie_state_max1.2752910455067952e-06
get_duckie_state_mean1.1884211017345295e-06
get_duckie_state_median1.189909211602636e-06
get_duckie_state_min1.1170496706102716e-06
get_robot_state_max0.01405917356411616
get_robot_state_mean0.012986305466345452
get_robot_state_median0.014022704421496782
get_robot_state_min0.007057358089246248
get_state_dump_max0.00948420912027359
get_state_dump_mean0.008943774220978213
get_state_dump_median0.009334560691333208
get_state_dump_min0.006321573257446289
get_ui_image_max0.049550651331416895
get_ui_image_mean0.043785254681854235
get_ui_image_median0.04629869385623217
get_ui_image_min0.03010616804424085
in-drivable-lane_max15.000000000000174
in-drivable-lane_mean3.3428571428571416
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9890394598807024, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 0.9806087867658176, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.6782066977650665, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.95873303761048, "driven_lanedir_consec": 0.9806087867658176, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.8432856129446265, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 2.9343931119964126, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 1.699999999999994, "deviation-heading": 2.3883024690025487, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.6283735239320577, "driven_lanedir_consec": 2.9343931119964126, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.0759813919462804, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 2.436377933801141, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 1.099999999999996, "deviation-heading": 1.676832794435903, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.9358976721504254, "driven_lanedir_consec": 2.436377933801141, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.9105640074134004, "get_ui_image": 0.0423459621767203, "step_physics": 1.0121659624079864, "survival_time": 9.55, "driven_lanedir": 0.5450087008662563, "get_state_dump": 0.00948420912027359, "get_robot_state": 0.01405917356411616, "sim_render-ego0": 0.0037246731420358023, "sim_render-ego1": 0.003710103531678518, "sim_render-ego2": 0.0036924046774705257, "sim_render-ego3": 0.003686646620432536, "get_duckie_state": 1.2752910455067952e-06, "in-drivable-lane": 8.100000000000001, "deviation-heading": 0.47802636087670897, "agent_compute-ego0": 0.01678554465373357, "agent_compute-ego1": 0.01579221834739049, "agent_compute-ego2": 0.015617876003185907, "agent_compute-ego3": 0.01630827784538269, "complete-iteration": 1.190376052012046, "set_robot_commands": 0.0023060540358225503, "deviation-center-line": 0.08818801705197274, "driven_lanedir_consec": 0.5450087008662563, "sim_compute_sim_state": 0.015985098977883656, "sim_compute_performance-ego0": 0.001920069257418315, "sim_compute_performance-ego1": 0.0019554197788238525, "sim_compute_performance-ego2": 0.0019375644624233248, "sim_compute_performance-ego3": 0.0019443556666374209}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 13.220585014878942, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 11.5294445739515, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 2.300000000000021, "deviation-heading": 8.533098825738684, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 2.481580182409881, "driven_lanedir_consec": 11.5294445739515, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.278174162527764, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 9.936901602388136, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 4.200000000000028, "deviation-heading": 6.975422387134058, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 2.6971355247447075, "driven_lanedir_consec": 9.936901602388136, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 8.361725547389481, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 7.16988966921317, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 1.6500000000000137, "deviation-heading": 8.540359334484943, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 3.023775767123455, "driven_lanedir_consec": 7.16988966921317, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 8.71154126105531, "get_ui_image": 0.049550651331416895, "step_physics": 1.10137550635416, "survival_time": 30.450000000000298, "driven_lanedir": 6.68482962887737, "get_state_dump": 0.009334560691333208, "get_robot_state": 0.014022704421496782, "sim_render-ego0": 0.003731683434033003, "sim_render-ego1": 0.003659979632643403, "sim_render-ego2": 0.0036358821587484393, "sim_render-ego3": 0.0036466926824851114, "get_duckie_state": 1.1170496706102716e-06, "in-drivable-lane": 15.000000000000174, "deviation-heading": 4.198721521960484, "agent_compute-ego0": 0.015350019345518018, "agent_compute-ego1": 0.014706426370339316, "agent_compute-ego2": 0.01485955050734223, "agent_compute-ego3": 0.014779325782275593, "complete-iteration": 1.302852382425402, "set_robot_commands": 0.002249415976102235, "deviation-center-line": 1.3574244502519075, "driven_lanedir_consec": 6.68482962887737, "sim_compute_sim_state": 0.03757484467303167, "sim_compute_performance-ego0": 0.0019205124651799437, "sim_compute_performance-ego1": 0.0018937079632868532, "sim_compute_performance-ego2": 0.001885319537803775, "sim_compute_performance-ego3": 0.0019219523570576651}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 26.6684807295862, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 23.9094140434016, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 2.7499999999999467, "deviation-heading": 17.84137628645837, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.711397938266967, "driven_lanedir_consec": 23.9094140434016, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 26.609009595258836, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 23.88166040373982, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 2.799999999999934, "deviation-heading": 17.539201337098525, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.775805359748888, "driven_lanedir_consec": 23.88166040373982, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 26.640018408616022, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 24.04662591700928, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 2.399999999999949, "deviation-heading": 17.740984322174157, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.829730933896657, "driven_lanedir_consec": 24.04662591700928, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 26.779255417316367, "get_ui_image": 0.04629869385623217, "step_physics": 0.890957235992203, "survival_time": 59.99999999999873, "driven_lanedir": 23.63031467541972, "get_state_dump": 0.0093236533330938, "get_robot_state": 0.013841512101973026, "sim_render-ego0": 0.0036590528130829086, "sim_render-ego1": 0.003607726513992043, "sim_render-ego2": 0.0035693774513162048, "sim_render-ego3": 0.00358043701622905, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 3.7999999999999297, "deviation-heading": 17.358942398481144, "agent_compute-ego0": 0.014910256634346154, "agent_compute-ego1": 0.014747215647383792, "agent_compute-ego2": 0.01430919664686268, "agent_compute-ego3": 0.016019901963296678, "complete-iteration": 1.0949231492391136, "set_robot_commands": 0.0022051459446636268, "deviation-center-line": 4.854292303770947, "driven_lanedir_consec": 23.63031467541972, "sim_compute_sim_state": 0.043725351608365305, "sim_compute_performance-ego0": 0.001892405882366095, "sim_compute_performance-ego1": 0.001882063359841022, "sim_compute_performance-ego2": 0.0018623782435027289, "sim_compute_performance-ego3": 0.0018821316495922385}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.8192620875185, "get_ui_image": 0.03010616804424085, "step_physics": 0.2708438045100162, "survival_time": 4.699999999999991, "driven_lanedir": 1.3016763425212197, "get_state_dump": 0.006321573257446289, "get_robot_state": 0.007057358089246248, "sim_render-ego0": 0.003728916770533512, "sim_render-ego1": 0.003672481838025545, "get_duckie_state": 1.1544478567023026e-06, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 0.5876126470554748, "agent_compute-ego0": 0.014849396755820829, "agent_compute-ego1": 0.014833299737227593, "complete-iteration": 0.36873028905768146, "set_robot_commands": 0.0021628530401932564, "deviation-center-line": 0.3314565701696103, "driven_lanedir_consec": 1.3016763425212197, "sim_compute_sim_state": 0.009006058542351973, "sim_compute_performance-ego0": 0.0018974153619063527, "sim_compute_performance-ego1": 0.001891216478849712}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6516386058608057, "get_ui_image": 0.03010616804424085, "step_physics": 0.2708438045100162, "survival_time": 4.699999999999991, "driven_lanedir": 1.5568219321262962, "get_state_dump": 0.006321573257446289, "get_robot_state": 0.007057358089246248, "sim_render-ego0": 0.003728916770533512, "sim_render-ego1": 0.003672481838025545, "get_duckie_state": 1.1544478567023026e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.2720688364574708, "agent_compute-ego0": 0.014849396755820829, "agent_compute-ego1": 0.014833299737227593, "complete-iteration": 0.36873028905768146, "set_robot_commands": 0.0021628530401932564, "deviation-center-line": 0.38616626146337646, "driven_lanedir_consec": 1.5568219321262962, "sim_compute_sim_state": 0.009006058542351973, "sim_compute_performance-ego0": 0.0018974153619063527, "sim_compute_performance-ego1": 0.001891216478849712}}
set_robot_commands_max0.0023060540358225503
set_robot_commands_mean0.0022405835647671545
set_robot_commands_median0.002249415976102235
set_robot_commands_min0.0021628530401932564
sim_compute_performance-ego0_max0.0019205124651799437
sim_compute_performance-ego0_mean0.0019090557959764369
sim_compute_performance-ego0_median0.001920069257418315
sim_compute_performance-ego0_min0.001892405882366095
sim_compute_performance-ego1_max0.0019554197788238525
sim_compute_performance-ego1_mean0.0019076569546790235
sim_compute_performance-ego1_median0.0018937079632868532
sim_compute_performance-ego1_min0.001882063359841022
sim_compute_performance-ego2_max0.0019375644624233248
sim_compute_performance-ego2_mean0.0018950874145766095
sim_compute_performance-ego2_median0.001885319537803775
sim_compute_performance-ego2_min0.0018623782435027289
sim_compute_performance-ego3_max0.0019443556666374209
sim_compute_performance-ego3_mean0.0019161465577624416
sim_compute_performance-ego3_median0.0019219523570576651
sim_compute_performance-ego3_min0.0018821316495922385
sim_compute_sim_state_max0.043725351608365305
sim_compute_sim_state_mean0.029082378437273324
sim_compute_sim_state_median0.03757484467303167
sim_compute_sim_state_min0.009006058542351973
sim_render-ego0_max0.003731683434033003
sim_render-ego0_mean0.003708533649833849
sim_render-ego0_median0.0037246731420358023
sim_render-ego0_min0.0036590528130829086
sim_render-ego1_max0.003710103531678518
sim_render-ego1_mean0.003661157313521925
sim_render-ego1_median0.003659979632643403
sim_render-ego1_min0.003607726513992043
sim_render-ego2_max0.0036924046774705257
sim_render-ego2_mean0.003632554762511723
sim_render-ego2_median0.0036358821587484393
sim_render-ego2_min0.0035693774513162048
sim_render-ego3_max0.003686646620432536
sim_render-ego3_mean0.0036379254397155662
sim_render-ego3_median0.0036466926824851114
sim_render-ego3_min0.00358043701622905
simulation-passed1
step_physics_max1.10137550635416
step_physics_mean0.8971201734312453
step_physics_median1.0121659624079864
step_physics_min0.2708438045100162
survival_time_max59.99999999999873
survival_time_mean29.24285714285687
survival_time_min4.699999999999991
No reset possible