Duckietown Challenges Home Challenges Submissions

Submission 12933

Submission12933
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAndrás Kalapos 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59876
Next
User label3086
Admin priority50
Blessingn/a
User priority50

59876

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59876LFVmultibodyv-simsuccessyes0:58:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.849286312168693
survival_time_median30.00000000000029
deviation-center-line_median1.242845197707601
in-drivable-lane_median1.4500000000000095


other stats
agent_compute-ego0_max0.013463931880914827
agent_compute-ego0_mean0.01299603627417129
agent_compute-ego0_median0.01280916925643506
agent_compute-ego0_min0.012663351319197212
agent_compute-ego1_max0.013202573222692832
agent_compute-ego1_mean0.012771444455512964
agent_compute-ego1_median0.012684707915314735
agent_compute-ego1_min0.012399800406914584
agent_compute-ego2_max0.013260508937414511
agent_compute-ego2_mean0.012569179326132269
agent_compute-ego2_median0.012328752578205211
agent_compute-ego2_min0.012118276462777085
agent_compute-ego3_max0.013551242720065432
agent_compute-ego3_mean0.012769435278284376
agent_compute-ego3_median0.012487661802516602
agent_compute-ego3_min0.012269401312271094
complete-iteration_max1.3000385926724984
complete-iteration_mean1.0614714029176144
complete-iteration_median1.2139585385509848
complete-iteration_min0.3433654202940714
deviation-center-line_max3.086117451201328
deviation-center-line_mean1.4441757569148972
deviation-center-line_min0.24178489923258445
deviation-heading_max15.719778260714584
deviation-heading_mean5.8035982286542085
deviation-heading_median4.5955107141226295
deviation-heading_min1.305633080105113
driven_any_max14.21524705318736
driven_any_mean7.357601332929633
driven_any_median6.855958759443519
driven_any_min1.7073002619039752
driven_lanedir_consec_max12.254349569374858
driven_lanedir_consec_mean6.354264275960783
driven_lanedir_consec_min1.227618647860131
driven_lanedir_max12.254349569374858
driven_lanedir_mean6.354264275960783
driven_lanedir_median5.849286312168693
driven_lanedir_min1.227618647860131
get_duckie_state_max1.368086420775212e-06
get_duckie_state_mean1.253539382082149e-06
get_duckie_state_median1.244674636518127e-06
get_duckie_state_min1.1551995047316972e-06
get_robot_state_max0.013920563628620906
get_robot_state_mean0.012810659466178528
get_robot_state_median0.013821614472887668
get_robot_state_min0.006970058488582379
get_state_dump_max0.009464510607794631
get_state_dump_mean0.008820807002988098
get_state_dump_median0.009222662340838385
get_state_dump_min0.0061210400491788245
get_ui_image_max0.04985558121738374
get_ui_image_mean0.043622656599872224
get_ui_image_median0.046057642046418434
get_ui_image_min0.029412230734008452
in-drivable-lane_max25.700000000000266
in-drivable-lane_mean3.9678571428571767
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 13.834770611603588, "get_ui_image": 0.04205995946874634, "step_physics": 0.8631576845134158, "survival_time": 30.00000000000029, "driven_lanedir": 12.254349569374858, "get_state_dump": 0.009125131537235914, "get_robot_state": 0.013610100785825098, "sim_render-ego0": 0.0035351282744955103, "sim_render-ego1": 0.0035425176636351523, "sim_render-ego2": 0.003470647751590773, "sim_render-ego3": 0.0034706989262941077, "get_duckie_state": 1.1551995047316972e-06, "in-drivable-lane": 2.150000000000019, "deviation-heading": 6.844612841497715, "agent_compute-ego0": 0.012663351319197212, "agent_compute-ego1": 0.012399800406914584, "agent_compute-ego2": 0.012118276462777085, "agent_compute-ego3": 0.012269401312271094, "complete-iteration": 1.0294700688411311, "set_robot_commands": 0.002039382541040811, "deviation-center-line": 1.4662990514789194, "driven_lanedir_consec": 12.254349569374858, "sim_compute_sim_state": 0.02231721433744256, "sim_compute_performance-ego0": 0.0018364014522406504, "sim_compute_performance-ego1": 0.001813712413616466, "sim_compute_performance-ego2": 0.001823314216093295, "sim_compute_performance-ego3": 0.0018191690651231912}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 6.706560737394435, "get_ui_image": 0.04205995946874634, "step_physics": 0.8631576845134158, "survival_time": 30.00000000000029, "driven_lanedir": 5.630929656905317, "get_state_dump": 0.009125131537235914, "get_robot_state": 0.013610100785825098, "sim_render-ego0": 0.0035351282744955103, "sim_render-ego1": 0.0035425176636351523, "sim_render-ego2": 0.003470647751590773, "sim_render-ego3": 0.0034706989262941077, "get_duckie_state": 1.1551995047316972e-06, "in-drivable-lane": 1.3000000000000105, "deviation-heading": 4.716975030620598, "agent_compute-ego0": 0.012663351319197212, "agent_compute-ego1": 0.012399800406914584, "agent_compute-ego2": 0.012118276462777085, "agent_compute-ego3": 0.012269401312271094, "complete-iteration": 1.0294700688411311, "set_robot_commands": 0.002039382541040811, "deviation-center-line": 2.089810789537073, "driven_lanedir_consec": 5.630929656905317, "sim_compute_sim_state": 0.02231721433744256, "sim_compute_performance-ego0": 0.0018364014522406504, "sim_compute_performance-ego1": 0.001813712413616466, "sim_compute_performance-ego2": 0.001823314216093295, "sim_compute_performance-ego3": 0.0018191690651231912}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 6.743145109830518, "get_ui_image": 0.04205995946874634, "step_physics": 0.8631576845134158, "survival_time": 30.00000000000029, "driven_lanedir": 5.897897990256672, "get_state_dump": 0.009125131537235914, "get_robot_state": 0.013610100785825098, "sim_render-ego0": 0.0035351282744955103, "sim_render-ego1": 0.0035425176636351523, "sim_render-ego2": 0.003470647751590773, "sim_render-ego3": 0.0034706989262941077, "get_duckie_state": 1.1551995047316972e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 15.719778260714584, "agent_compute-ego0": 0.012663351319197212, "agent_compute-ego1": 0.012399800406914584, "agent_compute-ego2": 0.012118276462777085, "agent_compute-ego3": 0.012269401312271094, "complete-iteration": 1.0294700688411311, "set_robot_commands": 0.002039382541040811, "deviation-center-line": 2.8605644310106917, "driven_lanedir_consec": 5.897897990256672, "sim_compute_sim_state": 0.02231721433744256, "sim_compute_performance-ego0": 0.0018364014522406504, "sim_compute_performance-ego1": 0.001813712413616466, "sim_compute_performance-ego2": 0.001823314216093295, "sim_compute_performance-ego3": 0.0018191690651231912}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.345123881426048, "get_ui_image": 0.04205995946874634, "step_physics": 0.8631576845134158, "survival_time": 30.00000000000029, "driven_lanedir": 9.893302145210772, "get_state_dump": 0.009125131537235914, "get_robot_state": 0.013610100785825098, "sim_render-ego0": 0.0035351282744955103, "sim_render-ego1": 0.0035425176636351523, "sim_render-ego2": 0.003470647751590773, "sim_render-ego3": 0.0034706989262941077, "get_duckie_state": 1.1551995047316972e-06, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 7.492379107314271, "agent_compute-ego0": 0.012663351319197212, "agent_compute-ego1": 0.012399800406914584, "agent_compute-ego2": 0.012118276462777085, "agent_compute-ego3": 0.012269401312271094, "complete-iteration": 1.0294700688411311, "set_robot_commands": 0.002039382541040811, "deviation-center-line": 1.3720800630004677, "driven_lanedir_consec": 9.893302145210772, "sim_compute_sim_state": 0.02231721433744256, "sim_compute_performance-ego0": 0.0018364014522406504, "sim_compute_performance-ego1": 0.001813712413616466, "sim_compute_performance-ego2": 0.001823314216093295, "sim_compute_performance-ego3": 0.0018191690651231912}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.9113554927962169, "get_ui_image": 0.04985558121738374, "step_physics": 1.1140822491811275, "survival_time": 15.80000000000009, "driven_lanedir": 1.8522792053716473, "get_state_dump": 0.009464510607794631, "get_robot_state": 0.013920563628620906, "sim_render-ego0": 0.003703069235624199, "sim_render-ego1": 0.0036553561875496752, "sim_render-ego2": 0.003660340414438338, "sim_render-ego3": 0.0036795304776742256, "get_duckie_state": 1.368086420775212e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.939389790416122, "agent_compute-ego0": 0.013463931880914827, "agent_compute-ego1": 0.013202573222692832, "agent_compute-ego2": 0.013260508937414511, "agent_compute-ego3": 0.013551242720065432, "complete-iteration": 1.3000385926724984, "set_robot_commands": 0.002192712356615518, "deviation-center-line": 0.29753209250038815, "driven_lanedir_consec": 1.8522792053716473, "sim_compute_sim_state": 0.028031609411871397, "sim_compute_performance-ego0": 0.001953043020110025, "sim_compute_performance-ego1": 0.0019234708431015257, "sim_compute_performance-ego2": 0.0018913309656859196, "sim_compute_performance-ego3": 0.0018930021520668775}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 6.647885977125939, "get_ui_image": 0.04985558121738374, "step_physics": 1.1140822491811275, "survival_time": 15.80000000000009, "driven_lanedir": 5.543852524699577, "get_state_dump": 0.009464510607794631, "get_robot_state": 0.013920563628620906, "sim_render-ego0": 0.003703069235624199, "sim_render-ego1": 0.0036553561875496752, "sim_render-ego2": 0.003660340414438338, "sim_render-ego3": 0.0036795304776742256, "get_duckie_state": 1.368086420775212e-06, "in-drivable-lane": 1.6000000000000083, "deviation-heading": 4.017356629992249, "agent_compute-ego0": 0.013463931880914827, "agent_compute-ego1": 0.013202573222692832, "agent_compute-ego2": 0.013260508937414511, "agent_compute-ego3": 0.013551242720065432, "complete-iteration": 1.3000385926724984, "set_robot_commands": 0.002192712356615518, "deviation-center-line": 0.9453159492494144, "driven_lanedir_consec": 5.543852524699577, "sim_compute_sim_state": 0.028031609411871397, "sim_compute_performance-ego0": 0.001953043020110025, "sim_compute_performance-ego1": 0.0019234708431015257, "sim_compute_performance-ego2": 0.0018913309656859196, "sim_compute_performance-ego3": 0.0018930021520668775}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.968772409056521, "get_ui_image": 0.04985558121738374, "step_physics": 1.1140822491811275, "survival_time": 15.80000000000009, "driven_lanedir": 5.800674634080714, "get_state_dump": 0.009464510607794631, "get_robot_state": 0.013920563628620906, "sim_render-ego0": 0.003703069235624199, "sim_render-ego1": 0.0036553561875496752, "sim_render-ego2": 0.003660340414438338, "sim_render-ego3": 0.0036795304776742256, "get_duckie_state": 1.368086420775212e-06, "in-drivable-lane": 2.3000000000000327, "deviation-heading": 4.135472748035969, "agent_compute-ego0": 0.013463931880914827, "agent_compute-ego1": 0.013202573222692832, "agent_compute-ego2": 0.013260508937414511, "agent_compute-ego3": 0.013551242720065432, "complete-iteration": 1.3000385926724984, "set_robot_commands": 0.002192712356615518, "deviation-center-line": 0.9560302839794634, "driven_lanedir_consec": 5.800674634080714, "sim_compute_sim_state": 0.028031609411871397, "sim_compute_performance-ego0": 0.001953043020110025, "sim_compute_performance-ego1": 0.0019234708431015257, "sim_compute_performance-ego2": 0.0018913309656859196, "sim_compute_performance-ego3": 0.0018930021520668775}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.7073002619039752, "get_ui_image": 0.04985558121738374, "step_physics": 1.1140822491811275, "survival_time": 15.80000000000009, "driven_lanedir": 1.227618647860131, "get_state_dump": 0.009464510607794631, "get_robot_state": 0.013920563628620906, "sim_render-ego0": 0.003703069235624199, "sim_render-ego1": 0.0036553561875496752, "sim_render-ego2": 0.003660340414438338, "sim_render-ego3": 0.0036795304776742256, "get_duckie_state": 1.368086420775212e-06, "in-drivable-lane": 12.300000000000091, "deviation-heading": 1.305633080105113, "agent_compute-ego0": 0.013463931880914827, "agent_compute-ego1": 0.013202573222692832, "agent_compute-ego2": 0.013260508937414511, "agent_compute-ego3": 0.013551242720065432, "complete-iteration": 1.3000385926724984, "set_robot_commands": 0.002192712356615518, "deviation-center-line": 0.24178489923258445, "driven_lanedir_consec": 1.227618647860131, "sim_compute_sim_state": 0.028031609411871397, "sim_compute_performance-ego0": 0.001953043020110025, "sim_compute_performance-ego1": 0.0019234708431015257, "sim_compute_performance-ego2": 0.0018913309656859196, "sim_compute_performance-ego3": 0.0018930021520668775}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.001383379105029, "get_ui_image": 0.046057642046418434, "step_physics": 1.0385038917518454, "survival_time": 33.05000000000026, "driven_lanedir": 8.313376401772913, "get_state_dump": 0.009222662340838385, "get_robot_state": 0.013821614472887668, "sim_render-ego0": 0.0035644326685418536, "sim_render-ego1": 0.003581113685654009, "sim_render-ego2": 0.003498180035017768, "sim_render-ego3": 0.0035001406856894133, "get_duckie_state": 1.244674636518127e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 7.225933743605126, "agent_compute-ego0": 0.01280916925643506, "agent_compute-ego1": 0.012684707915314735, "agent_compute-ego2": 0.012328752578205211, "agent_compute-ego3": 0.012487661802516602, "complete-iteration": 1.2139585385509848, "set_robot_commands": 0.0020527724412993, "deviation-center-line": 2.249593711149509, "driven_lanedir_consec": 8.313376401772913, "sim_compute_sim_state": 0.025996625963654763, "sim_compute_performance-ego0": 0.001843315236878179, "sim_compute_performance-ego1": 0.0018441057637378889, "sim_compute_performance-ego2": 0.001863826797808045, "sim_compute_performance-ego3": 0.0018384604295575008}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.9165852192745234, "get_ui_image": 0.046057642046418434, "step_physics": 1.0385038917518454, "survival_time": 33.05000000000026, "driven_lanedir": 2.7182840954477467, "get_state_dump": 0.009222662340838385, "get_robot_state": 0.013821614472887668, "sim_render-ego0": 0.0035644326685418536, "sim_render-ego1": 0.003581113685654009, "sim_render-ego2": 0.003498180035017768, "sim_render-ego3": 0.0035001406856894133, "get_duckie_state": 1.244674636518127e-06, "in-drivable-lane": 25.700000000000266, "deviation-heading": 2.9791290823162604, "agent_compute-ego0": 0.01280916925643506, "agent_compute-ego1": 0.012684707915314735, "agent_compute-ego2": 0.012328752578205211, "agent_compute-ego3": 0.012487661802516602, "complete-iteration": 1.2139585385509848, "set_robot_commands": 0.0020527724412993, "deviation-center-line": 0.5608946958075788, "driven_lanedir_consec": 2.7182840954477467, "sim_compute_sim_state": 0.025996625963654763, "sim_compute_performance-ego0": 0.001843315236878179, "sim_compute_performance-ego1": 0.0018441057637378889, "sim_compute_performance-ego2": 0.001863826797808045, "sim_compute_performance-ego3": 0.0018384604295575008}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.223291172993584, "get_ui_image": 0.046057642046418434, "step_physics": 1.0385038917518454, "survival_time": 33.05000000000026, "driven_lanedir": 4.106577213731439, "get_state_dump": 0.009222662340838385, "get_robot_state": 0.013821614472887668, "sim_render-ego0": 0.0035644326685418536, "sim_render-ego1": 0.003581113685654009, "sim_render-ego2": 0.003498180035017768, "sim_render-ego3": 0.0035001406856894133, "get_duckie_state": 1.244674636518127e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.096188545590675, "agent_compute-ego0": 0.01280916925643506, "agent_compute-ego1": 0.012684707915314735, "agent_compute-ego2": 0.012328752578205211, "agent_compute-ego3": 0.012487661802516602, "complete-iteration": 1.2139585385509848, "set_robot_commands": 0.0020527724412993, "deviation-center-line": 3.086117451201328, "driven_lanedir_consec": 4.106577213731439, "sim_compute_sim_state": 0.025996625963654763, "sim_compute_performance-ego0": 0.001843315236878179, "sim_compute_performance-ego1": 0.0018441057637378889, "sim_compute_performance-ego2": 0.001863826797808045, "sim_compute_performance-ego3": 0.0018384604295575008}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 14.21524705318736, "get_ui_image": 0.046057642046418434, "step_physics": 1.0385038917518454, "survival_time": 33.05000000000026, "driven_lanedir": 10.703463410913322, "get_state_dump": 0.009222662340838385, "get_robot_state": 0.013821614472887668, "sim_render-ego0": 0.0035644326685418536, "sim_render-ego1": 0.003581113685654009, "sim_render-ego2": 0.003498180035017768, "sim_render-ego3": 0.0035001406856894133, "get_duckie_state": 1.244674636518127e-06, "in-drivable-lane": 5.949999999999991, "deviation-heading": 10.362273844929604, "agent_compute-ego0": 0.01280916925643506, "agent_compute-ego1": 0.012684707915314735, "agent_compute-ego2": 0.012328752578205211, "agent_compute-ego3": 0.012487661802516602, "complete-iteration": 1.2139585385509848, "set_robot_commands": 0.0020527724412993, "deviation-center-line": 1.9962364308759648, "driven_lanedir_consec": 10.703463410913322, "sim_compute_sim_state": 0.025996625963654763, "sim_compute_performance-ego0": 0.001843315236878179, "sim_compute_performance-ego1": 0.0018441057637378889, "sim_compute_performance-ego2": 0.001863826797808045, "sim_compute_performance-ego3": 0.0018384604295575008}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 7.973845926057013, "get_ui_image": 0.029412230734008452, "step_physics": 0.24979605002956495, "survival_time": 18.05000000000012, "driven_lanedir": 7.467017918805542, "get_state_dump": 0.0061210400491788245, "get_robot_state": 0.006970058488582379, "sim_render-ego0": 0.003605251154188293, "sim_render-ego1": 0.0035514508821687645, "get_duckie_state": 1.2388545505249698e-06, "in-drivable-lane": 0.9500000000000136, "deviation-heading": 4.474046397624661, "agent_compute-ego0": 0.013099349006104865, "agent_compute-ego1": 0.012825948098746452, "complete-iteration": 0.3433654202940714, "set_robot_commands": 0.002088059377933734, "deviation-center-line": 0.9825904153704488, "driven_lanedir_consec": 7.467017918805542, "sim_compute_sim_state": 0.009970664978027344, "sim_compute_performance-ego0": 0.001863814190606386, "sim_compute_performance-ego1": 0.001840979354816247}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 7.811151429260129, "get_ui_image": 0.029412230734008452, "step_physics": 0.24979605002956495, "survival_time": 18.05000000000012, "driven_lanedir": 7.550076449020312, "get_state_dump": 0.0061210400491788245, "get_robot_state": 0.006970058488582379, "sim_render-ego0": 0.003605251154188293, "sim_render-ego1": 0.0035514508821687645, "get_duckie_state": 1.2388545505249698e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.9412060983959623, "agent_compute-ego0": 0.013099349006104865, "agent_compute-ego1": 0.012825948098746452, "complete-iteration": 0.3433654202940714, "set_robot_commands": 0.002088059377933734, "deviation-center-line": 1.1136103324147342, "driven_lanedir_consec": 7.550076449020312, "sim_compute_sim_state": 0.009970664978027344, "sim_compute_performance-ego0": 0.001863814190606386, "sim_compute_performance-ego1": 0.001840979354816247}}
set_robot_commands_max0.002192712356615518
set_robot_commands_mean0.0020939705794064275
set_robot_commands_median0.0020527724412993
set_robot_commands_min0.002039382541040811
sim_compute_performance-ego0_max0.001953043020110025
sim_compute_performance-ego0_mean0.001875619087009156
sim_compute_performance-ego0_median0.001843315236878179
sim_compute_performance-ego0_min0.0018364014522406504
sim_compute_performance-ego1_max0.0019234708431015257
sim_compute_performance-ego1_mean0.001857651056532572
sim_compute_performance-ego1_median0.0018441057637378889
sim_compute_performance-ego1_min0.001813712413616466
sim_compute_performance-ego2_max0.0018913309656859196
sim_compute_performance-ego2_mean0.00185949065986242
sim_compute_performance-ego2_median0.001863826797808045
sim_compute_performance-ego2_min0.001823314216093295
sim_compute_performance-ego3_max0.0018930021520668775
sim_compute_performance-ego3_mean0.0018502105489158567
sim_compute_performance-ego3_median0.0018384604295575008
sim_compute_performance-ego3_min0.0018191690651231912
sim_compute_sim_state_max0.028031609411871397
sim_compute_sim_state_mean0.023237366343423545
sim_compute_sim_state_median0.025996625963654763
sim_compute_sim_state_min0.009970664978027344
sim_render-ego0_max0.003703069235624199
sim_render-ego0_mean0.0036015016445016313
sim_render-ego0_median0.0035644326685418536
sim_render-ego0_min0.0035351282744955103
sim_render-ego1_max0.0036553561875496752
sim_render-ego1_mean0.003587060850835206
sim_render-ego1_median0.003581113685654009
sim_render-ego1_min0.0035425176636351523
sim_render-ego2_max0.003660340414438338
sim_render-ego2_mean0.0035430560670156267
sim_render-ego2_median0.003498180035017768
sim_render-ego2_min0.003470647751590773
sim_render-ego3_max0.0036795304776742256
sim_render-ego3_mean0.003550123363219249
sim_render-ego3_median0.0035001406856894133
sim_render-ego3_min0.0034706989262941077
simulation-passed1
step_physics_max1.1140822491811275
step_physics_mean0.8973262429889063
step_physics_median1.0385038917518454
step_physics_min0.24979605002956495
survival_time_max33.05000000000026
survival_time_mean25.107142857143053
survival_time_min15.80000000000009
No reset possible