Duckietown Challenges Home Challenges Submissions

Submission 12806

Submission12806
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59042
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59042LFVmultibodyv-simsuccessyes0:55:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5084838441570838
survival_time_median21.800000000000175
deviation-center-line_median1.2710970493463924
in-drivable-lane_median3.824999999999991


other stats
agent_compute-ego0_max0.013344642126335288
agent_compute-ego0_mean0.012635413948309474
agent_compute-ego0_median0.012588976128783748
agent_compute-ego0_min0.011835391788788192
agent_compute-ego1_max0.01324947313828902
agent_compute-ego1_mean0.012945847260571058
agent_compute-ego1_median0.012857615315872033
agent_compute-ego1_min0.012729663325119892
complete-iteration_max1.284680648743053
complete-iteration_mean1.0389465658538215
complete-iteration_median1.236206903210226
complete-iteration_min0.40150934291052653
deviation-center-line_max2.421882040545748
deviation-center-line_mean1.2787541563928515
deviation-center-line_min0.14838083384301978
deviation-heading_max13.7052251082897
deviation-heading_mean6.030426668860836
deviation-heading_median5.172551537136917
deviation-heading_min2.058733078090023
driven_any_max5.456927279279734
driven_any_mean3.0868713583176084
driven_any_median2.963504128837745
driven_any_min0.6128588800870656
driven_lanedir_consec_max4.8038757696390135
driven_lanedir_consec_mean1.960731648147889
driven_lanedir_consec_min0.1285661418938557
driven_lanedir_max4.8038757696390135
driven_lanedir_mean2.0337744836978535
driven_lanedir_median1.8452301892762584
driven_lanedir_min0.17756259747807523
get_duckie_state_max1.6374408074145048e-06
get_duckie_state_mean1.5317169709435185e-06
get_duckie_state_median1.5036192311302202e-06
get_duckie_state_min1.4617726519391253e-06
get_robot_state_max0.01657354325618384
get_robot_state_mean0.014269102602559092
get_robot_state_median0.014673409950606814
get_robot_state_min0.008349751259063507
get_state_dump_max0.010744894450565552
get_state_dump_mean0.00960743678826588
get_state_dump_median0.009724837731135609
get_state_dump_min0.00707233493978327
get_ui_image_max0.05150970342723725
get_ui_image_mean0.04781793958479881
get_ui_image_median0.050413284099326945
get_ui_image_min0.03743535613680219
in-drivable-lane_max26.05000000000027
in-drivable-lane_mean8.039285714285798
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1243037957907809, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 1.081660993845488, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.996207693079557, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 2.0143820992067414, "driven_lanedir_consec": 1.081660993845488, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.8408227491222977, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 3.5308316706101386, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 6.8933337507334205, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 1.5373697034973262, "driven_lanedir_consec": 3.5308316706101386, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.0998400612425856, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 2.856030957082494, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.292112498046781, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 1.183320624589836, "driven_lanedir_consec": 2.856030957082494, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.9882531904762024, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 0.9350585358583664, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.164222931351451, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 2.0989994855604155, "driven_lanedir_consec": 0.9350585358583664, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.384973723496649, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 0.6244060285224133, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 23.600000000000275, "deviation-heading": 2.440485261112225, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 0.34213408335642825, "driven_lanedir_consec": 0.6010602947416137, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 2.415531517680019, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 0.5318655681230391, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 9.000000000000025, "deviation-heading": 12.519849142300531, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 1.9335977564362208, "driven_lanedir_consec": 0.5015745274607548, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.6128588800870656, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 0.17756259747807523, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 26.05000000000027, "deviation-heading": 2.058733078090023, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 0.14838083384301978, "driven_lanedir_consec": 0.1285661418938557, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.7175352958788572, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 2.156927407027989, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 13.7052251082897, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 2.421882040545748, "driven_lanedir_consec": 1.236960939355791, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 4.676864111478588, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 4.477832723411174, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.348895381194277, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 1.1228981736012638, "driven_lanedir_consec": 4.477832723411174, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.827168196432904, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 1.0791313596694372, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 15.05000000000019, "deviation-heading": 3.1169705399694263, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 0.4830178090352112, "driven_lanedir_consec": 1.0791313596694372, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.657162908727112, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 2.527198781949801, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 5.799999999999988, "deviation-heading": 4.878830640086125, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 1.358873474102949, "driven_lanedir_consec": 2.527198781949801, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.7784672919695086, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 1.7800067489583768, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 12.60000000000018, "deviation-heading": 2.650837517707333, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 0.52595822033825, "driven_lanedir_consec": 1.7800067489583768, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.456927279279734, "get_ui_image": 0.03743535613680219, "step_physics": 0.29188143290006197, "survival_time": 28.55000000000027, "driven_lanedir": 4.8038757696390135, "get_state_dump": 0.00707233493978327, "get_robot_state": 0.008349751259063507, "sim_render-ego0": 0.004404397277565269, "sim_render-ego1": 0.004600667453312374, "get_duckie_state": 1.4617726519391253e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 8.71724594062464, "agent_compute-ego0": 0.01290987755035187, "agent_compute-ego1": 0.01324947313828902, "complete-iteration": 0.40150934291052653, "set_robot_commands": 0.0026478263048025277, "deviation-center-line": 1.8679021115491312, "driven_lanedir_consec": 4.8038757696390135, "sim_compute_sim_state": 0.011529435644616616, "sim_compute_performance-ego0": 0.002366334825128942, "sim_compute_performance-ego1": 0.0023559044291089465}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 4.635490014784218, "get_ui_image": 0.03743535613680219, "step_physics": 0.29188143290006197, "survival_time": 28.55000000000027, "driven_lanedir": 1.9104536295941408, "get_state_dump": 0.00707233493978327, "get_robot_state": 0.008349751259063507, "sim_render-ego0": 0.004404397277565269, "sim_render-ego1": 0.004600667453312374, "get_duckie_state": 1.4617726519391253e-06, "in-drivable-lane": 16.90000000000024, "deviation-heading": 3.643023881466235, "agent_compute-ego0": 0.01290987755035187, "agent_compute-ego1": 0.01324947313828902, "complete-iteration": 0.40150934291052653, "set_robot_commands": 0.0026478263048025277, "deviation-center-line": 0.8638417738373809, "driven_lanedir_consec": 1.9104536295941408, "sim_compute_sim_state": 0.011529435644616616, "sim_compute_performance-ego0": 0.002366334825128942, "sim_compute_performance-ego1": 0.0023559044291089465}}
set_robot_commands_max0.0028116382517904604
set_robot_commands_mean0.0025339973061624657
set_robot_commands_median0.0023797464033740146
set_robot_commands_min0.0023536927640028893
sim_compute_performance-ego0_max0.0024297023719211793
sim_compute_performance-ego0_mean0.002264838040226564
sim_compute_performance-ego0_median0.0021586852023121324
sim_compute_performance-ego0_min0.002155378153995191
sim_compute_performance-ego1_max0.002365599825697125
sim_compute_performance-ego1_mean0.002160636517214712
sim_compute_performance-ego1_median0.0020211012540352217
sim_compute_performance-ego1_min0.001997574515964674
sim_compute_sim_state_max0.03274885795209173
sim_compute_sim_state_mean0.02352856463790088
sim_compute_sim_state_median0.025062694566409915
sim_compute_sim_state_min0.011529435644616616
sim_render-ego0_max0.004518132727101164
sim_render-ego0_mean0.004191689741434331
sim_render-ego0_median0.004018446581944981
sim_render-ego0_min0.003932136147191377
sim_render-ego1_max0.004600667453312374
sim_render-ego1_mean0.004313610443061895
sim_render-ego1_median0.004147914610144948
sim_render-ego1_min0.004143800015307673
simulation-passed1
step_physics_max1.098352138229478
step_physics_mean0.8632242306589356
step_physics_median1.0485418169003613
step_physics_min0.29188143290006197
survival_time_max28.55000000000027
survival_time_mean24.421428571428784
survival_time_min21.15000000000017
No reset possible