Duckietown Challenges Home Challenges Submissions

Submission 12674

Submission12674
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53497
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53497LFVmultibodyv-simsuccessyes1:42:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0653124009090247
survival_time_median59.99999999999873
deviation-center-line_median3.5269811335906747
in-drivable-lane_median8.774999999999904


other stats
agent_compute-ego0_max0.01376057119297802
agent_compute-ego0_mean0.01207049405415167
agent_compute-ego0_median0.011660532788571272
agent_compute-ego0_min0.011143876948424124
agent_compute-ego1_max0.011805763848119733
agent_compute-ego1_mean0.011673112881559785
agent_compute-ego1_median0.01179619911409834
agent_compute-ego1_min0.011260593590671069
agent_compute-ego2_max0.01251318651273983
agent_compute-ego2_mean0.012083081460647654
agent_compute-ego2_median0.011946928531006163
agent_compute-ego2_min0.01178912933819697
agent_compute-ego3_max0.011412711465090736
agent_compute-ego3_mean0.0113453077649714
agent_compute-ego3_median0.011316363375288505
agent_compute-ego3_min0.011306848454534958
complete-iteration_max1.166461277725105
complete-iteration_mean0.9560285482629036
complete-iteration_median1.099287197254381
complete-iteration_min0.2741516959177305
deviation-center-line_max6.658525661278727
deviation-center-line_mean2.9922080985742023
deviation-center-line_min0.3487993547739799
deviation-heading_max27.898773454390817
deviation-heading_mean15.873855603124424
deviation-heading_median19.38328696414301
deviation-heading_min2.206078527664331
driven_any_max7.920431501175876
driven_any_mean4.7369239560146665
driven_any_median4.5514912282205575
driven_any_min0.160671805154944
driven_lanedir_consec_max5.602500060828261
driven_lanedir_consec_mean2.731521061487148
driven_lanedir_consec_min0.14746808103183673
driven_lanedir_max5.7266240465529705
driven_lanedir_mean3.170694365755834
driven_lanedir_median3.417872906512262
driven_lanedir_min0.14746808103183673
get_duckie_state_max1.8018827701272225e-06
get_duckie_state_mean1.725975120323046e-06
get_duckie_state_median1.7403960724258105e-06
get_duckie_state_min1.6568205338731396e-06
get_robot_state_max0.0138415809872744
get_robot_state_mean0.012784666016464294
get_robot_state_median0.013813085698962313
get_robot_state_min0.0068853407689969835
get_state_dump_max0.009192049652213955
get_state_dump_mean0.008700306973257367
get_state_dump_median0.009184334212377255
get_state_dump_min0.005873294725810012
get_ui_image_max0.05044645790652768
get_ui_image_mean0.044830890497356675
get_ui_image_median0.04772985328941123
get_ui_image_min0.02988703773446279
in-drivable-lane_max49.24999999999864
in-drivable-lane_mean12.760714285714077
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.160671805154944, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 0.14746808103183673, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 0.0, "deviation-heading": 20.38963322176847, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 5.01805768121352, "driven_lanedir_consec": 0.14746808103183673, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 5.152127725592337, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 3.876487024868991, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 5.600000000000059, "deviation-heading": 14.041142982422402, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 2.775152956893138, "driven_lanedir_consec": 3.1884305453985156, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.9728867243526669, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 1.4675005289315144, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 3.1000000000000085, "deviation-heading": 16.901668181558097, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 2.721012784244379, "driven_lanedir_consec": 1.4675005289315144, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.8997756200461005, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 1.3073588183958913, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 28.449999999999815, "deviation-heading": 4.017439501190517, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 0.6232606486747951, "driven_lanedir_consec": 0.760029404494907, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.098694708375491, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 1.2021005996937888, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 49.24999999999864, "deviation-heading": 4.479160067115061, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 0.6685777393441074, "driven_lanedir_consec": 0.9545128566479312, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 7.906586753557528, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 5.565443751359446, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 8.599999999999866, "deviation-heading": 25.494099881646363, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 4.106553766736716, "driven_lanedir_consec": 3.171366013662516, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 7.913471073902338, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 4.57146845509793, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 17.349999999999767, "deviation-heading": 22.16918242628548, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 3.87448456982687, "driven_lanedir_consec": 4.57146845509793, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 7.913401758913237, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 5.2157658710816595, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 13.099999999999795, "deviation-heading": 21.589342506614155, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 3.6521403641664008, "driven_lanedir_consec": 3.95946232119375, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 7.920421466363552, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 5.7266240465529705, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 8.949999999999942, "deviation-heading": 21.5390492896068, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.7659268681008897, "driven_lanedir_consec": 5.602500060828261, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.920329828289729, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 4.643283928995383, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 18.04999999999933, "deviation-heading": 18.378638396939017, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.4018219030149486, "driven_lanedir_consec": 4.643283928995383, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.950854730848779, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 2.9592587881555334, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 5.450000000000045, "deviation-heading": 27.898773454390817, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 6.658525661278727, "driven_lanedir_consec": 2.9592587881555334, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 7.920431501175876, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 5.3140278758051185, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 12.349999999999705, "deviation-heading": 20.387935531347008, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.7900592621661313, "driven_lanedir_consec": 5.3140278758051185, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7936922895829552, "get_ui_image": 0.02988703773446279, "step_physics": 0.18357656344975512, "survival_time": 14.550000000000072, "driven_lanedir": 1.6314436480886731, "get_state_dump": 0.005873294725810012, "get_robot_state": 0.0068853407689969835, "sim_render-ego0": 0.003560206661485646, "sim_render-ego1": 0.0035970039563636255, "get_duckie_state": 1.683627089408979e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 2.741834475193422, "agent_compute-ego0": 0.011363496519114872, "agent_compute-ego1": 0.011260593590671069, "complete-iteration": 0.2741516959177305, "set_robot_commands": 0.0020687498458444257, "deviation-center-line": 0.3487993547739799, "driven_lanedir_consec": 0.8664082177196974, "sim_compute_sim_state": 0.01026910461791574, "sim_compute_performance-ego0": 0.0018348024316030007, "sim_compute_performance-ego1": 0.0018260127877535888}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.793589398049799, "get_ui_image": 0.02988703773446279, "step_physics": 0.18357656344975512, "survival_time": 14.550000000000072, "driven_lanedir": 0.7614897025229552, "get_state_dump": 0.005873294725810012, "get_robot_state": 0.0068853407689969835, "sim_render-ego0": 0.003560206661485646, "sim_render-ego1": 0.0035970039563636255, "get_duckie_state": 1.683627089408979e-06, "in-drivable-lane": 7.900000000000079, "deviation-heading": 2.206078527664331, "agent_compute-ego0": 0.011363496519114872, "agent_compute-ego1": 0.011260593590671069, "complete-iteration": 0.2741516959177305, "set_robot_commands": 0.0020687498458444257, "deviation-center-line": 0.48653981960423054, "driven_lanedir_consec": 0.6355777828571864, "sim_compute_sim_state": 0.01026910461791574, "sim_compute_performance-ego0": 0.0018348024316030007, "sim_compute_performance-ego1": 0.0018260127877535888}}
set_robot_commands_max0.002127653156887185
set_robot_commands_mean0.002096018546088179
set_robot_commands_median0.002094592665669912
set_robot_commands_min0.0020687498458444257
sim_compute_performance-ego0_max0.001884248036329792
sim_compute_performance-ego0_mean0.0018624519157663015
sim_compute_performance-ego0_median0.001860888679523516
sim_compute_performance-ego0_min0.0018348024316030007
sim_compute_performance-ego1_max0.0018902150610634555
sim_compute_performance-ego1_mean0.0018594752550591016
sim_compute_performance-ego1_median0.001855757909452389
sim_compute_performance-ego1_min0.0018260127877535888
sim_compute_performance-ego2_max0.0018652241331592837
sim_compute_performance-ego2_mean0.001861022160456932
sim_compute_performance-ego2_median0.001861942300788568
sim_compute_performance-ego2_min0.001855900047422944
sim_compute_performance-ego3_max0.001888312193982882
sim_compute_performance-ego3_mean0.0018717470826524235
sim_compute_performance-ego3_median0.0018720466032512576
sim_compute_performance-ego3_min0.001854882450723132
sim_compute_sim_state_max0.03844714978652433
sim_compute_sim_state_mean0.027749253625989432
sim_compute_sim_state_median0.03789032269874083
sim_compute_sim_state_min0.01026910461791574
sim_render-ego0_max0.003644954590570359
sim_render-ego0_mean0.0036105240064669662
sim_render-ego0_median0.0036303222824592175
sim_render-ego0_min0.003560206661485646
sim_render-ego1_max0.0036898544686323
sim_render-ego1_mean0.003648677000026128
sim_render-ego1_median0.003650173507537459
sim_render-ego1_min0.0035970039563636255
sim_render-ego2_max0.003804211612545779
sim_render-ego2_mean0.003752164094587169
sim_render-ego2_median0.003739946169363227
sim_render-ego2_min0.003712334501852501
sim_render-ego3_max0.0036842823028564457
sim_render-ego3_mean0.0036568941491668585
sim_render-ego3_median0.003653979540468756
sim_render-ego3_min0.0036324206041753737
simulation-passed1
step_physics_max1.004639977500552
step_physics_mean0.7895518543458537
step_physics_median0.9112773281052944
step_physics_min0.18357656344975512
survival_time_max59.99999999999873
survival_time_mean47.749999999999254
survival_time_min14.550000000000072
No reset possible