Duckietown Challenges Home Challenges Submissions

Submission 12719

Submission12719
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53683
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53683LFVmultibodyv-simsuccessyes0:12:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3386162956066159
survival_time_median7.199999999999982
deviation-center-line_median0.13150150834523444
in-drivable-lane_median5.1749999999999865


other stats
agent_compute-ego0_max0.011722405751546225
agent_compute-ego0_mean0.010929438489737504
agent_compute-ego0_median0.011222859223683676
agent_compute-ego0_min0.00980748070610894
agent_compute-ego1_max0.011322734753290813
agent_compute-ego1_mean0.011028431262062323
agent_compute-ego1_median0.011310026563447095
agent_compute-ego1_min0.009510649575127495
complete-iteration_max0.7791247523688023
complete-iteration_mean0.6385245849410843
complete-iteration_median0.7153307931176547
complete-iteration_min0.22275862308463665
deviation-center-line_max1.1793353551209578
deviation-center-line_mean0.19682735223382447
deviation-center-line_min0.03781627258124975
deviation-heading_max4.13206271019058
deviation-heading_mean1.0463262829209203
deviation-heading_median0.9402685921450354
deviation-heading_min0.291348286294811
driven_any_max2.951704478527868
driven_any_mean1.9134596982041032
driven_any_median1.760372794839244
driven_any_min0.18489783262536005
driven_lanedir_consec_max0.7960762545928977
driven_lanedir_consec_mean0.3518580104312197
driven_lanedir_consec_min0.10162466951715476
driven_lanedir_max0.7960762545928977
driven_lanedir_mean0.3521650626338418
driven_lanedir_median0.3407656610249702
driven_lanedir_min0.10162466951715476
get_duckie_state_max1.621246337890625e-06
get_duckie_state_mean1.4283424279340927e-06
get_duckie_state_median1.41804514367596e-06
get_duckie_state_min1.1969094324593591e-06
get_robot_state_max0.013855441411336263
get_robot_state_mean0.012603908334645204
get_robot_state_median0.013493496796180462
get_robot_state_min0.006588858787459556
get_state_dump_max0.009104559818903605
get_state_dump_mean0.008536570188728405
get_state_dump_median0.009079020007763032
get_state_dump_min0.005694887854836204
get_ui_image_max0.046942214308113885
get_ui_image_mean0.04225200004815798
get_ui_image_median0.04475971764209224
get_ui_image_min0.027452302701545483
in-drivable-lane_max6.599999999999981
in-drivable-lane_mean4.764285714285701
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.274124355035624, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.7960762545928977, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.9316977066482196, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.23307611918600285, "driven_lanedir_consec": 0.7960762545928977, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.7771107787938447, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.4079052940890945, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 4.64999999999999, "deviation-heading": 0.5815629454748248, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.15345155549638095, "driven_lanedir_consec": 0.4079052940890945, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.615892599054939, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.3409414151275487, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 4.599999999999988, "deviation-heading": 0.9488394776418512, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.09422141413744677, "driven_lanedir_consec": 0.3409414151275487, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6398074009825068, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.21369386022737347, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 5.099999999999986, "deviation-heading": 0.36485645822221113, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.06914054888435704, "driven_lanedir_consec": 0.21369386022737347, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.5559095507228855, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.16582071872096904, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 6.449999999999982, "deviation-heading": 0.3586823355775982, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.059631431224197985, "driven_lanedir_consec": 0.16582071872096904, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.8734985354242055, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.19265203980442447, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 5.949999999999984, "deviation-heading": 1.2444813548952531, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.09612169677476312, "driven_lanedir_consec": 0.19265203980442447, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.3178974013322633, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.10162466951715476, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 6.499999999999982, "deviation-heading": 0.5541987636288823, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.03781627258124975, "driven_lanedir_consec": 0.10162466951715476, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.7765427252108315, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.6452515830462522, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 5.249999999999986, "deviation-heading": 0.9734465477255804, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.1436614022182105, "driven_lanedir_consec": 0.6452515830462522, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.18489783262536005, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.16126759294861004, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.13206271019058, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 1.1793353551209578, "driven_lanedir_consec": 0.16126759294861004, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.7205864887254294, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.34433052196676683, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1722790788608328, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 0.1193416144722584, "driven_lanedir_consec": 0.34433052196676683, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.7436348108846431, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.3484125379459806, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 6.049999999999981, "deviation-heading": 0.9782946667514604, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 0.14721758995799067, "driven_lanedir_consec": 0.3484125379459806, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.951704478527868, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.2576470504888566, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.3481560818464254, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 0.086677958791832, "driven_lanedir_consec": 0.2576470504888566, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.678414408768526, "get_ui_image": 0.027452302701545483, "step_physics": 0.1418391068776449, "survival_time": 4.899999999999991, "driven_lanedir": 0.6140974314754637, "get_state_dump": 0.005694887854836204, "get_robot_state": 0.006588858787459556, "sim_render-ego0": 0.003295166323883365, "sim_render-ego1": 0.0032425938230572324, "get_duckie_state": 1.1969094324593591e-06, "in-drivable-lane": 3.1499999999999897, "deviation-heading": 0.291348286294811, "agent_compute-ego0": 0.00980748070610894, "agent_compute-ego1": 0.009510649575127495, "complete-iteration": 0.22275862308463665, "set_robot_commands": 0.001906031309956252, "deviation-center-line": 0.16192487225063373, "driven_lanedir_consec": 0.6140974314754637, "sim_compute_sim_state": 0.008028813082762438, "sim_compute_performance-ego0": 0.0017115371395843198, "sim_compute_performance-ego1": 0.0016815541970609414}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6784144087685244, "get_ui_image": 0.027452302701545483, "step_physics": 0.1418391068776449, "survival_time": 4.899999999999991, "driven_lanedir": 0.34058990692239166, "get_state_dump": 0.005694887854836204, "get_robot_state": 0.006588858787459556, "sim_render-ego0": 0.003295166323883365, "sim_render-ego1": 0.0032425938230572324, "get_duckie_state": 1.1969094324593591e-06, "in-drivable-lane": 2.8999999999999924, "deviation-heading": 1.768661547134351, "agent_compute-ego0": 0.00980748070610894, "agent_compute-ego1": 0.009510649575127495, "complete-iteration": 0.22275862308463665, "set_robot_commands": 0.001906031309956252, "deviation-center-line": 0.17396510017726105, "driven_lanedir_consec": 0.33629117608568304, "sim_compute_sim_state": 0.008028813082762438, "sim_compute_performance-ego0": 0.0017115371395843198, "sim_compute_performance-ego1": 0.0016815541970609414}}
set_robot_commands_max0.002067895730336507
set_robot_commands_mean0.002003465559264225
set_robot_commands_median0.00201468530044057
set_robot_commands_min0.001906031309956252
sim_compute_performance-ego0_max0.001980968316396078
sim_compute_performance-ego0_mean0.001918462773474829
sim_compute_performance-ego0_median0.0019563428286848397
sim_compute_performance-ego0_min0.0017115371395843198
sim_compute_performance-ego1_max0.0018569456985573364
sim_compute_performance-ego1_mean0.0017967137390978757
sim_compute_performance-ego1_median0.0018273015817006429
sim_compute_performance-ego1_min0.0016815541970609414
sim_compute_sim_state_max0.03034915759645659
sim_compute_sim_state_mean0.022265041333594453
sim_compute_sim_state_median0.023762199613783095
sim_compute_sim_state_min0.008028813082762438
sim_render-ego0_max0.003640374327017591
sim_render-ego0_mean0.0035273315938283666
sim_render-ego0_median0.003612061341603597
sim_render-ego0_min0.003295166323883365
sim_render-ego1_max0.003557280699412028
sim_render-ego1_mean0.0034853825843783382
sim_render-ego1_median0.003532110476026348
sim_render-ego1_min0.0032425938230572324
simulation-passed1
step_physics_max0.6126421682195726
step_physics_mean0.4842806043614591
step_physics_median0.5423104351964491
step_physics_min0.1418391068776449
survival_time_max7.599999999999981
survival_time_mean6.628571428571413
survival_time_min4.899999999999991
No reset possible
53680LFVmultibodyv-simsuccessyes0:14:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53679LFVmultibodyv-simsuccessyes0:12:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53676LFVmultibodyv-simsuccessyes0:13:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53675LFVmultibodyv-simsuccessyes0:14:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible