Duckietown Challenges Home Challenges Submissions

Submission 13249

Submission13249
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60494
Next
User label202-1
Admin priority50
Blessingn/a
User priority50

60494

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
60494LFVmultibodyv-simsuccessyes1:13:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.84869486004899
survival_time_median35.9000000000001
deviation-center-line_median2.6203333805255373
in-drivable-lane_median0.5500000000000034


other stats
agent_compute-ego0_max0.015894041762361213
agent_compute-ego0_mean0.015394081063267976
agent_compute-ego0_median0.015362838486663434
agent_compute-ego0_min0.01500932198738024
agent_compute-ego1_max0.015277886591037782
agent_compute-ego1_mean0.014892554387049268
agent_compute-ego1_median0.014796115095326898
agent_compute-ego1_min0.014649854600429536
agent_compute-ego2_max0.01510484759101284
agent_compute-ego2_mean0.015014037292202931
agent_compute-ego2_median0.015043563702527216
agent_compute-ego2_min0.01489370058306873
agent_compute-ego3_max0.015029638755221326
agent_compute-ego3_mean0.014787260141176596
agent_compute-ego3_median0.014775448283167642
agent_compute-ego3_min0.014556693385140807
complete-iteration_max1.2936818204006226
complete-iteration_mean1.0171138748941515
complete-iteration_median1.201905055018412
complete-iteration_min0.3536271318793297
deviation-center-line_max4.820880733071909
deviation-center-line_mean2.583994453484847
deviation-center-line_min0.466437239046095
deviation-heading_max15.148598713817304
deviation-heading_mean5.203037960231751
deviation-heading_median4.411758578455328
deviation-heading_min1.127959157311374
driven_any_max22.424839675392775
driven_any_mean10.7743801554069
driven_any_median11.203885125998216
driven_any_min3.2160982794111104
driven_lanedir_consec_max21.05968142319627
driven_lanedir_consec_mean10.348705030915117
driven_lanedir_consec_min3.1399283515467307
driven_lanedir_max21.05968142319627
driven_lanedir_mean10.348705030915117
driven_lanedir_median10.84869486004899
driven_lanedir_min3.1399283515467307
get_duckie_state_max1.39772891998291e-06
get_duckie_state_mean1.3539451628275222e-06
get_duckie_state_median1.3335913169283827e-06
get_duckie_state_min1.3332071802371705e-06
get_robot_state_max0.013927355283448677
get_robot_state_mean0.012883092584580992
get_robot_state_median0.013861901524910843
get_robot_state_min0.0070449158549308775
get_state_dump_max0.009383029547058231
get_state_dump_mean0.008859866579930629
get_state_dump_median0.00930420911361843
get_state_dump_min0.00613345205783844
get_ui_image_max0.05216715716514267
get_ui_image_mean0.04613191217619763
get_ui_image_median0.049131659981821674
get_ui_image_min0.03093261271715164
in-drivable-lane_max7.400000000000105
in-drivable-lane_mean1.1178571428571522
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 17.91621921283043, "get_ui_image": 0.04469656911115156, "step_physics": 0.7045900569671716, "survival_time": 35.9000000000001, "driven_lanedir": 17.553951361206774, "get_state_dump": 0.00930420911361843, "get_robot_state": 0.013779109310208508, "sim_render-ego0": 0.003683151887089885, "sim_render-ego1": 0.0035983760101573024, "sim_render-ego2": 0.0036848072216474296, "sim_render-ego3": 0.00355256217245598, "get_duckie_state": 1.373145112739319e-06, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 4.66600613251002, "agent_compute-ego0": 0.01500932198738024, "agent_compute-ego1": 0.014796115095326898, "agent_compute-ego2": 0.01510484759101284, "agent_compute-ego3": 0.014775448283167642, "complete-iteration": 0.8874981207708325, "set_robot_commands": 0.0022246154525183835, "deviation-center-line": 2.36933388046839, "driven_lanedir_consec": 17.553951361206774, "sim_compute_sim_state": 0.024230667215063444, "sim_compute_performance-ego0": 0.0019212100701471364, "sim_compute_performance-ego1": 0.0018689566096277992, "sim_compute_performance-ego2": 0.0019253659812067743, "sim_compute_performance-ego3": 0.0018747423222399888}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.17624244867698, "get_ui_image": 0.04469656911115156, "step_physics": 0.7045900569671716, "survival_time": 35.9000000000001, "driven_lanedir": 11.030928589220746, "get_state_dump": 0.00930420911361843, "get_robot_state": 0.013779109310208508, "sim_render-ego0": 0.003683151887089885, "sim_render-ego1": 0.0035983760101573024, "sim_render-ego2": 0.0036848072216474296, "sim_render-ego3": 0.00355256217245598, "get_duckie_state": 1.373145112739319e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.712417315185204, "agent_compute-ego0": 0.01500932198738024, "agent_compute-ego1": 0.014796115095326898, "agent_compute-ego2": 0.01510484759101284, "agent_compute-ego3": 0.014775448283167642, "complete-iteration": 0.8874981207708325, "set_robot_commands": 0.0022246154525183835, "deviation-center-line": 3.3178323284146165, "driven_lanedir_consec": 11.030928589220746, "sim_compute_sim_state": 0.024230667215063444, "sim_compute_performance-ego0": 0.0019212100701471364, "sim_compute_performance-ego1": 0.0018689566096277992, "sim_compute_performance-ego2": 0.0019253659812067743, "sim_compute_performance-ego3": 0.0018747423222399888}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.820728104563052, "get_ui_image": 0.04469656911115156, "step_physics": 0.7045900569671716, "survival_time": 35.9000000000001, "driven_lanedir": 10.686567311795, "get_state_dump": 0.00930420911361843, "get_robot_state": 0.013779109310208508, "sim_render-ego0": 0.003683151887089885, "sim_render-ego1": 0.0035983760101573024, "sim_render-ego2": 0.0036848072216474296, "sim_render-ego3": 0.00355256217245598, "get_duckie_state": 1.373145112739319e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.5746342032539347, "agent_compute-ego0": 0.01500932198738024, "agent_compute-ego1": 0.014796115095326898, "agent_compute-ego2": 0.01510484759101284, "agent_compute-ego3": 0.014775448283167642, "complete-iteration": 0.8874981207708325, "set_robot_commands": 0.0022246154525183835, "deviation-center-line": 2.5227461747598157, "driven_lanedir_consec": 10.686567311795, "sim_compute_sim_state": 0.024230667215063444, "sim_compute_performance-ego0": 0.0019212100701471364, "sim_compute_performance-ego1": 0.0018689566096277992, "sim_compute_performance-ego2": 0.0019253659812067743, "sim_compute_performance-ego3": 0.0018747423222399888}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 14.680765950581186, "get_ui_image": 0.04469656911115156, "step_physics": 0.7045900569671716, "survival_time": 35.9000000000001, "driven_lanedir": 14.490557495839736, "get_state_dump": 0.00930420911361843, "get_robot_state": 0.013779109310208508, "sim_render-ego0": 0.003683151887089885, "sim_render-ego1": 0.0035983760101573024, "sim_render-ego2": 0.0036848072216474296, "sim_render-ego3": 0.00355256217245598, "get_duckie_state": 1.373145112739319e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.65932375431149, "agent_compute-ego0": 0.01500932198738024, "agent_compute-ego1": 0.014796115095326898, "agent_compute-ego2": 0.01510484759101284, "agent_compute-ego3": 0.014775448283167642, "complete-iteration": 0.8874981207708325, "set_robot_commands": 0.0022246154525183835, "deviation-center-line": 2.672201231237529, "driven_lanedir_consec": 14.490557495839736, "sim_compute_sim_state": 0.024230667215063444, "sim_compute_performance-ego0": 0.0019212100701471364, "sim_compute_performance-ego1": 0.0018689566096277992, "sim_compute_performance-ego2": 0.0019253659812067743, "sim_compute_performance-ego3": 0.0018747423222399888}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.424839675392775, "get_ui_image": 0.05216715716514267, "step_physics": 1.0918841497236942, "survival_time": 47.54999999999944, "driven_lanedir": 21.05968142319627, "get_state_dump": 0.009383029547058231, "get_robot_state": 0.013927355283448677, "sim_render-ego0": 0.0037043335057106337, "sim_render-ego1": 0.0036802574866960022, "sim_render-ego2": 0.0036456930537183746, "sim_render-ego3": 0.0036385865772471703, "get_duckie_state": 1.3335913169283827e-06, "in-drivable-lane": 2.699999999999992, "deviation-heading": 6.932303036613661, "agent_compute-ego0": 0.015362838486663434, "agent_compute-ego1": 0.015277886591037782, "agent_compute-ego2": 0.015043563702527216, "agent_compute-ego3": 0.015029638755221326, "complete-iteration": 1.2936818204006226, "set_robot_commands": 0.002254170529982623, "deviation-center-line": 3.6420978008728815, "driven_lanedir_consec": 21.05968142319627, "sim_compute_sim_state": 0.03409322319912309, "sim_compute_performance-ego0": 0.001946076625535468, "sim_compute_performance-ego1": 0.0019036984744192171, "sim_compute_performance-ego2": 0.0019183647231895383, "sim_compute_performance-ego3": 0.0018975283919262288}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.600869757873395, "get_ui_image": 0.05216715716514267, "step_physics": 1.0918841497236942, "survival_time": 47.54999999999944, "driven_lanedir": 10.95851146838975, "get_state_dump": 0.009383029547058231, "get_robot_state": 0.013927355283448677, "sim_render-ego0": 0.0037043335057106337, "sim_render-ego1": 0.0036802574866960022, "sim_render-ego2": 0.0036456930537183746, "sim_render-ego3": 0.0036385865772471703, "get_duckie_state": 1.3335913169283827e-06, "in-drivable-lane": 1.2000000000000035, "deviation-heading": 15.148598713817304, "agent_compute-ego0": 0.015362838486663434, "agent_compute-ego1": 0.015277886591037782, "agent_compute-ego2": 0.015043563702527216, "agent_compute-ego3": 0.015029638755221326, "complete-iteration": 1.2936818204006226, "set_robot_commands": 0.002254170529982623, "deviation-center-line": 4.820880733071909, "driven_lanedir_consec": 10.95851146838975, "sim_compute_sim_state": 0.03409322319912309, "sim_compute_performance-ego0": 0.001946076625535468, "sim_compute_performance-ego1": 0.0019036984744192171, "sim_compute_performance-ego2": 0.0019183647231895383, "sim_compute_performance-ego3": 0.0018975283919262288}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.91731045883886, "get_ui_image": 0.05216715716514267, "step_physics": 1.0918841497236942, "survival_time": 47.54999999999944, "driven_lanedir": 14.185557482748331, "get_state_dump": 0.009383029547058231, "get_robot_state": 0.013927355283448677, "sim_render-ego0": 0.0037043335057106337, "sim_render-ego1": 0.0036802574866960022, "sim_render-ego2": 0.0036456930537183746, "sim_render-ego3": 0.0036385865772471703, "get_duckie_state": 1.3335913169283827e-06, "in-drivable-lane": 1.3000000000000078, "deviation-heading": 6.688664903322455, "agent_compute-ego0": 0.015362838486663434, "agent_compute-ego1": 0.015277886591037782, "agent_compute-ego2": 0.015043563702527216, "agent_compute-ego3": 0.015029638755221326, "complete-iteration": 1.2936818204006226, "set_robot_commands": 0.002254170529982623, "deviation-center-line": 3.44638594482312, "driven_lanedir_consec": 14.185557482748331, "sim_compute_sim_state": 0.03409322319912309, "sim_compute_performance-ego0": 0.001946076625535468, "sim_compute_performance-ego1": 0.0019036984744192171, "sim_compute_performance-ego2": 0.0019183647231895383, "sim_compute_performance-ego3": 0.0018975283919262288}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.231527803319452, "get_ui_image": 0.05216715716514267, "step_physics": 1.0918841497236942, "survival_time": 47.54999999999944, "driven_lanedir": 10.738878251708233, "get_state_dump": 0.009383029547058231, "get_robot_state": 0.013927355283448677, "sim_render-ego0": 0.0037043335057106337, "sim_render-ego1": 0.0036802574866960022, "sim_render-ego2": 0.0036456930537183746, "sim_render-ego3": 0.0036385865772471703, "get_duckie_state": 1.3335913169283827e-06, "in-drivable-lane": 0.750000000000008, "deviation-heading": 5.129366931280317, "agent_compute-ego0": 0.015362838486663434, "agent_compute-ego1": 0.015277886591037782, "agent_compute-ego2": 0.015043563702527216, "agent_compute-ego3": 0.015029638755221326, "complete-iteration": 1.2936818204006226, "set_robot_commands": 0.002254170529982623, "deviation-center-line": 4.086093635124596, "driven_lanedir_consec": 10.738878251708233, "sim_compute_sim_state": 0.03409322319912309, "sim_compute_performance-ego0": 0.001946076625535468, "sim_compute_performance-ego1": 0.0019036984744192171, "sim_compute_performance-ego2": 0.0019183647231895383, "sim_compute_performance-ego3": 0.0018975283919262288}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.320153461116565, "get_ui_image": 0.049131659981821674, "step_physics": 1.0099869724399118, "survival_time": 25.80000000000023, "driven_lanedir": 8.64836042457885, "get_state_dump": 0.00925556834016132, "get_robot_state": 0.013861901524910843, "sim_render-ego0": 0.003632816170816034, "sim_render-ego1": 0.0035977548049543075, "sim_render-ego2": 0.0036106035833893702, "sim_render-ego3": 0.0035473193605817725, "get_duckie_state": 1.3332071802371705e-06, "in-drivable-lane": 7.400000000000105, "deviation-heading": 3.3455253875482898, "agent_compute-ego0": 0.015894041762361213, "agent_compute-ego1": 0.014725011368092992, "agent_compute-ego2": 0.01489370058306873, "agent_compute-ego3": 0.014556693385140807, "complete-iteration": 1.201905055018412, "set_robot_commands": 0.0021852870513207677, "deviation-center-line": 1.2147917027062982, "driven_lanedir_consec": 8.64836042457885, "sim_compute_sim_state": 0.02851147808466013, "sim_compute_performance-ego0": 0.0019039180799886384, "sim_compute_performance-ego1": 0.0018876032395796344, "sim_compute_performance-ego2": 0.0018973235235454032, "sim_compute_performance-ego3": 0.001881003610400674}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.647100121183924, "get_ui_image": 0.049131659981821674, "step_physics": 1.0099869724399118, "survival_time": 25.80000000000023, "driven_lanedir": 3.182805849269059, "get_state_dump": 0.00925556834016132, "get_robot_state": 0.013861901524910843, "sim_render-ego0": 0.003632816170816034, "sim_render-ego1": 0.0035977548049543075, "sim_render-ego2": 0.0036106035833893702, "sim_render-ego3": 0.0035473193605817725, "get_duckie_state": 1.3332071802371705e-06, "in-drivable-lane": 1.0000000000000009, "deviation-heading": 8.754757222101938, "agent_compute-ego0": 0.015894041762361213, "agent_compute-ego1": 0.014725011368092992, "agent_compute-ego2": 0.01489370058306873, "agent_compute-ego3": 0.014556693385140807, "complete-iteration": 1.201905055018412, "set_robot_commands": 0.0021852870513207677, "deviation-center-line": 2.9714834329964077, "driven_lanedir_consec": 3.182805849269059, "sim_compute_sim_state": 0.02851147808466013, "sim_compute_performance-ego0": 0.0019039180799886384, "sim_compute_performance-ego1": 0.0018876032395796344, "sim_compute_performance-ego2": 0.0018973235235454032, "sim_compute_performance-ego3": 0.001881003610400674}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.1293913374714215, "get_ui_image": 0.049131659981821674, "step_physics": 1.0099869724399118, "survival_time": 25.80000000000023, "driven_lanedir": 4.072136255655705, "get_state_dump": 0.00925556834016132, "get_robot_state": 0.013861901524910843, "sim_render-ego0": 0.003632816170816034, "sim_render-ego1": 0.0035977548049543075, "sim_render-ego2": 0.0036106035833893702, "sim_render-ego3": 0.0035473193605817725, "get_duckie_state": 1.3332071802371705e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.392118646864781, "agent_compute-ego0": 0.015894041762361213, "agent_compute-ego1": 0.014725011368092992, "agent_compute-ego2": 0.01489370058306873, "agent_compute-ego3": 0.014556693385140807, "complete-iteration": 1.201905055018412, "set_robot_commands": 0.0021852870513207677, "deviation-center-line": 2.5684655298135457, "driven_lanedir_consec": 4.072136255655705, "sim_compute_sim_state": 0.02851147808466013, "sim_compute_performance-ego0": 0.0019039180799886384, "sim_compute_performance-ego1": 0.0018876032395796344, "sim_compute_performance-ego2": 0.0018973235235454032, "sim_compute_performance-ego3": 0.001881003610400674}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.233311002417626, "get_ui_image": 0.049131659981821674, "step_physics": 1.0099869724399118, "survival_time": 25.80000000000023, "driven_lanedir": 11.66290534072794, "get_state_dump": 0.00925556834016132, "get_robot_state": 0.013861901524910843, "sim_render-ego0": 0.003632816170816034, "sim_render-ego1": 0.0035977548049543075, "sim_render-ego2": 0.0036106035833893702, "sim_render-ego3": 0.0035473193605817725, "get_duckie_state": 1.3332071802371705e-06, "in-drivable-lane": 0.9500000000000136, "deviation-heading": 4.164193402599166, "agent_compute-ego0": 0.015894041762361213, "agent_compute-ego1": 0.014725011368092992, "agent_compute-ego2": 0.01489370058306873, "agent_compute-ego3": 0.014556693385140807, "complete-iteration": 1.201905055018412, "set_robot_commands": 0.0021852870513207677, "deviation-center-line": 1.5514864102428068, "driven_lanedir_consec": 11.66290534072794, "sim_compute_sim_state": 0.02851147808466013, "sim_compute_performance-ego0": 0.0019039180799886384, "sim_compute_performance-ego1": 0.0018876032395796344, "sim_compute_performance-ego2": 0.0018973235235454032, "sim_compute_performance-ego3": 0.001881003610400674}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.5267645620198422, "get_ui_image": 0.03093261271715164, "step_physics": 0.253710600733757, "survival_time": 7.94999999999998, "driven_lanedir": 3.47110082692848, "get_state_dump": 0.00613345205783844, "get_robot_state": 0.0070449158549308775, "sim_render-ego0": 0.003631097078323364, "sim_render-ego1": 0.003918030858039856, "get_duckie_state": 1.39772891998291e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.127959157311374, "agent_compute-ego0": 0.01522616297006607, "agent_compute-ego1": 0.014649854600429536, "complete-iteration": 0.3536271318793297, "set_robot_commands": 0.0021451890468597414, "deviation-center-line": 0.5256863052098463, "driven_lanedir_consec": 3.47110082692848, "sim_compute_sim_state": 0.009711350500583648, "sim_compute_performance-ego0": 0.0018668577075004575, "sim_compute_performance-ego1": 0.0020621731877326966}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.2160982794111104, "get_ui_image": 0.03093261271715164, "step_physics": 0.253710600733757, "survival_time": 7.94999999999998, "driven_lanedir": 3.1399283515467307, "get_state_dump": 0.00613345205783844, "get_robot_state": 0.0070449158549308775, "sim_render-ego0": 0.003631097078323364, "sim_render-ego1": 0.003918030858039856, "get_duckie_state": 1.39772891998291e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.5466626365245582, "agent_compute-ego0": 0.01522616297006607, "agent_compute-ego1": 0.014649854600429536, "complete-iteration": 0.3536271318793297, "set_robot_commands": 0.0021451890468597414, "deviation-center-line": 0.466437239046095, "driven_lanedir_consec": 3.1399283515467307, "sim_compute_sim_state": 0.009711350500583648, "sim_compute_performance-ego0": 0.0018668577075004575, "sim_compute_performance-ego1": 0.0020621731877326966}}
set_robot_commands_max0.002254170529982623
set_robot_commands_mean0.002210476444929042
set_robot_commands_median0.0022246154525183835
set_robot_commands_min0.0021451890468597414
sim_compute_performance-ego0_max0.001946076625535468
sim_compute_performance-ego0_mean0.001915609608406135
sim_compute_performance-ego0_median0.0019212100701471364
sim_compute_performance-ego0_min0.0018668577075004575
sim_compute_performance-ego1_max0.0020621731877326966
sim_compute_performance-ego1_mean0.001911812833569429
sim_compute_performance-ego1_median0.0018876032395796344
sim_compute_performance-ego1_min0.0018689566096277992
sim_compute_performance-ego2_max0.0019253659812067743
sim_compute_performance-ego2_mean0.0019136847426472392
sim_compute_performance-ego2_median0.0019183647231895383
sim_compute_performance-ego2_min0.0018973235235454032
sim_compute_performance-ego3_max0.0018975283919262288
sim_compute_performance-ego3_mean0.0018844247748556304
sim_compute_performance-ego3_median0.001881003610400674
sim_compute_performance-ego3_min0.0018747423222399888
sim_compute_sim_state_max0.03409322319912309
sim_compute_sim_state_mean0.02619744107118243
sim_compute_sim_state_median0.02851147808466013
sim_compute_sim_state_min0.009711350500583648
sim_render-ego0_max0.0037043335057106337
sim_render-ego0_mean0.0036673857436509234
sim_render-ego0_median0.003683151887089885
sim_render-ego0_min0.003631097078323364
sim_render-ego1_max0.003918030858039856
sim_render-ego1_mean0.0036672582088078686
sim_render-ego1_median0.0035983760101573024
sim_render-ego1_min0.0035977548049543075
sim_render-ego2_max0.0036848072216474296
sim_render-ego2_mean0.0036470346195850577
sim_render-ego2_median0.0036456930537183746
sim_render-ego2_min0.0036106035833893702
sim_render-ego3_max0.0036385865772471703
sim_render-ego3_mean0.003579489370094974
sim_render-ego3_median0.00355256217245598
sim_render-ego3_min0.0035473193605817725
simulation-passed1
step_physics_max1.0918841497236942
step_physics_mean0.838090422713616
step_physics_median1.0099869724399118
step_physics_min0.253710600733757
survival_time_max47.54999999999944
survival_time_mean32.34999999999993
survival_time_min7.94999999999998
No reset possible