Duckietown Challenges Home Challenges Submissions

Submission 12699

Submission12699
Competingyes
Challengeaido5-LFV-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVv-sim: 53796
Next
User labelbaseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

53796

Click the images to see detailed statistics about the episode.

LFV-norm-loop-000

LFV-norm-small_loop-000

LFV-norm-techtrack-000

LFV-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53796LFVv-simsuccessyes0:27:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0526666091168733
survival_time_median14.975000000000078
deviation-center-line_median0.8739009884654972
in-drivable-lane_median1.9000000000000037


other stats
agent_compute-ego0_max0.03890066716208387
agent_compute-ego0_mean0.03379470477378194
agent_compute-ego0_median0.03222718735777645
agent_compute-ego0_min0.031823777217491
agent_compute-npc0_max0.02662731017639388
agent_compute-npc0_mean0.022231661780682616
agent_compute-npc0_median0.02132987484359359
agent_compute-npc0_min0.019639587259149407
agent_compute-npc1_max0.04876778453004126
agent_compute-npc1_mean0.042210951945066466
agent_compute-npc1_median0.04551064126973024
agent_compute-npc1_min0.032354430035427886
agent_compute-npc2_max0.04121033408636014
agent_compute-npc2_mean0.036696965193018787
agent_compute-npc2_median0.03607908230201871
agent_compute-npc2_min0.032801479190677496
agent_compute-npc3_max0.046842822773323155
agent_compute-npc3_mean0.041717971038354285
agent_compute-npc3_median0.041717971038354285
agent_compute-npc3_min0.036593119303385414
complete-iteration_max1.17238777571351
complete-iteration_mean0.8506740840411157
complete-iteration_median0.9476397509794736
complete-iteration_min0.33502905849200576
deviation-center-line_max1.2415126445993792
deviation-center-line_mean0.8732486247855841
deviation-center-line_min0.5036798776119628
deviation-heading_max6.009583597248758
deviation-heading_mean3.8769484867946815
deviation-heading_median3.514031918004536
deviation-heading_min2.470146513920896
driven_any_max4.758994818366164
driven_any_mean3.606539031203353
driven_any_median3.407846421200595
driven_any_min2.851468464046057
driven_lanedir_consec_max3.752433605467256
driven_lanedir_consec_mean3.0109795242133464
driven_lanedir_consec_min2.1861512731523813
driven_lanedir_max3.752433605467256
driven_lanedir_mean3.0109795242133464
driven_lanedir_median3.0526666091168733
driven_lanedir_min2.1861512731523813
get_duckie_state_max1.3603883631089157e-06
get_duckie_state_mean1.2801739117931358e-06
get_duckie_state_median1.2747995620607297e-06
get_duckie_state_min1.2107081599421689e-06
get_robot_state_max0.017022192711923637
get_robot_state_mean0.013650861432722452
get_robot_state_median0.015300157160518678
get_robot_state_min0.006980938697928813
get_state_dump_max0.01075879265280331
get_state_dump_mean0.009140623230981824
get_state_dump_median0.009925990386778598
get_state_dump_min0.005951719497566793
get_ui_image_max0.055378174839808704
get_ui_image_mean0.04537646479993051
get_ui_image_median0.04758390387215182
get_ui_image_min0.030959876615609696
in-drivable-lane_max2.7500000000000115
in-drivable-lane_mean1.6375000000000046
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 3.8052778682200135, "get_ui_image": 0.04314155836363096, "step_physics": 0.5091248231607156, "survival_time": 16.6000000000001, "driven_lanedir": 3.677934169239721, "get_state_dump": 0.009123785717709288, "get_robot_state": 0.013675926683901309, "sim_render-ego0": 0.00360169138636317, "sim_render-npc0": 0.0035638587252871767, "sim_render-npc1": 0.0035070542458657387, "sim_render-npc2": 0.0035194047578462253, "get_duckie_state": 1.2107081599421689e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.060180370878024, "agent_compute-ego0": 0.03216295772128635, "agent_compute-npc0": 0.019639587259149407, "agent_compute-npc1": 0.032354430035427886, "agent_compute-npc2": 0.032801479190677496, "complete-iteration": 0.7470840398255769, "set_robot_commands": 0.002188850809503962, "deviation-center-line": 0.951808955988989, "driven_lanedir_consec": 3.677934169239721, "sim_compute_sim_state": 0.02494982842568521, "sim_compute_performance-ego0": 0.0018466685985301708, "sim_compute_performance-npc0": 0.0018390635470370272, "sim_compute_performance-npc1": 0.00182953038373151, "sim_compute_performance-npc2": 0.0018305041052557685}, "LFV-norm-zigzag-000-ego0": {"driven_any": 4.758994818366164, "get_ui_image": 0.055378174839808704, "step_physics": 0.7998881096387431, "survival_time": 20.500000000000156, "driven_lanedir": 3.752433605467256, "get_state_dump": 0.01072819505584791, "get_robot_state": 0.016924387637136048, "sim_render-ego0": 0.0036817797779166786, "sim_render-npc0": 0.003627028778521684, "sim_render-npc1": 0.0035899230743556706, "sim_render-npc2": 0.003496581910590476, "sim_render-npc3": 0.003606907062576925, "get_duckie_state": 1.3005704485296912e-06, "in-drivable-lane": 2.7500000000000115, "deviation-heading": 6.009583597248758, "agent_compute-ego0": 0.032291416994266554, "agent_compute-npc0": 0.02194245888368927, "agent_compute-npc1": 0.04551064126973024, "agent_compute-npc2": 0.04121033408636014, "agent_compute-npc3": 0.046842822773323155, "complete-iteration": 1.17238777571351, "set_robot_commands": 0.00217763118790304, "deviation-center-line": 1.2415126445993792, "driven_lanedir_consec": 3.752433605467256, "sim_compute_sim_state": 0.06352495683080668, "sim_compute_performance-ego0": 0.0018947194092465145, "sim_compute_performance-npc0": 0.001878069555092322, "sim_compute_performance-npc1": 0.0018605936472723373, "sim_compute_performance-npc2": 0.0018102124949731385, "sim_compute_performance-npc3": 0.0018681325471604248}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.851468464046057, "get_ui_image": 0.05202624938067268, "step_physics": 0.7966399538750742, "survival_time": 12.700000000000044, "driven_lanedir": 2.427399048994026, "get_state_dump": 0.01075879265280331, "get_robot_state": 0.017022192711923637, "sim_render-ego0": 0.0035805029027602252, "sim_render-npc0": 0.003542635487575157, "sim_render-npc1": 0.003730174606921626, "sim_render-npc2": 0.0038766917060403263, "sim_render-npc3": 0.003652466044706457, "get_duckie_state": 1.3603883631089157e-06, "in-drivable-lane": 1.2499999999999956, "deviation-heading": 2.470146513920896, "agent_compute-ego0": 0.031823777217491, "agent_compute-npc0": 0.020717290803497913, "agent_compute-npc1": 0.04876778453004126, "agent_compute-npc2": 0.03607908230201871, "agent_compute-npc3": 0.036593119303385414, "complete-iteration": 1.14819546213337, "set_robot_commands": 0.002246830510158165, "deviation-center-line": 0.5036798776119628, "driven_lanedir_consec": 2.427399048994026, "sim_compute_sim_state": 0.05829532660690009, "sim_compute_performance-ego0": 0.0018387906691607304, "sim_compute_performance-npc0": 0.0018388738819197113, "sim_compute_performance-npc1": 0.0019501676746443207, "sim_compute_performance-npc2": 0.002083769031599456, "sim_compute_performance-npc3": 0.0019346882315242992}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.010414974181178, "get_ui_image": 0.030959876615609696, "step_physics": 0.1999883660629614, "survival_time": 13.350000000000056, "driven_lanedir": 2.1861512731523813, "get_state_dump": 0.005951719497566793, "get_robot_state": 0.006980938697928813, "sim_render-ego0": 0.003570834202552909, "sim_render-npc0": 0.0035507056250501036, "get_duckie_state": 1.2490286755917677e-06, "in-drivable-lane": 2.5500000000000114, "deviation-heading": 3.967883465131048, "agent_compute-ego0": 0.03890066716208387, "agent_compute-npc0": 0.02662731017639388, "complete-iteration": 0.33502905849200576, "set_robot_commands": 0.0020637636754050185, "deviation-center-line": 0.7959930209420055, "driven_lanedir_consec": 2.1861512731523813, "sim_compute_sim_state": 0.010562435014924008, "sim_compute_performance-ego0": 0.00184683390517733, "sim_compute_performance-npc0": 0.0018353622351119769}}
set_robot_commands_max0.002246830510158165
set_robot_commands_mean0.0021692690457425466
set_robot_commands_median0.0021832409987035013
set_robot_commands_min0.0020637636754050185
sim_compute_performance-ego0_max0.0018947194092465145
sim_compute_performance-ego0_mean0.0018567531455286864
sim_compute_performance-ego0_median0.0018467512518537503
sim_compute_performance-ego0_min0.0018387906691607304
sim_compute_performance-npc0_max0.001878069555092322
sim_compute_performance-npc0_mean0.0018478423047902592
sim_compute_performance-npc0_median0.0018389687144783691
sim_compute_performance-npc0_min0.0018353622351119769
sim_compute_performance-npc1_max0.0019501676746443207
sim_compute_performance-npc1_mean0.001880097235216056
sim_compute_performance-npc1_median0.0018605936472723373
sim_compute_performance-npc1_min0.00182953038373151
sim_compute_performance-npc2_max0.002083769031599456
sim_compute_performance-npc2_mean0.0019081618772761211
sim_compute_performance-npc2_median0.0018305041052557685
sim_compute_performance-npc2_min0.0018102124949731385
sim_compute_performance-npc3_max0.0019346882315242992
sim_compute_performance-npc3_mean0.001901410389342362
sim_compute_performance-npc3_median0.001901410389342362
sim_compute_performance-npc3_min0.0018681325471604248
sim_compute_sim_state_max0.06352495683080668
sim_compute_sim_state_mean0.03933313671957899
sim_compute_sim_state_median0.04162257751629265
sim_compute_sim_state_min0.010562435014924008
sim_render-ego0_max0.0036817797779166786
sim_render-ego0_mean0.0036087020673982455
sim_render-ego0_median0.003591097144561698
sim_render-ego0_min0.003570834202552909
sim_render-npc0_max0.003627028778521684
sim_render-npc0_mean0.0035710571541085305
sim_render-npc0_median0.00355728217516864
sim_render-npc0_min0.003542635487575157
sim_render-npc1_max0.003730174606921626
sim_render-npc1_mean0.003609050642381012
sim_render-npc1_median0.0035899230743556706
sim_render-npc1_min0.0035070542458657387
sim_render-npc2_max0.0038766917060403263
sim_render-npc2_mean0.0036308927914923423
sim_render-npc2_median0.0035194047578462253
sim_render-npc2_min0.003496581910590476
sim_render-npc3_max0.003652466044706457
sim_render-npc3_mean0.0036296865536416902
sim_render-npc3_median0.0036296865536416902
sim_render-npc3_min0.003606907062576925
simulation-passed1
step_physics_max0.7998881096387431
step_physics_mean0.5764103131843736
step_physics_median0.6528823885178949
step_physics_min0.1999883660629614
survival_time_max20.500000000000156
survival_time_mean15.787500000000088
survival_time_min12.700000000000044
No reset possible
53793LFVv-simsuccessyes0:28:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53791LFVv-simsuccessyes0:28:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible