Duckietown Challenges Home Challenges Submissions

Job 35205

Job ID35205
submission6735
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg03-68c9ae071294-1
date started
date completed
duration0:22:12
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7478066669431419
survival_time_median5.899999999999987
deviation-center-line_median0.12489755072162814
in-drivable-lane_median3.5749999999999873


other stats
agent_compute-ego_max0.10513066416201385
agent_compute-ego_mean0.1019289013751686
agent_compute-ego_median0.10210462007145424
agent_compute-ego_min0.098465082257293
complete-iteration_max0.5216396076734676
complete-iteration_mean0.48801966755991266
complete-iteration_median0.4833993401020339
complete-iteration_min0.4614677429199219
deviation-center-line_max0.599901807435934
deviation-center-line_mean0.26122294179991407
deviation-center-line_min0.08724815935068318
deviation-heading_max2.7246351473151647
deviation-heading_mean1.2660483471593769
deviation-heading_median0.6110975704169662
deviation-heading_min0.4605211539628332
driven_any_max5.2071538052620365
driven_any_mean2.614534626651415
driven_any_median1.87217845183321
driven_any_min0.763243625907263
driven_lanedir_consec_max2.5801328335329337
driven_lanedir_consec_mean1.2074366154325449
driven_lanedir_consec_min0.672004809164362
driven_lanedir_max2.5801328335329337
driven_lanedir_mean1.2092058062903246
driven_lanedir_median0.7478066669431419
driven_lanedir_min0.672004809164362
get_state_dump_max0.03897240265556004
get_state_dump_mean0.03852044369679914
get_state_dump_median0.03851215690885697
get_state_dump_min0.037744760513305664
get_ui_image_max0.08056119322045449
get_ui_image_mean0.07776046872689832
get_ui_image_median0.07761542062974919
get_ui_image_min0.07586332404095193
in-drivable-lane_max9.100000000000072
in-drivable-lane_mean4.025000000000015
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 5.2071538052620365, "get_ui_image": 0.07773137887318929, "step_physics": 0.17359885692596436, "survival_time": 14.950000000000076, "driven_lanedir": 1.696357411695782, "get_state_dump": 0.037744760513305664, "sim_render-ego": 0.0097307022412618, "in-drivable-lane": 9.100000000000072, "agent_compute-ego": 0.10196296374003092, "deviation-heading": 2.5016429345196767, "complete-iteration": 0.5107530752817789, "set_robot_commands": 0.008268470764160157, "deviation-center-line": 0.599901807435934, "driven_lanedir_consec": 1.696357411695782, "sim_compute_sim_state": 0.021970844268798827, "sim_compute_performance-ego": 0.006571473280588786, "sim_compute_robot_state-ego": 0.012646884123484293, "sim_compute_robot_state-npc0": 0.012092657883961995, "sim_compute_robot_state-npc1": 0.01187658707300822, "sim_compute_robot_state-npc2": 0.01214509646097819, "sim_compute_robot_state-npc3": 0.01205495834350586, "sim_compute_robot_state-parked0": 0.012007051308949789}, "udem1-0-1-ego": {"driven_any": 1.8888423700070112, "get_ui_image": 0.08056119322045449, "step_physics": 0.1455634620292055, "survival_time": 8.14999999999998, "driven_lanedir": 0.9667626035934584, "get_state_dump": 0.03849526124497864, "sim_render-ego": 0.009579232865316005, "in-drivable-lane": 3.2499999999999902, "agent_compute-ego": 0.10263415202041344, "deviation-heading": 1.4766377491797078, "complete-iteration": 0.4828849804181994, "set_robot_commands": 0.008408676627223477, "deviation-center-line": 0.3600439908957817, "driven_lanedir_consec": 0.9632399784759692, "sim_compute_sim_state": 0.019616703314283872, "sim_compute_performance-ego": 0.006558472393480547, "sim_compute_robot_state-ego": 0.012099946203407336, "sim_compute_robot_state-npc0": 0.012031340160252858, "sim_compute_robot_state-npc1": 0.01166015314909578, "sim_compute_robot_state-npc2": 0.011669452936371411, "sim_compute_robot_state-npc3": 0.011869348631314704, "sim_compute_robot_state-parked0": 0.011773435616054418}, "udem1-1-0-ego": {"driven_any": 1.8235519162485037, "get_ui_image": 0.07749946238630909, "step_physics": 0.14510970802630407, "survival_time": 5.899999999999987, "driven_lanedir": 0.7478066669431419, "get_state_dump": 0.03852905257273528, "sim_render-ego": 0.00904856091838772, "in-drivable-lane": 3.349999999999988, "agent_compute-ego": 0.10224627640287756, "deviation-heading": 0.6110975704169662, "complete-iteration": 0.46855226815757106, "set_robot_commands": 0.007205573178954043, "deviation-center-line": 0.10829380083326672, "driven_lanedir_consec": 0.7478066669431419, "sim_compute_sim_state": 0.021126209679296463, "sim_compute_performance-ego": 0.005836971735550186, "sim_compute_robot_state-ego": 0.00972479480808064, "sim_compute_robot_state-npc0": 0.01072272203736386, "sim_compute_robot_state-npc1": 0.010111277386293574, "sim_compute_robot_state-npc2": 0.01048033520326776, "sim_compute_robot_state-npc3": 0.010190656629659362, "sim_compute_robot_state-parked0": 0.01035643028000654}, "udem1-1-1-ego": {"driven_any": 1.8235519162485037, "get_ui_image": 0.07798913373785504, "step_physics": 0.14376304109217758, "survival_time": 5.899999999999987, "driven_lanedir": 0.7478066669431419, "get_state_dump": 0.038874383700096, "sim_render-ego": 0.009320174233388092, "in-drivable-lane": 3.349999999999988, "agent_compute-ego": 0.10323644088486492, "deviation-heading": 0.6110975704169662, "complete-iteration": 0.4759887416483992, "set_robot_commands": 0.008016751984418449, "deviation-center-line": 0.10829380083326672, "driven_lanedir_consec": 0.7478066669431419, "sim_compute_sim_state": 0.021446698803012653, "sim_compute_performance-ego": 0.006412019163875257, "sim_compute_robot_state-ego": 0.01112806190878658, "sim_compute_robot_state-npc0": 0.011184266058065124, "sim_compute_robot_state-npc1": 0.011043540501998643, "sim_compute_robot_state-npc2": 0.01093524997517214, "sim_compute_robot_state-npc3": 0.011064640546249132, "sim_compute_robot_state-parked0": 0.011195928363476769}, "udem1-2-0-ego": {"driven_any": 1.87217845183321, "get_ui_image": 0.07846119714819867, "step_physics": 0.1481516112451968, "survival_time": 5.749999999999988, "driven_lanedir": 0.672004809164362, "get_state_dump": 0.03897240265556004, "sim_render-ego": 0.008935420409492825, "in-drivable-lane": 3.7999999999999865, "agent_compute-ego": 0.10513066416201385, "deviation-heading": 0.4605211539628332, "complete-iteration": 0.4732381592626157, "set_robot_commands": 0.00699792944866678, "deviation-center-line": 0.12489755072162814, "driven_lanedir_consec": 0.672004809164362, "sim_compute_sim_state": 0.01795234265534774, "sim_compute_performance-ego": 0.0059770148733387825, "sim_compute_robot_state-ego": 0.010242994971897292, "sim_compute_robot_state-npc0": 0.010833107906839124, "sim_compute_robot_state-npc1": 0.01012584230174189, "sim_compute_robot_state-npc2": 0.01008704434270444, "sim_compute_robot_state-npc3": 0.010335472355718198, "sim_compute_robot_state-parked0": 0.01066739455513332}, "udem1-2-1-ego": {"driven_any": 1.87217845183321, "get_ui_image": 0.07586332404095193, "step_physics": 0.14482293128967286, "survival_time": 5.749999999999988, "driven_lanedir": 0.672004809164362, "get_state_dump": 0.038664573171864385, "sim_render-ego": 0.008905052102130393, "in-drivable-lane": 3.7999999999999865, "agent_compute-ego": 0.1007259410360585, "deviation-heading": 0.4605211539628332, "complete-iteration": 0.4614677429199219, "set_robot_commands": 0.007059607298477836, "deviation-center-line": 0.12489755072162814, "driven_lanedir_consec": 0.672004809164362, "sim_compute_sim_state": 0.01777711536573327, "sim_compute_performance-ego": 0.005769866445790166, "sim_compute_robot_state-ego": 0.00962695246157439, "sim_compute_robot_state-npc0": 0.01051988809005074, "sim_compute_robot_state-npc1": 0.010129449678503948, "sim_compute_robot_state-npc2": 0.01004741088203762, "sim_compute_robot_state-npc3": 0.010643621112989344, "sim_compute_robot_state-parked0": 0.010550513474837594}, "udem1-3-0-ego": {"driven_any": 0.763243625907263, "get_ui_image": 0.0783336273459501, "step_physics": 0.1928047690280648, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7145247141665643, "get_state_dump": 0.038202025169549986, "sim_render-ego": 0.009103758390559706, "in-drivable-lane": 0.0, "agent_compute-ego": 0.102399887040604, "deviation-heading": 0.5448475222522263, "complete-iteration": 0.5216396076734676, "set_robot_commands": 0.007241487503051758, "deviation-center-line": 0.08724815935068318, "driven_lanedir_consec": 0.7074400724364116, "sim_compute_sim_state": 0.025174745293550713, "sim_compute_performance-ego": 0.006211092305737872, "sim_compute_robot_state-ego": 0.009997090627980787, "sim_compute_robot_state-npc0": 0.010503536046937456, "sim_compute_robot_state-npc1": 0.009991845419240551, "sim_compute_robot_state-npc2": 0.010112623835718908, "sim_compute_robot_state-npc3": 0.01031396555346112, "sim_compute_robot_state-parked0": 0.010883713877478312}, "udem1-3-1-ego": {"driven_any": 0.763243625907263, "get_ui_image": 0.07726467487423919, "step_physics": 0.19185344008512276, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7145247141665643, "get_state_dump": 0.038864019305207005, "sim_render-ego": 0.009139022161794264, "in-drivable-lane": 0.0, "agent_compute-ego": 0.098465082257293, "deviation-heading": 0.5448475222522263, "complete-iteration": 0.5157266106716422, "set_robot_commands": 0.007145055504732354, "deviation-center-line": 0.08724815935068318, "driven_lanedir_consec": 0.7074400724364116, "sim_compute_sim_state": 0.024663309718287268, "sim_compute_performance-ego": 0.0060832001442133, "sim_compute_robot_state-ego": 0.00985252579977346, "sim_compute_robot_state-npc0": 0.010340047437091208, "sim_compute_robot_state-npc1": 0.010141450305317724, "sim_compute_robot_state-npc2": 0.010234849397526231, "sim_compute_robot_state-npc3": 0.01058038445406182, "sim_compute_robot_state-parked0": 0.010733998099038768}, "udem1-4-0-ego": {"driven_any": 5.0657010516335745, "get_ui_image": 0.07700845321019491, "step_physics": 0.15997599363327025, "survival_time": 14.950000000000076, "driven_lanedir": 2.5801328335329337, "get_state_dump": 0.038452831904093425, "sim_render-ego": 0.0090146803855896, "in-drivable-lane": 6.800000000000067, "agent_compute-ego": 0.10174193461736045, "deviation-heading": 2.7246351473151647, "complete-iteration": 0.48391369978586835, "set_robot_commands": 0.007127179304758708, "deviation-center-line": 0.5057022989281345, "driven_lanedir_consec": 2.5801328335329337, "sim_compute_sim_state": 0.02257466475168864, "sim_compute_performance-ego": 0.005904828707377116, "sim_compute_robot_state-ego": 0.0099100128809611, "sim_compute_robot_state-npc0": 0.010669302145640056, "sim_compute_robot_state-npc1": 0.010251187483469645, "sim_compute_robot_state-npc2": 0.010210207303365072, "sim_compute_robot_state-npc3": 0.01033902645111084, "sim_compute_robot_state-parked0": 0.0103630534807841}, "udem1-4-1-ego": {"driven_any": 5.0657010516335745, "get_ui_image": 0.07689224243164063, "step_physics": 0.15985370794932047, "survival_time": 14.950000000000076, "driven_lanedir": 2.5801328335329337, "get_state_dump": 0.038405126730600994, "sim_render-ego": 0.009110833009084066, "in-drivable-lane": 6.800000000000067, "agent_compute-ego": 0.10074567159016928, "deviation-heading": 2.7246351473151647, "complete-iteration": 0.4860317897796631, "set_robot_commands": 0.007458610534667969, "deviation-center-line": 0.5057022989281345, "driven_lanedir_consec": 2.5801328335329337, "sim_compute_sim_state": 0.02288753032684326, "sim_compute_performance-ego": 0.00599768082300822, "sim_compute_robot_state-ego": 0.010158604780832926, "sim_compute_robot_state-npc0": 0.011236208279927572, "sim_compute_robot_state-npc1": 0.01059465487798055, "sim_compute_robot_state-npc2": 0.010760637919108073, "sim_compute_robot_state-npc3": 0.010708792209625244, "sim_compute_robot_state-parked0": 0.0108552877108256}}
set_robot_commands_max0.008408676627223477
set_robot_commands_mean0.007492934214911153
set_robot_commands_median0.0072235303410029
set_robot_commands_min0.00699792944866678
sim_compute_performance-ego_max0.006571473280588786
sim_compute_performance-ego_mean0.0061322619872960235
sim_compute_performance-ego_median0.00604044048361076
sim_compute_performance-ego_min0.005769866445790166
sim_compute_robot_state-ego_max0.012646884123484293
sim_compute_robot_state-ego_mean0.01053878685667788
sim_compute_robot_state-ego_median0.010077847704406857
sim_compute_robot_state-ego_min0.00962695246157439
sim_compute_robot_state-npc0_max0.012092657883961995
sim_compute_robot_state-npc0_mean0.011013307604613
sim_compute_robot_state-npc0_median0.010777914972101493
sim_compute_robot_state-npc0_min0.010340047437091208
sim_compute_robot_state-npc1_max0.01187658707300822
sim_compute_robot_state-npc1_mean0.010592598817665052
sim_compute_robot_state-npc1_median0.010196318894393683
sim_compute_robot_state-npc1_min0.009991845419240551
sim_compute_robot_state-npc2_max0.01214509646097819
sim_compute_robot_state-npc2_mean0.010668290825624984
sim_compute_robot_state-npc2_median0.010357592300396996
sim_compute_robot_state-npc2_min0.01004741088203762
sim_compute_robot_state-npc3_max0.01205495834350586
sim_compute_robot_state-npc3_mean0.010810086628769562
sim_compute_robot_state-npc3_median0.01061200278352558
sim_compute_robot_state-npc3_min0.010190656629659362
sim_compute_robot_state-parked0_max0.012007051308949789
sim_compute_robot_state-parked0_mean0.010938680676658522
sim_compute_robot_state-parked0_median0.010794642904932183
sim_compute_robot_state-parked0_min0.01035643028000654
sim_compute_sim_state_max0.025174745293550713
sim_compute_sim_state_mean0.02151901641768427
sim_compute_sim_state_median0.021708771535905735
sim_compute_sim_state_min0.01777711536573327
sim_render-ego_max0.0097307022412618
sim_render-ego_mean0.009188743671700448
sim_render-ego_median0.009107295699821886
sim_render-ego_min0.008905052102130393
simulation-passed1
step_physics_max0.1928047690280648
step_physics_mean0.16054975213042996
step_physics_median0.15400265959725862
step_physics_min0.14376304109217758
survival_time_max14.950000000000076
survival_time_mean8.060000000000016
survival_time_min2.1500000000000004

Highlights

35205

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.