Duckietown Challenges Home Challenges Submissions

Job 34514

Job ID34514
submission6737
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg07-7ea520180144-1
date started
date completed
duration0:06:46
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4466359838869143
survival_time_median1.4000000000000006
deviation-center-line_median0.03789637555606848
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.13076668977737427
agent_compute-ego0_mean0.12643695303371977
agent_compute-ego0_median0.12643695303371974
agent_compute-ego0_min0.12210721629006524
agent_compute-ego1_max0.1331353783607483
agent_compute-ego1_mean0.12576978547232492
agent_compute-ego1_median0.12576978547232492
agent_compute-ego1_min0.11840419258390154
agent_compute-ego2_max0.13117721251079015
agent_compute-ego2_mean0.12385040095874245
agent_compute-ego2_median0.12385040095874242
agent_compute-ego2_min0.11652358940669467
complete-iteration_max1.4446094717298237
complete-iteration_mean1.437318193061011
complete-iteration_median1.437318193061011
complete-iteration_min1.4300269143921989
deviation-center-line_max0.0924742680606153
deviation-center-line_mean0.04796379651693274
deviation-center-line_min0.02326060200556992
deviation-heading_max0.31774131538081624
deviation-heading_mean0.16724003758412245
deviation-heading_median0.15308470044578482
deviation-heading_min0.09551200458847002
driven_any_max0.4600961679938569
driven_any_mean0.4432508394642794
driven_any_median0.448904153961071
driven_any_min0.4096898656709897
driven_lanedir_consec_max0.4573624868396155
driven_lanedir_consec_mean0.4301240075823998
driven_lanedir_consec_min0.3434169426931408
driven_lanedir_max0.4573624868396155
driven_lanedir_mean0.4301240075823998
driven_lanedir_median0.4466359838869143
driven_lanedir_min0.3434169426931408
get_state_dump_max0.048181618962969096
get_state_dump_mean0.048075888838086805
get_state_dump_median0.048075888838086805
get_state_dump_min0.04797015871320452
get_ui_image_max0.1113471473966326
get_ui_image_mean0.10985650335039412
get_ui_image_median0.10985650335039412
get_ui_image_min0.10836585930415564
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.025000000000000026
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.4096898656709897, "get_ui_image": 0.10836585930415564, "step_physics": 0.6641345960753304, "survival_time": 1.4000000000000006, "driven_lanedir": 0.3434169426931408, "get_state_dump": 0.04797015871320452, "sim_render-ego0": 0.007850340434483119, "sim_render-ego1": 0.007765718868800572, "sim_render-ego2": 0.007788028035845075, "in-drivable-lane": 0.15000000000000013, "deviation-heading": 0.31774131538081624, "agent_compute-ego0": 0.13076668977737427, "agent_compute-ego1": 0.1331353783607483, "agent_compute-ego2": 0.13117721251079015, "complete-iteration": 1.4300269143921989, "set_robot_commands": 0.007003699030194964, "deviation-center-line": 0.0924742680606153, "driven_lanedir_consec": 0.3434169426931408, "sim_compute_sim_state": 0.05610953058515277, "sim_compute_performance-ego0": 0.006714071546282087, "sim_compute_performance-ego1": 0.005934102194649833, "sim_compute_performance-ego2": 0.006046252591269357, "sim_compute_robot_state-ego0": 0.010578760078975132, "sim_compute_robot_state-ego1": 0.010970762797764369, "sim_compute_robot_state-ego2": 0.010455165590558733, "sim_compute_robot_state-parked0": 0.01069021224975586, "sim_compute_robot_state-parked1": 0.010587922164372036, "sim_compute_robot_state-parked2": 0.011101560933249335, "sim_compute_robot_state-parked3": 0.010427909237997872, "sim_compute_robot_state-parked4": 0.010179179055350167, "sim_compute_robot_state-parked5": 0.00993074689592634}, "udem1-0-0-ego1": {"driven_any": 0.4525997528447024, "get_ui_image": 0.10836585930415564, "step_physics": 0.6641345960753304, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4503776051681552, "get_state_dump": 0.04797015871320452, "sim_render-ego0": 0.007850340434483119, "sim_render-ego1": 0.007765718868800572, "sim_render-ego2": 0.007788028035845075, "in-drivable-lane": 0.0, "deviation-heading": 0.0986120715393395, "agent_compute-ego0": 0.13076668977737427, "agent_compute-ego1": 0.1331353783607483, "agent_compute-ego2": 0.13117721251079015, "complete-iteration": 1.4300269143921989, "set_robot_commands": 0.007003699030194964, "deviation-center-line": 0.03896519705346662, "driven_lanedir_consec": 0.4503776051681552, "sim_compute_sim_state": 0.05610953058515277, "sim_compute_performance-ego0": 0.006714071546282087, "sim_compute_performance-ego1": 0.005934102194649833, "sim_compute_performance-ego2": 0.006046252591269357, "sim_compute_robot_state-ego0": 0.010578760078975132, "sim_compute_robot_state-ego1": 0.010970762797764369, "sim_compute_robot_state-ego2": 0.010455165590558733, "sim_compute_robot_state-parked0": 0.01069021224975586, "sim_compute_robot_state-parked1": 0.010587922164372036, "sim_compute_robot_state-parked2": 0.011101560933249335, "sim_compute_robot_state-parked3": 0.010427909237997872, "sim_compute_robot_state-parked4": 0.010179179055350167, "sim_compute_robot_state-parked5": 0.00993074689592634}, "udem1-0-0-ego2": {"driven_any": 0.4492274507040544, "get_ui_image": 0.10836585930415564, "step_physics": 0.6641345960753304, "survival_time": 1.4000000000000006, "driven_lanedir": 0.44698985709557126, "get_state_dump": 0.04797015871320452, "sim_render-ego0": 0.007850340434483119, "sim_render-ego1": 0.007765718868800572, "sim_render-ego2": 0.007788028035845075, "in-drivable-lane": 0.0, "deviation-heading": 0.17062382620338448, "agent_compute-ego0": 0.13076668977737427, "agent_compute-ego1": 0.1331353783607483, "agent_compute-ego2": 0.13117721251079015, "complete-iteration": 1.4300269143921989, "set_robot_commands": 0.007003699030194964, "deviation-center-line": 0.02326060200556992, "driven_lanedir_consec": 0.44698985709557126, "sim_compute_sim_state": 0.05610953058515277, "sim_compute_performance-ego0": 0.006714071546282087, "sim_compute_performance-ego1": 0.005934102194649833, "sim_compute_performance-ego2": 0.006046252591269357, "sim_compute_robot_state-ego0": 0.010578760078975132, "sim_compute_robot_state-ego1": 0.010970762797764369, "sim_compute_robot_state-ego2": 0.010455165590558733, "sim_compute_robot_state-parked0": 0.01069021224975586, "sim_compute_robot_state-parked1": 0.010587922164372036, "sim_compute_robot_state-parked2": 0.011101560933249335, "sim_compute_robot_state-parked3": 0.010427909237997872, "sim_compute_robot_state-parked4": 0.010179179055350167, "sim_compute_robot_state-parked5": 0.00993074689592634}, "udem1-0-1-ego0": {"driven_any": 0.4600961679938569, "get_ui_image": 0.1113471473966326, "step_physics": 0.7128901396478925, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4573624868396155, "get_state_dump": 0.048181618962969096, "sim_render-ego0": 0.007601508072444371, "sim_render-ego1": 0.007798126765659877, "sim_render-ego2": 0.007701822689601353, "in-drivable-lane": 0.0, "deviation-heading": 0.13554557468818512, "agent_compute-ego0": 0.12210721629006524, "agent_compute-ego1": 0.11840419258390154, "agent_compute-ego2": 0.11652358940669467, "complete-iteration": 1.4446094717298237, "set_robot_commands": 0.006446949073246547, "deviation-center-line": 0.07166459790419333, "driven_lanedir_consec": 0.4573624868396155, "sim_compute_sim_state": 0.059316890580313544, "sim_compute_performance-ego0": 0.005981888089861188, "sim_compute_performance-ego1": 0.005982135023389544, "sim_compute_performance-ego2": 0.005961034979139056, "sim_compute_robot_state-ego0": 0.010748999459402902, "sim_compute_robot_state-ego1": 0.010276257991790771, "sim_compute_robot_state-ego2": 0.010534158774784632, "sim_compute_robot_state-parked0": 0.010767264025551932, "sim_compute_robot_state-parked1": 0.010444462299346924, "sim_compute_robot_state-parked2": 0.010665646621159144, "sim_compute_robot_state-parked3": 0.01020275694983346, "sim_compute_robot_state-parked4": 0.010429697377341134, "sim_compute_robot_state-parked5": 0.010289251804351808}, "udem1-0-1-ego1": {"driven_any": 0.44858085721808755, "get_ui_image": 0.1113471473966326, "step_physics": 0.7128901396478925, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4462821106782573, "get_state_dump": 0.048181618962969096, "sim_render-ego0": 0.007601508072444371, "sim_render-ego1": 0.007798126765659877, "sim_render-ego2": 0.007701822689601353, "in-drivable-lane": 0.0, "deviation-heading": 0.09551200458847002, "agent_compute-ego0": 0.12210721629006524, "agent_compute-ego1": 0.11840419258390154, "agent_compute-ego2": 0.11652358940669467, "complete-iteration": 1.4446094717298237, "set_robot_commands": 0.006446949073246547, "deviation-center-line": 0.03682755405867034, "driven_lanedir_consec": 0.4462821106782573, "sim_compute_sim_state": 0.059316890580313544, "sim_compute_performance-ego0": 0.005981888089861188, "sim_compute_performance-ego1": 0.005982135023389544, "sim_compute_performance-ego2": 0.005961034979139056, "sim_compute_robot_state-ego0": 0.010748999459402902, "sim_compute_robot_state-ego1": 0.010276257991790771, "sim_compute_robot_state-ego2": 0.010534158774784632, "sim_compute_robot_state-parked0": 0.010767264025551932, "sim_compute_robot_state-parked1": 0.010444462299346924, "sim_compute_robot_state-parked2": 0.010665646621159144, "sim_compute_robot_state-parked3": 0.01020275694983346, "sim_compute_robot_state-parked4": 0.010429697377341134, "sim_compute_robot_state-parked5": 0.010289251804351808}, "udem1-0-1-ego2": {"driven_any": 0.43931094235398593, "get_ui_image": 0.1113471473966326, "step_physics": 0.7128901396478925, "survival_time": 1.4000000000000006, "driven_lanedir": 0.43631504301965895, "get_state_dump": 0.048181618962969096, "sim_render-ego0": 0.007601508072444371, "sim_render-ego1": 0.007798126765659877, "sim_render-ego2": 0.007701822689601353, "in-drivable-lane": 0.0, "deviation-heading": 0.18540543310453952, "agent_compute-ego0": 0.12210721629006524, "agent_compute-ego1": 0.11840419258390154, "agent_compute-ego2": 0.11652358940669467, "complete-iteration": 1.4446094717298237, "set_robot_commands": 0.006446949073246547, "deviation-center-line": 0.024590560019080956, "driven_lanedir_consec": 0.43631504301965895, "sim_compute_sim_state": 0.059316890580313544, "sim_compute_performance-ego0": 0.005981888089861188, "sim_compute_performance-ego1": 0.005982135023389544, "sim_compute_performance-ego2": 0.005961034979139056, "sim_compute_robot_state-ego0": 0.010748999459402902, "sim_compute_robot_state-ego1": 0.010276257991790771, "sim_compute_robot_state-ego2": 0.010534158774784632, "sim_compute_robot_state-parked0": 0.010767264025551932, "sim_compute_robot_state-parked1": 0.010444462299346924, "sim_compute_robot_state-parked2": 0.010665646621159144, "sim_compute_robot_state-parked3": 0.01020275694983346, "sim_compute_robot_state-parked4": 0.010429697377341134, "sim_compute_robot_state-parked5": 0.010289251804351808}}
set_robot_commands_max0.007003699030194964
set_robot_commands_mean0.0067253240517207566
set_robot_commands_median0.006725324051720756
set_robot_commands_min0.006446949073246547
sim_compute_performance-ego0_max0.006714071546282087
sim_compute_performance-ego0_mean0.0063479798180716375
sim_compute_performance-ego0_median0.0063479798180716375
sim_compute_performance-ego0_min0.005981888089861188
sim_compute_performance-ego1_max0.005982135023389544
sim_compute_performance-ego1_mean0.005958118609019688
sim_compute_performance-ego1_median0.005958118609019689
sim_compute_performance-ego1_min0.005934102194649833
sim_compute_performance-ego2_max0.006046252591269357
sim_compute_performance-ego2_mean0.006003643785204207
sim_compute_performance-ego2_median0.006003643785204207
sim_compute_performance-ego2_min0.005961034979139056
sim_compute_robot_state-ego0_max0.010748999459402902
sim_compute_robot_state-ego0_mean0.010663879769189016
sim_compute_robot_state-ego0_median0.010663879769189016
sim_compute_robot_state-ego0_min0.010578760078975132
sim_compute_robot_state-ego1_max0.010970762797764369
sim_compute_robot_state-ego1_mean0.01062351039477757
sim_compute_robot_state-ego1_median0.010623510394777573
sim_compute_robot_state-ego1_min0.010276257991790771
sim_compute_robot_state-ego2_max0.010534158774784632
sim_compute_robot_state-ego2_mean0.010494662182671683
sim_compute_robot_state-ego2_median0.010494662182671682
sim_compute_robot_state-ego2_min0.010455165590558733
sim_compute_robot_state-parked0_max0.010767264025551932
sim_compute_robot_state-parked0_mean0.010728738137653897
sim_compute_robot_state-parked0_median0.010728738137653897
sim_compute_robot_state-parked0_min0.01069021224975586
sim_compute_robot_state-parked1_max0.010587922164372036
sim_compute_robot_state-parked1_mean0.010516192231859478
sim_compute_robot_state-parked1_median0.01051619223185948
sim_compute_robot_state-parked1_min0.010444462299346924
sim_compute_robot_state-parked2_max0.011101560933249335
sim_compute_robot_state-parked2_mean0.010883603777204242
sim_compute_robot_state-parked2_median0.01088360377720424
sim_compute_robot_state-parked2_min0.010665646621159144
sim_compute_robot_state-parked3_max0.010427909237997872
sim_compute_robot_state-parked3_mean0.010315333093915668
sim_compute_robot_state-parked3_median0.010315333093915666
sim_compute_robot_state-parked3_min0.01020275694983346
sim_compute_robot_state-parked4_max0.010429697377341134
sim_compute_robot_state-parked4_mean0.01030443821634565
sim_compute_robot_state-parked4_median0.01030443821634565
sim_compute_robot_state-parked4_min0.010179179055350167
sim_compute_robot_state-parked5_max0.010289251804351808
sim_compute_robot_state-parked5_mean0.010109999350139074
sim_compute_robot_state-parked5_median0.010109999350139072
sim_compute_robot_state-parked5_min0.00993074689592634
sim_compute_sim_state_max0.059316890580313544
sim_compute_sim_state_mean0.05771321058273315
sim_compute_sim_state_median0.057713210582733154
sim_compute_sim_state_min0.05610953058515277
sim_render-ego0_max0.007850340434483119
sim_render-ego0_mean0.007725924253463744
sim_render-ego0_median0.007725924253463745
sim_render-ego0_min0.007601508072444371
sim_render-ego1_max0.007798126765659877
sim_render-ego1_mean0.007781922817230225
sim_render-ego1_median0.007781922817230225
sim_render-ego1_min0.007765718868800572
sim_render-ego2_max0.007788028035845075
sim_render-ego2_mean0.007744925362723213
sim_render-ego2_median0.007744925362723214
sim_render-ego2_min0.007701822689601353
simulation-passed1
step_physics_max0.7128901396478925
step_physics_mean0.6885123678616115
step_physics_median0.6885123678616114
step_physics_min0.6641345960753304
survival_time_max1.4000000000000006
survival_time_mean1.4000000000000006
survival_time_min1.4000000000000006

Highlights

34514

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.