Duckietown Challenges Home Challenges Submissions

Job 33244

Job ID33244
submission6737
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:05:57
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7105369825058174
survival_time_median2.3249999999999997
deviation-center-line_median0.10940595539296626
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11521799862384796
agent_compute-ego0_mean0.11088840978013144
agent_compute-ego0_median0.11088840978013144
agent_compute-ego0_min0.10655882093641492
agent_compute-ego1_max0.1170592059691747
agent_compute-ego1_mean0.11247151775492564
agent_compute-ego1_median0.11247151775492562
agent_compute-ego1_min0.10788382954067656
agent_compute-ego2_max0.11380972464879352
agent_compute-ego2_mean0.10945821669366625
agent_compute-ego2_median0.10945821669366625
agent_compute-ego2_min0.10510670873853896
complete-iteration_max1.368095889687538
complete-iteration_mean1.3451324828796916
complete-iteration_median1.3451324828796918
complete-iteration_min1.3221690760718452
deviation-center-line_max0.2249556910720774
deviation-center-line_mean0.12314621208046415
deviation-center-line_min0.042585621718128394
deviation-heading_max0.8947248767261731
deviation-heading_mean0.42136767927751057
deviation-heading_median0.3786377605907326
deviation-heading_min0.17534142528065275
driven_any_max0.8787446209134575
driven_any_mean0.7401886254675766
driven_any_median0.7541230065861851
driven_any_min0.5388786365262782
driven_lanedir_consec_max0.7611038772217662
driven_lanedir_consec_mean0.6849181763637932
driven_lanedir_consec_min0.5357136234324127
driven_lanedir_max0.8677563500803285
driven_lanedir_mean0.716718088896692
driven_lanedir_median0.7439145948865682
driven_lanedir_min0.5357136234324127
get_state_dump_max0.04759761492411296
get_state_dump_mean0.046829714377721154
get_state_dump_median0.046829714377721154
get_state_dump_min0.046061813831329346
get_ui_image_max0.10270023842652638
get_ui_image_mean0.10147903478807872
get_ui_image_median0.10147903478807874
get_ui_image_min0.10025783114963108
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.7249487345966613, "get_ui_image": 0.10270023842652638, "step_physics": 0.6133942604064941, "survival_time": 2.3999999999999995, "driven_lanedir": 0.6479054928725083, "get_state_dump": 0.046061813831329346, "sim_render-ego0": 0.007094144821166992, "sim_render-ego1": 0.00696199635664622, "sim_render-ego2": 0.007036129633585612, "in-drivable-lane": 0.0, "deviation-heading": 0.8947248767261731, "agent_compute-ego0": 0.11521799862384796, "agent_compute-ego1": 0.1170592059691747, "agent_compute-ego2": 0.11380972464879352, "complete-iteration": 1.368095889687538, "set_robot_commands": 0.006569201747576396, "deviation-center-line": 0.2249556910720774, "driven_lanedir_consec": 0.6479054928725083, "sim_compute_sim_state": 0.10713220636049908, "sim_compute_performance-ego0": 0.006021817525227864, "sim_compute_performance-ego1": 0.005781993269920349, "sim_compute_performance-ego2": 0.005715295672416687, "sim_compute_robot_state-ego0": 0.010388592878977455, "sim_compute_robot_state-ego1": 0.010037392377853394, "sim_compute_robot_state-ego2": 0.010522082448005676, "sim_compute_robot_state-parked0": 0.010383163889249166, "sim_compute_robot_state-parked1": 0.01070950428644816, "sim_compute_robot_state-parked2": 0.010478228330612184, "sim_compute_robot_state-parked3": 0.010351523756980896, "sim_compute_robot_state-parked4": 0.010716716448465982, "sim_compute_robot_state-parked5": 0.0104095588127772}, "udem1-0-0-ego1": {"driven_any": 0.7757034579230421, "get_ui_image": 0.10270023842652638, "step_physics": 0.6133942604064941, "survival_time": 2.3999999999999995, "driven_lanedir": 0.7611038772217662, "get_state_dump": 0.046061813831329346, "sim_render-ego0": 0.007094144821166992, "sim_render-ego1": 0.00696199635664622, "sim_render-ego2": 0.007036129633585612, "in-drivable-lane": 0.0, "deviation-heading": 0.3891779213717114, "agent_compute-ego0": 0.11521799862384796, "agent_compute-ego1": 0.1170592059691747, "agent_compute-ego2": 0.11380972464879352, "complete-iteration": 1.368095889687538, "set_robot_commands": 0.006569201747576396, "deviation-center-line": 0.17535876757784885, "driven_lanedir_consec": 0.7611038772217662, "sim_compute_sim_state": 0.10713220636049908, "sim_compute_performance-ego0": 0.006021817525227864, "sim_compute_performance-ego1": 0.005781993269920349, "sim_compute_performance-ego2": 0.005715295672416687, "sim_compute_robot_state-ego0": 0.010388592878977455, "sim_compute_robot_state-ego1": 0.010037392377853394, "sim_compute_robot_state-ego2": 0.010522082448005676, "sim_compute_robot_state-parked0": 0.010383163889249166, "sim_compute_robot_state-parked1": 0.01070950428644816, "sim_compute_robot_state-parked2": 0.010478228330612184, "sim_compute_robot_state-parked3": 0.010351523756980896, "sim_compute_robot_state-parked4": 0.010716716448465982, "sim_compute_robot_state-parked5": 0.0104095588127772}, "udem1-0-0-ego2": {"driven_any": 0.8787446209134575, "get_ui_image": 0.10270023842652638, "step_physics": 0.6133942604064941, "survival_time": 2.3999999999999995, "driven_lanedir": 0.8677563500803285, "get_state_dump": 0.046061813831329346, "sim_render-ego0": 0.007094144821166992, "sim_render-ego1": 0.00696199635664622, "sim_render-ego2": 0.007036129633585612, "in-drivable-lane": 0.0, "deviation-heading": 0.36809759980975376, "agent_compute-ego0": 0.11521799862384796, "agent_compute-ego1": 0.1170592059691747, "agent_compute-ego2": 0.11380972464879352, "complete-iteration": 1.368095889687538, "set_robot_commands": 0.006569201747576396, "deviation-center-line": 0.07716528132879791, "driven_lanedir_consec": 0.6932458392480231, "sim_compute_sim_state": 0.10713220636049908, "sim_compute_performance-ego0": 0.006021817525227864, "sim_compute_performance-ego1": 0.005781993269920349, "sim_compute_performance-ego2": 0.005715295672416687, "sim_compute_robot_state-ego0": 0.010388592878977455, "sim_compute_robot_state-ego1": 0.010037392377853394, "sim_compute_robot_state-ego2": 0.010522082448005676, "sim_compute_robot_state-parked0": 0.010383163889249166, "sim_compute_robot_state-parked1": 0.01070950428644816, "sim_compute_robot_state-parked2": 0.010478228330612184, "sim_compute_robot_state-parked3": 0.010351523756980896, "sim_compute_robot_state-parked4": 0.010716716448465982, "sim_compute_robot_state-parked5": 0.0104095588127772}, "udem1-0-1-ego0": {"driven_any": 0.5388786365262782, "get_ui_image": 0.10025783114963108, "step_physics": 0.5909409787919786, "survival_time": 2.25, "driven_lanedir": 0.5357136234324127, "get_state_dump": 0.04759761492411296, "sim_render-ego0": 0.006950982411702474, "sim_render-ego1": 0.006981235080295139, "sim_render-ego2": 0.007282834582858616, "in-drivable-lane": 0.0, "deviation-heading": 0.21836815061992348, "agent_compute-ego0": 0.10655882093641492, "agent_compute-ego1": 0.10788382954067656, "agent_compute-ego2": 0.10510670873853896, "complete-iteration": 1.3221690760718452, "set_robot_commands": 0.006761508517795139, "deviation-center-line": 0.1364929929892348, "driven_lanedir_consec": 0.5357136234324127, "sim_compute_sim_state": 0.10929713249206544, "sim_compute_performance-ego0": 0.005834727817111545, "sim_compute_performance-ego1": 0.005681196848551433, "sim_compute_performance-ego2": 0.006058274375067817, "sim_compute_robot_state-ego0": 0.010771825578477648, "sim_compute_robot_state-ego1": 0.011076768239339192, "sim_compute_robot_state-ego2": 0.010587056477864584, "sim_compute_robot_state-parked0": 0.011494700113932292, "sim_compute_robot_state-parked1": 0.010261885325113932, "sim_compute_robot_state-parked2": 0.010267835193210178, "sim_compute_robot_state-parked3": 0.01046650144788954, "sim_compute_robot_state-parked4": 0.010033268398708769, "sim_compute_robot_state-parked5": 0.010134103563096788}, "udem1-0-1-ego1": {"driven_any": 0.7325425552493282, "get_ui_image": 0.10025783114963108, "step_physics": 0.5909409787919786, "survival_time": 2.25, "driven_lanedir": 0.7278281257636117, "get_state_dump": 0.04759761492411296, "sim_render-ego0": 0.006950982411702474, "sim_render-ego1": 0.006981235080295139, "sim_render-ego2": 0.007282834582858616, "in-drivable-lane": 0.0, "deviation-heading": 0.17534142528065275, "agent_compute-ego0": 0.10655882093641492, "agent_compute-ego1": 0.10788382954067656, "agent_compute-ego2": 0.10510670873853896, "complete-iteration": 1.3221690760718452, "set_robot_commands": 0.006761508517795139, "deviation-center-line": 0.042585621718128394, "driven_lanedir_consec": 0.7278281257636117, "sim_compute_sim_state": 0.10929713249206544, "sim_compute_performance-ego0": 0.005834727817111545, "sim_compute_performance-ego1": 0.005681196848551433, "sim_compute_performance-ego2": 0.006058274375067817, "sim_compute_robot_state-ego0": 0.010771825578477648, "sim_compute_robot_state-ego1": 0.011076768239339192, "sim_compute_robot_state-ego2": 0.010587056477864584, "sim_compute_robot_state-parked0": 0.011494700113932292, "sim_compute_robot_state-parked1": 0.010261885325113932, "sim_compute_robot_state-parked2": 0.010267835193210178, "sim_compute_robot_state-parked3": 0.01046650144788954, "sim_compute_robot_state-parked4": 0.010033268398708769, "sim_compute_robot_state-parked5": 0.010134103563096788}, "udem1-0-1-ego2": {"driven_any": 0.790313747596692, "get_ui_image": 0.10025783114963108, "step_physics": 0.5909409787919786, "survival_time": 2.25, "driven_lanedir": 0.7600010640095247, "get_state_dump": 0.04759761492411296, "sim_render-ego0": 0.006950982411702474, "sim_render-ego1": 0.006981235080295139, "sim_render-ego2": 0.007282834582858616, "in-drivable-lane": 0.0, "deviation-heading": 0.4824961018568489, "agent_compute-ego0": 0.10655882093641492, "agent_compute-ego1": 0.10788382954067656, "agent_compute-ego2": 0.10510670873853896, "complete-iteration": 1.3221690760718452, "set_robot_commands": 0.006761508517795139, "deviation-center-line": 0.0823189177966977, "driven_lanedir_consec": 0.7437120996444373, "sim_compute_sim_state": 0.10929713249206544, "sim_compute_performance-ego0": 0.005834727817111545, "sim_compute_performance-ego1": 0.005681196848551433, "sim_compute_performance-ego2": 0.006058274375067817, "sim_compute_robot_state-ego0": 0.010771825578477648, "sim_compute_robot_state-ego1": 0.011076768239339192, "sim_compute_robot_state-ego2": 0.010587056477864584, "sim_compute_robot_state-parked0": 0.011494700113932292, "sim_compute_robot_state-parked1": 0.010261885325113932, "sim_compute_robot_state-parked2": 0.010267835193210178, "sim_compute_robot_state-parked3": 0.01046650144788954, "sim_compute_robot_state-parked4": 0.010033268398708769, "sim_compute_robot_state-parked5": 0.010134103563096788}}
set_robot_commands_max0.006761508517795139
set_robot_commands_mean0.006665355132685767
set_robot_commands_median0.006665355132685767
set_robot_commands_min0.006569201747576396
sim_compute_performance-ego0_max0.006021817525227864
sim_compute_performance-ego0_mean0.005928272671169704
sim_compute_performance-ego0_median0.005928272671169705
sim_compute_performance-ego0_min0.005834727817111545
sim_compute_performance-ego1_max0.005781993269920349
sim_compute_performance-ego1_mean0.00573159505923589
sim_compute_performance-ego1_median0.005731595059235891
sim_compute_performance-ego1_min0.005681196848551433
sim_compute_performance-ego2_max0.006058274375067817
sim_compute_performance-ego2_mean0.005886785023742252
sim_compute_performance-ego2_median0.0058867850237422515
sim_compute_performance-ego2_min0.005715295672416687
sim_compute_robot_state-ego0_max0.010771825578477648
sim_compute_robot_state-ego0_mean0.010580209228727553
sim_compute_robot_state-ego0_median0.010580209228727553
sim_compute_robot_state-ego0_min0.010388592878977455
sim_compute_robot_state-ego1_max0.011076768239339192
sim_compute_robot_state-ego1_mean0.010557080308596293
sim_compute_robot_state-ego1_median0.010557080308596294
sim_compute_robot_state-ego1_min0.010037392377853394
sim_compute_robot_state-ego2_max0.010587056477864584
sim_compute_robot_state-ego2_mean0.01055456946293513
sim_compute_robot_state-ego2_median0.010554569462935133
sim_compute_robot_state-ego2_min0.010522082448005676
sim_compute_robot_state-parked0_max0.011494700113932292
sim_compute_robot_state-parked0_mean0.010938932001590728
sim_compute_robot_state-parked0_median0.01093893200159073
sim_compute_robot_state-parked0_min0.010383163889249166
sim_compute_robot_state-parked1_max0.01070950428644816
sim_compute_robot_state-parked1_mean0.010485694805781048
sim_compute_robot_state-parked1_median0.010485694805781046
sim_compute_robot_state-parked1_min0.010261885325113932
sim_compute_robot_state-parked2_max0.010478228330612184
sim_compute_robot_state-parked2_mean0.01037303176191118
sim_compute_robot_state-parked2_median0.01037303176191118
sim_compute_robot_state-parked2_min0.010267835193210178
sim_compute_robot_state-parked3_max0.01046650144788954
sim_compute_robot_state-parked3_mean0.01040901260243522
sim_compute_robot_state-parked3_median0.01040901260243522
sim_compute_robot_state-parked3_min0.010351523756980896
sim_compute_robot_state-parked4_max0.010716716448465982
sim_compute_robot_state-parked4_mean0.010374992423587377
sim_compute_robot_state-parked4_median0.010374992423587377
sim_compute_robot_state-parked4_min0.010033268398708769
sim_compute_robot_state-parked5_max0.0104095588127772
sim_compute_robot_state-parked5_mean0.010271831187936996
sim_compute_robot_state-parked5_median0.010271831187936994
sim_compute_robot_state-parked5_min0.010134103563096788
sim_compute_sim_state_max0.10929713249206544
sim_compute_sim_state_mean0.10821466942628225
sim_compute_sim_state_median0.10821466942628225
sim_compute_sim_state_min0.10713220636049908
sim_render-ego0_max0.007094144821166992
sim_render-ego0_mean0.007022563616434732
sim_render-ego0_median0.007022563616434733
sim_render-ego0_min0.006950982411702474
sim_render-ego1_max0.006981235080295139
sim_render-ego1_mean0.00697161571847068
sim_render-ego1_median0.006971615718470679
sim_render-ego1_min0.00696199635664622
sim_render-ego2_max0.007282834582858616
sim_render-ego2_mean0.007159482108222114
sim_render-ego2_median0.0071594821082221136
sim_render-ego2_min0.007036129633585612
simulation-passed1
step_physics_max0.6133942604064941
step_physics_mean0.6021676195992365
step_physics_median0.6021676195992364
step_physics_min0.5909409787919786
survival_time_max2.3999999999999995
survival_time_mean2.3249999999999997
survival_time_min2.25

Highlights

33244

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.