Duckietown Challenges Home Challenges Submissions

Job 33465

Job ID33465
submission6702
userBea Baselines 🐤
user labelstraight
challengeaido5-LF-sim-validation
stepLFv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg04-bf35e9d68df4-1
date started
date completed
duration0:18:48
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6430501145491379
survival_time_median10.90000000000002
deviation-center-line_median0.3525330450206732
in-drivable-lane_median2.225000000000011


other stats
agent_compute-ego_max0.02471322298049927
agent_compute-ego_mean0.02355996751952249
agent_compute-ego_median0.02346755575046426
agent_compute-ego_min0.02236087263123063
complete-iteration_max0.319506675731845
complete-iteration_mean0.29526939641119404
complete-iteration_median0.29562571088473
complete-iteration_min0.2829644896767356
deviation-center-line_max0.9632944711251068
deviation-center-line_mean0.4630340322034023
deviation-center-line_min0.14192664544797587
deviation-heading_max2.098533601853976
deviation-heading_mean0.9754792675440108
deviation-heading_median0.7342551245090743
deviation-heading_min0.585297346117501
driven_any_max2.420991347968776
driven_any_mean1.6207752930494792
driven_any_median1.7473878924063322
driven_any_min0.6646238014128742
driven_lanedir_consec_max2.0163429659604093
driven_lanedir_consec_mean0.9238482055775374
driven_lanedir_consec_min0.4265885495638271
driven_lanedir_max2.0163429659604093
driven_lanedir_mean0.9238482055775374
driven_lanedir_median0.6430501145491379
driven_lanedir_min0.4265885495638271
get_state_dump_max0.019084825988643427
get_state_dump_mean0.017736287353136104
get_state_dump_median0.01753746614736669
get_state_dump_min0.01703002406101601
get_ui_image_max0.05433523384007541
get_ui_image_mean0.05122339505742043
get_ui_image_median0.05120163081309147
get_ui_image_min0.04977791468302409
in-drivable-lane_max10.500000000000083
in-drivable-lane_mean4.055000000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.2994563656887796, "get_ui_image": 0.05099532371614038, "step_physics": 0.160311477940257, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.018504478582521765, "sim_render-ego": 0.007705307588344667, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.02433255387515557, "deviation-heading": 0.656882474004175, "complete-iteration": 0.319506675731845, "set_robot_commands": 0.006993194905723013, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.021356600086863447, "sim_compute_performance-ego": 0.006526380050473097, "sim_compute_robot_state-ego": 0.011658450452292838, "sim_compute_robot_state-parked0": 0.010896503925323486}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.1953194191238845, "get_ui_image": 0.050043376929619736, "step_physics": 0.13310037553310394, "survival_time": 13.600000000000058, "driven_lanedir": 1.1856250938826185, "get_state_dump": 0.017586722093469957, "sim_render-ego": 0.00728427925530602, "in-drivable-lane": 6.050000000000077, "agent_compute-ego": 0.02334825431599337, "deviation-heading": 0.6506184484994173, "complete-iteration": 0.2883906399502474, "set_robot_commands": 0.006950042703572442, "deviation-center-line": 0.7153797678025385, "driven_lanedir_consec": 1.1856250938826185, "sim_compute_sim_state": 0.021780006149235892, "sim_compute_performance-ego": 0.006288943921818453, "sim_compute_robot_state-ego": 0.011132905588430516, "sim_compute_robot_state-parked0": 0.010661014739204855}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7783468901478676, "get_ui_image": 0.05140793791004256, "step_physics": 0.13388538360595703, "survival_time": 5.09999999999999, "driven_lanedir": 0.4870179525099734, "get_state_dump": 0.01703002406101601, "sim_render-ego": 0.0068963181738759954, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.022922875834446327, "deviation-heading": 0.7371537164253312, "complete-iteration": 0.28435631359324737, "set_robot_commands": 0.00692291587006812, "deviation-center-line": 0.31383033576316843, "driven_lanedir_consec": 0.4870179525099734, "sim_compute_sim_state": 0.01827571438808067, "sim_compute_performance-ego": 0.00579533389970368, "sim_compute_robot_state-ego": 0.010457176788180485, "sim_compute_robot_state-parked0": 0.01055743413812974}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.678601870577068, "get_ui_image": 0.05042955848608125, "step_physics": 0.13254553280519635, "survival_time": 4.449999999999992, "driven_lanedir": 0.4265885495638271, "get_state_dump": 0.017477949013870755, "sim_render-ego": 0.007251211766446574, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.023586857184935153, "deviation-heading": 0.7313565325928172, "complete-iteration": 0.2850000670786654, "set_robot_commands": 0.007156688175844342, "deviation-center-line": 0.2683902859812928, "driven_lanedir_consec": 0.4265885495638271, "sim_compute_sim_state": 0.018475401267576755, "sim_compute_performance-ego": 0.006206820520122399, "sim_compute_robot_state-ego": 0.010999267020922028, "sim_compute_robot_state-parked0": 0.010655561189972951}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.420991347968776, "get_ui_image": 0.05158623298009237, "step_physics": 0.14252568960189818, "survival_time": 14.950000000000076, "driven_lanedir": 0.6446180995854834, "get_state_dump": 0.017488210201263427, "sim_render-ego": 0.007403604984283448, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.02406891902287801, "deviation-heading": 0.8468082391327437, "complete-iteration": 0.2929711596171061, "set_robot_commands": 0.006919553279876709, "deviation-center-line": 0.14192664544797587, "driven_lanedir_consec": 0.6446180995854834, "sim_compute_sim_state": 0.014911858240763349, "sim_compute_performance-ego": 0.006140494346618652, "sim_compute_robot_state-ego": 0.011180058320363362, "sim_compute_robot_state-parked0": 0.010533970991770426}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.4072325102045298, "get_ui_image": 0.05193746646245321, "step_physics": 0.14652240753173829, "survival_time": 14.950000000000076, "driven_lanedir": 0.6414821295127923, "get_state_dump": 0.017477169831593833, "sim_render-ego": 0.007489918073018392, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.02471322298049927, "deviation-heading": 0.8474318367616545, "complete-iteration": 0.2982802621523539, "set_robot_commands": 0.006858665148417155, "deviation-center-line": 0.14728565348872835, "driven_lanedir_consec": 0.6414821295127923, "sim_compute_sim_state": 0.015139238039652506, "sim_compute_performance-ego": 0.006207048098246256, "sim_compute_robot_state-ego": 0.011137666702270508, "sim_compute_robot_state-parked0": 0.01057717005411784}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.411956006437587, "get_ui_image": 0.04977791468302409, "step_physics": 0.14983869473139444, "survival_time": 14.950000000000076, "driven_lanedir": 2.0163429659604093, "get_state_dump": 0.017950069904327393, "sim_render-ego": 0.007368666330973307, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.024364782174428303, "deviation-heading": 2.098533601853976, "complete-iteration": 0.30330602486928304, "set_robot_commands": 0.006500864823659261, "deviation-center-line": 0.8309439677931447, "driven_lanedir_consec": 2.0163429659604093, "sim_compute_sim_state": 0.01965171734491984, "sim_compute_performance-ego": 0.006213645935058593, "sim_compute_robot_state-ego": 0.011232856114705404, "sim_compute_robot_state-parked0": 0.010189738273620606}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.410019798332097, "get_ui_image": 0.05015767415364583, "step_physics": 0.1465796160697937, "survival_time": 14.950000000000076, "driven_lanedir": 2.008955624758421, "get_state_dump": 0.017676823139190674, "sim_render-ego": 0.007159250577290853, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.023209540049235027, "deviation-heading": 2.0093607750461997, "complete-iteration": 0.2994491537412008, "set_robot_commands": 0.006636211077372233, "deviation-center-line": 0.9632944711251068, "driven_lanedir_consec": 2.008955624758421, "sim_compute_sim_state": 0.020402007897694904, "sim_compute_performance-ego": 0.0060244401295979815, "sim_compute_robot_state-ego": 0.010988434155782064, "sim_compute_robot_state-parked0": 0.010402880509694417}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.6646238014128742, "get_ui_image": 0.05433523384007541, "step_physics": 0.14574960686943747, "survival_time": 4.399999999999992, "driven_lanedir": 0.4333735891477426, "get_state_dump": 0.01708660071546381, "sim_render-ego": 0.007118590853431008, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02269179712642323, "deviation-heading": 0.5913497050062915, "complete-iteration": 0.29846917770125647, "set_robot_commands": 0.0064597698775204744, "deviation-center-line": 0.31869876800675323, "driven_lanedir_consec": 0.4333735891477426, "sim_compute_sim_state": 0.01721546866677024, "sim_compute_performance-ego": 0.006251646713777022, "sim_compute_robot_state-ego": 0.010905875401063398, "sim_compute_robot_state-parked0": 0.010444237427277998}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.9412049206013268, "get_ui_image": 0.051563231413029445, "step_physics": 0.13307557027202008, "survival_time": 6.0499999999999865, "driven_lanedir": 0.5069617153220096, "get_state_dump": 0.019084825988643427, "sim_render-ego": 0.006841562996225909, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.02236087263123063, "deviation-heading": 0.585297346117501, "complete-iteration": 0.2829644896767356, "set_robot_commands": 0.00674880634654652, "deviation-center-line": 0.3863673220345931, "driven_lanedir_consec": 0.5069617153220096, "sim_compute_sim_state": 0.016446598305189904, "sim_compute_performance-ego": 0.005943623456087979, "sim_compute_robot_state-ego": 0.010108242350176346, "sim_compute_robot_state-parked0": 0.010581940658821547}}
set_robot_commands_max0.007156688175844342
set_robot_commands_mean0.006814671220860028
set_robot_commands_median0.006889109214146932
set_robot_commands_min0.0064597698775204744
sim_compute_performance-ego_max0.006526380050473097
sim_compute_performance-ego_mean0.006159837707150412
sim_compute_performance-ego_median0.006206934309184328
sim_compute_performance-ego_min0.00579533389970368
sim_compute_robot_state-ego_max0.011658450452292838
sim_compute_robot_state-ego_mean0.010980093289418695
sim_compute_robot_state-ego_median0.011066086304676271
sim_compute_robot_state-ego_min0.010108242350176346
sim_compute_robot_state-parked0_max0.010896503925323486
sim_compute_robot_state-parked0_mean0.010550045190793386
sim_compute_robot_state-parked0_median0.01056730209612379
sim_compute_robot_state-parked0_min0.010189738273620606
sim_compute_sim_state_max0.021780006149235892
sim_compute_sim_state_mean0.01836546103867475
sim_compute_sim_state_median0.018375557827828713
sim_compute_sim_state_min0.014911858240763349
sim_render-ego_max0.007705307588344667
sim_render-ego_mean0.007251871059919616
sim_render-ego_median0.007267745510876297
sim_render-ego_min0.006841562996225909
simulation-passed1
step_physics_max0.160311477940257
step_physics_mean0.14241343549607963
step_physics_median0.14413764823566785
step_physics_min0.13254553280519635
survival_time_max14.950000000000076
survival_time_mean10.16000000000003
survival_time_min4.399999999999992

Highlights

33465

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.