Duckietown Challenges Home Challenges Submissions

Evaluator 1071

ID1071
evaluatorip-172-31-25-98-2470
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2470
versiond-c:4.0.29;d-c-r:4.0.40;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success4 22033
# timeout
# failed1 22012
# error
# aborted
# host-error4 22006
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
220793428jiang pengRL-TH-shiaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-25-98-24700:41:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.211521018163035
survival_time_median14.950000000000076
deviation-center-line_median0.7895597906655674
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1948044204711914
agent_compute-ego_mean0.17956787872314456
agent_compute-ego_median0.1898537540435791
agent_compute-ego_min0.1435151489575704
deviation-center-line_max0.9001812742716414
deviation-center-line_mean0.7704140767230496
deviation-center-line_min0.5800722607226289
deviation-heading_max4.292321589423205
deviation-heading_mean3.160662912264303
deviation-heading_median2.917931842006715
deviation-heading_min2.3302423082430295
driven_any_max3.703545346146835
driven_any_mean3.182838513454838
driven_any_median3.262839618285201
driven_any_min2.627917805894126
driven_lanedir_consec_max3.239738669166577
driven_lanedir_consec_mean2.9762072477374635
driven_lanedir_consec_min2.4768636309630376
driven_lanedir_max3.6479553876731257
driven_lanedir_mean3.101229965843199
driven_lanedir_median3.2115904821483108
driven_lanedir_min2.477038612964346
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.0264130434743657, "sim_physics": 0.20299437284469604, "survival_time": 14.950000000000076, "driven_lanedir": 2.9298266772636365, "sim_render-ego": 0.06403936306635538, "in-drivable-lane": 0, "agent_compute-ego": 0.17905685186386108, "deviation-heading": 3.6032022031637223, "set_robot_commands": 0.0972832711537679, "deviation-center-line": 0.7895597906655674, "driven_lanedir_consec": 2.7152571684569233, "sim_compute_sim_state": 0.04091646273930868, "sim_compute_performance-ego": 0.07203858057657878, "sim_compute_robot_state-ego": 0.0742251714070638, "sim_compute_robot_state-npc0": 0.06988219102223714, "sim_compute_robot_state-npc1": 0.06993733247121176, "sim_compute_robot_state-npc2": 0.07000805695851643, "sim_compute_robot_state-npc3": 0.07127993027369181}, "udem1-1-0": {"driven_any": 3.262839618285201, "sim_physics": 0.21790706237157187, "survival_time": 14.950000000000076, "driven_lanedir": 3.2115904821483108, "sim_render-ego": 0.06706384420394898, "in-drivable-lane": 0, "agent_compute-ego": 0.1898537540435791, "deviation-heading": 2.917931842006715, "set_robot_commands": 0.10459625085194904, "deviation-center-line": 0.7551716314492094, "driven_lanedir_consec": 3.211521018163035, "sim_compute_sim_state": 0.04153699636459351, "sim_compute_performance-ego": 0.0754030434290568, "sim_compute_robot_state-ego": 0.07837692737579345, "sim_compute_robot_state-npc0": 0.07396094242731731, "sim_compute_robot_state-npc1": 0.07502631187438964, "sim_compute_robot_state-npc2": 0.07414793888727823, "sim_compute_robot_state-npc3": 0.07310976028442383}, "udem1-2-0": {"driven_any": 3.703545346146835, "sim_physics": 0.22922886927922567, "survival_time": 14.950000000000076, "driven_lanedir": 3.6479553876731257, "sim_render-ego": 0.06811189492543539, "in-drivable-lane": 0, "agent_compute-ego": 0.19060921827952068, "deviation-heading": 2.6596166184848435, "set_robot_commands": 0.10195810556411744, "deviation-center-line": 0.5800722607226289, "driven_lanedir_consec": 3.237655751937743, "sim_compute_sim_state": 0.04236008246739705, "sim_compute_performance-ego": 0.07482016007105509, "sim_compute_robot_state-ego": 0.08084342956542968, "sim_compute_robot_state-npc0": 0.07316901524861653, "sim_compute_robot_state-npc1": 0.07374683698018392, "sim_compute_robot_state-npc2": 0.07463609218597413, "sim_compute_robot_state-npc3": 0.07503319978713989}, "udem1-3-0": {"driven_any": 2.627917805894126, "sim_physics": 0.22556105852127076, "survival_time": 14.950000000000076, "driven_lanedir": 2.477038612964346, "sim_render-ego": 0.06742030620574951, "in-drivable-lane": 0, "agent_compute-ego": 0.1948044204711914, "deviation-heading": 4.292321589423205, "set_robot_commands": 0.1003996213277181, "deviation-center-line": 0.827085426506201, "driven_lanedir_consec": 2.4768636309630376, "sim_compute_sim_state": 0.04261252641677857, "sim_compute_performance-ego": 0.07338754574457805, "sim_compute_robot_state-ego": 0.0809661595026652, "sim_compute_robot_state-npc0": 0.07296974817911783, "sim_compute_robot_state-npc1": 0.07434299866358439, "sim_compute_robot_state-npc2": 0.07412123998006184, "sim_compute_robot_state-npc3": 0.0748993468284607}, "udem1-4-0": {"driven_any": 3.293476753473662, "sim_physics": 0.1577261026700338, "survival_time": 14.950000000000076, "driven_lanedir": 3.239738669166577, "sim_render-ego": 0.05307475090026856, "in-drivable-lane": 0, "agent_compute-ego": 0.1435151489575704, "deviation-heading": 2.3302423082430295, "set_robot_commands": 0.07806015968322753, "deviation-center-line": 0.9001812742716414, "driven_lanedir_consec": 3.239738669166577, "sim_compute_sim_state": 0.03338013410568237, "sim_compute_performance-ego": 0.0589110008875529, "sim_compute_robot_state-ego": 0.06169424454371134, "sim_compute_robot_state-npc0": 0.05970281759897868, "sim_compute_robot_state-npc1": 0.05840065399805705, "sim_compute_robot_state-npc2": 0.05700177113215128, "sim_compute_robot_state-npc3": 0.05840598503748576}}
set_robot_commands_max0.10459625085194904
set_robot_commands_mean0.096459481716156
set_robot_commands_median0.1003996213277181
set_robot_commands_min0.07806015968322753
sim_compute_performance-ego_max0.0754030434290568
sim_compute_performance-ego_mean0.07091206614176433
sim_compute_performance-ego_median0.07338754574457805
sim_compute_performance-ego_min0.0589110008875529
sim_compute_robot_state-ego_max0.0809661595026652
sim_compute_robot_state-ego_mean0.0752211864789327
sim_compute_robot_state-ego_median0.07837692737579345
sim_compute_robot_state-ego_min0.06169424454371134
sim_compute_robot_state-npc0_max0.07396094242731731
sim_compute_robot_state-npc0_mean0.0699369428952535
sim_compute_robot_state-npc0_median0.07296974817911783
sim_compute_robot_state-npc0_min0.05970281759897868
sim_compute_robot_state-npc1_max0.07502631187438964
sim_compute_robot_state-npc1_mean0.07029082679748536
sim_compute_robot_state-npc1_median0.07374683698018392
sim_compute_robot_state-npc1_min0.05840065399805705
sim_compute_robot_state-npc2_max0.07463609218597413
sim_compute_robot_state-npc2_mean0.06998301982879639
sim_compute_robot_state-npc2_median0.07412123998006184
sim_compute_robot_state-npc2_min0.05700177113215128
sim_compute_robot_state-npc3_max0.07503319978713989
sim_compute_robot_state-npc3_mean0.07054564444224039
sim_compute_robot_state-npc3_median0.07310976028442383
sim_compute_robot_state-npc3_min0.05840598503748576
sim_compute_sim_state_max0.04261252641677857
sim_compute_sim_state_mean0.040161240418752034
sim_compute_sim_state_median0.04153699636459351
sim_compute_sim_state_min0.03338013410568237
sim_physics_max0.22922886927922567
sim_physics_mean0.2066834931373596
sim_physics_median0.21790706237157187
sim_physics_min0.1577261026700338
sim_render-ego_max0.06811189492543539
sim_render-ego_mean0.06394203186035156
sim_render-ego_median0.06706384420394898
sim_render-ego_min0.05307475090026856
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
220663418jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-24700:29:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.477618147417371
survival_time_median14.950000000000076
deviation-center-line_median0.41610245264751655
in-drivable-lane_median0.4000000000000057


other stats
agent_compute-ego_max0.1847273988285284
agent_compute-ego_mean0.1552929166706129
agent_compute-ego_median0.13980335394541424
agent_compute-ego_min0.1353608806927999
deviation-center-line_max1.8441434784961936
deviation-center-line_mean0.6816987549983642
deviation-center-line_min0.1352609308088931
deviation-heading_max7.268181873394548
deviation-heading_mean2.5741501785960166
deviation-heading_median2.1211344504999516
deviation-heading_min0.5911832352707294
driven_any_max3.539835909855764
driven_any_mean1.9533074283756435
driven_any_median1.544386490290354
driven_any_min1.3549285889882925
driven_lanedir_consec_max3.4958257540644144
driven_lanedir_consec_mean1.8359327003354369
driven_lanedir_consec_min1.2714972796305468
driven_lanedir_max3.4958257540644144
driven_lanedir_mean1.8359327003354369
driven_lanedir_median1.477618147417371
driven_lanedir_min1.2714972796305468
in-drivable-lane_max10.900000000000084
in-drivable-lane_mean4.410000000000035
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.544386490290354, "sim_physics": 0.13490498145421345, "survival_time": 14.950000000000076, "driven_lanedir": 1.477618147417371, "sim_render-ego": 0.051219571431477866, "in-drivable-lane": 0, "agent_compute-ego": 0.13980335394541424, "deviation-heading": 7.268181873394548, "set_robot_commands": 0.07449322541554769, "deviation-center-line": 1.8441434784961936, "driven_lanedir_consec": 1.477618147417371, "sim_compute_sim_state": 0.03080873250961304, "sim_compute_performance-ego": 0.05534373839696249, "sim_compute_robot_state-ego": 0.05798586924870809, "sim_compute_robot_state-npc0": 0.056382668813069664, "sim_compute_robot_state-npc1": 0.055494805971781414, "sim_compute_robot_state-npc2": 0.05523664395014445, "sim_compute_robot_state-npc3": 0.05469653606414795}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.539835909855764, "sim_physics": 0.14617358525594076, "survival_time": 14.950000000000076, "driven_lanedir": 3.4958257540644144, "sim_render-ego": 0.051259349981943765, "in-drivable-lane": 0, "agent_compute-ego": 0.1353608806927999, "deviation-heading": 2.1211344504999516, "set_robot_commands": 0.07419891595840454, "deviation-center-line": 0.7724394617447361, "driven_lanedir_consec": 3.4958257540644144, "sim_compute_sim_state": 0.032362333138783776, "sim_compute_performance-ego": 0.0545812718073527, "sim_compute_robot_state-ego": 0.060665179093678794, "sim_compute_robot_state-npc0": 0.05638939301172892, "sim_compute_robot_state-npc1": 0.05649090528488159, "sim_compute_robot_state-npc2": 0.05503296454747518, "sim_compute_robot_state-npc3": 0.05585675080617269}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.490210516274784, "sim_physics": 0.12876949230829873, "survival_time": 14.950000000000076, "driven_lanedir": 1.2714972796305468, "sim_render-ego": 0.04975727399190267, "in-drivable-lane": 10.750000000000083, "agent_compute-ego": 0.13800065517425536, "deviation-heading": 0.7026919804286774, "set_robot_commands": 0.07485011418660482, "deviation-center-line": 0.1352609308088931, "driven_lanedir_consec": 1.2714972796305468, "sim_compute_sim_state": 0.030840100447336833, "sim_compute_performance-ego": 0.05418767849604289, "sim_compute_robot_state-ego": 0.05713441292444865, "sim_compute_robot_state-npc0": 0.05816709756851196, "sim_compute_robot_state-npc1": 0.05543315331141154, "sim_compute_robot_state-npc2": 0.053387905756632485, "sim_compute_robot_state-npc3": 0.05428322633107503}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3549285889882925, "sim_physics": 0.17428364197413126, "survival_time": 14.950000000000076, "driven_lanedir": 1.2838547585222382, "sim_render-ego": 0.06414818445841472, "in-drivable-lane": 10.900000000000084, "agent_compute-ego": 0.17857229471206665, "deviation-heading": 0.5911832352707294, "set_robot_commands": 0.10009062608083089, "deviation-center-line": 0.2405474512944813, "driven_lanedir_consec": 1.2838547585222382, "sim_compute_sim_state": 0.04124237855275472, "sim_compute_performance-ego": 0.07170687675476074, "sim_compute_robot_state-ego": 0.07717386722564697, "sim_compute_robot_state-npc0": 0.07213738203048706, "sim_compute_robot_state-npc1": 0.07288112878799438, "sim_compute_robot_state-npc2": 0.07324933369954427, "sim_compute_robot_state-npc3": 0.07506820678710938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.837175636469023, "sim_physics": 0.17490281592840437, "survival_time": 8.699999999999989, "driven_lanedir": 1.6508675620426134, "sim_render-ego": 0.06612370480066058, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.1847273988285284, "deviation-heading": 2.1875593533861775, "set_robot_commands": 0.09944823007474, "deviation-center-line": 0.41610245264751655, "driven_lanedir_consec": 1.6508675620426134, "sim_compute_sim_state": 0.04104255122699957, "sim_compute_performance-ego": 0.07043782321886084, "sim_compute_robot_state-ego": 0.07716299747598582, "sim_compute_robot_state-npc0": 0.07202513464565935, "sim_compute_robot_state-npc1": 0.07243249060093672, "sim_compute_robot_state-npc2": 0.07315903422476232, "sim_compute_robot_state-npc3": 0.07098646821646855}}
set_robot_commands_max0.10009062608083089
set_robot_commands_mean0.08461622234322559
set_robot_commands_median0.07485011418660482
set_robot_commands_min0.07419891595840454
sim_compute_performance-ego_max0.07170687675476074
sim_compute_performance-ego_mean0.06125147773479593
sim_compute_performance-ego_median0.05534373839696249
sim_compute_performance-ego_min0.05418767849604289
sim_compute_robot_state-ego_max0.07717386722564697
sim_compute_robot_state-ego_mean0.06602446519369366
sim_compute_robot_state-ego_median0.060665179093678794
sim_compute_robot_state-ego_min0.05713441292444865
sim_compute_robot_state-npc0_max0.07213738203048706
sim_compute_robot_state-npc0_mean0.06302033521389139
sim_compute_robot_state-npc0_median0.05816709756851196
sim_compute_robot_state-npc0_min0.056382668813069664
sim_compute_robot_state-npc1_max0.07288112878799438
sim_compute_robot_state-npc1_mean0.06254649679140113
sim_compute_robot_state-npc1_median0.05649090528488159
sim_compute_robot_state-npc1_min0.05543315331141154
sim_compute_robot_state-npc2_max0.07324933369954427
sim_compute_robot_state-npc2_mean0.06201317643571175
sim_compute_robot_state-npc2_median0.05523664395014445
sim_compute_robot_state-npc2_min0.053387905756632485
sim_compute_robot_state-npc3_max0.07506820678710938
sim_compute_robot_state-npc3_mean0.06217823764099471
sim_compute_robot_state-npc3_median0.05585675080617269
sim_compute_robot_state-npc3_min0.05428322633107503
sim_compute_sim_state_max0.04124237855275472
sim_compute_sim_state_mean0.035259219175097584
sim_compute_sim_state_median0.032362333138783776
sim_compute_sim_state_min0.03080873250961304
sim_physics_max0.17490281592840437
sim_physics_mean0.15180690338419772
sim_physics_median0.14617358525594076
sim_physics_min0.12876949230829873
sim_render-ego_max0.06612370480066058
sim_render-ego_mean0.05650161693287992
sim_render-ego_median0.051259349981943765
sim_render-ego_min0.04975727399190267
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.70000000000006
survival_time_min8.699999999999989
No reset possible
220593412jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-25-98-24700:36:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1170319729193263
survival_time_median14.950000000000076
deviation-center-line_median0.669401506264004
in-drivable-lane_median0.20000000000000284


other stats
agent_compute-ego_max0.1925611753721495
agent_compute-ego_mean0.18973056577562217
agent_compute-ego_median0.18988429148991903
agent_compute-ego_min0.1841786257425944
deviation-center-line_max1.0363995200136338
deviation-center-line_mean0.7332854622662206
deviation-center-line_min0.4475046471710668
deviation-heading_max6.574658269182281
deviation-heading_mean4.135424324931191
deviation-heading_median3.8271145701854663
deviation-heading_min2.1644874191051224
driven_any_max3.6176088593258378
driven_any_mean2.6611473765465954
driven_any_median2.4599104038365303
driven_any_min1.9737633861025847
driven_lanedir_consec_max3.552621186311328
driven_lanedir_consec_mean2.3758932528742127
driven_lanedir_consec_min1.4559090470160427
driven_lanedir_max3.552621186311328
driven_lanedir_mean2.4765410653154616
driven_lanedir_median2.2420916456906643
driven_lanedir_min1.6386045434392444
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean0.6100000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.04062589561721, "sim_physics": 0.18643476009368895, "survival_time": 14.950000000000076, "driven_lanedir": 1.834088436450948, "sim_render-ego": 0.06774195750554403, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.1841786257425944, "deviation-heading": 6.574658269182281, "set_robot_commands": 0.10262927452723183, "deviation-center-line": 0.5729163122459467, "driven_lanedir_consec": 1.4559090470160427, "sim_compute_sim_state": 0.04246886094411214, "sim_compute_performance-ego": 0.07420280377070108, "sim_compute_robot_state-ego": 0.08105912208557128, "sim_compute_robot_state-npc0": 0.07397331714630127, "sim_compute_robot_state-npc1": 0.07402107954025268, "sim_compute_robot_state-npc2": 0.07439037164052327, "sim_compute_robot_state-npc3": 0.07406147241592408}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6176088593258378, "sim_physics": 0.21080356518427532, "survival_time": 14.950000000000076, "driven_lanedir": 3.552621186311328, "sim_render-ego": 0.06801529963811238, "in-drivable-lane": 0, "agent_compute-ego": 0.1896040455500285, "deviation-heading": 2.411699302213478, "set_robot_commands": 0.10314570824305216, "deviation-center-line": 0.669401506264004, "driven_lanedir_consec": 3.552621186311328, "sim_compute_sim_state": 0.04207516113917033, "sim_compute_performance-ego": 0.07336221138636272, "sim_compute_robot_state-ego": 0.08105612119038899, "sim_compute_robot_state-npc0": 0.07372759819030762, "sim_compute_robot_state-npc1": 0.07485515038172404, "sim_compute_robot_state-npc2": 0.07465130964914958, "sim_compute_robot_state-npc3": 0.07542889436086019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4599104038365303, "sim_physics": 0.17632683436075847, "survival_time": 14.950000000000076, "driven_lanedir": 2.2420916456906643, "sim_render-ego": 0.06671892881393432, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.18988429148991903, "deviation-heading": 5.699162063969605, "set_robot_commands": 0.10085198481877646, "deviation-center-line": 0.940205325636452, "driven_lanedir_consec": 2.1170319729193263, "sim_compute_sim_state": 0.042087447643280027, "sim_compute_performance-ego": 0.07492113431294758, "sim_compute_robot_state-ego": 0.08027693033218383, "sim_compute_robot_state-npc0": 0.0731946094830831, "sim_compute_robot_state-npc1": 0.07380872329076131, "sim_compute_robot_state-npc2": 0.07337249199549357, "sim_compute_robot_state-npc3": 0.07366467634836833}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.213828337850817, "sim_physics": 0.1864305090904236, "survival_time": 14.950000000000076, "driven_lanedir": 3.1152995146851232, "sim_render-ego": 0.06703760464986165, "in-drivable-lane": 0, "agent_compute-ego": 0.1924246907234192, "deviation-heading": 3.8271145701854663, "set_robot_commands": 0.10495473146438598, "deviation-center-line": 1.0363995200136338, "driven_lanedir_consec": 3.1152995146851232, "sim_compute_sim_state": 0.042247575918833415, "sim_compute_performance-ego": 0.07421987851460775, "sim_compute_robot_state-ego": 0.0814269757270813, "sim_compute_robot_state-npc0": 0.07505246877670288, "sim_compute_robot_state-npc1": 0.07438211679458619, "sim_compute_robot_state-npc2": 0.07478137572606404, "sim_compute_robot_state-npc3": 0.07346221764882406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9737633861025847, "sim_physics": 0.17596924884899243, "survival_time": 9.249999999999996, "driven_lanedir": 1.6386045434392444, "sim_render-ego": 0.06574377626986116, "in-drivable-lane": 0.6999999999999984, "agent_compute-ego": 0.1925611753721495, "deviation-heading": 2.1644874191051224, "set_robot_commands": 0.10551489108317608, "deviation-center-line": 0.4475046471710668, "driven_lanedir_consec": 1.6386045434392444, "sim_compute_sim_state": 0.04163567439929859, "sim_compute_performance-ego": 0.0740145799275991, "sim_compute_robot_state-ego": 0.08180068505776895, "sim_compute_robot_state-npc0": 0.0751545016830032, "sim_compute_robot_state-npc1": 0.0753734691722973, "sim_compute_robot_state-npc2": 0.07380648174801388, "sim_compute_robot_state-npc3": 0.07326707839965821}}
set_robot_commands_max0.10551489108317608
set_robot_commands_mean0.10341931802732449
set_robot_commands_median0.10314570824305216
set_robot_commands_min0.10085198481877646
sim_compute_performance-ego_max0.07492113431294758
sim_compute_performance-ego_mean0.07414412158244366
sim_compute_performance-ego_median0.07420280377070108
sim_compute_performance-ego_min0.07336221138636272
sim_compute_robot_state-ego_max0.08180068505776895
sim_compute_robot_state-ego_mean0.08112396687859887
sim_compute_robot_state-ego_median0.08105912208557128
sim_compute_robot_state-ego_min0.08027693033218383
sim_compute_robot_state-npc0_max0.0751545016830032
sim_compute_robot_state-npc0_mean0.07422049905587962
sim_compute_robot_state-npc0_median0.07397331714630127
sim_compute_robot_state-npc0_min0.0731946094830831
sim_compute_robot_state-npc1_max0.0753734691722973
sim_compute_robot_state-npc1_mean0.0744881078359243
sim_compute_robot_state-npc1_median0.07438211679458619
sim_compute_robot_state-npc1_min0.07380872329076131
sim_compute_robot_state-npc2_max0.07478137572606404
sim_compute_robot_state-npc2_mean0.07420040615184886
sim_compute_robot_state-npc2_median0.07439037164052327
sim_compute_robot_state-npc2_min0.07337249199549357
sim_compute_robot_state-npc3_max0.07542889436086019
sim_compute_robot_state-npc3_mean0.07397686783472697
sim_compute_robot_state-npc3_median0.07366467634836833
sim_compute_robot_state-npc3_min0.07326707839965821
sim_compute_sim_state_max0.04246886094411214
sim_compute_sim_state_mean0.042102944008938895
sim_compute_sim_state_median0.042087447643280027
sim_compute_sim_state_min0.04163567439929859
sim_physics_max0.21080356518427532
sim_physics_mean0.18719298351562777
sim_physics_median0.1864305090904236
sim_physics_min0.17596924884899243
sim_render-ego_max0.06801529963811238
sim_render-ego_mean0.06705151337546271
sim_render-ego_median0.06703760464986165
sim_render-ego_min0.06574377626986116
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.810000000000064
survival_time_min9.249999999999996
No reset possible
220533410jiang pengRL - TH -hhkaido2-LFV-sim-validationstep1-simulationhost-errornoip-172-31-25-98-24700:21:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22053-308410', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22053-308410', 'down']:

   >  Command '['docker-compose', '-p', 'job22053-308410', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
220333397jiang pengRL-TH-shiaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-25-98-24700:58:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.587521570318358
survival_time_median14.950000000000076
deviation-center-line_median0.7858888668943199
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.20324397563934327
agent_compute-ego_mean0.16530282933351317
agent_compute-ego_median0.17682173490524292
agent_compute-ego_min0.13467177267997496
deviation-center-line_max1.241547377665953
deviation-center-line_mean0.7216313266428078
deviation-center-line_min0.10707862518563668
deviation-heading_max7.071985149105531
deviation-heading_mean3.1022584801767477
deviation-heading_median2.75021711739316
deviation-heading_min0.37045205877278664
driven_any_max4.151453746463873
driven_any_mean2.6165489101195054
driven_any_median2.6880721214847387
driven_any_min0.5843345886026792
driven_lanedir_consec_max4.088309075320682
driven_lanedir_consec_mean2.4390666010485744
driven_lanedir_consec_min0.5591027685134207
driven_lanedir_max4.088309075320682
driven_lanedir_mean2.4452862570059968
driven_lanedir_median2.587521570318358
driven_lanedir_min0.5591027685134207
in-drivable-lane_max4.249999999999996
in-drivable-lane_mean0.9300000000000028
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9344828058048589, "sim_physics": 0.11131460405886172, "survival_time": 12.800000000000049, "driven_lanedir": 1.5355003204817352, "sim_render-ego": 0.06264701392501593, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.17762088682502508, "deviation-heading": 6.25083347122875, "set_robot_commands": 0.09609784837812184, "deviation-center-line": 0.6888779437771526, "driven_lanedir_consec": 1.4534666729068475, "sim_compute_sim_state": 0.039312949404120445, "sim_compute_performance-ego": 0.06888494919985533, "sim_compute_robot_state-ego": 0.07583011873066425}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8092564987058544, "sim_physics": 0.1182784636815389, "survival_time": 14.950000000000076, "driven_lanedir": 3.6810027659603217, "sim_render-ego": 0.06777841806411743, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.18963438669840496, "deviation-heading": 2.3879231605595654, "set_robot_commands": 0.10462818066279092, "deviation-center-line": 0.9136621314215104, "driven_lanedir_consec": 3.6810027659603217, "sim_compute_sim_state": 0.04216038703918457, "sim_compute_performance-ego": 0.07421852032343547, "sim_compute_robot_state-ego": 0.08137588818868001}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3665190430801657, "sim_physics": 0.12655502973600877, "survival_time": 4.299999999999993, "driven_lanedir": 1.225907898577684, "sim_render-ego": 0.06747301234755405, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.18220063974690992, "deviation-heading": 0.8414081094995131, "set_robot_commands": 0.1005427504694739, "deviation-center-line": 0.27263607478505886, "driven_lanedir_consec": 1.225907898577684, "sim_compute_sim_state": 0.0425046820973241, "sim_compute_performance-ego": 0.07684738968693933, "sim_compute_robot_state-ego": 0.07794213017752004}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6065162562211617, "sim_physics": 0.11716188585138046, "survival_time": 8.649999999999988, "driven_lanedir": 1.293494260500215, "sim_render-ego": 0.06353557316554075, "in-drivable-lane": 4.249999999999996, "agent_compute-ego": 0.1776367860033333, "deviation-heading": 0.6384326421088591, "set_robot_commands": 0.10047345492192086, "deviation-center-line": 0.20658495908403005, "driven_lanedir_consec": 1.293494260500215, "sim_compute_sim_state": 0.04196304668580866, "sim_compute_performance-ego": 0.07417442481641824, "sim_compute_robot_state-ego": 0.07744612032278425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2445397250015944, "sim_physics": 0.12339991092681885, "survival_time": 14.950000000000076, "driven_lanedir": 2.023882936274182, "sim_render-ego": 0.06714134693145751, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.20324397563934327, "deviation-heading": 7.071985149105531, "set_robot_commands": 0.10379162470499674, "deviation-center-line": 0.5655973315416546, "driven_lanedir_consec": 2.012621744487736, "sim_compute_sim_state": 0.04231700976689656, "sim_compute_performance-ego": 0.07637276967366537, "sim_compute_robot_state-ego": 0.08705077489217122}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.334409222996135, "sim_physics": 0.12125200907389325, "survival_time": 14.950000000000076, "driven_lanedir": 3.1642083661373364, "sim_render-ego": 0.06406582355499267, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.17682173490524292, "deviation-heading": 2.75021711739316, "set_robot_commands": 0.1015057905515035, "deviation-center-line": 1.1213341589204266, "driven_lanedir_consec": 3.1642083661373364, "sim_compute_sim_state": 0.04122875372568766, "sim_compute_performance-ego": 0.07504116376241048, "sim_compute_robot_state-ego": 0.07898723045984904}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.694164930908004, "sim_physics": 0.1249418330192566, "survival_time": 14.950000000000076, "driven_lanedir": 2.6114921016154424, "sim_render-ego": 0.06605112314224243, "in-drivable-lane": 0, "agent_compute-ego": 0.17983638525009157, "deviation-heading": 3.5068225382075555, "set_robot_commands": 0.09980441570281982, "deviation-center-line": 0.7858888668943199, "driven_lanedir_consec": 2.6114921016154424, "sim_compute_sim_state": 0.0410329786936442, "sim_compute_performance-ego": 0.07419214884440105, "sim_compute_robot_state-ego": 0.07704314947128296}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.951876372918241, "sim_physics": 0.13369003772735596, "survival_time": 14.950000000000076, "driven_lanedir": 1.554409332231617, "sim_render-ego": 0.06786174376805623, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.1961675516764323, "deviation-heading": 6.369645564010951, "set_robot_commands": 0.10377514123916626, "deviation-center-line": 1.241547377665953, "driven_lanedir_consec": 1.554409332231617, "sim_compute_sim_state": 0.04287583669026693, "sim_compute_performance-ego": 0.07647014061609904, "sim_compute_robot_state-ego": 0.08670267422993978}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.477551190932583, "sim_physics": 0.08610780316014444, "survival_time": 7.7499999999999805, "driven_lanedir": 2.3808848392157773, "sim_render-ego": 0.049021905468356226, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.13467177267997496, "deviation-heading": 1.0794932338361498, "set_robot_commands": 0.07227320363444667, "deviation-center-line": 0.2779474707495926, "driven_lanedir_consec": 2.3808848392157773, "sim_compute_sim_state": 0.03254764926049017, "sim_compute_performance-ego": 0.05629054038755355, "sim_compute_robot_state-ego": 0.05766635402556389}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.022470387250509, "sim_physics": 0.08712589104970296, "survival_time": 14.950000000000076, "driven_lanedir": 2.793280605876886, "sim_render-ego": 0.05039700428644816, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.13798319657643637, "deviation-heading": 2.5403815151300173, "set_robot_commands": 0.07448871850967408, "deviation-center-line": 0.865388818540996, "driven_lanedir_consec": 2.793280605876886, "sim_compute_sim_state": 0.03257162094116211, "sim_compute_performance-ego": 0.05529180367787679, "sim_compute_robot_state-ego": 0.05834012667338053}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.303075846021778, "sim_physics": 0.08993508736292521, "survival_time": 14.950000000000076, "driven_lanedir": 3.216499281760903, "sim_render-ego": 0.04930716991424561, "in-drivable-lane": 0, "agent_compute-ego": 0.13820693095525105, "deviation-heading": 3.1344515495985688, "set_robot_commands": 0.07384857575098673, "deviation-center-line": 0.9566655512758564, "driven_lanedir_consec": 3.216499281760903, "sim_compute_sim_state": 0.03268439531326294, "sim_compute_performance-ego": 0.05534936189651489, "sim_compute_robot_state-ego": 0.0578100848197937}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.6880721214847387, "sim_physics": 0.08934972047805786, "survival_time": 14.950000000000076, "driven_lanedir": 2.587521570318358, "sim_render-ego": 0.04913323720296224, "in-drivable-lane": 0, "agent_compute-ego": 0.1355832576751709, "deviation-heading": 3.597466743327468, "set_robot_commands": 0.07294434785842896, "deviation-center-line": 1.2239309985719986, "driven_lanedir_consec": 2.587521570318358, "sim_compute_sim_state": 0.03222354729970296, "sim_compute_performance-ego": 0.05430604616800944, "sim_compute_robot_state-ego": 0.056517442067464195}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.5843345886026792, "sim_physics": 0.10335205495357512, "survival_time": 1.6000000000000008, "driven_lanedir": 0.5591027685134207, "sim_render-ego": 0.05995167791843414, "in-drivable-lane": 0, "agent_compute-ego": 0.17618288099765778, "deviation-heading": 0.37045205877278664, "set_robot_commands": 0.09302157163619997, "deviation-center-line": 0.10707862518563668, "driven_lanedir_consec": 0.5591027685134207, "sim_compute_sim_state": 0.0395565927028656, "sim_compute_performance-ego": 0.06707625091075897, "sim_compute_robot_state-ego": 0.07065895199775696}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.151453746463873, "sim_physics": 0.08283527771631877, "survival_time": 14.950000000000076, "driven_lanedir": 4.088309075320682, "sim_render-ego": 0.04862961133321126, "in-drivable-lane": 0, "agent_compute-ego": 0.13476049820582073, "deviation-heading": 2.437757169176842, "set_robot_commands": 0.07353519598642985, "deviation-center-line": 0.6460706317975551, "driven_lanedir_consec": 4.088309075320682, "sim_compute_sim_state": 0.03170078674952189, "sim_compute_performance-ego": 0.05359811226526896, "sim_compute_robot_state-ego": 0.0571161683400472}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.079510915400405, "sim_physics": 0.08897622426350911, "survival_time": 14.950000000000076, "driven_lanedir": 3.963797732305389, "sim_render-ego": 0.05015342950820923, "in-drivable-lane": 0, "agent_compute-ego": 0.13899155616760253, "deviation-heading": 3.556607180695506, "set_robot_commands": 0.07602832158406575, "deviation-center-line": 0.9512589594303776, "driven_lanedir_consec": 3.963797732305389, "sim_compute_sim_state": 0.032166968981424966, "sim_compute_performance-ego": 0.05577219724655151, "sim_compute_robot_state-ego": 0.05901548385620117}}
set_robot_commands_max0.10462818066279092
set_robot_commands_mean0.08978394277273506
set_robot_commands_median0.09609784837812184
set_robot_commands_min0.07227320363444667
sim_compute_performance-ego_max0.07684738968693933
sim_compute_performance-ego_mean0.06625905463171723
sim_compute_performance-ego_median0.06888494919985533
sim_compute_performance-ego_min0.05359811226526896
sim_compute_robot_state-ego_max0.08705077489217122
sim_compute_robot_state-ego_mean0.07063351321687329
sim_compute_robot_state-ego_median0.07583011873066425
sim_compute_robot_state-ego_min0.056517442067464195
sim_compute_sim_state_max0.04287583669026693
sim_compute_sim_state_mean0.03778981369009092
sim_compute_sim_state_median0.0395565927028656
sim_compute_sim_state_min0.03170078674952189
sim_physics_max0.13369003772735596
sim_physics_mean0.10695172220395652
sim_physics_median0.11131460405886172
sim_physics_min0.08283527771631877
sim_render-ego_max0.06786174376805623
sim_render-ego_mean0.05887653936872293
sim_render-ego_median0.06264701392501593
sim_render-ego_min0.04862961133321126
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.306666666666718
survival_time_min1.6000000000000008
No reset possible
220213382jiang pengRL-TH-shiaido2-LFV-sim-testingstep1-simulationhost-errornoip-172-31-25-98-24701:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22021-250940', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22021-250940', 'down']:

   >  Command '['docker-compose', '-p', 'job22021-250940', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
220163392jiang pengRL-TH-shiaido2-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-25-98-24700:26:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22016-492904', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22016-492904', 'down']:

   >  Command '['docker-compose', '-p', 'job22016-492904', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
220123388Liam Paull 🇨🇦duckietown lane following demoaido2-LF-sim-testingstep1-simulationfailednoip-172-31-25-98-24700:02:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
220063387jiang pengRL - TH -hhkaido2-LFV-sim-testingstep1-simulationhost-errornoip-172-31-25-98-24700:11:44
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22006-933174', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22006-933174', 'down']:

   >  Command '['docker-compose', '-p', 'job22006-933174', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible