Duckietown Challenges Home Challenges Submissions

Evaluator 1300

ID1300
evaluatorip-172-31-40-253-3847
ownerI don't have one 😀
machineip-172-31-40-253
processip-172-31-40-253-3847
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success8 23321
# timeout
# failed1 23683
# error4 23162
# aborted1 23454
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
237503760Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-40-253-38470:26:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0784719073372124
survival_time_median9.700000000000005
deviation-center-line_median0.583110362891347
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2631992999712626
agent_compute-ego_mean0.2517970474771228
agent_compute-ego_median0.2586921041116774
agent_compute-ego_min0.2206054970070168
deviation-center-line_max1.0048645425095442
deviation-center-line_mean0.5862363148504832
deviation-center-line_min0.27296775129615297
deviation-heading_max2.3041595595447433
deviation-heading_mean1.9108819811563464
deviation-heading_median1.9578685097330464
deviation-heading_min1.187351601477849
driven_any_max2.075355301231588
driven_any_mean1.2736023805757026
driven_any_median1.109214448836218
driven_any_min0.5086722131812776
driven_lanedir_consec_max2.053209724700958
driven_lanedir_consec_mean1.160486163009136
driven_lanedir_consec_min0.4720449630306436
driven_lanedir_max2.053209724700958
driven_lanedir_mean1.160486163009136
driven_lanedir_median1.0784719073372124
driven_lanedir_min0.4720449630306436
in-drivable-lane_max2.7000000000000384
in-drivable-lane_mean0.5400000000000077
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5086722131812776, "sim_physics": 0.15921807877811384, "survival_time": 4.049999999999994, "driven_lanedir": 0.4720449630306436, "sim_render-ego": 0.05331638124254015, "in-drivable-lane": 0, "agent_compute-ego": 0.2206054970070168, "deviation-heading": 1.187351601477849, "set_robot_commands": 0.0853724597412863, "deviation-center-line": 0.27296775129615297, "driven_lanedir_consec": 0.4720449630306436, "sim_compute_sim_state": 0.03523095154467924, "sim_compute_performance-ego": 0.06060127858762388, "sim_compute_robot_state-ego": 0.06618822945488824, "sim_compute_robot_state-npc0": 0.06088822270617073, "sim_compute_robot_state-npc1": 0.06129996276196138, "sim_compute_robot_state-npc2": 0.06318708702369973, "sim_compute_robot_state-npc3": 0.06280864609612359}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.075355301231588, "sim_physics": 0.17254042307535808, "survival_time": 14.950000000000076, "driven_lanedir": 2.053209724700958, "sim_render-ego": 0.06495882511138916, "in-drivable-lane": 0, "agent_compute-ego": 0.2631992999712626, "deviation-heading": 1.9578685097330464, "set_robot_commands": 0.09892650127410887, "deviation-center-line": 1.0048645425095442, "driven_lanedir_consec": 2.053209724700958, "sim_compute_sim_state": 0.039872778256734215, "sim_compute_performance-ego": 0.0702991795539856, "sim_compute_robot_state-ego": 0.07774390776952107, "sim_compute_robot_state-npc0": 0.07242823123931885, "sim_compute_robot_state-npc1": 0.0707525928815206, "sim_compute_robot_state-npc2": 0.07047090609868367, "sim_compute_robot_state-npc3": 0.07072603940963745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0594455331375507, "sim_physics": 0.1709532422839471, "survival_time": 7.94999999999998, "driven_lanedir": 0.9956735042689502, "sim_render-ego": 0.06602687955652393, "in-drivable-lane": 0, "agent_compute-ego": 0.2586921041116774, "deviation-heading": 2.3041595595447433, "set_robot_commands": 0.09733743337715196, "deviation-center-line": 0.583110362891347, "driven_lanedir_consec": 0.9956735042689502, "sim_compute_sim_state": 0.04059388952435187, "sim_compute_performance-ego": 0.07054622218293964, "sim_compute_robot_state-ego": 0.07659660345353421, "sim_compute_robot_state-npc0": 0.070886123105415, "sim_compute_robot_state-npc1": 0.07021084971397927, "sim_compute_robot_state-npc2": 0.06915025741049328, "sim_compute_robot_state-npc3": 0.07085771530679187}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6153244064918788, "sim_physics": 0.16244792178332568, "survival_time": 12.550000000000043, "driven_lanedir": 1.203030715707916, "sim_render-ego": 0.06306203617992628, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.2628714895818338, "deviation-heading": 2.2483305996102327, "set_robot_commands": 0.09716525875714672, "deviation-center-line": 0.6638259000856481, "driven_lanedir_consec": 1.203030715707916, "sim_compute_sim_state": 0.03987383272543371, "sim_compute_performance-ego": 0.06951016258908457, "sim_compute_robot_state-ego": 0.07635468030830779, "sim_compute_robot_state-npc0": 0.07140225433258421, "sim_compute_robot_state-npc1": 0.06995861368825236, "sim_compute_robot_state-npc2": 0.06997828559571528, "sim_compute_robot_state-npc3": 0.06964351646453736}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.109214448836218, "sim_physics": 0.16659812951825329, "survival_time": 9.700000000000005, "driven_lanedir": 1.0784719073372124, "sim_render-ego": 0.06313981960729226, "in-drivable-lane": 0, "agent_compute-ego": 0.2536168467138231, "deviation-heading": 1.8566996354158596, "set_robot_commands": 0.09605063482658152, "deviation-center-line": 0.4064130174697237, "driven_lanedir_consec": 1.0784719073372124, "sim_compute_sim_state": 0.03892563913286347, "sim_compute_performance-ego": 0.0690227132482627, "sim_compute_robot_state-ego": 0.07474204191227549, "sim_compute_robot_state-npc0": 0.06999771865372806, "sim_compute_robot_state-npc1": 0.07066537793149653, "sim_compute_robot_state-npc2": 0.0727755372057256, "sim_compute_robot_state-npc3": 0.06925670756507166}}
set_robot_commands_max0.09892650127410887
set_robot_commands_mean0.09497045759525506
set_robot_commands_median0.09716525875714672
set_robot_commands_min0.0853724597412863
sim_compute_performance-ego_max0.07054622218293964
sim_compute_performance-ego_mean0.06799591123237927
sim_compute_performance-ego_median0.06951016258908457
sim_compute_performance-ego_min0.06060127858762388
sim_compute_robot_state-ego_max0.07774390776952107
sim_compute_robot_state-ego_mean0.07432509257970536
sim_compute_robot_state-ego_median0.07635468030830779
sim_compute_robot_state-ego_min0.06618822945488824
sim_compute_robot_state-npc0_max0.07242823123931885
sim_compute_robot_state-npc0_mean0.06912051000744338
sim_compute_robot_state-npc0_median0.070886123105415
sim_compute_robot_state-npc0_min0.06088822270617073
sim_compute_robot_state-npc1_max0.0707525928815206
sim_compute_robot_state-npc1_mean0.06857747939544202
sim_compute_robot_state-npc1_median0.07021084971397927
sim_compute_robot_state-npc1_min0.06129996276196138
sim_compute_robot_state-npc2_max0.0727755372057256
sim_compute_robot_state-npc2_mean0.06911241466686352
sim_compute_robot_state-npc2_median0.06997828559571528
sim_compute_robot_state-npc2_min0.06318708702369973
sim_compute_robot_state-npc3_max0.07085771530679187
sim_compute_robot_state-npc3_mean0.06865852496843239
sim_compute_robot_state-npc3_median0.06964351646453736
sim_compute_robot_state-npc3_min0.06280864609612359
sim_compute_sim_state_max0.04059388952435187
sim_compute_sim_state_mean0.0388994182368125
sim_compute_sim_state_median0.039872778256734215
sim_compute_sim_state_min0.03523095154467924
sim_physics_max0.17254042307535808
sim_physics_mean0.16635155908779958
sim_physics_median0.16659812951825329
sim_physics_min0.15921807877811384
sim_render-ego_max0.06602687955652393
sim_render-ego_mean0.06210078833953436
sim_render-ego_median0.06313981960729226
sim_render-ego_min0.05331638124254015
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.84000000000002
survival_time_min4.049999999999994
No reset possible
237413749sebastian glatzaido2-LFV-sim-testingstep1-simulationsuccessyesip-172-31-40-253-38470:12:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.09514439105987547
agent_compute-ego_mean0.09060751436777892
agent_compute-ego_median0.09021308245482268
agent_compute-ego_min0.08942995071411133
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08748391381016483, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03752420566700123, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.09025235087783248, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05577951448935049, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02332131509427671, "sim_compute_performance-ego": 0.040444767033612286, "sim_compute_robot_state-ego": 0.04233121871948242, "sim_compute_robot_state-npc0": 0.041774891040943285, "sim_compute_robot_state-npc1": 0.040584546548348886, "sim_compute_robot_state-npc2": 0.040428629627934205, "sim_compute_robot_state-npc3": 0.0404201657683761}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.0981775951385498, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.03592100143432617, "in-drivable-lane": 0, "agent_compute-ego": 0.08942995071411133, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.05541240692138672, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.023043909072875977, "sim_compute_performance-ego": 0.03880617141723633, "sim_compute_robot_state-ego": 0.04225399971008301, "sim_compute_robot_state-npc0": 0.04153904914855957, "sim_compute_robot_state-npc1": 0.040848388671875, "sim_compute_robot_state-npc2": 0.03966206550598145, "sim_compute_robot_state-npc3": 0.04017415046691895}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.09457143043216906, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.03650746220036557, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09054377204493472, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.05556058256249679, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.023163610383083944, "sim_compute_performance-ego": 0.0403082527612385, "sim_compute_robot_state-ego": 0.0418965220451355, "sim_compute_robot_state-npc0": 0.04117516781154432, "sim_compute_robot_state-npc1": 0.04084874768006174, "sim_compute_robot_state-npc2": 0.04021407428540682, "sim_compute_robot_state-npc3": 0.04007307479256078}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.09552646286879914, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.03683512723898586, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.09067580669741088, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05535458009454269, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.02294215371337118, "sim_compute_performance-ego": 0.03959648216827006, "sim_compute_robot_state-ego": 0.04197724861434744, "sim_compute_robot_state-npc0": 0.04198651675936542, "sim_compute_robot_state-npc1": 0.04054591323755964, "sim_compute_robot_state-npc2": 0.0401321785359443, "sim_compute_robot_state-npc3": 0.04044062578225437}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.09059114967073711, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.03723647764750889, "in-drivable-lane": 0, "agent_compute-ego": 0.09514439105987547, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05560668877192906, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.023453056812286377, "sim_compute_performance-ego": 0.03978008883340018, "sim_compute_robot_state-ego": 0.04237709726606097, "sim_compute_robot_state-npc0": 0.0412551930972508, "sim_compute_robot_state-npc1": 0.04037027699606759, "sim_compute_robot_state-npc2": 0.0399661660194397, "sim_compute_robot_state-npc3": 0.03985844339643206}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08637514820805302, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.036958389812045626, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.09012735773015904, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.055496154008088286, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.02328871797632288, "sim_compute_performance-ego": 0.041944419896161114, "sim_compute_robot_state-ego": 0.04197420455791332, "sim_compute_robot_state-npc0": 0.04122307123961272, "sim_compute_robot_state-npc1": 0.040752940707736544, "sim_compute_robot_state-npc2": 0.04007095760769314, "sim_compute_robot_state-npc3": 0.03985007603963216}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.09105575526202168, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.0367216843145865, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.09021308245482268, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05507029427422418, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.023038387298583984, "sim_compute_performance-ego": 0.040052974665606464, "sim_compute_robot_state-ego": 0.04187914177223488, "sim_compute_robot_state-npc0": 0.04157529053864656, "sim_compute_robot_state-npc1": 0.04035830056225812, "sim_compute_robot_state-npc2": 0.04037393022466589, "sim_compute_robot_state-npc3": 0.040435596748634624}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.10635848575168186, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03675602277119954, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.09115617540147568, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05582051806979709, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.02300056881374783, "sim_compute_performance-ego": 0.040228409237331814, "sim_compute_robot_state-ego": 0.04270912276373969, "sim_compute_robot_state-npc0": 0.04163814650641547, "sim_compute_robot_state-npc1": 0.04096650547451443, "sim_compute_robot_state-npc2": 0.04036630524529351, "sim_compute_robot_state-npc3": 0.040565872192382814}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.0883156216662863, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03691837062006411, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.09026378652323848, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05486440140268077, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.022995658542798912, "sim_compute_performance-ego": 0.04002698608066725, "sim_compute_robot_state-ego": 0.04217061270838198, "sim_compute_robot_state-npc0": 0.0410450437794561, "sim_compute_robot_state-npc1": 0.0412386707637621, "sim_compute_robot_state-npc2": 0.04094730252804964, "sim_compute_robot_state-npc3": 0.040587150532266365}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.09971698760986328, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.04504415512084961, "in-drivable-lane": 0, "agent_compute-ego": 0.09007116794586181, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05503795623779297, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02306151866912842, "sim_compute_performance-ego": 0.042254490852355955, "sim_compute_robot_state-ego": 0.041920838356018064, "sim_compute_robot_state-npc0": 0.041054797172546384, "sim_compute_robot_state-npc1": 0.040208659172058105, "sim_compute_robot_state-npc2": 0.04039183616638184, "sim_compute_robot_state-npc3": 0.03978763580322266}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.10898665189743044, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.037787222862243654, "in-drivable-lane": 0, "agent_compute-ego": 0.09013986587524414, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.055128955841064455, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.02345423698425293, "sim_compute_performance-ego": 0.04016985893249512, "sim_compute_robot_state-ego": 0.04151029586791992, "sim_compute_robot_state-npc0": 0.041510927677154544, "sim_compute_robot_state-npc1": 0.04127770662307739, "sim_compute_robot_state-npc2": 0.040328586101531984, "sim_compute_robot_state-npc3": 0.04024840593338013}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.09234875126888878, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03608061137952303, "in-drivable-lane": 0, "agent_compute-ego": 0.0898680561467221, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05530545586033871, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02278765879179302, "sim_compute_performance-ego": 0.039542976178620994, "sim_compute_robot_state-ego": 0.04179305779306512, "sim_compute_robot_state-npc0": 0.04081004544308311, "sim_compute_robot_state-npc1": 0.04019466199372944, "sim_compute_robot_state-npc2": 0.04045890506945158, "sim_compute_robot_state-npc3": 0.03983122424075478}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08525107383728027, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.03671358585357666, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.08981899261474609, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.054349212646484374, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.023401570320129395, "sim_compute_performance-ego": 0.03927504062652588, "sim_compute_robot_state-ego": 0.04173075675964356, "sim_compute_robot_state-npc0": 0.04141705513000488, "sim_compute_robot_state-npc1": 0.04052660942077637, "sim_compute_robot_state-npc2": 0.04108050346374512, "sim_compute_robot_state-npc3": 0.04014220237731934}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1062504920092496, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.037087451327930794, "in-drivable-lane": 0, "agent_compute-ego": 0.0916083509271795, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.05489619211717085, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02337890321558172, "sim_compute_performance-ego": 0.040123159235174, "sim_compute_robot_state-ego": 0.04211744395169345, "sim_compute_robot_state-npc0": 0.04152271964333274, "sim_compute_robot_state-npc1": 0.04062561555342241, "sim_compute_robot_state-npc2": 0.040090571750294075, "sim_compute_robot_state-npc3": 0.03974735736846924}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10130530474137286, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.03745815218711386, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.0897996085030692, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.055346284593854635, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.022533864391093353, "sim_compute_performance-ego": 0.040027594079776685, "sim_compute_robot_state-ego": 0.042368883989295184, "sim_compute_robot_state-npc0": 0.04158479340222417, "sim_compute_robot_state-npc1": 0.04063973621446259, "sim_compute_robot_state-npc2": 0.03994781630379813, "sim_compute_robot_state-npc3": 0.040493590491158624}}
set_robot_commands_max0.05582051806979709
set_robot_commands_mean0.055268613192746806
set_robot_commands_median0.055346284593854635
set_robot_commands_min0.054349212646484374
sim_compute_performance-ego_max0.042254490852355955
sim_compute_performance-ego_mean0.040172111466564846
sim_compute_performance-ego_median0.040052974665606464
sim_compute_performance-ego_min0.03880617141723633
sim_compute_robot_state-ego_max0.04270912276373969
sim_compute_robot_state-ego_mean0.04206736299166763
sim_compute_robot_state-ego_median0.04197724861434744
sim_compute_robot_state-ego_min0.04151029586791992
sim_compute_robot_state-npc0_max0.04198651675936542
sim_compute_robot_state-npc0_mean0.041407513892676016
sim_compute_robot_state-npc0_median0.041510927677154544
sim_compute_robot_state-npc0_min0.04081004544308311
sim_compute_robot_state-npc1_max0.04127770662307739
sim_compute_robot_state-npc1_mean0.04066581864131402
sim_compute_robot_state-npc1_median0.04062561555342241
sim_compute_robot_state-npc1_min0.04019466199372944
sim_compute_robot_state-npc2_max0.04108050346374512
sim_compute_robot_state-npc2_mean0.04029732189570743
sim_compute_robot_state-npc2_median0.040328586101531984
sim_compute_robot_state-npc2_min0.03966206550598145
sim_compute_robot_state-npc3_max0.040587150532266365
sim_compute_robot_state-npc3_mean0.040177038128917535
sim_compute_robot_state-npc3_median0.04017415046691895
sim_compute_robot_state-npc3_min0.03974735736846924
sim_compute_sim_state_max0.02345423698425293
sim_compute_sim_state_mean0.02312434200528845
sim_compute_sim_state_median0.02306151866912842
sim_compute_sim_state_min0.022533864391093353
sim_physics_max0.10898665189743044
sim_physics_mean0.09548765494483652
sim_physics_median0.09457143043216906
sim_physics_min0.08525107383728027
sim_render-ego_max0.04504415512084961
sim_render-ego_mean0.03743666136248807
sim_render-ego_median0.03691837062006411
sim_render-ego_min0.03592100143432617
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
237143740jiang pengLF sim test - whaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-40-253-38470:13:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2680825948255388
survival_time_median6.999999999999983
deviation-center-line_median0.4036830621352199
in-drivable-lane_median1.5000000000000062


other stats
agent_compute-ego_max0.10107710659503936
agent_compute-ego_mean0.10044021550246648
agent_compute-ego_median0.10067240851266045
agent_compute-ego_min0.0995094100634257
deviation-center-line_max1.308331987214011
deviation-center-line_mean0.6972254173307504
deviation-center-line_min0.20950118463033576
deviation-heading_max4.5969498233482575
deviation-heading_mean2.010237308221182
deviation-heading_median1.892141705539839
deviation-heading_min0.33994119971330583
driven_any_max5.199519768748244
driven_any_mean2.51269819192411
driven_any_median1.6411861839802668
driven_any_min1.063437507534733
driven_lanedir_consec_max4.652405255926178
driven_lanedir_consec_mean2.0198113231986587
driven_lanedir_consec_min0.5727761043013953
driven_lanedir_max4.652405255926178
driven_lanedir_mean2.0220034311216644
driven_lanedir_median1.2790431344405675
driven_lanedir_min0.5727761043013953
in-drivable-lane_max5.099999999999982
in-drivable-lane_mean2.069999999999999
in-drivable-lane_min0.7499999999999973
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.063437507534733, "sim_physics": 0.08189107860837663, "survival_time": 6.999999999999983, "driven_lanedir": 0.5727761043013953, "sim_render-ego": 0.03602158171789987, "in-drivable-lane": 5.099999999999982, "agent_compute-ego": 0.10067240851266045, "deviation-heading": 0.33994119971330583, "set_robot_commands": 0.05622274875640869, "deviation-center-line": 0.20950118463033576, "driven_lanedir_consec": 0.5727761043013953, "sim_compute_sim_state": 0.022980138233729772, "sim_compute_performance-ego": 0.04000005892344883, "sim_compute_robot_state-ego": 0.04173712730407715, "sim_compute_robot_state-npc0": 0.04093869243349347, "sim_compute_robot_state-npc1": 0.04012874705450875, "sim_compute_robot_state-npc2": 0.0398763826915196, "sim_compute_robot_state-npc3": 0.04009952204568046}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.199519768748244, "sim_physics": 0.0881436276435852, "survival_time": 14.950000000000076, "driven_lanedir": 4.652405255926178, "sim_render-ego": 0.03625224510828654, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.10101362546284992, "deviation-heading": 2.5813805813860555, "set_robot_commands": 0.05822129329045614, "deviation-center-line": 1.308331987214011, "driven_lanedir_consec": 4.652405255926178, "sim_compute_sim_state": 0.022829655011494955, "sim_compute_performance-ego": 0.039620129267374675, "sim_compute_robot_state-ego": 0.041133146286010745, "sim_compute_robot_state-npc0": 0.040894046624501544, "sim_compute_robot_state-npc1": 0.03995526870091756, "sim_compute_robot_state-npc2": 0.03976868391036987, "sim_compute_robot_state-npc3": 0.039664711157480874}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.610185720421281, "sim_physics": 0.0922094076871872, "survival_time": 3.999999999999994, "driven_lanedir": 1.2653212214549727, "sim_render-ego": 0.03626855611801147, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.10107710659503936, "deviation-heading": 0.6407732311184526, "set_robot_commands": 0.0554614007472992, "deviation-center-line": 0.29305616254275557, "driven_lanedir_consec": 1.2653212214549727, "sim_compute_sim_state": 0.023196595907211303, "sim_compute_performance-ego": 0.0398299902677536, "sim_compute_robot_state-ego": 0.0412327766418457, "sim_compute_robot_state-npc0": 0.04110535085201263, "sim_compute_robot_state-npc1": 0.04060029685497284, "sim_compute_robot_state-npc2": 0.03999173939228058, "sim_compute_robot_state-npc3": 0.04017433226108551}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6411861839802668, "sim_physics": 0.08639048139254252, "survival_time": 5.999999999999987, "driven_lanedir": 1.2790431344405675, "sim_render-ego": 0.035730590422948204, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.0995094100634257, "deviation-heading": 1.892141705539839, "set_robot_commands": 0.05609984000523885, "deviation-center-line": 0.4036830621352199, "driven_lanedir_consec": 1.2680825948255388, "sim_compute_sim_state": 0.022533241907755533, "sim_compute_performance-ego": 0.039103613297144575, "sim_compute_robot_state-ego": 0.04090777039527893, "sim_compute_robot_state-npc0": 0.04031384785970052, "sim_compute_robot_state-npc1": 0.03964723149935404, "sim_compute_robot_state-npc2": 0.039785073200861616, "sim_compute_robot_state-npc3": 0.03908820748329163}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.049161778936024, "sim_physics": 0.08222603877385458, "survival_time": 14.950000000000076, "driven_lanedir": 2.3404714394852077, "sim_render-ego": 0.03577154556910197, "in-drivable-lane": 1.5000000000000062, "agent_compute-ego": 0.09992852687835692, "deviation-heading": 4.5969498233482575, "set_robot_commands": 0.05537312746047974, "deviation-center-line": 1.27155469013143, "driven_lanedir_consec": 2.3404714394852077, "sim_compute_sim_state": 0.02266944408416748, "sim_compute_performance-ego": 0.03907036383946737, "sim_compute_robot_state-ego": 0.041365419228871665, "sim_compute_robot_state-npc0": 0.04028188784917196, "sim_compute_robot_state-npc1": 0.039699108600616456, "sim_compute_robot_state-npc2": 0.0394242246945699, "sim_compute_robot_state-npc3": 0.039424532254536945}}
set_robot_commands_max0.05822129329045614
set_robot_commands_mean0.05627568205197653
set_robot_commands_median0.05609984000523885
set_robot_commands_min0.05537312746047974
sim_compute_performance-ego_max0.04000005892344883
sim_compute_performance-ego_mean0.03952483111903781
sim_compute_performance-ego_median0.039620129267374675
sim_compute_performance-ego_min0.03907036383946737
sim_compute_robot_state-ego_max0.04173712730407715
sim_compute_robot_state-ego_mean0.04127524797121683
sim_compute_robot_state-ego_median0.0412327766418457
sim_compute_robot_state-ego_min0.04090777039527893
sim_compute_robot_state-npc0_max0.04110535085201263
sim_compute_robot_state-npc0_mean0.04070676512377602
sim_compute_robot_state-npc0_median0.040894046624501544
sim_compute_robot_state-npc0_min0.04028188784917196
sim_compute_robot_state-npc1_max0.04060029685497284
sim_compute_robot_state-npc1_mean0.04000613054207393
sim_compute_robot_state-npc1_median0.03995526870091756
sim_compute_robot_state-npc1_min0.03964723149935404
sim_compute_robot_state-npc2_max0.03999173939228058
sim_compute_robot_state-npc2_mean0.03976922077792032
sim_compute_robot_state-npc2_median0.039785073200861616
sim_compute_robot_state-npc2_min0.0394242246945699
sim_compute_robot_state-npc3_max0.04017433226108551
sim_compute_robot_state-npc3_mean0.039690261040415085
sim_compute_robot_state-npc3_median0.039664711157480874
sim_compute_robot_state-npc3_min0.03908820748329163
sim_compute_sim_state_max0.023196595907211303
sim_compute_sim_state_mean0.02284181502887181
sim_compute_sim_state_median0.022829655011494955
sim_compute_sim_state_min0.022533241907755533
sim_physics_max0.0922094076871872
sim_physics_mean0.08617212682110922
sim_physics_median0.08639048139254252
sim_physics_min0.08189107860837663
sim_render-ego_max0.03626855611801147
sim_render-ego_mean0.036008903787249615
sim_render-ego_median0.03602158171789987
sim_render-ego_min0.035730590422948204
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.380000000000024
survival_time_min3.999999999999994
No reset possible
237003730jiang pengLF sim test - whaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-40-253-38470:13:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236863723jiang pengSecond test -RGB- TH-jpaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-40-253-38470:12:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12384362556172056
survival_time_median14.950000000000076
deviation-center-line_median0.44968712428343416
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10367570241292318
agent_compute-ego_mean0.10248382086980908
agent_compute-ego_median0.1022684939702352
agent_compute-ego_min0.10192000309626262
deviation-center-line_max0.8955570411533516
deviation-center-line_mean0.506008282026704
deviation-center-line_min0.14766215279886277
deviation-heading_max4.258856738101937
deviation-heading_mean2.581976201641489
deviation-heading_median2.79893897512231
deviation-heading_min0.6848851153488514
driven_any_max0.9727403914838488
driven_any_mean0.4131260690736247
driven_any_median0.15866560527590537
driven_any_min0.0978495400597368
driven_lanedir_consec_max0.9662462913344538
driven_lanedir_consec_mean0.40330875778998954
driven_lanedir_consec_min0.0961501857959215
driven_lanedir_max0.9662462913344538
driven_lanedir_mean0.40330875778998954
driven_lanedir_median0.12384362556172056
driven_lanedir_min0.0961501857959215
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.030000000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.0978495400597368, "sim_physics": 0.0545974866549174, "survival_time": 14.950000000000076, "driven_lanedir": 0.0961501857959215, "sim_render-ego": 0.036753011544545494, "in-drivable-lane": 0, "agent_compute-ego": 0.10367570241292318, "deviation-heading": 3.01318674835583, "set_robot_commands": 0.05502467155456543, "deviation-center-line": 0.8955570411533516, "driven_lanedir_consec": 0.0961501857959215, "sim_compute_sim_state": 0.023402520815531413, "sim_compute_performance-ego": 0.03956474542617798, "sim_compute_robot_state-ego": 0.041250795523325605}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.10206542241109312, "sim_physics": 0.05326637983322144, "survival_time": 14.950000000000076, "driven_lanedir": 0.1008171932334786, "sim_render-ego": 0.036115954717000326, "in-drivable-lane": 0, "agent_compute-ego": 0.1022684939702352, "deviation-heading": 2.154013431278516, "set_robot_commands": 0.05528174956639608, "deviation-center-line": 0.2406555536076634, "driven_lanedir_consec": 0.1008171932334786, "sim_compute_sim_state": 0.023339441617329915, "sim_compute_performance-ego": 0.03952980120976766, "sim_compute_robot_state-ego": 0.041354459126790366}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15866560527590537, "sim_physics": 0.05533323969159808, "survival_time": 1.7500000000000009, "driven_lanedir": 0.12384362556172056, "sim_render-ego": 0.03538871492658343, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.10235740797860282, "deviation-heading": 0.6848851153488514, "set_robot_commands": 0.05469413484845843, "deviation-center-line": 0.14766215279886277, "driven_lanedir_consec": 0.12384362556172056, "sim_compute_sim_state": 0.02359170232500349, "sim_compute_performance-ego": 0.0407703059060233, "sim_compute_robot_state-ego": 0.04114536557878767}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7343093861375396, "sim_physics": 0.055194002787272135, "survival_time": 14.950000000000076, "driven_lanedir": 0.729486493024373, "sim_render-ego": 0.03639833132425944, "in-drivable-lane": 0, "agent_compute-ego": 0.10219749689102171, "deviation-heading": 2.79893897512231, "set_robot_commands": 0.05500343084335327, "deviation-center-line": 0.44968712428343416, "driven_lanedir_consec": 0.729486493024373, "sim_compute_sim_state": 0.023314042886098223, "sim_compute_performance-ego": 0.039305177529652915, "sim_compute_robot_state-ego": 0.041023983160654705}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9727403914838488, "sim_physics": 0.054979663689931235, "survival_time": 14.950000000000076, "driven_lanedir": 0.9662462913344538, "sim_render-ego": 0.03634351889292399, "in-drivable-lane": 0, "agent_compute-ego": 0.10192000309626262, "deviation-heading": 4.258856738101937, "set_robot_commands": 0.05508118391036987, "deviation-center-line": 0.7964795382902085, "driven_lanedir_consec": 0.9662462913344538, "sim_compute_sim_state": 0.02325332005818685, "sim_compute_performance-ego": 0.039422608216603594, "sim_compute_robot_state-ego": 0.041205250422159834}}
set_robot_commands_max0.05528174956639608
set_robot_commands_mean0.05501703414462862
set_robot_commands_median0.05502467155456543
set_robot_commands_min0.05469413484845843
sim_compute_performance-ego_max0.0407703059060233
sim_compute_performance-ego_mean0.03971852765764509
sim_compute_performance-ego_median0.03952980120976766
sim_compute_performance-ego_min0.039305177529652915
sim_compute_robot_state-ego_max0.041354459126790366
sim_compute_robot_state-ego_mean0.04119597076234364
sim_compute_robot_state-ego_median0.041205250422159834
sim_compute_robot_state-ego_min0.041023983160654705
sim_compute_sim_state_max0.02359170232500349
sim_compute_sim_state_mean0.02338020554042998
sim_compute_sim_state_median0.023339441617329915
sim_compute_sim_state_min0.02325332005818685
sim_physics_max0.05533323969159808
sim_physics_mean0.05467415453138806
sim_physics_median0.054979663689931235
sim_physics_min0.05326637983322144
sim_render-ego_max0.036753011544545494
sim_render-ego_mean0.03619990628106253
sim_render-ego_median0.03634351889292399
sim_render-ego_min0.03538871492658343
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.310000000000064
survival_time_min1.7500000000000009
No reset possible
236833722jiang pengLF sim test - whaido2-LF-sim-testingstep1-simulationfailedyesip-172-31-40-253-38470:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 60, in on_received_get_commands
               ||     action = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     if action[0]<1e-2:
               || UnboundLocalError: local variable 'action' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236703714jiang pengfinal test - whaido2-LF-sim-testingstep1-simulationerroryesip-172-31-40-253-38470:20:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235943695Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-40-253-38470:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.38570501583005834
survival_time_median2.7499999999999982
deviation-center-line_median0.1830200250640151
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.08930998715487394
agent_compute-ego_mean0.08801351755843988
agent_compute-ego_median0.08868340106859599
agent_compute-ego_min0.08660580831415512
deviation-center-line_max0.4868109247638323
deviation-center-line_mean0.23367544172047375
deviation-center-line_min0.11241981500944132
deviation-heading_max2.2570729896243744
deviation-heading_mean1.2799310618260402
deviation-heading_median0.9007141503429875
deviation-heading_min0.4273218245473685
driven_any_max1.7152054523730864
driven_any_mean0.7583494004211413
driven_any_median0.6223920953526237
driven_any_min0.3634098801461044
driven_lanedir_consec_max1.1037466669788063
driven_lanedir_consec_mean0.5266538564659718
driven_lanedir_consec_min0.27868395075345886
driven_lanedir_max1.1037466669788063
driven_lanedir_mean0.5462544273542824
driven_lanedir_median0.38570501583005834
driven_lanedir_min0.3431156367839603
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5399999999999985
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6527377780557704, "sim_physics": 0.09486011591824618, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5220180119835756, "sim_render-ego": 0.03764090538024902, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.08930998715487394, "deviation-heading": 0.9007141503429875, "set_robot_commands": 0.05767260464754972, "deviation-center-line": 0.16864171606822467, "driven_lanedir_consec": 0.5220180119835756, "sim_compute_sim_state": 0.02331348332491788, "sim_compute_performance-ego": 0.040728096528486774, "sim_compute_robot_state-ego": 0.04293740879405628, "sim_compute_robot_state-npc0": 0.04207406477494673, "sim_compute_robot_state-npc1": 0.04054034406488592, "sim_compute_robot_state-npc2": 0.040583220395174896, "sim_compute_robot_state-npc3": 0.04070664752613414}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4380017961781212, "sim_physics": 0.09457332246443804, "survival_time": 1.7000000000000008, "driven_lanedir": 0.38570501583005834, "sim_render-ego": 0.03667309003717759, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08660580831415512, "deviation-heading": 0.6368370883593325, "set_robot_commands": 0.05621025842778823, "deviation-center-line": 0.11241981500944132, "driven_lanedir_consec": 0.38570501583005834, "sim_compute_sim_state": 0.023149756824269015, "sim_compute_performance-ego": 0.04042929761550006, "sim_compute_robot_state-ego": 0.042383397326749915, "sim_compute_robot_state-npc0": 0.04287139107199276, "sim_compute_robot_state-npc1": 0.041289020987117994, "sim_compute_robot_state-npc2": 0.040540120180915386, "sim_compute_robot_state-npc3": 0.040253372753367704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3634098801461044, "sim_physics": 0.09803730088311272, "survival_time": 1.850000000000001, "driven_lanedir": 0.3431156367839603, "sim_render-ego": 0.03741579442410856, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.08670350667592641, "deviation-heading": 0.4273218245473685, "set_robot_commands": 0.05557182028486922, "deviation-center-line": 0.1830200250640151, "driven_lanedir_consec": 0.3431156367839603, "sim_compute_sim_state": 0.023157583700644004, "sim_compute_performance-ego": 0.040481032551945864, "sim_compute_robot_state-ego": 0.04291528624457282, "sim_compute_robot_state-npc0": 0.04228154388633934, "sim_compute_robot_state-npc1": 0.04097740070239918, "sim_compute_robot_state-npc2": 0.04066821046777674, "sim_compute_robot_state-npc3": 0.04122836525375779}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7152054523730864, "sim_physics": 0.08862238387538962, "survival_time": 7.299999999999982, "driven_lanedir": 1.1037466669788063, "sim_render-ego": 0.037102473925237786, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08868340106859599, "deviation-heading": 2.2570729896243744, "set_robot_commands": 0.05571769688227405, "deviation-center-line": 0.4868109247638323, "driven_lanedir_consec": 1.1037466669788063, "sim_compute_sim_state": 0.023634703191992356, "sim_compute_performance-ego": 0.04045876574842897, "sim_compute_robot_state-ego": 0.04228884226655307, "sim_compute_robot_state-npc0": 0.04192583201682731, "sim_compute_robot_state-npc1": 0.04103748929010679, "sim_compute_robot_state-npc2": 0.040568704474462224, "sim_compute_robot_state-npc3": 0.04069275725377749}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6223920953526237, "sim_physics": 0.0965369032390082, "survival_time": 3.349999999999996, "driven_lanedir": 0.3766868051950114, "sim_render-ego": 0.03726253224842584, "in-drivable-lane": 0.3999999999999993, "agent_compute-ego": 0.0887648845786479, "deviation-heading": 2.1777092562561373, "set_robot_commands": 0.056640963056194246, "deviation-center-line": 0.21748472769685528, "driven_lanedir_consec": 0.27868395075345886, "sim_compute_sim_state": 0.023236025625200413, "sim_compute_performance-ego": 0.04084755769416468, "sim_compute_robot_state-ego": 0.04229061639131005, "sim_compute_robot_state-npc0": 0.0413450767744833, "sim_compute_robot_state-npc1": 0.040435556155532154, "sim_compute_robot_state-npc2": 0.04037141088229507, "sim_compute_robot_state-npc3": 0.04031317269624169}}
set_robot_commands_max0.05767260464754972
set_robot_commands_mean0.05636266865973509
set_robot_commands_median0.05621025842778823
set_robot_commands_min0.05557182028486922
sim_compute_performance-ego_max0.04084755769416468
sim_compute_performance-ego_mean0.04058895002770527
sim_compute_performance-ego_median0.040481032551945864
sim_compute_performance-ego_min0.04042929761550006
sim_compute_robot_state-ego_max0.04293740879405628
sim_compute_robot_state-ego_mean0.04256311020464843
sim_compute_robot_state-ego_median0.042383397326749915
sim_compute_robot_state-ego_min0.04228884226655307
sim_compute_robot_state-npc0_max0.04287139107199276
sim_compute_robot_state-npc0_mean0.042099581704917885
sim_compute_robot_state-npc0_median0.04207406477494673
sim_compute_robot_state-npc0_min0.0413450767744833
sim_compute_robot_state-npc1_max0.041289020987117994
sim_compute_robot_state-npc1_mean0.04085596224000841
sim_compute_robot_state-npc1_median0.04097740070239918
sim_compute_robot_state-npc1_min0.040435556155532154
sim_compute_robot_state-npc2_max0.04066821046777674
sim_compute_robot_state-npc2_mean0.040546333280124865
sim_compute_robot_state-npc2_median0.040568704474462224
sim_compute_robot_state-npc2_min0.04037141088229507
sim_compute_robot_state-npc3_max0.04122836525375779
sim_compute_robot_state-npc3_mean0.04063886309665576
sim_compute_robot_state-npc3_median0.04069275725377749
sim_compute_robot_state-npc3_min0.040253372753367704
sim_compute_sim_state_max0.023634703191992356
sim_compute_sim_state_mean0.023298310533404733
sim_compute_sim_state_median0.023236025625200413
sim_compute_sim_state_min0.023149756824269015
sim_physics_max0.09803730088311272
sim_physics_mean0.09452600527603897
sim_physics_median0.09486011591824618
sim_physics_min0.08862238387538962
sim_render-ego_max0.03764090538024902
sim_render-ego_mean0.03721895920303976
sim_render-ego_median0.03726253224842584
sim_render-ego_min0.03667309003717759
simulation-passed1
survival_time_max7.299999999999982
survival_time_mean3.389999999999996
survival_time_min1.7000000000000008
No reset possible
234583651FANG MEIYI 🇸🇬testaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-40-253-38470:13:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8874164793480672
survival_time_median12.600000000000044
deviation-center-line_median0.6842255228273263
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13195606281882838
agent_compute-ego_mean0.11412451851020688
agent_compute-ego_median0.1213131129184616
agent_compute-ego_min0.09275409910413954
deviation-center-line_max0.8267650336018489
deviation-center-line_mean0.6247884434850932
deviation-center-line_min0.2424943523562899
deviation-heading_max3.0487774791766435
deviation-heading_mean1.9022308954172975
deviation-heading_median2.0024219416340188
deviation-heading_min0.8181291229215135
driven_any_max3.639865283486979
driven_any_mean2.5740402434858716
driven_any_median2.619807800990891
driven_any_min1.172981649357779
driven_lanedir_consec_max3.616658755239362
driven_lanedir_consec_mean2.36970188436488
driven_lanedir_consec_min1.1532591823184015
driven_lanedir_max3.616658755239362
driven_lanedir_mean2.36970188436488
driven_lanedir_median1.8874164793480672
driven_lanedir_min1.1532591823184015
in-drivable-lane_max2.9000000000000377
in-drivable-lane_mean0.6300000000000082
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.619807800990891, "sim_physics": 0.05963221618107387, "survival_time": 12.600000000000044, "driven_lanedir": 1.8448913073393731, "sim_render-ego": 0.03661983259140499, "in-drivable-lane": 2.9000000000000377, "agent_compute-ego": 0.09275409910413954, "deviation-heading": 3.0487774791766435, "set_robot_commands": 0.05511638664063953, "deviation-center-line": 0.8267650336018489, "driven_lanedir_consec": 1.8448913073393731, "sim_compute_sim_state": 0.023373998346782863, "sim_compute_performance-ego": 0.03952610019653562, "sim_compute_robot_state-ego": 0.04152825238212707}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.639865283486979, "sim_physics": 0.05605815966924032, "survival_time": 14.950000000000076, "driven_lanedir": 3.616658755239362, "sim_render-ego": 0.0367551040649414, "in-drivable-lane": 0, "agent_compute-ego": 0.09292973359425864, "deviation-heading": 1.2762923266136157, "set_robot_commands": 0.05713132460912069, "deviation-center-line": 0.6529553897960417, "driven_lanedir_consec": 3.616658755239362, "sim_compute_sim_state": 0.024109305540720626, "sim_compute_performance-ego": 0.04042894601821899, "sim_compute_robot_state-ego": 0.04201446771621704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.395490148597132, "sim_physics": 0.0763342539469401, "survival_time": 14.950000000000076, "driven_lanedir": 3.3462836975791967, "sim_render-ego": 0.04617169698079427, "in-drivable-lane": 0, "agent_compute-ego": 0.13166958411534627, "deviation-heading": 2.0024219416340188, "set_robot_commands": 0.0691435448328654, "deviation-center-line": 0.7175019188439589, "driven_lanedir_consec": 3.3462836975791967, "sim_compute_sim_state": 0.02934378703435262, "sim_compute_performance-ego": 0.04976915677388509, "sim_compute_robot_state-ego": 0.05306248664855957}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.172981649357779, "sim_physics": 0.07902510366707205, "survival_time": 5.349999999999989, "driven_lanedir": 1.1532591823184015, "sim_render-ego": 0.04785667178786804, "in-drivable-lane": 0, "agent_compute-ego": 0.1213131129184616, "deviation-heading": 0.8181291229215135, "set_robot_commands": 0.07279393606096785, "deviation-center-line": 0.2424943523562899, "driven_lanedir_consec": 1.1532591823184015, "sim_compute_sim_state": 0.030984637893248942, "sim_compute_performance-ego": 0.05424531375136331, "sim_compute_robot_state-ego": 0.054710655568916106}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0420563349965772, "sim_physics": 0.08299718656037983, "survival_time": 9.5, "driven_lanedir": 1.8874164793480672, "sim_render-ego": 0.05058938704038921, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.13195606281882838, "deviation-heading": 2.365533606740696, "set_robot_commands": 0.07868105612303081, "deviation-center-line": 0.6842255228273263, "driven_lanedir_consec": 1.8874164793480672, "sim_compute_sim_state": 0.03192770732076545, "sim_compute_performance-ego": 0.05530772711101331, "sim_compute_robot_state-ego": 0.05888144342522872}}
set_robot_commands_max0.07868105612303081
set_robot_commands_mean0.06657324965332485
set_robot_commands_median0.0691435448328654
set_robot_commands_min0.05511638664063953
sim_compute_performance-ego_max0.05530772711101331
sim_compute_performance-ego_mean0.047855448770203264
sim_compute_performance-ego_median0.04976915677388509
sim_compute_performance-ego_min0.03952610019653562
sim_compute_robot_state-ego_max0.05888144342522872
sim_compute_robot_state-ego_mean0.050039461148209695
sim_compute_robot_state-ego_median0.05306248664855957
sim_compute_robot_state-ego_min0.04152825238212707
sim_compute_sim_state_max0.03192770732076545
sim_compute_sim_state_mean0.0279478872271741
sim_compute_sim_state_median0.02934378703435262
sim_compute_sim_state_min0.023373998346782863
sim_physics_max0.08299718656037983
sim_physics_mean0.07080938400494123
sim_physics_median0.0763342539469401
sim_physics_min0.05605815966924032
sim_render-ego_max0.05058938704038921
sim_render-ego_mean0.04359853849307958
sim_render-ego_median0.04617169698079427
sim_render-ego_min0.03661983259140499
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.470000000000038
survival_time_min5.349999999999989
No reset possible
234543648Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationabortedyesip-172-31-40-253-38470:13:15
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
233243598Victor Adolfo Romero Cano 🇨🇴aido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-40-253-38470:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1636180111340114
agent_compute-ego_mean0.15548824175908274
agent_compute-ego_median0.15149415293826332
agent_compute-ego_min0.1499622344970703
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17393668051119204, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06465643423574942, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16225831596939652, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09827004538642035, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03938384409304018, "sim_compute_performance-ego": 0.06887352466583252, "sim_compute_robot_state-ego": 0.07642809549967448, "sim_compute_robot_state-npc0": 0.06765392974570945, "sim_compute_robot_state-npc1": 0.06832265853881836, "sim_compute_robot_state-npc2": 0.07012453344133165, "sim_compute_robot_state-npc3": 0.07100137074788411}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.17327096939086914, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06263805389404296, "in-drivable-lane": 0, "agent_compute-ego": 0.1499622344970703, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09258023262023926, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.037319364547729494, "sim_compute_performance-ego": 0.06942743301391602, "sim_compute_robot_state-ego": 0.06968855857849121, "sim_compute_robot_state-npc0": 0.06899770736694336, "sim_compute_robot_state-npc1": 0.06941263198852539, "sim_compute_robot_state-npc2": 0.06937885284423828, "sim_compute_robot_state-npc3": 0.06940648078918457}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17156648949572914, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05980373370020013, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1501084942566721, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09378794619911596, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03906741895173725, "sim_compute_performance-ego": 0.06440149169219167, "sim_compute_robot_state-ego": 0.07138939280258982, "sim_compute_robot_state-npc0": 0.06736151481929578, "sim_compute_robot_state-npc1": 0.06616758045397307, "sim_compute_robot_state-npc2": 0.06731074734737999, "sim_compute_robot_state-npc3": 0.06791826925779644}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1879996680006196, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06025430220591871, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15149415293826332, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09718008886409712, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04088437104526954, "sim_compute_performance-ego": 0.06881147698511052, "sim_compute_robot_state-ego": 0.07447367378428013, "sim_compute_robot_state-npc0": 0.06951101822189137, "sim_compute_robot_state-npc1": 0.06808224509033976, "sim_compute_robot_state-npc2": 0.0681146338016172, "sim_compute_robot_state-npc3": 0.06964153579518764}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1737396206174578, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06514853239059448, "in-drivable-lane": 0, "agent_compute-ego": 0.1636180111340114, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0961583001273019, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03866051776068551, "sim_compute_performance-ego": 0.07107406854629517, "sim_compute_robot_state-ego": 0.0726250410079956, "sim_compute_robot_state-npc0": 0.07096328054155622, "sim_compute_robot_state-npc1": 0.07279522929872785, "sim_compute_robot_state-npc2": 0.07091809170586723, "sim_compute_robot_state-npc3": 0.0687963536807469}}
set_robot_commands_max0.09827004538642035
set_robot_commands_mean0.0955953226394349
set_robot_commands_median0.0961583001273019
set_robot_commands_min0.09258023262023926
sim_compute_performance-ego_max0.07107406854629517
sim_compute_performance-ego_mean0.06851759898066918
sim_compute_performance-ego_median0.06887352466583252
sim_compute_performance-ego_min0.06440149169219167
sim_compute_robot_state-ego_max0.07642809549967448
sim_compute_robot_state-ego_mean0.07292095233460624
sim_compute_robot_state-ego_median0.0726250410079956
sim_compute_robot_state-ego_min0.06968855857849121
sim_compute_robot_state-npc0_max0.07096328054155622
sim_compute_robot_state-npc0_mean0.06889749013907924
sim_compute_robot_state-npc0_median0.06899770736694336
sim_compute_robot_state-npc0_min0.06736151481929578
sim_compute_robot_state-npc1_max0.07279522929872785
sim_compute_robot_state-npc1_mean0.06895606907407689
sim_compute_robot_state-npc1_median0.06832265853881836
sim_compute_robot_state-npc1_min0.06616758045397307
sim_compute_robot_state-npc2_max0.07091809170586723
sim_compute_robot_state-npc2_mean0.06916937182808687
sim_compute_robot_state-npc2_median0.06937885284423828
sim_compute_robot_state-npc2_min0.06731074734737999
sim_compute_robot_state-npc3_max0.07100137074788411
sim_compute_robot_state-npc3_mean0.06935280205415992
sim_compute_robot_state-npc3_median0.06940648078918457
sim_compute_robot_state-npc3_min0.06791826925779644
sim_compute_sim_state_max0.04088437104526954
sim_compute_sim_state_mean0.0390631032796924
sim_compute_sim_state_median0.03906741895173725
sim_compute_sim_state_min0.037319364547729494
sim_physics_max0.1879996680006196
sim_physics_mean0.17610268560317355
sim_physics_median0.1737396206174578
sim_physics_min0.17156648949572914
sim_render-ego_max0.06514853239059448
sim_render-ego_mean0.06250021128530114
sim_render-ego_median0.06263805389404296
sim_render-ego_min0.05980373370020013
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
233213592Victor Adolfo Romero Cano 🇨🇴PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-40-253-38470:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.09793558761413096
error_L20.014616395845197337


No reset possible
232903507Bea Baselines 🐤challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryesip-172-31-40-253-38470:10:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
231623563Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-40-253-38470:01:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible