Duckietown Challenges Home Challenges Submissions

Evaluator 1723

ID1723
evaluatorp-1
ownerI don't have one 😀
machinec7fdef542ed7
processp-1
versiond-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success9 32935
# timeout
# failed2 32966
# error8 32926
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
329966653Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329956652Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido3-off-LF-sim-validationstep1-simulationerroryesp-10:02:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329926651Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329916650Anthony Courchesne 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:13:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8876758055083984
survival_time_median12.200000000000038
deviation-center-line_median0.7790546600998602
in-drivable-lane_median0


other stats
agent_compute-ego_max0.031459661240273336
agent_compute-ego_mean0.03116057245856842
agent_compute-ego_median0.031052863526487062
agent_compute-ego_min0.03098400274912516
deviation-center-line_max0.8567035381863349
deviation-center-line_mean0.5589364286719085
deviation-center-line_min0.1269429849101329
deviation-heading_max4.792452643756836
deviation-heading_mean2.0674504900839454
deviation-heading_median1.3534965285537228
deviation-heading_min1.1272292230569867
driven_any_max2.3491473475291933
driven_any_mean1.7175404881579432
driven_any_median1.9071481002377937
driven_any_min0.6940590343202031
driven_lanedir_consec_max2.3357663158000697
driven_lanedir_consec_mean1.6309052437467877
driven_lanedir_consec_min0.5894882098344412
driven_lanedir_max2.3357663158000697
driven_lanedir_mean1.6309052437467877
driven_lanedir_median1.8876758055083984
driven_lanedir_min0.5894882098344412
in-drivable-lane_max0.34999999999999876
in-drivable-lane_mean0.12000000000000048
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6940590343202031, "sim_physics": 0.06396690074433671, "survival_time": 4.699999999999991, "driven_lanedir": 0.5894882098344412, "sim_render-ego": 0.01275350438787582, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.031459661240273336, "deviation-heading": 1.1272292230569867, "set_robot_commands": 0.008417976663467731, "deviation-center-line": 0.1269429849101329, "driven_lanedir_consec": 0.5894882098344412, "sim_compute_sim_state": 0.0058945696404639715, "sim_compute_performance-ego": 0.007537552650938643, "sim_compute_robot_state-ego": 0.009504543974044476}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9071481002377937, "sim_physics": 0.063904875614604, "survival_time": 12.200000000000038, "driven_lanedir": 1.8876758055083984, "sim_render-ego": 0.013093586827887863, "in-drivable-lane": 0, "agent_compute-ego": 0.030996751589853256, "deviation-heading": 1.3534965285537228, "set_robot_commands": 0.008423363576169874, "deviation-center-line": 0.782585577581069, "driven_lanedir_consec": 1.8876758055083984, "sim_compute_sim_state": 0.005938526059760422, "sim_compute_performance-ego": 0.00742456561229268, "sim_compute_robot_state-ego": 0.00963973412748243}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490028366851, "sim_physics": 0.06314097801844279, "survival_time": 14.950000000000076, "driven_lanedir": 2.1504296474823543, "sim_render-ego": 0.013011913299560546, "in-drivable-lane": 0, "agent_compute-ego": 0.03098400274912516, "deviation-heading": 4.792452643756836, "set_robot_commands": 0.008548560937245687, "deviation-center-line": 0.8567035381863349, "driven_lanedir_consec": 2.1504296474823543, "sim_compute_sim_state": 0.005894443988800049, "sim_compute_performance-ego": 0.007403465112050375, "sim_compute_robot_state-ego": 0.009602871735890708}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.288345122017426, "sim_physics": 0.063608837698748, "survival_time": 8.349999999999984, "driven_lanedir": 1.191166240108675, "sim_render-ego": 0.013351241985480943, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.031052863526487062, "deviation-heading": 1.7441673627900742, "set_robot_commands": 0.008393297652284542, "deviation-center-line": 0.249395382582146, "driven_lanedir_consec": 1.191166240108675, "sim_compute_sim_state": 0.00607401025509406, "sim_compute_performance-ego": 0.007465276889458388, "sim_compute_robot_state-ego": 0.009574764502976467}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491473475291933, "sim_physics": 0.06243123451868693, "survival_time": 14.950000000000076, "driven_lanedir": 2.3357663158000697, "sim_render-ego": 0.013030997117360431, "in-drivable-lane": 0, "agent_compute-ego": 0.03130958318710327, "deviation-heading": 1.319906692262108, "set_robot_commands": 0.008345667521158855, "deviation-center-line": 0.7790546600998602, "driven_lanedir_consec": 2.3357663158000697, "sim_compute_sim_state": 0.0059949994087219235, "sim_compute_performance-ego": 0.007516238689422607, "sim_compute_robot_state-ego": 0.009712319374084472}}
set_robot_commands_max0.008548560937245687
set_robot_commands_mean0.008425773270065337
set_robot_commands_median0.008417976663467731
set_robot_commands_min0.008345667521158855
sim_compute_performance-ego_max0.007537552650938643
sim_compute_performance-ego_mean0.007469419790832538
sim_compute_performance-ego_median0.007465276889458388
sim_compute_performance-ego_min0.007403465112050375
sim_compute_robot_state-ego_max0.009712319374084472
sim_compute_robot_state-ego_mean0.00960684674289571
sim_compute_robot_state-ego_median0.009602871735890708
sim_compute_robot_state-ego_min0.009504543974044476
sim_compute_sim_state_max0.00607401025509406
sim_compute_sim_state_mean0.005959309870568086
sim_compute_sim_state_median0.005938526059760422
sim_compute_sim_state_min0.005894443988800049
sim_physics_max0.06396690074433671
sim_physics_mean0.06341056531896369
sim_physics_median0.063608837698748
sim_physics_min0.06243123451868693
sim_render-ego_max0.013351241985480943
sim_render-ego_mean0.01304824872363312
sim_render-ego_median0.013030997117360431
sim_render-ego_min0.01275350438787582
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.030000000000031
survival_time_min4.699999999999991
No reset possible
329896649Anthony Courchesne 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:08:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.181487781547686
survival_time_median14.950000000000076
deviation-center-line_median0.7077087262533381
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03136259906894558
agent_compute-ego_mean0.03031154134843748
agent_compute-ego_median0.030105971708530337
agent_compute-ego_min0.029937111536661783
deviation-center-line_max0.9298827245521312
deviation-center-line_mean0.6575653316039497
deviation-center-line_min0.1294990591278939
deviation-heading_max4.342267538891645
deviation-heading_mean1.9788983780999383
deviation-heading_median1.436792525329698
deviation-heading_min1.1335356914766528
driven_any_max2.349147484265723
driven_any_mean1.9281025458616152
driven_any_median2.3490528515152143
driven_any_min0.6699605000975001
driven_lanedir_consec_max2.3339961705299475
driven_lanedir_consec_mean1.8633767937080832
driven_lanedir_consec_min0.5672568443789251
driven_lanedir_max2.3339961705299475
driven_lanedir_mean1.8633767937080832
driven_lanedir_median2.181487781547686
driven_lanedir_min0.5672568443789251
in-drivable-lane_max0.34999999999999876
in-drivable-lane_mean0.06999999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6699605000975001, "sim_physics": 0.06337881612253714, "survival_time": 4.549999999999992, "driven_lanedir": 0.5672568443789251, "sim_render-ego": 0.012604270662580215, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.03136259906894558, "deviation-heading": 1.1335356914766528, "set_robot_commands": 0.008454453814160693, "deviation-center-line": 0.1294990591278939, "driven_lanedir_consec": 0.5672568443789251, "sim_compute_sim_state": 0.005523498241717999, "sim_compute_performance-ego": 0.007616344389024672, "sim_compute_robot_state-ego": 0.009317345671601349}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9232051039647595, "sim_physics": 0.06253802970172913, "survival_time": 12.30000000000004, "driven_lanedir": 1.904123069272544, "sim_render-ego": 0.01244675434701811, "in-drivable-lane": 0, "agent_compute-ego": 0.030105971708530337, "deviation-heading": 1.3629616445508017, "set_robot_commands": 0.008300370317164475, "deviation-center-line": 0.6656753915166786, "driven_lanedir_consec": 1.904123069272544, "sim_compute_sim_state": 0.005685548472210643, "sim_compute_performance-ego": 0.00719197203473347, "sim_compute_robot_state-ego": 0.009514049785893135}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490528515152143, "sim_physics": 0.06312103509902954, "survival_time": 14.950000000000076, "driven_lanedir": 2.181487781547686, "sim_render-ego": 0.012261533737182617, "in-drivable-lane": 0, "agent_compute-ego": 0.029976538022359212, "deviation-heading": 4.342267538891645, "set_robot_commands": 0.008352237542470296, "deviation-center-line": 0.8550607565697063, "driven_lanedir_consec": 2.181487781547686, "sim_compute_sim_state": 0.0056534417470296226, "sim_compute_performance-ego": 0.007257526715596517, "sim_compute_robot_state-ego": 0.009332454204559328}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.349147484265723, "sim_physics": 0.06221183776855469, "survival_time": 14.950000000000076, "driven_lanedir": 2.330020102811313, "sim_render-ego": 0.01208790938059489, "in-drivable-lane": 0, "agent_compute-ego": 0.03017548640569051, "deviation-heading": 1.6189344902508946, "set_robot_commands": 0.008394804000854492, "deviation-center-line": 0.9298827245521312, "driven_lanedir_consec": 2.330020102811313, "sim_compute_sim_state": 0.005624579588572184, "sim_compute_performance-ego": 0.007196369171142578, "sim_compute_robot_state-ego": 0.009429945945739746}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.349146789464879, "sim_physics": 0.06164412577946981, "survival_time": 14.950000000000076, "driven_lanedir": 2.3339961705299475, "sim_render-ego": 0.01223241885503133, "in-drivable-lane": 0, "agent_compute-ego": 0.029937111536661783, "deviation-heading": 1.436792525329698, "set_robot_commands": 0.008360523382822673, "deviation-center-line": 0.7077087262533381, "driven_lanedir_consec": 2.3339961705299475, "sim_compute_sim_state": 0.00571893056233724, "sim_compute_performance-ego": 0.007080144882202148, "sim_compute_robot_state-ego": 0.00945119857788086}}
set_robot_commands_max0.008454453814160693
set_robot_commands_mean0.008372477811494524
set_robot_commands_median0.008360523382822673
set_robot_commands_min0.008300370317164475
sim_compute_performance-ego_max0.007616344389024672
sim_compute_performance-ego_mean0.007268471438539877
sim_compute_performance-ego_median0.007196369171142578
sim_compute_performance-ego_min0.007080144882202148
sim_compute_robot_state-ego_max0.009514049785893135
sim_compute_robot_state-ego_mean0.009408998837134882
sim_compute_robot_state-ego_median0.009429945945739746
sim_compute_robot_state-ego_min0.009317345671601349
sim_compute_sim_state_max0.00571893056233724
sim_compute_sim_state_mean0.005641199722373538
sim_compute_sim_state_median0.0056534417470296226
sim_compute_sim_state_min0.005523498241717999
sim_physics_max0.06337881612253714
sim_physics_mean0.06257876889426407
sim_physics_median0.06253802970172913
sim_physics_min0.06164412577946981
sim_render-ego_max0.012604270662580215
sim_render-ego_mean0.012326577396481433
sim_render-ego_median0.012261533737182617
sim_render-ego_min0.01208790938059489
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.340000000000051
survival_time_min4.549999999999992
No reset possible
329876648Anthony Courchesne 🇨🇦challenge-aido_LF-template-randomaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.030181435977711397
agent_compute-ego_mean0.02959810211523891
agent_compute-ego_median0.02948009967803955
agent_compute-ego_min0.02929240367451652
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.06397532499753512, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.012825195605938252, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.029736596804398756, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.008329253930311937, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.005586307782393236, "sim_compute_performance-ego": 0.007616552022787241, "sim_compute_robot_state-ego": 0.00980915931554941}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06685545444488525, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.013266777992248536, "in-drivable-lane": 0, "agent_compute-ego": 0.02948009967803955, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.008494877815246582, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.005587244033813476, "sim_compute_performance-ego": 0.007389688491821289, "sim_compute_robot_state-ego": 0.00950918197631836}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.06438615742851705, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.012723186436821432, "in-drivable-lane": 0, "agent_compute-ego": 0.030181435977711397, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.008412284009596881, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.00546721851124483, "sim_compute_performance-ego": 0.007320151609532973, "sim_compute_robot_state-ego": 0.009897673831266517}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.06165009248452109, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.0135709496795154, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.02929240367451652, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.008740921489527969, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.005620862616867316, "sim_compute_performance-ego": 0.007358308698310227, "sim_compute_robot_state-ego": 0.009911345653846616}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06693816184997559, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.013364542614329945, "in-drivable-lane": 0, "agent_compute-ego": 0.02929997444152832, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.008549202572215687, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.005580241029912775, "sim_compute_performance-ego": 0.007523146542635831, "sim_compute_robot_state-ego": 0.009684150869196112}}
set_robot_commands_max0.008740921489527969
set_robot_commands_mean0.00850530796337981
set_robot_commands_median0.008494877815246582
set_robot_commands_min0.008329253930311937
sim_compute_performance-ego_max0.007616552022787241
sim_compute_performance-ego_mean0.007441569473017512
sim_compute_performance-ego_median0.007389688491821289
sim_compute_performance-ego_min0.007320151609532973
sim_compute_robot_state-ego_max0.009911345653846616
sim_compute_robot_state-ego_mean0.009762302329235403
sim_compute_robot_state-ego_median0.00980915931554941
sim_compute_robot_state-ego_min0.00950918197631836
sim_compute_sim_state_max0.005620862616867316
sim_compute_sim_state_mean0.005568374794846326
sim_compute_sim_state_median0.005586307782393236
sim_compute_sim_state_min0.00546721851124483
sim_physics_max0.06693816184997559
sim_physics_mean0.06476103824108682
sim_physics_median0.06438615742851705
sim_physics_min0.06165009248452109
sim_render-ego_max0.0135709496795154
sim_render-ego_mean0.013150130465770711
sim_render-ego_median0.013266777992248536
sim_render-ego_min0.012723186436821432
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
329736639Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6424439406374929
survival_time_median14.950000000000076
deviation-center-line_median0.8680210113809217
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04865238312128428
agent_compute-ego_mean0.04573200970848255
agent_compute-ego_median0.045331176385839944
agent_compute-ego_min0.04424221356709798
deviation-center-line_max1.472070671182124
deviation-center-line_mean0.9108117458430968
deviation-center-line_min0.3921288904563016
deviation-heading_max5.972380702714731
deviation-heading_mean3.542151119324631
deviation-heading_median2.986475880062104
deviation-heading_min2.267617206309601
driven_any_max1.2504571052785514
driven_any_mean0.9690431247258888
driven_any_median1.052154017027272
driven_any_min0.6493066140444245
driven_lanedir_consec_max1.1990991286300687
driven_lanedir_consec_mean0.7260698666674449
driven_lanedir_consec_min0.23198200088462295
driven_lanedir_max1.1990991286300687
driven_lanedir_mean0.7181542049136669
driven_lanedir_median0.6424439406374929
driven_lanedir_min0.19240369211573283
in-drivable-lane_max2.600000000000037
in-drivable-lane_mean0.5200000000000073
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7271901342958214, "sim_physics": 0.05949745468191198, "survival_time": 7.399999999999982, "driven_lanedir": 0.6424439406374929, "sim_render-ego": 0.012160020905572015, "in-drivable-lane": 0, "agent_compute-ego": 0.04865238312128428, "deviation-heading": 2.267617206309601, "set_robot_commands": 0.006785694006327036, "deviation-center-line": 0.3921288904563016, "driven_lanedir_consec": 0.6424439406374929, "sim_compute_sim_state": 0.00403322561367138, "sim_compute_performance-ego": 0.007356814436010412, "sim_compute_robot_state-ego": 0.009447379692180735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1661077529833743, "sim_physics": 0.05867364962895711, "survival_time": 14.950000000000076, "driven_lanedir": 1.0006835084325532, "sim_render-ego": 0.012045833269755044, "in-drivable-lane": 0, "agent_compute-ego": 0.04556999444961548, "deviation-heading": 2.986475880062104, "set_robot_commands": 0.006746785640716553, "deviation-center-line": 0.8680210113809217, "driven_lanedir_consec": 1.0006835084325532, "sim_compute_sim_state": 0.004029750823974609, "sim_compute_performance-ego": 0.007048397858937581, "sim_compute_robot_state-ego": 0.00939317544301351}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6493066140444245, "sim_physics": 0.0581351367632548, "survival_time": 14.950000000000076, "driven_lanedir": 0.19240369211573283, "sim_render-ego": 0.011880009174346924, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.04424221356709798, "deviation-heading": 5.972380702714731, "set_robot_commands": 0.006756378809611003, "deviation-center-line": 1.472070671182124, "driven_lanedir_consec": 0.23198200088462295, "sim_compute_sim_state": 0.004040990670522054, "sim_compute_performance-ego": 0.007091481685638428, "sim_compute_robot_state-ego": 0.009352084795633951}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2504571052785514, "sim_physics": 0.05888029252839781, "survival_time": 12.050000000000036, "driven_lanedir": 1.1990991286300687, "sim_render-ego": 0.01203606039656643, "in-drivable-lane": 0, "agent_compute-ego": 0.045331176385839944, "deviation-heading": 2.6964503381702563, "set_robot_commands": 0.006726329257379429, "deviation-center-line": 0.3968632964830895, "driven_lanedir_consec": 1.1990991286300687, "sim_compute_sim_state": 0.004029213640205098, "sim_compute_performance-ego": 0.007059297126358476, "sim_compute_robot_state-ego": 0.009405160840616189}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.052154017027272, "sim_physics": 0.05912733793258667, "survival_time": 14.950000000000076, "driven_lanedir": 0.5561407547524866, "sim_render-ego": 0.012240409056345622, "in-drivable-lane": 0, "agent_compute-ego": 0.04486428101857503, "deviation-heading": 3.787831469366459, "set_robot_commands": 0.006761113007863363, "deviation-center-line": 1.4249748597130472, "driven_lanedir_consec": 0.5561407547524866, "sim_compute_sim_state": 0.004035401344299317, "sim_compute_performance-ego": 0.00702193816502889, "sim_compute_robot_state-ego": 0.009652369022369383}}
set_robot_commands_max0.006785694006327036
set_robot_commands_mean0.006755260144379477
set_robot_commands_median0.006756378809611003
set_robot_commands_min0.006726329257379429
sim_compute_performance-ego_max0.007356814436010412
sim_compute_performance-ego_mean0.007115585854394757
sim_compute_performance-ego_median0.007059297126358476
sim_compute_performance-ego_min0.00702193816502889
sim_compute_robot_state-ego_max0.009652369022369383
sim_compute_robot_state-ego_mean0.009450033958762752
sim_compute_robot_state-ego_median0.009405160840616189
sim_compute_robot_state-ego_min0.009352084795633951
sim_compute_sim_state_max0.004040990670522054
sim_compute_sim_state_mean0.0040337164185344915
sim_compute_sim_state_median0.00403322561367138
sim_compute_sim_state_min0.004029213640205098
sim_physics_max0.05949745468191198
sim_physics_mean0.05886277430702168
sim_physics_median0.05888029252839781
sim_physics_min0.0581351367632548
sim_render-ego_max0.012240409056345622
sim_render-ego_mean0.012072466560517208
sim_render-ego_median0.012045833269755044
sim_render-ego_min0.011880009174346924
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.860000000000053
survival_time_min7.399999999999982
No reset possible
329696636Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationfailedyesp-10:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 54, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 50, in compute_action
               ||     actions = [action[0], action[1]*self.gain]
               || AttributeError: 'IILAgent' object has no attribute 'gain'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329666635Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationfailedyesp-10:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 53, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 50, in compute_action
               ||     return action.astype(float)
               || AttributeError: 'Tensor' object has no attribute 'astype'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329656634Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329636632Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationerroryesp-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329626631Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationerroryesp-10:01:16
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329596630Du Xiaoshichallenge-aido_LF-template-randomaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03107722447468684
agent_compute-ego_mean0.029348489206351785
agent_compute-ego_median0.029379677772521973
agent_compute-ego_min0.027904597195712
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.06310142003572904, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.012239474516648512, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.03107722447468684, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.00796201595893273, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0054138807150033805, "sim_compute_performance-ego": 0.007082984997675969, "sim_compute_robot_state-ego": 0.009526381125816932}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06757581233978271, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.012344813346862792, "in-drivable-lane": 0, "agent_compute-ego": 0.029379677772521973, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.00854116678237915, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.005418014526367187, "sim_compute_performance-ego": 0.006969571113586426, "sim_compute_robot_state-ego": 0.0098557710647583}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.06485024620504941, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.012749398455900304, "in-drivable-lane": 0, "agent_compute-ego": 0.029435985228594613, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.008435508784125833, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.005482603521908031, "sim_compute_performance-ego": 0.0070190850426169, "sim_compute_robot_state-ego": 0.009708958513596478}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.06380660025799861, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.012311341332607582, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.0289449613602435, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.008340229753588066, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.005529145725437852, "sim_compute_performance-ego": 0.007130712759299356, "sim_compute_robot_state-ego": 0.009334634562007716}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06875090165571733, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.01246376471085982, "in-drivable-lane": 0, "agent_compute-ego": 0.027904597195712, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.008265115998008034, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.005708466876636852, "sim_compute_performance-ego": 0.007213289087468927, "sim_compute_robot_state-ego": 0.00910916111686013}}
set_robot_commands_max0.00854116678237915
set_robot_commands_mean0.008308807455406762
set_robot_commands_median0.008340229753588066
set_robot_commands_min0.00796201595893273
sim_compute_performance-ego_max0.007213289087468927
sim_compute_performance-ego_mean0.0070831286001295166
sim_compute_performance-ego_median0.007082984997675969
sim_compute_performance-ego_min0.006969571113586426
sim_compute_robot_state-ego_max0.0098557710647583
sim_compute_robot_state-ego_mean0.009506981276607911
sim_compute_robot_state-ego_median0.009526381125816932
sim_compute_robot_state-ego_min0.00910916111686013
sim_compute_sim_state_max0.005708466876636852
sim_compute_sim_state_mean0.00551042227307066
sim_compute_sim_state_median0.005482603521908031
sim_compute_sim_state_min0.0054138807150033805
sim_physics_max0.06875090165571733
sim_physics_mean0.06561699609885543
sim_physics_median0.06485024620504941
sim_physics_min0.06310142003572904
sim_render-ego_max0.012749398455900304
sim_render-ego_mean0.012421758472575805
sim_render-ego_median0.012344813346862792
sim_render-ego_min0.012239474516648512
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
329436622Frank (Chude) Qian 🇨🇦FrankNet-V2-2020_05_20_SSaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.6533769027102245
survival_time_median14.950000000000076
deviation-center-line_median0.838717023676766
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08908132076263428
agent_compute-ego_mean0.08726150757158306
agent_compute-ego_median0.08727352887811796
agent_compute-ego_min0.08606147766113281
deviation-center-line_max0.996772878654252
deviation-center-line_mean0.6389693629005728
deviation-center-line_min0.1645179081743745
deviation-heading_max3.5213242040784833
deviation-heading_mean2.012734425937418
deviation-heading_median2.0161882500986055
deviation-heading_min0.810798411340836
driven_any_max6.385163458595729
driven_any_mean4.262191095659039
driven_any_median4.75691787713361
driven_any_min1.6712384521762411
driven_lanedir_consec_max6.290761995403108
driven_lanedir_consec_mean3.956516812614784
driven_lanedir_consec_min1.2368633090227736
driven_lanedir_max6.290761995403108
driven_lanedir_mean3.956516812614784
driven_lanedir_median4.6533769027102245
driven_lanedir_min1.2368633090227736
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean0.7399999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.75691787713361, "sim_physics": 0.06273991982142131, "survival_time": 14.950000000000076, "driven_lanedir": 4.655386958690681, "sim_render-ego": 0.01277798016866048, "in-drivable-lane": 0, "agent_compute-ego": 0.08908132076263428, "deviation-heading": 2.464870037530382, "set_robot_commands": 0.008095373312632242, "deviation-center-line": 0.838717023676766, "driven_lanedir_consec": 4.655386958690681, "sim_compute_sim_state": 0.006175173123677572, "sim_compute_performance-ego": 0.007428239981333414, "sim_compute_robot_state-ego": 0.00979068120320638}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.494906879917436, "sim_physics": 0.061917471885681155, "survival_time": 14.950000000000076, "driven_lanedir": 4.6533769027102245, "sim_render-ego": 0.012677768071492512, "in-drivable-lane": 1.75, "agent_compute-ego": 0.08730801423390706, "deviation-heading": 3.5213242040784833, "set_robot_commands": 0.008020164966583252, "deviation-center-line": 0.8712317643120067, "driven_lanedir_consec": 4.6533769027102245, "sim_compute_sim_state": 0.006182761987050375, "sim_compute_performance-ego": 0.007181994120279948, "sim_compute_robot_state-ego": 0.009716742038726809}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 6.385163458595729, "sim_physics": 0.06182738939921061, "survival_time": 14.950000000000076, "driven_lanedir": 6.290761995403108, "sim_render-ego": 0.012372931639353437, "in-drivable-lane": 0, "agent_compute-ego": 0.0865831963221232, "deviation-heading": 2.0161882500986055, "set_robot_commands": 0.007964824835459391, "deviation-center-line": 0.996772878654252, "driven_lanedir_consec": 6.290761995403108, "sim_compute_sim_state": 0.006127918561299642, "sim_compute_performance-ego": 0.007100082238515218, "sim_compute_robot_state-ego": 0.009749871095021566}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6712384521762411, "sim_physics": 0.06215524673461914, "survival_time": 5.14999999999999, "driven_lanedir": 1.2368633090227736, "sim_render-ego": 0.012186925388076931, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.08606147766113281, "deviation-heading": 0.810798411340836, "set_robot_commands": 0.00787672487277429, "deviation-center-line": 0.1645179081743745, "driven_lanedir_consec": 1.2368633090227736, "sim_compute_sim_state": 0.006117239739131001, "sim_compute_performance-ego": 0.006840108667762534, "sim_compute_robot_state-ego": 0.00956703389732583}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0027288104721856, "sim_physics": 0.0635495320172377, "survival_time": 7.099999999999983, "driven_lanedir": 2.94619489724713, "sim_render-ego": 0.012469943140594053, "in-drivable-lane": 0, "agent_compute-ego": 0.08727352887811796, "deviation-heading": 1.250491226638779, "set_robot_commands": 0.007967692025950258, "deviation-center-line": 0.3236072396854652, "driven_lanedir_consec": 2.94619489724713, "sim_compute_sim_state": 0.006107278273139201, "sim_compute_performance-ego": 0.007159861040786958, "sim_compute_robot_state-ego": 0.009597272940084969}}
set_robot_commands_max0.008095373312632242
set_robot_commands_mean0.007984956002679889
set_robot_commands_median0.007967692025950258
set_robot_commands_min0.00787672487277429
sim_compute_performance-ego_max0.007428239981333414
sim_compute_performance-ego_mean0.007142057209735615
sim_compute_performance-ego_median0.007159861040786958
sim_compute_performance-ego_min0.006840108667762534
sim_compute_robot_state-ego_max0.00979068120320638
sim_compute_robot_state-ego_mean0.009684320234873112
sim_compute_robot_state-ego_median0.009716742038726809
sim_compute_robot_state-ego_min0.00956703389732583
sim_compute_sim_state_max0.006182761987050375
sim_compute_sim_state_mean0.0061420743368595584
sim_compute_sim_state_median0.006127918561299642
sim_compute_sim_state_min0.006107278273139201
sim_physics_max0.0635495320172377
sim_physics_mean0.06243791197163399
sim_physics_median0.06215524673461914
sim_physics_min0.06182738939921061
sim_render-ego_max0.01277798016866048
sim_render-ego_mean0.012497109681635483
sim_render-ego_median0.012469943140594053
sim_render-ego_min0.012186925388076931
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.42000000000004
survival_time_min5.14999999999999
No reset possible
329416621Frank (Chude) Qian 🇨🇦FrankNet-V2-2020_05_20aido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.698967458158407
survival_time_median6.949999999999983
deviation-center-line_median0.4814746534071578
in-drivable-lane_median0.5999999999999981


other stats
agent_compute-ego_max0.09059578142348368
agent_compute-ego_mean0.0867723920015713
agent_compute-ego_median0.08610156059265137
agent_compute-ego_min0.0838378701891218
deviation-center-line_max0.589835641677194
deviation-center-line_mean0.40509016888403304
deviation-center-line_min0.10483995333128482
deviation-heading_max2.0890706040087297
deviation-heading_mean1.2876959750691
deviation-heading_median1.2617491775300826
deviation-heading_min0.31812446521324617
driven_any_max4.30908224824312
driven_any_mean2.7322174528337184
driven_any_median2.874140865126914
driven_any_min1.0266132566975572
driven_lanedir_consec_max3.907305390099749
driven_lanedir_consec_mean2.474330039916813
driven_lanedir_consec_min0.8165368780163555
driven_lanedir_max3.907305390099749
driven_lanedir_mean2.474330039916813
driven_lanedir_median2.698967458158407
driven_lanedir_min0.8165368780163555
in-drivable-lane_max1.050000000000015
in-drivable-lane_mean0.5700000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.874140865126914, "sim_physics": 0.0611293452560522, "survival_time": 7.84999999999998, "driven_lanedir": 2.698967458158407, "sim_render-ego": 0.01240952303455134, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09059578142348368, "deviation-heading": 2.0890706040087297, "set_robot_commands": 0.007999849926893877, "deviation-center-line": 0.5317522463058174, "driven_lanedir_consec": 2.698967458158407, "sim_compute_sim_state": 0.005910864301547883, "sim_compute_performance-ego": 0.007326019797355506, "sim_compute_robot_state-ego": 0.00934493313929078}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.271564340651618, "sim_physics": 0.06079815909976051, "survival_time": 5.249999999999989, "driven_lanedir": 1.8368663137833192, "sim_render-ego": 0.011926144645327614, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0838378701891218, "deviation-heading": 1.1139558413062025, "set_robot_commands": 0.007858539762951079, "deviation-center-line": 0.31754834969871115, "driven_lanedir_consec": 1.8368663137833192, "sim_compute_sim_state": 0.00587546257745652, "sim_compute_performance-ego": 0.00686866215297154, "sim_compute_robot_state-ego": 0.00929798852829706}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0266132566975572, "sim_physics": 0.0626943302154541, "survival_time": 2.499999999999999, "driven_lanedir": 0.8165368780163555, "sim_render-ego": 0.012217144966125488, "in-drivable-lane": 0.5999999999999981, "agent_compute-ego": 0.08610156059265137, "deviation-heading": 0.31812446521324617, "set_robot_commands": 0.008217320442199708, "deviation-center-line": 0.10483995333128482, "driven_lanedir_consec": 0.8165368780163555, "sim_compute_sim_state": 0.006093134880065918, "sim_compute_performance-ego": 0.007109642028808594, "sim_compute_robot_state-ego": 0.009316539764404295}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.30908224824312, "sim_physics": 0.060893224947380295, "survival_time": 9.900000000000006, "driven_lanedir": 3.907305390099749, "sim_render-ego": 0.01222834683427907, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.08603814515200528, "deviation-heading": 1.65557978728724, "set_robot_commands": 0.008041755117551244, "deviation-center-line": 0.589835641677194, "driven_lanedir_consec": 3.907305390099749, "sim_compute_sim_state": 0.005852940106632734, "sim_compute_performance-ego": 0.007118895800426753, "sim_compute_robot_state-ego": 0.009305805870980928}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.179686553449383, "sim_physics": 0.06132775073428806, "survival_time": 6.949999999999983, "driven_lanedir": 3.111974159526236, "sim_render-ego": 0.012230202448453834, "in-drivable-lane": 0, "agent_compute-ego": 0.08728860265059436, "deviation-heading": 1.2617491775300826, "set_robot_commands": 0.00789674923574324, "deviation-center-line": 0.4814746534071578, "driven_lanedir_consec": 3.111974159526236, "sim_compute_sim_state": 0.005989295973194589, "sim_compute_performance-ego": 0.007210040263992419, "sim_compute_robot_state-ego": 0.009335514452817628}}
set_robot_commands_max0.008217320442199708
set_robot_commands_mean0.00800284289706783
set_robot_commands_median0.007999849926893877
set_robot_commands_min0.007858539762951079
sim_compute_performance-ego_max0.007326019797355506
sim_compute_performance-ego_mean0.007126652008710962
sim_compute_performance-ego_median0.007118895800426753
sim_compute_performance-ego_min0.00686866215297154
sim_compute_robot_state-ego_max0.00934493313929078
sim_compute_robot_state-ego_mean0.009320156351158135
sim_compute_robot_state-ego_median0.009316539764404295
sim_compute_robot_state-ego_min0.00929798852829706
sim_compute_sim_state_max0.006093134880065918
sim_compute_sim_state_mean0.005944339567779529
sim_compute_sim_state_median0.005910864301547883
sim_compute_sim_state_min0.005852940106632734
sim_physics_max0.0626943302154541
sim_physics_mean0.06136856205058703
sim_physics_median0.0611293452560522
sim_physics_min0.06079815909976051
sim_render-ego_max0.01240952303455134
sim_render-ego_mean0.01220227238574747
sim_render-ego_median0.01222834683427907
sim_render-ego_min0.011926144645327614
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean6.489999999999992
survival_time_min2.499999999999999
No reset possible
329396620Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido3-off-LF-sim-validationstep1-simulationerroryesp-10:02:11
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329366619Nour Eldin Alaa Badr 🇩🇪challenge-aido_LF-template-pytorchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.058674923473062024
survival_time_median1.1500000000000004
deviation-center-line_median0.034177811085950124
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.385791540145874
agent_compute-ego_mean0.3401491828953795
agent_compute-ego_median0.3182489975639012
agent_compute-ego_min0.3038347221556164
deviation-center-line_max0.0674165723104173
deviation-center-line_mean0.04278686506328245
deviation-center-line_min0.02615451203145854
deviation-heading_max0.6966279116124542
deviation-heading_mean0.6395711301067614
deviation-heading_median0.6714844748747123
deviation-heading_min0.534693285999645
driven_any_max0.2154795727057498
driven_any_mean0.16230997991652138
driven_any_median0.1630415664404585
driven_any_min0.0961330346392196
driven_lanedir_consec_max0.12108936319912678
driven_lanedir_consec_mean0.07386242066222207
driven_lanedir_consec_min0.03955626713676841
driven_lanedir_max0.12108936319912678
driven_lanedir_mean0.07386242066222207
driven_lanedir_median0.058674923473062024
driven_lanedir_min0.03955626713676841
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.20000000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.13968473781292937, "sim_physics": 0.06197898728506906, "survival_time": 1.0500000000000005, "driven_lanedir": 0.058674923473062024, "sim_render-ego": 0.011559395563034784, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.3038347221556164, "deviation-heading": 0.6966279116124542, "set_robot_commands": 0.005132811410086495, "deviation-center-line": 0.034177811085950124, "driven_lanedir_consec": 0.058674923473062024, "sim_compute_sim_state": 0.002990359351748512, "sim_compute_performance-ego": 0.006853659947713216, "sim_compute_robot_state-ego": 0.007860967091151647}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.0961330346392196, "sim_physics": 0.05881215466393365, "survival_time": 0.9000000000000002, "driven_lanedir": 0.03955626713676841, "sim_render-ego": 0.01198544767167833, "in-drivable-lane": 0, "agent_compute-ego": 0.3159697983000014, "deviation-heading": 0.6714844748747123, "set_robot_commands": 0.005332774586147732, "deviation-center-line": 0.0674165723104173, "driven_lanedir_consec": 0.03955626713676841, "sim_compute_sim_state": 0.0030989117092556423, "sim_compute_performance-ego": 0.007126993603176541, "sim_compute_robot_state-ego": 0.009108980496724447}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2154795727057498, "sim_physics": 0.05972084632286659, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12108936319912678, "sim_render-ego": 0.012086162200340858, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.37690085631150466, "deviation-heading": 0.6216581031026469, "set_robot_commands": 0.005286996181194599, "deviation-center-line": 0.053530469267230395, "driven_lanedir_consec": 0.12108936319912678, "sim_compute_sim_state": 0.002837997216444749, "sim_compute_performance-ego": 0.00687560668358436, "sim_compute_robot_state-ego": 0.009641684018648587}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19721098798424969, "sim_physics": 0.06097835879172048, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0936970199453353, "sim_render-ego": 0.011816701581401207, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.385791540145874, "deviation-heading": 0.534693285999645, "set_robot_commands": 0.0050798693010883945, "deviation-center-line": 0.02615451203145854, "driven_lanedir_consec": 0.0936970199453353, "sim_compute_sim_state": 0.002830274643436555, "sim_compute_performance-ego": 0.00704426150168142, "sim_compute_robot_state-ego": 0.008338236039684664}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1630415664404585, "sim_physics": 0.06173576479372771, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05629452955681779, "sim_render-ego": 0.01225460093954335, "in-drivable-lane": 0.2500000000000001, "agent_compute-ego": 0.3182489975639012, "deviation-heading": 0.6733918749443487, "set_robot_commands": 0.005525402400804603, "deviation-center-line": 0.032654960621355866, "driven_lanedir_consec": 0.05629452955681779, "sim_compute_sim_state": 0.0029788846554963484, "sim_compute_performance-ego": 0.006675564724466075, "sim_compute_robot_state-ego": 0.008312308269998302}}
set_robot_commands_max0.005525402400804603
set_robot_commands_mean0.005271570775864365
set_robot_commands_median0.005286996181194599
set_robot_commands_min0.0050798693010883945
sim_compute_performance-ego_max0.007126993603176541
sim_compute_performance-ego_mean0.006915217292124322
sim_compute_performance-ego_median0.00687560668358436
sim_compute_performance-ego_min0.006675564724466075
sim_compute_robot_state-ego_max0.009641684018648587
sim_compute_robot_state-ego_mean0.00865243518324153
sim_compute_robot_state-ego_median0.008338236039684664
sim_compute_robot_state-ego_min0.007860967091151647
sim_compute_sim_state_max0.0030989117092556423
sim_compute_sim_state_mean0.0029472855152763615
sim_compute_sim_state_median0.0029788846554963484
sim_compute_sim_state_min0.002830274643436555
sim_physics_max0.06197898728506906
sim_physics_mean0.06064522237146349
sim_physics_median0.06097835879172048
sim_physics_min0.05881215466393365
sim_render-ego_max0.01225460093954335
sim_render-ego_mean0.011940461591199708
sim_render-ego_median0.01198544767167833
sim_render-ego_min0.011559395563034784
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.1900000000000004
survival_time_min0.9000000000000002
No reset possible
329356618Charlie Gauthier 🇨🇦challenge-aido_LF-template-pytorchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:14:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34859181541263173
survival_time_median14.950000000000076
deviation-center-line_median0.4872386399889345
in-drivable-lane_median9.050000000000065


other stats
agent_compute-ego_max0.3425541130701701
agent_compute-ego_mean0.2762756388982137
agent_compute-ego_median0.33289589246114093
agent_compute-ego_min0.0672285278638204
deviation-center-line_max0.6744166098993453
deviation-center-line_mean0.5047479962075783
deviation-center-line_min0.35782816808686413
deviation-heading_max5.9770519723851026
deviation-heading_mean4.8992221091949215
deviation-heading_median4.974478897274121
deviation-heading_min2.8705464646879717
driven_any_max1.5682102991570612
driven_any_mean1.4653619357870424
driven_any_median1.4559691468524705
driven_any_min1.383984265498873
driven_lanedir_consec_max0.5190146659797961
driven_lanedir_consec_mean0.3551154568456852
driven_lanedir_consec_min0.16928945897811065
driven_lanedir_max0.5190146659797961
driven_lanedir_mean0.35635458745541204
driven_lanedir_median0.34859181541263173
driven_lanedir_min0.175485112026745
in-drivable-lane_max11.45000000000008
in-drivable-lane_mean8.780000000000058
in-drivable-lane_min6.95000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4752061738039195, "sim_physics": 0.055316987037658694, "survival_time": 14.950000000000076, "driven_lanedir": 0.175485112026745, "sim_render-ego": 0.011541393597920736, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.2993205038706462, "deviation-heading": 2.8705464646879717, "set_robot_commands": 0.005491185983022054, "deviation-center-line": 0.35782816808686413, "driven_lanedir_consec": 0.16928945897811065, "sim_compute_sim_state": 0.00307144562403361, "sim_compute_performance-ego": 0.006707178751627604, "sim_compute_robot_state-ego": 0.008775208791097005}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5682102991570612, "sim_physics": 0.055647268295288085, "survival_time": 14.950000000000076, "driven_lanedir": 0.3013006105735101, "sim_render-ego": 0.01140031337738037, "in-drivable-lane": 9.200000000000069, "agent_compute-ego": 0.33937915722529094, "deviation-heading": 4.974478897274121, "set_robot_commands": 0.005982576211293538, "deviation-center-line": 0.4674047224775068, "driven_lanedir_consec": 0.3013006105735101, "sim_compute_sim_state": 0.003016300201416016, "sim_compute_performance-ego": 0.006452574729919434, "sim_compute_robot_state-ego": 0.00827727476755778}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.383984265498873, "sim_physics": 0.057048838138580325, "survival_time": 14.950000000000076, "driven_lanedir": 0.4373807332843773, "sim_render-ego": 0.011298314730326334, "in-drivable-lane": 7.250000000000043, "agent_compute-ego": 0.33289589246114093, "deviation-heading": 5.806329501981888, "set_robot_commands": 0.005287284851074219, "deviation-center-line": 0.6744166098993453, "driven_lanedir_consec": 0.4373807332843773, "sim_compute_sim_state": 0.003037107785542806, "sim_compute_performance-ego": 0.006539469559987386, "sim_compute_robot_state-ego": 0.008310508728027344}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4434397936228882, "sim_physics": 0.05983045657475789, "survival_time": 14.950000000000076, "driven_lanedir": 0.5190146659797961, "sim_render-ego": 0.01182704528172811, "in-drivable-lane": 6.95000000000004, "agent_compute-ego": 0.3425541130701701, "deviation-heading": 5.9770519723851026, "set_robot_commands": 0.005328946113586426, "deviation-center-line": 0.5368518405852408, "driven_lanedir_consec": 0.5190146659797961, "sim_compute_sim_state": 0.003031932512919108, "sim_compute_performance-ego": 0.006572893460591634, "sim_compute_robot_state-ego": 0.008047161102294921}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4559691468524705, "sim_physics": 0.059957025845845544, "survival_time": 14.950000000000076, "driven_lanedir": 0.34859181541263173, "sim_render-ego": 0.012438809076944987, "in-drivable-lane": 9.050000000000065, "agent_compute-ego": 0.0672285278638204, "deviation-heading": 4.867703709645522, "set_robot_commands": 0.006736869812011719, "deviation-center-line": 0.4872386399889345, "driven_lanedir_consec": 0.34859181541263173, "sim_compute_sim_state": 0.0040316899617513025, "sim_compute_performance-ego": 0.0069434801737467446, "sim_compute_robot_state-ego": 0.00988831917444865}}
set_robot_commands_max0.006736869812011719
set_robot_commands_mean0.005765372594197591
set_robot_commands_median0.005491185983022054
set_robot_commands_min0.005287284851074219
sim_compute_performance-ego_max0.0069434801737467446
sim_compute_performance-ego_mean0.00664311933517456
sim_compute_performance-ego_median0.006572893460591634
sim_compute_performance-ego_min0.006452574729919434
sim_compute_robot_state-ego_max0.00988831917444865
sim_compute_robot_state-ego_mean0.00865969451268514
sim_compute_robot_state-ego_median0.008310508728027344
sim_compute_robot_state-ego_min0.008047161102294921
sim_compute_sim_state_max0.0040316899617513025
sim_compute_sim_state_mean0.0032376952171325685
sim_compute_sim_state_median0.003037107785542806
sim_compute_sim_state_min0.003016300201416016
sim_physics_max0.059957025845845544
sim_physics_mean0.05756011517842611
sim_physics_median0.057048838138580325
sim_physics_min0.055316987037658694
sim_render-ego_max0.012438809076944987
sim_render-ego_mean0.011701175212860107
sim_render-ego_median0.011541393597920736
sim_render-ego_min0.011298314730326334
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
329266614Hyejun Yuchallenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationerroryesp-10:02:43
The container "solut [...]
The container "solution" exited with code 255.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible