Duckietown Challenges Home Challenges Submissions

Evaluator 1603

ID1603
evaluatorip-172-31-35-218-10491
ownerI don't have one 😀
machineip-172-31-35-218
processip-172-31-35-218-10491
versiond-c:5.0.7;d-c-r:5.0.11;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success1 25187
# timeout
# failed
# error
# aborted
# host-error3 25136
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251874405Alex Deliyannischallenge-aido_LF-template-tensorflowaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.21567484424021055
survival_time_median1.1500000000000004
deviation-center-line_median0.09202644174720588
in-drivable-lane_median0


other stats
agent_compute-ego_max0.027314144632090694
agent_compute-ego_mean0.02264620892834745
agent_compute-ego_median0.02181239005846855
agent_compute-ego_min0.019157327924455916
deviation-center-line_max0.13742256273739673
deviation-center-line_mean0.10186544180454853
deviation-center-line_min0.07648716702190818
deviation-heading_max0.9283648249206472
deviation-heading_mean0.5941781376071209
deviation-heading_median0.6282491126854428
deviation-heading_min0.21230857637950903
driven_any_max0.9862035338856492
driven_any_mean0.4040107866093038
driven_any_median0.27154885470854984
driven_any_min0.21491945572480511
driven_lanedir_consec_max0.459691401734295
driven_lanedir_consec_mean0.26045848488948453
driven_lanedir_consec_min0.17119141786374703
driven_lanedir_max0.459691401734295
driven_lanedir_mean0.26045848488948453
driven_lanedir_median0.21567484424021055
driven_lanedir_min0.17119141786374703
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean0.33999999999999886
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.25833880240614737, "sim_physics": 0.1699209627897843, "survival_time": 1.1500000000000004, "driven_lanedir": 0.17984146011203173, "sim_render-ego": 0.01156547795171323, "in-drivable-lane": 0, "agent_compute-ego": 0.027314144632090694, "deviation-heading": 0.6282491126854428, "set_robot_commands": 0.007968114769977072, "deviation-center-line": 0.07903495559454898, "driven_lanedir_consec": 0.17984146011203173, "sim_compute_sim_state": 0.004328717356142791, "sim_compute_performance-ego": 0.006162705628768257, "sim_compute_robot_state-ego": 0.007550851158473803, "sim_compute_robot_state-npc0": 0.0072675787884256115, "sim_compute_robot_state-npc1": 0.00694665701492973, "sim_compute_robot_state-npc2": 0.007206315579621688, "sim_compute_robot_state-npc3": 0.007049405056497325}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.27154885470854984, "sim_physics": 0.12345364434378488, "survival_time": 1.7500000000000009, "driven_lanedir": 0.21567484424021055, "sim_render-ego": 0.008392749513898576, "in-drivable-lane": 0, "agent_compute-ego": 0.019157327924455916, "deviation-heading": 0.9283648249206472, "set_robot_commands": 0.006003563744681222, "deviation-center-line": 0.13742256273739673, "driven_lanedir_consec": 0.21567484424021055, "sim_compute_sim_state": 0.003397927965436663, "sim_compute_performance-ego": 0.004613276890345982, "sim_compute_robot_state-ego": 0.005770574297223772, "sim_compute_robot_state-npc0": 0.005637768336704799, "sim_compute_robot_state-npc1": 0.005462428501674107, "sim_compute_robot_state-npc2": 0.00556988034929548, "sim_compute_robot_state-npc3": 0.0053657259259905134}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28904328632136767, "sim_physics": 0.17661687305995397, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2758933004971382, "sim_render-ego": 0.010958501270839149, "in-drivable-lane": 0, "agent_compute-ego": 0.02446880794706799, "deviation-heading": 0.21230857637950903, "set_robot_commands": 0.00868126324244908, "deviation-center-line": 0.09202644174720588, "driven_lanedir_consec": 0.2758933004971382, "sim_compute_sim_state": 0.004623560678391229, "sim_compute_performance-ego": 0.005960702896118164, "sim_compute_robot_state-ego": 0.007719823292323521, "sim_compute_robot_state-npc0": 0.007751260484967913, "sim_compute_robot_state-npc1": 0.007663374855404808, "sim_compute_robot_state-npc2": 0.007397594906034924, "sim_compute_robot_state-npc3": 0.007490010488600958}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21491945572480511, "sim_physics": 0.15139166932356984, "survival_time": 0.9500000000000004, "driven_lanedir": 0.17119141786374703, "sim_render-ego": 0.009185088308233964, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.020478374079654093, "deviation-heading": 0.28220858091753603, "set_robot_commands": 0.00697846161691766, "deviation-center-line": 0.07648716702190818, "driven_lanedir_consec": 0.17119141786374703, "sim_compute_sim_state": 0.003517928876374897, "sim_compute_performance-ego": 0.005102345817967465, "sim_compute_robot_state-ego": 0.006247658478586297, "sim_compute_robot_state-npc0": 0.006012427179436935, "sim_compute_robot_state-npc1": 0.005814113115009509, "sim_compute_robot_state-npc2": 0.005784273147583008, "sim_compute_robot_state-npc3": 0.005880682091963918}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9862035338856492, "sim_physics": 0.12739895245967767, "survival_time": 3.899999999999994, "driven_lanedir": 0.459691401734295, "sim_render-ego": 0.00953513231032934, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.02181239005846855, "deviation-heading": 0.91975959313247, "set_robot_commands": 0.007300315759120843, "deviation-center-line": 0.12435608192168282, "driven_lanedir_consec": 0.459691401734295, "sim_compute_sim_state": 0.003961972701243865, "sim_compute_performance-ego": 0.005347447517590645, "sim_compute_robot_state-ego": 0.006676444640526405, "sim_compute_robot_state-npc0": 0.0067954949843577845, "sim_compute_robot_state-npc1": 0.006631325452755659, "sim_compute_robot_state-npc2": 0.006532403138967661, "sim_compute_robot_state-npc3": 0.006560805516365247}}
set_robot_commands_max0.00868126324244908
set_robot_commands_mean0.007386343826629176
set_robot_commands_median0.007300315759120843
set_robot_commands_min0.006003563744681222
sim_compute_performance-ego_max0.006162705628768257
sim_compute_performance-ego_mean0.005437295750158103
sim_compute_performance-ego_median0.005347447517590645
sim_compute_performance-ego_min0.004613276890345982
sim_compute_robot_state-ego_max0.007719823292323521
sim_compute_robot_state-ego_mean0.00679307037342676
sim_compute_robot_state-ego_median0.006676444640526405
sim_compute_robot_state-ego_min0.005770574297223772
sim_compute_robot_state-npc0_max0.007751260484967913
sim_compute_robot_state-npc0_mean0.006692905954778608
sim_compute_robot_state-npc0_median0.0067954949843577845
sim_compute_robot_state-npc0_min0.005637768336704799
sim_compute_robot_state-npc1_max0.007663374855404808
sim_compute_robot_state-npc1_mean0.006503579787954762
sim_compute_robot_state-npc1_median0.006631325452755659
sim_compute_robot_state-npc1_min0.005462428501674107
sim_compute_robot_state-npc2_max0.007397594906034924
sim_compute_robot_state-npc2_mean0.006498093424300552
sim_compute_robot_state-npc2_median0.006532403138967661
sim_compute_robot_state-npc2_min0.00556988034929548
sim_compute_robot_state-npc3_max0.007490010488600958
sim_compute_robot_state-npc3_mean0.006469325815883592
sim_compute_robot_state-npc3_median0.006560805516365247
sim_compute_robot_state-npc3_min0.0053657259259905134
sim_compute_sim_state_max0.004623560678391229
sim_compute_sim_state_mean0.003966021515517889
sim_compute_sim_state_median0.003961972701243865
sim_compute_sim_state_min0.003397927965436663
sim_physics_max0.17661687305995397
sim_physics_mean0.14975642039535414
sim_physics_median0.15139166932356984
sim_physics_min0.12345364434378488
sim_render-ego_max0.01156547795171323
sim_render-ego_mean0.009927389871002851
sim_render-ego_median0.00953513231032934
sim_render-ego_min0.008392749513898576
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean1.7599999999999991
survival_time_min0.9500000000000004
No reset possible
251633264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104910:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251373257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104910:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251363265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104910:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible