Duckietown Challenges Home Challenges Submissions

Evaluator 1051

ID1051
evaluatorip-172-31-25-98-2470
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2470
versiond-c:4.0.28;d-c-r:4.0.39;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success1 21989
# timeout
# failed
# error
# aborted
# host-error1 21978
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
219893376Lei Chenchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-25-98-24700:14:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8850620976712323
survival_time_median8.74999999999999
deviation-center-line_median0.5801347658846865
in-drivable-lane_median0.350000000000005


other stats
agent_compute-ego_max0.10582107305526732
agent_compute-ego_mean0.0998134376776076
agent_compute-ego_median0.10337171819474962
agent_compute-ego_min0.08162595716755042
deviation-center-line_max0.8691432064647118
deviation-center-line_mean0.5734454061309832
deviation-center-line_min0.382067516529864
deviation-heading_max5.511722239428853
deviation-heading_mean2.6990788069296294
deviation-heading_median2.521342525257346
deviation-heading_min0.43867019752844166
driven_any_max2.341210737784756
driven_any_mean1.2529634691325398
driven_any_median1.352560298483635
driven_any_min0.5249471893485225
driven_lanedir_consec_max1.282307192572876
driven_lanedir_consec_mean0.8204858258130041
driven_lanedir_consec_min0.206617526870352
driven_lanedir_max1.9584338323510757
driven_lanedir_mean1.0730679722863714
driven_lanedir_median1.2073969342935131
driven_lanedir_min0.39615652455734535
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.35000000000000026
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.341210737784756, "sim_physics": 0.13323268572489422, "survival_time": 14.950000000000076, "driven_lanedir": 1.9584338323510757, "sim_render-ego": 0.07075203418731689, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.10499951680501302, "deviation-heading": 5.511722239428853, "set_robot_commands": 0.11147429863611856, "deviation-center-line": 0.8691432064647118, "driven_lanedir_consec": 0.8850620976712323, "sim_compute_sim_state": 0.04309683084487915, "sim_compute_performance-ego": 0.08021319309870402, "sim_compute_robot_state-ego": 0.08822489420572917}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6694352983340317, "sim_physics": 0.13623911804623073, "survival_time": 4.499999999999992, "driven_lanedir": 0.39615652455734535, "sim_render-ego": 0.07436807685428196, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.10337171819474962, "deviation-heading": 2.62346941858947, "set_robot_commands": 0.11081885231865776, "deviation-center-line": 0.382067516529864, "driven_lanedir_consec": 0.206617526870352, "sim_compute_sim_state": 0.042230995496114095, "sim_compute_performance-ego": 0.07637743420071072, "sim_compute_robot_state-ego": 0.08481619358062745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5249471893485225, "sim_physics": 0.12194689114888509, "survival_time": 3.599999999999995, "driven_lanedir": 0.521045377657047, "sim_render-ego": 0.07050479451815288, "in-drivable-lane": 0, "agent_compute-ego": 0.10582107305526732, "deviation-heading": 0.43867019752844166, "set_robot_commands": 0.11828153000937568, "deviation-center-line": 0.3926689527350763, "driven_lanedir_consec": 0.521045377657047, "sim_compute_sim_state": 0.04445351163546244, "sim_compute_performance-ego": 0.0778284039762285, "sim_compute_robot_state-ego": 0.08789035015636021}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.352560298483635, "sim_physics": 0.14260964802333287, "survival_time": 8.74999999999999, "driven_lanedir": 1.2073969342935131, "sim_render-ego": 0.0687145219530378, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.10324892316545758, "deviation-heading": 2.4001896538440355, "set_robot_commands": 0.11233472006661552, "deviation-center-line": 0.6432125890405775, "driven_lanedir_consec": 1.2073969342935131, "sim_compute_sim_state": 0.04225152969360352, "sim_compute_performance-ego": 0.0777679089137486, "sim_compute_robot_state-ego": 0.08637692315237863}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3766638217117544, "sim_physics": 0.09386302246136612, "survival_time": 8.899999999999991, "driven_lanedir": 1.282307192572876, "sim_render-ego": 0.053587162092830355, "in-drivable-lane": 0, "agent_compute-ego": 0.08162595716755042, "deviation-heading": 2.521342525257346, "set_robot_commands": 0.08868288458063361, "deviation-center-line": 0.5801347658846865, "driven_lanedir_consec": 1.282307192572876, "sim_compute_sim_state": 0.03386532322744305, "sim_compute_performance-ego": 0.0587799535708481, "sim_compute_robot_state-ego": 0.06220325727141305}}
set_robot_commands_max0.11828153000937568
set_robot_commands_mean0.1083184571222802
set_robot_commands_median0.11147429863611856
set_robot_commands_min0.08868288458063361
sim_compute_performance-ego_max0.08021319309870402
sim_compute_performance-ego_mean0.07419337875204798
sim_compute_performance-ego_median0.0777679089137486
sim_compute_performance-ego_min0.0587799535708481
sim_compute_robot_state-ego_max0.08822489420572917
sim_compute_robot_state-ego_mean0.0819023236733017
sim_compute_robot_state-ego_median0.08637692315237863
sim_compute_robot_state-ego_min0.06220325727141305
sim_compute_sim_state_max0.04445351163546244
sim_compute_sim_state_mean0.041179638179500454
sim_compute_sim_state_median0.04225152969360352
sim_compute_sim_state_min0.03386532322744305
sim_physics_max0.14260964802333287
sim_physics_mean0.1255782730809418
sim_physics_median0.13323268572489422
sim_physics_min0.09386302246136612
sim_render-ego_max0.07436807685428196
sim_render-ego_mean0.06758531792112397
sim_render-ego_median0.07050479451815288
sim_render-ego_min0.053587162092830355
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.14000000000001
survival_time_min3.599999999999995
No reset possible
219783363Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationhost-errornoip-172-31-25-98-24700:04:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1066, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job21978-729294', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 535, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1071, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job21978-729294', 'down']:

   >  Command '['docker-compose', '-p', 'job21978-729294', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible