Duckietown Challenges Home Challenges Submissions

Evaluator 1052

ID1052
evaluatorip-172-31-25-98-2348
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2348
versiond-c:4.0.28;d-c-r:4.0.39;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success1 21990
# timeout
# failed
# error
# aborted
# host-error1 21981
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
219903372Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-25-98-23480:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1879925472395761
agent_compute-ego_mean0.17779936055788145
agent_compute-ego_median0.1759878247976303
agent_compute-ego_min0.1735956090167888
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2555161518386648, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.07045131997217106, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1741521690465227, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10814199266554432, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.043843332725235176, "sim_compute_performance-ego": 0.07886358454257628, "sim_compute_robot_state-ego": 0.08717633500883851, "sim_compute_robot_state-npc0": 0.07637475110307525, "sim_compute_robot_state-npc1": 0.0769515097895755, "sim_compute_robot_state-npc2": 0.07804064509234851, "sim_compute_robot_state-npc3": 0.07840850987011873}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.26611946310315815, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.07038110494613647, "in-drivable-lane": 0, "agent_compute-ego": 0.1879925472395761, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.11641183921269008, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.043632490294320245, "sim_compute_performance-ego": 0.08051022461482457, "sim_compute_robot_state-ego": 0.09397402831486291, "sim_compute_robot_state-npc0": 0.07637656586510795, "sim_compute_robot_state-npc1": 0.07910159655979701, "sim_compute_robot_state-npc2": 0.07954545531954084, "sim_compute_robot_state-npc3": 0.07750710419246129}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.22655102118705084, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.07109080472038788, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1735956090167888, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.11416114418252, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04378472022639895, "sim_compute_performance-ego": 0.07930469049990756, "sim_compute_robot_state-ego": 0.08351336173640872, "sim_compute_robot_state-npc0": 0.07921584370066818, "sim_compute_robot_state-npc1": 0.07556041236062652, "sim_compute_robot_state-npc2": 0.07562543350516014, "sim_compute_robot_state-npc3": 0.07872631943341597}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2589681496222814, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06821441153685252, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1759878247976303, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10976295669873556, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.043841550747553505, "sim_compute_performance-ego": 0.08150161802768707, "sim_compute_robot_state-ego": 0.08767954011758168, "sim_compute_robot_state-npc0": 0.0770568201939265, "sim_compute_robot_state-npc1": 0.07684414088726044, "sim_compute_robot_state-npc2": 0.07453134655952454, "sim_compute_robot_state-npc3": 0.07553487022717793}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.22596134458269393, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.07260294187636603, "in-drivable-lane": 0, "agent_compute-ego": 0.17726865268888928, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.11079631532941546, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04304084323701404, "sim_compute_performance-ego": 0.08360918362935384, "sim_compute_robot_state-ego": 0.08554468836103167, "sim_compute_robot_state-npc0": 0.07634728295462472, "sim_compute_robot_state-npc1": 0.07818534260704404, "sim_compute_robot_state-npc2": 0.07795669918968565, "sim_compute_robot_state-npc3": 0.07847655387151808}}
set_robot_commands_max0.11641183921269008
set_robot_commands_mean0.11185484961778108
set_robot_commands_median0.11079631532941546
set_robot_commands_min0.10814199266554432
sim_compute_performance-ego_max0.08360918362935384
sim_compute_performance-ego_mean0.08075786026286987
sim_compute_performance-ego_median0.08051022461482457
sim_compute_performance-ego_min0.07886358454257628
sim_compute_robot_state-ego_max0.09397402831486291
sim_compute_robot_state-ego_mean0.0875775907077447
sim_compute_robot_state-ego_median0.08717633500883851
sim_compute_robot_state-ego_min0.08351336173640872
sim_compute_robot_state-npc0_max0.07921584370066818
sim_compute_robot_state-npc0_mean0.07707425276348052
sim_compute_robot_state-npc0_median0.07637656586510795
sim_compute_robot_state-npc0_min0.07634728295462472
sim_compute_robot_state-npc1_max0.07910159655979701
sim_compute_robot_state-npc1_mean0.07732860044086069
sim_compute_robot_state-npc1_median0.0769515097895755
sim_compute_robot_state-npc1_min0.07556041236062652
sim_compute_robot_state-npc2_max0.07954545531954084
sim_compute_robot_state-npc2_mean0.07713991593325194
sim_compute_robot_state-npc2_median0.07795669918968565
sim_compute_robot_state-npc2_min0.07453134655952454
sim_compute_robot_state-npc3_max0.07872631943341597
sim_compute_robot_state-npc3_mean0.0777306715189384
sim_compute_robot_state-npc3_median0.07840850987011873
sim_compute_robot_state-npc3_min0.07553487022717793
sim_compute_sim_state_max0.043843332725235176
sim_compute_sim_state_mean0.043628587446104386
sim_compute_sim_state_median0.04378472022639895
sim_compute_sim_state_min0.04304084323701404
sim_physics_max0.26611946310315815
sim_physics_mean0.24662322606676984
sim_physics_median0.2555161518386648
sim_physics_min0.22596134458269393
sim_render-ego_max0.07260294187636603
sim_render-ego_mean0.0705481166103828
sim_render-ego_median0.07045131997217106
sim_render-ego_min0.06821441153685252
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
219813367Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationhost-errornoip-172-31-25-98-23480:03:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1066, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job21981-955546', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 535, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1071, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job21981-955546', 'down']:

   >  Command '['docker-compose', '-p', 'job21981-955546', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible