Duckietown Challenges Home Challenges Submissions

Evaluator 5352

ID5352
evaluatorgpu-production-spot-0-03
ownerI don't have one 😀
machinegpu-production-spot-0_e9a82eb79dfc
processgpu-production-spot-0-03_e9a82eb79dfc
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success4 79662
# timeout
# failed
# error
# aborted
# host-error1 79658
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)245.9 GB
Disk (MB)969.3 GB
Disk available (MB)882.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7969516091Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-030:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.4
false_positive_rate0.03


other stats
nsamples400
No reset possible
7969116091Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-030:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.4
false_positive_rate0.03


other stats
nsamples400
No reset possible
7966516094Rohan Kaushikexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-030:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.119141291971209


other stats
agent_compute-ego0_max0.011590222517649332
agent_compute-ego0_mean0.011590222517649332
agent_compute-ego0_median0.011590222517649332
agent_compute-ego0_min0.011590222517649332
complete-iteration_max0.2279880858849788
complete-iteration_mean0.2279880858849788
complete-iteration_median0.2279880858849788
complete-iteration_min0.2279880858849788
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.119141291971209
distance-from-start_median1.119141291971209
distance-from-start_min1.119141291971209
driven_any_max1.1264080097231202
driven_any_mean1.1264080097231202
driven_any_median1.1264080097231202
driven_any_min1.1264080097231202
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09208146039990411
get_duckie_state_mean0.09208146039990411
get_duckie_state_median0.09208146039990411
get_duckie_state_min0.09208146039990411
get_robot_state_max0.003759169060250987
get_robot_state_mean0.003759169060250987
get_robot_state_median0.003759169060250987
get_robot_state_min0.003759169060250987
get_state_dump_max0.01894240102906158
get_state_dump_mean0.01894240102906158
get_state_dump_median0.01894240102906158
get_state_dump_min0.01894240102906158
get_ui_image_max0.014928894630376844
get_ui_image_mean0.014928894630376844
get_ui_image_median0.014928894630376844
get_ui_image_min0.014928894630376844
in-drivable-lane_max13.75000000000006
in-drivable-lane_mean13.75000000000006
in-drivable-lane_median13.75000000000006
in-drivable-lane_min13.75000000000006
per-episodes
details{"d45-ego0": {"driven_any": 1.1264080097231202, "get_ui_image": 0.014928894630376844, "step_physics": 0.06822869829509569, "survival_time": 13.75000000000006, "driven_lanedir": 0.0, "get_state_dump": 0.01894240102906158, "get_robot_state": 0.003759169060250987, "sim_render-ego0": 0.0036456783612569175, "get_duckie_state": 0.09208146039990411, "in-drivable-lane": 13.75000000000006, "deviation-heading": 0.0, "agent_compute-ego0": 0.011590222517649332, "complete-iteration": 0.2279880858849788, "set_robot_commands": 0.002263265243474988, "distance-from-start": 1.119141291971209, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010511681653451227, "sim_compute_performance-ego0": 0.0019470444623974784}}
set_robot_commands_max0.002263265243474988
set_robot_commands_mean0.002263265243474988
set_robot_commands_median0.002263265243474988
set_robot_commands_min0.002263265243474988
sim_compute_performance-ego0_max0.0019470444623974784
sim_compute_performance-ego0_mean0.0019470444623974784
sim_compute_performance-ego0_median0.0019470444623974784
sim_compute_performance-ego0_min0.0019470444623974784
sim_compute_sim_state_max0.010511681653451227
sim_compute_sim_state_mean0.010511681653451227
sim_compute_sim_state_median0.010511681653451227
sim_compute_sim_state_min0.010511681653451227
sim_render-ego0_max0.0036456783612569175
sim_render-ego0_mean0.0036456783612569175
sim_render-ego0_median0.0036456783612569175
sim_render-ego0_min0.0036456783612569175
simulation-passed1
step_physics_max0.06822869829509569
step_physics_mean0.06822869829509569
step_physics_median0.06822869829509569
step_physics_min0.06822869829509569
survival_time_max13.75000000000006
survival_time_mean13.75000000000006
survival_time_median13.75000000000006
survival_time_min13.75000000000006
No reset possible
7966216091Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-030:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.4
false_positive_rate0.03


other stats
nsamples400
No reset possible
7965816089Matteo Razzanellicollision-check-exercisemooc-collision-check-valistep1host-errornogpu-production-spot-0-030:01:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible