Duckietown Challenges Home Challenges Submissions

Evaluator 134

ID134
evaluatorrudolf-3
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-3
versionDC:3.1.45;DCR:3.2.8;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success4 2623
# timeout1 2662
# failed
# error2 2630
# aborted2 2619
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
2662313Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-30:11:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2654309Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-31:40:14
Timeout: Waited 600 [...]
Timeout:

Waited 600.097904921 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2650309Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationabortednorudolf-30:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 292, in go_
    solution_container = res['parameters']['hash']
KeyError: 'hash'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2635267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2630305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-vizerrornorudolf-30:00:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 530, in wrap_scorer
    evaluator.score(cie)
  File "/visualizer/videos.py", line 27, in score
    cie.set_evaluation_file(f, f)
  File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 309, in set_evaluation_file
    raise_wrapped(InvalidEvaluator, e, msg)
  File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/utils.py", line 214, in raise_wrapped
    raise e
InvalidEvaluator: Invalid set_evaluation_file()
| Traceback (most recent call last):
|   File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 306, in set_evaluation_file
|     self.evaluation_files.add(basename, from_file, description)
|   File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 42, in add
|     raise ValueError(msg)
| ValueError: The file does not exist: ep001/log/drawing-interactive.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2626305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessnorudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2625305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnorudolf-30:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.766666666666646


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.882928574085236, "good_angle": 24.375838822717732, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 378, "reward": -3.2346388968068087, "good_angle": 20.40007076965622, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 263, "reward": -3.8167757951701415, "good_angle": 0.1680230027077296, "survival_time": 8.766666666666646, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 260, "reward": -6.211007033403103, "good_angle": 26.028367959175476, "survival_time": 8.666666666666647, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}, "ep004": {"nsteps": 272, "reward": -5.535193312062749, "good_angle": 5.085881159803281, "survival_time": 9.066666666666643, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.028367959175476
good_angle_mean15.211636342812085
good_angle_median20.40007076965622
good_angle_min0.1680230027077296
reward_max-3.2346388968068087
reward_mean-5.336108722305608
reward_median-5.535193312062749
reward_min-7.882928574085236
survival_time_max12.599999999999966
survival_time_mean8.953333333333314
survival_time_min5.666666666666656
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666535
valid_direction_mean2.9733333333333234
valid_direction_median3.933333333333321
valid_direction_min0
No reset possible
2623305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2619306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationabortednorudolf-30:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible