Duckietown Challenges Home Challenges Submissions

Evaluator 108

ID108
evaluatordtvm-15652
ownerAndrea Censi 🇨🇭
machinedtvm
processdtvm-15652
versionDC:3.1.42;DCR:3.2.4;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success3 483
# timeout1 502
# failed
# error
# aborted1 476
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
502224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationtimeoutnodtvm-156520:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
494268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step3-videossuccessnodtvm-156520:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
49154Andrea Censi 🇨🇭Solution templateaido1_test_multistep-v3step2successyesdtvm-156520:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step21


No reset possible
48330Manfred DiazSolution templateaido1_test_multistep-v3step1successyesdtvm-156520:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step11


No reset possible
476224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizabortednodtvm-156520:07:26
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 530, in wrap_scorer
    evaluator.score(cie)
  File "/visualizer/videos.py", line 12, in score
    logdir = cie.get_completed_step_evaluation_file('step1-simulation', 'episodes')
  File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 398, in get_completed_step_evaluation_file
    return get_completed_step_evaluation_file(self.root, step_name, basename)
  File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 427, in get_completed_step_evaluation_file
    available = get_completed_step_evaluation_files(root, step_name)
  File "/visualizer/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 421, in get_completed_step_evaluation_files
    raise InvalidEnvironment(msg)
InvalidEnvironment: Could not find dir /previous-steps/step1-simulation/challenge-evaluation-output
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible