Duckietown Challenges Home Challenges Submissions

Evaluator 198

ID198
evaluatorrudolf-3
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-3
versionDC:3.1.47;DCR:3.2.10;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success5 2686
# timeout5 2707
# failed1 2680
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
2732165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videostimeoutnorudolf-30:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2730165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnorudolf-30:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.633333333333313


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.812373652177699, "good_angle": 24.087746930908946, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 376, "reward": -3.3345901525840707, "good_angle": 22.08298366314928, "survival_time": 12.5333333333333, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 259, "reward": -3.910537747261708, "good_angle": 0.16612215408925146, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 257, "reward": -6.108992447648995, "good_angle": 24.958607361599043, "survival_time": 8.566666666666647, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep004": {"nsteps": 271, "reward": -5.544229294305729, "good_angle": 4.7541386616447125, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max24.958607361599043
good_angle_mean15.209919754278246
good_angle_median22.08298366314928
good_angle_min0.16612215408925146
reward_max-3.3345901525840707
reward_mean-5.3421446587956405
reward_median-5.544229294305729
reward_min-7.812373652177699
survival_time_max12.5333333333333
survival_time_mean8.886666666666645
survival_time_min5.666666666666656
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.933333333333321
valid_direction_mean2.9533333333333234
valid_direction_median3.899999999999987
valid_direction_min0
No reset possible
2721165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2716268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step4-viztimeoutnorudolf-30:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2713267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringtimeoutnorudolf-30:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2710305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-viztimeoutnorudolf-30:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2707306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-viztimeoutnorudolf-30:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2700305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessnorudolf-30:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2695305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnorudolf-30:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.6460242309765505, "good_angle": 24.249066480473875, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 375, "reward": -3.8768316665490463, "good_angle": 24.539164796989667, "survival_time": 12.499999999999966, "traveled_tiles": 3, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 500, "reward": 0.2011011467983481, "good_angle": 0.5805570292675675, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.2666666666666977}, "ep003": {"nsteps": 258, "reward": -6.073310826175897, "good_angle": 25.417973555772736, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.602108182520451, "good_angle": 5.549369878553417, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.0666666666666567}}
good_angle_max25.417973555772736
good_angle_mean16.067226348211452
good_angle_median24.249066480473875
good_angle_min0.5805570292675675
reward_max0.2011011467983481
reward_mean-4.599434751884719
reward_median-5.602108182520451
reward_min-7.6460242309765505
survival_time_max16.666666666666654
survival_time_mean10.49999999999998
survival_time_min5.6999999999999895
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666544
valid_direction_mean3.226666666666663
valid_direction_median3.899999999999986
valid_direction_min1.2666666666666977
No reset possible
2686306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2680312Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible