Duckietown Challenges Home Challenges Submissions

Evaluator 199

ID199
evaluatoridsc-rudolf-11443
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-11443
versionDC:3.1.47;DCR:3.2.10;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success3 2687
# timeout4 2705
# failed1 2681
# error
# aborted3 2719
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
2731166Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step4-vizabortednoidsc-rudolf-114430:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2728166Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step3-videosabortednoidsc-rudolf-114430:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2719166Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step2-scoringabortednoidsc-rudolf-114430:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.6999999999999895


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.739076233049582, "good_angle": 24.99373480414379, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 358, "reward": -3.542345441503232, "good_angle": 17.10589711158306, "survival_time": 11.933333333333302, "traveled_tiles": 3, "valid_direction": 3.9999999999999862}, "ep002": {"nsteps": 114, "reward": -9.93257513707667, "good_angle": 4.298503973974893, "survival_time": 3.799999999999996, "traveled_tiles": 1, "valid_direction": 3.0333333333333297}, "ep003": {"nsteps": 42, "reward": -25.59433995542072, "good_angle": 0.04070231407991517, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 331, "reward": -3.789489026971336, "good_angle": 0.1510300120516093, "survival_time": 11.033333333333305, "traveled_tiles": 4, "valid_direction": 0}}
good_angle_max24.99373480414379
good_angle_mean9.317973643166654
good_angle_median4.298503973974893
good_angle_min0.04070231407991517
reward_max-3.542345441503232
reward_mean-10.11956515880431
reward_median-7.739076233049582
reward_min-25.59433995542072
survival_time_max11.933333333333302
survival_time_mean6.773333333333319
survival_time_min1.400000000000001
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.9999999999999862
valid_direction_mean2.1999999999999944
valid_direction_median3.0333333333333297
valid_direction_min0
No reset possible
2714267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringtimeoutnoidsc-rudolf-114430:11:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2711305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-viztimeoutnoidsc-rudolf-114430:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2708306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-viztimeoutnoidsc-rudolf-114430:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2705306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-viztimeoutnoidsc-rudolf-114430:11:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2699306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessnoidsc-rudolf-114430:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2694305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnoidsc-rudolf-114430:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.6460242309765505, "good_angle": 24.249066480473875, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 375, "reward": -3.8768316665490463, "good_angle": 24.539164796989667, "survival_time": 12.499999999999966, "traveled_tiles": 3, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 500, "reward": 0.2011011467983481, "good_angle": 0.5805570292675675, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.2666666666666977}, "ep003": {"nsteps": 258, "reward": -6.073310826175897, "good_angle": 25.417973555772736, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.602108182520451, "good_angle": 5.549369878553417, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.0666666666666567}}
good_angle_max25.417973555772736
good_angle_mean16.067226348211452
good_angle_median24.249066480473875
good_angle_min0.5805570292675675
reward_max0.2011011467983481
reward_mean-4.599434751884719
reward_median-5.602108182520451
reward_min-7.6460242309765505
survival_time_max16.666666666666654
survival_time_mean10.49999999999998
survival_time_min5.6999999999999895
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666544
valid_direction_mean3.226666666666663
valid_direction_median3.899999999999986
valid_direction_min1.2666666666666977
No reset possible
2687305Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-114430:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2681310Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-114430:10:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible