Duckietown Challenges Home Challenges Submissions

Evaluator 292

ID292
evaluatornutonomy-P50-2110
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-2110
versionDC:3.1.54;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success17 5750
# timeout
# failed
# error
# aborted4 5851
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5946799Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videosabortednonutonomy-P50-21100:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5932799Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortednonutonomy-P50-21100:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5925799Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringabortednonutonomy-P50-21100:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.833333333333306


other stats
episodes
details{"ep000": {"nsteps": 204, "reward": -6.7331884848136525, "good_angle": 29.572980253786163, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 4.699999999999983}, "ep001": {"nsteps": 452, "reward": -3.059079861185983, "good_angle": 27.6059563105319, "survival_time": 15.066666666666624, "traveled_tiles": 3, "valid_direction": 4.699999999999983}, "ep002": {"nsteps": 336, "reward": -3.0095930438303964, "good_angle": 0.184076416761546, "survival_time": 11.19999999999997, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 310, "reward": -5.454106606206587, "good_angle": 31.408071657883266, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 4.699999999999984}, "ep004": {"nsteps": 325, "reward": -4.930836339840361, "good_angle": 5.946495714391657, "survival_time": 10.833333333333306, "traveled_tiles": 3, "valid_direction": 3.566666666666655}}
good_angle_max31.408071657883266
good_angle_mean18.943516070670903
good_angle_median27.6059563105319
good_angle_min0.184076416761546
reward_max-3.0095930438303964
reward_mean-4.637360867175396
reward_median-4.930836339840361
reward_min-6.7331884848136525
survival_time_max15.066666666666624
survival_time_mean10.84666666666664
survival_time_min6.799999999999986
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.699999999999984
valid_direction_mean3.5333333333333217
valid_direction_median4.699999999999983
valid_direction_min0
No reset possible
5920798Luca BonaminiRandom executionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-21100:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5908795Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-21100:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5901795Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-21100:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5899792Edoardo Gabbi 🇮🇹Random executionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-21100:00:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5891792Edoardo Gabbi 🇮🇹Random executionaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-21100:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 119, "reward": -10.29928544088572, "good_angle": 17.226891564339322, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 2.766666666666662}, "ep001": {"nsteps": 264, "reward": -4.779882687623754, "good_angle": 16.51740361855984, "survival_time": 8.79999999999998, "traveled_tiles": 3, "valid_direction": 2.7666666666666577}, "ep002": {"nsteps": 279, "reward": -3.644003686591512, "good_angle": 0.06896665489742422, "survival_time": 9.299999999999978, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.788495979256393, "good_angle": 18.313907760322827, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 2.766666666666657}, "ep004": {"nsteps": 190, "reward": -7.142260233303042, "good_angle": 3.5933936079923985, "survival_time": 6.333333333333321, "traveled_tiles": 3, "valid_direction": 2.1333333333333258}}
good_angle_max18.313907760322827
good_angle_mean11.144112641222362
good_angle_median16.51740361855984
good_angle_min0.06896665489742422
reward_max-3.644003686591512
reward_mean-6.730785605532084
reward_median-7.142260233303042
reward_min-10.29928544088572
survival_time_max9.299999999999978
survival_time_mean6.886666666666652
survival_time_min3.9666666666666623
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.766666666666662
valid_direction_mean2.08666666666666
valid_direction_median2.766666666666657
valid_direction_min0
No reset possible
5887792Edoardo Gabbi 🇮🇹Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-21100:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5883789Mikita Sazanovich 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-21100:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5866784hanxue liangRandom executionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-21100:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5851786Marta Tintore 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortednonutonomy-P50-21100:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5834782Zijian Dong 🇨🇳AMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-21100:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5832779Aleksandar Petrov 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-21100:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5828780Amaury Camus 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-21100:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5816777Yannick BerdouAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-21100:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5805777Yannick BerdouAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-21100:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.166666666666665


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -18.55895467996597, "good_angle": 8.631361811097454, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.4000000000000028}, "ep001": {"nsteps": 132, "reward": -8.560128116697976, "good_angle": 8.371777309085797, "survival_time": 4.399999999999994, "traveled_tiles": 3, "valid_direction": 1.399999999999995}, "ep002": {"nsteps": 140, "reward": -7.20356833904516, "good_angle": 0.034675126335285154, "survival_time": 4.66666666666666, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 91, "reward": -13.248195889231924, "good_angle": 9.188896207380877, "survival_time": 3.0333333333333323, "traveled_tiles": 3, "valid_direction": 1.3999999999999972}, "ep004": {"nsteps": 95, "reward": -12.396050412678404, "good_angle": 1.806465789696306, "survival_time": 3.166666666666665, "traveled_tiles": 3, "valid_direction": 1.0666666666666629}}
good_angle_max9.188896207380877
good_angle_mean5.606635248719142
good_angle_median8.371777309085797
good_angle_min0.034675126335285154
reward_max-7.20356833904516
reward_mean-11.993379487523889
reward_median-12.396050412678404
reward_min-18.55895467996597
survival_time_max4.66666666666666
survival_time_mean3.4533333333333305
survival_time_min2.0000000000000027
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.4000000000000028
valid_direction_mean1.0533333333333317
valid_direction_median1.399999999999995
valid_direction_min0
No reset possible
5797776Alessandro MorraAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-21100:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5785774Gianmarco BernasconiNot Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-21100:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5757766Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step4-vizsuccessnonutonomy-P50-21100:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5750765Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-21100:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.633333333333313


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.73651718135391, "good_angle": 23.848374609970847, "survival_time": 5.59999999999999, "traveled_tiles": 2, "valid_direction": 3.8666666666666543}, "ep001": {"nsteps": 379, "reward": -3.182353427777396, "good_angle": 20.844525634495124, "survival_time": 12.6333333333333, "traveled_tiles": 3, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 255, "reward": -3.954567064091052, "good_angle": 0.1750858106248234, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 259, "reward": -6.242146121949303, "good_angle": 26.09013709887037, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.5840711386159505, "good_angle": 5.0010487282363805, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.09013709887037
good_angle_mean15.19183437643951
good_angle_median20.844525634495124
good_angle_min0.1750858106248234
reward_max-3.182353427777396
reward_mean-5.339930986757522
reward_median-5.5840711386159505
reward_min-7.73651718135391
survival_time_max12.6333333333333
survival_time_mean8.879999999999978
survival_time_min5.59999999999999
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.966666666666653
valid_direction_mean2.9533333333333234
valid_direction_median3.8666666666666543
valid_direction_min0
No reset possible