Duckietown Challenges Home Challenges Submissions

Evaluator 79

ID79
evaluatornutonomy-P50-29851
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-29851
versionDC:3.1.41;DCR:3.2.3;DTS:3.0.24
first heard
last heard
statusinactive
# evaluating
# success22 376
# timeout
# failed
# error
# aborted2 395
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
462265Mandana Samiei 🇨🇦Solution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score17.626741646983447


No reset possible
461264Mandana Samiei 🇨🇦Tensorflow templateaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean3.0999999999999956
good_angle_mean0.8570140833982431
valid_direction_mean1.0799999999999996


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 40, "reward": -27.01203115135431, "good_angle": 0.3688051618962453, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.9000000000000004}, "ep004": {"nsteps": 110, "reward": -9.894138616831466, "good_angle": 0.7900234528606676, "survival_time": 1.166666666666667, "traveled_tiles": 5, "valid_direction": 1.899999999999998}}
good_angle_max2.464011645649803
good_angle_median0.44670148280839816
good_angle_min0.21552867377610185
reward_max-4.432748170956362
reward_mean-14.708630419364832
reward_median-9.894138616831466
reward_min-27.01203115135431
survival_time_max7.899999999999982
survival_time_median1.500000000000001
survival_time_min1.166666666666667
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_min1
valid_direction_max1.899999999999998
valid_direction_median0.9000000000000004
valid_direction_min0.5333333333333314
No reset possible
458262Vadim Volodin 🇷🇺Simple based on center pixelaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean1.4466666666666677
good_angle_mean33.66180062299222
valid_direction_mean4.846666666666651


other stats
episodes
details{"ep000": {"nsteps": 43, "reward": -24.1210139712622, "good_angle": 0.0001490357416107672, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0}, "ep001": {"nsteps": 500, "reward": -0.779671716362238, "good_angle": 59.90173853263349, "survival_time": 1.3666666666666676, "traveled_tiles": 6, "valid_direction": 10.099999999999966}, "ep002": {"nsteps": 500, "reward": -1.5157463335990906, "good_angle": 0.565799216449206, "survival_time": 1.466666666666668, "traveled_tiles": 3, "valid_direction": 0.6999999999999998}, "ep003": {"nsteps": 23, "reward": -45.41889384518499, "good_angle": 0.0007966565707015758, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -3.354815784573555, "good_angle": 107.84051967356608, "survival_time": 2.200000000000002, "traveled_tiles": 5, "valid_direction": 13.433333333333287}}
good_angle_max107.84051967356608
good_angle_median0.565799216449206
good_angle_min0.0001490357416107672
reward_max-0.779671716362238
reward_mean-15.038028330196417
reward_median-3.354815784573555
reward_min-45.41889384518499
survival_time_max2.200000000000002
survival_time_median1.4333333333333345
survival_time_min0.7666666666666666
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_min1
valid_direction_max13.433333333333287
valid_direction_median0.6999999999999998
valid_direction_min0
No reset possible
435251David AbrahamRandom executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
433249Laurent MandrileRandom executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean19.8803917415779
valid_direction_mean13.566666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.716711878657341, "good_angle": 12.928631578606826, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.799999999999992}, "ep001": {"nsteps": 500, "reward": -0.6267161850109696, "good_angle": 26.832388208911254, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 16.06666666666663}, "ep002": {"nsteps": 500, "reward": -1.5259272064566611, "good_angle": 18.031352217728003, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 10.899999999999997}, "ep003": {"nsteps": 500, "reward": -0.8399770502801984, "good_angle": 15.92773724687262, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.599999999999987}, "ep004": {"nsteps": 500, "reward": -1.1113408311866224, "good_angle": 25.681849455770795, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.466666666666663}}
good_angle_max26.832388208911254
good_angle_median18.031352217728003
good_angle_min12.928631578606826
reward_max-0.6267161850109696
reward_mean-1.1641346303183586
reward_median-1.1113408311866224
reward_min-1.716711878657341
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max16.06666666666663
valid_direction_median13.799999999999992
valid_direction_min10.899999999999997
No reset possible
430248Ikra Monjur 🇺🇸Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
422241Emma Sung 🇺🇸Random executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean22.02311555656599
valid_direction_mean12.559999999999992


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.920630420446396, "good_angle": 9.42156234290726, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 10.766666666666652}, "ep001": {"nsteps": 500, "reward": -0.5217390315292869, "good_angle": 66.16948420170264, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 16.39999999999998}, "ep002": {"nsteps": 500, "reward": -1.3886782833337783, "good_angle": 10.474530149205336, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.566666666666666}, "ep003": {"nsteps": 500, "reward": -0.8641132079366652, "good_angle": 11.867354211931431, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.233333333333327}, "ep004": {"nsteps": 500, "reward": -1.578261361837387, "good_angle": 12.182646877083304, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.833333333333329}}
good_angle_max66.16948420170264
good_angle_median11.867354211931431
good_angle_min9.42156234290726
reward_max-0.5217390315292869
reward_mean-1.0546844610167028
reward_median-0.920630420446396
reward_min-1.578261361837387
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max16.39999999999998
valid_direction_median11.833333333333329
valid_direction_min10.566666666666666
No reset possible
420240Emma Sung 🇺🇸Random executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean26.587435657101658
valid_direction_mean13.633333333333322


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0176489030122755, "good_angle": 18.617818819476415, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.199999999999994}, "ep001": {"nsteps": 500, "reward": -0.8716742685264908, "good_angle": 41.07462361123737, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 15.866666666666651}, "ep002": {"nsteps": 500, "reward": -1.1847928442955018, "good_angle": 47.115231328357, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.23333333333332}, "ep003": {"nsteps": 500, "reward": -0.6607411708626896, "good_angle": 11.591295321672384, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.43333333333332}, "ep004": {"nsteps": 500, "reward": -1.2609345889687538, "good_angle": 14.5382092047651, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.43333333333332}}
good_angle_max47.115231328357
good_angle_median18.617818819476415
good_angle_min11.591295321672384
reward_max-0.6607411708626896
reward_mean-0.9991583551331424
reward_median-1.0176489030122755
reward_min-1.2609345889687538
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max15.866666666666651
valid_direction_median13.43333333333332
valid_direction_min10.43333333333332
No reset possible
418239Emma Sung 🇺🇸Solution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score127.689130343027273


No reset possible
409233Benjamin Ramtoula 🇨🇦Template for ROS Submissionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
407232John Hughes 🇺🇸Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
406231John Hughes 🇺🇸Solution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score152.095840755040726


No reset possible
404230Irene Hung 🇺🇸Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
403229Irene Hung 🇺🇸Solution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score144.18463844201344


No reset possible
402228Philippe LacailleRandom executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean11.350653378370495
valid_direction_mean11.833333333333323


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9806589748188272, "good_angle": 14.930434269644056, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.733333333333324}, "ep001": {"nsteps": 500, "reward": -1.8157041236162184, "good_angle": 4.196235290568257, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 8.333333333333318}, "ep002": {"nsteps": 500, "reward": -1.7923278148472308, "good_angle": 15.507665313350032, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.933333333333318}, "ep003": {"nsteps": 500, "reward": -1.212890817284584, "good_angle": 10.885805088807745, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.333333333333332}, "ep004": {"nsteps": 500, "reward": -1.5788201929330823, "good_angle": 11.233126929482388, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 12.833333333333329}}
good_angle_max15.507665313350032
good_angle_median11.233126929482388
good_angle_min4.196235290568257
reward_max-0.9806589748188272
reward_mean-1.4760803846999884
reward_median-1.5788201929330823
reward_min-1.8157041236162184
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_min1
valid_direction_max14.733333333333324
valid_direction_median11.933333333333318
valid_direction_min8.333333333333318
No reset possible
401228Philippe LacailleRandom executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
400227Ahmad Roumie 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score165.03128303271235


No reset possible
399226Philippe LacailleSolution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score144.431736853011415


No reset possible
398225Jonathan Plante 🇨🇦Solution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score117.63050261297377


No reset possible
397224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videosabortednonutonomy-P50-298510:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
395224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortednonutonomy-P50-298510:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
392222Suzanne PetrykRandom executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
383211Andrea Censi 🇨🇭Python templateaido1_amod_fleet_size_r1-v3step2-scoringsuccessyesnutonomy-P50-298510:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-62.53162920579799
service_quality-31.995517301450096
No reset possible
376211Andrea Censi 🇨🇭Python templateaido1_amod_fleet_size_r1-v3step1-simulationsuccessnonutonomy-P50-298510:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible