Duckietown Challenges Home Challenges Submissions

Submission 773

Submission773
Competingyes
Challengeaido1_LF1_r3-v3
UserAmaury Camus 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11704 step2-scoring: 11707 step3-videos: 11709 step4-viz: 11711
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
Blessingn/a
User priority50

11711

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11709

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11711step4-vizsuccessyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4894326591386844
deviation-center-line_median0.10159491874534542
in-drivable-lane_median0.2666666666666667


other stats
deviation-center-line_max0.11559937270810716
deviation-center-line_mean0.08282191850267559
deviation-center-line_min0.02743801479716522
deviation-heading_max0.770108248316512
deviation-heading_mean0.4503493147067932
deviation-heading_median0.41209290450046726
deviation-heading_min0.0948856061765822
driven_any_max1.1983820471401816
driven_any_mean0.7767767072516831
driven_any_median0.846413340904546
driven_any_min0.16272225453819997
driven_lanedir_max0.7220398668396617
driven_lanedir_mean0.5091146229978228
driven_lanedir_min0.1532558876545953
in-drivable-lane_max0.6666666666666666
in-drivable-lane_mean0.28666666666666696
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.9499640131782666, "driven_lanedir": 0.47091672106597704, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0.41209290450046726, "deviation-center-line": 0.10159491874534542}, "ep001": {"driven_any": 0.16272225453819997, "driven_lanedir": 0.1532558876545953, "in-drivable-lane": 0, "deviation-heading": 0.0948856061765822, "deviation-center-line": 0.02743801479716522}, "ep002": {"driven_any": 0.846413340904546, "driven_lanedir": 0.4894326591386844, "in-drivable-lane": 0.2666666666666667, "deviation-heading": 0.7386266900232743, "deviation-center-line": 0.1048251255779308}, "ep003": {"driven_any": 1.1983820471401816, "driven_lanedir": 0.7220398668396617, "in-drivable-lane": 0.5000000000000013, "deviation-heading": 0.770108248316512, "deviation-center-line": 0.11559937270810716}, "ep004": {"driven_any": 0.726401880497221, "driven_lanedir": 0.7099279802901961, "in-drivable-lane": 0, "deviation-heading": 0.23603312451712977, "deviation-center-line": 0.0646521606848293}}
No reset possible
11709step3-videossuccessyes0:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11707step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.466666666666668


other stats
episodes
details{"ep000": {"nsteps": 49, "reward": -20.629765765104747, "good_angle": 0.4483085155065757, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 1.133333333333335}, "ep001": {"nsteps": 10, "reward": -99.75981116220356, "good_angle": 0.03589697696020486, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.1}, "ep002": {"nsteps": 44, "reward": -22.20786445858804, "good_angle": 0.4891297095591765, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.7333333333333347}, "ep003": {"nsteps": 64, "reward": -15.322045463937684, "good_angle": 0.8550957756948183, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 1.0333333333333352}, "ep004": {"nsteps": 40, "reward": -24.44970727339387, "good_angle": 0.06481757410176862, "survival_time": 1.333333333333334, "traveled_tiles": 3, "valid_direction": 0.16666666666666674}}
good_angle_max0.8550957756948183
good_angle_mean0.3786497103645088
good_angle_median0.4483085155065757
good_angle_min0.03589697696020486
reward_max-15.322045463937684
reward_mean-36.473838824645576
reward_median-22.20786445858804
reward_min-99.75981116220356
survival_time_max2.1333333333333355
survival_time_mean1.3800000000000012
survival_time_min0.3333333333333333
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.133333333333335
valid_direction_mean0.6333333333333344
valid_direction_median0.7333333333333347
valid_direction_min0.1
No reset possible
11704step1-simulationsuccessyes0:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6891step4-vizsuccessyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6888step3-videossuccessyes0:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6885step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6877step1-simulationsuccessno0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6588step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission773/step1-simulation-nutonomy-P50-2570-job6588'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6359step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission773/step1-simulation-nutonomy-P50-2210-job6359'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5796step4-vizabortedno0:00:52
Error while running [...]

Creating job5796-6102_videos_1 ... error
stderr | ERROR: for job5796-6102_videos_1  Cannot start service videos: network job5796-6102_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job5796-6102_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5795step3-videossuccessno0:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5787step2-scoringsuccessno0:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5783step1-simulationsuccessno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible