Duckietown Challenges Home Challenges Submissions

Submission 775

Submission775
Competingyes
Challengeaido1_LF1_r3-v3
UserTim Franzmeyer 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 11723 step2-scoring: 6881 step3-videos: 6883 step4-viz: 6886
Next
User labelAMOD18-AIDO not tht random execution
Admin priority50
Blessingn/a
User priority50

6886

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

6883

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11723step1-simulationerroryes0:03:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6886step4-vizsuccessyes0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.04742661482216626
deviation-center-line_median0.06706775368664313
in-drivable-lane_median0


other stats
deviation-center-line_max0.07245094460723446
deviation-center-line_mean0.05097903643968239
deviation-center-line_min0
deviation-heading_max0.6407455719619255
deviation-heading_mean0.44170466270342457
deviation-heading_median0.5496465875077392
deviation-heading_min0
driven_any_max1.6597045453740809
driven_any_mean0.3972626140734745
driven_any_median0.07665302117189599
driven_any_min0.05665658086618131
driven_lanedir_max0.05064672641817136
driven_lanedir_mean0.037617725773334554
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.4199999999999973
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.6597045453740809, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05665658086618131, "driven_lanedir": 0.041536281827109445, "in-drivable-lane": 0, "deviation-heading": 0.41316327485171694, "deviation-center-line": 0.06706775368664313}, "ep002": {"driven_any": 0.07665302117189599, "driven_lanedir": 0.048479005799225705, "in-drivable-lane": 0, "deviation-heading": 0.6407455719619255, "deviation-center-line": 0.07245094460723446}, "ep003": {"driven_any": 0.1199786418342722, "driven_lanedir": 0.04742661482216626, "in-drivable-lane": 0.46666666666666734, "deviation-heading": 0.6049678791957415, "deviation-center-line": 0.044265128307991175}, "ep004": {"driven_any": 0.07332028112094219, "driven_lanedir": 0.05064672641817136, "in-drivable-lane": 0, "deviation-heading": 0.5496465875077392, "deviation-center-line": 0.0711113555965432}}
No reset possible
6883step3-videossuccessyes0:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6881step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.8333333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.63808721524477, "good_angle": 58.66847121999813, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.06666666666665}, "ep001": {"nsteps": 19, "reward": -53.290431381840456, "good_angle": 0.4100684333027115, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.49999999999999994}, "ep002": {"nsteps": 25, "reward": -40.58239138126373, "good_angle": 0.754252675255224, "survival_time": 0.8333333333333333, "traveled_tiles": 2, "valid_direction": 0.6666666666666665}, "ep003": {"nsteps": 38, "reward": -27.836160013746273, "good_angle": 1.277982506095772, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 1.1000000000000003}, "ep004": {"nsteps": 24, "reward": -42.23857562492291, "good_angle": 0.6130555684083776, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.5999999999999999}}
good_angle_max58.66847121999813
good_angle_mean12.344766080612043
good_angle_median0.754252675255224
good_angle_min0.4100684333027115
reward_max-1.63808721524477
reward_mean-33.11712912340363
reward_median-40.58239138126373
reward_min-53.290431381840456
survival_time_max16.666666666666654
survival_time_mean4.039999999999997
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.06666666666665
valid_direction_mean3.586666666666664
valid_direction_median0.6666666666666665
valid_direction_min0.49999999999999994
No reset possible
6871step1-simulationsuccessno0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6586step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission775/step1-simulation-nutonomy-P50-2210-job6586'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6356step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission775/step1-simulation-nutonomy-P50-2210-job6356'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5809step4-vizsuccessno0:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5808step3-videossuccessno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5807step3-videossuccessno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5806step3-videossuccessno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5799step2-scoringsuccessno0:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5798step2-scoringsuccessno0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5789step1-simulationsuccessno0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5788step1-simulationsuccessno0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible