Duckietown Challenges Home Challenges Submissions

Submission 712

Submission712
Competingyes
Challengeaido1_LF1_r3-v3
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13629 step2-scoring: 13642 step3-videos: 13645 step4-viz: 13650
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

13650

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13645

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13650step4-vizsuccessyes0:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1374889235448205
deviation-center-line_median0.2520393826581857
in-drivable-lane_median0


other stats
deviation-center-line_max2.03255640822436
deviation-center-line_mean0.894261041262226
deviation-center-line_min0.04685026574068999
deviation-heading_max1.9648959938482315
deviation-heading_mean0.990957686580287
deviation-heading_median1.1853642404885243
deviation-heading_min0.1373106535319752
driven_any_max5.335405555710802
driven_any_mean2.5240196399485333
driven_any_median1.2208212777141358
driven_any_min0.149884451234161
driven_lanedir_max3.460325074454387
driven_lanedir_mean1.7110849863588768
driven_lanedir_min0.13984549915618238
in-drivable-lane_max6.033333333333314
in-drivable-lane_mean2.259999999999992
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.335405555710802, "driven_lanedir": 3.2423342570895275, "in-drivable-lane": 6.033333333333314, "deviation-heading": 1.5034850227712455, "deviation-center-line": 2.03255640822436}, "ep001": {"driven_any": 0.5785992351871089, "driven_lanedir": 0.5754311775494676, "in-drivable-lane": 0, "deviation-heading": 0.163732522261458, "deviation-center-line": 0.17774150813757067}, "ep002": {"driven_any": 1.2208212777141358, "driven_lanedir": 1.1374889235448205, "in-drivable-lane": 0, "deviation-heading": 1.1853642404885243, "deviation-center-line": 0.2520393826581857}, "ep003": {"driven_any": 5.33538767989646, "driven_lanedir": 3.460325074454387, "in-drivable-lane": 5.266666666666648, "deviation-heading": 1.9648959938482315, "deviation-center-line": 1.9621176415503232}, "ep004": {"driven_any": 0.149884451234161, "driven_lanedir": 0.13984549915618238, "in-drivable-lane": 0, "deviation-heading": 0.1373106535319752, "deviation-center-line": 0.04685026574068999}}
No reset possible
13645step3-videossuccessyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13642step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8666666666666623


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.03399783622240648, "good_angle": 2.5879587635967822, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.500000000000016}, "ep001": {"nsteps": 56, "reward": -17.565453245969756, "good_angle": 0.0200453150176543, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 116, "reward": -8.149260365895943, "good_angle": 0.2606366121500726, "survival_time": 3.8666666666666623, "traveled_tiles": 3, "valid_direction": 0.533333333333332}, "ep003": {"nsteps": 500, "reward": 0.10452219875674928, "good_angle": 2.1889535769206447, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.96666666666669}, "ep004": {"nsteps": 16, "reward": -62.290221896604635, "good_angle": 0.1469362066838789, "survival_time": 0.5333333333333333, "traveled_tiles": 2, "valid_direction": 0.13333333333333336}}
good_angle_max2.5879587635967822
good_angle_mean1.0409060948738067
good_angle_median0.2606366121500726
good_angle_min0.0200453150176543
reward_max0.10452219875674928
reward_mean-17.5868822291872
reward_median-8.149260365895943
reward_min-62.290221896604635
survival_time_max16.666666666666654
survival_time_mean7.919999999999995
survival_time_min0.5333333333333333
traveled_tiles_max10
traveled_tiles_mean5.4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.500000000000016
valid_direction_mean1.4266666666666743
valid_direction_median0.533333333333332
valid_direction_min0
No reset possible
13629step1-simulationsuccessyes0:04:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7039step1-simulationfailedno0:09:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6650step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission712/step1-simulation-nutonomy-P50-2110-job6650'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6444step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission712/step1-simulation-nutonomy-P50-2570-job6444'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5500step4-vizsuccessno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5499step4-vizsuccessno0:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5498step4-vizsuccessno0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5497step3-videossuccessno0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5496step2-scoringsuccessno0:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5495step2-scoringsuccessno0:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5493step1-simulationsuccessno0:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible