Duckietown Challenges Home Challenges Submissions

Submission 689

Submission689
Competingyes
Challengeaido1_LF1_r3-v3
UserMandana Samiei 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 13370 step2-scoring: 7132 step3-videos: 7134 step4-viz: 7138
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

7138

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

7134

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13370step1-simulationfailedyes0:08:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7138step4-vizsuccessyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.163587505423334
deviation-center-line_median0.14090614756679057
in-drivable-lane_median0


other stats
deviation-center-line_max0.361985590230278
deviation-center-line_mean0.18275758894104777
deviation-center-line_min0.0730502489089567
deviation-heading_max1.7721669502942847
deviation-heading_mean0.8405589602830114
deviation-heading_median0.6095677373580766
deviation-heading_min0.395649211909228
driven_any_max0.7857352523890606
driven_any_mean0.2950026166379576
driven_any_median0.19285406594748625
driven_any_min0.06784959615308007
driven_lanedir_max0.5485313658051105
driven_lanedir_mean0.23069338720056196
driven_lanedir_min0.0524430454333471
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857352523890606, "driven_lanedir": 0.5485313658051105, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7721669502942847, "deviation-center-line": 0.361985590230278}, "ep001": {"driven_any": 0.06784959615308007, "driven_lanedir": 0.0524430454333471, "in-drivable-lane": 0, "deviation-heading": 0.395649211909228, "deviation-center-line": 0.0730502489089567}, "ep002": {"driven_any": 0.1785716907122184, "driven_lanedir": 0.1564801120218069, "in-drivable-lane": 0, "deviation-heading": 0.6095677373580766, "deviation-center-line": 0.14090614756679057}, "ep003": {"driven_any": 0.19285406594748625, "driven_lanedir": 0.163587505423334, "in-drivable-lane": 0, "deviation-heading": 0.8219507291376054, "deviation-center-line": 0.1232526807136534}, "ep004": {"driven_any": 0.2500024779879429, "driven_lanedir": 0.23242490731921128, "in-drivable-lane": 0, "deviation-heading": 0.6034601727158618, "deviation-center-line": 0.2145932772855602}}
No reset possible
7134step3-videossuccessyes0:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7132step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8666666666666691


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.6725652776417315, "good_angle": 0.7619739059953089, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.3666666666666618}, "ep001": {"nsteps": 21, "reward": -48.25360845384144, "good_angle": 0.38521134577333366, "survival_time": 0.7, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 52, "reward": -19.68344509372344, "good_angle": 0.5169259604290245, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.5666666666666684}, "ep003": {"nsteps": 56, "reward": -18.227136365803226, "good_angle": 0.6489835124272907, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.7333333333333356}, "ep004": {"nsteps": 72, "reward": -14.369265000439352, "good_angle": 0.39804197168283767, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.599999999999999}}
good_angle_max0.7619739059953089
good_angle_mean0.5422273392615591
good_angle_median0.5169259604290245
good_angle_min0.38521134577333366
reward_max-4.6725652776417315
reward_mean-21.04120403828984
reward_median-18.227136365803226
reward_min-48.25360845384144
survival_time_max7.399999999999984
survival_time_mean2.819999999999998
survival_time_min0.7
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3666666666666618
valid_direction_mean0.7399999999999997
valid_direction_median0.599999999999999
valid_direction_min0.4333333333333333
No reset possible
7120step1-simulationsuccessno0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6674step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission689/step1-simulation-nutonomy-P50-2110-job6674'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6475step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission689/step1-simulation-nutonomy-P50-2210-job6475'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5399step1-simulationfailedno0:06:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible