Duckietown Challenges Home Challenges Submissions

Submission 729

Submission729
Competingyes
Challengeaido1_LF1_r3-v3
UserAnton Mashikhin 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13816 step2-scoring: 13820 step3-videos: 13825 step4-viz: 13835
Next
User labelAI DL RL MML XXXL 2k18 yoo
Admin priority50
Blessingn/a
User priority50

13835

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13825

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13835step4-vizsuccessyes0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.9719025309559286
deviation-center-line_median1.2828172855158575
in-drivable-lane_median0.6999999999999982


other stats
deviation-center-line_max1.3268156399619444
deviation-center-line_mean0.8158175883315473
deviation-center-line_min0
deviation-heading_max12.30286214726098
deviation-heading_mean7.492911373676364
deviation-heading_median11.791788515571948
deviation-heading_min0
driven_any_max4.639692202041085
driven_any_mean2.9515150393707104
driven_any_median4.639692202041062
driven_any_min0.232916275202866
driven_lanedir_max2.97366098162551
driven_lanedir_mean1.8585194438277488
driven_lanedir_min0
in-drivable-lane_max0.8666666666666666
in-drivable-lane_mean0.5799999999999993
in-drivable-lane_min0.16666666666666685
per-episodes
details{"ep000": {"driven_any": 0.232916275202866, "driven_lanedir": 0, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 4.639692202041062, "driven_lanedir": 2.973359424269386, "in-drivable-lane": 0.7333333333333325, "deviation-heading": 11.791788515571948, "deviation-center-line": 1.299074331276045}, "ep002": {"driven_any": 0.6055823155274532, "driven_lanedir": 0.3736742822879182, "in-drivable-lane": 0.16666666666666685, "deviation-heading": 1.5163173734972024, "deviation-center-line": 0.17038068490388883}, "ep003": {"driven_any": 4.6396922020410845, "driven_lanedir": 2.97366098162551, "in-drivable-lane": 0.6999999999999982, "deviation-heading": 11.853588832051686, "deviation-center-line": 1.2828172855158575}, "ep004": {"driven_any": 4.639692202041085, "driven_lanedir": 2.9719025309559286, "in-drivable-lane": 0.43333333333333224, "deviation-heading": 12.30286214726098, "deviation-center-line": 1.3268156399619444}}
No reset possible
13825step3-videossuccessyes0:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13820step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 27, "reward": -38.80096993181441, "good_angle": 0.5670615028987019, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.6999999999999998}, "ep001": {"nsteps": 500, "reward": 0.21128437551110985, "good_angle": 13.418610029853284, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.9}, "ep002": {"nsteps": 67, "reward": -14.764856543113936, "good_angle": 1.8488018607767789, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 1.7666666666666693}, "ep003": {"nsteps": 500, "reward": 0.21980279483040796, "good_angle": 13.45476251240043, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.9}, "ep004": {"nsteps": 500, "reward": 0.23003951618261637, "good_angle": 13.540210786108863, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.966666666666663}}
good_angle_max13.540210786108863
good_angle_mean8.565889338407612
good_angle_median13.418610029853284
good_angle_min0.5670615028987019
reward_max0.23003951618261637
reward_mean-10.580939957680842
reward_median0.21128437551110985
reward_min-38.80096993181441
survival_time_max16.666666666666654
survival_time_mean10.62666666666666
survival_time_min0.8999999999999999
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.966666666666663
valid_direction_mean8.246666666666666
valid_direction_median12.9
valid_direction_min0.6999999999999998
No reset possible
13816step1-simulationsuccessyes0:06:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6632step1-simulationfailedno0:06:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 116, in run
    solve(params, cis)
  File "solution.py", line 81, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6631step1-simulationsuccessno0:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6400step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission729'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5594step4-vizsuccessno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5593step4-vizsuccessno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5592step4-vizsuccessno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5591step3-videossuccessno0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5590step2-scoringsuccessno0:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5589step1-simulationsuccessno0:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible