Duckietown Challenges Home Challenges Submissions

Submission 436

Submission436
Competingyes
Challengeaido1_LF1_r3-v3
UserOrlando Marquez 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13391 step2-scoring: 13399 step3-videos: 13402 step4-viz: 13406
Next
User labelPyTorch DDPG template
Admin priority57
Blessingn/a
User priority57

13406

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13402

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13406step4-vizsuccessyes0:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median9.311616118207551
deviation-center-line_median1.3745504270569049
in-drivable-lane_median1.333333333333331


other stats
deviation-center-line_max1.4011942005038411
deviation-center-line_mean1.3772210504550673
deviation-center-line_min1.3611208237516923
deviation-heading_max11.74707094717592
deviation-heading_mean11.108784947195296
deviation-heading_median11.099677050076671
deviation-heading_min10.351507705045384
driven_any_max14.916078396590851
driven_any_mean14.91589944723149
driven_any_median14.915912413296308
driven_any_min14.915674103930964
driven_lanedir_max9.394942130563432
driven_lanedir_mean9.296269275478387
driven_lanedir_min9.122690663301016
in-drivable-lane_max1.9333333333333311
in-drivable-lane_mean1.3399999999999983
in-drivable-lane_min0.866666666666666
per-episodes
details{"ep000": {"driven_any": 14.916078396590851, "driven_lanedir": 9.356934605061218, "in-drivable-lane": 1.166666666666665, "deviation-heading": 11.325398647950186, "deviation-center-line": 1.369370369314258}, "ep001": {"driven_any": 14.915753925748524, "driven_lanedir": 9.394942130563432, "in-drivable-lane": 0.866666666666666, "deviation-heading": 11.74707094717592, "deviation-center-line": 1.37986943164864}, "ep002": {"driven_any": 14.915912413296308, "driven_lanedir": 9.295162860258728, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 11.020270385728312, "deviation-center-line": 1.3745504270569049}, "ep003": {"driven_any": 14.915674103930964, "driven_lanedir": 9.122690663301016, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 10.351507705045384, "deviation-center-line": 1.4011942005038411}, "ep004": {"driven_any": 14.916078396590809, "driven_lanedir": 9.311616118207551, "in-drivable-lane": 1.333333333333331, "deviation-heading": 11.099677050076671, "deviation-center-line": 1.3611208237516923}}
No reset possible
13402step3-videossuccessyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13399step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.306630763130961, "good_angle": 13.625583836466248, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.83333333333332}, "ep001": {"nsteps": 500, "reward": 0.33102615126920865, "good_angle": 13.66984956822564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.199999999999983}, "ep002": {"nsteps": 500, "reward": 0.2721846809310373, "good_angle": 13.606712335197498, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.666666666666655}, "ep003": {"nsteps": 500, "reward": 0.17541598234581762, "good_angle": 13.661231358784333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.13333333333332}, "ep004": {"nsteps": 500, "reward": 0.2897547553096665, "good_angle": 13.640331732151727, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999988}}
good_angle_max13.66984956822564
good_angle_mean13.640741766165087
good_angle_median13.640331732151727
good_angle_min13.606712335197498
reward_max0.33102615126920865
reward_mean0.2750024665973382
reward_median0.2897547553096665
reward_min0.17541598234581762
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.199999999999983
valid_direction_mean12.966666666666654
valid_direction_median12.999999999999988
valid_direction_min12.666666666666655
No reset possible
13391step1-simulationsuccessyes0:05:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10323step1-simulationfailedno0:09:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 104, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4047step4-vizsuccessno0:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4046step3-videossuccessno0:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4045step3-videossuccessno0:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4044step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4041step1-simulationsuccessno0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible