Duckietown Challenges Home Challenges Submissions

Submission 334

Submission334
Competingyes
Challengeaido1_LFV_r1-v3
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11571 step2-scoring: 11578 step3-videos: 11583 step4-viz: 15495
Next
User labelTensorflow template
Admin priority60
Blessingn/a
User priority60

15495

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11583

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
15495step4-vizsuccessyes0:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.023355043530481123
deviation-center-line_median0.07775975196317281
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.2528457512861703
deviation-center-line_mean0.10717561570835366
deviation-center-line_min0.02973567662582986
deviation-heading_max0.40591590002918265
deviation-heading_mean0.23229935656336412
deviation-heading_median0.17380540498635186
deviation-heading_min0.1302387436108034
driven_any_max0.1059126335538316
driven_any_mean0.041048459540552765
driven_any_median0.024175203773013784
driven_any_min0.011136545815414806
driven_lanedir_consec_max0.10533221428365934
driven_lanedir_consec_mean0.03832628120521449
driven_lanedir_consec_min0.00017354072185680927
driven_lanedir_max0.10533221428365934
driven_lanedir_mean0.03865077745354123
driven_lanedir_median0.023355043530481123
driven_lanedir_min0.001796021963490483
in-drivable-lane_max0.13333333333333333
in-drivable-lane_mean0.039999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.011136545815414806, "driven_lanedir": 0.001796021963490483, "in-drivable-lane": 0.13333333333333333, "deviation-heading": 0.40591590002918265, "deviation-center-line": 0.02973567662582986, "driven_lanedir_consec": 0.00017354072185680927}, "ep001": {"driven_any": 0.024175203773013784, "driven_lanedir": 0.02325270272447173, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.1302387436108034, "deviation-center-line": 0.059661438319126826, "driven_lanedir_consec": 0.02325270272447173}, "ep002": {"driven_any": 0.1059126335538316, "driven_lanedir": 0.10533221428365934, "in-drivable-lane": 0, "deviation-heading": 0.3136524445887545, "deviation-center-line": 0.2528457512861703, "driven_lanedir_consec": 0.10533221428365934}, "ep003": {"driven_any": 0.02408095443404853, "driven_lanedir": 0.023355043530481123, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.13788428960172827, "deviation-center-line": 0.07775975196317281, "driven_lanedir_consec": 0.023355043530481123}, "ep004": {"driven_any": 0.03993696012645507, "driven_lanedir": 0.03951790476560345, "in-drivable-lane": 0, "deviation-heading": 0.17380540498635186, "deviation-center-line": 0.11587546034746844, "driven_lanedir_consec": 0.03951790476560345}}
No reset possible
11587step4-vizsuccessno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11583step3-videossuccessyes0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11578step2-scoringsuccessyes0:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.8666666666666666


other stats
episodes
details{"ep000": {"nsteps": 14, "reward": -71.97903623378703, "good_angle": 0.7481956896959677, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep001": {"nsteps": 26, "reward": -37.94616676322543, "good_angle": 0.10206560991583928, "survival_time": 0.8666666666666666, "traveled_tiles": 2, "valid_direction": 0.19999999999999996}, "ep002": {"nsteps": 101, "reward": -9.39753664189046, "good_angle": 0.028116203740938355, "survival_time": 3.3666666666666645, "traveled_tiles": 6, "valid_direction": 0}, "ep003": {"nsteps": 26, "reward": -38.066638908707176, "good_angle": 0.08704276824611788, "survival_time": 0.8666666666666666, "traveled_tiles": 2, "valid_direction": 0.1333333333333333}, "ep004": {"nsteps": 40, "reward": -24.494018056150527, "good_angle": 0.03495715417445244, "survival_time": 1.333333333333334, "traveled_tiles": 3, "valid_direction": 0.03333333333333344}}
good_angle_max0.7481956896959677
good_angle_mean0.2000754851546631
good_angle_median0.08704276824611788
good_angle_min0.028116203740938355
reward_max-9.39753664189046
reward_mean-36.376679320752125
reward_median-37.94616676322543
reward_min-71.97903623378703
survival_time_max3.3666666666666645
survival_time_mean1.3799999999999994
survival_time_min0.4666666666666666
traveled_tiles_max6
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.4333333333333333
valid_direction_mean0.16
valid_direction_median0.1333333333333333
valid_direction_min0
No reset possible
11571step1-simulationsuccessyes0:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10550step4-vizsuccessno0:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10549step4-vizsuccessno0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10546step3-videossuccessyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10545step3-videossuccessyes0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10544step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10543step2-scoringsuccessyes0:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10534step1-simulationsuccessno0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10533step1-simulationsuccessno0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3010step2-scoringsuccessno0:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2993step1-simulationsuccessno0:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2915step4-vizsuccessno0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2914step4-vizsuccessno0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2913step3-videossuccessno0:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2912step3-videossuccessno0:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2902step2-scoringsuccessno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2901step2-scoringsuccessno0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2895step1-simulationsuccessno0:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2854step1-simulationfailedno0:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 52, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible