Duckietown Challenges Home Challenges Submissions

Submission 701

Submission701
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13500 step2-scoring: 13502 step3-videos: 13506 step4-viz: 13514
Next
User labelMy modified ROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

13514

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13506

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13514step4-vizsuccessyes0:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.604091965865259
deviation-center-line_median0.425471831409666
in-drivable-lane_median0.1333333333333333


other stats
deviation-center-line_max1.7059798864094065
deviation-center-line_mean0.743214711429151
deviation-center-line_min0.03384307342225714
deviation-heading_max4.378052413096013
deviation-heading_mean2.050031979427378
deviation-heading_median1.5480714337091876
deviation-heading_min0.1368465730615221
driven_any_max13.376724361158692
driven_any_mean6.493646364156502
driven_any_median5.003158160377602
driven_any_min0.4312008855907454
driven_lanedir_max11.259027594146367
driven_lanedir_mean5.472618936526671
driven_lanedir_min0.3755487089721268
in-drivable-lane_max2
in-drivable-lane_mean0.82
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 13.376724361158692, "driven_lanedir": 11.259027594146367, "in-drivable-lane": 1.8333333333333328, "deviation-heading": 3.820127911723107, "deviation-center-line": 1.7059798864094065}, "ep001": {"driven_any": 13.116782415405655, "driven_lanedir": 10.706696806072468, "in-drivable-lane": 2, "deviation-heading": 4.378052413096013, "deviation-center-line": 1.5067374116640306}, "ep002": {"driven_any": 0.4312008855907454, "driven_lanedir": 0.4177296075771335, "in-drivable-lane": 0, "deviation-heading": 0.1368465730615221, "deviation-center-line": 0.03384307342225714}, "ep003": {"driven_any": 5.003158160377602, "driven_lanedir": 4.604091965865259, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.5480714337091876, "deviation-center-line": 0.425471831409666}, "ep004": {"driven_any": 0.5403659982498157, "driven_lanedir": 0.3755487089721268, "in-drivable-lane": 0.1333333333333333, "deviation-heading": 0.36706156554706126, "deviation-center-line": 0.04404135424039474}}
No reset possible
13506step3-videossuccessyes0:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13502step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.966666666666655


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.44962745301052925, "good_angle": 1.9776854284883243, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.433333333333336}, "ep001": {"nsteps": 500, "reward": 0.5027632872750982, "good_angle": 2.3874734320372255, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 5.366666666666668}, "ep002": {"nsteps": 18, "reward": -55.11483549828537, "good_angle": 0.12304616480439293, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.10000000000000003}, "ep003": {"nsteps": 179, "reward": -5.000211028829633, "good_angle": 0.6885183046998005, "survival_time": 5.966666666666655, "traveled_tiles": 9, "valid_direction": 1.733333333333329}, "ep004": {"nsteps": 25, "reward": -39.84338593363762, "good_angle": 0.631905327021265, "survival_time": 0.8333333333333333, "traveled_tiles": 2, "valid_direction": 0.5999999999999999}}
good_angle_max2.3874734320372255
good_angle_mean1.161725731410202
good_angle_median0.6885183046998005
good_angle_min0.12304616480439293
reward_max0.5027632872750982
reward_mean-19.8012083440934
reward_median-5.000211028829633
reward_min-55.11483549828537
survival_time_max16.666666666666654
survival_time_mean8.14666666666666
survival_time_min0.6
traveled_tiles_max18
traveled_tiles_mean9.6
traveled_tiles_median9
traveled_tiles_min1
valid_direction_max5.366666666666668
valid_direction_mean2.4466666666666663
valid_direction_median1.733333333333329
valid_direction_min0.10000000000000003
No reset possible
13500step1-simulationsuccessyes0:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7073step1-simulationfailedno0:04:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6661step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission701/step1-simulation-nutonomy-P50-2210-job6661'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6456step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission701/step1-simulation-nutonomy-P50-2570-job6456'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5443step1-simulationfailedno0:06:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible