Duckietown Challenges Home Challenges Submissions

Submission 694

Submission694
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13416 step2-scoring: 13429 step3-videos: 13431 step4-viz: 13433
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

13433

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13431

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13433step4-vizsuccessyes0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.962811259869261
deviation-center-line_median0.2121334821089294
in-drivable-lane_median0.09999999999999998


other stats
deviation-center-line_max0.30417857749949784
deviation-center-line_mean0.16931118736094714
deviation-center-line_min0.026819765725172
deviation-heading_max1.1546902506279084
deviation-heading_mean0.8102719152215239
deviation-heading_median1.062987763999241
deviation-heading_min0.32576174424528564
driven_any_max3.202259467015756
driven_any_mean1.7405391715192189
driven_any_median2.241982029880967
driven_any_min0.407774607309627
driven_lanedir_max2.687393548563292
driven_lanedir_mean1.4735611704161384
driven_lanedir_min0.3321633358632381
in-drivable-lane_max0.4000000000000013
in-drivable-lane_mean0.15333333333333352
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.318764328030631, "driven_lanedir": 1.962811259869261, "in-drivable-lane": 0.2333333333333331, "deviation-heading": 1.1546902506279084, "deviation-center-line": 0.2683737187752131}, "ep001": {"driven_any": 3.202259467015756, "driven_lanedir": 2.687393548563292, "in-drivable-lane": 0.4000000000000013, "deviation-heading": 1.062987763999241, "deviation-center-line": 0.30417857749949784}, "ep002": {"driven_any": 2.241982029880967, "driven_lanedir": 1.9947508338725937, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 1.128358532529517, "deviation-center-line": 0.2121334821089294}, "ep003": {"driven_any": 0.407774607309627, "driven_lanedir": 0.3321633358632381, "in-drivable-lane": 0, "deviation-heading": 0.32576174424528564, "deviation-center-line": 0.026819765725172}, "ep004": {"driven_any": 0.5319154253591121, "driven_lanedir": 0.3906868739123066, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 0.3795612847056669, "deviation-center-line": 0.035050392695923444}}
No reset possible
13431step3-videossuccessyes0:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13429step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.833333333333333


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -10.221945155732412, "good_angle": 0.9385788869453336, "survival_time": 3.0999999999999988, "traveled_tiles": 4, "valid_direction": 1.5333333333333323}, "ep001": {"nsteps": 116, "reward": -8.004329447281258, "good_angle": 0.5294641643402367, "survival_time": 3.8666666666666623, "traveled_tiles": 6, "valid_direction": 1.3666666666666654}, "ep002": {"nsteps": 85, "reward": -10.995850246185984, "good_angle": 0.5063394299035693, "survival_time": 2.833333333333333, "traveled_tiles": 4, "valid_direction": 1.2333333333333327}, "ep003": {"nsteps": 19, "reward": -52.03311068211731, "good_angle": 0.34026914446878304, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.3666666666666667}, "ep004": {"nsteps": 25, "reward": -39.88275510162115, "good_angle": 1.0281478405987987, "survival_time": 0.8333333333333333, "traveled_tiles": 2, "valid_direction": 0.4666666666666666}}
good_angle_max1.0281478405987987
good_angle_mean0.6685598932513442
good_angle_median0.5294641643402367
good_angle_min0.34026914446878304
reward_max-8.004329447281258
reward_mean-24.227598126587623
reward_median-10.995850246185984
reward_min-52.03311068211731
survival_time_max3.8666666666666623
survival_time_mean2.253333333333332
survival_time_min0.6333333333333333
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max1.5333333333333323
valid_direction_mean0.9933333333333326
valid_direction_median1.2333333333333327
valid_direction_min0.3666666666666667
No reset possible
13416step1-simulationsuccessyes0:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7118step4-vizsuccessyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7117step4-vizsuccessyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7115step3-videossuccessyes0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7114step3-videossuccessyes0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7112step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7098step1-simulationsuccessno0:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6669step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission694'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6469step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission694'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5420step1-simulationfailedno0:03:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5419step1-simulationsuccessno0:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible