Duckietown Challenges Home Challenges Submissions

Submission 1218

Submission1218
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11632 step2-scoring: 11640 step3-videos: 11642 step4-viz: 11644
Next
User labelJP pipeline
Admin priority65
Blessingn/a
User priority65

11644

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11642

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11644step4-vizsuccessyes0:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.516332344618734
deviation-center-line_median0.41730864456122463
in-drivable-lane_median0.8666666666666638


other stats
deviation-center-line_max1.183996685872265
deviation-center-line_mean0.5595783761753557
deviation-center-line_min0.021055182344907677
deviation-heading_max2.83484736798613
deviation-heading_mean1.3428293434425411
deviation-heading_median0.972205421064388
deviation-heading_min0.18342956864139295
driven_any_max18.941215905863785
driven_any_mean9.227443930130388
driven_any_median6.136877245145523
driven_any_min1.1964750359211365
driven_lanedir_max16.49764953509191
driven_lanedir_mean7.993530563285452
driven_lanedir_min0.19805673514931765
in-drivable-lane_max1.566666666666661
in-drivable-lane_mean0.8066666666666649
in-drivable-lane_min0.3666666666666658
per-episodes
details{"ep000": {"driven_any": 1.1964750359211365, "driven_lanedir": 0.19805673514931765, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0.18342956864139295, "deviation-center-line": 0.021055182344907677}, "ep001": {"driven_any": 6.136877245145523, "driven_lanedir": 5.516332344618734, "in-drivable-lane": 0.3666666666666666, "deviation-heading": 0.7897143012744152, "deviation-center-line": 0.41730864456122463}, "ep002": {"driven_any": 14.44854344507617, "driven_lanedir": 12.996832639225907, "in-drivable-lane": 0.8666666666666638, "deviation-heading": 1.9339500582463804, "deviation-center-line": 0.8569148276208011}, "ep003": {"driven_any": 18.941215905863785, "driven_lanedir": 16.49764953509191, "in-drivable-lane": 1.566666666666661, "deviation-heading": 2.83484736798613, "deviation-center-line": 1.183996685872265}, "ep004": {"driven_any": 5.414108018645329, "driven_lanedir": 4.758781562341394, "in-drivable-lane": 0.3666666666666658, "deviation-heading": 0.972205421064388, "deviation-center-line": 0.31861654047757987}}
No reset possible
11642step3-videossuccessyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11640step2-scoringsuccessyes0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.399999999999991


other stats
episodes
details{"ep000": {"nsteps": 35, "reward": -29.15053927249142, "good_angle": 0.34486177249544686, "survival_time": 1.166666666666667, "traveled_tiles": 3, "valid_direction": 0.5333333333333337}, "ep001": {"nsteps": 162, "reward": -5.599635734326309, "good_angle": 0.17519793560250463, "survival_time": 5.399999999999991, "traveled_tiles": 11, "valid_direction": 0.4999999999999991}, "ep002": {"nsteps": 379, "reward": -1.9871136692394369, "good_angle": 0.4523153475328166, "survival_time": 12.6333333333333, "traveled_tiles": 18, "valid_direction": 1.199999999999996}, "ep003": {"nsteps": 500, "reward": 0.6010044494001194, "good_angle": 0.92725251733234, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2999999999999927}, "ep004": {"nsteps": 146, "reward": -6.197705786126628, "good_angle": 0.27483451760132255, "survival_time": 4.866666666666659, "traveled_tiles": 10, "valid_direction": 0.7666666666666673}}
good_angle_max0.92725251733234
good_angle_mean0.4348924181128861
good_angle_median0.34486177249544686
good_angle_min0.17519793560250463
reward_max0.6010044494001194
reward_mean-8.466798002556732
reward_median-5.599635734326309
reward_min-29.15053927249142
survival_time_max16.666666666666654
survival_time_mean8.146666666666654
survival_time_min1.166666666666667
traveled_tiles_max18
traveled_tiles_mean12
traveled_tiles_median11
traveled_tiles_min3
valid_direction_max2.2999999999999927
valid_direction_mean1.0599999999999978
valid_direction_median0.7666666666666673
valid_direction_min0.4999999999999991
No reset possible
11632step1-simulationsuccessyes0:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9562step4-vizsuccessyes0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9561step4-vizsuccessyes0:16:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9560step4-vizsuccessyes0:04:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9559step3-videossuccessyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9558step3-videossuccessyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9557step3-videossuccessyes0:10:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9556step3-videossuccessyes0:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9555step2-scoringsuccessyes0:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9554step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9553step2-scoringabortedyes0:00:13
Error while running [...]

Creating job9553-9012_scorer_1 ... error
stderr | ERROR: for job9553-9012_scorer_1  Cannot start service scorer: network job9553-9012_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9553-9012_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9552step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9551step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9550step1-simulationsuccessno0:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9549step1-simulationsuccessno0:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9548step1-simulationfailedno0:05:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible