Duckietown Challenges Home Challenges Submissions

Submission 489

Submission489
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13977 step2-scoring: 13983 step3-videos: 13988 step4-viz: 13996
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

13996

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13988

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13996step4-vizsuccessyes0:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.42227261567306407
deviation-center-line_median0.09452149957254032
in-drivable-lane_median1.1999999999999995


other stats
deviation-center-line_max0.509135173436567
deviation-center-line_mean0.17499721258171877
deviation-center-line_min0.05977368650864371
deviation-heading_max10.54133142278161
deviation-heading_mean2.445508858270102
deviation-heading_median0.43623171255341986
deviation-heading_min0.39555103215797793
driven_any_max5.304125776697546
driven_any_mean1.656727145077686
driven_any_median0.8905392926537553
driven_any_min0.1965478520622135
driven_lanedir_max0.5814875869893381
driven_lanedir_mean0.3307504517839068
driven_lanedir_min0.0029119701673430143
in-drivable-lane_max14.599999999999952
in-drivable-lane_mean5.8533333333333175
in-drivable-lane_min0.36666666666666664
per-episodes
details{"ep000": {"driven_any": 0.1965478520622135, "driven_lanedir": 0.0029119701673430143, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 10.54133142278161, "deviation-center-line": 0.509135173436567}, "ep001": {"driven_any": 1.0430997801399369, "driven_lanedir": 0.5814875869893381, "in-drivable-lane": 1.1999999999999995, "deviation-heading": 0.39555103215797793, "deviation-center-line": 0.13026589242752282}, "ep002": {"driven_any": 5.304125776697546, "driven_lanedir": 0.19574528279350775, "in-drivable-lane": 11.966666666666631, "deviation-heading": 0.43623171255341986, "deviation-center-line": 0.05977368650864371}, "ep003": {"driven_any": 0.8493230238349783, "driven_lanedir": 0.42227261567306407, "in-drivable-lane": 1.1333333333333355, "deviation-heading": 0.3988180652546159, "deviation-center-line": 0.08128981096332001}, "ep004": {"driven_any": 0.8905392926537553, "driven_lanedir": 0.45133480329628095, "in-drivable-lane": 14.599999999999952, "deviation-heading": 0.4556120586028843, "deviation-center-line": 0.09452149957254032}}
No reset possible
13988step3-videossuccessyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13983step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.266666666666651


other stats
episodes
details{"ep000": {"nsteps": 218, "reward": -5.325309671803352, "good_angle": 16.363275715288456, "survival_time": 7.266666666666651, "traveled_tiles": 1, "valid_direction": 7.033333333333317}, "ep001": {"nsteps": 77, "reward": -13.377506421298367, "good_angle": 0.8639605632684145, "survival_time": 2.5666666666666673, "traveled_tiles": 4, "valid_direction": 1.566666666666667}, "ep002": {"nsteps": 378, "reward": -3.685251702273649, "good_angle": 2.3664048221559972, "survival_time": 12.599999999999966, "traveled_tiles": 12, "valid_direction": 3.066666666666662}, "ep003": {"nsteps": 64, "reward": -16.204104097603704, "good_angle": 1.0245663286158004, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 1.7333333333333358}, "ep004": {"nsteps": 472, "reward": -4.740832843123225, "good_angle": 19.449477512928855, "survival_time": 15.733333333333288, "traveled_tiles": 4, "valid_direction": 12.499999999999964}}
good_angle_max19.449477512928855
good_angle_mean8.013536988451504
good_angle_median2.3664048221559972
good_angle_min0.8639605632684145
reward_max-3.685251702273649
reward_mean-8.66660094722046
reward_median-5.325309671803352
reward_min-16.204104097603704
survival_time_max15.733333333333288
survival_time_mean8.059999999999983
survival_time_min2.1333333333333355
traveled_tiles_max12
traveled_tiles_mean4.6
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max12.499999999999964
valid_direction_mean5.17999999999999
valid_direction_median3.066666666666662
valid_direction_min1.566666666666667
No reset possible
13977step1-simulationsuccessyes0:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10190step1-simulationfailedno0:09:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4305step4-vizsuccessno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4304step3-videossuccessno0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4302step2-scoringsuccessno0:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4301step1-simulationsuccessno0:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible