Duckietown Challenges Home Challenges Submissions

Submission 807

Submission807
Competingyes
Challengeaido1_LF1_r3-v3
UserJonathan Plante 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12063 step2-scoring: 12067 step3-videos: 12068 step4-viz: 12071
Next
User labelJP pipeline
Admin priority50
Blessingn/a
User priority50

12071

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12068

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12071step4-vizsuccessyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.607624049226363
deviation-center-line_median0.09769270192405038
in-drivable-lane_median0.3


other stats
deviation-center-line_max0.2807110704826897
deviation-center-line_mean0.13076338687869743
deviation-center-line_min0.05856940306194948
deviation-heading_max0.9197741612116908
deviation-heading_mean0.3249047489015602
deviation-heading_median0.19534587516365087
deviation-heading_min0.043767648089746966
driven_any_max5.264957098433552
driven_any_mean2.4360087876537113
driven_any_median1.7516612884487968
driven_any_min0.760000000000006
driven_lanedir_max3.8116242098045743
driven_lanedir_mean1.8737289318078532
driven_lanedir_min0.7583624342945385
in-drivable-lane_max1.0999999999999994
in-drivable-lane_mean0.45333333333333314
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.765690119410677, "driven_lanedir": 1.8004243933449766, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0.19459316021262463, "deviation-center-line": 0.12582232583024844}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 1.7516612884487968, "driven_lanedir": 1.3906095723688114, "in-drivable-lane": 0.3, "deviation-heading": 0.27104289983008756, "deviation-center-line": 0.09102143309454926}, "ep003": {"driven_any": 1.6377354319755246, "driven_lanedir": 1.607624049226363, "in-drivable-lane": 0, "deviation-heading": 0.19534587516365087, "deviation-center-line": 0.09769270192405038}, "ep004": {"driven_any": 5.264957098433552, "driven_lanedir": 3.8116242098045743, "in-drivable-lane": 1.0999999999999994, "deviation-heading": 0.9197741612116908, "deviation-center-line": 0.2807110704826897}}
No reset possible
12068step3-videossuccessyes0:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12067step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.6000000000000016


other stats
episodes
details{"ep000": {"nsteps": 74, "reward": -13.553733680611224, "good_angle": 0.15295490970335693, "survival_time": 2.4666666666666677, "traveled_tiles": 6, "valid_direction": 0.33333333333333326}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -20.198876121081412, "good_angle": 0.0760380430539281, "survival_time": 1.6000000000000016, "traveled_tiles": 4, "valid_direction": 0.13333333333333333}, "ep003": {"nsteps": 45, "reward": -21.9200642131062, "good_angle": 0.028802507913967136, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 142, "reward": -6.726724396574534, "good_angle": 0.4677490215111309, "survival_time": 4.733333333333326, "traveled_tiles": 10, "valid_direction": 1.0666666666666664}}
good_angle_max0.4677490215111309
good_angle_mean0.1457131663140111
good_angle_median0.0760380430539281
good_angle_min0.0030213493876724944
reward_max-6.726724396574534
reward_mean-21.935783753094803
reward_median-20.198876121081412
reward_min-47.27952035410063
survival_time_max4.733333333333326
survival_time_mean2.1999999999999993
survival_time_min0.7
traveled_tiles_max10
traveled_tiles_mean5.2
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max1.0666666666666664
valid_direction_mean0.3066666666666666
valid_direction_median0.13333333333333333
valid_direction_min0
No reset possible
12063step1-simulationsuccessyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6293step1-simulationfailedno0:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 97, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5993step4-vizsuccessno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5992step4-vizsuccessno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5991step4-vizabortedno0:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5990step4-vizsuccessno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5989step4-vizabortedno0:01:09
Error while running [...]

Creating job5989-8649_videos_1 ... error
stderr | ERROR: for job5989-8649_videos_1  Cannot start service videos: network job5989-8649_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job5989-8649_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5988step3-videossuccessno0:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5987step2-scoringabortedno0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5986step2-scoringsuccessno0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5984step1-simulationabortedno0:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible