Duckietown Challenges Home Challenges Submissions

Submission 1087

Submission1087
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12267 step2-scoring: 12281 step3-videos: 12283 step4-viz: 12296
Next
User labelMy ROS solution
Admin priority64
Blessingn/a
User priority64

12296

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12283

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12296step4-vizsuccessyes0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median9.884683172304296
deviation-center-line_median1.2732459252018646
in-drivable-lane_median1.2999999999999972


other stats
deviation-center-line_max2.1512105790611593
deviation-center-line_mean1.4063164865101077
deviation-center-line_min0.6542793726173993
deviation-heading_max2.8765405071093073
deviation-heading_mean2.2867867308223633
deviation-heading_median2.275344591918222
deviation-heading_min1.9170372195096697
driven_any_max15.616747381248093
driven_any_mean12.162634795926058
driven_any_median10.713872929367318
driven_any_min9.181830271851467
driven_lanedir_max13.666118941628994
driven_lanedir_mean10.748049990693348
driven_lanedir_min8.312014124649192
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean1.1599999999999973
in-drivable-lane_min0.5666666666666649
per-episodes
details{"ep000": {"driven_any": 15.041547818231136, "driven_lanedir": 13.168958557655111, "in-drivable-lane": 1.5333333333333332, "deviation-heading": 2.8765405071093073, "deviation-center-line": 1.7061122815151633}, "ep001": {"driven_any": 10.713872929367318, "driven_lanedir": 9.884683172304296, "in-drivable-lane": 0.5666666666666649, "deviation-heading": 1.9753835019966075, "deviation-center-line": 1.246734274154952}, "ep002": {"driven_any": 10.259175578932274, "driven_lanedir": 8.708475157229142, "in-drivable-lane": 1.2999999999999972, "deviation-heading": 2.3896278335780106, "deviation-center-line": 1.2732459252018646}, "ep003": {"driven_any": 9.181830271851467, "driven_lanedir": 8.312014124649192, "in-drivable-lane": 0.5999999999999981, "deviation-heading": 1.9170372195096697, "deviation-center-line": 0.6542793726173993}, "ep004": {"driven_any": 15.616747381248093, "driven_lanedir": 13.666118941628994, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 2.275344591918222, "deviation-center-line": 2.1512105790611593}}
No reset possible
12283step3-videossuccessyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12281step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.799999999999969


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.5099749747589231, "good_angle": 0.9392848196058804, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.9666666666666774}, "ep001": {"nsteps": 354, "reward": -2.305884959676045, "good_angle": 0.7140271053689863, "survival_time": 11.799999999999969, "traveled_tiles": 18, "valid_direction": 1.866666666666661}, "ep002": {"nsteps": 350, "reward": -2.365502188392649, "good_angle": 0.8623657376902836, "survival_time": 11.666666666666636, "traveled_tiles": 18, "valid_direction": 2.333333333333327}, "ep003": {"nsteps": 313, "reward": -2.5371944703036746, "good_angle": 0.48769484592721857, "survival_time": 10.433333333333309, "traveled_tiles": 15, "valid_direction": 0.9666666666666636}, "ep004": {"nsteps": 500, "reward": -0.07174235597334336, "good_angle": 27.60769044090787, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.099999999999987}}
good_angle_max27.60769044090787
good_angle_mean6.122212589900047
good_angle_median0.8623657376902836
good_angle_min0.48769484592721857
reward_max0.5099749747589231
reward_mean-1.3540697999173577
reward_median-2.305884959676045
reward_min-2.5371944703036746
survival_time_max16.666666666666654
survival_time_mean13.446666666666644
survival_time_min10.433333333333309
traveled_tiles_max18
traveled_tiles_mean17.4
traveled_tiles_median18
traveled_tiles_min15
valid_direction_max4.099999999999987
valid_direction_mean2.446666666666663
valid_direction_median2.333333333333327
valid_direction_min0.9666666666666636
No reset possible
12267step1-simulationsuccessyes0:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8680step4-vizsuccessyes0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8679step4-vizsuccessyes0:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8678step4-vizsuccessyes0:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8645step4-viztimeoutyes0:31:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8644step4-vizsuccessyes0:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8639step3-videossuccessyes0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8636step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8635step2-scoringsuccessyes0:05:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8634step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8630step1-simulationsuccessno0:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8629step1-simulationfailedno0:07:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible