Duckietown Challenges Home Challenges Submissions

Submission 1114

Submission1114
Competingyes
Challengeaido1_LF1_r3-v3
UserVincent Mai 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12513 step2-scoring: 8793 step3-videos: 8795 step4-viz: 8797
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

8797

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8795

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12513step1-simulationfailedyes0:08:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8797step4-vizsuccessyes0:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.082504584496517
deviation-center-line_median1.4213223962150685
in-drivable-lane_median4.699999999999987


other stats
deviation-center-line_max1.6933122370849438
deviation-center-line_mean1.1386942129245123
deviation-center-line_min0.09897289157693905
deviation-heading_max1.9148581555476023
deviation-heading_mean1.4473556308766535
deviation-heading_median1.8108213480222968
deviation-heading_min0.06092138286581164
driven_any_max6.295938102764451
driven_any_mean5.088299035557098
driven_any_median6.253828164121973
driven_any_min0.34666666666667245
driven_lanedir_max5.139916753040794
driven_lanedir_mean3.5184652864023205
driven_lanedir_min0.3458718774424743
in-drivable-lane_max6.699999999999977
in-drivable-lane_mean3.9933333333333274
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.250979620371302, "driven_lanedir": 4.365396730185181, "in-drivable-lane": 4.699999999999987, "deviation-heading": 1.8108213480222968, "deviation-center-line": 1.6933122370849438}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.295938102764451, "driven_lanedir": 4.082504584496517, "in-drivable-lane": 5.800000000000015, "deviation-heading": 1.5873098348142642, "deviation-center-line": 1.479346434076568}, "ep003": {"driven_any": 6.294082623861087, "driven_lanedir": 5.139916753040794, "in-drivable-lane": 2.766666666666657, "deviation-heading": 1.9148581555476023, "deviation-center-line": 1.0005171056690436}, "ep004": {"driven_any": 6.253828164121973, "driven_lanedir": 3.6586364868466377, "in-drivable-lane": 6.699999999999977, "deviation-heading": 1.8628674331332924, "deviation-center-line": 1.4213223962150685}}
No reset possible
8796step4-vizsuccessyes0:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8795step3-videossuccessyes0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8794step3-videossuccessyes0:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8793step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.500694146130234, "good_angle": 0.911197145557986, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.766666666666662}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.556684414820047, "good_angle": 0.6492836056174036, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.2999999999999954}, "ep003": {"nsteps": 500, "reward": -0.31227157474868, "good_angle": 0.45083800620122894, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.9666666666666632}, "ep004": {"nsteps": 500, "reward": -0.7018088672138983, "good_angle": 22.694390984151426, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.63333333333332}}
good_angle_max22.694390984151426
good_angle_mean4.941966707170116
good_angle_median0.6492836056174036
good_angle_min0.004123794322536422
reward_max-0.31227157474868
reward_mean-7.668375682641941
reward_median-0.556684414820047
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean13.51999999999999
survival_time_min0.9333333333333332
traveled_tiles_max13
traveled_tiles_mean9.6
traveled_tiles_median11
traveled_tiles_min1
valid_direction_max3.63333333333332
valid_direction_mean1.5333333333333283
valid_direction_median1.2999999999999954
valid_direction_min0
No reset possible
8792step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8789step1-simulationsuccessno0:07:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8788step1-simulationfailedno0:06:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible