Duckietown Challenges Home Challenges Submissions

Submission 941

Submission941
Competingyes
Challengeaido1_LF1_r3-v3
UserDavid Abraham
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 13333 step2-scoring: 7770 step3-videos: 7771 step4-viz: 7775
Next
User labelPytorch IL
Admin priority50
Blessingn/a
User priority50

7775

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

7771

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13333step1-simulationerroryes0:02:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7775step4-vizsuccessyes0:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
No reset possible
7774step4-vizsuccessyes0:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7773step4-vizsuccessyes0:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7772step4-vizsuccessyes0:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7771step3-videossuccessyes0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7770step2-scoringsuccessyes0:06:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.5666666666666682


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4576184816499007, "good_angle": 40.9939386169918, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 9.933333333333335}, "ep001": {"nsteps": 30, "reward": -33.80661088923613, "good_angle": 0.13794416402598422, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.33333333333333326}, "ep002": {"nsteps": 47, "reward": -21.693168340528263, "good_angle": 0.06418811201799242, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.1000000000000002}, "ep003": {"nsteps": 433, "reward": -2.8357827126970148, "good_angle": 8.859400916232572, "survival_time": 14.433333333333293, "traveled_tiles": 7, "valid_direction": 4.466666666666655}, "ep004": {"nsteps": 24, "reward": -42.15544073283672, "good_angle": 0.05680776574138376, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.1333333333333333}}
good_angle_max40.9939386169918
good_angle_mean10.022455915001943
good_angle_median0.13794416402598422
good_angle_min0.05680776574138376
reward_max-1.4576184816499007
reward_mean-20.389724231389607
reward_median-21.693168340528263
reward_min-42.15544073283672
survival_time_max16.666666666666654
survival_time_mean6.893333333333322
survival_time_min0.7999999999999999
traveled_tiles_max7
traveled_tiles_mean3
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max9.933333333333335
valid_direction_mean2.9933333333333314
valid_direction_median0.33333333333333326
valid_direction_min0.1000000000000002
No reset possible
7769step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7768step1-simulationsuccessno0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible