Duckietown Challenges Home Challenges Submissions

Submission 397

Submission397
Competingyes
Challengeaido1_LF1_r3-v3
UserVadim Volodin 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13020 step2-scoring: 13035 step3-videos: 13036 step4-viz: 13044
Next
User labelRandom execution
Admin priority50
Blessingn/a
User priority50

13044

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13036

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13044step4-vizsuccessyes0:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.399139945130385
deviation-center-line_median0.8888675914213932
in-drivable-lane_median0


other stats
deviation-center-line_max1.1598350106836834
deviation-center-line_mean0.675926397608005
deviation-center-line_min0
deviation-heading_max1.1804023800821166
deviation-heading_mean0.680659931928711
deviation-heading_median0.5710794021342425
deviation-heading_min0
driven_any_max19.91999999999997
driven_any_mean19.919999999999856
driven_any_median19.919999999999828
driven_any_min19.919999999999764
driven_lanedir_max0.7196036722083514
driven_lanedir_mean0.4154372350856983
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.6599999999999966
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 19.91999999999997, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 19.919999999999927, "driven_lanedir": 0.399139945130385, "in-drivable-lane": 0, "deviation-heading": 1.0920028198391911, "deviation-center-line": 1.078793989348826}, "ep002": {"driven_any": 19.919999999999764, "driven_lanedir": 0.3987537044887417, "in-drivable-lane": 1.6666666666666652, "deviation-heading": 1.1804023800821166, "deviation-center-line": 0.2521353965861226}, "ep003": {"driven_any": 19.919999999999828, "driven_lanedir": 0.5596888536010134, "in-drivable-lane": 0, "deviation-heading": 0.5710794021342425, "deviation-center-line": 1.1598350106836834}, "ep004": {"driven_any": 19.919999999999796, "driven_lanedir": 0.7196036722083514, "in-drivable-lane": 0, "deviation-heading": 0.5598150575880045, "deviation-center-line": 0.8888675914213932}}
No reset possible
13036step3-videossuccessyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13035step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.060659675717354, "good_angle": 0.048527729621783845, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 500, "reward": 0.4966344596147537, "good_angle": 0.07169159269760109, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": 0.8487190539836884, "good_angle": 0.1028399850203609, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": 0.46811697614192965, "good_angle": 0.023736323581860147, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.5583847699761391, "good_angle": 0.02970190202143955, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.1028399850203609
good_angle_mean0.055299506588609104
good_angle_median0.048527729621783845
good_angle_min0.023736323581860147
reward_max0.8487190539836884
reward_mean0.26223911679983136
reward_median0.4966344596147537
reward_min-1.060659675717354
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0
valid_direction_mean0
valid_direction_median0
valid_direction_min0
No reset possible
13020step1-simulationsuccessyes0:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10441step4-vizsuccessyes0:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10434step3-videossuccessyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10431step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10416step1-simulationsuccessno0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10415step1-simulationfailedno0:03:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 73, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3934step4-vizsuccessno0:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3933step4-vizsuccessno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3932step3-videossuccessno0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3931step2-scoringsuccessno0:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3930step1-simulationsuccessno0:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible