Duckietown Challenges Home Challenges Submissions

Submission 14899

Submission14899
Competingyes
Challengemooc-modcon
UserLin Wei-Chih
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 112627
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

112627

Click the images to see detailed statistics about the episode.

LF-full-loop-000

LF-full-loop-001

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
112627simsuccessyes0:04:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median16.150000000000137
deviation-center-line_median0.4065823300815643
driven_lanedir_consec_median0.39240754644181663
survival_time_median20.450000000000156


other stats
deviation-center-line_max0.6273903887049603
deviation-center-line_mean0.4065823300815643
deviation-center-line_min0.18577427145816824
deviation-heading_max5.371416726264612
deviation-heading_mean3.6115585265259895
deviation-heading_median3.6115585265259895
deviation-heading_min1.8517003267873673
distance-from-start_max2.943612391679902
distance-from-start_mean2.256859157576153
distance-from-start_median2.256859157576153
distance-from-start_min1.570105923472404
driven_any_max3.6421922234424047
driven_any_mean2.7057861761713977
driven_any_median2.7057861761713977
driven_any_min1.7693801289003908
driven_lanedir_consec_max0.6269138359931843
driven_lanedir_consec_mean0.39240754644181663
driven_lanedir_consec_min0.15790125689044898
driven_lanedir_max0.6269138359931843
driven_lanedir_mean0.39240754644181663
driven_lanedir_median0.39240754644181663
driven_lanedir_min0.15790125689044898
in-drivable-lane_max20.450000000000205
in-drivable-lane_mean16.150000000000137
in-drivable-lane_min11.850000000000067
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.6421922234424047, "survival_time": 27.10000000000025, "driven_lanedir": 0.6269138359931843, "in-drivable-lane": 20.450000000000205, "deviation-heading": 5.371416726264612, "distance-from-start": 2.943612391679902, "deviation-center-line": 0.6273903887049603, "driven_lanedir_consec": 0.6269138359931843}, "LF-full-loop-001-ego0": {"driven_any": 1.7693801289003908, "survival_time": 13.80000000000006, "driven_lanedir": 0.15790125689044898, "in-drivable-lane": 11.850000000000067, "deviation-heading": 1.8517003267873673, "distance-from-start": 1.570105923472404, "deviation-center-line": 0.18577427145816824, "driven_lanedir_consec": 0.15790125689044898}}
simulation-passed1
survival_time_max27.10000000000025
survival_time_mean20.450000000000156
survival_time_min13.80000000000006
No reset possible
92888simsuccessno0:12:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
92883simfailedno0:04:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
92882simtimeoutno0:00:26
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
75514simsuccessno0:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible