Duckietown Challenges Home Challenges Submissions

Submission 16199

Submission16199
Competingyes
Challengemooc-modcon
UserThomas Steinle
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 108985
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

108985

Click the images to see detailed statistics about the episode.

LF-full-loop-000

LF-full-loop-001

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
108985simsuccessyes0:10:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median37.69999999999979
deviation-center-line_median2.364403364449702
driven_lanedir_consec_median3.1148238631055354
survival_time_median59.99999999999873


other stats
deviation-center-line_max2.8306122176948274
deviation-center-line_mean2.364403364449702
deviation-center-line_min1.8981945112045764
deviation-heading_max1.377092008268047
deviation-heading_mean0.7425408888275895
deviation-heading_median0.7425408888275895
deviation-heading_min0.10798976938713212
distance-from-start_max8.327515559153056
distance-from-start_mean8.325232033776302
distance-from-start_median8.325232033776302
distance-from-start_min8.322948508399547
driven_any_max8.338222216132829
driven_any_mean8.331235046681458
driven_any_median8.331235046681458
driven_any_min8.324247877230087
driven_lanedir_consec_max4.713211562099443
driven_lanedir_consec_mean3.1148238631055354
driven_lanedir_consec_min1.516436164111628
driven_lanedir_max4.713211562099443
driven_lanedir_mean3.1148238631055354
driven_lanedir_median3.1148238631055354
driven_lanedir_min1.516436164111628
in-drivable-lane_max49.149999999999345
in-drivable-lane_mean37.69999999999979
in-drivable-lane_min26.25000000000024
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324247877230087, "survival_time": 59.99999999999873, "driven_lanedir": 1.516436164111628, "in-drivable-lane": 49.149999999999345, "deviation-heading": 0.10798976938713212, "distance-from-start": 8.322948508399547, "deviation-center-line": 1.8981945112045764, "driven_lanedir_consec": 1.516436164111628}, "LF-full-loop-001-ego0": {"driven_any": 8.338222216132829, "survival_time": 59.99999999999873, "driven_lanedir": 4.713211562099443, "in-drivable-lane": 26.25000000000024, "deviation-heading": 1.377092008268047, "distance-from-start": 8.327515559153056, "deviation-center-line": 2.8306122176948274, "driven_lanedir_consec": 4.713211562099443}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
89216simsuccessno0:20:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
80384simfailedno0:03:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible