Duckietown Challenges Home Challenges Submissions

Submission 26429

Submission26429
Competingyes
Challengelx22-BV1
Useruser8310
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 186935 sim-1of5: 186903 sim-2of5: 186934 sim-3of5: 186904 sim-4of5: 186924
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

186935

Click the images to see detailed statistics about the episode.

d30

186924

Click the images to see detailed statistics about the episode.

d60

186904

Click the images to see detailed statistics about the episode.

d50

186903

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
186935sim-0of5successyes0:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.329500791731153


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.329500791731153
distance-from-start_median6.329500791731153
distance-from-start_min6.329500791731153
driven_any_max6.476987068100559
driven_any_mean6.476987068100559
driven_any_median6.476987068100559
driven_any_min6.476987068100559
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max22.650000000000187
in-drivable-lane_mean22.650000000000187
in-drivable-lane_median22.650000000000187
in-drivable-lane_min22.650000000000187
per-episodes
details{"d30-ego0": {"driven_any": 6.476987068100559, "survival_time": 22.650000000000187, "driven_lanedir": 0.0, "in-drivable-lane": 22.650000000000187, "deviation-heading": 0.0, "distance-from-start": 6.329500791731153, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max22.650000000000187
survival_time_mean22.650000000000187
survival_time_median22.650000000000187
survival_time_min22.650000000000187
No reset possible
186934sim-2of5failedyes0:02:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186927sim-0of5successyes0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186925sim-2of5successyes0:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186924sim-4of5successyes0:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.076126237470041


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.076126237470041
distance-from-start_median5.076126237470041
distance-from-start_min5.076126237470041
driven_any_max5.321962132296136
driven_any_mean5.321962132296136
driven_any_median5.321962132296136
driven_any_min5.321962132296136
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max18.800000000000132
in-drivable-lane_mean18.800000000000132
in-drivable-lane_median18.800000000000132
in-drivable-lane_min18.800000000000132
per-episodes
details{"d60-ego0": {"driven_any": 5.321962132296136, "survival_time": 18.800000000000132, "driven_lanedir": 0.0, "in-drivable-lane": 18.800000000000132, "deviation-heading": 0.0, "distance-from-start": 5.076126237470041, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max18.800000000000132
survival_time_mean18.800000000000132
survival_time_median18.800000000000132
survival_time_min18.800000000000132
No reset possible
186904sim-3of5successyes0:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.530562281674428


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.530562281674428
distance-from-start_median1.530562281674428
distance-from-start_min1.530562281674428
driven_any_max2.2469443438875207
driven_any_mean2.2469443438875207
driven_any_median2.2469443438875207
driven_any_min2.2469443438875207
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max8.549999999999986
in-drivable-lane_mean8.549999999999986
in-drivable-lane_median8.549999999999986
in-drivable-lane_min8.549999999999986
per-episodes
details{"d50-ego0": {"driven_any": 2.2469443438875207, "survival_time": 8.549999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 8.549999999999986, "deviation-heading": 0.0, "distance-from-start": 1.530562281674428, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max8.549999999999986
survival_time_mean8.549999999999986
survival_time_median8.549999999999986
survival_time_min8.549999999999986
No reset possible
186903sim-1of5successyes0:09:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.446725450372542


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.446725450372542
distance-from-start_median4.446725450372542
distance-from-start_min4.446725450372542
driven_any_max5.876951488814638
driven_any_mean5.876951488814638
driven_any_median5.876951488814638
driven_any_min5.876951488814638
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max20.65000000000016
in-drivable-lane_mean20.65000000000016
in-drivable-lane_median20.65000000000016
in-drivable-lane_min20.65000000000016
per-episodes
details{"d60-ego0": {"driven_any": 5.876951488814638, "survival_time": 20.65000000000016, "driven_lanedir": 0.0, "in-drivable-lane": 20.65000000000016, "deviation-heading": 0.0, "distance-from-start": 4.446725450372542, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max20.65000000000016
survival_time_mean20.65000000000016
survival_time_median20.65000000000016
survival_time_min20.65000000000016
No reset possible