Duckietown Challenges Home Challenges Submissions

Submission 13940

Submission13940
Competingyes
Challengeaido-LF-sim-validation
UserYU CHEN
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 115196 sim-1of4: 115197 sim-2of4: 115194 sim-3of4: 115188
Next
User labelCBC Net v2 test - added mar 31 anomaly + mar 28 bc
Admin priority50
Blessingn/a
User priority50

115197

Click the images to see detailed statistics about the episode.

autolab-000

115196

Click the images to see detailed statistics about the episode.

loop2-000

115194

Click the images to see detailed statistics about the episode.

loop-000

115188

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
115197sim-1of4successyes0:06:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.03727650813172
survival_time_median59.99999999999873
deviation-center-line_median2.9996764692778624
in-drivable-lane_median23.74999999999949


other stats
deviation-center-line_max2.9996764692778624
deviation-center-line_mean2.9996764692778624
deviation-center-line_min2.9996764692778624
deviation-heading_max12.804433612706733
deviation-heading_mean12.804433612706733
deviation-heading_median12.804433612706733
deviation-heading_min12.804433612706733
distance-from-start_max3.0790408762491155
distance-from-start_mean3.0790408762491155
distance-from-start_median3.0790408762491155
distance-from-start_min3.0790408762491155
driven_any_max25.465655913817137
driven_any_mean25.465655913817137
driven_any_median25.465655913817137
driven_any_min25.465655913817137
driven_lanedir_consec_max13.03727650813172
driven_lanedir_consec_mean13.03727650813172
driven_lanedir_consec_min13.03727650813172
driven_lanedir_max13.03727650813172
driven_lanedir_mean13.03727650813172
driven_lanedir_median13.03727650813172
driven_lanedir_min13.03727650813172
in-drivable-lane_max23.74999999999949
in-drivable-lane_mean23.74999999999949
in-drivable-lane_min23.74999999999949
per-episodes
details{"autolab-000-ego0": {"driven_any": 25.465655913817137, "survival_time": 59.99999999999873, "driven_lanedir": 13.03727650813172, "in-drivable-lane": 23.74999999999949, "deviation-heading": 12.804433612706733, "distance-from-start": 3.0790408762491155, "deviation-center-line": 2.9996764692778624, "driven_lanedir_consec": 13.03727650813172}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
115196sim-0of4successyes0:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.196857630949637
survival_time_median36.500000000000064
deviation-center-line_median1.3972311126229666
in-drivable-lane_median18.299999999999883


other stats
deviation-center-line_max1.3972311126229666
deviation-center-line_mean1.3972311126229666
deviation-center-line_min1.3972311126229666
deviation-heading_max7.402711030535046
deviation-heading_mean7.402711030535046
deviation-heading_median7.402711030535046
deviation-heading_min7.402711030535046
distance-from-start_max1.7296929371529384
distance-from-start_mean1.7296929371529384
distance-from-start_median1.7296929371529384
distance-from-start_min1.7296929371529384
driven_any_max14.653835163385864
driven_any_mean14.653835163385864
driven_any_median14.653835163385864
driven_any_min14.653835163385864
driven_lanedir_consec_max7.196857630949637
driven_lanedir_consec_mean7.196857630949637
driven_lanedir_consec_min7.196857630949637
driven_lanedir_max7.196857630949637
driven_lanedir_mean7.196857630949637
driven_lanedir_median7.196857630949637
driven_lanedir_min7.196857630949637
in-drivable-lane_max18.299999999999883
in-drivable-lane_mean18.299999999999883
in-drivable-lane_min18.299999999999883
per-episodes
details{"loop2-000-ego0": {"driven_any": 14.653835163385864, "survival_time": 36.500000000000064, "driven_lanedir": 7.196857630949637, "in-drivable-lane": 18.299999999999883, "deviation-heading": 7.402711030535046, "distance-from-start": 1.7296929371529384, "deviation-center-line": 1.3972311126229666, "driven_lanedir_consec": 7.196857630949637}}
simulation-passed1
survival_time_max36.500000000000064
survival_time_mean36.500000000000064
survival_time_min36.500000000000064
No reset possible
115194sim-2of4successyes0:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.679363141959003
survival_time_median59.99999999999873
deviation-center-line_median2.5510227457441643
in-drivable-lane_median26.299999999999528


other stats
deviation-center-line_max2.5510227457441643
deviation-center-line_mean2.5510227457441643
deviation-center-line_min2.5510227457441643
deviation-heading_max10.862857132393398
deviation-heading_mean10.862857132393398
deviation-heading_median10.862857132393398
deviation-heading_min10.862857132393398
distance-from-start_max2.632159957858285
distance-from-start_mean2.632159957858285
distance-from-start_median2.632159957858285
distance-from-start_min2.632159957858285
driven_any_max24.996579639094236
driven_any_mean24.996579639094236
driven_any_median24.996579639094236
driven_any_min24.996579639094236
driven_lanedir_consec_max13.679363141959003
driven_lanedir_consec_mean13.679363141959003
driven_lanedir_consec_min13.679363141959003
driven_lanedir_max13.679363141959003
driven_lanedir_mean13.679363141959003
driven_lanedir_median13.679363141959003
driven_lanedir_min13.679363141959003
in-drivable-lane_max26.299999999999528
in-drivable-lane_mean26.299999999999528
in-drivable-lane_min26.299999999999528
per-episodes
details{"loop-000-ego0": {"driven_any": 24.996579639094236, "survival_time": 59.99999999999873, "driven_lanedir": 13.679363141959003, "in-drivable-lane": 26.299999999999528, "deviation-heading": 10.862857132393398, "distance-from-start": 2.632159957858285, "deviation-center-line": 2.5510227457441643, "driven_lanedir_consec": 13.679363141959003}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
115188sim-3of4successyes0:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.006369117641244
survival_time_median59.99999999999873
deviation-center-line_median2.9091083094645125
in-drivable-lane_median24.749999999999556


other stats
deviation-center-line_max2.9091083094645125
deviation-center-line_mean2.9091083094645125
deviation-center-line_min2.9091083094645125
deviation-heading_max11.185973256721851
deviation-heading_mean11.185973256721851
deviation-heading_median11.185973256721851
deviation-heading_min11.185973256721851
distance-from-start_max4.39664354849673
distance-from-start_mean4.39664354849673
distance-from-start_median4.39664354849673
distance-from-start_min4.39664354849673
driven_any_max24.72233926008928
driven_any_mean24.72233926008928
driven_any_median24.72233926008928
driven_any_min24.72233926008928
driven_lanedir_consec_max13.006369117641244
driven_lanedir_consec_mean13.006369117641244
driven_lanedir_consec_min13.006369117641244
driven_lanedir_max13.006369117641244
driven_lanedir_mean13.006369117641244
driven_lanedir_median13.006369117641244
driven_lanedir_min13.006369117641244
in-drivable-lane_max24.749999999999556
in-drivable-lane_mean24.749999999999556
in-drivable-lane_min24.749999999999556
per-episodes
details{"zigzag-000-ego0": {"driven_any": 24.72233926008928, "survival_time": 59.99999999999873, "driven_lanedir": 13.006369117641244, "in-drivable-lane": 24.749999999999556, "deviation-heading": 11.185973256721851, "distance-from-start": 4.39664354849673, "deviation-center-line": 2.9091083094645125, "driven_lanedir_consec": 13.006369117641244}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
96304sim-0of4successno0:10:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96303sim-3of4successno0:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96296sim-0of4host-errorno0:09:48
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/5608e44c8b43ad4ab07682827adcbd6e8934b0e687c080708dbc77aeb18a001a/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/5608e44c8b43ad4ab07682827adcbd6e8934b0e687c080708dbc77aeb18a001a/json: Not Found ("No such container: 5608e44c8b43ad4ab07682827adcbd6e8934b0e687c080708dbc77aeb18a001a")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96295sim-3of4host-errorno0:11:00
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/7dee1884f5a31bd963535ce44d379f9dae3e59b5a4405d68afa1e29b33266c7a/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/7dee1884f5a31bd963535ce44d379f9dae3e59b5a4405d68afa1e29b33266c7a/json: Not Found ("No such container: 7dee1884f5a31bd963535ce44d379f9dae3e59b5a4405d68afa1e29b33266c7a")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96292sim-2of4successno0:07:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96291sim-1of4successno0:10:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
75279sim-3of4successno0:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
75278sim-0of4successno0:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
75277sim-1of4successno0:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
75276sim-2of4successno0:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66037sim-0of4successno0:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66036sim-2of4successno0:10:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66035sim-3of4successno0:13:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
66034sim-1of4successno0:11:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62897347successyes1:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible