Duckietown Challenges Home Challenges Submissions

Submission 15558

Submission15558
Competingyes
Challengeaido-LF-sim-validation
UserAdriano Almeida
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 111055 sim-1of4: 111037 sim-2of4: 111035 sim-3of4: 111034
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

111055

Click the images to see detailed statistics about the episode.

loop2-000

111037

Click the images to see detailed statistics about the episode.

autolab-000

111035

Click the images to see detailed statistics about the episode.

loop-000

111034

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
111055sim-0of4successyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.29568656647978897
survival_time_median5.1999999999999895
deviation-center-line_median0.09712808946762395
in-drivable-lane_median3.799999999999991


other stats
deviation-center-line_max0.09712808946762395
deviation-center-line_mean0.09712808946762395
deviation-center-line_min0.09712808946762395
deviation-heading_max1.059713529966028
deviation-heading_mean1.059713529966028
deviation-heading_median1.059713529966028
deviation-heading_min1.059713529966028
distance-from-start_max1.797170732420033
distance-from-start_mean1.797170732420033
distance-from-start_median1.797170732420033
distance-from-start_min1.797170732420033
driven_any_max1.8318188611028656
driven_any_mean1.8318188611028656
driven_any_median1.8318188611028656
driven_any_min1.8318188611028656
driven_lanedir_consec_max0.29568656647978897
driven_lanedir_consec_mean0.29568656647978897
driven_lanedir_consec_min0.29568656647978897
driven_lanedir_max0.29568656647978897
driven_lanedir_mean0.29568656647978897
driven_lanedir_median0.29568656647978897
driven_lanedir_min0.29568656647978897
in-drivable-lane_max3.799999999999991
in-drivable-lane_mean3.799999999999991
in-drivable-lane_min3.799999999999991
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8318188611028656, "survival_time": 5.1999999999999895, "driven_lanedir": 0.29568656647978897, "in-drivable-lane": 3.799999999999991, "deviation-heading": 1.059713529966028, "distance-from-start": 1.797170732420033, "deviation-center-line": 0.09712808946762395, "driven_lanedir_consec": 0.29568656647978897}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
111051sim-0of4successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111046sim-0of4successyes0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111040sim-0of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111037sim-1of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18754996087002465
survival_time_median4.849999999999991
deviation-center-line_median0.05343390873052095
in-drivable-lane_median3.9499999999999904


other stats
deviation-center-line_max0.05343390873052095
deviation-center-line_mean0.05343390873052095
deviation-center-line_min0.05343390873052095
deviation-heading_max0.5221649571734411
deviation-heading_mean0.5221649571734411
deviation-heading_median0.5221649571734411
deviation-heading_min0.5221649571734411
distance-from-start_max1.6447693204816205
distance-from-start_mean1.6447693204816205
distance-from-start_median1.6447693204816205
distance-from-start_min1.6447693204816205
driven_any_max1.6751106797058428
driven_any_mean1.6751106797058428
driven_any_median1.6751106797058428
driven_any_min1.6751106797058428
driven_lanedir_consec_max0.18754996087002465
driven_lanedir_consec_mean0.18754996087002465
driven_lanedir_consec_min0.18754996087002465
driven_lanedir_max0.18754996087002465
driven_lanedir_mean0.18754996087002465
driven_lanedir_median0.18754996087002465
driven_lanedir_min0.18754996087002465
in-drivable-lane_max3.9499999999999904
in-drivable-lane_mean3.9499999999999904
in-drivable-lane_min3.9499999999999904
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.6751106797058428, "survival_time": 4.849999999999991, "driven_lanedir": 0.18754996087002465, "in-drivable-lane": 3.9499999999999904, "deviation-heading": 0.5221649571734411, "distance-from-start": 1.6447693204816205, "deviation-center-line": 0.05343390873052095, "driven_lanedir_consec": 0.18754996087002465}}
simulation-passed1
survival_time_max4.849999999999991
survival_time_mean4.849999999999991
survival_time_min4.849999999999991
No reset possible
111035sim-2of4successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1875463845913623
survival_time_median2.849999999999998
deviation-center-line_median0.05343391934931863
in-drivable-lane_median1.9499999999999975


other stats
deviation-center-line_max0.05343391934931863
deviation-center-line_mean0.05343391934931863
deviation-center-line_min0.05343391934931863
deviation-heading_max0.5221649571734411
deviation-heading_mean0.5221649571734411
deviation-heading_median0.5221649571734411
deviation-heading_min0.5221649571734411
distance-from-start_max0.7743794768805139
distance-from-start_mean0.7743794768805139
distance-from-start_median0.7743794768805139
distance-from-start_min0.7743794768805139
driven_any_max0.7749353729910085
driven_any_mean0.7749353729910085
driven_any_median0.7749353729910085
driven_any_min0.7749353729910085
driven_lanedir_consec_max0.1875463845913623
driven_lanedir_consec_mean0.1875463845913623
driven_lanedir_consec_min0.1875463845913623
driven_lanedir_max0.1875463845913623
driven_lanedir_mean0.1875463845913623
driven_lanedir_median0.1875463845913623
driven_lanedir_min0.1875463845913623
in-drivable-lane_max1.9499999999999975
in-drivable-lane_mean1.9499999999999975
in-drivable-lane_min1.9499999999999975
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7749353729910085, "survival_time": 2.849999999999998, "driven_lanedir": 0.1875463845913623, "in-drivable-lane": 1.9499999999999975, "deviation-heading": 0.5221649571734411, "distance-from-start": 0.7743794768805139, "deviation-center-line": 0.05343391934931863, "driven_lanedir_consec": 0.1875463845913623}}
simulation-passed1
survival_time_max2.849999999999998
survival_time_mean2.849999999999998
survival_time_min2.849999999999998
No reset possible
111034sim-3of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13682171392361742
survival_time_median3.2999999999999963
deviation-center-line_median0.04260627341040775
in-drivable-lane_median2.4999999999999964


other stats
deviation-center-line_max0.04260627341040775
deviation-center-line_mean0.04260627341040775
deviation-center-line_min0.04260627341040775
deviation-heading_max0.5307299782170598
deviation-heading_mean0.5307299782170598
deviation-heading_median0.5307299782170598
deviation-heading_min0.5307299782170598
distance-from-start_max0.9764264022520436
distance-from-start_mean0.9764264022520436
distance-from-start_median0.9764264022520436
distance-from-start_min0.9764264022520436
driven_any_max0.9800952459743258
driven_any_mean0.9800952459743258
driven_any_median0.9800952459743258
driven_any_min0.9800952459743258
driven_lanedir_consec_max0.13682171392361742
driven_lanedir_consec_mean0.13682171392361742
driven_lanedir_consec_min0.13682171392361742
driven_lanedir_max0.13682171392361742
driven_lanedir_mean0.13682171392361742
driven_lanedir_median0.13682171392361742
driven_lanedir_min0.13682171392361742
in-drivable-lane_max2.4999999999999964
in-drivable-lane_mean2.4999999999999964
in-drivable-lane_min2.4999999999999964
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.9800952459743258, "survival_time": 3.2999999999999963, "driven_lanedir": 0.13682171392361742, "in-drivable-lane": 2.4999999999999964, "deviation-heading": 0.5307299782170598, "distance-from-start": 0.9764264022520436, "deviation-center-line": 0.04260627341040775, "driven_lanedir_consec": 0.13682171392361742}}
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean3.2999999999999963
survival_time_min3.2999999999999963
No reset possible
111033sim-1of4successyes0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111032sim-3of4successyes0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111031sim-2of4successyes0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111029sim-3of4successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111028sim-1of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111027sim-2of4successyes0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111024sim-3of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91411sim-2of4successno0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91406sim-3of4successno0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91404sim-2of4successno0:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91403sim-1of4successno0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91401sim-3of4host-errorno0:00:30
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91399sim-1of4successno0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91398sim-3of4successno0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91397sim-1of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91396sim-3of4successno0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91395sim-1of4successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91394sim-0of4successno0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91392sim-0of4successno0:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77248sim-0of4successno0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77243sim-1of4successno0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77239sim-0of4successno0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77237sim-1of4successno0:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77220sim-2of4successno0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77219sim-3of4successno0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77211sim-3of4successno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77210sim-2of4successno0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77208sim-1of4host-errorno0:02:36
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1146, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77207sim-0of4host-errorno0:02:36
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1146, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible