Submission 6574

Submission	`6574`

Competing	yes
Challenge	`aido3-off-LF-real-validation`
User	Gianmarco Bernasconi
Date submitted	2020-02-25 19:05:43+00:00
Last status update	2021-12-04 20:53:46+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💚
Jobs	eval0: `32365` eval0-videos: `32461` eval0-visualize: `32460` eval1: `32538` eval1-videos: `32574` eval1-visualize: `32557` eval2: `32604` eval2-videos: `32611` eval2-visualize: `32608`
Next
User label	Test diffDB 03-0
Admin priority	120
Blessing	n/a
User priority	120

32611

autobot03

watchtower21

watchtower22

watchtower23

watchtower24

watchtower25

watchtower26

watchtower27

watchtower28

watchtower29

watchtower30

watchtower31

watchtower32

watchtower33

watchtower34

watchtower35

watchtower36

32608

Click the images to see detailed statistics about the episode.

index.html

32574

autobot03

watchtower21

watchtower22

watchtower23

watchtower24

watchtower25

watchtower26

watchtower27

watchtower28

watchtower29

watchtower30

watchtower31

watchtower32

watchtower33

watchtower34

watchtower35

watchtower36

32557

Click the images to see detailed statistics about the episode.

index.html

32461

autobot03

watchtower05

watchtower21

watchtower22

watchtower23

watchtower24

watchtower25

watchtower27

watchtower28

watchtower29

watchtower30

watchtower31

watchtower32

watchtower33

watchtower34

watchtower35

watchtower36

32460

Click the images to see detailed statistics about the episode.

index.html

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

32611

eval2-videos

success

yes

2020-02-28 16:20:49+00:00

2020-02-28 16:27:22+00:00

0:06:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32609

eval2-videos

host-error

yes

2020-02-28 16:15:57+00:00

2020-02-28 16:19:49+00:00

0:03:52

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 583, in _main
    fileobj.write(data)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 332, in write
    self._fileobj.write(data)
OSError: [Errno 28] No space left on device

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32608

eval2-visualize

success

yes

2020-02-28 16:15:53+00:00

2020-02-28 16:26:24+00:00

0:10:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec	4.897982962320533
survival_time	45.3333
deviation-center-line	3.3031238796142075
in-drivable-lane	7.333300000000001

other stats

deviation-heading	5.122730137905192
driven_any	6.220712241024981
driven_lanedir	4.897982962320533
visualized-eval2-passed	1

No reset possible

32607

eval2-visualize

success

yes

2020-02-28 16:15:17+00:00

2020-02-28 16:26:14+00:00

0:10:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32606

eval2-videos

success

yes

2020-02-28 16:15:16+00:00

2020-02-28 16:27:22+00:00

0:12:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32604

eval2

success

yes

2020-02-28 15:52:38+00:00

2020-02-28 16:14:43+00:00

0:22:05

Scores from the eval [...]

Scores from the evaluation of job: 32604

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

driven_lanedir_consec_median	6.352582223391545
survival_time_median	45.821

No reset possible

32601

eval2

aborted

yes

2020-02-28 14:51:49+00:00

2020-02-28 15:52:15+00:00

1:00:26

Scores from the eval [...]

Scores from the evaluation of job: 32601

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32575

eval2

aborted

yes

2020-02-28 13:53:36+00:00

2020-02-28 14:16:27+00:00

0:22:51

Scores from the eval [...]

Scores from the evaluation of job: 32575

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32574

eval1-videos

success

yes

2020-02-28 13:53:03+00:00

2020-02-28 13:55:53+00:00

0:02:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32573

eval1-videos

success

yes

2020-02-28 13:52:24+00:00

2020-02-28 13:55:53+00:00

0:03:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32563

eval1-videos

host-error

yes

2020-02-28 13:30:55+00:00

2020-02-28 13:51:47+00:00

0:20:52

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32559

eval1-videos

host-error

yes

2020-02-28 13:30:24+00:00

2020-02-28 13:51:29+00:00

0:21:05

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32558

eval1-videos

host-error

yes

2020-02-28 13:30:22+00:00

2020-02-28 13:51:40+00:00

0:21:18

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32557

eval1-visualize

success

yes

2020-02-28 13:30:20+00:00

2020-02-28 13:48:04+00:00

0:17:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec	5.433757531382581
survival_time	44.6666
deviation-center-line	1.878392153889877
in-drivable-lane	0

other stats

deviation-heading	4.720117602219368
driven_any	5.558436086745207
driven_lanedir	5.433757531382581
visualized-eval1-passed	1

No reset possible

32556

eval1-visualize

success

yes

2020-02-28 13:29:29+00:00

2020-02-28 13:47:30+00:00

0:18:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32538

eval1

success

yes

2020-02-28 13:07:59+00:00

2020-02-28 13:28:05+00:00

0:20:06

Scores from the eval [...]

Scores from the evaluation of job: 32538

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

driven_lanedir_consec_median	5.653015930805655
survival_time_median	46.802

No reset possible

32476

eval2-visualize

success

yes

2020-02-28 11:12:46+00:00

2020-02-28 11:17:15+00:00

0:04:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32475

eval1-visualize

success

yes

2020-02-28 11:10:11+00:00

2020-02-28 11:12:10+00:00

0:01:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32470

eval1-visualize

host-error

yes

2020-02-28 11:04:12+00:00

2020-02-28 11:08:24+00:00

0:04:12

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32469

eval2-visualize

host-error

yes

2020-02-28 11:04:06+00:00

2020-02-28 11:08:27+00:00

0:04:21

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32468

eval2-visualize

host-error

yes

2020-02-28 11:02:59+00:00

2020-02-28 11:08:26+00:00

0:05:27

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32467

eval2-visualize

host-error

yes

2020-02-28 11:02:30+00:00

2020-02-28 11:08:28+00:00

0:05:58

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 919, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32462

eval1-visualize

success

yes

2020-02-28 10:29:38+00:00

2020-02-28 11:01:59+00:00

0:32:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32461

eval0-videos

success

yes

2020-02-28 10:29:38+00:00

2020-02-28 11:09:41+00:00

0:40:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32460

eval0-visualize

success

yes

2020-02-28 10:29:36+00:00

2020-02-28 11:02:20+00:00

0:32:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec	6.271129205981461
survival_time	47.3333
deviation-center-line	2.0435606932498467
in-drivable-lane	2

other stats

deviation-heading	4.011674224420538
driven_any	6.747221546413961
driven_lanedir	6.271129205981461
visualized-eval0-passed	1

No reset possible

32459

eval2-visualize

host-error

yes

2020-02-28 10:29:36+00:00

2020-02-28 10:36:04+00:00

0:06:28

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1404, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 28, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 643, in get_cr
    server_host=server_host,
  File "/project/src/duckietown_challenges_runner/runner.py", line 720, in run_single
    prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1029, in prepare_dir
    aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs
  File "/project/src/duckietown_challenges_runner/runner.py", line 1419, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1463, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 583, in _main
    fileobj.write(data)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 332, in write
    self._fileobj.write(data)
OSError: [Errno 28] No space left on device

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32458

eval2-videos

success

yes

2020-02-28 10:29:36+00:00

2020-02-28 11:03:32+00:00

0:33:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32457

eval1-videos

success

yes

2020-02-28 10:29:35+00:00

2020-02-28 11:03:39+00:00

0:34:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32444

eval2-visualize

success

2020-02-27 18:46:01+00:00

2020-02-27 18:50:44+00:00

0:04:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32443

eval2-videos

success

2020-02-27 18:45:57+00:00

2020-02-27 18:51:19+00:00

0:05:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32442

eval2

aborted

yes

2020-02-27 18:37:53+00:00

2020-02-27 18:45:18+00:00

0:07:25

Scores from the eval [...]

Scores from the evaluation of job: 32442

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32436

eval2-videos

success

2020-02-27 18:02:24+00:00

2020-02-27 18:08:10+00:00

0:05:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32435

eval2-visualize

success

2020-02-27 18:02:01+00:00

2020-02-27 18:07:19+00:00

0:05:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32434

eval2-videos

success

2020-02-27 18:01:43+00:00

2020-02-27 18:07:22+00:00

0:05:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32433

eval2-visualize

success

2020-02-27 18:01:28+00:00

2020-02-27 18:07:21+00:00

0:05:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32432

eval2

aborted

yes

2020-02-27 17:52:16+00:00

2020-02-27 18:00:55+00:00

0:08:39

Scores from the eval [...]

Scores from the evaluation of job: 32432

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32428

eval1-videos

success

2020-02-27 16:31:50+00:00

2020-02-27 16:39:18+00:00

0:07:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32427

eval1-visualize

success

2020-02-27 16:31:45+00:00

2020-02-27 16:38:53+00:00

0:07:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32426

eval1-visualize

success

2020-02-27 16:31:24+00:00

2020-02-27 16:38:19+00:00

0:06:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32425

eval1-videos

success

2020-02-27 16:31:13+00:00

2020-02-27 16:39:18+00:00

0:08:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32424

eval1

aborted

yes

2020-02-27 16:22:33+00:00

2020-02-27 16:30:00+00:00

0:07:27

Scores from the eval [...]

Scores from the evaluation of job: 32424

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32423

eval1

timeout

yes

2020-02-27 16:19:08+00:00

2020-02-27 16:22:06+00:00

0:02:58

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32390

eval2-visualize

success

2020-02-27 12:03:27+00:00

2020-02-27 12:12:28+00:00

0:09:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32389

eval2-videos

success

2020-02-27 12:03:14+00:00

2020-02-27 12:10:35+00:00

0:07:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32388

eval2-visualize

success

2020-02-27 12:03:04+00:00

2020-02-27 12:12:27+00:00

0:09:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32387

eval2-videos

success

2020-02-27 12:02:43+00:00

2020-02-27 12:13:09+00:00

0:10:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32386

eval2

aborted

yes

2020-02-27 11:47:32+00:00

2020-02-27 12:02:00+00:00

0:14:28

Scores from the eval [...]

Scores from the evaluation of job: 32386

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32384

eval2

aborted

yes

2020-02-27 09:57:23+00:00

2020-02-27 11:45:10+00:00

1:47:47

Scores from the eval [...]

Scores from the evaluation of job: 32384

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32383

eval1-videos

success

2020-02-27 01:28:42+00:00

2020-02-27 01:40:49+00:00

0:12:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32382

eval1-videos

success

2020-02-27 01:28:27+00:00

2020-02-27 01:40:50+00:00

0:12:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32365

eval0

success

yes

2020-02-25 20:56:07+00:00

2020-02-25 21:11:54+00:00

0:15:47

Scores from the eval [...]

Scores from the evaluation of job: 32365

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

driven_lanedir_consec_median	6.8809925383748745
survival_time_median	51.872

No reset possible