Duckietown Challenges Home Challenges Submissions

Submission 16984

Submission16984
Competingyes
Challengemooc-BV1
UserAndrey Naydenko
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 108170 sim-1of5: 108162 sim-2of5: 108166 sim-3of5: 108174 sim-4of5: 108165
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

108174

Click the images to see detailed statistics about the episode.

d30

108170

Click the images to see detailed statistics about the episode.

d45

108166

Click the images to see detailed statistics about the episode.

d40

108165

Click the images to see detailed statistics about the episode.

d60

108162

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
108174sim-3of5successyes0:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.369174882212506


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.369174882212506
distance-from-start_median4.369174882212506
distance-from-start_min4.369174882212506
driven_any_max4.778912212286809
driven_any_mean4.778912212286809
driven_any_median4.778912212286809
driven_any_min4.778912212286809
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max53.4999999999991
in-drivable-lane_mean53.4999999999991
in-drivable-lane_median53.4999999999991
in-drivable-lane_min53.4999999999991
per-episodes
details{"d30-ego0": {"driven_any": 4.778912212286809, "survival_time": 53.4999999999991, "driven_lanedir": 0.0, "in-drivable-lane": 53.4999999999991, "deviation-heading": 0.0, "distance-from-start": 4.369174882212506, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max53.4999999999991
survival_time_mean53.4999999999991
survival_time_median53.4999999999991
survival_time_min53.4999999999991
No reset possible
108170sim-0of5successyes0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.6034736430398102


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.6034736430398102
distance-from-start_median1.6034736430398102
distance-from-start_min1.6034736430398102
driven_any_max1.6753558564796447
driven_any_mean1.6753558564796447
driven_any_median1.6753558564796447
driven_any_min1.6753558564796447
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max19.600000000000144
in-drivable-lane_mean19.600000000000144
in-drivable-lane_median19.600000000000144
in-drivable-lane_min19.600000000000144
per-episodes
details{"d45-ego0": {"driven_any": 1.6753558564796447, "survival_time": 19.600000000000144, "driven_lanedir": 0.0, "in-drivable-lane": 19.600000000000144, "deviation-heading": 0.0, "distance-from-start": 1.6034736430398102, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max19.600000000000144
survival_time_mean19.600000000000144
survival_time_median19.600000000000144
survival_time_min19.600000000000144
No reset possible
108169sim-3of5successyes0:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108167sim-0of5successyes0:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108166sim-2of5successyes0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8021110908679357


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8021110908679357
distance-from-start_median0.8021110908679357
distance-from-start_min0.8021110908679357
driven_any_max0.8230811780607488
driven_any_mean0.8230811780607488
driven_any_median0.8230811780607488
driven_any_min0.8230811780607488
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max9.700000000000005
in-drivable-lane_mean9.700000000000005
in-drivable-lane_median9.700000000000005
in-drivable-lane_min9.700000000000005
per-episodes
details{"d40-ego0": {"driven_any": 0.8230811780607488, "survival_time": 9.700000000000005, "driven_lanedir": 0.0, "in-drivable-lane": 9.700000000000005, "deviation-heading": 0.0, "distance-from-start": 0.8021110908679357, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max9.700000000000005
survival_time_mean9.700000000000005
survival_time_median9.700000000000005
survival_time_min9.700000000000005
No reset possible
108165sim-4of5successyes0:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.451291903163052


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.451291903163052
distance-from-start_median2.451291903163052
distance-from-start_min2.451291903163052
driven_any_max2.529032074647519
driven_any_mean2.529032074647519
driven_any_median2.529032074647519
driven_any_min2.529032074647519
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max28.250000000000263
in-drivable-lane_mean28.250000000000263
in-drivable-lane_median28.250000000000263
in-drivable-lane_min28.250000000000263
per-episodes
details{"d60-ego0": {"driven_any": 2.529032074647519, "survival_time": 28.250000000000263, "driven_lanedir": 0.0, "in-drivable-lane": 28.250000000000263, "deviation-heading": 0.0, "distance-from-start": 2.451291903163052, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max28.250000000000263
survival_time_mean28.250000000000263
survival_time_median28.250000000000263
survival_time_min28.250000000000263
No reset possible
108164sim-2of5successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108162sim-1of5successyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8925890695658765


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8925890695658765
distance-from-start_median0.8925890695658765
distance-from-start_min0.8925890695658765
driven_any_max0.91336348514275
driven_any_mean0.91336348514275
driven_any_median0.91336348514275
driven_any_min0.91336348514275
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max9.950000000000006
in-drivable-lane_mean9.950000000000006
in-drivable-lane_median9.950000000000006
in-drivable-lane_min9.950000000000006
per-episodes
details{"d50-ego0": {"driven_any": 0.91336348514275, "survival_time": 9.950000000000006, "driven_lanedir": 0.0, "in-drivable-lane": 9.950000000000006, "deviation-heading": 0.0, "distance-from-start": 0.8925890695658765, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max9.950000000000006
survival_time_mean9.950000000000006
survival_time_median9.950000000000006
survival_time_min9.950000000000006
No reset possible
108160sim-4of5successyes0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108158sim-1of5successyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108155sim-1of5successyes0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108152sim-1of5successyes0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108149sim-1of5successyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108146sim-1of5successyes0:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108143sim-1of5successyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108139sim-1of5successyes0:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108137sim-1of5timeoutyes0:00:11
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84922sim-0of5successno0:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84921sim-0of5successno0:04:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84920sim-2of5successno0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84919sim-1of5successno0:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84918sim-4of5successno0:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84917sim-3of5successno0:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84916sim-2of5successno0:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84915sim-0of5host-errorno0:21:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 281, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 676, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 851, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.upload_file(realfile, ExtraArgs={"ContentType": mime_type})
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 278, in object_upload_file
    return self.meta.client.upload_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 129, in upload_file
    return transfer.upload_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/transfer.py", line 279, in upload_file
    future.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 106, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 265, in result
    raise self._exception
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/upload.py", line 692, in _main
    client.put_object(Bucket=bucket, Key=key, Body=body, **extra_args)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 662, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 682, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 136, in _send_request
    while self._needs_retry(attempts, operation_model, request_dict,
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 253, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 250, in __call__
    should_retry = self._should_retry(attempt_number, response,
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 316, in __call__
    checker_response = checker(attempt_number, response,
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 222, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 200, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 269, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 343, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/v3/frankfurt/by-value/sha256/f3a37499fc7ccfd1b84682bec8241a10f43f6c6e446ccba67682ff1854fbe861"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible