Submission 17196

Submission

17196

Competing

yes

Challenge

mooc-BV1

User

Dmytro Humeniuk

Date submitted

2021-10-13 03:46:55+00:00

Last status update

2021-12-04 20:48:59+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of5: 107312 sim-1of5: 107310 sim-2of5: 107336 sim-3of5: 107327 sim-4of5: 107330

User label

exercises_braitenberg

Admin priority

Blessing

n/a

User priority

107336

Click the images to see detailed statistics about the episode.

d40

107330

Click the images to see detailed statistics about the episode.

d60

107327

Click the images to see detailed statistics about the episode.

d30

107312

Click the images to see detailed statistics about the episode.

d45

107310

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

107336

sim-2of5

success

yes

2021-11-03 10:54:44+00:00

2021-11-03 10:57:07+00:00

0:02:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

0.716576020664128

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	0.716576020664128
distance-from-start_median	0.716576020664128
distance-from-start_min	0.716576020664128
driven_any_max	1.4718385504794411
driven_any_mean	1.4718385504794411
driven_any_median	1.4718385504794411
driven_any_min	1.4718385504794411
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	21.700000000000173
in-drivable-lane_mean	21.700000000000173
in-drivable-lane_median	21.700000000000173
in-drivable-lane_min	21.700000000000173
per-episodes	details {"d40-ego0": {"driven_any": 1.4718385504794411, "survival_time": 21.700000000000173, "driven_lanedir": 0.0, "in-drivable-lane": 21.700000000000173, "deviation-heading": 0.0, "distance-from-start": 0.716576020664128, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	21.700000000000173
survival_time_mean	21.700000000000173
survival_time_median	21.700000000000173
survival_time_min	21.700000000000173

No reset possible

107330

sim-4of5

success

yes

2021-11-03 10:51:57+00:00

2021-11-03 10:58:20+00:00

0:06:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.9996549825790426

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.9996549825790426
distance-from-start_median	2.9996549825790426
distance-from-start_min	2.9996549825790426
driven_any_max	4.516134551430202
driven_any_mean	4.516134551430202
driven_any_median	4.516134551430202
driven_any_min	4.516134551430202
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d60-ego0": {"driven_any": 4.516134551430202, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 2.9996549825790426, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107329

sim-2of5

success

yes

2021-11-03 10:51:56+00:00

2021-11-03 10:54:24+00:00

0:02:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107327

sim-3of5

success

yes

2021-11-03 10:50:20+00:00

2021-11-03 10:55:09+00:00

0:04:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

3.579600000000537

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	3.579600000000537
distance-from-start_median	3.579600000000537
distance-from-start_min	3.579600000000537
driven_any_max	3.579600000000637
driven_any_mean	3.579600000000637
driven_any_median	3.579600000000637
driven_any_min	3.579600000000637
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d30-ego0": {"driven_any": 3.579600000000637, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 3.579600000000537, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107323

sim-2of5

success

yes

2021-11-03 10:48:50+00:00

2021-11-03 10:51:16+00:00

0:02:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107320

sim-2of5

success

yes

2021-11-03 10:45:54+00:00

2021-11-03 10:48:23+00:00

0:02:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107319

sim-3of5

success

yes

2021-11-03 10:45:21+00:00

2021-11-03 10:50:08+00:00

0:04:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107318

sim-4of5

success

yes

2021-11-03 10:45:20+00:00

2021-11-03 10:51:24+00:00

0:06:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107312

sim-0of5

success

yes

2021-11-03 10:42:50+00:00

2021-11-03 10:48:38+00:00

0:05:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

1.791891921357158

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	1.791891921357158
distance-from-start_median	1.791891921357158
distance-from-start_min	1.791891921357158
driven_any_max	3.869247533806361
driven_any_mean	3.869247533806361
driven_any_median	3.869247533806361
driven_any_min	3.869247533806361
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d45-ego0": {"driven_any": 3.869247533806361, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 1.791891921357158, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107310

sim-1of5

success

yes

2021-11-03 10:42:49+00:00

2021-11-03 10:48:34+00:00

0:05:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

2.624258403876479

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	2.624258403876479
distance-from-start_median	2.624258403876479
distance-from-start_min	2.624258403876479
driven_any_max	4.109666561331031
driven_any_mean	4.109666561331031
driven_any_median	4.109666561331031
driven_any_min	4.109666561331031
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d50-ego0": {"driven_any": 4.109666561331031, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 2.624258403876479, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

107301

sim-1of5

success

yes

2021-11-03 10:36:13+00:00

2021-11-03 10:41:49+00:00

0:05:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

107299

sim-0of5

success

yes

2021-11-03 10:35:04+00:00

2021-11-03 10:40:28+00:00

0:05:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87113

sim-3of5

success

2021-10-13 04:03:38+00:00

2021-10-13 04:11:51+00:00

0:08:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87112

sim-0of5

success

2021-10-13 03:53:09+00:00

2021-10-13 04:02:54+00:00

0:09:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87111

sim-0of5

error

2021-10-13 03:52:06+00:00

2021-10-13 03:52:50+00:00

0:00:44

The result file [...]

    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-BV1/submission17196/sim-0of5-montreal05_802404650a97-job87111-a-wd/logs/solution-ego0/online.html

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87110

sim-2of5

success

2021-10-13 03:51:59+00:00

2021-10-13 03:56:04+00:00

0:04:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87109

sim-4of5

success

2021-10-13 03:51:54+00:00

2021-10-13 04:03:00+00:00

0:11:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87108

sim-1of5

success

2021-10-13 03:51:53+00:00

2021-10-13 04:02:05+00:00

0:10:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

87107

sim-3of5

host-error

2021-10-13 03:51:51+00:00

2021-10-13 04:00:16+00:00

0:08:25

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/containers/84b796169abc8361565f97632422459906717cb7fc1a1b5d40b9d02ba254eb0d/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 889, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 773, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.41/containers/84b796169abc8361565f97632422459906717cb7fc1a1b5d40b9d02ba254eb0d/json: Not Found ("No such container: 84b796169abc8361565f97632422459906717cb7fc1a1b5d40b9d02ba254eb0d")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible