Duckietown Challenges Home Challenges Submissions

Submission 6306

Submission6306
Competingyes
Challengeaido3-off-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 31097
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

31097

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
31097step1-simulationsuccessyes0:10:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7835355636765784
survival_time_median14.950000000000076
deviation-center-line_median0.7101027224414815
in-drivable-lane_median0


other stats
agent_compute-ego_max0.030942429701487223
agent_compute-ego_mean0.02772881650924683
agent_compute-ego_median0.02714486519495646
agent_compute-ego_min0.025747315883636476
deviation-center-line_max0.9903927783146376
deviation-center-line_mean0.7998691098945789
deviation-center-line_min0.6496077858461564
deviation-heading_max3.2161070953357767
deviation-heading_mean2.6156349047636076
deviation-heading_median2.405642019522237
deviation-heading_min2.2910744135425523
driven_any_max3.267331264127204
driven_any_mean2.914217084797529
driven_any_median2.881640685866953
driven_any_min2.5439437083871876
driven_lanedir_consec_max3.21959839155442
driven_lanedir_consec_mean2.8518339822581855
driven_lanedir_consec_min2.4742300557133934
driven_lanedir_max3.21959839155442
driven_lanedir_mean2.8518339822581855
driven_lanedir_median2.7835355636765784
driven_lanedir_min2.4742300557133934
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5439437083871876, "sim_physics": 0.08630985816319783, "survival_time": 14.950000000000076, "driven_lanedir": 2.4742300557133934, "sim_render-ego": 0.013066232204437256, "in-drivable-lane": 0, "agent_compute-ego": 0.030942429701487223, "deviation-heading": 2.7951463580211557, "set_robot_commands": 0.009665327866872152, "deviation-center-line": 0.9903927783146376, "driven_lanedir_consec": 2.4742300557133934, "sim_compute_sim_state": 0.006229080359141032, "sim_compute_performance-ego": 0.008262728055318197, "sim_compute_robot_state-ego": 0.00976054588953654}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.0649861042526294, "sim_physics": 0.08912631193796794, "survival_time": 14.950000000000076, "driven_lanedir": 3.0157327840412025, "sim_render-ego": 0.013219904899597169, "in-drivable-lane": 0, "agent_compute-ego": 0.02844676733016968, "deviation-heading": 2.370204637396318, "set_robot_commands": 0.009573546250661214, "deviation-center-line": 0.6496077858461564, "driven_lanedir_consec": 3.0157327840412025, "sim_compute_sim_state": 0.006323529084523519, "sim_compute_performance-ego": 0.008066710631052652, "sim_compute_robot_state-ego": 0.009264693260192872}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.881640685866953, "sim_physics": 0.07655500809351604, "survival_time": 14.950000000000076, "driven_lanedir": 2.7835355636765784, "sim_render-ego": 0.012409950097401937, "in-drivable-lane": 0, "agent_compute-ego": 0.025747315883636476, "deviation-heading": 3.2161070953357767, "set_robot_commands": 0.009109538396199544, "deviation-center-line": 0.9779609294364936, "driven_lanedir_consec": 2.7835355636765784, "sim_compute_sim_state": 0.005672473112742106, "sim_compute_performance-ego": 0.007700091203053793, "sim_compute_robot_state-ego": 0.009280303319295248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.813183661353671, "sim_physics": 0.07553450425465902, "survival_time": 14.950000000000076, "driven_lanedir": 2.766073116305332, "sim_render-ego": 0.012844321727752683, "in-drivable-lane": 0, "agent_compute-ego": 0.026362704435984294, "deviation-heading": 2.2910744135425523, "set_robot_commands": 0.009052569071451824, "deviation-center-line": 0.7101027224414815, "driven_lanedir_consec": 2.766073116305332, "sim_compute_sim_state": 0.005731671651204427, "sim_compute_performance-ego": 0.007567052046457926, "sim_compute_robot_state-ego": 0.009265218575795492}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.267331264127204, "sim_physics": 0.08208397388458252, "survival_time": 14.950000000000076, "driven_lanedir": 3.21959839155442, "sim_render-ego": 0.012826624711354574, "in-drivable-lane": 0, "agent_compute-ego": 0.02714486519495646, "deviation-heading": 2.405642019522237, "set_robot_commands": 0.008904244899749756, "deviation-center-line": 0.6712813334341254, "driven_lanedir_consec": 3.21959839155442, "sim_compute_sim_state": 0.005517286459604899, "sim_compute_performance-ego": 0.007787386576334636, "sim_compute_robot_state-ego": 0.009056768417358398}}
set_robot_commands_max0.009665327866872152
set_robot_commands_mean0.009261045296986898
set_robot_commands_median0.009109538396199544
set_robot_commands_min0.008904244899749756
sim_compute_performance-ego_max0.008262728055318197
sim_compute_performance-ego_mean0.00787679370244344
sim_compute_performance-ego_median0.007787386576334636
sim_compute_performance-ego_min0.007567052046457926
sim_compute_robot_state-ego_max0.00976054588953654
sim_compute_robot_state-ego_mean0.00932550589243571
sim_compute_robot_state-ego_median0.009265218575795492
sim_compute_robot_state-ego_min0.009056768417358398
sim_compute_sim_state_max0.006323529084523519
sim_compute_sim_state_mean0.005894808133443197
sim_compute_sim_state_median0.005731671651204427
sim_compute_sim_state_min0.005517286459604899
sim_physics_max0.08912631193796794
sim_physics_mean0.08192193126678467
sim_physics_median0.08208397388458252
sim_physics_min0.07553450425465902
sim_render-ego_max0.013219904899597169
sim_render-ego_mean0.01287340672810872
sim_render-ego_median0.012844321727752683
sim_render-ego_min0.012409950097401937
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
31023step1-simulationerrorno0:00:44
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
31012step1-simulationhost-errorno0:00:43
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 67, in check_docker_environment
    _containers = client.containers.list(filters=dict(status="running"))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
    containers.append(self.get(r['Id']))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ed897b661055c970e3676d53f9507c24632bfe27ec84b6bd3c892266c5de1038/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 911, in run_one
    client = check_docker_environment()
  File "/usr/local/lib/python3.6/dist-packages/dt_shell/env_checks.py", line 74, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/ed897b661055c970e3676d53f9507c24632bfe27ec84b6bd3c892266c5de1038/json

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30875step1-simulationerrorno0:00:28
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30872step1-simulationerrorno0:00:32
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30765step1-simulationsuccessno0:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
30764step1-simulationsuccessno0:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible