Duckietown Challenges Home Challenges Submissions

Submission 12020

Submission12020
Competingyes
Challengeaido5-LF-sim-validation
UserAyman Shams 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53778
Next
User labelreal-exercise-2
Admin priority50
Blessingn/a
User priority50

53778

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53778LFv-simsuccessyes0:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48138958790383146
survival_time_median12.025000000000036
deviation-center-line_median0.33345678746877366
in-drivable-lane_median7.375000000000044


other stats
agent_compute-ego0_max0.012832539980528784
agent_compute-ego0_mean0.01172570420912135
agent_compute-ego0_median0.011743148871913
agent_compute-ego0_min0.010583979112130625
complete-iteration_max0.33769771414743344
complete-iteration_mean0.2960611463078184
complete-iteration_median0.31237469224801656
complete-iteration_min0.221797486587807
deviation-center-line_max0.3802916658264969
deviation-center-line_mean0.30650273601039024
deviation-center-line_min0.17880570327751663
deviation-heading_max3.161356130982209
deviation-heading_mean1.9743522719863076
deviation-heading_median1.9373237576458648
deviation-heading_min0.8614054416712923
driven_any_max3.0219426596847994
driven_any_mean1.7506289087613158
driven_any_median1.4585254890416857
driven_any_min1.0635219972770928
driven_lanedir_consec_max0.6434143025977583
driven_lanedir_consec_mean0.46863120846268286
driven_lanedir_consec_min0.26833135544531017
driven_lanedir_max0.6434143025977583
driven_lanedir_mean0.46863120846268286
driven_lanedir_median0.48138958790383146
driven_lanedir_min0.26833135544531017
get_duckie_state_max1.7379802432867998e-06
get_duckie_state_mean1.4976826822215935e-06
get_duckie_state_median1.4958905558423218e-06
get_duckie_state_min1.2609693739149303e-06
get_robot_state_max0.003942367157649473
get_robot_state_mean0.0037440756746175505
get_robot_state_median0.0038206473956036422
get_robot_state_min0.003392640749613444
get_state_dump_max0.0049804064745460055
get_state_dump_mean0.004703151783724566
get_state_dump_median0.004737289186230365
get_state_dump_min0.004357622287891529
get_ui_image_max0.03558991660534496
get_ui_image_mean0.03136665889429588
get_ui_image_median0.032468142823123824
get_ui_image_min0.02494043332559091
in-drivable-lane_max20.200000000000177
in-drivable-lane_mean9.637500000000069
in-drivable-lane_min3.600000000000006
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0219426596847994, "get_ui_image": 0.030966586286916672, "step_physics": 0.2289744148214408, "survival_time": 23.800000000000203, "driven_lanedir": 0.26833135544531017, "get_state_dump": 0.004806338116307928, "get_robot_state": 0.003803089229815661, "sim_render-ego0": 0.003855975668885173, "get_duckie_state": 1.492990137895948e-06, "in-drivable-lane": 20.200000000000177, "deviation-heading": 2.827428306829461, "agent_compute-ego0": 0.01180254938217579, "complete-iteration": 0.29966660165686776, "set_robot_commands": 0.0023117735200957933, "deviation-center-line": 0.3802916658264969, "driven_lanedir_consec": 0.26833135544531017, "sim_compute_sim_state": 0.010943471260790556, "sim_compute_performance-ego0": 0.0021086523867753066}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2693221366233258, "get_ui_image": 0.03558991660534496, "step_physics": 0.26364394196881935, "survival_time": 10.600000000000016, "driven_lanedir": 0.35456502837156756, "get_state_dump": 0.004668240256152802, "get_robot_state": 0.003838205561391625, "sim_render-ego0": 0.0036547732465144057, "get_duckie_state": 1.4987909737886958e-06, "in-drivable-lane": 6.350000000000023, "deviation-heading": 3.161356130982209, "agent_compute-ego0": 0.011683748361650209, "complete-iteration": 0.33769771414743344, "set_robot_commands": 0.0021199497258719145, "deviation-center-line": 0.3573313604846532, "driven_lanedir_consec": 0.35456502837156756, "sim_compute_sim_state": 0.01045173658451564, "sim_compute_performance-ego0": 0.0019582963325607944}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0635219972770928, "get_ui_image": 0.033969699359330974, "step_physics": 0.2520597007105259, "survival_time": 9.099999999999994, "driven_lanedir": 0.6434143025977583, "get_state_dump": 0.0049804064745460055, "get_robot_state": 0.003942367157649473, "sim_render-ego0": 0.003956291844936017, "get_duckie_state": 1.7379802432867998e-06, "in-drivable-lane": 3.600000000000006, "deviation-heading": 1.0472192084622685, "agent_compute-ego0": 0.012832539980528784, "complete-iteration": 0.32508278283916536, "set_robot_commands": 0.0023347862431260407, "deviation-center-line": 0.17880570327751663, "driven_lanedir_consec": 0.6434143025977583, "sim_compute_sim_state": 0.008775574262024926, "sim_compute_performance-ego0": 0.0021296941517480734}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6477288414600455, "get_ui_image": 0.02494043332559091, "step_physics": 0.16634774914494269, "survival_time": 13.450000000000056, "driven_lanedir": 0.6082141474360954, "get_state_dump": 0.004357622287891529, "get_robot_state": 0.003392640749613444, "sim_render-ego0": 0.00342794347692419, "get_duckie_state": 1.2609693739149303e-06, "in-drivable-lane": 8.400000000000066, "deviation-heading": 0.8614054416712923, "agent_compute-ego0": 0.010583979112130625, "complete-iteration": 0.221797486587807, "set_robot_commands": 0.002025606014110424, "deviation-center-line": 0.30958221445289413, "driven_lanedir_consec": 0.6082141474360954, "sim_compute_sim_state": 0.004847162741201895, "sim_compute_performance-ego0": 0.0017913429825394242}}
set_robot_commands_max0.0023347862431260407
set_robot_commands_mean0.002198028875801043
set_robot_commands_median0.002215861622983854
set_robot_commands_min0.002025606014110424
sim_compute_performance-ego0_max0.0021296941517480734
sim_compute_performance-ego0_mean0.0019969964634058996
sim_compute_performance-ego0_median0.0020334743596680505
sim_compute_performance-ego0_min0.0017913429825394242
sim_compute_sim_state_max0.010943471260790556
sim_compute_sim_state_mean0.008754486212133254
sim_compute_sim_state_median0.009613655423270282
sim_compute_sim_state_min0.004847162741201895
sim_render-ego0_max0.003956291844936017
sim_render-ego0_mean0.003723746059314946
sim_render-ego0_median0.003755374457699789
sim_render-ego0_min0.00342794347692419
simulation-passed1
step_physics_max0.26364394196881935
step_physics_mean0.2277564516614322
step_physics_median0.24051705776598337
step_physics_min0.16634774914494269
survival_time_max23.800000000000203
survival_time_mean14.237500000000068
survival_time_min9.099999999999994
No reset possible
53775LFv-simsuccessyes0:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53774LFv-simsuccessyes0:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53745LFv-simhost-erroryes0:11:49
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53733LFv-simhost-erroryes0:12:12
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53721LFv-simsuccessyes0:10:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible