Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 79693
16087
Matteo Razzanelli collision-check-exercise mooc-collision-check-vali
step1 failed no gpu-production-spot-0-02
2021-07-03 19:58:25+00:00 2021-07-03 19:58:39+00:00 0:00:14 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 82, in run_checker
msg = agent_ci.write_topic_and_expect("query", q, expect="response")
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:
error in checker |Exception while handling a message on topic "query".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/project/collision_checker.py", line 30, in on_received_query
|| collided = check_collision(Wcoll=self.params.environment, robot_body=self.params.body, robot_pose=data.pose)
|| File "/project/collision_checker.py", line 45, in check_collision
|| rototranslated_robot.append(np.dot(T_or,p))
|| File "<__array_function__ internals>", line 5, in dot
|| TypeError: unsupported operand type(s) for *: 'float' and 'PlacedPrimitive'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 561, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f784aef9ca0>>.
|| │ f: <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f784aef9ca0>>
|| │ args: dict[2]
|| │ │ data :
|| │ │ CollisionCheckQuery
|| │ │ │ pose :
|| │ │ │ FriendlyPose
|| │ │ │ │ x : 3.357616573732855
|| │ │ │ │ y : 3.885123846583553
|| │ │ │ │ theta_deg : 224.5250538878613
|| │ │ context : <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f771ce56ee0>
|| │ argspec: <class 'inspect.FullArgSpec'> [7]
|| │ #0 [self, context, data]
|| │ #1 None
|| │ #2 None
|| │ #3 None
|| │ #4 []
|| │ #5 None
|| │ #6 dict[2]
|| │ │ context : <class 'zuper_nodes_wrapper.interface.Context'>
|| │ │ data :
|| │ │ dataclass dt_protocols.collision_protocol.CollisionCheckQuery
|| │ │ field pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
|| │ │ field x : float
|| │ │ field y : float
|| │ │ field theta_deg : float
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 89, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 95, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 79687
16089
Matteo Razzanelli collision-check-exercise mooc-collision-check-vali
step1 success no gpu-production-spot-0-02
2021-07-03 19:57:53+00:00 2021-07-03 19:58:16+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate 1.0 false_positive_rate 0.0
other stats No reset possible 79686
13798
Nicholas Kostelnik template-random aido-hello-sim-validation
370 aborted no gpu-production-spot-0-02
2021-07-03 19:57:13+00:00 2021-07-03 19:57:35+00:00 0:00:22 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691 tag None
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 79669
16081
Evanthia Fasoula exercises_braitenberg mooc-BV1
sim-2of5 success no gpu-production-spot-0-02
2021-07-03 19:54:55+00:00 2021-07-03 19:56:33+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 2.700087207312898
other stats agent_compute-ego0_max 0.011830152609409433 agent_compute-ego0_mean 0.011830152609409433 agent_compute-ego0_median 0.011830152609409433 agent_compute-ego0_min 0.011830152609409433 complete-iteration_max 0.22262148368052948 complete-iteration_mean 0.22262148368052948 complete-iteration_median 0.22262148368052948 complete-iteration_min 0.22262148368052948 deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 2.700087207312898 distance-from-start_median 2.700087207312898 distance-from-start_min 2.700087207312898 driven_any_max 2.7101917725835074 driven_any_mean 2.7101917725835074 driven_any_median 2.7101917725835074 driven_any_min 2.7101917725835074 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 get_duckie_state_max 0.08292801156003252 get_duckie_state_mean 0.08292801156003252 get_duckie_state_median 0.08292801156003252 get_duckie_state_min 0.08292801156003252 get_robot_state_max 0.003996166408571423 get_robot_state_mean 0.003996166408571423 get_robot_state_median 0.003996166408571423 get_robot_state_min 0.003996166408571423 get_state_dump_max 0.01859110848516481 get_state_dump_mean 0.01859110848516481 get_state_dump_median 0.01859110848516481 get_state_dump_min 0.01859110848516481 get_ui_image_max 0.01510038742652306 get_ui_image_mean 0.01510038742652306 get_ui_image_median 0.01510038742652306 get_ui_image_min 0.01510038742652306 in-drivable-lane_max 5.799999999999987 in-drivable-lane_mean 5.799999999999987 in-drivable-lane_median 5.799999999999987 in-drivable-lane_min 5.799999999999987 per-episodes details {"d40-ego0": {"driven_any": 2.7101917725835074, "get_ui_image": 0.01510038742652306, "step_physics": 0.07247338335738222, "survival_time": 5.799999999999987, "driven_lanedir": 0.0, "get_state_dump": 0.01859110848516481, "get_robot_state": 0.003996166408571423, "sim_render-ego0": 0.0036801048833080847, "get_duckie_state": 0.08292801156003252, "in-drivable-lane": 5.799999999999987, "deviation-heading": 0.0, "agent_compute-ego0": 0.011830152609409433, "complete-iteration": 0.22262148368052948, "set_robot_commands": 0.0023022105551173543, "distance-from-start": 2.700087207312898, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009642274970682258, "sim_compute_performance-ego0": 0.0019725958506266275}}set_robot_commands_max 0.0023022105551173543 set_robot_commands_mean 0.0023022105551173543 set_robot_commands_median 0.0023022105551173543 set_robot_commands_min 0.0023022105551173543 sim_compute_performance-ego0_max 0.0019725958506266275 sim_compute_performance-ego0_mean 0.0019725958506266275 sim_compute_performance-ego0_median 0.0019725958506266275 sim_compute_performance-ego0_min 0.0019725958506266275 sim_compute_sim_state_max 0.009642274970682258 sim_compute_sim_state_mean 0.009642274970682258 sim_compute_sim_state_median 0.009642274970682258 sim_compute_sim_state_min 0.009642274970682258 sim_render-ego0_max 0.0036801048833080847 sim_render-ego0_mean 0.0036801048833080847 sim_render-ego0_median 0.0036801048833080847 sim_render-ego0_min 0.0036801048833080847 simulation-passed 1 step_physics_max 0.07247338335738222 step_physics_mean 0.07247338335738222 step_physics_median 0.07247338335738222 step_physics_min 0.07247338335738222 survival_time_max 5.799999999999987 survival_time_mean 5.799999999999987 survival_time_median 5.799999999999987 survival_time_min 5.799999999999987
No reset possible 79664
16087
Matteo Razzanelli collision-check-exercise mooc-collision-check-vali
step1 failed no gpu-production-spot-0-02
2021-07-03 19:54:23+00:00 2021-07-03 19:54:45+00:00 0:00:22 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 82, in run_checker
msg = agent_ci.write_topic_and_expect("query", q, expect="response")
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:
error in checker |Exception while handling a message on topic "query".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/project/collision_checker.py", line 30, in on_received_query
|| collided = check_collision(Wcoll=self.params.environment, robot_body=self.params.body, robot_pose=data.pose)
|| File "/project/collision_checker.py", line 45, in check_collision
|| rototranslated_robot.append(np.dot(T_or,p))
|| File "<__array_function__ internals>", line 5, in dot
|| TypeError: unsupported operand type(s) for *: 'float' and 'PlacedPrimitive'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 561, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f2be4d3bca0>>.
|| │ f: <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f2be4d3bca0>>
|| │ args: dict[2]
|| │ │ data :
|| │ │ CollisionCheckQuery
|| │ │ │ pose :
|| │ │ │ FriendlyPose
|| │ │ │ │ x : 3.357616573732855
|| │ │ │ │ y : 3.885123846583553
|| │ │ │ │ theta_deg : 224.5250538878613
|| │ │ context : <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f2ab6c9ae80>
|| │ argspec: <class 'inspect.FullArgSpec'> [7]
|| │ #0 [self, context, data]
|| │ #1 None
|| │ #2 None
|| │ #3 None
|| │ #4 []
|| │ #5 None
|| │ #6 dict[2]
|| │ │ context : <class 'zuper_nodes_wrapper.interface.Context'>
|| │ │ data :
|| │ │ dataclass dt_protocols.collision_protocol.CollisionCheckQuery
|| │ │ field pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
|| │ │ field x : float
|| │ │ field y : float
|| │ │ field theta_deg : float
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 89, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 95, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 79660
16087
Matteo Razzanelli collision-check-exercise mooc-collision-check-vali
step1 failed no gpu-production-spot-0-02
2021-07-03 19:53:49+00:00 2021-07-03 19:54:06+00:00 0:00:17 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 82, in run_checker
msg = agent_ci.write_topic_and_expect("query", q, expect="response")
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:
error in checker |Exception while handling a message on topic "query".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/project/collision_checker.py", line 30, in on_received_query
|| collided = check_collision(Wcoll=self.params.environment, robot_body=self.params.body, robot_pose=data.pose)
|| File "/project/collision_checker.py", line 45, in check_collision
|| rototranslated_robot.append(np.dot(T_or,p))
|| File "<__array_function__ internals>", line 5, in dot
|| TypeError: unsupported operand type(s) for *: 'float' and 'PlacedPrimitive'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 561, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f33bc65dca0>>.
|| │ f: <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f33bc65dca0>>
|| │ args: dict[2]
|| │ │ data :
|| │ │ CollisionCheckQuery
|| │ │ │ pose :
|| │ │ │ FriendlyPose
|| │ │ │ │ x : 3.357616573732855
|| │ │ │ │ y : 3.885123846583553
|| │ │ │ │ theta_deg : 224.5250538878613
|| │ │ context : <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f328e5b2d00>
|| │ argspec: <class 'inspect.FullArgSpec'> [7]
|| │ #0 [self, context, data]
|| │ #1 None
|| │ #2 None
|| │ #3 None
|| │ #4 []
|| │ #5 None
|| │ #6 dict[2]
|| │ │ context : <class 'zuper_nodes_wrapper.interface.Context'>
|| │ │ data :
|| │ │ dataclass dt_protocols.collision_protocol.CollisionCheckQuery
|| │ │ field pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
|| │ │ field x : float
|| │ │ field y : float
|| │ │ field theta_deg : float
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 89, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 95, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 79657
16091
Matteo Razzanelli collision-check-exercise mooc-collision-check-vali
step1 host-error no gpu-production-spot-0-02
2021-07-03 19:52:06+00:00 2021-07-03 19:53:38+00:00 0:01:32 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
container = client.containers.get(container_id)
File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
resp = self.client.api.inspect_container(container_id)
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
write_logs(wd, project, services=config["services"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│ names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible