Job ID | submission | user | user label | challenge | step | status | up to date | evaluator | date started | date completed | duration | message | | |
79697 | 16087 | Matteo Razzanelli | collision-check-exercise | mooc-collision-check-vali | step1 | failed | no | gpu-production-spot-0-04 | | | 0:00:16 | InvalidSubmission:
T [...]InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 82, in run_checker
msg = agent_ci.write_topic_and_expect("query", q, expect="response")
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:
error in checker |Exception while handling a message on topic "query".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/project/collision_checker.py", line 30, in on_received_query
|| collided = check_collision(Wcoll=self.params.environment, robot_body=self.params.body, robot_pose=data.pose)
|| File "/project/collision_checker.py", line 45, in check_collision
|| rototranslated_robot.append(np.dot(T_or,p))
|| File "<__array_function__ internals>", line 5, in dot
|| TypeError: unsupported operand type(s) for *: 'float' and 'PlacedPrimitive'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 561, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7faad1b83ca0>>.
|| │ f: <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7faad1b83ca0>>
|| │ args: dict[2]
|| │ │ data:
|| │ │ CollisionCheckQuery
|| │ │ │ pose:
|| │ │ │ FriendlyPose
|| │ │ │ │ x: 3.357616573732855
|| │ │ │ │ y: 3.885123846583553
|| │ │ │ │ theta_deg: 224.5250538878613
|| │ │ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fa9a3a7e580>
|| │ argspec: <class 'inspect.FullArgSpec'>[7]
|| │ #0 [self, context, data]
|| │ #1 None
|| │ #2 None
|| │ #3 None
|| │ #4 []
|| │ #5 None
|| │ #6 dict[2]
|| │ │ context: <class 'zuper_nodes_wrapper.interface.Context'>
|| │ │ data:
|| │ │ dataclass dt_protocols.collision_protocol.CollisionCheckQuery
|| │ │ field pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
|| │ │ field x : float
|| │ │ field y : float
|| │ │ field theta_deg : float
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 89, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 95, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
79683 | 16081 | Evanthia Fasoula | exercises_braitenberg | mooc-BV1 | sim-2of5 | success | no | gpu-production-spot-0-04 | | | 0:01:41 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | distance-from-start_mean | 2.699916375419549 |
other statsagent_compute-ego0_max | 0.011758928624992697 | agent_compute-ego0_mean | 0.011758928624992697 | agent_compute-ego0_median | 0.011758928624992697 | agent_compute-ego0_min | 0.011758928624992697 | complete-iteration_max | 0.21892075660901192 | complete-iteration_mean | 0.21892075660901192 | complete-iteration_median | 0.21892075660901192 | complete-iteration_min | 0.21892075660901192 | deviation-center-line_max | 0.0 | deviation-center-line_mean | 0.0 | deviation-center-line_median | 0.0 | deviation-center-line_min | 0.0 | deviation-heading_max | 0.0 | deviation-heading_mean | 0.0 | deviation-heading_median | 0.0 | deviation-heading_min | 0.0 | distance-from-start_max | 2.699916375419549 | distance-from-start_median | 2.699916375419549 | distance-from-start_min | 2.699916375419549 | driven_any_max | 2.7101916805883888 | driven_any_mean | 2.7101916805883888 | driven_any_median | 2.7101916805883888 | driven_any_min | 2.7101916805883888 | driven_lanedir_consec_max | 0.0 | driven_lanedir_consec_mean | 0.0 | driven_lanedir_consec_median | 0.0 | driven_lanedir_consec_min | 0.0 | driven_lanedir_max | 0.0 | driven_lanedir_mean | 0.0 | driven_lanedir_median | 0.0 | driven_lanedir_min | 0.0 | get_duckie_state_max | 0.08281134540199214 | get_duckie_state_mean | 0.08281134540199214 | get_duckie_state_median | 0.08281134540199214 | get_duckie_state_min | 0.08281134540199214 | get_robot_state_max | 0.003969716210650583 | get_robot_state_mean | 0.003969716210650583 | get_robot_state_median | 0.003969716210650583 | get_robot_state_min | 0.003969716210650583 | get_state_dump_max | 0.018211489049797382 | get_state_dump_mean | 0.018211489049797382 | get_state_dump_median | 0.018211489049797382 | get_state_dump_min | 0.018211489049797382 | get_ui_image_max | 0.014347406534048228 | get_ui_image_mean | 0.014347406534048228 | get_ui_image_median | 0.014347406534048228 | get_ui_image_min | 0.014347406534048228 | in-drivable-lane_max | 5.799999999999987 | in-drivable-lane_mean | 5.799999999999987 | in-drivable-lane_median | 5.799999999999987 | in-drivable-lane_min | 5.799999999999987 | per-episodes | details{"d40-ego0": {"driven_any": 2.7101916805883888, "get_ui_image": 0.014347406534048228, "step_physics": 0.07015938840360723, "survival_time": 5.799999999999987, "driven_lanedir": 0.0, "get_state_dump": 0.018211489049797382, "get_robot_state": 0.003969716210650583, "sim_render-ego0": 0.003667849760789138, "get_duckie_state": 0.08281134540199214, "in-drivable-lane": 5.799999999999987, "deviation-heading": 0.0, "agent_compute-ego0": 0.011758928624992697, "complete-iteration": 0.21892075660901192, "set_robot_commands": 0.002401266342554337, "distance-from-start": 2.699916375419549, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009522183328612238, "sim_compute_performance-ego0": 0.0019677500439505293}} | set_robot_commands_max | 0.002401266342554337 | set_robot_commands_mean | 0.002401266342554337 | set_robot_commands_median | 0.002401266342554337 | set_robot_commands_min | 0.002401266342554337 | sim_compute_performance-ego0_max | 0.0019677500439505293 | sim_compute_performance-ego0_mean | 0.0019677500439505293 | sim_compute_performance-ego0_median | 0.0019677500439505293 | sim_compute_performance-ego0_min | 0.0019677500439505293 | sim_compute_sim_state_max | 0.009522183328612238 | sim_compute_sim_state_mean | 0.009522183328612238 | sim_compute_sim_state_median | 0.009522183328612238 | sim_compute_sim_state_min | 0.009522183328612238 | sim_render-ego0_max | 0.003667849760789138 | sim_render-ego0_mean | 0.003667849760789138 | sim_render-ego0_median | 0.003667849760789138 | sim_render-ego0_min | 0.003667849760789138 | simulation-passed | 1 | step_physics_max | 0.07015938840360723 | step_physics_mean | 0.07015938840360723 | step_physics_median | 0.07015938840360723 | step_physics_min | 0.07015938840360723 | survival_time_max | 5.799999999999987 | survival_time_mean | 5.799999999999987 | survival_time_median | 5.799999999999987 | survival_time_min | 5.799999999999987 |
| No reset possible |
79678 | 16087 | Matteo Razzanelli | collision-check-exercise | mooc-collision-check-vali | step1 | failed | no | gpu-production-spot-0-04 | | | 0:00:15 | InvalidSubmission:
T [...]InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 82, in run_checker
msg = agent_ci.write_topic_and_expect("query", q, expect="response")
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:
error in checker |Exception while handling a message on topic "query".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/project/collision_checker.py", line 30, in on_received_query
|| collided = check_collision(Wcoll=self.params.environment, robot_body=self.params.body, robot_pose=data.pose)
|| File "/project/collision_checker.py", line 45, in check_collision
|| rototranslated_robot.append(np.dot(T_or,p))
|| File "<__array_function__ internals>", line 5, in dot
|| TypeError: unsupported operand type(s) for *: 'float' and 'PlacedPrimitive'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 561, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7fd60c576ca0>>.
|| │ f: <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7fd60c576ca0>>
|| │ args: dict[2]
|| │ │ data:
|| │ │ CollisionCheckQuery
|| │ │ │ pose:
|| │ │ │ FriendlyPose
|| │ │ │ │ x: 3.357616573732855
|| │ │ │ │ y: 3.885123846583553
|| │ │ │ │ theta_deg: 224.5250538878613
|| │ │ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fd4de453b50>
|| │ argspec: <class 'inspect.FullArgSpec'>[7]
|| │ #0 [self, context, data]
|| │ #1 None
|| │ #2 None
|| │ #3 None
|| │ #4 []
|| │ #5 None
|| │ #6 dict[2]
|| │ │ context: <class 'zuper_nodes_wrapper.interface.Context'>
|| │ │ data:
|| │ │ dataclass dt_protocols.collision_protocol.CollisionCheckQuery
|| │ │ field pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
|| │ │ field x : float
|| │ │ field y : float
|| │ │ field theta_deg : float
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 89, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 95, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
79671 | 16089 | Matteo Razzanelli | collision-check-exercise | mooc-collision-check-vali | step1 | success | no | gpu-production-spot-0-04 | | | 0:00:27 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | false_negative_rate | 1.0 | false_positive_rate | 0.0 |
other stats | No reset possible |
79668 | 16087 | Matteo Razzanelli | collision-check-exercise | mooc-collision-check-vali | step1 | failed | no | gpu-production-spot-0-04 | | | 0:00:23 | InvalidSubmission:
T [...]InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 82, in run_checker
msg = agent_ci.write_topic_and_expect("query", q, expect="response")
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:
error in checker |Exception while handling a message on topic "query".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/project/collision_checker.py", line 30, in on_received_query
|| collided = check_collision(Wcoll=self.params.environment, robot_body=self.params.body, robot_pose=data.pose)
|| File "/project/collision_checker.py", line 45, in check_collision
|| rototranslated_robot.append(np.dot(T_or,p))
|| File "<__array_function__ internals>", line 5, in dot
|| TypeError: unsupported operand type(s) for *: 'float' and 'PlacedPrimitive'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 561, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f64656ddca0>>.
|| │ f: <bound method CollisionChecker.on_received_query of <collision_checker.CollisionChecker object at 0x7f64656ddca0>>
|| │ args: dict[2]
|| │ │ data:
|| │ │ CollisionCheckQuery
|| │ │ │ pose:
|| │ │ │ FriendlyPose
|| │ │ │ │ x: 3.357616573732855
|| │ │ │ │ y: 3.885123846583553
|| │ │ │ │ theta_deg: 224.5250538878613
|| │ │ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f633763acd0>
|| │ argspec: <class 'inspect.FullArgSpec'>[7]
|| │ #0 [self, context, data]
|| │ #1 None
|| │ #2 None
|| │ #3 None
|| │ #4 []
|| │ #5 None
|| │ #6 dict[2]
|| │ │ context: <class 'zuper_nodes_wrapper.interface.Context'>
|| │ │ data:
|| │ │ dataclass dt_protocols.collision_protocol.CollisionCheckQuery
|| │ │ field pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
|| │ │ field x : float
|| │ │ field y : float
|| │ │ field theta_deg : float
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 89, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 95, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
79659 | 16093 | Chahbaz Aman | template-random | aido-hello-sim-validation | 370 | success | no | gpu-production-spot-0-04 | | | 0:02:39 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | survival_time_median | 2.1500000000000004 | in-drivable-lane_median | 1.15 | driven_lanedir_consec_median | 0.2357331065993169 | deviation-center-line_median | 0.05863921966719952 |
other statsagent_compute-ego0_max | 0.011880598284981468 | agent_compute-ego0_mean | 0.011880598284981468 | agent_compute-ego0_median | 0.011880598284981468 | agent_compute-ego0_min | 0.011880598284981468 | complete-iteration_max | 0.14597298882224344 | complete-iteration_mean | 0.14597298882224344 | complete-iteration_median | 0.14597298882224344 | complete-iteration_min | 0.14597298882224344 | deviation-center-line_max | 0.05863921966719952 | deviation-center-line_mean | 0.05863921966719952 | deviation-center-line_min | 0.05863921966719952 | deviation-heading_max | 0.46108604520141144 | deviation-heading_mean | 0.46108604520141144 | deviation-heading_median | 0.46108604520141144 | deviation-heading_min | 0.46108604520141144 | driven_any_max | 0.4603380961060899 | driven_any_mean | 0.4603380961060899 | driven_any_median | 0.4603380961060899 | driven_any_min | 0.4603380961060899 | driven_lanedir_consec_max | 0.2357331065993169 | driven_lanedir_consec_mean | 0.2357331065993169 | driven_lanedir_consec_min | 0.2357331065993169 | driven_lanedir_max | 0.2357331065993169 | driven_lanedir_mean | 0.2357331065993169 | driven_lanedir_median | 0.2357331065993169 | driven_lanedir_min | 0.2357331065993169 | get_duckie_state_max | 0.0048039663921702995 | get_duckie_state_mean | 0.0048039663921702995 | get_duckie_state_median | 0.0048039663921702995 | get_duckie_state_min | 0.0048039663921702995 | get_robot_state_max | 0.004176665436137806 | get_robot_state_mean | 0.004176665436137806 | get_robot_state_median | 0.004176665436137806 | get_robot_state_min | 0.004176665436137806 | get_state_dump_max | 0.0066402229395779696 | get_state_dump_mean | 0.0066402229395779696 | get_state_dump_median | 0.0066402229395779696 | get_state_dump_min | 0.0066402229395779696 | get_ui_image_max | 0.0281394286589189 | get_ui_image_mean | 0.0281394286589189 | get_ui_image_median | 0.0281394286589189 | get_ui_image_min | 0.0281394286589189 | in-drivable-lane_max | 1.15 | in-drivable-lane_mean | 1.15 | in-drivable-lane_min | 1.15 | per-episodes | details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.0281394286589189, "step_physics": 0.07597875053232367, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0066402229395779696, "get_robot_state": 0.004176665436137806, "sim_render-ego0": 0.004182208668101917, "get_duckie_state": 0.0048039663921702995, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011880598284981468, "complete-iteration": 0.14597298882224344, "set_robot_commands": 0.002480561083013361, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.00540326942097057, "sim_compute_performance-ego0": 0.00219516320662065}} | set_robot_commands_max | 0.002480561083013361 | set_robot_commands_mean | 0.002480561083013361 | set_robot_commands_median | 0.002480561083013361 | set_robot_commands_min | 0.002480561083013361 | sim_compute_performance-ego0_max | 0.00219516320662065 | sim_compute_performance-ego0_mean | 0.00219516320662065 | sim_compute_performance-ego0_median | 0.00219516320662065 | sim_compute_performance-ego0_min | 0.00219516320662065 | sim_compute_sim_state_max | 0.00540326942097057 | sim_compute_sim_state_mean | 0.00540326942097057 | sim_compute_sim_state_median | 0.00540326942097057 | sim_compute_sim_state_min | 0.00540326942097057 | sim_render-ego0_max | 0.004182208668101917 | sim_render-ego0_mean | 0.004182208668101917 | sim_render-ego0_median | 0.004182208668101917 | sim_render-ego0_min | 0.004182208668101917 | simulation-passed | 1 | step_physics_max | 0.07597875053232367 | step_physics_mean | 0.07597875053232367 | step_physics_median | 0.07597875053232367 | step_physics_min | 0.07597875053232367 | survival_time_max | 2.1500000000000004 | survival_time_mean | 2.1500000000000004 | survival_time_min | 2.1500000000000004 |
| No reset possible |