Job ID step status up to date date started date completed duration message 22727step1-simulation success yes 2019-05-17 01:05:03+00:00 2019-05-17 01:15:47+00:00 0:10:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6257610897668884 survival_time_median 6.949999999999983 deviation-center-line_median 0.36802347786147127 in-drivable-lane_median 0.34999999999999876
other stats agent_compute-ego_max 0.11059255444485208 agent_compute-ego_mean 0.10917776086442908 agent_compute-ego_median 0.10878886593331535 agent_compute-ego_min 0.1085490173763699 deviation-center-line_max 0.4965815196195033 deviation-center-line_mean 0.3792729624308385 deviation-center-line_min 0.2343069985322712 deviation-heading_max 1.733865139930398 deviation-heading_mean 0.9312492766179614 deviation-heading_median 0.801279189692507 deviation-heading_min 0.505641683871309 driven_any_max 1.5927758413436657 driven_any_mean 0.9016551802808832 driven_any_median 0.9900915586687412 driven_any_min 0.27886243064338945 driven_lanedir_consec_max 0.8945129127998332 driven_lanedir_consec_mean 0.6133119330362333 driven_lanedir_consec_min 0.2720172605900939 driven_lanedir_max 0.8945129127998332 driven_lanedir_mean 0.6133119330362333 driven_lanedir_median 0.6257610897668884 driven_lanedir_min 0.2720172605900939 in-drivable-lane_max 6.400000000000029 in-drivable-lane_mean 1.7500000000000042 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.04649427983400633, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05079731495260335, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.10878886593331535, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.049578368234977445, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03758604234928707, "sim_compute_performance-ego": 0.0550598189127531, "sim_compute_robot_state-ego": 0.05544713932833226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.005814130764868, "sim_physics": 0.04871683801923479, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998332, "sim_render-ego": 0.05081957748958043, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.10854978220803398, "deviation-heading": 1.733865139930398, "set_robot_commands": 0.05084887402398246, "deviation-center-line": 0.4965815196195033, "driven_lanedir_consec": 0.8945129127998332, "sim_compute_sim_state": 0.03735688073294503, "sim_compute_performance-ego": 0.05469750506537301, "sim_compute_robot_state-ego": 0.05456629310335432}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27886243064338945, "sim_physics": 0.047973548041449654, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.048547792434692386, "in-drivable-lane": 0, "agent_compute-ego": 0.1085490173763699, "deviation-heading": 0.505641683871309, "set_robot_commands": 0.05283535851372613, "deviation-center-line": 0.2343069985322712, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.034115674760606556, "sim_compute_performance-ego": 0.05194313261244032, "sim_compute_robot_state-ego": 0.05317652490403917}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.640731939983751, "sim_physics": 0.05149528254633364, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.04943403990372368, "in-drivable-lane": 0, "agent_compute-ego": 0.11059255444485208, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.05224698522816534, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.03655658856682155, "sim_compute_performance-ego": 0.05345122192216956, "sim_compute_robot_state-ego": 0.05356197512668112}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436657, "sim_physics": 0.04874351362115172, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.05199978993907911, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.10940858435957398, "deviation-heading": 0.6381843430101408, "set_robot_commands": 0.05113891379473961, "deviation-center-line": 0.45845443186951645, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.038147239380231186, "sim_compute_performance-ego": 0.05622135558629145, "sim_compute_robot_state-ego": 0.0556903712825688}}set_robot_commands_max 0.05283535851372613 set_robot_commands_mean 0.0513296999591182 set_robot_commands_median 0.05113891379473961 set_robot_commands_min 0.049578368234977445 sim_compute_performance-ego_max 0.05622135558629145 sim_compute_performance-ego_mean 0.05427460681980548 sim_compute_performance-ego_median 0.05469750506537301 sim_compute_performance-ego_min 0.05194313261244032 sim_compute_robot_state-ego_max 0.0556903712825688 sim_compute_robot_state-ego_mean 0.05448846074899514 sim_compute_robot_state-ego_median 0.05456629310335432 sim_compute_robot_state-ego_min 0.05317652490403917 sim_compute_sim_state_max 0.038147239380231186 sim_compute_sim_state_mean 0.036752485157978285 sim_compute_sim_state_median 0.03735688073294503 sim_compute_sim_state_min 0.034115674760606556 sim_physics_max 0.05149528254633364 sim_physics_mean 0.04868469241243523 sim_physics_median 0.04871683801923479 sim_physics_min 0.04649427983400633 sim_render-ego_max 0.05199978993907911 sim_render-ego_mean 0.0503197029439358 sim_render-ego_median 0.05079731495260335 sim_render-ego_min 0.048547792434692386 simulation-passed 1 survival_time_max 10.95000000000002 survival_time_mean 6.349999999999996 survival_time_min 2.25
No reset possible 20952step1-simulation success no 2019-04-27 15:57:07+00:00 2019-04-27 16:05:34+00:00 0:08:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20283step1-simulation success no 2019-04-25 11:08:54+00:00 2019-04-25 11:20:44+00:00 0:11:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20264step1-simulation host-error no 2019-04-25 10:51:16+00:00 2019-04-25 11:00:07+00:00 0:08:51 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20264-637010', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20264-637010', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job20264-637010', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19938step1-simulation error no 2019-04-25 08:39:10+00:00 2019-04-25 08:40:00+00:00 0:00:50 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 281, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 359, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 281, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 359, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19873step1-simulation error no 2019-04-25 08:33:40+00:00 2019-04-25 08:34:38+00:00 0:00:58 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 274, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 352, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 274, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 352, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19337step1-simulation success no 2019-04-24 14:00:31+00:00 2019-04-24 14:17:40+00:00 0:17:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19296step1-simulation host-error no 2019-04-24 13:49:18+00:00 2019-04-24 14:00:13+00:00 0:10:55 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19296-915199', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18933step1-simulation success no 2019-04-21 01:53:06+00:00 2019-04-21 02:08:18+00:00 0:15:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Daniele 🇮🇹