Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 169672250Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation error no rudolf-02019-04-03 21:48:21+00:00 2019-04-03 22:19:04+00:00 0:30:43 Timeout:
Waited 180 [...] Timeout:
Waited 1803.3444590568542 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169662251Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation error no rudolf-02019-04-03 21:46:53+00:00 2019-04-03 21:47:30+00:00 0:00:37 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169632264Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation host-error no rudolf-02019-04-03 21:45:42+00:00 2019-04-03 21:46:39+00:00 0:00:57 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 418, in go_
challenge_step_name, project, do_pull, debug_volumes=debug_volumes)
File "/project/src/duckietown_challenges_runner/runner.py", line 521, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 861, in write_logs
f.write(logs)
UnicodeEncodeError: 'ascii' codec can't encode character '\u2502' in position 7146: ordinal not in range(128)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169602261Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation failed no rudolf-02019-04-03 21:43:38+00:00 2019-04-03 21:44:43+00:00 0:01:05 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 272, in run_episode
r: MsgReceived = agent.read_one(expect_topic='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 164, in read_one
raise RemoteNodeAborted(m) # XXX
zuper_nodes_wrapper.wrapper_outside.RemoteNodeAborted: I was waiting for a message from component "agent" but it aborted with the following error.
agent error |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 426, in loop
|| handle_message_node(parsed, protocol, pc, node, context_data)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 500, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 583, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 48, in on_received_get_commands
|| pwm_left, pwm_right = compute_action(self.config.current_image)
|| NameError: name 'compute_action' is not defined
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 665, in scoring_context
yield cie
File "experiment_manager.py", line 399, in <module>
wrap(cie)
File "experiment_manager.py", line 388, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 122, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 275, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169582262Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation error no rudolf-02019-04-03 21:41:57+00:00 2019-04-03 21:42:35+00:00 0:00:38 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169562265Andrea Censi PredictorMean aido2-PREDstep1-simulation success no rudolf-02019-04-03 21:41:26+00:00 2019-04-03 21:41:50+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.2718059012586107 error_L2 0.08831421974866666
No reset possible 169522267Andrea Censi PredictorLast aido2-PREDstep1-simulation success no rudolf-02019-04-03 21:39:58+00:00 2019-04-03 21:40:26+00:00 0:00:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.1148924454280556 error_L2 0.02188728608112184
No reset possible 169512271Andrea Censi PredictorLast aido2-PREDstep1-simulation success no rudolf-02019-04-03 21:38:34+00:00 2019-04-03 21:39:01+00:00 0:00:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10079367321877342 error_L2 0.01660988142955351
No reset possible 169462274Andrea Censi Solution template aido2_LF_r2-v4step1-simulation success no rudolf-02019-04-03 21:28:27+00:00 2019-04-03 21:37:22+00:00 0:08:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.779772556196247 deviation-center-line_median 0.12392521434035476 in-drivable-lane_median 1.124999999999996
other stats deviation-center-line_max 0.3286137010320844 deviation-center-line_mean 0.1746020579214195 deviation-center-line_min 0.08372360758865739 deviation-heading_max 1.6095489732413446 deviation-heading_mean 0.7816043915936564 deviation-heading_median 0.5894040460563357 deviation-heading_min 0.36633339585354935 driven_any_max 2.1748492745499397 driven_any_mean 1.1968422471283295 driven_any_median 1.0101039653070671 driven_any_min 0.9590281129286472 driven_lanedir_consec_max 1.030018821637598 driven_lanedir_consec_mean 0.7556862978133073 driven_lanedir_consec_min 0.4539923912906554 driven_lanedir_max 1.0586363759652746 driven_lanedir_mean 0.7604558902012535 driven_lanedir_median 0.779772556196247 driven_lanedir_min 0.4539923912906554 in-drivable-lane_max 3.149999999999989 in-drivable-lane_mean 1.2333333333333292 in-drivable-lane_min 0.09999999999999964 per-episodes details {"4way-0-0": {"driven_any": 2.1748492745499397, "driven_lanedir": 1.0586363759652746, "in-drivable-lane": 3.149999999999989, "deviation-heading": 1.6095489732413446, "deviation-center-line": 0.3286137010320844, "driven_lanedir_consec": 1.030018821637598}, "4way-1-0": {"driven_any": 0.9890108043245012, "driven_lanedir": 0.6673100453941898, "in-drivable-lane": 0.849999999999997, "deviation-heading": 0.6111577689033946, "deviation-center-line": 0.08372360758865739, "driven_lanedir_consec": 0.6673100453941898}, "udem1-0-0": {"driven_any": 0.9590281129286472, "driven_lanedir": 0.4539923912906554, "in-drivable-lane": 1.599999999999996, "deviation-heading": 0.36633339585354935, "deviation-center-line": 0.10736979027635338, "driven_lanedir_consec": 0.4539923912906554}, "udem1-1-0": {"driven_any": 1.0119633264875876, "driven_lanedir": 0.5802323616425489, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.3937578179184137, "deviation-center-line": 0.12907424552231972, "driven_lanedir_consec": 0.5802323616425489}, "small_loop-0-0": {"driven_any": 1.037957360352754, "driven_lanedir": 0.9103290999165478, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.1411780704359595, "deviation-center-line": 0.2800548199507123, "driven_lanedir_consec": 0.9103290999165478}, "small_loop-1-0": {"driven_any": 1.008244604126547, "driven_lanedir": 0.8922350669983042, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 0.5676503232092769, "deviation-center-line": 0.1187761831583898, "driven_lanedir_consec": 0.8922350669983042}}simulation-passed 1
No reset possible 168972240Ka Yue Fung Solution template aido1_test_multistep-v3step1 error no rudolf-02019-04-03 20:57:09+00:00 2019-04-03 21:27:38+00:00 0:30:29 Timeout:
Waited 180 [...] Timeout:
Waited 1800.5047702789307 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168962254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:56:01+00:00 2019-04-03 20:56:24+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168932254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:54:45+00:00 2019-04-03 20:55:05+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168912248Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:53:38+00:00 2019-04-03 20:54:01+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168892254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:52:28+00:00 2019-04-03 20:52:48+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168882254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:51:17+00:00 2019-04-03 20:51:41+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168862248Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:50:06+00:00 2019-04-03 20:50:26+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168832254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:48:56+00:00 2019-04-03 20:49:19+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168822254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:47:47+00:00 2019-04-03 20:48:10+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168792248Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:46:31+00:00 2019-04-03 20:46:55+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168772254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:45:25+00:00 2019-04-03 20:45:49+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168752248Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:44:11+00:00 2019-04-03 20:44:30+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168742248Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:43:05+00:00 2019-04-03 20:43:25+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168722254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:41:58+00:00 2019-04-03 20:42:19+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168702254Andrea Censi Solution template aido1_luck-v4step1 success no rudolf-02019-04-03 20:40:41+00:00 2019-04-03 20:41:00+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 168382245Andrea Censi Solution template aido2_LFV_r1-v4step1-simulation aborted no rudolf-02019-04-03 20:24:25+00:00 2019-04-03 20:40:16+00:00 0:15:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9306017070461028 deviation-center-line_median 0.2467154410917354 in-drivable-lane_median 2.299999999999992
other stats deviation-center-line_max 0.34338570913942046 deviation-center-line_mean 0.25030164980112507 deviation-center-line_min 0.16439000788160887 deviation-heading_max 1.6095489732413446 deviation-heading_mean 0.97710984480811 deviation-heading_median 0.9609461645189982 deviation-heading_min 0.3769980769530998 driven_any_max 2.234179003106766 driven_any_mean 1.8425421206705448 driven_any_median 1.873567146510747 driven_any_min 1.3888551865539178 driven_lanedir_consec_max 1.3390397100187108 driven_lanedir_consec_mean 0.983516144317161 driven_lanedir_consec_min 0.7338214531577274 driven_lanedir_max 1.7355909832406682 driven_lanedir_mean 1.089808351204569 driven_lanedir_median 0.944910484209941 driven_lanedir_min 0.7338214531577274 in-drivable-lane_max 3.149999999999989 in-drivable-lane_mean 2.224999999999992 in-drivable-lane_min 1.149999999999996 per-episodes details {"4way-0-0": {"driven_any": 2.1748492745499397, "driven_lanedir": 1.0586363759652746, "in-drivable-lane": 3.149999999999989, "deviation-heading": 1.6095489732413446, "deviation-center-line": 0.3286137010320844, "driven_lanedir_consec": 1.030018821637598}, "4way-1-0": {"driven_any": 2.234179003106766, "driven_lanedir": 1.7355909832406682, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.530260565460663, "deviation-center-line": 0.34338570913942046, "driven_lanedir_consec": 1.3390397100187108}, "udem1-0-0": {"driven_any": 1.3888551865539178, "driven_lanedir": 0.8311845924546073, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 0.39163176357733337, "deviation-center-line": 0.16481718115138638, "driven_lanedir_consec": 0.8311845924546073}, "udem1-1-0": {"driven_any": 1.5722850184715549, "driven_lanedir": 0.7338214531577274, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.3769980769530998, "deviation-center-line": 0.16439000788160887, "driven_lanedir_consec": 0.7338214531577274}}simulation-passed 1
No reset possible
Andrea Censi 🇨🇭
