Submission 13520

Submission	`13520`

Competing	yes
Challenge	`aido-LF-sim-validation`
User	András Kalapos 🇭🇺
Date submitted	2021-01-31 22:16:40+00:00
Last status update	2021-12-04 20:47:19+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💚
Jobs	sim-0of4: `105223` sim-1of4: `105224` sim-2of4: `105225` sim-3of4: `105222`
Next
User label	real-v1.0-3092-363
Admin priority	50
Blessing	n/a
User priority	50

105225

Click the images to see detailed statistics about the episode.

autolab-000

105224

Click the images to see detailed statistics about the episode.

zigzag-000

105223

Click the images to see detailed statistics about the episode.

loop2-000

105222

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

105225

sim-2of4

success

yes

2021-11-03 01:26:12+00:00

2021-11-03 01:32:15+00:00

0:06:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	30.122882332710887
survival_time_median	59.99999999999873
deviation-center-line_median	2.590624964172946
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.590624964172946
deviation-center-line_mean	2.590624964172946
deviation-center-line_min	2.590624964172946
deviation-heading_max	6.646331468192012
deviation-heading_mean	6.646331468192012
deviation-heading_median	6.646331468192012
deviation-heading_min	6.646331468192012
distance-from-start_max	3.238651046665559
distance-from-start_mean	3.238651046665559
distance-from-start_median	3.238651046665559
distance-from-start_min	3.238651046665559
driven_any_max	30.38035849871264
driven_any_mean	30.38035849871264
driven_any_median	30.38035849871264
driven_any_min	30.38035849871264
driven_lanedir_consec_max	30.122882332710887
driven_lanedir_consec_mean	30.122882332710887
driven_lanedir_consec_min	30.122882332710887
driven_lanedir_max	30.122882332710887
driven_lanedir_mean	30.122882332710887
driven_lanedir_median	30.122882332710887
driven_lanedir_min	30.122882332710887
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 30.38035849871264, "survival_time": 59.99999999999873, "driven_lanedir": 30.122882332710887, "in-drivable-lane": 0.0, "deviation-heading": 6.646331468192012, "distance-from-start": 3.238651046665559, "deviation-center-line": 2.590624964172946, "driven_lanedir_consec": 30.122882332710887}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105224

sim-1of4

success

yes

2021-11-03 01:26:09+00:00

2021-11-03 01:32:19+00:00

0:06:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	28.56994847955205
survival_time_median	59.99999999999873
deviation-center-line_median	2.819755033333339
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.819755033333339
deviation-center-line_mean	2.819755033333339
deviation-center-line_min	2.819755033333339
deviation-heading_max	8.5582186065492
deviation-heading_mean	8.5582186065492
deviation-heading_median	8.5582186065492
deviation-heading_min	8.5582186065492
distance-from-start_max	4.425982599324195
distance-from-start_mean	4.425982599324195
distance-from-start_median	4.425982599324195
distance-from-start_min	4.425982599324195
driven_any_max	28.937752872623804
driven_any_mean	28.937752872623804
driven_any_median	28.937752872623804
driven_any_min	28.937752872623804
driven_lanedir_consec_max	28.56994847955205
driven_lanedir_consec_mean	28.56994847955205
driven_lanedir_consec_min	28.56994847955205
driven_lanedir_max	28.56994847955205
driven_lanedir_mean	28.56994847955205
driven_lanedir_median	28.56994847955205
driven_lanedir_min	28.56994847955205
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 28.937752872623804, "survival_time": 59.99999999999873, "driven_lanedir": 28.56994847955205, "in-drivable-lane": 0.0, "deviation-heading": 8.5582186065492, "distance-from-start": 4.425982599324195, "deviation-center-line": 2.819755033333339, "driven_lanedir_consec": 28.56994847955205}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105223

sim-0of4

success

yes

2021-11-03 01:25:37+00:00

2021-11-03 01:30:30+00:00

0:04:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	28.86122556910812
survival_time_median	59.99999999999873
deviation-center-line_median	2.406563636766404
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.406563636766404
deviation-center-line_mean	2.406563636766404
deviation-center-line_min	2.406563636766404
deviation-heading_max	8.356036033141224
deviation-heading_mean	8.356036033141224
deviation-heading_median	8.356036033141224
deviation-heading_min	8.356036033141224
distance-from-start_max	1.1053171910507622
distance-from-start_mean	1.1053171910507622
distance-from-start_median	1.1053171910507622
distance-from-start_min	1.1053171910507622
driven_any_max	29.134536331738246
driven_any_mean	29.134536331738246
driven_any_median	29.134536331738246
driven_any_min	29.134536331738246
driven_lanedir_consec_max	28.86122556910812
driven_lanedir_consec_mean	28.86122556910812
driven_lanedir_consec_min	28.86122556910812
driven_lanedir_max	28.86122556910812
driven_lanedir_mean	28.86122556910812
driven_lanedir_median	28.86122556910812
driven_lanedir_min	28.86122556910812
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 29.134536331738246, "survival_time": 59.99999999999873, "driven_lanedir": 28.86122556910812, "in-drivable-lane": 0.0, "deviation-heading": 8.356036033141224, "distance-from-start": 1.1053171910507622, "deviation-center-line": 2.406563636766404, "driven_lanedir_consec": 28.86122556910812}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

105222

sim-3of4

success

yes

2021-11-03 01:25:37+00:00

2021-11-03 01:30:34+00:00

0:04:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	30.437823680279323
survival_time_median	59.99999999999873
deviation-center-line_median	2.347273902812751
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.347273902812751
deviation-center-line_mean	2.347273902812751
deviation-center-line_min	2.347273902812751
deviation-heading_max	6.004231763453829
deviation-heading_mean	6.004231763453829
deviation-heading_median	6.004231763453829
deviation-heading_min	6.004231763453829
distance-from-start_max	2.545668420981054
distance-from-start_mean	2.545668420981054
distance-from-start_median	2.545668420981054
distance-from-start_min	2.545668420981054
driven_any_max	30.618148302284588
driven_any_mean	30.618148302284588
driven_any_median	30.618148302284588
driven_any_min	30.618148302284588
driven_lanedir_consec_max	30.437823680279323
driven_lanedir_consec_mean	30.437823680279323
driven_lanedir_consec_min	30.437823680279323
driven_lanedir_max	30.437823680279323
driven_lanedir_mean	30.437823680279323
driven_lanedir_median	30.437823680279323
driven_lanedir_min	30.437823680279323
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 30.618148302284588, "survival_time": 59.99999999999873, "driven_lanedir": 30.437823680279323, "in-drivable-lane": 0.0, "deviation-heading": 6.004231763453829, "distance-from-start": 2.545668420981054, "deviation-center-line": 2.347273902812751, "driven_lanedir_consec": 30.437823680279323}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

100640

sim-1of4

failed

2021-11-02 06:40:38+00:00

2021-11-02 06:41:23+00:00

0:00:45

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100637

sim-2of4

failed

2021-11-02 06:40:03+00:00

2021-11-02 06:40:39+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100636

sim-3of4

failed

2021-11-02 06:40:00+00:00

2021-11-02 06:40:35+00:00

0:00:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100634

sim-0of4

failed

2021-11-02 06:39:59+00:00

2021-11-02 06:40:35+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100629

sim-1of4

failed

2021-11-02 06:39:30+00:00

2021-11-02 06:40:06+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100628

sim-0of4

failed

2021-11-02 06:38:56+00:00

2021-11-02 06:39:32+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100627

sim-2of4

failed

2021-11-02 06:38:55+00:00

2021-11-02 06:39:32+00:00

0:00:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100623

sim-3of4

failed

2021-11-02 06:38:52+00:00

2021-11-02 06:39:27+00:00

0:00:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100622

sim-1of4

failed

2021-11-02 06:38:25+00:00

2021-11-02 06:39:01+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100620

sim-0of4

failed

2021-11-02 06:37:53+00:00

2021-11-02 06:38:29+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100618

sim-2of4

failed

2021-11-02 06:37:51+00:00

2021-11-02 06:38:26+00:00

0:00:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100614

sim-3of4

failed

2021-11-02 06:37:49+00:00

2021-11-02 06:38:30+00:00

0:00:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100613

sim-1of4

failed

2021-11-02 06:37:22+00:00

2021-11-02 06:37:59+00:00

0:00:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100610

sim-1of4

failed

2021-11-02 06:36:19+00:00

2021-11-02 06:36:55+00:00

0:00:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98274

sim-1of4

success

2021-11-01 22:49:58+00:00

2021-11-01 22:55:54+00:00

0:05:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98266

sim-0of4

success

2021-11-01 22:45:13+00:00

2021-11-01 22:49:47+00:00

0:04:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98264

sim-3of4

success

2021-11-01 22:44:09+00:00

2021-11-01 22:48:48+00:00

0:04:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

98263

sim-2of4

success

2021-11-01 22:44:07+00:00

2021-11-01 22:49:14+00:00

0:05:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88231

sim-0of4

success

2021-10-19 02:59:52+00:00

2021-10-19 03:09:37+00:00

0:09:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88227

sim-0of4

success

2021-10-19 02:58:41+00:00

2021-10-19 03:08:12+00:00

0:09:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88217

sim-2of4

success

2021-10-19 02:50:51+00:00

2021-10-19 03:00:41+00:00

0:09:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88214

sim-2of4

success

2021-10-19 02:49:21+00:00

2021-10-19 02:59:18+00:00

0:09:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88211

sim-0of4

success

2021-10-19 02:48:44+00:00

2021-10-19 02:58:13+00:00

0:09:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88204

sim-3of4

success

2021-10-19 02:45:35+00:00

2021-10-19 02:54:15+00:00

0:08:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88200

sim-3of4

success

2021-10-19 02:43:44+00:00

2021-10-19 02:52:08+00:00

0:08:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88196

sim-0of4

success

2021-10-19 02:42:56+00:00

2021-10-19 02:52:31+00:00

0:09:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88193

sim-1of4

success

2021-10-19 02:42:05+00:00

2021-10-19 02:50:37+00:00

0:08:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88189

sim-1of4

success

2021-10-19 02:40:12+00:00

2021-10-19 02:48:35+00:00

0:08:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

88174

sim-1of4

success

2021-10-19 02:29:18+00:00

2021-10-19 02:38:18+00:00

0:09:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71219

sim-2of4

success

2021-04-21 15:18:09+00:00

2021-04-21 15:29:15+00:00

0:11:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71218

sim-3of4

success

2021-04-21 15:18:07+00:00

2021-04-21 15:27:31+00:00

0:09:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71216

sim-0of4

success

2021-04-21 15:17:34+00:00

2021-04-21 15:28:57+00:00

0:11:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

71213

sim-1of4

success

2021-04-21 15:17:33+00:00

2021-04-21 15:28:05+00:00

0:10:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

69174

sim-2of4

success

2021-04-21 00:38:36+00:00

2021-04-21 00:47:49+00:00

0:09:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

69164

sim-3of4

success

2021-04-21 00:36:58+00:00

2021-04-21 00:45:10+00:00

0:08:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

69163

sim-0of4

success

2021-04-21 00:36:57+00:00

2021-04-21 00:45:50+00:00

0:08:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

69133

sim-1of4

success

2021-04-21 00:30:28+00:00

2021-04-21 00:38:17+00:00

0:07:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

63254

sim-2of4

success

2021-04-08 23:26:23+00:00

2021-04-08 23:36:51+00:00

0:10:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

63251

sim-3of4

success

2021-04-08 23:25:57+00:00

2021-04-08 23:33:17+00:00

0:07:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

63250

sim-1of4

success

2021-04-08 23:25:56+00:00

2021-04-08 23:33:22+00:00

0:07:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

63249

sim-0of4

success

2021-04-08 23:25:55+00:00

2021-04-08 23:34:27+00:00

0:08:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62271

347

success

yes

2021-03-20 21:07:28+00:00

2021-03-20 22:04:49+00:00

0:57:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

62153

347

success

2021-02-01 05:47:27+00:00

2021-02-01 06:47:54+00:00

1:00:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible