Submission 13607

Submission	`13607`

Competing	yes
Challenge	`aido-LFVI_multi-sim-validation`
User	Andras Beres
Date submitted	2021-01-31 22:17:49+00:00
Last status update	2021-12-04 20:47:44+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💚
Jobs	sim-0of4: `105014` sim-1of4: `105029` sim-2of4: `105021` sim-3of4: `105032`
Next
User label	fsf+il
Admin priority	50
Blessing	n/a
User priority	50

105029

Click the images to see detailed statistics about the episode.

4way-000

105014

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

105032

sim-3of4

success

yes

2021-11-02 23:39:26+00:00

2021-11-02 23:40:34+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

105029

sim-1of4

success

yes

2021-11-02 23:37:55+00:00

2021-11-02 23:42:36+00:00

0:04:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.500000000000044
in-drivable-lane_median	0.6750000000000008
driven_lanedir_consec_median	3.1997901558355366
deviation-center-line_median	0.9850798807759212

other stats

deviation-center-line_max	1.276300408465891
deviation-center-line_mean	1.0430353831907209
deviation-center-line_min	0.92568136274515
deviation-heading_max	6.010963899801612
deviation-heading_mean	3.1308245807650383
deviation-heading_median	2.2865051309532545
deviation-heading_min	1.939324161352033
distance-from-start_max	2.2378474896549236
distance-from-start_mean	1.6779026790374556
distance-from-start_median	1.6472764301892089
distance-from-start_min	1.1792103661164814
driven_any_max	5.561358838194039
driven_any_mean	3.921069169160342
driven_any_median	3.708201172300508
driven_any_min	2.706515493846313
driven_lanedir_consec_max	4.647150150069911
driven_lanedir_consec_mean	3.181503761184522
driven_lanedir_consec_min	1.679284582997102
driven_lanedir_max	5.0434861995346525
driven_lanedir_mean	3.424405399056468
driven_lanedir_median	3.42791242150787
driven_lanedir_min	1.7983105536754784
in-drivable-lane_max	1.5999999999999943
in-drivable-lane_mean	0.8500000000000005
in-drivable-lane_min	0.4500000000000064
per-episodes	details {"4way-000-ego0": {"driven_any": 2.706515493846313, "survival_time": 12.500000000000044, "driven_lanedir": 1.7983105536754784, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 6.010963899801612, "distance-from-start": 1.296906359361004, "deviation-center-line": 1.276300408465891, "driven_lanedir_consec": 1.679284582997102}, "4way-000-ego1": {"driven_any": 4.686960462402803, "survival_time": 12.500000000000044, "driven_lanedir": 4.396067358757827, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 1.939324161352033, "distance-from-start": 1.9976465010174136, "deviation-center-line": 1.0042365630325358, "driven_lanedir_consec": 3.987990327161442}, "4way-000-ego2": {"driven_any": 2.729441882198213, "survival_time": 12.500000000000044, "driven_lanedir": 2.4597574842579126, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 2.4094742375015517, "distance-from-start": 1.1792103661164814, "deviation-center-line": 0.9659231985193064, "driven_lanedir_consec": 2.4115899845096314}, "4way-000-ego3": {"driven_any": 5.561358838194039, "survival_time": 12.500000000000044, "driven_lanedir": 5.0434861995346525, "in-drivable-lane": 0.8500000000000034, "deviation-heading": 2.1635360244049577, "distance-from-start": 2.2378474896549236, "deviation-center-line": 0.92568136274515, "driven_lanedir_consec": 4.647150150069911}}
simulation-passed	1
survival_time_max	12.500000000000044
survival_time_mean	12.500000000000044
survival_time_min	12.500000000000044

No reset possible

105027

sim-3of4

success

yes

2021-11-02 23:37:51+00:00

2021-11-02 23:39:02+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105025

sim-3of4

success

yes

2021-11-02 23:36:26+00:00

2021-11-02 23:37:37+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105022

sim-3of4

success

yes

2021-11-02 23:34:34+00:00

2021-11-02 23:35:44+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105021

sim-2of4

success

yes

2021-11-02 23:33:39+00:00

2021-11-02 23:34:48+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

105020

sim-3of4

success

yes

2021-11-02 23:33:06+00:00

2021-11-02 23:34:14+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105018

sim-2of4

success

yes

2021-11-02 23:32:11+00:00

2021-11-02 23:33:19+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105017

sim-1of4

success

yes

2021-11-02 23:31:38+00:00

2021-11-02 23:37:13+00:00

0:05:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105016

sim-3of4

success

yes

2021-11-02 23:31:34+00:00

2021-11-02 23:32:39+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105015

sim-2of4

success

yes

2021-11-02 23:30:36+00:00

2021-11-02 23:31:45+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

105014

sim-0of4

success

yes

2021-11-02 23:28:58+00:00

2021-11-02 23:36:21+00:00

0:07:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	23.050000000000193
in-drivable-lane_median	1.375000000000015
driven_lanedir_consec_median	6.187061403267676
deviation-center-line_median	1.8562512114043672

other stats

deviation-center-line_max	2.5442953267448947
deviation-center-line_mean	1.9576466935970531
deviation-center-line_min	1.5737890248345827
deviation-heading_max	6.103101889048004
deviation-heading_mean	4.049069830841433
deviation-heading_median	3.8896738687047785
deviation-heading_min	2.313829696908174
distance-from-start_max	2.3806816903343115
distance-from-start_mean	1.5987241928343243
distance-from-start_median	1.4547157486770694
distance-from-start_min	1.1047835836488475
driven_any_max	10.570274716904915
driven_any_mean	7.5771977640693455
driven_any_median	7.027939995828961
driven_any_min	5.682636347714544
driven_lanedir_consec_max	9.254187045789935
driven_lanedir_consec_mean	6.45099216050682
driven_lanedir_consec_min	4.175658789701987
driven_lanedir_max	9.57714295497479
driven_lanedir_mean	6.854003014650622
driven_lanedir_median	6.617610017728338
driven_lanedir_min	4.603649068171019
in-drivable-lane_max	2.050000000000015
in-drivable-lane_mean	1.3000000000000127
in-drivable-lane_min	0.4000000000000057
per-episodes	details {"udem-000-ego0": {"driven_any": 10.570274716904915, "survival_time": 23.050000000000193, "driven_lanedir": 9.57714295497479, "in-drivable-lane": 2.050000000000015, "deviation-heading": 3.47057768072482, "distance-from-start": 2.3806816903343115, "deviation-center-line": 1.603220742274829, "driven_lanedir_consec": 9.254187045789935}, "udem-000-ego1": {"driven_any": 5.682636347714544, "survival_time": 23.050000000000193, "driven_lanedir": 4.603649068171019, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 2.313829696908174, "distance-from-start": 1.120324743037226, "deviation-center-line": 2.5442953267448947, "driven_lanedir_consec": 4.175658789701987}, "udem-000-ego2": {"driven_any": 5.794620407610023, "survival_time": 23.050000000000193, "driven_lanedir": 5.558955748027268, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 6.103101889048004, "distance-from-start": 1.789106754316913, "deviation-center-line": 1.5737890248345827, "driven_lanedir_consec": 5.555929169469021}, "udem-000-ego3": {"driven_any": 8.261259584047899, "survival_time": 23.050000000000193, "driven_lanedir": 7.676264287429408, "in-drivable-lane": 0.7500000000000018, "deviation-heading": 4.308770056684737, "distance-from-start": 1.1047835836488475, "deviation-center-line": 2.1092816805339054, "driven_lanedir_consec": 6.818193637066331}}
simulation-passed	1
survival_time_max	23.050000000000193
survival_time_mean	23.050000000000193
survival_time_min	23.050000000000193

No reset possible

100165

sim-1of4

failed

2021-11-02 05:35:22+00:00

2021-11-02 05:36:25+00:00

0:01:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100156

sim-1of4

failed

2021-11-02 05:34:00+00:00

2021-11-02 05:35:00+00:00

0:01:00

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100147

sim-1of4

failed

2021-11-02 05:32:55+00:00

2021-11-02 05:33:46+00:00

0:00:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100139

sim-0of4

failed

2021-11-02 05:31:32+00:00

2021-11-02 05:32:28+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100138

sim-1of4

failed

2021-11-02 05:31:28+00:00

2021-11-02 05:32:28+00:00

0:01:00

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100137

sim-2of4

success

2021-11-02 05:31:28+00:00

2021-11-02 05:32:35+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100135

sim-3of4

success

2021-11-02 05:30:58+00:00

2021-11-02 05:32:04+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100129

sim-0of4

failed

2021-11-02 05:30:01+00:00

2021-11-02 05:31:00+00:00

0:00:59

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100128

sim-1of4

failed

2021-11-02 05:29:59+00:00

2021-11-02 05:31:01+00:00

0:01:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100127

sim-2of4

success

2021-11-02 05:29:56+00:00

2021-11-02 05:31:01+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100123

sim-3of4

success

2021-11-02 05:29:23+00:00

2021-11-02 05:30:31+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100121

sim-1of4

failed

2021-11-02 05:28:56+00:00

2021-11-02 05:29:47+00:00

0:00:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100119

sim-0of4

failed

2021-11-02 05:28:51+00:00

2021-11-02 05:29:49+00:00

0:00:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100118

sim-2of4

success

2021-11-02 05:28:29+00:00

2021-11-02 05:29:36+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100114

sim-3of4

success

2021-11-02 05:27:51+00:00

2021-11-02 05:28:58+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100113

sim-0of4

failed

2021-11-02 05:27:48+00:00

2021-11-02 05:28:45+00:00

0:00:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100106

sim-2of4

success

2021-11-02 05:26:43+00:00

2021-11-02 05:27:50+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100105

sim-0of4

failed

2021-11-02 05:26:43+00:00

2021-11-02 05:27:32+00:00

0:00:49

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97970

sim-3of4

success

2021-11-01 20:45:24+00:00

2021-11-01 20:46:38+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97961

sim-3of4

success

2021-11-01 20:43:15+00:00

2021-11-01 20:45:03+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97932

sim-2of4

success

2021-11-01 20:30:46+00:00

2021-11-01 20:31:54+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97930

sim-2of4

success

2021-11-01 20:29:07+00:00

2021-11-01 20:30:20+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97929

sim-1of4

success

2021-11-01 20:28:42+00:00

2021-11-01 20:34:16+00:00

0:05:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97928

sim-2of4

success

2021-11-01 20:27:37+00:00

2021-11-01 20:28:47+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97921

sim-0of4

success

2021-11-01 20:25:02+00:00

2021-11-01 20:32:04+00:00

0:07:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97910

sim-1of4

success

2021-11-01 20:21:44+00:00

2021-11-01 20:27:24+00:00

0:05:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97908

sim-2of4

success

2021-11-01 20:21:08+00:00

2021-11-01 20:22:17+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97903

sim-2of4

success

2021-11-01 20:19:11+00:00

2021-11-01 20:20:21+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97901

sim-0of4

success

2021-11-01 20:18:12+00:00

2021-11-01 20:24:30+00:00

0:06:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

90286

sim-3of4

success

2021-10-21 19:32:15+00:00

2021-10-21 19:34:05+00:00

0:01:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

90284

sim-3of4

success

2021-10-21 19:29:49+00:00

2021-10-21 19:31:38+00:00

0:01:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

90233

sim-0of4

success

2021-10-21 18:19:54+00:00

2021-10-21 19:29:20+00:00

1:09:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

90232

sim-2of4

success

2021-10-21 18:17:52+00:00

2021-10-21 18:19:47+00:00

0:01:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

90230

sim-2of4

success

2021-10-21 18:15:45+00:00

2021-10-21 18:17:33+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

90224

sim-1of4

success

2021-10-21 17:59:42+00:00

2021-10-21 18:15:25+00:00

0:15:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72157

sim-3of4

success

2021-04-21 17:54:52+00:00

2021-04-21 17:55:51+00:00

0:00:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72154

sim-0of4

success

2021-04-21 17:54:48+00:00

2021-04-21 18:22:31+00:00

0:27:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72111

sim-2of4

success

2021-04-21 17:50:09+00:00

2021-04-21 17:51:09+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible