Duckietown Challenges Home Challenges Submissions

Submission 14811

Submission14811
Competingyes
Challengeaido-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104387 sim-1of4: 104377 sim-2of4: 104383 sim-3of4: 104410
Next
User labelstraight
Admin priority50
Blessingn/a
User priority50

104387

Click the images to see detailed statistics about the episode.

udem-000

104377

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
104410sim-3of4successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104402sim-3of4successyes0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104397sim-3of4successyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104388sim-3of4successyes0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104387sim-0of4successyes0:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.750000000000004
in-drivable-lane_median6.05000000000001
driven_lanedir_consec_median0.30101962152421446
deviation-center-line_median0.33331321378753215


other stats
deviation-center-line_max0.9867208312321796
deviation-center-line_mean0.444755703855315
deviation-center-line_min0.12567555661401583
deviation-heading_max2.548187013405534
deviation-heading_mean1.64877502395785
deviation-heading_median1.6495518057392644
deviation-heading_min0.7478094709473372
distance-from-start_max1.438162383761261
distance-from-start_mean0.7289714152785263
distance-from-start_median0.5564612149057249
distance-from-start_min0.3648008475413942
driven_any_max1.4382693230332029
driven_any_mean0.729004624492714
driven_any_median0.556470991690694
driven_any_min0.3648071915562648
driven_lanedir_consec_max0.7375240370941809
driven_lanedir_consec_mean0.3748149029942042
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.746168337032741
driven_lanedir_mean0.37697597797884425
driven_lanedir_median0.30101962152421446
driven_lanedir_min0.15969633183420706
in-drivable-lane_max8.300000000000004
in-drivable-lane_mean5.100000000000006
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.6981436944804056, "survival_time": 9.750000000000004, "driven_lanedir": 0.199551480959018, "in-drivable-lane": 8.000000000000004, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.6981319454565775, "deviation-center-line": 0.12567555661401583, "driven_lanedir_consec": 0.199551480959018}, "udem-000-ego1": {"driven_any": 0.3648071915562648, "survival_time": 9.750000000000004, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 8.300000000000004, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.3648008475413942, "deviation-center-line": 0.1356249877645468, "driven_lanedir_consec": 0.15969633183420706}, "udem-000-ego2": {"driven_any": 0.4147982889009824, "survival_time": 9.750000000000004, "driven_lanedir": 0.40248776208941095, "in-drivable-lane": 0.0, "deviation-heading": 2.350281655920482, "distance-from-start": 0.41479048435487215, "deviation-center-line": 0.9867208312321796, "driven_lanedir_consec": 0.40248776208941095}, "udem-000-ego3": {"driven_any": 1.4382693230332029, "survival_time": 9.750000000000004, "driven_lanedir": 0.746168337032741, "in-drivable-lane": 4.100000000000016, "deviation-heading": 2.548187013405534, "distance-from-start": 1.438162383761261, "deviation-center-line": 0.5310014398105175, "driven_lanedir_consec": 0.7375240370941809}}
simulation-passed1
survival_time_max9.750000000000004
survival_time_mean9.750000000000004
survival_time_min9.750000000000004
No reset possible
104383sim-2of4successyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104377sim-1of4successyes0:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.750000000000004
in-drivable-lane_median6.05000000000001
driven_lanedir_consec_median0.30101962152421446
deviation-center-line_median0.33331321378753215


other stats
deviation-center-line_max0.9867208312321796
deviation-center-line_mean0.444755703855315
deviation-center-line_min0.12567555661401583
deviation-heading_max2.548187013405534
deviation-heading_mean1.64877502395785
deviation-heading_median1.6495518057392644
deviation-heading_min0.7478094709473372
distance-from-start_max1.438162383761261
distance-from-start_mean0.7289714152785263
distance-from-start_median0.5564612149057249
distance-from-start_min0.3648008475413942
driven_any_max1.4382693230332029
driven_any_mean0.729004624492714
driven_any_median0.556470991690694
driven_any_min0.3648071915562648
driven_lanedir_consec_max0.7375240370941809
driven_lanedir_consec_mean0.3748149029942042
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.746168337032741
driven_lanedir_mean0.37697597797884425
driven_lanedir_median0.30101962152421446
driven_lanedir_min0.15969633183420706
in-drivable-lane_max8.300000000000004
in-drivable-lane_mean5.100000000000006
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.6981436944804056, "survival_time": 9.750000000000004, "driven_lanedir": 0.199551480959018, "in-drivable-lane": 8.000000000000004, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.6981319454565775, "deviation-center-line": 0.12567555661401583, "driven_lanedir_consec": 0.199551480959018}, "udem-000-ego1": {"driven_any": 0.3648071915562648, "survival_time": 9.750000000000004, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 8.300000000000004, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.3648008475413942, "deviation-center-line": 0.1356249877645468, "driven_lanedir_consec": 0.15969633183420706}, "udem-000-ego2": {"driven_any": 0.4147982889009824, "survival_time": 9.750000000000004, "driven_lanedir": 0.40248776208941095, "in-drivable-lane": 0.0, "deviation-heading": 2.350281655920482, "distance-from-start": 0.41479048435487215, "deviation-center-line": 0.9867208312321796, "driven_lanedir_consec": 0.40248776208941095}, "udem-000-ego3": {"driven_any": 1.4382693230332029, "survival_time": 9.750000000000004, "driven_lanedir": 0.746168337032741, "in-drivable-lane": 4.100000000000016, "deviation-heading": 2.548187013405534, "distance-from-start": 1.438162383761261, "deviation-center-line": 0.5310014398105175, "driven_lanedir_consec": 0.7375240370941809}}
simulation-passed1
survival_time_max9.750000000000004
survival_time_mean9.750000000000004
survival_time_min9.750000000000004
No reset possible
104376sim-2of4successyes0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104375sim-0of4successyes0:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98786sim-3of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98785sim-2of4successno0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98784sim-1of4failedno0:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98781sim-2of4successno0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98780sim-3of4successno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98779sim-1of4failedno0:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98775sim-2of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98774sim-3of4successno0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98773sim-1of4failedno0:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98771sim-1of4failedno0:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98770sim-2of4successno0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98768sim-3of4successno0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98767sim-0of4failedno0:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98766sim-1of4failedno0:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98764sim-2of4successno0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98763sim-3of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98762sim-0of4failedno0:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98761sim-1of4failedno0:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98758sim-0of4failedno0:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98751sim-0of4failedno0:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
98745sim-0of4failedno0:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96633sim-3of4successno0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96630sim-0of4successno0:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96629sim-2of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96626sim-3of4successno0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96625sim-2of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96621sim-3of4successno0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96618sim-2of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96617sim-1of4successno0:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96616sim-0of4successno0:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96614sim-3of4successno0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87778sim-1of4successno0:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87776sim-1of4successno0:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87774sim-1of4successno0:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87750sim-2of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87745sim-2of4successno0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87742sim-1of4successno0:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87738sim-2of4successno0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87737sim-1of4successno0:05:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87735sim-2of4successno0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87733sim-2of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible