Duckietown Challenges Home Challenges Submissions

Submission 15557

Submission15557
Competingyes
Challengeaido-LFV-sim-validation
UserAdriano Almeida
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104773 sim-1of4: 104776 sim-2of4: 104774 sim-3of4: 104772
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

104776

Click the images to see detailed statistics about the episode.

autolab-000

104774

Click the images to see detailed statistics about the episode.

autolab-000

104773

Click the images to see detailed statistics about the episode.

loop2-000

104772

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
104776sim-1of4successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.2000000000000002
driven_lanedir_consec_median0.2155260283587579
deviation-center-line_median0.05641337072449522


other stats
deviation-center-line_max0.05641337072449522
deviation-center-line_mean0.05641337072449522
deviation-center-line_min0.05641337072449522
deviation-heading_max0.509801784039702
deviation-heading_mean0.509801784039702
deviation-heading_median0.509801784039702
deviation-heading_min0.509801784039702
distance-from-start_max0.48097618723251934
distance-from-start_mean0.48097618723251934
distance-from-start_median0.48097618723251934
distance-from-start_min0.48097618723251934
driven_any_max0.481764804281138
driven_any_mean0.481764804281138
driven_any_median0.481764804281138
driven_any_min0.481764804281138
driven_lanedir_consec_max0.2155260283587579
driven_lanedir_consec_mean0.2155260283587579
driven_lanedir_consec_min0.2155260283587579
driven_lanedir_max0.2155260283587579
driven_lanedir_mean0.2155260283587579
driven_lanedir_median0.2155260283587579
driven_lanedir_min0.2155260283587579
in-drivable-lane_max1.2000000000000002
in-drivable-lane_mean1.2000000000000002
in-drivable-lane_min1.2000000000000002
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.481764804281138, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2155260283587579, "in-drivable-lane": 1.2000000000000002, "deviation-heading": 0.509801784039702, "distance-from-start": 0.48097618723251934, "deviation-center-line": 0.05641337072449522, "driven_lanedir_consec": 0.2155260283587579}}
simulation-passed1
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
104774sim-2of4successyes0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.2000000000000002
driven_lanedir_consec_median0.2155260283587579
deviation-center-line_median0.05641337072449522


other stats
deviation-center-line_max0.05641337072449522
deviation-center-line_mean0.05641337072449522
deviation-center-line_min0.05641337072449522
deviation-heading_max0.509801784039702
deviation-heading_mean0.509801784039702
deviation-heading_median0.509801784039702
deviation-heading_min0.509801784039702
distance-from-start_max0.48097618723251934
distance-from-start_mean0.48097618723251934
distance-from-start_median0.48097618723251934
distance-from-start_min0.48097618723251934
driven_any_max0.481764804281138
driven_any_mean0.481764804281138
driven_any_median0.481764804281138
driven_any_min0.481764804281138
driven_lanedir_consec_max0.2155260283587579
driven_lanedir_consec_mean0.2155260283587579
driven_lanedir_consec_min0.2155260283587579
driven_lanedir_max0.2155260283587579
driven_lanedir_mean0.2155260283587579
driven_lanedir_median0.2155260283587579
driven_lanedir_min0.2155260283587579
in-drivable-lane_max1.2000000000000002
in-drivable-lane_mean1.2000000000000002
in-drivable-lane_min1.2000000000000002
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.481764804281138, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2155260283587579, "in-drivable-lane": 1.2000000000000002, "deviation-heading": 0.509801784039702, "distance-from-start": 0.48097618723251934, "deviation-center-line": 0.05641337072449522, "driven_lanedir_consec": 0.2155260283587579}}
simulation-passed1
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
104773sim-0of4successyes0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.149999999999997
in-drivable-lane_median1.599999999999998
driven_lanedir_consec_median0.3547105463544855
deviation-center-line_median0.11558783406246016


other stats
deviation-center-line_max0.11558783406246016
deviation-center-line_mean0.11558783406246016
deviation-center-line_min0.11558783406246016
deviation-heading_max1.1209455199435732
deviation-heading_mean1.1209455199435732
deviation-heading_median1.1209455199435732
deviation-heading_min1.1209455199435732
distance-from-start_max0.9273920625044212
distance-from-start_mean0.9273920625044212
distance-from-start_median0.9273920625044212
distance-from-start_min0.9273920625044212
driven_any_max0.928908586637055
driven_any_mean0.928908586637055
driven_any_median0.928908586637055
driven_any_min0.928908586637055
driven_lanedir_consec_max0.3547105463544855
driven_lanedir_consec_mean0.3547105463544855
driven_lanedir_consec_min0.3547105463544855
driven_lanedir_max0.3547105463544855
driven_lanedir_mean0.3547105463544855
driven_lanedir_median0.3547105463544855
driven_lanedir_min0.3547105463544855
in-drivable-lane_max1.599999999999998
in-drivable-lane_mean1.599999999999998
in-drivable-lane_min1.599999999999998
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.928908586637055, "survival_time": 3.149999999999997, "driven_lanedir": 0.3547105463544855, "in-drivable-lane": 1.599999999999998, "deviation-heading": 1.1209455199435732, "distance-from-start": 0.9273920625044212, "deviation-center-line": 0.11558783406246016, "driven_lanedir_consec": 0.3547105463544855}}
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean3.149999999999997
survival_time_min3.149999999999997
No reset possible
104772sim-3of4successyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.5999999999999988
in-drivable-lane_median1.6499999999999986
driven_lanedir_consec_median0.21552340575441553
deviation-center-line_median0.05641337072449539


other stats
deviation-center-line_max0.05641337072449539
deviation-center-line_mean0.05641337072449539
deviation-center-line_min0.05641337072449539
deviation-heading_max0.509801784039702
deviation-heading_mean0.509801784039702
deviation-heading_median0.509801784039702
deviation-heading_min0.509801784039702
distance-from-start_max0.6829168542888796
distance-from-start_mean0.6829168542888796
distance-from-start_median0.6829168542888796
distance-from-start_min0.6829168542888796
driven_any_max0.6837924166052131
driven_any_mean0.6837924166052131
driven_any_median0.6837924166052131
driven_any_min0.6837924166052131
driven_lanedir_consec_max0.21552340575441553
driven_lanedir_consec_mean0.21552340575441553
driven_lanedir_consec_min0.21552340575441553
driven_lanedir_max0.21552340575441553
driven_lanedir_mean0.21552340575441553
driven_lanedir_median0.21552340575441553
driven_lanedir_min0.21552340575441553
in-drivable-lane_max1.6499999999999986
in-drivable-lane_mean1.6499999999999986
in-drivable-lane_min1.6499999999999986
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6837924166052131, "survival_time": 2.5999999999999988, "driven_lanedir": 0.21552340575441553, "in-drivable-lane": 1.6499999999999986, "deviation-heading": 0.509801784039702, "distance-from-start": 0.6829168542888796, "deviation-center-line": 0.05641337072449539, "driven_lanedir_consec": 0.21552340575441553}}
simulation-passed1
survival_time_max2.5999999999999988
survival_time_mean2.5999999999999988
survival_time_min2.5999999999999988
No reset possible
104765sim-1of4successyes0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104764sim-0of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104763sim-2of4successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104760sim-3of4successyes0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99630sim-2of4failedno0:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99629sim-0of4failedno0:01:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99628sim-3of4failedno0:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99624sim-1of4failedno0:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99623sim-2of4failedno0:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99620sim-2of4failedno0:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99618sim-0of4host-errorno0:01:21
The container "npc0" [...]
The container "npc0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99614sim-3of4host-errorno0:01:12
The container "npc0" [...]
The container "npc0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99613sim-1of4host-errorno0:01:13
The container "npc0" [...]
The container "npc0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99610sim-0of4failedno0:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99607sim-3of4failedno0:01:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99604sim-2of4failedno0:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99603sim-1of4failedno0:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96833sim-0of4successno0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96829sim-3of4successno0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96827sim-1of4successno0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96826sim-2of4successno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96823sim-3of4successno0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96822sim-0of4successno0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96817sim-2of4successno0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96816sim-1of4successno0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96811sim-3of4successno0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96810sim-0of4successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96807sim-2of4successno0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96805sim-1of4successno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96802sim-0of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96799sim-3of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible