Duckietown Challenges Home Challenges Submissions

Submission 17270

Submission17270
Competingyes
Challengeaido-LF-sim-validation
UserKatica Bozsó
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104644 sim-1of4: 104645 sim-2of4: 104643 sim-3of4: 104648
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

104648

Click the images to see detailed statistics about the episode.

zigzag-000

104645

Click the images to see detailed statistics about the episode.

autolab-000

104644

Click the images to see detailed statistics about the episode.

loop2-000

104643

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
104648sim-3of4successyes0:09:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7517424258233485
survival_time_median59.99999999999873
deviation-center-line_median1.9832698417038055
in-drivable-lane_median31.54999999999933


other stats
deviation-center-line_max1.9832698417038055
deviation-center-line_mean1.9832698417038055
deviation-center-line_min1.9832698417038055
deviation-heading_max22.33334622862453
deviation-heading_mean22.33334622862453
deviation-heading_median22.33334622862453
deviation-heading_min22.33334622862453
distance-from-start_max0.4691470171982234
distance-from-start_mean0.4691470171982234
distance-from-start_median0.4691470171982234
distance-from-start_min0.4691470171982234
driven_any_max5.413828947457846
driven_any_mean5.413828947457846
driven_any_median5.413828947457846
driven_any_min5.413828947457846
driven_lanedir_consec_max1.7517424258233485
driven_lanedir_consec_mean1.7517424258233485
driven_lanedir_consec_min1.7517424258233485
driven_lanedir_max1.7517424258233485
driven_lanedir_mean1.7517424258233485
driven_lanedir_median1.7517424258233485
driven_lanedir_min1.7517424258233485
in-drivable-lane_max31.54999999999933
in-drivable-lane_mean31.54999999999933
in-drivable-lane_min31.54999999999933
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.413828947457846, "survival_time": 59.99999999999873, "driven_lanedir": 1.7517424258233485, "in-drivable-lane": 31.54999999999933, "deviation-heading": 22.33334622862453, "distance-from-start": 0.4691470171982234, "deviation-center-line": 1.9832698417038055, "driven_lanedir_consec": 1.7517424258233485}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
104645sim-1of4successyes0:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9894360165056676
survival_time_median59.99999999999873
deviation-center-line_median2.035628744961666
in-drivable-lane_median28.2999999999994


other stats
deviation-center-line_max2.035628744961666
deviation-center-line_mean2.035628744961666
deviation-center-line_min2.035628744961666
deviation-heading_max24.937569313215768
deviation-heading_mean24.937569313215768
deviation-heading_median24.937569313215768
deviation-heading_min24.937569313215768
distance-from-start_max0.7162357481589043
distance-from-start_mean0.7162357481589043
distance-from-start_median0.7162357481589043
distance-from-start_min0.7162357481589043
driven_any_max2.370109266735853
driven_any_mean2.370109266735853
driven_any_median2.370109266735853
driven_any_min2.370109266735853
driven_lanedir_consec_max0.9894360165056676
driven_lanedir_consec_mean0.9894360165056676
driven_lanedir_consec_min0.9894360165056676
driven_lanedir_max0.9894360165056676
driven_lanedir_mean0.9894360165056676
driven_lanedir_median0.9894360165056676
driven_lanedir_min0.9894360165056676
in-drivable-lane_max28.2999999999994
in-drivable-lane_mean28.2999999999994
in-drivable-lane_min28.2999999999994
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.370109266735853, "survival_time": 59.99999999999873, "driven_lanedir": 0.9894360165056676, "in-drivable-lane": 28.2999999999994, "deviation-heading": 24.937569313215768, "distance-from-start": 0.7162357481589043, "deviation-center-line": 2.035628744961666, "driven_lanedir_consec": 0.9894360165056676}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
104644sim-0of4successyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6491100473611013
survival_time_median10.000000000000009
deviation-center-line_median0.3129153711332641
in-drivable-lane_median4.650000000000014


other stats
deviation-center-line_max0.3129153711332641
deviation-center-line_mean0.3129153711332641
deviation-center-line_min0.3129153711332641
deviation-heading_max4.039711350951367
deviation-heading_mean4.039711350951367
deviation-heading_median4.039711350951367
deviation-heading_min4.039711350951367
distance-from-start_max0.2446925319409675
distance-from-start_mean0.2446925319409675
distance-from-start_median0.2446925319409675
distance-from-start_min0.2446925319409675
driven_any_max1.714551247698101
driven_any_mean1.714551247698101
driven_any_median1.714551247698101
driven_any_min1.714551247698101
driven_lanedir_consec_max0.6491100473611013
driven_lanedir_consec_mean0.6491100473611013
driven_lanedir_consec_min0.6491100473611013
driven_lanedir_max0.6491100473611013
driven_lanedir_mean0.6491100473611013
driven_lanedir_median0.6491100473611013
driven_lanedir_min0.6491100473611013
in-drivable-lane_max4.650000000000014
in-drivable-lane_mean4.650000000000014
in-drivable-lane_min4.650000000000014
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.714551247698101, "survival_time": 10.000000000000009, "driven_lanedir": 0.6491100473611013, "in-drivable-lane": 4.650000000000014, "deviation-heading": 4.039711350951367, "distance-from-start": 0.2446925319409675, "deviation-center-line": 0.3129153711332641, "driven_lanedir_consec": 0.6491100473611013}}
simulation-passed1
survival_time_max10.000000000000009
survival_time_mean10.000000000000009
survival_time_min10.000000000000009
No reset possible
104643sim-2of4successyes0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04226845992453643
survival_time_median2.549999999999999
deviation-center-line_median0.025684546762411647
in-drivable-lane_median1.6499999999999988


other stats
deviation-center-line_max0.025684546762411647
deviation-center-line_mean0.025684546762411647
deviation-center-line_min0.025684546762411647
deviation-heading_max0.7583921621482473
deviation-heading_mean0.7583921621482473
deviation-heading_median0.7583921621482473
deviation-heading_min0.7583921621482473
distance-from-start_max0.13194712687538435
distance-from-start_mean0.13194712687538435
distance-from-start_median0.13194712687538435
distance-from-start_min0.13194712687538435
driven_any_max0.1901705188595263
driven_any_mean0.1901705188595263
driven_any_median0.1901705188595263
driven_any_min0.1901705188595263
driven_lanedir_consec_max0.04226845992453643
driven_lanedir_consec_mean0.04226845992453643
driven_lanedir_consec_min0.04226845992453643
driven_lanedir_max0.04226845992453643
driven_lanedir_mean0.04226845992453643
driven_lanedir_median0.04226845992453643
driven_lanedir_min0.04226845992453643
in-drivable-lane_max1.6499999999999988
in-drivable-lane_mean1.6499999999999988
in-drivable-lane_min1.6499999999999988
per-episodes
details{"loop-000-ego0": {"driven_any": 0.1901705188595263, "survival_time": 2.549999999999999, "driven_lanedir": 0.04226845992453643, "in-drivable-lane": 1.6499999999999988, "deviation-heading": 0.7583921621482473, "distance-from-start": 0.13194712687538435, "deviation-center-line": 0.025684546762411647, "driven_lanedir_consec": 0.04226845992453643}}
simulation-passed1
survival_time_max2.549999999999999
survival_time_mean2.549999999999999
survival_time_min2.549999999999999
No reset possible
99489sim-1of4failedno0:02:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99488sim-3of4failedno0:02:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99487sim-2of4failedno0:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99483sim-0of4failedno0:02:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96607sim-2of4successno0:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96606sim-1of4successno0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96605sim-3of4successno0:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96603sim-2of4successno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96600sim-0of4successno0:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96599sim-1of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90180sim-2of4successno0:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90175sim-0of4successno0:07:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90169sim-1of4successno0:13:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90159sim-3of4successno0:21:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90158sim-3of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90157sim-3of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90156sim-3of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90155sim-3of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90154sim-3of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90153sim-3of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90152sim-1of4timeoutno0:00:39
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90151sim-1of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90150sim-1of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90149sim-3of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90148sim-3of4timeoutno0:00:39
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90147sim-3of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90146sim-3of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90145sim-1of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90144sim-1of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90143sim-1of4timeoutno0:00:42
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90142sim-1of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90141sim-1of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90140sim-3of4timeoutno0:00:42
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90139sim-3of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90138sim-3of4timeoutno0:00:39
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90137sim-3of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90136sim-1of4timeoutno0:00:39
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90135sim-1of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90134sim-1of4timeoutno0:00:42
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90133sim-1of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90132sim-3of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90131sim-3of4timeoutno0:00:42
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90130sim-1of4timeoutno0:00:39
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90129sim-1of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90128sim-1of4timeoutno0:00:40
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90127sim-1of4timeoutno0:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible