Duckietown Challenges Home Challenges Submissions

Submission 13630

Submission13630
Competingyes
Challengeaido-LFI-sim-validation
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 116783 sim-1of4: 116784 sim-2of4: 104909 sim-3of4: 104907
Next
User labelmobile-segmentation
Admin priority50
Blessingn/a
User priority50

116784

Click the images to see detailed statistics about the episode.

4way-000

116783

Click the images to see detailed statistics about the episode.

udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
116784sim-1of4successyes0:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.4999999999999956
in-drivable-lane_median0.29999999999999893
driven_lanedir_consec_median0.7096074663277117
deviation-center-line_median0.2056116773642877


other stats
deviation-center-line_max0.2056116773642877
deviation-center-line_mean0.2056116773642877
deviation-center-line_min0.2056116773642877
deviation-heading_max1.7611704433718218
deviation-heading_mean1.7611704433718218
deviation-heading_median1.7611704433718218
deviation-heading_min1.7611704433718218
distance-from-start_max1.005970141272594
distance-from-start_mean1.005970141272594
distance-from-start_median1.005970141272594
distance-from-start_min1.005970141272594
driven_any_max1.0403083511823386
driven_any_mean1.0403083511823386
driven_any_median1.0403083511823386
driven_any_min1.0403083511823386
driven_lanedir_consec_max0.7096074663277117
driven_lanedir_consec_mean0.7096074663277117
driven_lanedir_consec_min0.7096074663277117
driven_lanedir_max0.8672458500150257
driven_lanedir_mean0.8672458500150257
driven_lanedir_median0.8672458500150257
driven_lanedir_min0.8672458500150257
in-drivable-lane_max0.29999999999999893
in-drivable-lane_mean0.29999999999999893
in-drivable-lane_min0.29999999999999893
per-episodes
details{"4way-000-ego0": {"driven_any": 1.0403083511823386, "survival_time": 3.4999999999999956, "driven_lanedir": 0.8672458500150257, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 1.7611704433718218, "distance-from-start": 1.005970141272594, "deviation-center-line": 0.2056116773642877, "driven_lanedir_consec": 0.7096074663277117}}
simulation-passed1
survival_time_max3.4999999999999956
survival_time_mean3.4999999999999956
survival_time_min3.4999999999999956
No reset possible
116783sim-0of4successyes0:07:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.100000000000025
in-drivable-lane_median0.25000000000000355
driven_lanedir_consec_median4.1253326281380795
deviation-center-line_median0.6757431629362138


other stats
deviation-center-line_max0.6757431629362138
deviation-center-line_mean0.6757431629362138
deviation-center-line_min0.6757431629362138
deviation-heading_max3.3692665992260435
deviation-heading_mean3.3692665992260435
deviation-heading_median3.3692665992260435
deviation-heading_min3.3692665992260435
distance-from-start_max2.296837868951322
distance-from-start_mean2.296837868951322
distance-from-start_median2.296837868951322
distance-from-start_min2.296837868951322
driven_any_max4.431760518232192
driven_any_mean4.431760518232192
driven_any_median4.431760518232192
driven_any_min4.431760518232192
driven_lanedir_consec_max4.1253326281380795
driven_lanedir_consec_mean4.1253326281380795
driven_lanedir_consec_min4.1253326281380795
driven_lanedir_max4.143442103579684
driven_lanedir_mean4.143442103579684
driven_lanedir_median4.143442103579684
driven_lanedir_min4.143442103579684
in-drivable-lane_max0.25000000000000355
in-drivable-lane_mean0.25000000000000355
in-drivable-lane_min0.25000000000000355
per-episodes
details{"udem1-000-ego0": {"driven_any": 4.431760518232192, "survival_time": 11.100000000000025, "driven_lanedir": 4.143442103579684, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 3.3692665992260435, "distance-from-start": 2.296837868951322, "deviation-center-line": 0.6757431629362138, "driven_lanedir_consec": 4.1253326281380795}}
simulation-passed1
survival_time_max11.100000000000025
survival_time_mean11.100000000000025
survival_time_min11.100000000000025
No reset possible
104909sim-2of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104907sim-3of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104906sim-2of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104904sim-3of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104903sim-2of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104900sim-3of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104898sim-2of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100234sim-0of4host-errorno0:01:08
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100221sim-0of4host-errorno0:01:09
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100210sim-0of4host-errorno0:01:20
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100194sim-0of4host-errorno0:01:05
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100184sim-0of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100174sim-0of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100120sim-0of4host-errorno0:01:02
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100109sim-0of4host-errorno0:01:26
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100103sim-1of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100089sim-1of4host-errorno0:01:05
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100076sim-1of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100070sim-1of4host-errorno0:01:52
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100061sim-0of4host-errorno0:01:13
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100049sim-0of4failedno0:01:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100035sim-0of4host-errorno0:01:32
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100031sim-1of4host-errorno0:01:05
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100018sim-1of4host-errorno0:01:07
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100001sim-1of4host-errorno0:03:21
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99968sim-1of4host-errorno0:01:10
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99962sim-1of4host-errorno0:04:37
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99957sim-1of4host-errorno0:01:31
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99938sim-1of4host-errorno0:01:32
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99933sim-1of4host-errorno0:01:09
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99928sim-1of4host-errorno0:01:12
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99920sim-0of4timeoutno0:26:01
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99918sim-1of4failedno0:01:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99910sim-0of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99903sim-1of4host-errorno0:01:31
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99902sim-0of4host-errorno0:01:25
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99892sim-1of4host-errorno0:01:13
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99889sim-0of4host-errorno0:01:05
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99881sim-0of4failedno0:01:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99879sim-1of4host-errorno0:01:30
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99870sim-1of4host-errorno0:01:25
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99866sim-0of4host-errorno0:01:30
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99860sim-2of4successno0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99859sim-3of4successno0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99858sim-1of4host-errorno0:01:09
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99857sim-0of4host-errorno0:01:03
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99850sim-3of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99849sim-2of4successno0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible