Duckietown Challenges Home Challenges Submissions

Submission 13588

Submission13588
Competingyes
Challengeaido-LFV-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105516 sim-1of4: 105511 sim-2of4: 105518 sim-3of4: 105531
Next
User label202-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
105531sim-3of4successyes0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.450000000000014
in-drivable-lane_median0.29999999999999893
driven_lanedir_consec_median4.189930698265808
deviation-center-line_median0.6651828642468578


other stats
deviation-center-line_max0.6651828642468578
deviation-center-line_mean0.6651828642468578
deviation-center-line_min0.6651828642468578
deviation-heading_max1.9766956356556955
deviation-heading_mean1.9766956356556955
deviation-heading_median1.9766956356556955
deviation-heading_min1.9766956356556955
distance-from-start_max3.246594451275677
distance-from-start_mean3.246594451275677
distance-from-start_median3.246594451275677
distance-from-start_min3.246594451275677
driven_any_max4.389009310345488
driven_any_mean4.389009310345488
driven_any_median4.389009310345488
driven_any_min4.389009310345488
driven_lanedir_consec_max4.189930698265808
driven_lanedir_consec_mean4.189930698265808
driven_lanedir_consec_min4.189930698265808
driven_lanedir_max4.189930698265808
driven_lanedir_mean4.189930698265808
driven_lanedir_median4.189930698265808
driven_lanedir_min4.189930698265808
in-drivable-lane_max0.29999999999999893
in-drivable-lane_mean0.29999999999999893
in-drivable-lane_min0.29999999999999893
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.389009310345488, "survival_time": 10.450000000000014, "driven_lanedir": 4.189930698265808, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 1.9766956356556955, "distance-from-start": 3.246594451275677, "deviation-center-line": 0.6651828642468578, "driven_lanedir_consec": 4.189930698265808}}
simulation-passed1
survival_time_max10.450000000000014
survival_time_mean10.450000000000014
survival_time_min10.450000000000014
No reset possible
105520sim-3of4successyes0:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105518sim-2of4successyes0:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.299999999999986
in-drivable-lane_median0.0
driven_lanedir_consec_median2.517050200027501
deviation-center-line_median0.4934445796443232


other stats
deviation-center-line_max0.4934445796443232
deviation-center-line_mean0.4934445796443232
deviation-center-line_min0.4934445796443232
deviation-heading_max1.2065262784012942
deviation-heading_mean1.2065262784012942
deviation-heading_median1.2065262784012942
deviation-heading_min1.2065262784012942
distance-from-start_max1.7898555841431842
distance-from-start_mean1.7898555841431842
distance-from-start_median1.7898555841431842
distance-from-start_min1.7898555841431842
driven_any_max2.57655750951974
driven_any_mean2.57655750951974
driven_any_median2.57655750951974
driven_any_min2.57655750951974
driven_lanedir_consec_max2.517050200027501
driven_lanedir_consec_mean2.517050200027501
driven_lanedir_consec_min2.517050200027501
driven_lanedir_max2.517050200027501
driven_lanedir_mean2.517050200027501
driven_lanedir_median2.517050200027501
driven_lanedir_min2.517050200027501
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.57655750951974, "survival_time": 6.299999999999986, "driven_lanedir": 2.517050200027501, "in-drivable-lane": 0.0, "deviation-heading": 1.2065262784012942, "distance-from-start": 1.7898555841431842, "deviation-center-line": 0.4934445796443232, "driven_lanedir_consec": 2.517050200027501}}
simulation-passed1
survival_time_max6.299999999999986
survival_time_mean6.299999999999986
survival_time_min6.299999999999986
No reset possible
105516sim-0of4successyes0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.449999999999985
in-drivable-lane_median0.0
driven_lanedir_consec_median3.332574223909506
deviation-center-line_median0.665414083557024


other stats
deviation-center-line_max0.665414083557024
deviation-center-line_mean0.665414083557024
deviation-center-line_min0.665414083557024
deviation-heading_max1.662250989275296
deviation-heading_mean1.662250989275296
deviation-heading_median1.662250989275296
deviation-heading_min1.662250989275296
distance-from-start_max1.1107698290228016
distance-from-start_mean1.1107698290228016
distance-from-start_median1.1107698290228016
distance-from-start_min1.1107698290228016
driven_any_max3.4219747785386527
driven_any_mean3.4219747785386527
driven_any_median3.4219747785386527
driven_any_min3.4219747785386527
driven_lanedir_consec_max3.332574223909506
driven_lanedir_consec_mean3.332574223909506
driven_lanedir_consec_min3.332574223909506
driven_lanedir_max3.332574223909506
driven_lanedir_mean3.332574223909506
driven_lanedir_median3.332574223909506
driven_lanedir_min3.332574223909506
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4219747785386527, "survival_time": 8.449999999999985, "driven_lanedir": 3.332574223909506, "in-drivable-lane": 0.0, "deviation-heading": 1.662250989275296, "distance-from-start": 1.1107698290228016, "deviation-center-line": 0.665414083557024, "driven_lanedir_consec": 3.332574223909506}}
simulation-passed1
survival_time_max8.449999999999985
survival_time_mean8.449999999999985
survival_time_min8.449999999999985
No reset possible
105512sim-2of4successyes0:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105511sim-1of4successyes0:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.550000000000114
in-drivable-lane_median1.5500000000000205
driven_lanedir_consec_median7.019664114120786
deviation-center-line_median1.2669071326101875


other stats
deviation-center-line_max1.2669071326101875
deviation-center-line_mean1.2669071326101875
deviation-center-line_min1.2669071326101875
deviation-heading_max2.892617515379227
deviation-heading_mean2.892617515379227
deviation-heading_median2.892617515379227
deviation-heading_min2.892617515379227
distance-from-start_max3.352120709591046
distance-from-start_mean3.352120709591046
distance-from-start_median3.352120709591046
distance-from-start_min3.352120709591046
driven_any_max7.7356790449127635
driven_any_mean7.7356790449127635
driven_any_median7.7356790449127635
driven_any_min7.7356790449127635
driven_lanedir_consec_max7.019664114120786
driven_lanedir_consec_mean7.019664114120786
driven_lanedir_consec_min7.019664114120786
driven_lanedir_max7.019664114120786
driven_lanedir_mean7.019664114120786
driven_lanedir_median7.019664114120786
driven_lanedir_min7.019664114120786
in-drivable-lane_max1.5500000000000205
in-drivable-lane_mean1.5500000000000205
in-drivable-lane_min1.5500000000000205
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.7356790449127635, "survival_time": 17.550000000000114, "driven_lanedir": 7.019664114120786, "in-drivable-lane": 1.5500000000000205, "deviation-heading": 2.892617515379227, "distance-from-start": 3.352120709591046, "deviation-center-line": 1.2669071326101875, "driven_lanedir_consec": 7.019664114120786}}
simulation-passed1
survival_time_max17.550000000000114
survival_time_mean17.550000000000114
survival_time_min17.550000000000114
No reset possible
105510sim-0of4successyes0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91033sim-3of4successno0:07:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91028sim-0of4successno0:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90972sim-1of4successno0:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90969sim-2of4successno0:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74581sim-3of4successno0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74579sim-0of4successno0:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74569sim-3of4host-errorno0:01:12
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74544sim-1of4successno0:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74527sim-2of4successno0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible