Duckietown Challenges Home Challenges Submissions

Submission 13579

Submission13579
Competingyes
Challengeaido-LF-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105590 sim-1of4: 105575 sim-2of4: 105574 sim-3of4: 105579
Next
User label202-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
105590sim-0of4successyes0:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median26.773531109556536
survival_time_median59.99999999999873
deviation-center-line_median4.07119006599574
in-drivable-lane_median0.0


other stats
deviation-center-line_max4.07119006599574
deviation-center-line_mean4.07119006599574
deviation-center-line_min4.07119006599574
deviation-heading_max10.158298415865588
deviation-heading_mean10.158298415865588
deviation-heading_median10.158298415865588
deviation-heading_min10.158298415865588
distance-from-start_max1.1270796647157777
distance-from-start_mean1.1270796647157777
distance-from-start_median1.1270796647157777
distance-from-start_min1.1270796647157777
driven_any_max27.35012016914082
driven_any_mean27.35012016914082
driven_any_median27.35012016914082
driven_any_min27.35012016914082
driven_lanedir_consec_max26.773531109556536
driven_lanedir_consec_mean26.773531109556536
driven_lanedir_consec_min26.773531109556536
driven_lanedir_max26.773531109556536
driven_lanedir_mean26.773531109556536
driven_lanedir_median26.773531109556536
driven_lanedir_min26.773531109556536
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 27.35012016914082, "survival_time": 59.99999999999873, "driven_lanedir": 26.773531109556536, "in-drivable-lane": 0.0, "deviation-heading": 10.158298415865588, "distance-from-start": 1.1270796647157777, "deviation-center-line": 4.07119006599574, "driven_lanedir_consec": 26.773531109556536}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105582sim-0of4successyes0:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105579sim-3of4successyes0:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median26.383529824308845
survival_time_median59.99999999999873
deviation-center-line_median4.095940213037033
in-drivable-lane_median1.8999999999999595


other stats
deviation-center-line_max4.095940213037033
deviation-center-line_mean4.095940213037033
deviation-center-line_min4.095940213037033
deviation-heading_max10.647781708625647
deviation-heading_mean10.647781708625647
deviation-heading_median10.647781708625647
deviation-heading_min10.647781708625647
distance-from-start_max3.3596861715227995
distance-from-start_mean3.3596861715227995
distance-from-start_median3.3596861715227995
distance-from-start_min3.3596861715227995
driven_any_max27.69775113769016
driven_any_mean27.69775113769016
driven_any_median27.69775113769016
driven_any_min27.69775113769016
driven_lanedir_consec_max26.383529824308845
driven_lanedir_consec_mean26.383529824308845
driven_lanedir_consec_min26.383529824308845
driven_lanedir_max26.383529824308845
driven_lanedir_mean26.383529824308845
driven_lanedir_median26.383529824308845
driven_lanedir_min26.383529824308845
in-drivable-lane_max1.8999999999999595
in-drivable-lane_mean1.8999999999999595
in-drivable-lane_min1.8999999999999595
per-episodes
details{"zigzag-000-ego0": {"driven_any": 27.69775113769016, "survival_time": 59.99999999999873, "driven_lanedir": 26.383529824308845, "in-drivable-lane": 1.8999999999999595, "deviation-heading": 10.647781708625647, "distance-from-start": 3.3596861715227995, "deviation-center-line": 4.095940213037033, "driven_lanedir_consec": 26.383529824308845}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105575sim-1of4successyes0:05:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.227657828692305
survival_time_median59.99999999999873
deviation-center-line_median4.326519263937919
in-drivable-lane_median2.4499999999999673


other stats
deviation-center-line_max4.326519263937919
deviation-center-line_mean4.326519263937919
deviation-center-line_min4.326519263937919
deviation-heading_max8.83595461221568
deviation-heading_mean8.83595461221568
deviation-heading_median8.83595461221568
deviation-heading_min8.83595461221568
distance-from-start_max3.976069775426724
distance-from-start_mean3.976069775426724
distance-from-start_median3.976069775426724
distance-from-start_min3.976069775426724
driven_any_max29.62738025645802
driven_any_mean29.62738025645802
driven_any_median29.62738025645802
driven_any_min29.62738025645802
driven_lanedir_consec_max28.227657828692305
driven_lanedir_consec_mean28.227657828692305
driven_lanedir_consec_min28.227657828692305
driven_lanedir_max28.227657828692305
driven_lanedir_mean28.227657828692305
driven_lanedir_median28.227657828692305
driven_lanedir_min28.227657828692305
in-drivable-lane_max2.4499999999999673
in-drivable-lane_mean2.4499999999999673
in-drivable-lane_min2.4499999999999673
per-episodes
details{"autolab-000-ego0": {"driven_any": 29.62738025645802, "survival_time": 59.99999999999873, "driven_lanedir": 28.227657828692305, "in-drivable-lane": 2.4499999999999673, "deviation-heading": 8.83595461221568, "distance-from-start": 3.976069775426724, "deviation-center-line": 4.326519263937919, "driven_lanedir_consec": 28.227657828692305}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105574sim-2of4successyes0:05:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median30.245175201828964
survival_time_median59.99999999999873
deviation-center-line_median4.070927347524227
in-drivable-lane_median0.7999999999999794


other stats
deviation-center-line_max4.070927347524227
deviation-center-line_mean4.070927347524227
deviation-center-line_min4.070927347524227
deviation-heading_max7.503108843626066
deviation-heading_mean7.503108843626066
deviation-heading_median7.503108843626066
deviation-heading_min7.503108843626066
distance-from-start_max2.542110344574637
distance-from-start_mean2.542110344574637
distance-from-start_median2.542110344574637
distance-from-start_min2.542110344574637
driven_any_max30.93835542939646
driven_any_mean30.93835542939646
driven_any_median30.93835542939646
driven_any_min30.93835542939646
driven_lanedir_consec_max30.245175201828964
driven_lanedir_consec_mean30.245175201828964
driven_lanedir_consec_min30.245175201828964
driven_lanedir_max30.245175201828964
driven_lanedir_mean30.245175201828964
driven_lanedir_median30.245175201828964
driven_lanedir_min30.245175201828964
in-drivable-lane_max0.7999999999999794
in-drivable-lane_mean0.7999999999999794
in-drivable-lane_min0.7999999999999794
per-episodes
details{"loop-000-ego0": {"driven_any": 30.93835542939646, "survival_time": 59.99999999999873, "driven_lanedir": 30.245175201828964, "in-drivable-lane": 0.7999999999999794, "deviation-heading": 7.503108843626066, "distance-from-start": 2.542110344574637, "deviation-center-line": 4.070927347524227, "driven_lanedir_consec": 30.245175201828964}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91225sim-3of4successno0:17:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91216sim-1of4successno0:17:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91207sim-0of4successno0:18:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91194sim-2of4successno0:18:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74263sim-1of4successno0:09:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74254sim-3of4successno0:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74243sim-0of4successno0:08:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74221sim-2of4successno0:08:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65891sim-3of4successno0:14:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65887sim-1of4successno0:13:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65883sim-0of4successno0:12:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
65880sim-2of4successno0:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62339348successyes1:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62096348successno1:12:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62087348host-errorno0:01:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62086348host-errorno0:01:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "submission.py", line 60, in init
              ||     self.agent = self.create_agent(self.env)
              ||   File "submission.py", line 162, in create_agent_dagger
              ||     agent = DaggerAgent.load_from_checkpoint(
              ||   File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/utilities/device_dtype_mixin.py", line 124, in cuda
              ||     return super().cuda(device=device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in cuda
              ||     return self._apply(lambda t: t.cuda(device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 463, in <lambda>
              ||     return self._apply(lambda t: t.cuda(device))
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible