Evaluator 4924

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:32:10+00:00

2020-12-07 12:32:47+00:00

0:00:37

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60111

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:29:57+00:00

2020-12-07 12:30:33+00:00

0:00:36

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60107

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:28:49+00:00

2020-12-07 12:29:25+00:00

0:00:36

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60105

11012

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:27:38+00:00

2020-12-07 12:28:11+00:00

0:00:33

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60102

11012

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:24:21+00:00

2020-12-07 12:24:56+00:00

0:00:35

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60098

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

host-error

yes

2020-12-07 12:21:36+00:00

2020-12-07 12:21:58+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60096

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:20:37+00:00

2020-12-07 12:21:13+00:00

0:00:36

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60087

template-pytorch

LFv-sim

host-error

yes

aido5-LFP-sim-validation

2020-12-07 12:17:56+00:00

2020-12-07 12:19:20+00:00

0:01:24

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59944

12766

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFP-sim

success

yes

2020-12-07 10:36:22+00:00

2020-12-07 10:43:40+00:00

0:07:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.149999999999986
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.6700998441725898
deviation-center-line_median	0.3320116784695889

other stats

agent_compute-ego0_max	0.03439344373242609
agent_compute-ego0_mean	0.03146219902320069
agent_compute-ego0_median	0.030859546291017996
agent_compute-ego0_min	0.029736259778340657
complete-iteration_max	0.33879520893096926
complete-iteration_mean	0.2918938402309573
complete-iteration_median	0.3018231305258174
complete-iteration_min	0.22513389094122524
deviation-center-line_max	0.5858437583448596
deviation-center-line_mean	0.3495715397118493
deviation-center-line_min	0.14841904356335991
deviation-heading_max	2.1430259798880575
deviation-heading_mean	1.5443303235745387
deviation-heading_median	1.7866576025586256
deviation-heading_min	0.4609801092928453
driven_any_max	2.388939092819927
driven_any_mean	1.655287425403806
driven_any_median	1.8452474667276169
driven_any_min	0.5417156753400634
driven_lanedir_consec_max	2.2567264002183403
driven_lanedir_consec_mean	1.532318302377878
driven_lanedir_consec_min	0.5323471209479919
driven_lanedir_max	2.2567264002183403
driven_lanedir_mean	1.532318302377878
driven_lanedir_median	1.6700998441725898
driven_lanedir_min	0.5323471209479919
get_duckie_state_max	0.024179946581522622
get_duckie_state_mean	0.01726093761517312
get_duckie_state_median	0.020449397193575365
get_duckie_state_min	0.003965009492019127
get_robot_state_max	0.0037878847122192385
get_robot_state_mean	0.003579509727870523
get_robot_state_median	0.003534885803086858
get_robot_state_min	0.0034603825930891365
get_state_dump_max	0.008341816266377767
get_state_dump_mean	0.0073125302645261105
get_state_dump_median	0.007936854223603185
get_state_dump_min	0.005034596344520306
get_ui_image_max	0.03647085666656494
get_ui_image_mean	0.03151126404570064
get_ui_image_median	0.032300778407495
get_ui_image_min	0.024972642701247643
in-drivable-lane_max	0.4999999999999982
in-drivable-lane_mean	0.12499999999999956
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 2.154395577398295, "get_ui_image": 0.030658683776855468, "step_physics": 0.1715819009145101, "survival_time": 7.449999999999981, "driven_lanedir": 2.0258478305146967, "get_state_dump": 0.008341816266377767, "get_robot_state": 0.0035559956232706705, "sim_render-ego0": 0.00366235097249349, "get_duckie_state": 0.024179946581522622, "in-drivable-lane": 0.0, "deviation-heading": 2.1430259798880575, "agent_compute-ego0": 0.029736259778340657, "complete-iteration": 0.28311309655507405, "set_robot_commands": 0.0020417690277099608, "deviation-center-line": 0.5858437583448596, "driven_lanedir_consec": 2.0258478305146967, "sim_compute_sim_state": 0.007408769925435384, "sim_compute_performance-ego0": 0.001847848892211914}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5417156753400634, "get_ui_image": 0.03647085666656494, "step_physics": 0.22165968418121337, "survival_time": 2.4499999999999993, "driven_lanedir": 0.5323471209479919, "get_state_dump": 0.008209733963012696, "get_robot_state": 0.0037878847122192385, "sim_render-ego0": 0.003975296020507812, "get_duckie_state": 0.021148571968078612, "in-drivable-lane": 0.0, "deviation-heading": 0.4609801092928453, "agent_compute-ego0": 0.02994732856750488, "complete-iteration": 0.33879520893096926, "set_robot_commands": 0.0022504377365112306, "deviation-center-line": 0.14841904356335991, "driven_lanedir_consec": 0.5323471209479919, "sim_compute_sim_state": 0.009109349250793456, "sim_compute_performance-ego0": 0.002130708694458008}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.5360993560569387, "get_ui_image": 0.03394287303813453, "step_physics": 0.20390395747805104, "survival_time": 5.09999999999999, "driven_lanedir": 1.314351857830483, "get_state_dump": 0.007663974484193673, "get_robot_state": 0.003513775982903045, "sim_render-ego0": 0.003689115487256096, "get_duckie_state": 0.01975022241907212, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.6827025907793602, "agent_compute-ego0": 0.031771764014531106, "complete-iteration": 0.3205331644965607, "set_robot_commands": 0.0021897010432863698, "deviation-center-line": 0.26787037380379725, "driven_lanedir_consec": 1.314351857830483, "sim_compute_sim_state": 0.012198938906771465, "sim_compute_performance-ego0": 0.0018210457366647072}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.388939092819927, "get_ui_image": 0.024972642701247643, "step_physics": 0.1404870395002694, "survival_time": 7.199999999999982, "driven_lanedir": 2.2567264002183403, "get_state_dump": 0.005034596344520306, "get_robot_state": 0.0034603825930891365, "sim_render-ego0": 0.0035464089492271687, "get_duckie_state": 0.003965009492019127, "in-drivable-lane": 0.0, "deviation-heading": 1.8906126143378912, "agent_compute-ego0": 0.03439344373242609, "complete-iteration": 0.22513389094122524, "set_robot_commands": 0.002036612609337116, "deviation-center-line": 0.3961529831353806, "driven_lanedir_consec": 2.2567264002183403, "sim_compute_sim_state": 0.005375934469288793, "sim_compute_performance-ego0": 0.0017804112927667026}}
set_robot_commands_max	0.0022504377365112306
set_robot_commands_mean	0.002129630104211169
set_robot_commands_median	0.0021157350354981653
set_robot_commands_min	0.002036612609337116
sim_compute_performance-ego0_max	0.002130708694458008
sim_compute_performance-ego0_mean	0.0018950036540253327
sim_compute_performance-ego0_median	0.0018344473144383104
sim_compute_performance-ego0_min	0.0017804112927667026
sim_compute_sim_state_max	0.012198938906771465
sim_compute_sim_state_mean	0.008523248138072275
sim_compute_sim_state_median	0.008259059588114421
sim_compute_sim_state_min	0.005375934469288793
sim_render-ego0_max	0.003975296020507812
sim_render-ego0_mean	0.0037182928573711417
sim_render-ego0_median	0.0036757332298747937
sim_render-ego0_min	0.0035464089492271687
simulation-passed	1
step_physics_max	0.22165968418121337
step_physics_mean	0.18440814551851095
step_physics_median	0.18774292919628055
step_physics_min	0.1404870395002694
survival_time_max	7.449999999999981
survival_time_mean	5.549999999999988
survival_time_min	2.4499999999999993

No reset possible

59137

10359

Charlie Gauthier 🇨🇦

template-ros

aido5-LF-sanity

sanity-check

host-error

yes

aido5-LFV_multi-sim-testing

2020-12-05 13:02:56+00:00

2020-12-05 14:05:18+00:00

1:02:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca,
│                 e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2,
│                 e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf]
│      services: dict[4]
│                │ solution:
│                │ dict[6]
│                │ │ image: docker.io/velythyl/aido-submissions@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10359
│                │ │ │ submitter_name: Velythyl
│                │ │ │ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 0.5
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10359
│                │ │ │ submitter_name: Velythyl
│                │ │ │ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10359
│                │ │ │ submitter_name: Velythyl
│                │ │ │ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- udem1
│                │ │ │ |scenarios_per_map: 1
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |robots_parked: [parked]
│                │ │ │ |nduckies: 1
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10359
│                │ │ │ submitter_name: Velythyl
│                │ │ │ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca
│                │ simulator: e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2
│                │ solution: e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf
│         names: dict[3]
│                │ f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca: nogpu-prod-07_62d94014cea0-job59137-459234_evaluator_1
│                │ e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2: nogpu-prod-07_62d94014cea0-job59137-459234_simulator_1
│                │ e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf: nogpu-prod-07_62d94014cea0-job59137-459234_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca
│         |e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2
│         |e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf
│         |
│  names: dict[3]
│         │ f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca: nogpu-prod-07_62d94014cea0-job59137-459234_evaluator_1
│         │ e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2: nogpu-prod-07_62d94014cea0-job59137-459234_simulator_1
│         │ e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf: nogpu-prod-07_62d94014cea0-job59137-459234_solution_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59095

12779

Thomas Wiggers 🇳🇱

ppo_v1

LFVmultibodyv-sim

success

yes

aido5-LFV_multi-sim-testing

2020-12-04 20:16:07+00:00

2020-12-04 21:03:20+00:00

0:47:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9075967771138004
survival_time_median	22.450000000000184
deviation-center-line_median	0.4134319513314788
in-drivable-lane_median	16.150000000000148

other stats

agent_compute-ego0_max	0.08101010163625082
agent_compute-ego0_mean	0.056528832223570705
agent_compute-ego0_median	0.05015542543479029
agent_compute-ego0_min	0.037675070094170975
agent_compute-ego1_max	0.06270090103149414
agent_compute-ego1_mean	0.047062601155130605
agent_compute-ego1_median	0.043238236466982334
agent_compute-ego1_min	0.0371654871468232
complete-iteration_max	1.0742355998357136
complete-iteration_mean	0.8159477637058418
complete-iteration_median	0.8301285621014141
complete-iteration_min	0.26491468688037906
deviation-center-line_max	1.4614637709352958
deviation-center-line_mean	0.5003826453413441
deviation-center-line_min	0.198255572192448
deviation-heading_max	5.361874023570144
deviation-heading_mean	2.3374592517609862
deviation-heading_median	2.1348641746248775
deviation-heading_min	0.9085832568332964
driven_any_max	4.101273107299533
driven_any_mean	2.4521668405743924
driven_any_median	2.3105641095039764
driven_any_min	1.544939587680913
driven_lanedir_consec_max	2.4749083751355956
driven_lanedir_consec_mean	1.1607565960151955
driven_lanedir_consec_min	0.24681941851253697
driven_lanedir_max	2.4749083751355956
driven_lanedir_mean	1.1607565960151955
driven_lanedir_median	0.9075967771138004
driven_lanedir_min	0.24681941851253697
get_duckie_state_max	1.576346189237488e-06
get_duckie_state_mean	1.462483156917084e-06
get_duckie_state_median	1.5396542019314235e-06
get_duckie_state_min	1.248689455406688e-06
get_robot_state_max	0.015346341326757131
get_robot_state_mean	0.01375601206508867
get_robot_state_median	0.01521022531721327
get_robot_state_min	0.007157248202885423
get_state_dump_max	0.010059102537668296
get_state_dump_mean	0.009222730150689076
get_state_dump_median	0.01001835028330485
get_state_dump_min	0.006117479823460089
get_ui_image_max	0.05376271459791395
get_ui_image_mean	0.04501472232622112
get_ui_image_median	0.04852765405238582
get_ui_image_min	0.029198673283942392
in-drivable-lane_max	27.500000000000306
in-drivable-lane_mean	15.7535714285716
in-drivable-lane_min	2.3000000000000327
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.1107282518616355, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 1.2571455658674062, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 24.200000000000315, "deviation-heading": 0.9085832568332964, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 0.198255572192448, "driven_lanedir_consec": 1.2571455658674062, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 4.101273107299533, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 2.4749083751355956, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 10.650000000000034, "deviation-heading": 5.361874023570144, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 1.4614637709352958, "driven_lanedir_consec": 2.4749083751355956, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.8059518699530184, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 0.621071654044125, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 27.500000000000306, "deviation-heading": 2.585283291963731, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 0.4114472906255719, "driven_lanedir_consec": 0.621071654044125, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 2.010304922531389, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 1.149143085542506, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 22.150000000000286, "deviation-heading": 1.3332807907818554, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 0.69967880067541, "driven_lanedir_consec": 1.149143085542506, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.373812951345048, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.25529014552212925, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 19.550000000000164, "deviation-heading": 2.5537395848337066, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.2804450003183821, "driven_lanedir_consec": 0.25529014552212925, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 2.854767910004957, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.5675129205560778, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 15.550000000000107, "deviation-heading": 3.99511126118562, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.5647234750374569, "driven_lanedir_consec": 0.5675129205560778, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.544939587680913, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.24681941851253697, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 19.650000000000176, "deviation-heading": 2.597615201358681, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.2300032088314247, "driven_lanedir_consec": 0.24681941851253697, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.410477726126387, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.6660504686850947, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 16.75000000000019, "deviation-heading": 2.1378171419524685, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.43895825515084136, "driven_lanedir_consec": 0.6660504686850947, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 2.6883420152890776, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 2.436038708471386, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 2.3000000000000327, "deviation-heading": 2.1319112072972866, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.43521798585758786, "driven_lanedir_consec": 2.436038708471386, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.8248585908060764, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 1.2535112233305803, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 10.60000000000015, "deviation-heading": 1.7637546876533845, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.29788914521425613, "driven_lanedir_consec": 1.2535112233305803, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.8530493828909933, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 0.6463363841639935, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 15.200000000000152, "deviation-heading": 1.6909610342417762, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.4018426655624288, "driven_lanedir_consec": 0.6463363841639935, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.2473152676629047, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 1.856295107123529, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 6.35000000000009, "deviation-heading": 1.4343091479090504, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.2992954873997595, "driven_lanedir_consec": 1.856295107123529, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 2.9991511324006854, "get_ui_image": 0.029198673283942392, "step_physics": 0.1236694906359521, "survival_time": 26.700000000000244, "driven_lanedir": 2.181933881901564, "get_state_dump": 0.006117479823460089, "get_robot_state": 0.007157248202885423, "sim_render-ego0": 0.003766509082829841, "sim_render-ego1": 0.0036778302950279734, "get_duckie_state": 1.248689455406688e-06, "in-drivable-lane": 8.050000000000114, "deviation-heading": 2.408788199437072, "agent_compute-ego0": 0.037675070094170975, "agent_compute-ego1": 0.0371654871468232, "complete-iteration": 0.26491468688037906, "set_robot_commands": 0.002094090541946554, "deviation-center-line": 0.870719764940569, "driven_lanedir_consec": 2.181933881901564, "sim_compute_sim_state": 0.008408496535827066, "sim_compute_performance-ego0": 0.001944762969685492, "sim_compute_performance-ego1": 0.001848137935745382}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.5053630521888683, "get_ui_image": 0.029198673283942392, "step_physics": 0.1236694906359521, "survival_time": 26.700000000000244, "driven_lanedir": 0.6385354053562109, "get_state_dump": 0.006117479823460089, "get_robot_state": 0.007157248202885423, "sim_render-ego0": 0.003766509082829841, "sim_render-ego1": 0.0036778302950279734, "get_duckie_state": 1.248689455406688e-06, "in-drivable-lane": 22.050000000000253, "deviation-heading": 1.8214006956357336, "agent_compute-ego0": 0.037675070094170975, "agent_compute-ego1": 0.0371654871468232, "complete-iteration": 0.26491468688037906, "set_robot_commands": 0.002094090541946554, "deviation-center-line": 0.41541661203738567, "driven_lanedir_consec": 0.6385354053562109, "sim_compute_sim_state": 0.008408496535827066, "sim_compute_performance-ego0": 0.001944762969685492, "sim_compute_performance-ego1": 0.001848137935745382}}
set_robot_commands_max	0.0023771705966310454
set_robot_commands_mean	0.002255160188941889
set_robot_commands_median	0.002355409198337131
set_robot_commands_min	0.002094090541946554
sim_compute_performance-ego0_max	0.002252230789455666
sim_compute_performance-ego0_mean	0.0021280399194610047
sim_compute_performance-ego0_median	0.0022149409188164603
sim_compute_performance-ego0_min	0.001944762969685492
sim_compute_performance-ego1_max	0.0020387451055691327
sim_compute_performance-ego1_mean	0.0019459439654966931
sim_compute_performance-ego1_median	0.002000792821248372
sim_compute_performance-ego1_min	0.0018471969845482309
sim_compute_sim_state_max	0.03292341401734328
sim_compute_sim_state_mean	0.023621230428009
sim_compute_sim_state_median	0.030156453450520832
sim_compute_sim_state_min	0.008408496535827066
sim_render-ego0_max	0.004168548583984375
sim_render-ego0_mean	0.003989834569724421
sim_render-ego0_median	0.0041582735661927816
sim_render-ego0_min	0.0037543443024434
sim_render-ego1_max	0.00400056627061632
sim_render-ego1_mean	0.003850118868550274
sim_render-ego1_median	0.00398674834198153
sim_render-ego1_min	0.003649186279814122
simulation-passed	1
step_physics_max	0.6746942297617594
step_physics_mean	0.516120015011605
step_physics_median	0.5564923363584215
step_physics_min	0.1236694906359521
survival_time_max	32.4000000000003
survival_time_mean	25.100000000000215
survival_time_min	19.650000000000144

No reset possible

59027

12792

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFVmultibodyv-sim

success

yes

aido5-LFVI_multi-sim-validation

2020-12-04 18:25:44+00:00

2020-12-04 20:00:53+00:00

1:35:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.473467837984988
survival_time_median	59.99999999999873
deviation-center-line_median	3.102259236213401
in-drivable-lane_median	5.150000000000006

other stats

agent_compute-ego0_max	0.014387388487119932
agent_compute-ego0_mean	0.013359566699639096
agent_compute-ego0_median	0.013553423845797751
agent_compute-ego0_min	0.012407968284486237
agent_compute-ego1_max	0.014284776828019366
agent_compute-ego1_mean	0.013494309245780793
agent_compute-ego1_median	0.013786391949871994
agent_compute-ego1_min	0.012135063579537092
complete-iteration_max	1.2420102128862691
complete-iteration_mean	1.0353576275290035
complete-iteration_median	1.157199922151907
complete-iteration_min	0.5074327443097089
deviation-center-line_max	6.382123514300493
deviation-center-line_mean	2.7186293534837307
deviation-center-line_min	0.08249049450010255
deviation-heading_max	33.5414002574734
deviation-heading_mean	11.062085616378846
deviation-heading_median	10.635150955911026
deviation-heading_min	0.8810969047076987
driven_any_max	16.674867115266423
driven_any_mean	7.732733659830941
driven_any_median	7.269598890667819
driven_any_min	0.6455725053178668
driven_lanedir_consec_max	15.338966243641597
driven_lanedir_consec_mean	5.5963854038201815
driven_lanedir_consec_min	0.0867289967724445
driven_lanedir_max	15.338966243641597
driven_lanedir_mean	6.089188176807332
driven_lanedir_median	4.545709249857182
driven_lanedir_min	0.1045373479882219
get_duckie_state_max	1.9105705055030618e-06
get_duckie_state_mean	1.7012355290773662e-06
get_duckie_state_median	1.7729439041986928e-06
get_duckie_state_min	1.4237619061751926e-06
get_robot_state_max	0.01559989041432453
get_robot_state_mean	0.013977026196515622
get_robot_state_median	0.015277964422475927
get_robot_state_min	0.008019962826290646
get_state_dump_max	0.010210108286174451
get_state_dump_mean	0.00947738368029557
get_state_dump_median	0.010181461940895607
get_state_dump_min	0.007026292182303764
get_ui_image_max	0.05052066148932575
get_ui_image_mean	0.045054503316421766
get_ui_image_median	0.04969845246911347
get_ui_image_min	0.03447814567669018
in-drivable-lane_max	55.999999999998735
in-drivable-lane_mean	9.964285714285609
in-drivable-lane_min	0.30000000000000027
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 16.67459515562513, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 13.301119220569555, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 8.499999999999813, "deviation-heading": 16.145531009658406, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 3.957731338189476, "driven_lanedir_consec": 12.51929634793704, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 16.674867115266423, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 12.745887708461913, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 11.249999999999693, "deviation-heading": 14.4050200455332, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 3.4249074728415736, "driven_lanedir_consec": 12.745887708461913, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.1766455832772191, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 0.9423753708305256, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 55.999999999998735, "deviation-heading": 1.4761691987470416, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 0.34128729523482976, "driven_lanedir_consec": 0.9423753708305256, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 7.059920197211196, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 4.198062806478481, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 8.8, "deviation-heading": 33.5414002574734, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 6.382123514300493, "driven_lanedir_consec": 4.198062806478481, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 7.479277584124441, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 4.893355693235883, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 7.150000000000093, "deviation-heading": 7.646644820255594, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 1.728499262430977, "driven_lanedir_consec": 4.748872869491496, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.9591093111536857, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 1.219550796852962, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 1.6499999999999988, "deviation-heading": 4.752192370702666, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 2.779610999585228, "driven_lanedir_consec": 1.219550796852962, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.6455725053178668, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 0.1045373479882219, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 26.70000000000026, "deviation-heading": 1.040002795236692, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 0.08249049450010255, "driven_lanedir_consec": 0.0867289967724445, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.959167556805801, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 1.080346846763416, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 2.849999999999994, "deviation-heading": 3.777731256617123, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 1.5385249868974396, "driven_lanedir_consec": 1.080346846763416, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 13.195040146172389, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 10.496381491590778, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 6.749999999999989, "deviation-heading": 18.78078703716115, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 3.6768290598310145, "driven_lanedir_consec": 7.297747930978954, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.65742065055351, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 9.897554698448513, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 3.550000000000022, "deviation-heading": 20.811153987120395, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 4.355665880160116, "driven_lanedir_consec": 7.576497643348985, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 11.657577176537572, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 10.11572208855264, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 2.949999999999843, "deviation-heading": 13.62365709156646, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 5.101032904807404, "driven_lanedir_consec": 10.11572208855264, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 16.660463953551083, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 15.338966243641597, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 16.492475029957017, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 4.274562737428306, "driven_lanedir_consec": 15.338966243641597, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 0.7292998297775959, "get_ui_image": 0.03447814567669018, "step_physics": 0.4000845180975424, "survival_time": 3.649999999999995, "driven_lanedir": 0.401255794605804, "get_state_dump": 0.007026292182303764, "get_robot_state": 0.008019962826290646, "sim_render-ego0": 0.004381025159681165, "sim_render-ego1": 0.0044133663177490234, "get_duckie_state": 1.9105705055030618e-06, "in-drivable-lane": 1.5999999999999956, "deviation-heading": 0.8810969047076987, "agent_compute-ego0": 0.014387388487119932, "agent_compute-ego1": 0.014047700005608637, "complete-iteration": 0.5074327443097089, "set_robot_commands": 0.002711379850232923, "deviation-center-line": 0.17070156850554713, "driven_lanedir_consec": 0.1955285616296547, "sim_compute_sim_state": 0.010620281503007218, "sim_compute_performance-ego0": 0.00225503058046908, "sim_compute_performance-ego1": 0.0023378391523618956}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 0.7293144722592511, "get_ui_image": 0.03447814567669018, "step_physics": 0.4000845180975424, "survival_time": 3.649999999999995, "driven_lanedir": 0.5135183672823647, "get_state_dump": 0.007026292182303764, "get_robot_state": 0.008019962826290646, "sim_render-ego0": 0.004381025159681165, "sim_render-ego1": 0.0044133663177490234, "get_duckie_state": 1.9105705055030618e-06, "in-drivable-lane": 0.30000000000000027, "deviation-heading": 1.4953368245669745, "agent_compute-ego0": 0.014387388487119932, "agent_compute-ego1": 0.014047700005608637, "complete-iteration": 0.5074327443097089, "set_robot_commands": 0.002711379850232923, "deviation-center-line": 0.24684343405971995, "driven_lanedir_consec": 0.28381144174244644, "sim_compute_sim_state": 0.010620281503007218, "sim_compute_performance-ego0": 0.00225503058046908, "sim_compute_performance-ego1": 0.0023378391523618956}}
set_robot_commands_max	0.002711379850232923
set_robot_commands_mean	0.00243610179381759
set_robot_commands_median	0.0023798110780866816
set_robot_commands_min	0.002254549013784188
sim_compute_performance-ego0_max	0.0023440113671117776
sim_compute_performance-ego0_mean	0.002195654920991923
sim_compute_performance-ego0_median	0.0022129948306126484
sim_compute_performance-ego0_min	0.002000270735512765
sim_compute_performance-ego1_max	0.0023378391523618956
sim_compute_performance-ego1_mean	0.0021361626683496578
sim_compute_performance-ego1_median	0.0021823218737727222
sim_compute_performance-ego1_min	0.001917235162434828
sim_compute_sim_state_max	0.03759184804784567
sim_compute_sim_state_mean	0.024374192696204333
sim_compute_sim_state_median	0.023037100180689267
sim_compute_sim_state_min	0.010620281503007218
sim_render-ego0_max	0.004381025159681165
sim_render-ego0_mean	0.004156830173451221
sim_render-ego0_median	0.004232512227105261
sim_render-ego0_min	0.003824106362538969
sim_render-ego1_max	0.0044133663177490234
sim_render-ego1_mean	0.004261292572798468
sim_render-ego1_median	0.004323760238317129
sim_render-ego1_min	0.003985705125540321
simulation-passed	1
step_physics_max	1.0506754062762167
step_physics_mean	0.857139320820394
step_physics_median	0.9540307438443046
step_physics_min	0.4000845180975424
survival_time_max	59.99999999999873
survival_time_mean	42.74999999999935
survival_time_min	3.649999999999995

No reset possible

59002

12771

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFVIv-sim

success

yes

2020-12-04 18:00:14+00:00

2020-12-04 18:25:19+00:00

0:25:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.37426325650891
survival_time_median	14.025000000000064
deviation-center-line_median	0.8592875017104415
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.07245763259775498
agent_compute-ego0_mean	0.07046542329449856
agent_compute-ego0_median	0.07046542329449856
agent_compute-ego0_min	0.06847321399124214
agent_compute-ego1_max	0.05089265776322027
agent_compute-ego1_mean	0.04753485095120458
agent_compute-ego1_median	0.04753485095120458
agent_compute-ego1_min	0.04417704413918888
agent_compute-ego2_max	0.05520859427516236
agent_compute-ego2_mean	0.05376344198791938
agent_compute-ego2_median	0.05376344198791938
agent_compute-ego2_min	0.05231828970067641
agent_compute-ego3_max	0.05322014269807414
agent_compute-ego3_mean	0.050829532046772125
agent_compute-ego3_median	0.050829532046772125
agent_compute-ego3_min	0.04843892139547011
complete-iteration_max	1.7344178957097671
complete-iteration_mean	1.70066785258311
complete-iteration_median	1.70066785258311
complete-iteration_min	1.6669178094564532
deviation-center-line_max	1.8897093965926235
deviation-center-line_mean	0.947999853789872
deviation-center-line_min	0.5156198978120006
deviation-heading_max	5.3373499459132985
deviation-heading_mean	3.485271097567628
deviation-heading_median	3.3199815891104754
deviation-heading_min	2.2141833965834214
driven_any_max	6.852306051733557
driven_any_mean	2.8474597680564373
driven_any_median	2.911124247946466
driven_any_min	0.07852088040883592
driven_lanedir_consec_max	6.089293695663062
driven_lanedir_consec_mean	2.371882593741857
driven_lanedir_consec_min	0.07683731957692785
driven_lanedir_max	6.4390916402177085
driven_lanedir_mean	2.616871830644529
driven_lanedir_median	2.6795414815333105
driven_lanedir_min	0.07683731957692785
get_duckie_state_max	1.9641483531278723e-06
get_duckie_state_mean	1.926126218477298e-06
get_duckie_state_median	1.926126218477298e-06
get_duckie_state_min	1.8881040838267237e-06
get_robot_state_max	0.01587843681130174
get_robot_state_mean	0.01568658560538034
get_robot_state_median	0.01568658560538034
get_robot_state_min	0.01549473439945894
get_state_dump_max	0.01025293784983018
get_state_dump_mean	0.010205390863071422
get_state_dump_median	0.010205390863071422
get_state_dump_min	0.010157843876312666
get_ui_image_max	0.05764316977941402
get_ui_image_mean	0.057426138266634105
get_ui_image_median	0.057426138266634105
get_ui_image_min	0.05720910675385419
in-drivable-lane_max	2.9500000000000144
in-drivable-lane_mean	0.4937500000000026
in-drivable-lane_min	0.0
per-episodes	details {"LFVI_multi-norm-4way-000-ego0": {"driven_any": 4.01756092963324, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 3.882510373278359, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.350893197938481, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 0.5612397687338413, "driven_lanedir_consec": 3.2439126986847335, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.923072857769204, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 2.7832916635144405, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.936535384847721, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 1.0538458025245925, "driven_lanedir_consec": 2.3779213556222545, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 2.8991756381237277, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 2.8014859612358047, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.889032439267994, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 0.8323618528615205, "driven_lanedir_consec": 2.477837971920734, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 3.389804425218106, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 2.575791299552181, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 2.9500000000000144, "deviation-heading": 2.966802639828065, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 0.5156198978120006, "driven_lanedir_consec": 2.370605157395566, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 0.07852088040883592, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 0.07683731957692785, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.3373499459132985, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 0.8131645581161442, "driven_lanedir_consec": 0.07683731957692785, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 6.852306051733557, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 6.4390916402177085, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 3.673160538392886, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 0.8862131505593625, "driven_lanedir_consec": 6.089293695663062, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.8876668821898546, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 0.8502943029830949, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.2141833965834214, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 1.8897093965926235, "driven_lanedir_consec": 0.8315615534354952, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.7315704793749742, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 1.525672084797716, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 4.514211237769154, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 1.0318444031188905, "driven_lanedir_consec": 1.5070909976360798, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}}
set_robot_commands_max	0.002564865701338824
set_robot_commands_mean	0.0024821225318893596
set_robot_commands_median	0.0024821225318893596
set_robot_commands_min	0.0023993793624398955
sim_compute_performance-ego0_max	0.00232973120137715
sim_compute_performance-ego0_mean	0.002284052549016032
sim_compute_performance-ego0_median	0.002284052549016032
sim_compute_performance-ego0_min	0.0022383738966549145
sim_compute_performance-ego1_max	0.002197605612032082
sim_compute_performance-ego1_mean	0.0021795885854080594
sim_compute_performance-ego1_median	0.0021795885854080594
sim_compute_performance-ego1_min	0.002161571558784036
sim_compute_performance-ego2_max	0.0023586664499188753
sim_compute_performance-ego2_mean	0.0023091455777570023
sim_compute_performance-ego2_median	0.0023091455777570023
sim_compute_performance-ego2_min	0.0022596247055951288
sim_compute_performance-ego3_max	0.002204921748071508
sim_compute_performance-ego3_mean	0.002170845381158915
sim_compute_performance-ego3_median	0.002170845381158915
sim_compute_performance-ego3_min	0.0021367690142463235
sim_compute_sim_state_max	0.03880173956866756
sim_compute_sim_state_mean	0.02977210918003637
sim_compute_sim_state_median	0.02977210918003637
sim_compute_sim_state_min	0.020742478791405172
sim_render-ego0_max	0.004231377910165226
sim_render-ego0_mean	0.004229456224028965
sim_render-ego0_median	0.004229456224028965
sim_render-ego0_min	0.004227534537892705
sim_render-ego1_max	0.004080130773432115
sim_render-ego1_mean	0.004062155366289807
sim_render-ego1_median	0.004062155366289807
sim_render-ego1_min	0.0040441799591475
sim_render-ego2_max	0.00420908998040592
sim_render-ego2_mean	0.004185404080383635
sim_render-ego2_median	0.004185404080383635
sim_render-ego2_min	0.00416171818036135
sim_render-ego3_max	0.003976541784312159
sim_render-ego3_mean	0.003943405620531682
sim_render-ego3_median	0.003943405620531682
sim_render-ego3_min	0.003910269456751206
simulation-passed	1
step_physics_max	1.3771786240970387
step_physics_mean	1.3290117375110455
step_physics_median	1.3290117375110455
step_physics_min	1.280844850925052
survival_time_max	16.950000000000106
survival_time_mean	14.025000000000064
survival_time_min	11.100000000000025

No reset possible

58980

12816

Yishu Malhotra 🇨🇦

sim-exercise-2

aido5-LFVI-sim-testing

LFVIt-sim

success

yes

aido5-LFI-sim-validation

2020-12-04 17:40:55+00:00

2020-12-04 17:59:44+00:00

0:18:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.244797847221183
survival_time_median	15.82500000000009
deviation-center-line_median	0.916026237734522
in-drivable-lane_median	0.274999999999999

other stats

agent_compute-ego0_max	0.013712803522745768
agent_compute-ego0_mean	0.013366754645100648
agent_compute-ego0_median	0.013366754645100648
agent_compute-ego0_min	0.01302070576745553
agent_compute-npc0_max	0.051221739593429946
agent_compute-npc0_mean	0.04886061107264968
agent_compute-npc0_median	0.04886061107264968
agent_compute-npc0_min	0.046499482551869406
agent_compute-npc1_max	0.0449728835281448
agent_compute-npc1_mean	0.041282221610329295
agent_compute-npc1_median	0.041282221610329295
agent_compute-npc1_min	0.037591559692513786
agent_compute-npc2_max	0.044926343272574505
agent_compute-npc2_mean	0.039071854461105615
agent_compute-npc2_median	0.039071854461105615
agent_compute-npc2_min	0.033217365649636725
complete-iteration_max	1.308302015807498
complete-iteration_mean	1.2198824120690903
complete-iteration_median	1.2198824120690903
complete-iteration_min	1.1314628083306832
deviation-center-line_max	1.1057711044441143
deviation-center-line_mean	0.916026237734522
deviation-center-line_min	0.7262813710249294
deviation-heading_max	5.725693303638807
deviation-heading_mean	5.035242124334255
deviation-heading_median	5.035242124334255
deviation-heading_min	4.344790945029702
driven_any_max	3.625700170231009
driven_any_mean	2.8127184972025843
driven_any_median	2.8127184972025843
driven_any_min	1.999736824174159
driven_lanedir_consec_max	3.113330296396851
driven_lanedir_consec_mean	2.244797847221183
driven_lanedir_consec_min	1.3762653980455146
driven_lanedir_max	3.410624612560299
driven_lanedir_mean	2.5761271981271454
driven_lanedir_median	2.5761271981271454
driven_lanedir_min	1.7416297836939918
get_duckie_state_max	1.7899185863893424e-06
get_duckie_state_mean	1.68695920832175e-06
get_duckie_state_median	1.68695920832175e-06
get_duckie_state_min	1.5839998302541578e-06
get_robot_state_max	0.015627874070732156
get_robot_state_mean	0.015176092990602947
get_robot_state_median	0.015176092990602947
get_robot_state_min	0.014724311910473738
get_state_dump_max	0.010274664679569985
get_state_dump_mean	0.010117651899103306
get_state_dump_median	0.010117651899103306
get_state_dump_min	0.009960639118636629
get_ui_image_max	0.05601796344738102
get_ui_image_mean	0.05472579932575805
get_ui_image_median	0.05472579932575805
get_ui_image_min	0.05343363520413509
in-drivable-lane_max	0.549999999999998
in-drivable-lane_mean	0.274999999999999
in-drivable-lane_min	0.0
per-episodes	details {"LFVI-norm-4way-000-ego0": {"driven_any": 1.999736824174159, "get_ui_image": 0.05343363520413509, "step_physics": 0.8485166412566353, "survival_time": 11.60000000000003, "driven_lanedir": 1.7416297836939918, "get_state_dump": 0.009960639118636629, "get_robot_state": 0.014724311910473738, "sim_render-ego0": 0.004098349886390784, "sim_render-npc0": 0.0041741843898920545, "sim_render-npc1": 0.004069944308039457, "sim_render-npc2": 0.0040146762209388835, "get_duckie_state": 1.5839998302541578e-06, "in-drivable-lane": 0.549999999999998, "deviation-heading": 4.344790945029702, "agent_compute-ego0": 0.01302070576745553, "agent_compute-npc0": 0.046499482551869406, "agent_compute-npc1": 0.037591559692513786, "agent_compute-npc2": 0.033217365649636725, "complete-iteration": 1.1314628083306832, "set_robot_commands": 0.002390022441552944, "deviation-center-line": 0.7262813710249294, "driven_lanedir_consec": 1.3762653980455146, "sim_compute_sim_state": 0.039908000839626326, "sim_compute_performance-ego0": 0.002208267670332618, "sim_compute_performance-npc0": 0.0020517095475749395, "sim_compute_performance-npc1": 0.002098008798427336, "sim_compute_performance-npc2": 0.002101644425944709}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.625700170231009, "get_ui_image": 0.05601796344738102, "step_physics": 0.9876649842333438, "survival_time": 20.05000000000015, "driven_lanedir": 3.410624612560299, "get_state_dump": 0.010274664679569985, "get_robot_state": 0.015627874070732156, "sim_render-ego0": 0.004285273267262017, "sim_render-npc0": 0.004443872034253173, "sim_render-npc1": 0.004346401537235697, "sim_render-npc2": 0.004350191918178577, "get_duckie_state": 1.7899185863893424e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.725693303638807, "agent_compute-ego0": 0.013712803522745768, "agent_compute-npc0": 0.051221739593429946, "agent_compute-npc1": 0.0449728835281448, "agent_compute-npc2": 0.044926343272574505, "complete-iteration": 1.308302015807498, "set_robot_commands": 0.0025773321218158477, "deviation-center-line": 1.1057711044441143, "driven_lanedir_consec": 3.113330296396851, "sim_compute_sim_state": 0.046825581522130254, "sim_compute_performance-ego0": 0.0023426879104690174, "sim_compute_performance-npc0": 0.002232910388737769, "sim_compute_performance-npc1": 0.0022693771628004996, "sim_compute_performance-npc2": 0.0022775373648648237}}
set_robot_commands_max	0.0025773321218158477
set_robot_commands_mean	0.0024836772816843955
set_robot_commands_median	0.0024836772816843955
set_robot_commands_min	0.002390022441552944
sim_compute_performance-ego0_max	0.0023426879104690174
sim_compute_performance-ego0_mean	0.0022754777904008174
sim_compute_performance-ego0_median	0.0022754777904008174
sim_compute_performance-ego0_min	0.002208267670332618
sim_compute_performance-npc0_max	0.002232910388737769
sim_compute_performance-npc0_mean	0.002142309968156354
sim_compute_performance-npc0_median	0.002142309968156354
sim_compute_performance-npc0_min	0.0020517095475749395
sim_compute_performance-npc1_max	0.0022693771628004996
sim_compute_performance-npc1_mean	0.002183692980613918
sim_compute_performance-npc1_median	0.002183692980613918
sim_compute_performance-npc1_min	0.002098008798427336
sim_compute_performance-npc2_max	0.0022775373648648237
sim_compute_performance-npc2_mean	0.0021895908954047663
sim_compute_performance-npc2_median	0.0021895908954047663
sim_compute_performance-npc2_min	0.002101644425944709
sim_compute_sim_state_max	0.046825581522130254
sim_compute_sim_state_mean	0.043366791180878286
sim_compute_sim_state_median	0.043366791180878286
sim_compute_sim_state_min	0.039908000839626326
sim_render-ego0_max	0.004285273267262017
sim_render-ego0_mean	0.004191811576826401
sim_render-ego0_median	0.004191811576826401
sim_render-ego0_min	0.004098349886390784
sim_render-npc0_max	0.004443872034253173
sim_render-npc0_mean	0.004309028212072614
sim_render-npc0_median	0.004309028212072614
sim_render-npc0_min	0.0041741843898920545
sim_render-npc1_max	0.004346401537235697
sim_render-npc1_mean	0.004208172922637577
sim_render-npc1_median	0.004208172922637577
sim_render-npc1_min	0.004069944308039457
sim_render-npc2_max	0.004350191918178577
sim_render-npc2_mean	0.004182434069558731
sim_render-npc2_median	0.004182434069558731
sim_render-npc2_min	0.0040146762209388835
simulation-passed	1
step_physics_max	0.9876649842333438
step_physics_mean	0.9180908127449896
step_physics_median	0.9180908127449896
step_physics_min	0.8485166412566353
survival_time_max	20.05000000000015
survival_time_mean	15.82500000000009
survival_time_min	11.60000000000003

No reset possible

58968

12812

Yishu Malhotra 🇨🇦

sim-exercise-2

LFVIv-sim

success

yes

2020-12-04 17:25:23+00:00

2020-12-04 17:40:42+00:00

0:15:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.879839920755538
survival_time_median	38.4749999999995
deviation-center-line_median	2.651193687660204
in-drivable-lane_median	2.824999999999982

other stats

agent_compute-ego0_max	0.013794804278227126
agent_compute-ego0_mean	0.013590361324482271
agent_compute-ego0_median	0.013590361324482271
agent_compute-ego0_min	0.01338591837073742
complete-iteration_max	0.28709091281143867
complete-iteration_mean	0.28112437503487314
complete-iteration_median	0.28112437503487314
complete-iteration_min	0.2751578372583076
deviation-center-line_max	3.7375019500454822
deviation-center-line_mean	2.651193687660204
deviation-center-line_min	1.5648854252749256
deviation-heading_max	16.77281071775747
deviation-heading_mean	11.347528772888602
deviation-heading_median	11.347528772888602
deviation-heading_min	5.922246828019733
driven_any_max	11.429606136243816
driven_any_mean	7.237370504580571
driven_any_median	7.237370504580571
driven_any_min	3.045134872917327
driven_lanedir_consec_max	9.753630784981633
driven_lanedir_consec_mean	5.879839920755538
driven_lanedir_consec_min	2.0060490565294424
driven_lanedir_max	10.184761070548872
driven_lanedir_mean	6.364658187237648
driven_lanedir_median	6.364658187237648
driven_lanedir_min	2.5445553039264235
get_duckie_state_max	1.5992097381512115e-06
get_duckie_state_mean	1.5982453425945705e-06
get_duckie_state_median	1.5982453425945705e-06
get_duckie_state_min	1.597280947037929e-06
get_robot_state_max	0.004077126942767998
get_robot_state_mean	0.004025714164137006
get_robot_state_median	0.004025714164137006
get_robot_state_min	0.003974301385506015
get_state_dump_max	0.005270494080578107
get_state_dump_mean	0.005227460511604602
get_state_dump_median	0.005227460511604602
get_state_dump_min	0.005184426942631096
get_ui_image_max	0.04129390580666498
get_ui_image_mean	0.040855965295939295
get_ui_image_median	0.040855965295939295
get_ui_image_min	0.04041802478521362
in-drivable-lane_max	2.899999999999934
in-drivable-lane_mean	2.824999999999982
in-drivable-lane_min	2.7500000000000293
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 3.045134872917327, "get_ui_image": 0.04041802478521362, "step_physics": 0.2032996991907025, "survival_time": 19.100000000000136, "driven_lanedir": 2.5445553039264235, "get_state_dump": 0.005184426942631096, "get_robot_state": 0.003974301385506015, "sim_render-ego0": 0.004217058809245535, "get_duckie_state": 1.5992097381512115e-06, "in-drivable-lane": 2.7500000000000293, "deviation-heading": 5.922246828019733, "agent_compute-ego0": 0.01338591837073742, "complete-iteration": 0.28709091281143867, "set_robot_commands": 0.0023721440965139523, "deviation-center-line": 1.5648854252749256, "driven_lanedir_consec": 2.0060490565294424, "sim_compute_sim_state": 0.011916116385796052, "sim_compute_performance-ego0": 0.0022205036551771837}, "LFI-norm-udem1-000-ego0": {"driven_any": 11.429606136243816, "get_ui_image": 0.04129390580666498, "step_physics": 0.18717103671533455, "survival_time": 57.84999999999885, "driven_lanedir": 10.184761070548872, "get_state_dump": 0.005270494080578107, "get_robot_state": 0.004077126942767998, "sim_render-ego0": 0.004268853157913129, "get_duckie_state": 1.597280947037929e-06, "in-drivable-lane": 2.899999999999934, "deviation-heading": 16.77281071775747, "agent_compute-ego0": 0.013794804278227126, "complete-iteration": 0.2751578372583076, "set_robot_commands": 0.0024781344468111817, "deviation-center-line": 3.7375019500454822, "driven_lanedir_consec": 9.753630784981633, "sim_compute_sim_state": 0.014398832807063233, "sim_compute_performance-ego0": 0.00229903885737602}}
set_robot_commands_max	0.0024781344468111817
set_robot_commands_mean	0.002425139271662567
set_robot_commands_median	0.002425139271662567
set_robot_commands_min	0.0023721440965139523
sim_compute_performance-ego0_max	0.00229903885737602
sim_compute_performance-ego0_mean	0.0022597712562766018
sim_compute_performance-ego0_median	0.0022597712562766018
sim_compute_performance-ego0_min	0.0022205036551771837
sim_compute_sim_state_max	0.014398832807063233
sim_compute_sim_state_mean	0.013157474596429642
sim_compute_sim_state_median	0.013157474596429642
sim_compute_sim_state_min	0.011916116385796052
sim_render-ego0_max	0.004268853157913129
sim_render-ego0_mean	0.004242955983579332
sim_render-ego0_median	0.004242955983579332
sim_render-ego0_min	0.004217058809245535
simulation-passed	1
step_physics_max	0.2032996991907025
step_physics_mean	0.19523536795301857
step_physics_median	0.19523536795301857
step_physics_min	0.18717103671533455
survival_time_max	57.84999999999885
survival_time_mean	38.4749999999995
survival_time_min	19.100000000000136

No reset possible

58890

12848

aido5-LFV_multi-sim-testing

exercise_state_estimation

LFVmultibodyv-sim

success

yes

2020-12-04 15:31:59+00:00

2020-12-04 17:25:03+00:00

1:53:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	11.793491061002037
survival_time_median	59.99999999999873
deviation-center-line_median	2.832891030800841
in-drivable-lane_median	0.39999999999997726

other stats

agent_compute-ego0_max	0.01265458004560002
agent_compute-ego0_mean	0.012482446222335446
agent_compute-ego0_median	0.012562019441844425
agent_compute-ego0_min	0.012101759189551536
agent_compute-ego1_max	0.013603949208207795
agent_compute-ego1_mean	0.013428983425016937
agent_compute-ego1_median	0.013394974153504383
agent_compute-ego1_min	0.013230190388268972
complete-iteration_max	0.8536739325543228
complete-iteration_mean	0.7167808244573194
complete-iteration_median	0.7615731038419928
complete-iteration_min	0.31115600877537164
deviation-center-line_max	3.2219619150488223
deviation-center-line_mean	2.6841379364849316
deviation-center-line_min	1.470900002173385
deviation-heading_max	14.0581177238736
deviation-heading_mean	11.292188999663583
deviation-heading_median	11.570473009987378
deviation-heading_min	6.734227259330157
driven_any_max	13.15675454546058
driven_any_mean	11.976233511566637
driven_any_median	12.317259903620512
driven_any_min	9.605020699484449
driven_lanedir_consec_max	12.67169577979376
driven_lanedir_consec_mean	11.49087961772119
driven_lanedir_consec_min	9.189551847815316
driven_lanedir_max	12.67169577979376
driven_lanedir_mean	11.49087961772119
driven_lanedir_median	11.793491061002037
driven_lanedir_min	9.189551847815316
get_duckie_state_max	1.9883434540226894e-06
get_duckie_state_mean	1.8633825459082016e-06
get_duckie_state_median	1.8706230398618016e-06
get_duckie_state_min	1.6504063044574326e-06
get_robot_state_max	0.015876032728438176
get_robot_state_mean	0.014423203391496149
get_robot_state_median	0.015609581206462268
get_robot_state_min	0.007723593174066758
get_state_dump_max	0.010372359786402873
get_state_dump_mean	0.0096878273271955
get_state_dump_median	0.010327658387246875
get_state_dump_min	0.006613391184667397
get_ui_image_max	0.05320540097829801
get_ui_image_mean	0.04661870970133549
get_ui_image_median	0.04835869847090417
get_ui_image_min	0.0332816907935274
in-drivable-lane_max	17.999999999998977
in-drivable-lane_mean	2.107142857142744
in-drivable-lane_min	0.0
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.605020699484449, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.189551847815316, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 17.999999999998977, "deviation-heading": 6.734227259330157, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 1.470900002173385, "driven_lanedir_consec": 9.189551847815316, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 12.729893485875111, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.391834096800164, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.0335919919765, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.5491723741911403, "driven_lanedir_consec": 12.391834096800164, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 13.15675454546058, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.67169577979376, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 9.667137337377063, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.1142253492938843, "driven_lanedir_consec": 12.67169577979376, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.066989486085204, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.79623364235938, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.935090231739808, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.791749835640689, "driven_lanedir_consec": 9.79623364235938, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.761823474414404, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.404529564159846, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.900609269709186, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 2.901641841880598, "driven_lanedir_consec": 11.404529564159846, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.358442570695937, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.883958952039952, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.843112176195133, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.045032350778056, "driven_lanedir_consec": 11.883958952039952, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.758261731301484, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.053653688726538, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 1.54999999999995, "deviation-heading": 14.0581177238736, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.1799253068445967, "driven_lanedir_consec": 11.053653688726538, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 12.124884855342724, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.70302316996412, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.30770068006252, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.0233654414533175, "driven_lanedir_consec": 11.70302316996412, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 12.292330237289017, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 10.92939381711261, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 5.499999999999687, "deviation-heading": 11.240336750265568, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.6329031186280676, "driven_lanedir_consec": 10.92939381711261, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 12.555697899878016, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.079467342239806, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 11.933219922184197, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 3.2219619150488223, "driven_lanedir_consec": 12.079467342239806, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.34218956995201, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.059791441374523, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.480699278883648, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.7957626803214253, "driven_lanedir_consec": 12.059791441374523, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.579073254667296, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.028819150422938, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 1.1999999999999886, "deviation-heading": 11.909416689255572, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.8700193812802564, "driven_lanedir_consec": 12.028819150422938, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 13.08244984908215, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 12.64016487002798, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.823345842066242, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.940878034606406, "driven_lanedir_consec": 12.64016487002798, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.25345750240458, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 11.04019728525973, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 9.224040842370997, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.0403934786483973, "driven_lanedir_consec": 11.04019728525973, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}}
set_robot_commands_max	0.0024433360310220204
set_robot_commands_mean	0.002419093979328201
set_robot_commands_median	0.002418304065383543
set_robot_commands_min	0.0023841113472461302
sim_compute_performance-ego0_max	0.002496616131657863
sim_compute_performance-ego0_mean	0.002310194338511973
sim_compute_performance-ego0_median	0.002351885731273845
sim_compute_performance-ego0_min	0.002120696412789991
sim_compute_performance-ego1_max	0.0022743147279102537
sim_compute_performance-ego1_mean	0.0021654550030987016
sim_compute_performance-ego1_median	0.0021622482684133053
sim_compute_performance-ego1_min	0.002091392093058133
sim_compute_sim_state_max	0.05218466513361363
sim_compute_sim_state_mean	0.03749790352135485
sim_compute_sim_state_median	0.04655727240366304
sim_compute_sim_state_min	0.010699498025994552
sim_render-ego0_max	0.0042936708607542624
sim_render-ego0_mean	0.004207073430462971
sim_render-ego0_median	0.004245964315511305
sim_render-ego0_min	0.0040952278956235605
sim_render-ego1_max	0.004372762303666012
sim_render-ego1_mean	0.004260912781694478
sim_render-ego1_median	0.004260746267415602
sim_render-ego1_min	0.004180781747975219
simulation-passed	1
step_physics_max	0.6351948385929486
step_physics_mean	0.5276506219450541
step_physics_median	0.5551639452862005
step_physics_min	0.20965059419024856
survival_time_max	59.99999999999873
survival_time_mean	59.971428571427296
survival_time_min	59.79999999999874

No reset possible

58858

12843

exercise_state_estimation

aido5-LFV-sim-testing

LFVv-sim

success

yes

2020-12-04 14:50:29+00:00

2020-12-04 15:31:31+00:00

0:41:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.4549460701429
survival_time_median	13.600000000000067
deviation-center-line_median	0.6792106551046603
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.012950465626960252
agent_compute-ego0_mean	0.01248895950074756
agent_compute-ego0_median	0.01251617235197177
agent_compute-ego0_min	0.011973027672086444
agent_compute-npc0_max	0.028293682710967796
agent_compute-npc0_mean	0.024317688493637208
agent_compute-npc0_median	0.023306048183636824
agent_compute-npc0_min	0.02236497489630739
agent_compute-npc1_max	0.0338656593117912
agent_compute-npc1_mean	0.031233563632173517
agent_compute-npc1_median	0.03035596165343793
agent_compute-npc1_min	0.029479069931291423
agent_compute-npc2_max	0.03648021273369337
agent_compute-npc2_mean	0.033310485993477024
agent_compute-npc2_median	0.03432366550874565
agent_compute-npc2_min	0.029127579737992043
agent_compute-npc3_max	0.05068307549413974
agent_compute-npc3_mean	0.04729384797343568
agent_compute-npc3_median	0.04729384797343568
agent_compute-npc3_min	0.04390462045273163
complete-iteration_max	1.4626252459783624
complete-iteration_mean	1.0421628713186992
complete-iteration_median	1.154597839195421
complete-iteration_min	0.3968305609055928
deviation-center-line_max	2.133958036436802
deviation-center-line_mean	0.9118703937436404
deviation-center-line_min	0.15510222832843967
deviation-heading_max	8.312333671287861
deviation-heading_mean	3.716950081592371
deviation-heading_median	2.8403192807397155
deviation-heading_min	0.8748280936021909
driven_any_max	11.828492424318682
driven_any_mean	4.479934772810512
driven_any_median	2.5422845135611705
driven_any_min	1.0066776398010222
driven_lanedir_consec_max	11.558593051907078
driven_lanedir_consec_mean	4.365517176849893
driven_lanedir_consec_min	0.99358351520669
driven_lanedir_max	11.558593051907078
driven_lanedir_mean	4.365517176849893
driven_lanedir_median	2.4549460701429
driven_lanedir_min	0.99358351520669
get_duckie_state_max	1.9752196151844777e-06
get_duckie_state_mean	1.7168113237504423e-06
get_duckie_state_median	1.729692733947255e-06
get_duckie_state_min	1.4326402119227815e-06
get_robot_state_max	0.01960301747287277
get_robot_state_mean	0.015217497623318648
get_robot_state_median	0.016934936345501358
get_robot_state_min	0.007397100329399109
get_state_dump_max	0.012310057660959065
get_state_dump_mean	0.01011502250764512
get_state_dump_median	0.010909031392441955
get_state_dump_min	0.006331969584737506
get_ui_image_max	0.060677476172899675
get_ui_image_mean	0.04859007892855752
get_ui_image_median	0.050222456971865434
get_ui_image_min	0.033237925597599575
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 11.828492424318682, "get_ui_image": 0.046446462291110734, "step_physics": 0.6771285792372993, "survival_time": 49.299999999999336, "driven_lanedir": 11.558593051907078, "get_state_dump": 0.01011370767092874, "get_robot_state": 0.015557901716763727, "sim_render-ego0": 0.00419814946562082, "sim_render-npc0": 0.004358190895938583, "sim_render-npc1": 0.004224100856916279, "sim_render-npc2": 0.004166491488192944, "get_duckie_state": 1.7070963510747135e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.312333671287861, "agent_compute-ego0": 0.012788725237474374, "agent_compute-npc0": 0.02241821129633663, "agent_compute-npc1": 0.0338656593117912, "agent_compute-npc2": 0.03432366550874565, "complete-iteration": 0.925399368898726, "set_robot_commands": 0.0024501528541850948, "deviation-center-line": 2.133958036436802, "driven_lanedir_consec": 11.558593051907078, "sim_compute_sim_state": 0.03693454219698302, "sim_compute_performance-ego0": 0.002333190303443051, "sim_compute_performance-npc0": 0.0021382808202185044, "sim_compute_performance-npc1": 0.002209193076043868, "sim_compute_performance-npc2": 0.0021657332581710427}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.071014710236497, "get_ui_image": 0.060677476172899675, "step_physics": 1.0969702919034192, "survival_time": 6.799999999999984, "driven_lanedir": 0.99358351520669, "get_state_dump": 0.012310057660959065, "get_robot_state": 0.01960301747287277, "sim_render-ego0": 0.004403984459647297, "sim_render-npc0": 0.004423155401744982, "sim_render-npc1": 0.004364363468476456, "sim_render-npc2": 0.004326461875525704, "sim_render-npc3": 0.004121984008454928, "get_duckie_state": 1.9752196151844777e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.095380064104783, "agent_compute-ego0": 0.012950465626960252, "agent_compute-npc0": 0.028293682710967796, "agent_compute-npc1": 0.03035596165343793, "agent_compute-npc2": 0.03648021273369337, "agent_compute-npc3": 0.05068307549413974, "complete-iteration": 1.4626252459783624, "set_robot_commands": 0.002789398179437122, "deviation-center-line": 0.457152634137058, "driven_lanedir_consec": 0.99358351520669, "sim_compute_sim_state": 0.06815142005029386, "sim_compute_performance-ego0": 0.002360310867755082, "sim_compute_performance-npc0": 0.0022348905131764655, "sim_compute_performance-npc1": 0.002232114764025612, "sim_compute_performance-npc2": 0.0022569677255449504, "sim_compute_performance-npc3": 0.0021671900784012176}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.013554316885844, "get_ui_image": 0.05399845165262013, "step_physics": 1.065828330359424, "survival_time": 20.400000000000155, "driven_lanedir": 3.9153266141782455, "get_state_dump": 0.011704355113955171, "get_robot_state": 0.018311970974238985, "sim_render-ego0": 0.004119702831165715, "sim_render-npc0": 0.004157632370741268, "sim_render-npc1": 0.0040412252281580695, "sim_render-npc2": 0.004005781304282489, "sim_render-npc3": 0.004007830887960047, "get_duckie_state": 1.7522891168197969e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.585258497374648, "agent_compute-ego0": 0.012243619466469166, "agent_compute-npc0": 0.02236497489630739, "agent_compute-npc1": 0.029479069931291423, "agent_compute-npc2": 0.029127579737992043, "agent_compute-npc3": 0.04390462045273163, "complete-iteration": 1.383796309492116, "set_robot_commands": 0.002294025094701492, "deviation-center-line": 0.9012686760722626, "driven_lanedir_consec": 3.9153266141782455, "sim_compute_sim_state": 0.054287473263542343, "sim_compute_performance-ego0": 0.002196162720472714, "sim_compute_performance-npc0": 0.002044225380298269, "sim_compute_performance-npc1": 0.002033372380039803, "sim_compute_performance-npc2": 0.002040569823062216, "sim_compute_performance-npc3": 0.002040146615511048}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.0066776398010222, "get_ui_image": 0.033237925597599575, "step_physics": 0.2865377366542816, "survival_time": 5.549999999999988, "driven_lanedir": 0.9945655261075548, "get_state_dump": 0.006331969584737506, "get_robot_state": 0.007397100329399109, "sim_render-ego0": 0.003857372062546866, "sim_render-npc0": 0.004132317645209176, "get_duckie_state": 1.4326402119227815e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.8748280936021909, "agent_compute-ego0": 0.011973027672086444, "agent_compute-npc0": 0.024193885070937025, "complete-iteration": 0.3968305609055928, "set_robot_commands": 0.002376518079212734, "deviation-center-line": 0.15510222832843967, "driven_lanedir_consec": 0.9945655261075548, "sim_compute_sim_state": 0.010358382548604692, "sim_compute_performance-ego0": 0.0020252402339662823, "sim_compute_performance-npc0": 0.002008042165211269}}
set_robot_commands_max	0.002789398179437122
set_robot_commands_mean	0.0024775235518841106
set_robot_commands_median	0.0024133354666989143
set_robot_commands_min	0.002294025094701492
sim_compute_performance-ego0_max	0.002360310867755082
sim_compute_performance-ego0_mean	0.002228726031409282
sim_compute_performance-ego0_median	0.002264676511957882
sim_compute_performance-ego0_min	0.0020252402339662823
sim_compute_performance-npc0_max	0.0022348905131764655
sim_compute_performance-npc0_mean	0.002106359719726127
sim_compute_performance-npc0_median	0.002091253100258387
sim_compute_performance-npc0_min	0.002008042165211269
sim_compute_performance-npc1_max	0.002232114764025612
sim_compute_performance-npc1_mean	0.0021582267400364276
sim_compute_performance-npc1_median	0.002209193076043868
sim_compute_performance-npc1_min	0.002033372380039803
sim_compute_performance-npc2_max	0.0022569677255449504
sim_compute_performance-npc2_mean	0.002154423602259403
sim_compute_performance-npc2_median	0.0021657332581710427
sim_compute_performance-npc2_min	0.002040569823062216
sim_compute_performance-npc3_max	0.0021671900784012176
sim_compute_performance-npc3_mean	0.0021036683469561326
sim_compute_performance-npc3_median	0.0021036683469561326
sim_compute_performance-npc3_min	0.002040146615511048
sim_compute_sim_state_max	0.06815142005029386
sim_compute_sim_state_mean	0.04243295451485598
sim_compute_sim_state_median	0.04561100773026268
sim_compute_sim_state_min	0.010358382548604692
sim_render-ego0_max	0.004403984459647297
sim_render-ego0_mean	0.004144802204745175
sim_render-ego0_median	0.004158926148393267
sim_render-ego0_min	0.003857372062546866
sim_render-npc0_max	0.004423155401744982
sim_render-npc0_mean	0.004267824078408503
sim_render-npc0_median	0.004257911633339925
sim_render-npc0_min	0.004132317645209176
sim_render-npc1_max	0.004364363468476456
sim_render-npc1_mean	0.004209896517850268
sim_render-npc1_median	0.004224100856916279
sim_render-npc1_min	0.0040412252281580695
sim_render-npc2_max	0.004326461875525704
sim_render-npc2_mean	0.004166244889333713
sim_render-npc2_median	0.004166491488192944
sim_render-npc2_min	0.004005781304282489
sim_render-npc3_max	0.004121984008454928
sim_render-npc3_mean	0.004064907448207488
sim_render-npc3_median	0.004064907448207488
sim_render-npc3_min	0.004007830887960047
simulation-passed	1
step_physics_max	1.0969702919034192
step_physics_mean	0.781616234538606
step_physics_median	0.8714784547983616
step_physics_min	0.2865377366542816
survival_time_max	49.299999999999336
survival_time_mean	20.512499999999868
survival_time_min	5.549999999999988

No reset possible

58831

12874

aido5-LFVI-sim-validation

sim-exercise-2

LFVIv-sim

success

yes

2020-12-04 14:10:55+00:00

2020-12-04 14:50:13+00:00

0:39:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	9.355654379514442
survival_time_median	37.24999999999946
deviation-center-line_median	1.5988195518496573
in-drivable-lane_median	2.3749999999999583

other stats

agent_compute-ego0_max	0.012994239204808286
agent_compute-ego0_mean	0.012889533484944413
agent_compute-ego0_median	0.012889533484944413
agent_compute-ego0_min	0.01278482776508054
agent_compute-npc0_max	0.04430883291748673
agent_compute-npc0_mean	0.04410334009525955
agent_compute-npc0_median	0.04410334009525955
agent_compute-npc0_min	0.04389784727303237
agent_compute-npc1_max	0.0449859600377144
agent_compute-npc1_mean	0.04446018770309361
agent_compute-npc1_median	0.04446018770309361
agent_compute-npc1_min	0.043934415368472826
agent_compute-npc2_max	0.04415232447908922
agent_compute-npc2_mean	0.04022835784229229
agent_compute-npc2_median	0.04022835784229229
agent_compute-npc2_min	0.036304391205495355
complete-iteration_max	1.2293093359507274
complete-iteration_mean	1.1520922521532344
complete-iteration_median	1.1520922521532344
complete-iteration_min	1.0748751683557412
deviation-center-line_max	2.4736770036450277
deviation-center-line_mean	1.5988195518496573
deviation-center-line_min	0.723962100054287
deviation-heading_max	9.283157806622578
deviation-heading_mean	5.839468735176641
deviation-heading_median	5.839468735176641
deviation-heading_min	2.395779663730703
driven_any_max	17.95988966815339
driven_any_mean	10.766802727164508
driven_any_median	10.766802727164508
driven_any_min	3.5737157861756232
driven_lanedir_consec_max	15.952273258657945
driven_lanedir_consec_mean	9.355654379514442
driven_lanedir_consec_min	2.7590355003709415
driven_lanedir_max	17.314204333713832
driven_lanedir_mean	10.036619917042389
driven_lanedir_median	10.036619917042389
driven_lanedir_min	2.7590355003709415
get_duckie_state_max	1.5626381794365567e-06
get_duckie_state_mean	1.4911701286943162e-06
get_duckie_state_median	1.4911701286943162e-06
get_duckie_state_min	1.4197020779520758e-06
get_robot_state_max	0.015100859267054696
get_robot_state_mean	0.014969264868026612
get_robot_state_median	0.014969264868026612
get_robot_state_min	0.014837670468998526
get_state_dump_max	0.00987398292258059
get_state_dump_mean	0.00975291684243109
get_state_dump_median	0.00975291684243109
get_state_dump_min	0.00963185076228159
get_ui_image_max	0.05458256408526063
get_ui_image_mean	0.05383726920039486
get_ui_image_median	0.05383726920039486
get_ui_image_min	0.053091974315529096
in-drivable-lane_max	3.4999999999999876
in-drivable-lane_mean	2.3749999999999583
in-drivable-lane_min	1.249999999999929
per-episodes	details {"LFVI-norm-4way-000-ego0": {"driven_any": 17.95988966815339, "get_ui_image": 0.053091974315529096, "step_physics": 0.7745589298300503, "survival_time": 58.39999999999882, "driven_lanedir": 17.314204333713832, "get_state_dump": 0.00963185076228159, "get_robot_state": 0.014837670468998526, "sim_render-ego0": 0.004039574526027291, "sim_render-npc0": 0.004154659928777873, "sim_render-npc1": 0.004060723008611857, "sim_render-npc2": 0.004036729411246738, "get_duckie_state": 1.4197020779520758e-06, "in-drivable-lane": 1.249999999999929, "deviation-heading": 9.283157806622578, "agent_compute-ego0": 0.01278482776508054, "agent_compute-npc0": 0.04430883291748673, "agent_compute-npc1": 0.0449859600377144, "agent_compute-npc2": 0.04415232447908922, "complete-iteration": 1.0748751683557412, "set_robot_commands": 0.0024337999019182267, "deviation-center-line": 2.4736770036450277, "driven_lanedir_consec": 15.952273258657945, "sim_compute_sim_state": 0.04190980888412384, "sim_compute_performance-ego0": 0.0022119250024252206, "sim_compute_performance-npc0": 0.0020762065009646584, "sim_compute_performance-npc1": 0.002107020827620533, "sim_compute_performance-npc2": 0.002117258753911158}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.5737157861756232, "get_ui_image": 0.05458256408526063, "step_physics": 0.933612721623282, "survival_time": 16.100000000000094, "driven_lanedir": 2.7590355003709415, "get_state_dump": 0.00987398292258059, "get_robot_state": 0.015100859267054696, "sim_render-ego0": 0.004075734607944547, "sim_render-npc0": 0.004283036240852285, "sim_render-npc1": 0.004197003302559395, "sim_render-npc2": 0.004137112998371892, "get_duckie_state": 1.5626381794365567e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 2.395779663730703, "agent_compute-ego0": 0.012994239204808286, "agent_compute-npc0": 0.04389784727303237, "agent_compute-npc1": 0.043934415368472826, "agent_compute-npc2": 0.036304391205495355, "complete-iteration": 1.2293093359507274, "set_robot_commands": 0.002540093826435668, "deviation-center-line": 0.723962100054287, "driven_lanedir_consec": 2.7590355003709415, "sim_compute_sim_state": 0.04350428389321909, "sim_compute_performance-ego0": 0.0022444053331026723, "sim_compute_performance-npc0": 0.002108749590421978, "sim_compute_performance-npc1": 0.0021575737294766925, "sim_compute_performance-npc2": 0.002208418890418652}}
set_robot_commands_max	0.002540093826435668
set_robot_commands_mean	0.0024869468641769473
set_robot_commands_median	0.0024869468641769473
set_robot_commands_min	0.0024337999019182267
sim_compute_performance-ego0_max	0.0022444053331026723
sim_compute_performance-ego0_mean	0.0022281651677639467
sim_compute_performance-ego0_median	0.0022281651677639467
sim_compute_performance-ego0_min	0.0022119250024252206
sim_compute_performance-npc0_max	0.002108749590421978
sim_compute_performance-npc0_mean	0.002092478045693318
sim_compute_performance-npc0_median	0.002092478045693318
sim_compute_performance-npc0_min	0.0020762065009646584
sim_compute_performance-npc1_max	0.0021575737294766925
sim_compute_performance-npc1_mean	0.002132297278548613
sim_compute_performance-npc1_median	0.002132297278548613
sim_compute_performance-npc1_min	0.002107020827620533
sim_compute_performance-npc2_max	0.002208418890418652
sim_compute_performance-npc2_mean	0.002162838822164905
sim_compute_performance-npc2_median	0.002162838822164905
sim_compute_performance-npc2_min	0.002117258753911158
sim_compute_sim_state_max	0.04350428389321909
sim_compute_sim_state_mean	0.04270704638867147
sim_compute_sim_state_median	0.04270704638867147
sim_compute_sim_state_min	0.04190980888412384
sim_render-ego0_max	0.004075734607944547
sim_render-ego0_mean	0.004057654566985919
sim_render-ego0_median	0.004057654566985919
sim_render-ego0_min	0.004039574526027291
sim_render-npc0_max	0.004283036240852285
sim_render-npc0_mean	0.004218848084815079
sim_render-npc0_median	0.004218848084815079
sim_render-npc0_min	0.004154659928777873
sim_render-npc1_max	0.004197003302559395
sim_render-npc1_mean	0.004128863155585626
sim_render-npc1_median	0.004128863155585626
sim_render-npc1_min	0.004060723008611857
sim_render-npc2_max	0.004137112998371892
sim_render-npc2_mean	0.004086921204809316
sim_render-npc2_median	0.004086921204809316
sim_render-npc2_min	0.004036729411246738
simulation-passed	1
step_physics_max	0.933612721623282
step_physics_mean	0.8540858257266661
step_physics_median	0.8540858257266661
step_physics_min	0.7745589298300503
survival_time_max	58.39999999999882
survival_time_mean	37.24999999999946
survival_time_min	16.100000000000094

No reset possible

58822

12841

exercise_state_estimation

aido5-LFP-sim-testing

LFP-sim

success

yes

2020-12-04 13:56:20+00:00

2020-12-04 14:10:34+00:00

0:14:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.8846654603782507
survival_time_median	16.950000000000127
deviation-center-line_median	0.7717239311801183
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.01367514518501319
agent_compute-ego0_mean	0.013092819661081103
agent_compute-ego0_median	0.013050135917830883
agent_compute-ego0_min	0.012595861623649462
complete-iteration_max	0.30998887829057153
complete-iteration_mean	0.2739040445225345
complete-iteration_median	0.2836281623449988
complete-iteration_min	0.2183709751095688
deviation-center-line_max	1.4873629692195598
deviation-center-line_mean	0.7887785974173877
deviation-center-line_min	0.12430355808975406
deviation-heading_max	6.864919866523777
deviation-heading_mean	3.751650973358172
deviation-heading_median	3.620220090731565
deviation-heading_min	0.9012438454457804
driven_any_max	5.9777793204937915
driven_any_mean	3.071397996002476
driven_any_median	2.975316750155098
driven_any_min	0.3571791632059191
driven_lanedir_consec_max	5.763857547021798
driven_lanedir_consec_mean	2.967831159571064
driven_lanedir_consec_min	0.33813617050595446
driven_lanedir_max	5.763857547021798
driven_lanedir_mean	2.967831159571064
driven_lanedir_median	2.8846654603782507
driven_lanedir_min	0.33813617050595446
get_duckie_state_max	0.02738405466079712
get_duckie_state_mean	0.01980774300262412
get_duckie_state_median	0.02363212123496129
get_duckie_state_min	0.0045826748797768045
get_robot_state_max	0.004452726385916232
get_robot_state_mean	0.004182567780491376
get_robot_state_median	0.0041190437057562045
get_robot_state_min	0.004039457324536866
get_state_dump_max	0.009636529286702474
get_state_dump_mean	0.00833706743521469
get_state_dump_median	0.008896670062350145
get_state_dump_min	0.0059184003294559945
get_ui_image_max	0.04401611970649458
get_ui_image_mean	0.03729949307282544
get_ui_image_median	0.03730050912313383
get_ui_image_min	0.030580834338539524
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 0.3571791632059191, "get_ui_image": 0.03542192776997884, "step_physics": 0.18321621417999268, "survival_time": 2.9499999999999975, "driven_lanedir": 0.33813617050595446, "get_state_dump": 0.009636529286702474, "get_robot_state": 0.00413295030593872, "sim_render-ego0": 0.0042571504910786945, "get_duckie_state": 0.02738405466079712, "in-drivable-lane": 0.0, "deviation-heading": 0.9012438454457804, "agent_compute-ego0": 0.012946840127309164, "complete-iteration": 0.28856370051701863, "set_robot_commands": 0.0025008042653401692, "deviation-center-line": 0.12430355808975406, "driven_lanedir_consec": 0.33813617050595446, "sim_compute_sim_state": 0.00681538979212443, "sim_compute_performance-ego0": 0.0021509250005086263}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.9777793204937915, "get_ui_image": 0.04401611970649458, "step_physics": 0.18657799996131785, "survival_time": 30.6000000000003, "driven_lanedir": 5.763857547021798, "get_state_dump": 0.00925388460641584, "get_robot_state": 0.004452726385916232, "sim_render-ego0": 0.004584344720762666, "get_duckie_state": 0.02448153340213645, "in-drivable-lane": 0.0, "deviation-heading": 6.864919866523777, "agent_compute-ego0": 0.01367514518501319, "complete-iteration": 0.30998887829057153, "set_robot_commands": 0.002635128151923175, "deviation-center-line": 1.4873629692195598, "driven_lanedir_consec": 5.763857547021798, "sim_compute_sim_state": 0.01772516508864734, "sim_compute_performance-ego0": 0.0024708278027483145}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.046609439702182, "get_ui_image": 0.039179090476288814, "step_physics": 0.16876094290729968, "survival_time": 28.250000000000263, "driven_lanedir": 4.882564619691772, "get_state_dump": 0.008539455518284451, "get_robot_state": 0.004039457324536866, "sim_render-ego0": 0.004121984272879341, "get_duckie_state": 0.02278270906778612, "in-drivable-lane": 0.0, "deviation-heading": 6.069977923236526, "agent_compute-ego0": 0.012595861623649462, "complete-iteration": 0.278692624172979, "set_robot_commands": 0.002409130018928447, "deviation-center-line": 1.3511808744564784, "driven_lanedir_consec": 4.882564619691772, "sim_compute_sim_state": 0.013973030942910133, "sim_compute_performance-ego0": 0.002195035189706108}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.9040240606080132, "get_ui_image": 0.030580834338539524, "step_physics": 0.14451779817280017, "survival_time": 5.649999999999988, "driven_lanedir": 0.8867663010647296, "get_state_dump": 0.0059184003294559945, "get_robot_state": 0.004105137105573688, "sim_render-ego0": 0.004129748595388312, "get_duckie_state": 0.0045826748797768045, "in-drivable-lane": 0.0, "deviation-heading": 1.1704622582266049, "agent_compute-ego0": 0.013153431708352608, "complete-iteration": 0.2183709751095688, "set_robot_commands": 0.00241273327877647, "deviation-center-line": 0.19226698790375824, "driven_lanedir_consec": 0.8867663010647296, "sim_compute_sim_state": 0.006732622782389323, "sim_compute_performance-ego0": 0.0021467146120573346}}
set_robot_commands_max	0.002635128151923175
set_robot_commands_mean	0.0024894489287420655
set_robot_commands_median	0.00245676877205832
set_robot_commands_min	0.002409130018928447
sim_compute_performance-ego0_max	0.0024708278027483145
sim_compute_performance-ego0_mean	0.0022408756512550957
sim_compute_performance-ego0_median	0.002172980095107367
sim_compute_performance-ego0_min	0.0021467146120573346
sim_compute_sim_state_max	0.01772516508864734
sim_compute_sim_state_mean	0.011311552151517806
sim_compute_sim_state_median	0.01039421036751728
sim_compute_sim_state_min	0.006732622782389323
sim_render-ego0_max	0.004584344720762666
sim_render-ego0_mean	0.004273307020027254
sim_render-ego0_median	0.0041934495432335035
sim_render-ego0_min	0.004121984272879341
simulation-passed	1
step_physics_max	0.18657799996131785
step_physics_mean	0.1707682388053526
step_physics_median	0.1759885785436462
step_physics_min	0.14451779817280017
survival_time_max	30.6000000000003
survival_time_mean	16.86250000000014
survival_time_min	2.9499999999999975

No reset possible

58803

12872

aido5-LFV-sim-validation

sim-exercise-2

LFVv-sim

success

yes

2020-12-04 13:18:56+00:00

2020-12-04 13:55:58+00:00

0:37:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.771276324515667
survival_time_median	17.17500000000011
deviation-center-line_median	0.9356682929172696
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.01361848675785735
agent_compute-ego0_mean	0.013310504640101231
agent_compute-ego0_median	0.013401148574838498
agent_compute-ego0_min	0.01282123465287058
agent_compute-npc0_max	0.030628917065072567
agent_compute-npc0_mean	0.02476997782770527
agent_compute-npc0_median	0.023035933258193912
agent_compute-npc0_min	0.022379127729360695
agent_compute-npc1_max	0.03138450564295533
agent_compute-npc1_mean	0.030476337877106702
agent_compute-npc1_median	0.030991511603894704
agent_compute-npc1_min	0.029052996384470085
agent_compute-npc2_max	0.03806945442003453
agent_compute-npc2_mean	0.030882097911425353
agent_compute-npc2_median	0.028250752165675543
agent_compute-npc2_min	0.02632608714856599
agent_compute-npc3_max	0.04604419504110806
agent_compute-npc3_mean	0.03899682143685877
agent_compute-npc3_median	0.03899682143685877
agent_compute-npc3_min	0.03194944783260948
complete-iteration_max	1.3592382543764936
complete-iteration_mean	0.9906751821464028
complete-iteration_median	1.1186078061144007
complete-iteration_min	0.3662468619803165
deviation-center-line_max	1.4463327823681624
deviation-center-line_mean	1.009594731951163
deviation-center-line_min	0.7207095596019495
deviation-heading_max	6.004327449675906
deviation-heading_mean	3.987247956559663
deviation-heading_median	3.333422017628235
deviation-heading_min	3.277820341306275
driven_any_max	5.227685548881521
driven_any_mean	4.13848452842385
driven_any_median	3.88147666909527
driven_any_min	3.5632992266233368
driven_lanedir_consec_max	4.908643126453767
driven_lanedir_consec_mean	3.9757497829816746
driven_lanedir_consec_min	3.4518033564415953
driven_lanedir_max	4.908643126453767
driven_lanedir_mean	3.9757497829816746
driven_lanedir_median	3.771276324515667
driven_lanedir_min	3.4518033564415953
get_duckie_state_max	1.8310546875e-06
get_duckie_state_mean	1.7042839023606012e-06
get_duckie_state_median	1.694376307015968e-06
get_duckie_state_min	1.5973283079104683e-06
get_robot_state_max	0.019513979506568788
get_robot_state_mean	0.01529363511099954
get_robot_state_median	0.01687861109530387
get_robot_state_min	0.007903338746821626
get_state_dump_max	0.012036655657588484
get_state_dump_mean	0.010003149229092036
get_state_dump_median	0.010680094511703824
get_state_dump_min	0.006615752235372016
get_ui_image_max	0.06051780164432221
get_ui_image_mean	0.05034646926441508
get_ui_image_median	0.05259570672762618
get_ui_image_min	0.03567666195808573
in-drivable-lane_max	1.1500000000000163
in-drivable-lane_mean	0.2875000000000041
in-drivable-lane_min	0.0
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 3.904095341060964, "get_ui_image": 0.04928863623517886, "step_physics": 0.7341162782773327, "survival_time": 15.500000000000083, "driven_lanedir": 3.783704181075364, "get_state_dump": 0.010087391187907031, "get_robot_state": 0.015406881497987211, "sim_render-ego0": 0.004148385149106335, "sim_render-npc0": 0.00417778039668534, "sim_render-npc1": 0.004192453488659629, "sim_render-npc2": 0.004330489413147954, "get_duckie_state": 1.776256745267911e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.277820341306275, "agent_compute-ego0": 0.013482850464210633, "agent_compute-npc0": 0.022379127729360695, "agent_compute-npc1": 0.03138450564295533, "agent_compute-npc2": 0.03806945442003453, "complete-iteration": 0.9768128349083413, "set_robot_commands": 0.002461438776979109, "deviation-center-line": 0.913975976140524, "driven_lanedir_consec": 3.783704181075364, "sim_compute_sim_state": 0.026533428112410273, "sim_compute_performance-ego0": 0.0022876515649139307, "sim_compute_performance-npc0": 0.0021396948210296142, "sim_compute_performance-npc1": 0.002317847929583485, "sim_compute_performance-npc2": 0.002202203419430846}, "LFV-norm-zigzag-000-ego0": {"driven_any": 5.227685548881521, "get_ui_image": 0.0559027772200735, "step_physics": 0.9497900485992432, "survival_time": 23.7000000000002, "driven_lanedir": 4.908643126453767, "get_state_dump": 0.011272797835500616, "get_robot_state": 0.01835034069262053, "sim_render-ego0": 0.004032984783774928, "sim_render-npc0": 0.004127956189607319, "sim_render-npc1": 0.004077537938168174, "sim_render-npc2": 0.004003921809949373, "sim_render-npc3": 0.0040350698169909025, "get_duckie_state": 1.8310546875e-06, "in-drivable-lane": 1.1500000000000163, "deviation-heading": 6.004327449675906, "agent_compute-ego0": 0.01282123465287058, "agent_compute-npc0": 0.02248320228175113, "agent_compute-npc1": 0.029052996384470085, "agent_compute-npc2": 0.02632608714856599, "agent_compute-npc3": 0.03194944783260948, "complete-iteration": 1.2604027773204602, "set_robot_commands": 0.0023914929440147, "deviation-center-line": 1.4463327823681624, "driven_lanedir_consec": 4.908643126453767, "sim_compute_sim_state": 0.05951244555021587, "sim_compute_performance-ego0": 0.002346969905652498, "sim_compute_performance-npc0": 0.002009155875758121, "sim_compute_performance-npc1": 0.0020781160655774567, "sim_compute_performance-npc2": 0.002078621512965152, "sim_compute_performance-npc3": 0.0020350114922774464}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.5632992266233368, "get_ui_image": 0.06051780164432221, "step_physics": 1.016922901994504, "survival_time": 15.600000000000088, "driven_lanedir": 3.4518033564415953, "get_state_dump": 0.012036655657588484, "get_robot_state": 0.019513979506568788, "sim_render-ego0": 0.004335622817944414, "sim_render-npc0": 0.0043256709369988485, "sim_render-npc1": 0.00440819423419599, "sim_render-npc2": 0.00420073122262193, "sim_render-npc3": 0.004199985498056625, "get_duckie_state": 1.5973283079104683e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.2810291719235924, "agent_compute-ego0": 0.01361848675785735, "agent_compute-npc0": 0.02358866423463669, "agent_compute-npc1": 0.030991511603894704, "agent_compute-npc2": 0.028250752165675543, "agent_compute-npc3": 0.04604419504110806, "complete-iteration": 1.3592382543764936, "set_robot_commands": 0.0026027843975030577, "deviation-center-line": 0.7207095596019495, "driven_lanedir_consec": 3.4518033564415953, "sim_compute_sim_state": 0.06177321028785584, "sim_compute_performance-ego0": 0.002424144897217187, "sim_compute_performance-npc0": 0.002194781653797284, "sim_compute_performance-npc1": 0.0023079466895935255, "sim_compute_performance-npc2": 0.0022457278193757178, "sim_compute_performance-npc3": 0.0022669508815192567}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.858857997129576, "get_ui_image": 0.03567666195808573, "step_physics": 0.24280392109079563, "survival_time": 18.75000000000013, "driven_lanedir": 3.7588484679559704, "get_state_dump": 0.006615752235372016, "get_robot_state": 0.007903338746821626, "sim_render-ego0": 0.0041442963671176995, "sim_render-npc0": 0.00430888571637742, "get_duckie_state": 1.612495868764025e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.385814863332879, "agent_compute-ego0": 0.01331944668546636, "agent_compute-npc0": 0.030628917065072567, "complete-iteration": 0.3662468619803165, "set_robot_commands": 0.0026048415518821555, "deviation-center-line": 0.9573606096940152, "driven_lanedir_consec": 3.7588484679559704, "sim_compute_sim_state": 0.011253904154960146, "sim_compute_performance-ego0": 0.0022420990974345105, "sim_compute_performance-npc0": 0.0021374878731179746}}
set_robot_commands_max	0.0026048415518821555
set_robot_commands_mean	0.0025151394175947552
set_robot_commands_median	0.002532111587241083
set_robot_commands_min	0.0023914929440147
sim_compute_performance-ego0_max	0.002424144897217187
sim_compute_performance-ego0_mean	0.0023252163663045316
sim_compute_performance-ego0_median	0.002317310735283214
sim_compute_performance-ego0_min	0.0022420990974345105
sim_compute_performance-npc0_max	0.002194781653797284
sim_compute_performance-npc0_mean	0.0021202800559257484
sim_compute_performance-npc0_median	0.002138591347073794
sim_compute_performance-npc0_min	0.002009155875758121
sim_compute_performance-npc1_max	0.002317847929583485
sim_compute_performance-npc1_mean	0.0022346368949181556
sim_compute_performance-npc1_median	0.0023079466895935255
sim_compute_performance-npc1_min	0.0020781160655774567
sim_compute_performance-npc2_max	0.0022457278193757178
sim_compute_performance-npc2_mean	0.0021755175839239054
sim_compute_performance-npc2_median	0.002202203419430846
sim_compute_performance-npc2_min	0.002078621512965152
sim_compute_performance-npc3_max	0.0022669508815192567
sim_compute_performance-npc3_mean	0.0021509811868983516
sim_compute_performance-npc3_median	0.0021509811868983516
sim_compute_performance-npc3_min	0.0020350114922774464
sim_compute_sim_state_max	0.06177321028785584
sim_compute_sim_state_mean	0.03976824702636053
sim_compute_sim_state_median	0.04302293683131307
sim_compute_sim_state_min	0.011253904154960146
sim_render-ego0_max	0.004335622817944414
sim_render-ego0_mean	0.004165322279485844
sim_render-ego0_median	0.004146340758112018
sim_render-ego0_min	0.004032984783774928
sim_render-npc0_max	0.0043256709369988485
sim_render-npc0_mean	0.004235073309917232
sim_render-npc0_median	0.0042433330565313804
sim_render-npc0_min	0.004127956189607319
sim_render-npc1_max	0.00440819423419599
sim_render-npc1_mean	0.004226061887007931
sim_render-npc1_median	0.004192453488659629
sim_render-npc1_min	0.004077537938168174
sim_render-npc2_max	0.004330489413147954
sim_render-npc2_mean	0.004178380815239752
sim_render-npc2_median	0.00420073122262193
sim_render-npc2_min	0.004003921809949373
sim_render-npc3_max	0.004199985498056625
sim_render-npc3_mean	0.004117527657523764
sim_render-npc3_median	0.004117527657523764
sim_render-npc3_min	0.0040350698169909025
simulation-passed	1
step_physics_max	1.016922901994504
step_physics_mean	0.735908287490469
step_physics_median	0.841953163438288
step_physics_min	0.24280392109079563
survival_time_max	23.7000000000002
survival_time_mean	18.387500000000124
survival_time_min	15.500000000000083

No reset possible

58793

12775

Thomas Wiggers 🇳🇱

ppo_v1

aido5-LF-sim-testing

LFt-sim

success

yes

aido5-LFP-sim-validation

2020-12-04 13:02:25+00:00

2020-12-04 13:18:34+00:00

0:16:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8091968051150191
survival_time_median	24.77500000000022
deviation-center-line_median	0.8004147069678376
in-drivable-lane_median	8.250000000000117

other stats

agent_compute-ego0_max	0.09344273079805268
agent_compute-ego0_mean	0.08351057105432441
agent_compute-ego0_median	0.09197522714831773
agent_compute-ego0_min	0.05664909912260952
complete-iteration_max	0.2684615816086729
complete-iteration_mean	0.24602651452170027
complete-iteration_median	0.24156658067670717
complete-iteration_min	0.23251131512471385
deviation-center-line_max	0.9702136282486312
deviation-center-line_mean	0.7390720339398957
deviation-center-line_min	0.3852450935752763
deviation-heading_max	4.19560090973135
deviation-heading_mean	2.5854715210270713
deviation-heading_median	2.358852092046509
deviation-heading_min	1.4285809902839186
driven_any_max	3.106810362690964
driven_any_mean	2.75966198838233
driven_any_median	2.9907977896137736
driven_any_min	1.9502420116108108
driven_lanedir_consec_max	2.2528060639072183
driven_lanedir_consec_mean	1.718611187848167
driven_lanedir_consec_min	1.0032450772554116
driven_lanedir_max	2.2528060639072183
driven_lanedir_mean	1.718611187848167
driven_lanedir_median	1.8091968051150191
driven_lanedir_min	1.0032450772554116
get_duckie_state_max	1.613944219047293e-06
get_duckie_state_mean	1.5819036461696378e-06
get_duckie_state_median	1.599552223695921e-06
get_duckie_state_min	1.514565918239416e-06
get_robot_state_max	0.004010899966915712
get_robot_state_mean	0.003932889128175546
get_robot_state_median	0.003917305929779978
get_robot_state_min	0.003886044686226517
get_state_dump_max	0.0050966502814892905
get_state_dump_mean	0.004890215636196912
get_state_dump_median	0.00483068988137913
get_state_dump_min	0.004802832500540095
get_ui_image_max	0.03939641870046138
get_ui_image_mean	0.03343673324969038
get_ui_image_median	0.03274992733872626
get_ui_image_min	0.02885065962084763
in-drivable-lane_max	12.350000000000154
in-drivable-lane_mean	8.162500000000112
in-drivable-lane_min	3.800000000000054
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.106810362690964, "get_ui_image": 0.03090921407256179, "step_physics": 0.09678247010136004, "survival_time": 27.05000000000025, "driven_lanedir": 2.2528060639072183, "get_state_dump": 0.004829180196642436, "get_robot_state": 0.003891341800619315, "sim_render-ego0": 0.0041509255271996075, "get_duckie_state": 1.613944219047293e-06, "in-drivable-lane": 8.000000000000114, "deviation-heading": 2.335465205919194, "agent_compute-ego0": 0.09344273079805268, "complete-iteration": 0.246211907960392, "set_robot_commands": 0.002424848915466083, "deviation-center-line": 0.909175256147186, "driven_lanedir_consec": 2.2528060639072183, "sim_compute_sim_state": 0.007548929580463255, "sim_compute_performance-ego0": 0.0021360457163455302}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.9981857532159286, "get_ui_image": 0.03939641870046138, "step_physics": 0.10609605412789828, "survival_time": 22.500000000000185, "driven_lanedir": 1.0032450772554116, "get_state_dump": 0.004832199566115826, "get_robot_state": 0.003886044686226517, "sim_render-ego0": 0.004248289205546919, "get_duckie_state": 1.514565918239416e-06, "in-drivable-lane": 12.350000000000154, "deviation-heading": 4.19560090973135, "agent_compute-ego0": 0.09334724335342712, "complete-iteration": 0.2684615816086729, "set_robot_commands": 0.00227712791933453, "deviation-center-line": 0.6916541577884892, "driven_lanedir_consec": 1.0032450772554116, "sim_compute_sim_state": 0.012132473901211556, "sim_compute_performance-ego0": 0.002149889051517732}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.9502420116108108, "get_ui_image": 0.034590640604890734, "step_physics": 0.10909608578839838, "survival_time": 15.05000000000008, "driven_lanedir": 1.461627638767126, "get_state_dump": 0.0050966502814892905, "get_robot_state": 0.004010899966915712, "sim_render-ego0": 0.00428083006119886, "get_duckie_state": 1.5923519008207006e-06, "in-drivable-lane": 3.800000000000054, "deviation-heading": 1.4285809902839186, "agent_compute-ego0": 0.05664909912260952, "complete-iteration": 0.23251131512471385, "set_robot_commands": 0.0023574544893984763, "deviation-center-line": 0.3852450935752763, "driven_lanedir_consec": 1.461627638767126, "sim_compute_sim_state": 0.014141473549091264, "sim_compute_performance-ego0": 0.00218491917414381}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.983409826011618, "get_ui_image": 0.02885065962084763, "step_physics": 0.092846557819586, "survival_time": 27.75000000000026, "driven_lanedir": 2.1567659714629124, "get_state_dump": 0.004802832500540095, "get_robot_state": 0.00394327005894064, "sim_render-ego0": 0.00417100697112598, "get_duckie_state": 1.6067525465711414e-06, "in-drivable-lane": 8.50000000000012, "deviation-heading": 2.3822389781738247, "agent_compute-ego0": 0.09060321094320832, "complete-iteration": 0.23692125339302228, "set_robot_commands": 0.002331516725553883, "deviation-center-line": 0.9702136282486312, "driven_lanedir_consec": 2.1567659714629124, "sim_compute_sim_state": 0.007130255802072209, "sim_compute_performance-ego0": 0.002144156600073945}}
set_robot_commands_max	0.002424848915466083
set_robot_commands_mean	0.002347737012438243
set_robot_commands_median	0.00234448560747618
set_robot_commands_min	0.00227712791933453
sim_compute_performance-ego0_max	0.00218491917414381
sim_compute_performance-ego0_mean	0.002153752635520254
sim_compute_performance-ego0_median	0.002147022825795838
sim_compute_performance-ego0_min	0.0021360457163455302
sim_compute_sim_state_max	0.014141473549091264
sim_compute_sim_state_mean	0.01023828320820957
sim_compute_sim_state_median	0.009840701740837406
sim_compute_sim_state_min	0.007130255802072209
sim_render-ego0_max	0.00428083006119886
sim_render-ego0_mean	0.0042127629412678416
sim_render-ego0_median	0.004209648088336449
sim_render-ego0_min	0.0041509255271996075
simulation-passed	1
step_physics_max	0.10909608578839838
step_physics_mean	0.10120529195931068
step_physics_median	0.10143926211462916
step_physics_min	0.092846557819586
survival_time_max	27.75000000000026
survival_time_mean	23.08750000000019
survival_time_min	15.05000000000008

No reset possible

58768

12741

Thomas Wiggers 🇳🇱

ppo_v1

LFP-sim

success

2020-12-04 12:29:38+00:00

2020-12-04 13:02:11+00:00

0:32:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	46.64999999999949
in-drivable-lane_median	24.94999999999996
driven_lanedir_consec_median	2.0454448641542737
deviation-center-line_median	0.8986681564618777

other stats

agent_compute-ego0_max	0.08985944677676473
agent_compute-ego0_mean	0.07384526659161661
agent_compute-ego0_median	0.07360761782102725
agent_compute-ego0_min	0.058306383947647186
complete-iteration_max	0.3063776005023413
complete-iteration_mean	0.27137769759634633
complete-iteration_median	0.2822267360368459
complete-iteration_min	0.2146797178093523
deviation-center-line_max	2.016729942727011
deviation-center-line_mean	1.0701691912709164
deviation-center-line_min	0.4666105094328992
deviation-heading_max	17.14244730029623
deviation-heading_mean	7.00715030117988
deviation-heading_median	4.518897894034499
deviation-heading_min	1.8483581163542928
driven_any_max	7.140361848468016
driven_any_mean	5.005428995531474
driven_any_median	5.045696872609133
driven_any_min	2.789960388439615
driven_lanedir_consec_max	3.4764263956997734
driven_lanedir_consec_mean	2.296485743567537
driven_lanedir_consec_min	1.6186268502618266
driven_lanedir_max	3.4764263956997734
driven_lanedir_mean	2.322704139036498
driven_lanedir_median	2.096949784182823
driven_lanedir_min	1.6204905920805734
get_duckie_state_max	0.027676849492958615
get_duckie_state_mean	0.01967156182578687
get_duckie_state_median	0.023186254174160863
get_duckie_state_min	0.004636889461867153
get_robot_state_max	0.004188307752912635
get_robot_state_mean	0.004052646821648824
get_robot_state_median	0.004043401581974904
get_robot_state_min	0.003935476369732852
get_state_dump_max	0.009057917233024324
get_state_dump_mean	0.00793867730217058
get_state_dump_median	0.0085936367198804
get_state_dump_min	0.0055095185358972005
get_ui_image_max	0.040198107940966045
get_ui_image_mean	0.03601174081618873
get_ui_image_median	0.037865582441720086
get_ui_image_min	0.02811769044034866
in-drivable-lane_max	31.64999999999906
in-drivable-lane_mean	23.137499999999783
in-drivable-lane_min	11.000000000000156
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 2.789960388439615, "get_ui_image": 0.03572769303406988, "step_physics": 0.11075271027428764, "survival_time": 22.350000000000183, "driven_lanedir": 1.8948116367432, "get_state_dump": 0.009057917233024324, "get_robot_state": 0.0040487317102296016, "sim_render-ego0": 0.00408215235386576, "get_duckie_state": 0.027676849492958615, "in-drivable-lane": 11.000000000000156, "deviation-heading": 1.8483581163542928, "agent_compute-ego0": 0.08985944677676473, "complete-iteration": 0.2936175497514861, "set_robot_commands": 0.0023834221065044403, "deviation-center-line": 0.4666105094328992, "driven_lanedir_consec": 1.8948116367432, "sim_compute_sim_state": 0.0077368515942777905, "sim_compute_performance-ego0": 0.002185953514916556}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.324954070845563, "get_ui_image": 0.040198107940966045, "step_physics": 0.11536120217011236, "survival_time": 59.99999999999873, "driven_lanedir": 2.2990879316224464, "get_state_dump": 0.008553481121841417, "get_robot_state": 0.004038071453720207, "sim_render-ego0": 0.0040777170290855645, "get_duckie_state": 0.02266530351376752, "in-drivable-lane": 31.64999999999906, "deviation-heading": 17.14244730029623, "agent_compute-ego0": 0.058306383947647186, "complete-iteration": 0.27083592232220577, "set_robot_commands": 0.0023854487543796916, "deviation-center-line": 2.016729942727011, "driven_lanedir_consec": 2.1960780915653473, "sim_compute_sim_state": 0.01295077731269881, "sim_compute_performance-ego0": 0.002181903408727082}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.766439674372702, "get_ui_image": 0.0400034718493703, "step_physics": 0.12340964288302642, "survival_time": 36.10000000000009, "driven_lanedir": 1.6204905920805734, "get_state_dump": 0.008633792317919381, "get_robot_state": 0.004188307752912635, "sim_render-ego0": 0.004190718319735916, "get_duckie_state": 0.02370720483455421, "in-drivable-lane": 20.150000000000286, "deviation-heading": 4.8506371602986444, "agent_compute-ego0": 0.08199100144836088, "complete-iteration": 0.3063776005023413, "set_robot_commands": 0.002486055157821043, "deviation-center-line": 0.9268987960366551, "driven_lanedir_consec": 1.6186268502618266, "sim_compute_sim_state": 0.015348140959258232, "sim_compute_performance-ego0": 0.002308211715719347}, "LFP-norm-small_loop-000-ego0": {"driven_any": 7.140361848468016, "get_ui_image": 0.02811769044034866, "step_physics": 0.09209793436475196, "survival_time": 57.19999999999889, "driven_lanedir": 3.4764263956997734, "get_state_dump": 0.0055095185358972005, "get_robot_state": 0.003935476369732852, "sim_render-ego0": 0.004024405250382735, "get_duckie_state": 0.004636889461867153, "in-drivable-lane": 29.74999999999963, "deviation-heading": 4.187158627770353, "agent_compute-ego0": 0.06522423419369361, "complete-iteration": 0.2146797178093523, "set_robot_commands": 0.0023005535508867957, "deviation-center-line": 0.8704375168871002, "driven_lanedir_consec": 3.4764263956997734, "sim_compute_sim_state": 0.006623249803568078, "sim_compute_performance-ego0": 0.002113355195157913}}
set_robot_commands_max	0.002486055157821043
set_robot_commands_mean	0.0023888698923979924
set_robot_commands_median	0.002384435430442066
set_robot_commands_min	0.0023005535508867957
sim_compute_performance-ego0_max	0.002308211715719347
sim_compute_performance-ego0_mean	0.0021973559586302245
sim_compute_performance-ego0_median	0.002183928461821819
sim_compute_performance-ego0_min	0.002113355195157913
sim_compute_sim_state_max	0.015348140959258232
sim_compute_sim_state_mean	0.010664754917450728
sim_compute_sim_state_median	0.0103438144534883
sim_compute_sim_state_min	0.006623249803568078
sim_render-ego0_max	0.004190718319735916
sim_render-ego0_mean	0.004093748238267494
sim_render-ego0_median	0.004079934691475662
sim_render-ego0_min	0.004024405250382735
simulation-passed	1
step_physics_max	0.12340964288302642
step_physics_mean	0.1104053724230446
step_physics_median	0.1130569562222
step_physics_min	0.09209793436475196
survival_time_max	59.99999999999873
survival_time_mean	43.91249999999947
survival_time_min	22.350000000000183

No reset possible

58747

12738

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

error

yes

2020-12-04 06:44:37+00:00

2020-12-04 06:53:29+00:00

0:08:52

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58715

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

aborted

yes

2020-12-04 02:20:20+00:00

2020-12-04 02:20:42+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58690

6729

Andrea Censi 🇨🇭

template-random

LFv-sim

success

yes

2020-12-04 02:13:18+00:00

2020-12-04 02:17:22+00:00

0:04:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5040495128145347
survival_time_median	4.6499999999999915
deviation-center-line_median	0.10620228737371736
in-drivable-lane_median	2.674999999999992

other stats

agent_compute-ego0_max	0.01205473393201828
agent_compute-ego0_mean	0.01147756573000279
agent_compute-ego0_median	0.011365817967178784
agent_compute-ego0_min	0.011123893053635307
complete-iteration_max	0.20485658446947733
complete-iteration_mean	0.18707465599601125
complete-iteration_median	0.18698700955757808
complete-iteration_min	0.16946802039941153
deviation-center-line_max	0.16455763165774434
deviation-center-line_mean	0.1092777488823554
deviation-center-line_min	0.06014878912424249
deviation-heading_max	1.819139548495243
deviation-heading_mean	0.860079214882594
deviation-heading_median	0.6517793617099584
deviation-heading_min	0.31761858761521594
driven_any_max	3.078535752374254
driven_any_mean	1.8526223552312917
driven_any_median	1.6219947547238958
driven_any_min	1.0879641591031215
driven_lanedir_consec_max	0.6643282900394009
driven_lanedir_consec_mean	0.4884432809313369
driven_lanedir_consec_min	0.28134580805687714
driven_lanedir_max	0.6643282900394009
driven_lanedir_mean	0.4924956463812869
driven_lanedir_median	0.5121542437144349
driven_lanedir_min	0.28134580805687714
get_duckie_state_max	1.5844272661812698e-06
get_duckie_state_mean	1.477097877958663e-06
get_duckie_state_median	1.4554187295517483e-06
get_duckie_state_min	1.413126786549886e-06
get_robot_state_max	0.00508646418650945
get_robot_state_mean	0.004173749635694392
get_robot_state_median	0.003920441647957481
get_robot_state_min	0.0037676510603531542
get_state_dump_max	0.007296358545621236
get_state_dump_mean	0.005586687898248414
get_state_dump_median	0.005047583043491455
get_state_dump_min	0.00495522696038951
get_ui_image_max	0.034041150756504227
get_ui_image_mean	0.03097159847526483
get_ui_image_median	0.030725760178433523
get_ui_image_min	0.02839372278768805
in-drivable-lane_max	6.549999999999982
in-drivable-lane_mean	3.3499999999999894
in-drivable-lane_min	1.499999999999995
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02839372278768805, "step_physics": 0.10463331922700134, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.005108813696269748, "get_robot_state": 0.003985065448133251, "sim_render-ego0": 0.0040026118483724475, "get_duckie_state": 1.5844272661812698e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.01118136508555352, "complete-iteration": 0.17209403575221194, "set_robot_commands": 0.002381330803979801, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.01014792315567596, "sim_compute_performance-ego0": 0.0021592982207672504}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.034041150756504227, "step_physics": 0.13014014389203943, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.00495522696038951, "get_robot_state": 0.0037676510603531542, "sim_render-ego0": 0.003962198029393735, "get_duckie_state": 1.4538350312606148e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011123893053635307, "complete-iteration": 0.20187998336294424, "set_robot_commands": 0.0023220492445904274, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009371327317279318, "sim_compute_performance-ego0": 0.0021042020424552584}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03212733401192559, "step_physics": 0.13574842611948648, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004986352390713162, "get_robot_state": 0.0038558178477817113, "sim_render-ego0": 0.003969113032023112, "get_duckie_state": 1.457002427842882e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.01155027084880405, "complete-iteration": 0.20485658446947733, "set_robot_commands": 0.0022844208611382377, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008105754852294922, "sim_compute_performance-ego0": 0.0021341111924913195}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.029324186344941456, "step_physics": 0.098877248664697, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.007296358545621236, "get_robot_state": 0.00508646418650945, "sim_render-ego0": 0.004051377375920613, "get_duckie_state": 1.413126786549886e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.01205473393201828, "complete-iteration": 0.16946802039941153, "set_robot_commands": 0.003787574668725332, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.006659636894861857, "sim_compute_performance-ego0": 0.00223885973294576}}
set_robot_commands_max	0.003787574668725332
set_robot_commands_mean	0.0026938438946084494
set_robot_commands_median	0.0023516900242851143
set_robot_commands_min	0.0022844208611382377
sim_compute_performance-ego0_max	0.00223885973294576
sim_compute_performance-ego0_mean	0.002159117797164897
sim_compute_performance-ego0_median	0.0021467047066292847
sim_compute_performance-ego0_min	0.0021042020424552584
sim_compute_sim_state_max	0.01014792315567596
sim_compute_sim_state_mean	0.008571160555028014
sim_compute_sim_state_median	0.00873854108478712
sim_compute_sim_state_min	0.006659636894861857
sim_render-ego0_max	0.004051377375920613
sim_render-ego0_mean	0.003996325071427477
sim_render-ego0_median	0.00398586244019778
sim_render-ego0_min	0.003962198029393735
simulation-passed	1
step_physics_max	0.13574842611948648
step_physics_mean	0.11734978447580606
step_physics_median	0.11738673155952038
step_physics_min	0.098877248664697
survival_time_max	7.84999999999998
survival_time_mean	5.17499999999999
survival_time_min	3.5499999999999954

No reset possible

58678

6757

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-04 02:10:04+00:00

2020-12-04 02:12:45+00:00

0:02:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58661

6757

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-04 02:06:17+00:00

2020-12-04 02:09:50+00:00

0:03:33

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58589

6824

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

success

yes

2020-12-04 01:28:53+00:00

2020-12-04 02:05:53+00:00

0:37:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.002314083215814
survival_time_median	59.99999999999873
deviation-center-line_median	3.765939027372612
in-drivable-lane_median	5.299999999999827

other stats

agent_compute-ego0_max	0.027114534854491883
agent_compute-ego0_mean	0.016647593365620814
agent_compute-ego0_median	0.013285370492419036
agent_compute-ego0_min	0.012905097623153292
complete-iteration_max	0.22204340665564748
complete-iteration_mean	0.19734031765983068
complete-iteration_median	0.19285601322895085
complete-iteration_min	0.1816058375257735
deviation-center-line_max	3.9993801272199616
deviation-center-line_mean	3.3470933573017083
deviation-center-line_min	1.8571152472416488
deviation-heading_max	11.421854622463831
deviation-heading_mean	9.846151059516366
deviation-heading_median	10.462466891355817
deviation-heading_min	7.037815832890002
driven_any_max	7.92109796500289
driven_any_mean	7.919257990147589
driven_any_median	7.920762405552621
driven_any_min	7.914409184482228
driven_lanedir_consec_max	6.9322005888327265
driven_lanedir_consec_mean	5.517380537038701
driven_lanedir_consec_min	3.1326933928904506
driven_lanedir_max	6.9808572497215104
driven_lanedir_mean	5.973649833720918
driven_lanedir_median	6.890524346135855
driven_lanedir_min	3.1326933928904506
get_duckie_state_max	1.6494754152829998e-06
get_duckie_state_mean	1.4803888001707969e-06
get_duckie_state_median	1.44321654460313e-06
get_duckie_state_min	1.385646696193927e-06
get_robot_state_max	0.003966866683007081
get_robot_state_mean	0.0038710091632172825
get_robot_state_median	0.003889221335132354
get_robot_state_min	0.0037387272995973407
get_state_dump_max	0.0053071370232015925
get_state_dump_mean	0.0051262985657494235
get_state_dump_median	0.005121611635651219
get_state_dump_min	0.0049548339684936625
get_ui_image_max	0.03682669989770894
get_ui_image_mean	0.03106524575064323
get_ui_image_median	0.030718630894733208
get_ui_image_min	0.025997021315397568
in-drivable-lane_max	33.49999999999849
in-drivable-lane_mean	12.074999999999498
in-drivable-lane_min	4.19999999999985
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.92109796500289, "get_ui_image": 0.029183531879485396, "step_physics": 0.1116353601936893, "survival_time": 59.99999999999873, "driven_lanedir": 6.9808572497215104, "get_state_dump": 0.0053071370232015925, "get_robot_state": 0.003966866683007081, "sim_render-ego0": 0.004105021812635894, "get_duckie_state": 1.6494754152829998e-06, "in-drivable-lane": 4.19999999999985, "deviation-heading": 9.791800354351734, "agent_compute-ego0": 0.013242144270999349, "complete-iteration": 0.1816058375257735, "set_robot_commands": 0.002399665529185985, "deviation-center-line": 3.884101689042238, "driven_lanedir_consec": 5.155780062992643, "sim_compute_sim_state": 0.009485275124034517, "sim_compute_performance-ego0": 0.002182036613445298}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920965842274734, "get_ui_image": 0.03682669989770894, "step_physics": 0.14090210670833286, "survival_time": 59.99999999999873, "driven_lanedir": 6.9322005888327265, "get_state_dump": 0.00506213642377639, "get_robot_state": 0.003905086493511978, "sim_render-ego0": 0.004035156831256952, "get_duckie_state": 1.4209826721140586e-06, "in-drivable-lane": 5.19999999999983, "deviation-heading": 11.421854622463831, "agent_compute-ego0": 0.013328596713838728, "complete-iteration": 0.22204340665564748, "set_robot_commands": 0.002337574462509473, "deviation-center-line": 3.9993801272199616, "driven_lanedir_consec": 6.9322005888327265, "sim_compute_sim_state": 0.013361309489838586, "sim_compute_performance-ego0": 0.0021902968941084253}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914409184482228, "get_ui_image": 0.03225372990998102, "step_physics": 0.12134907724061278, "survival_time": 59.99999999999873, "driven_lanedir": 6.848848103438985, "get_state_dump": 0.0049548339684936625, "get_robot_state": 0.0038733561767527306, "sim_render-ego0": 0.003977697159626601, "get_duckie_state": 1.465450417092202e-06, "in-drivable-lane": 5.3999999999998245, "deviation-heading": 11.133133428359896, "agent_compute-ego0": 0.012905097623153292, "complete-iteration": 0.1972454354526796, "set_robot_commands": 0.002328415893694443, "deviation-center-line": 3.6477763657029856, "driven_lanedir_consec": 6.848848103438985, "sim_compute_sim_state": 0.013261078597107696, "sim_compute_performance-ego0": 0.002248479960661546}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920558968830507, "get_ui_image": 0.025997021315397568, "step_physics": 0.11185973093571214, "survival_time": 59.99999999999873, "driven_lanedir": 3.1326933928904506, "get_state_dump": 0.005181086847526048, "get_robot_state": 0.0037387272995973407, "sim_render-ego0": 0.00381695122444858, "get_duckie_state": 1.385646696193927e-06, "in-drivable-lane": 33.49999999999849, "deviation-heading": 7.037815832890002, "agent_compute-ego0": 0.027114534854491883, "complete-iteration": 0.1884665910052221, "set_robot_commands": 0.0022771620532058856, "deviation-center-line": 1.8571152472416488, "driven_lanedir_consec": 3.1326933928904506, "sim_compute_sim_state": 0.006387949783935039, "sim_compute_performance-ego0": 0.002002149497738091}}
set_robot_commands_max	0.002399665529185985
set_robot_commands_mean	0.002335704484648947
set_robot_commands_median	0.002332995178101958
set_robot_commands_min	0.0022771620532058856
sim_compute_performance-ego0_max	0.002248479960661546
sim_compute_performance-ego0_mean	0.00215574074148834
sim_compute_performance-ego0_median	0.002186166753776862
sim_compute_performance-ego0_min	0.002002149497738091
sim_compute_sim_state_max	0.013361309489838586
sim_compute_sim_state_mean	0.01062390324872896
sim_compute_sim_state_median	0.011373176860571106
sim_compute_sim_state_min	0.006387949783935039
sim_render-ego0_max	0.004105021812635894
sim_render-ego0_mean	0.0039837067569920065
sim_render-ego0_median	0.004006426995441776
sim_render-ego0_min	0.00381695122444858
simulation-passed	1
step_physics_max	0.14090210670833286
step_physics_mean	0.12143656876958678
step_physics_median	0.11660440408816246
step_physics_min	0.1116353601936893
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58556

6838

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-04 00:42:59+00:00

2020-12-04 01:28:15+00:00

0:45:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	1.2422730096440104
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.01334281070941096
agent_compute-ego0_mean	0.012681178258519488
agent_compute-ego0_median	0.012697727753657484
agent_compute-ego0_min	0.011986446817352015
complete-iteration_max	0.3699000564641897
complete-iteration_mean	0.31169622873485736
complete-iteration_median	0.311216535516623
complete-iteration_min	0.25445178744199376
deviation-center-line_max	4.053503393024394
deviation-center-line_mean	1.731069028434027
deviation-center-line_min	0.386226701423694
deviation-heading_max	27.859809596736422
deviation-heading_mean	14.925250437835436
deviation-heading_median	14.309269950178932
deviation-heading_min	3.22265225424745
driven_any_max	2.6645352591003757e-13
driven_any_mean	1.9984014443252818e-13
driven_any_median	2.6645352591003757e-13
driven_any_min	0.0
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	7.152557373046875e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	7.152557373046875e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	1.4690237180279454e-06
get_duckie_state_mean	1.4143819912188656e-06
get_duckie_state_median	1.4200893468801226e-06
get_duckie_state_min	1.348325553087271e-06
get_robot_state_max	0.003866280643866521
get_robot_state_mean	0.0038399002037874178
get_robot_state_median	0.003851447871682249
get_robot_state_min	0.0037904244279186494
get_state_dump_max	0.004851795850844308
get_state_dump_mean	0.004775505578091103
get_state_dump_median	0.004770343746372702
get_state_dump_min	0.004709538968774699
get_ui_image_max	0.037291504759077825
get_ui_image_mean	0.031746185242782325
get_ui_image_median	0.031245584491885373
get_ui_image_min	0.027202067228280735
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.029377726095105885, "step_physics": 0.2301380979726952, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0047799659509841445, "get_robot_state": 0.0037904244279186494, "sim_render-ego0": 0.00391189660954535, "get_duckie_state": 1.4134390368052664e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011986446817352015, "complete-iteration": 0.297294145222012, "set_robot_commands": 0.0023024334300070577, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008852341689237648, "sim_compute_performance-ego0": 0.0020645498534622637}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.037291504759077825, "step_physics": 0.28971411107878803, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004851795850844308, "get_robot_state": 0.003866280643866521, "sim_render-ego0": 0.00406614469548844, "get_duckie_state": 1.426739656954979e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.01334281070941096, "complete-iteration": 0.3699000564641897, "set_robot_commands": 0.0023250633433498412, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012202226946891891, "sim_compute_performance-ego0": 0.002146086228280937}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.033113442888664864, "step_physics": 0.2536727929492477, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004709538968774699, "get_robot_state": 0.0038582877652234182, "sim_render-ego0": 0.003925981569250458, "get_duckie_state": 1.348325553087271e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012136733303657676, "complete-iteration": 0.325138925811234, "set_robot_commands": 0.002339996564993751, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009131656300515358, "sim_compute_performance-ego0": 0.002161417078912308}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027202067228280735, "step_physics": 0.1906479804541646, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00476072154176126, "get_robot_state": 0.00384460797814108, "sim_render-ego0": 0.0038967208004712464, "get_duckie_state": 1.4690237180279454e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.013258722203657291, "complete-iteration": 0.25445178744199376, "set_robot_commands": 0.0023524937879830774, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006293492154415998, "sim_compute_performance-ego0": 0.0021053208201056613}}
set_robot_commands_max	0.0023524937879830774
set_robot_commands_mean	0.002329996781583432
set_robot_commands_median	0.002332529954171796
set_robot_commands_min	0.0023024334300070577
sim_compute_performance-ego0_max	0.002161417078912308
sim_compute_performance-ego0_mean	0.0021193434951902925
sim_compute_performance-ego0_median	0.002125703524193299
sim_compute_performance-ego0_min	0.0020645498534622637
sim_compute_sim_state_max	0.012202226946891891
sim_compute_sim_state_mean	0.009119929272765224
sim_compute_sim_state_median	0.008991998994876502
sim_compute_sim_state_min	0.006293492154415998
sim_render-ego0_max	0.00406614469548844
sim_render-ego0_mean	0.003950185918688873
sim_render-ego0_median	0.003918939089397904
sim_render-ego0_min	0.0038967208004712464
simulation-passed	1
step_physics_max	0.28971411107878803
step_physics_mean	0.24104324561372387
step_physics_median	0.24190544546097145
step_physics_min	0.1906479804541646
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58546

6842

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-04 00:21:56+00:00

2020-12-04 00:42:44+00:00

0:20:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.369809816459718
survival_time_median	38.79999999999993
deviation-center-line_median	0.9757756004173964
in-drivable-lane_median	26.97499999999979

other stats

agent_compute-ego0_max	0.013187305086609945
agent_compute-ego0_mean	0.012778584672878174
agent_compute-ego0_median	0.01268754199795101
agent_compute-ego0_min	0.012551949609000728
complete-iteration_max	0.17992923052414603
complete-iteration_mean	0.17280386029607137
complete-iteration_median	0.17404510254348848
complete-iteration_min	0.16319600557316247
deviation-center-line_max	2.85943674679007
deviation-center-line_mean	1.3253461977998249
deviation-center-line_min	0.49039684357443686
deviation-heading_max	6.737338443463686
deviation-heading_mean	3.717919967894424
deviation-heading_median	2.7954353768650764
deviation-heading_min	2.543470674383859
driven_any_max	7.25501758244321
driven_any_mean	5.017088138792421
driven_any_median	5.273899010405366
driven_any_min	2.2655369519157462
driven_lanedir_consec_max	3.5455711447493834
driven_lanedir_consec_mean	1.7513336228236152
driven_lanedir_consec_min	0.7201437136256412
driven_lanedir_max	3.5455711447493834
driven_lanedir_mean	1.7513336228236152
driven_lanedir_median	1.369809816459718
driven_lanedir_min	0.7201437136256412
get_duckie_state_max	2.176775408618023e-06
get_duckie_state_mean	2.0824851748588395e-06
get_duckie_state_median	2.11062866838897e-06
get_duckie_state_min	1.931907954039397e-06
get_robot_state_max	0.003833086504412524
get_robot_state_mean	0.003708110540313848
get_robot_state_median	0.003696670668013524
get_robot_state_min	0.003606014320815819
get_state_dump_max	0.004878664292352048
get_state_dump_mean	0.004679044399894286
get_state_dump_median	0.004665826682774526
get_state_dump_min	0.004505859941676043
get_ui_image_max	0.03521759751914204
get_ui_image_mean	0.03103338344636485
get_ui_image_median	0.030220155644404313
get_ui_image_min	0.02847562497750872
in-drivable-lane_max	28.649999999999608
in-drivable-lane_mean	23.212499999999828
in-drivable-lane_min	10.250000000000128
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.25501758244321, "get_ui_image": 0.02877092721327296, "step_physics": 0.10490713704307124, "survival_time": 52.94999999999913, "driven_lanedir": 3.5455711447493834, "get_state_dump": 0.004717687615808451, "get_robot_state": 0.003718326451643458, "sim_render-ego0": 0.003798641348784825, "get_duckie_state": 2.1131533496784713e-06, "in-drivable-lane": 25.69999999999938, "deviation-heading": 6.737338443463686, "agent_compute-ego0": 0.012551949609000728, "complete-iteration": 0.17264916267035144, "set_robot_commands": 0.0022672695933647876, "deviation-center-line": 2.85943674679007, "driven_lanedir_consec": 3.5455711447493834, "sim_compute_sim_state": 0.009846558210984716, "sim_compute_performance-ego0": 0.0019870758056640624}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.669430088706166, "get_ui_image": 0.03521759751914204, "step_physics": 0.10557488600413004, "survival_time": 34.45000000000018, "driven_lanedir": 0.7201437136256412, "get_state_dump": 0.004505859941676043, "get_robot_state": 0.003606014320815819, "sim_render-ego0": 0.00371756380882816, "get_duckie_state": 2.108103987099468e-06, "in-drivable-lane": 28.250000000000195, "deviation-heading": 2.543470674383859, "agent_compute-ego0": 0.012745545221411664, "complete-iteration": 0.17992923052414603, "set_robot_commands": 0.0021875982699186905, "deviation-center-line": 0.4996437211347808, "driven_lanedir_consec": 0.7201437136256412, "sim_compute_sim_state": 0.010347349056299185, "sim_compute_performance-ego0": 0.0019444648770318516}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.878367932104565, "get_ui_image": 0.03166938407553567, "step_physics": 0.10242625519081398, "survival_time": 43.149999999999686, "driven_lanedir": 1.9030394355120637, "get_state_dump": 0.004613965749740601, "get_robot_state": 0.00367501488438359, "sim_render-ego0": 0.00373961141815892, "get_duckie_state": 1.931907954039397e-06, "in-drivable-lane": 28.649999999999608, "deviation-heading": 2.995115020731234, "agent_compute-ego0": 0.012629538774490356, "complete-iteration": 0.17544104241662556, "set_robot_commands": 0.0021635625097486707, "deviation-center-line": 1.4519074797000118, "driven_lanedir_consec": 1.9030394355120637, "sim_compute_sim_state": 0.012423444401334834, "sim_compute_performance-ego0": 0.002018600426338337}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.2655369519157462, "get_ui_image": 0.02847562497750872, "step_physics": 0.09846804045528346, "survival_time": 17.25000000000011, "driven_lanedir": 0.8365801974073721, "get_state_dump": 0.004878664292352048, "get_robot_state": 0.003833086504412524, "sim_render-ego0": 0.003973663886847524, "get_duckie_state": 2.176775408618023e-06, "in-drivable-lane": 10.250000000000128, "deviation-heading": 2.595755732998919, "agent_compute-ego0": 0.013187305086609945, "complete-iteration": 0.16319600557316247, "set_robot_commands": 0.002320306838592353, "deviation-center-line": 0.49039684357443686, "driven_lanedir_consec": 0.8365801974073721, "sim_compute_sim_state": 0.005898206909267889, "sim_compute_performance-ego0": 0.002073449206490048}}
set_robot_commands_max	0.002320306838592353
set_robot_commands_mean	0.0022346843029061253
set_robot_commands_median	0.002227433931641739
set_robot_commands_min	0.0021635625097486707
sim_compute_performance-ego0_max	0.002073449206490048
sim_compute_performance-ego0_mean	0.0020058975788810746
sim_compute_performance-ego0_median	0.0020028381160012
sim_compute_performance-ego0_min	0.0019444648770318516
sim_compute_sim_state_max	0.012423444401334834
sim_compute_sim_state_mean	0.009628889644471656
sim_compute_sim_state_median	0.01009695363364195
sim_compute_sim_state_min	0.005898206909267889
sim_render-ego0_max	0.003973663886847524
sim_render-ego0_mean	0.0038073701156548577
sim_render-ego0_median	0.003769126383471872
sim_render-ego0_min	0.00371756380882816
simulation-passed	1
step_physics_max	0.10557488600413004
step_physics_mean	0.10284407967332468
step_physics_median	0.1036666961169426
step_physics_min	0.09846804045528346
survival_time_max	52.94999999999913
survival_time_mean	36.949999999999775
survival_time_min	17.25000000000011

No reset possible

58517

6852

Melisande Teng

exercise_ros_template

LFv-sim

success

yes

2020-12-04 00:09:22+00:00

2020-12-04 00:21:16+00:00

0:11:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5240190696856952
survival_time_median	19.475000000000147
deviation-center-line_median	0.8513289698196783
in-drivable-lane_median	7.150000000000059

other stats

agent_compute-ego0_max	0.013531981952606685
agent_compute-ego0_mean	0.012720114649187916
agent_compute-ego0_median	0.01268763880603122
agent_compute-ego0_min	0.011973199032082542
complete-iteration_max	0.21073509235771337
complete-iteration_mean	0.18926134044556173
complete-iteration_median	0.191713508524512
complete-iteration_min	0.16288325237550946
deviation-center-line_max	1.872857122116128
deviation-center-line_mean	0.9509368884469848
deviation-center-line_min	0.22823249203245383
deviation-heading_max	8.592933225157614
deviation-heading_mean	4.734570651683564
deviation-heading_median	4.859731153875548
deviation-heading_min	0.625887073825545
driven_any_max	7.161183210697387
driven_any_mean	3.897188872646371
driven_any_median	3.678140197237401
driven_any_min	1.071291885413297
driven_lanedir_consec_max	2.5565599558454064
driven_lanedir_consec_mean	1.5395192168775471
driven_lanedir_consec_min	0.5534787722933927
driven_lanedir_max	3.5382427218958483
driven_lanedir_mean	1.7849399083901578
driven_lanedir_median	1.5240190696856952
driven_lanedir_min	0.5534787722933927
get_duckie_state_max	1.404020521375868e-06
get_duckie_state_mean	1.321567945579272e-06
get_duckie_state_median	1.313490601258453e-06
get_duckie_state_min	1.255270058424315e-06
get_robot_state_max	0.0037592875092563567
get_robot_state_mean	0.0036881118760337074
get_robot_state_median	0.0036793564258435457
get_robot_state_min	0.003634447143191383
get_state_dump_max	0.005276980043268528
get_state_dump_mean	0.00480875822400765
get_state_dump_median	0.0046781514745214406
get_state_dump_min	0.00460174990371919
get_ui_image_max	0.03589555844157732
get_ui_image_mean	0.031061219197455636
get_ui_image_median	0.030911358783848996
get_ui_image_min	0.02652660078054723
in-drivable-lane_max	20.94999999999998
in-drivable-lane_mean	9.575000000000022
in-drivable-lane_min	3.049999999999989
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.161183210697387, "get_ui_image": 0.028805210892583283, "step_physics": 0.11696816531705184, "survival_time": 35.450000000000124, "driven_lanedir": 2.3467882866669756, "get_state_dump": 0.00460174990371919, "get_robot_state": 0.003685435107056524, "sim_render-ego0": 0.003789747265023245, "get_duckie_state": 1.2921615385673415e-06, "in-drivable-lane": 20.94999999999998, "deviation-heading": 8.592933225157614, "agent_compute-ego0": 0.01265436998555358, "complete-iteration": 0.1850913675738053, "set_robot_commands": 0.0021881872499492807, "deviation-center-line": 1.3378200799834203, "driven_lanedir_consec": 2.3467882866669756, "sim_compute_sim_state": 0.010292949139232366, "sim_compute_performance-ego0": 0.002013985539825869}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746908710611196, "get_ui_image": 0.03589555844157732, "step_physics": 0.13547427638047407, "survival_time": 7.299999999999982, "driven_lanedir": 0.7012498527044149, "get_state_dump": 0.005276980043268528, "get_robot_state": 0.0036732777446305672, "sim_render-ego0": 0.003727434443778732, "get_duckie_state": 1.334819663949564e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 1.7829688026092236, "agent_compute-ego0": 0.012720907626508855, "complete-iteration": 0.21073509235771337, "set_robot_commands": 0.0022104094628574086, "deviation-center-line": 0.36483785965593635, "driven_lanedir_consec": 0.7012498527044149, "sim_compute_sim_state": 0.009733766114630667, "sim_compute_performance-ego0": 0.0019354804032513885}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.071291885413297, "get_ui_image": 0.03301750667511471, "step_physics": 0.12691700080084423, "survival_time": 6.249999999999986, "driven_lanedir": 0.5534787722933927, "get_state_dump": 0.0047326333939083035, "get_robot_state": 0.003634447143191383, "sim_render-ego0": 0.0038782623079088, "get_duckie_state": 1.404020521375868e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.625887073825545, "agent_compute-ego0": 0.013531981952606685, "complete-iteration": 0.19833564947521876, "set_robot_commands": 0.0022142784936087473, "deviation-center-line": 0.22823249203245383, "driven_lanedir_consec": 0.5534787722933927, "sim_compute_sim_state": 0.00829764207204183, "sim_compute_performance-ego0": 0.0020144364190480065}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.081589523413682, "get_ui_image": 0.02652660078054723, "step_physics": 0.10153586029630354, "survival_time": 31.650000000000315, "driven_lanedir": 3.5382427218958483, "get_state_dump": 0.004623669555134578, "get_robot_state": 0.0037592875092563567, "sim_render-ego0": 0.0038193558292810097, "get_duckie_state": 1.255270058424315e-06, "in-drivable-lane": 11.15000000000013, "deviation-heading": 7.936493505141872, "agent_compute-ego0": 0.011973199032082542, "complete-iteration": 0.16288325237550946, "set_robot_commands": 0.0022271615849684466, "deviation-center-line": 1.872857122116128, "driven_lanedir_consec": 2.5565599558454064, "sim_compute_sim_state": 0.006254818913312365, "sim_compute_performance-ego0": 0.0020752347982268228}}
set_robot_commands_max	0.0022271615849684466
set_robot_commands_mean	0.0022100091978459707
set_robot_commands_median	0.002212343978233078
set_robot_commands_min	0.0021881872499492807
sim_compute_performance-ego0_max	0.0020752347982268228
sim_compute_performance-ego0_mean	0.002009784290088022
sim_compute_performance-ego0_median	0.0020142109794369376
sim_compute_performance-ego0_min	0.0019354804032513885
sim_compute_sim_state_max	0.010292949139232366
sim_compute_sim_state_mean	0.008644794059804306
sim_compute_sim_state_median	0.009015704093336248
sim_compute_sim_state_min	0.006254818913312365
sim_render-ego0_max	0.0038782623079088
sim_render-ego0_mean	0.003803699961497947
sim_render-ego0_median	0.003804551547152127
sim_render-ego0_min	0.003727434443778732
simulation-passed	1
step_physics_max	0.13547427638047407
step_physics_mean	0.12022382569866844
step_physics_median	0.12194258305894803
step_physics_min	0.10153586029630354
survival_time_max	35.450000000000124
survival_time_mean	20.1625000000001
survival_time_min	6.249999999999986

No reset possible

58464

9255

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 23:38:01+00:00

2020-12-04 00:08:54+00:00

0:30:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.90973020276577
survival_time_median	59.99999999999873
deviation-center-line_median	3.653488213488563
in-drivable-lane_median	3.124999999999913

other stats

agent_compute-ego0_max	0.013101722278960242
agent_compute-ego0_mean	0.012883695866303134
agent_compute-ego0_median	0.012943441788536526
agent_compute-ego0_min	0.01254617760917924
complete-iteration_max	0.2143140952851155
complete-iteration_mean	0.1850799464633769
complete-iteration_median	0.1822185486719368
complete-iteration_min	0.1615685932245183
deviation-center-line_max	4.129043031955287
deviation-center-line_mean	3.268425385313492
deviation-center-line_min	1.6376820823215548
deviation-heading_max	19.106087575170715
deviation-heading_mean	11.968858912280428
deviation-heading_median	11.269202423626776
deviation-heading_min	6.230943226697443
driven_any_max	12.125958105800242
driven_any_mean	8.918270907805367
driven_any_median	9.807232750025149
driven_any_min	3.932660025370928
driven_lanedir_consec_max	11.748658582789458
driven_lanedir_consec_mean	7.207295131600916
driven_lanedir_consec_min	3.2610615380826644
driven_lanedir_max	11.748658582789458
driven_lanedir_mean	8.28063082147185
driven_lanedir_median	9.050339843128151
driven_lanedir_min	3.273185016841635
get_duckie_state_max	1.5833693479717425e-06
get_duckie_state_mean	1.5101486711527471e-06
get_duckie_state_median	1.5345982199107452e-06
get_duckie_state_min	1.388028896817756e-06
get_robot_state_max	0.004087995033677075
get_robot_state_mean	0.003875225495591072
get_robot_state_median	0.003842781993677215
get_robot_state_min	0.00372734296133278
get_state_dump_max	0.005101583680939813
get_state_dump_mean	0.004956541002683074
get_state_dump_median	0.00496673145032738
get_state_dump_min	0.004791117429137726
get_ui_image_max	0.037129590751527254
get_ui_image_mean	0.031152512659078
get_ui_image_median	0.03035044501591357
get_ui_image_min	0.026779569852957617
in-drivable-lane_max	3.5000000000000355
in-drivable-lane_mean	2.8624999999999714
in-drivable-lane_min	1.7000000000000242
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 12.125958105800242, "get_ui_image": 0.028943443179229814, "step_physics": 0.10347260960333551, "survival_time": 59.99999999999873, "driven_lanedir": 11.748658582789458, "get_state_dump": 0.005029663654489382, "get_robot_state": 0.0038747932392790554, "sim_render-ego0": 0.004014793383291024, "get_duckie_state": 1.496816058639285e-06, "in-drivable-lane": 1.7000000000000242, "deviation-heading": 8.655546972646226, "agent_compute-ego0": 0.01307113422740012, "complete-iteration": 0.17281216824680046, "set_robot_commands": 0.0023068806015383095, "deviation-center-line": 3.364791070243221, "driven_lanedir_consec": 11.748658582789458, "sim_compute_sim_state": 0.009806687587703098, "sim_compute_performance-ego0": 0.002192325933489772}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.40271898745405, "get_ui_image": 0.037129590751527254, "step_physics": 0.13394319762993018, "survival_time": 59.99999999999873, "driven_lanedir": 8.49121372275058, "get_state_dump": 0.005101583680939813, "get_robot_state": 0.004087995033677075, "sim_render-ego0": 0.004165697058074977, "get_duckie_state": 1.5833693479717425e-06, "in-drivable-lane": 3.0999999999998984, "deviation-heading": 19.106087575170715, "agent_compute-ego0": 0.013101722278960242, "complete-iteration": 0.2143140952851155, "set_robot_commands": 0.0024039598428438743, "deviation-center-line": 4.129043031955287, "driven_lanedir_consec": 5.793953531456659, "sim_compute_sim_state": 0.011942933342240437, "sim_compute_performance-ego0": 0.002335228788961876}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.932660025370928, "get_ui_image": 0.03175744685259732, "step_physics": 0.11915145481913544, "survival_time": 24.150000000000208, "driven_lanedir": 3.273185016841635, "get_state_dump": 0.004903799246165378, "get_robot_state": 0.003810770748075375, "sim_render-ego0": 0.003871083259582519, "get_duckie_state": 1.5723803811822055e-06, "in-drivable-lane": 3.5000000000000355, "deviation-heading": 6.230943226697443, "agent_compute-ego0": 0.012815749349672933, "complete-iteration": 0.19162492909707313, "set_robot_commands": 0.0022959068786999413, "deviation-center-line": 1.6376820823215548, "driven_lanedir_consec": 3.2610615380826644, "sim_compute_sim_state": 0.010845384321922114, "sim_compute_performance-ego0": 0.002074668230104052}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.211746512596248, "get_ui_image": 0.026779569852957617, "step_physics": 0.09923003932816302, "survival_time": 59.99999999999873, "driven_lanedir": 9.609465963505723, "get_state_dump": 0.004791117429137726, "get_robot_state": 0.00372734296133278, "sim_render-ego0": 0.0038425860853616048, "get_duckie_state": 1.388028896817756e-06, "in-drivable-lane": 3.1499999999999275, "deviation-heading": 13.882857874607328, "agent_compute-ego0": 0.01254617760917924, "complete-iteration": 0.1615685932245183, "set_robot_commands": 0.0022376850185346644, "deviation-center-line": 3.942185356733906, "driven_lanedir_consec": 8.025506874074882, "sim_compute_sim_state": 0.006294693180563845, "sim_compute_performance-ego0": 0.002027747831574884}}
set_robot_commands_max	0.0024039598428438743
set_robot_commands_mean	0.0023111080854041973
set_robot_commands_median	0.002301393740119126
set_robot_commands_min	0.0022376850185346644
sim_compute_performance-ego0_max	0.002335228788961876
sim_compute_performance-ego0_mean	0.002157492696032646
sim_compute_performance-ego0_median	0.002133497081796912
sim_compute_performance-ego0_min	0.002027747831574884
sim_compute_sim_state_max	0.011942933342240437
sim_compute_sim_state_mean	0.009722424608107372
sim_compute_sim_state_median	0.010326035954812605
sim_compute_sim_state_min	0.006294693180563845
sim_render-ego0_max	0.004165697058074977
sim_render-ego0_mean	0.003973539946577531
sim_render-ego0_median	0.003942938321436771
sim_render-ego0_min	0.0038425860853616048
simulation-passed	1
step_physics_max	0.13394319762993018
step_physics_mean	0.11394932534514104
step_physics_median	0.11131203221123548
step_physics_min	0.09923003932816302
survival_time_max	59.99999999999873
survival_time_mean	51.0374999999991
survival_time_min	24.150000000000208

No reset possible

58425

12737

Thomas Wiggers 🇳🇱

ppo_v1

LFv-sim

success

yes

2020-12-03 23:10:12+00:00

2020-12-03 23:37:53+00:00

0:27:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.005842514583398
survival_time_median	48.84999999999936
deviation-center-line_median	1.4327743733040914
in-drivable-lane_median	16.224999999999604

other stats

agent_compute-ego0_max	0.08254542761291099
agent_compute-ego0_mean	0.06769732685991768
agent_compute-ego0_median	0.07910213998513456
agent_compute-ego0_min	0.030039599856490608
complete-iteration_max	0.2702517648406376
complete-iteration_mean	0.22847649819711888
complete-iteration_median	0.22402530268368176
complete-iteration_min	0.19560362258047428
deviation-center-line_max	1.727448202272121
deviation-center-line_mean	1.206958210469721
deviation-center-line_min	0.23483589299857993
deviation-heading_max	8.242515626645647
deviation-heading_mean	5.68190415981711
deviation-heading_median	6.4589238912184825
deviation-heading_min	1.567253230185828
driven_any_max	8.257641686220643
driven_any_mean	5.158522104789978
driven_any_median	5.65968531786957
driven_any_min	1.05707609720013
driven_lanedir_consec_max	6.234609611855749
driven_lanedir_consec_mean	3.2280041590129795
driven_lanedir_consec_min	0.665721995029373
driven_lanedir_max	6.412127692860614
driven_lanedir_mean	3.746936079760564
driven_lanedir_median	3.953638465950234
driven_lanedir_min	0.6683396942811742
get_duckie_state_max	1.6254548923260564e-06
get_duckie_state_mean	1.459765131108965e-06
get_duckie_state_median	1.455370203796969e-06
get_duckie_state_min	1.3028652245158656e-06
get_robot_state_max	0.003976332746594157
get_robot_state_mean	0.003884169178249125
get_robot_state_median	0.003922969269070429
get_robot_state_min	0.003714405428261483
get_state_dump_max	0.005045066963723061
get_state_dump_mean	0.00490692857439917
get_state_dump_median	0.004906278894079576
get_state_dump_min	0.004770089545714468
get_ui_image_max	0.03841703332812581
get_ui_image_mean	0.03198304348199626
get_ui_image_median	0.031097978323379516
get_ui_image_min	0.0273191839531002
in-drivable-lane_max	17.84999999999985
in-drivable-lane_mean	13.46249999999976
in-drivable-lane_min	3.5499999999999874
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.257641686220643, "get_ui_image": 0.030570448884161983, "step_physics": 0.09646465498442255, "survival_time": 59.99999999999873, "driven_lanedir": 6.412127692860614, "get_state_dump": 0.005045066963723061, "get_robot_state": 0.003939396137996677, "sim_render-ego0": 0.004081560511275394, "get_duckie_state": 1.6254548923260564e-06, "in-drivable-lane": 16.949999999999037, "deviation-heading": 7.185590887937301, "agent_compute-ego0": 0.07698949389811062, "complete-iteration": 0.2321008264174767, "set_robot_commands": 0.002402496576110687, "deviation-center-line": 1.727448202272121, "driven_lanedir_consec": 6.234609611855749, "sim_compute_sim_state": 0.01027501631934478, "sim_compute_performance-ego0": 0.002231095454575716}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.813859977277248, "get_ui_image": 0.03841703332812581, "step_physics": 0.11945498352808669, "survival_time": 37.7, "driven_lanedir": 2.019043075749777, "get_state_dump": 0.004920721369863346, "get_robot_state": 0.003976332746594157, "sim_render-ego0": 0.004162138503118856, "get_duckie_state": 1.4232483920672082e-06, "in-drivable-lane": 17.84999999999985, "deviation-heading": 8.242515626645647, "agent_compute-ego0": 0.08254542761291099, "complete-iteration": 0.2702517648406376, "set_robot_commands": 0.002324953773953267, "deviation-center-line": 1.2840388783336976, "driven_lanedir_consec": 1.4861844484571298, "sim_compute_sim_state": 0.012108769322073222, "sim_compute_performance-ego0": 0.002248742880410706}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.05707609720013, "get_ui_image": 0.031625507762597045, "step_physics": 0.1084520771818341, "survival_time": 7.89999999999998, "driven_lanedir": 0.6683396942811742, "get_state_dump": 0.004891836418295806, "get_robot_state": 0.0039065424001441815, "sim_render-ego0": 0.003885769994003967, "get_duckie_state": 1.4874920155267297e-06, "in-drivable-lane": 3.5499999999999874, "deviation-heading": 1.567253230185828, "agent_compute-ego0": 0.030039599856490608, "complete-iteration": 0.19560362258047428, "set_robot_commands": 0.002206324031517941, "deviation-center-line": 0.23483589299857993, "driven_lanedir_consec": 0.665721995029373, "sim_compute_sim_state": 0.008454540240689644, "sim_compute_performance-ego0": 0.0020466930461379715}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.505510658461892, "get_ui_image": 0.0273191839531002, "step_physics": 0.08494178837880206, "survival_time": 59.99999999999873, "driven_lanedir": 5.888233856150691, "get_state_dump": 0.004770089545714468, "get_robot_state": 0.003714405428261483, "sim_render-ego0": 0.0038422257775172506, "get_duckie_state": 1.3028652245158656e-06, "in-drivable-lane": 15.500000000000174, "deviation-heading": 5.732256894499663, "agent_compute-ego0": 0.0812147860721585, "complete-iteration": 0.21594977894988684, "set_robot_commands": 0.002245128402900537, "deviation-center-line": 1.5815098682744857, "driven_lanedir_consec": 4.525500580709666, "sim_compute_sim_state": 0.005798677719205146, "sim_compute_performance-ego0": 0.002018840187892231}}
set_robot_commands_max	0.002402496576110687
set_robot_commands_mean	0.002294725696120608
set_robot_commands_median	0.002285041088426902
set_robot_commands_min	0.002206324031517941
sim_compute_performance-ego0_max	0.002248742880410706
sim_compute_performance-ego0_mean	0.002136342892254156
sim_compute_performance-ego0_median	0.0021388942503568435
sim_compute_performance-ego0_min	0.002018840187892231
sim_compute_sim_state_max	0.012108769322073222
sim_compute_sim_state_mean	0.009159250900328198
sim_compute_sim_state_median	0.009364778280017211
sim_compute_sim_state_min	0.005798677719205146
sim_render-ego0_max	0.004162138503118856
sim_render-ego0_mean	0.0039929236964788666
sim_render-ego0_median	0.003983665252639681
sim_render-ego0_min	0.0038422257775172506
simulation-passed	1
step_physics_max	0.11945498352808669
step_physics_mean	0.10232837601828636
step_physics_median	0.10245836608312832
step_physics_min	0.08494178837880206
survival_time_max	59.99999999999873
survival_time_mean	41.39999999999936
survival_time_min	7.89999999999998

No reset possible

58408

9275

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 23:07:11+00:00

2020-12-03 23:10:04+00:00

0:02:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58398

9277

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 23:04:13+00:00

2020-12-03 23:07:02+00:00

0:02:49

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58383

9294

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 23:01:05+00:00

2020-12-03 23:04:05+00:00

0:03:00

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58373

9295

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:57:54+00:00

2020-12-03 23:00:55+00:00

0:03:01

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58363

9297

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:54:44+00:00

2020-12-03 22:57:40+00:00

0:02:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58354

9299

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:51:35+00:00

2020-12-03 22:54:35+00:00

0:03:00

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58348

template-pytorch

LFv-sim

aborted

yes

2020-12-03 22:50:37+00:00

2020-12-03 22:51:21+00:00

0:00:44

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58340

template-pytorch

LFv-sim

aborted

yes

2020-12-03 22:49:42+00:00

2020-12-03 22:50:22+00:00

0:00:40

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58310

9307

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:46:32+00:00

2020-12-03 22:49:35+00:00

0:03:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58296

9307

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:43:29+00:00

2020-12-03 22:46:23+00:00

0:02:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58286

9307

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:40:26+00:00

2020-12-03 22:43:16+00:00

0:02:50

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58276

9307

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:37:21+00:00

2020-12-03 22:40:18+00:00

0:02:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58274

11012

template-pytorch

LFv-sim

aborted

yes

2020-12-03 22:35:57+00:00

2020-12-03 22:36:40+00:00

0:00:43

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58269

template-pytorch

LFv-sim

aborted

yes

2020-12-03 22:35:13+00:00

2020-12-03 22:35:50+00:00

0:00:37

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58255

9308

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 22:31:45+00:00

2020-12-03 22:34:39+00:00

0:02:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58169

9330

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

yes