Evaluator 2330

LFv-sim

host-error

2020-11-30 05:16:34+00:00

2020-11-30 05:16:39+00:00

0:00:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44035

11778

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-30 04:58:47+00:00

2020-11-30 04:58:52+00:00

0:00:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43995

11777

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-30 04:41:26+00:00

2020-11-30 04:41:32+00:00

0:00:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43944

11773

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

error

2020-11-30 02:40:58+00:00

2020-11-30 02:45:42+00:00

0:04:44

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43939

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

aborted

2020-11-30 02:39:08+00:00

2020-11-30 02:39:14+00:00

0:00:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43907

11771

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-30 02:21:06+00:00

2020-11-30 02:30:00+00:00

0:08:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.063260556273213
survival_time_median	14.950000000000076
deviation-center-line_median	0.8795703897282818
in-drivable-lane_median	2.625000000000022

other stats

agent_compute-ego_max	0.017505478064219156
agent_compute-ego_mean	0.01722185949484507
agent_compute-ego_median	0.01715028444925944
agent_compute-ego_min	0.01708139101664225
complete-iteration_max	0.20657628536224365
complete-iteration_mean	0.19499151508013407
complete-iteration_median	0.19523459355036415
complete-iteration_min	0.1829205878575643
deviation-center-line_max	1.0111805149579205
deviation-center-line_mean	0.8866114959563144
deviation-center-line_min	0.7761246894107738
deviation-heading_max	4.382988144294613
deviation-heading_mean	3.8425058120975857
deviation-heading_median	3.899001061879138
deviation-heading_min	3.189032980337454
driven_any_max	4.893110605089141
driven_any_mean	4.373946444528931
driven_any_median	4.31835744687463
driven_any_min	3.965960279277321
driven_lanedir_consec_max	4.281332281212943
driven_lanedir_consec_mean	3.149816102192974
driven_lanedir_consec_min	2.1914110150125263
driven_lanedir_max	4.281332281212943
driven_lanedir_mean	3.283885801604043
driven_lanedir_median	3.1112800497019393
driven_lanedir_min	2.63165082579935
get_duckie_state_max	2.533594767252604e-06
get_duckie_state_mean	2.5226672490437824e-06
get_duckie_state_median	2.5224685668945313e-06
get_duckie_state_min	2.5121370951334636e-06
get_robot_state_max	0.015486995379130043
get_robot_state_mean	0.014557683865229288
get_robot_state_median	0.014767724672953286
get_robot_state_min	0.013208290735880536
get_state_dump_max	0.01361569325129191
get_state_dump_mean	0.013356382449467977
get_state_dump_median	0.01349385420481364
get_state_dump_min	0.01282212813695272
get_ui_image_max	0.035307926336924235
get_ui_image_mean	0.03388044019540151
get_ui_image_median	0.034068653583526606
get_ui_image_min	0.03207652727762858
in-drivable-lane_max	4.950000000000052
in-drivable-lane_mean	2.912500000000029
in-drivable-lane_min	1.4500000000000206
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.25817937315047, "get_ui_image": 0.03207652727762858, "step_physics": 0.07078949054082234, "survival_time": 14.950000000000076, "driven_lanedir": 3.4948702867470764, "get_state_dump": 0.01282212813695272, "sim_render-ego": 0.00544731855392456, "get_robot_state": 0.013208290735880536, "get_duckie_state": 2.5121370951334636e-06, "in-drivable-lane": 1.7500000000000062, "agent_compute-ego": 0.01708139101664225, "deviation-heading": 4.382988144294613, "complete-iteration": 0.1829205878575643, "set_robot_commands": 0.004541168212890625, "deviation-center-line": 0.9641810265428324, "driven_lanedir_consec": 3.4948702867470764, "sim_compute_sim_state": 0.023109389940897625, "sim_compute_performance-ego": 0.0036943840980529783}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.893110605089141, "get_ui_image": 0.0331712539990743, "step_physics": 0.07363619168599446, "survival_time": 14.950000000000076, "driven_lanedir": 4.281332281212943, "get_state_dump": 0.01361569325129191, "sim_render-ego": 0.00585776408513387, "get_robot_state": 0.01495108922322591, "get_duckie_state": 2.5224685668945313e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.0170846422513326, "deviation-heading": 3.612319807501829, "complete-iteration": 0.19095460335413617, "set_robot_commands": 0.004646246433258057, "deviation-center-line": 1.0111805149579205, "driven_lanedir_consec": 4.281332281212943, "sim_compute_sim_state": 0.023840214411417645, "sim_compute_performance-ego": 0.003987802664438884}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.965960279277321, "get_ui_image": 0.03496605316797892, "step_physics": 0.07878031651178996, "survival_time": 14.950000000000076, "driven_lanedir": 2.63165082579935, "get_state_dump": 0.013398366769154868, "sim_render-ego": 0.005975869496663412, "get_robot_state": 0.015486995379130043, "get_duckie_state": 2.533594767252604e-06, "in-drivable-lane": 3.500000000000038, "agent_compute-ego": 0.017505478064219156, "deviation-heading": 4.185682316256447, "complete-iteration": 0.1995145837465922, "set_robot_commands": 0.004777291615804037, "deviation-center-line": 0.7761246894107738, "driven_lanedir_consec": 2.63165082579935, "sim_compute_sim_state": 0.024409724871317547, "sim_compute_performance-ego": 0.004050266742706299}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.37853552059879, "get_ui_image": 0.035307926336924235, "step_physics": 0.08340153773625691, "survival_time": 14.950000000000076, "driven_lanedir": 2.727689812656802, "get_state_dump": 0.013589341640472413, "sim_render-ego": 0.0058132688204447424, "get_robot_state": 0.014584360122680664, "get_duckie_state": 2.5224685668945313e-06, "in-drivable-lane": 4.950000000000052, "agent_compute-ego": 0.01721592664718628, "deviation-heading": 3.189032980337454, "complete-iteration": 0.20657628536224365, "set_robot_commands": 0.004661142826080322, "deviation-center-line": 0.7949597529137314, "driven_lanedir_consec": 2.1914110150125263, "sim_compute_sim_state": 0.027855899333953858, "sim_compute_performance-ego": 0.003980300426483154}}
set_robot_commands_max	0.004777291615804037
set_robot_commands_mean	0.00465646227200826
set_robot_commands_median	0.00465369462966919
set_robot_commands_min	0.004541168212890625
sim_compute_performance-ego_max	0.004050266742706299
sim_compute_performance-ego_mean	0.003928188482920329
sim_compute_performance-ego_median	0.003984051545461019
sim_compute_performance-ego_min	0.0036943840980529783
sim_compute_sim_state_max	0.027855899333953858
sim_compute_sim_state_mean	0.024803807139396665
sim_compute_sim_state_median	0.02412496964136759
sim_compute_sim_state_min	0.023109389940897625
sim_render-ego_max	0.005975869496663412
sim_render-ego_mean	0.005773555239041646
sim_render-ego_median	0.005835516452789307
sim_render-ego_min	0.00544731855392456
simulation-passed	1
step_physics_max	0.08340153773625691
step_physics_mean	0.07665188411871592
step_physics_median	0.0762082540988922
step_physics_min	0.07078949054082234
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43879

11769

Ayman Shams 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-28 20:22:36+00:00

2020-11-28 20:29:12+00:00

0:06:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7910206304739127
survival_time_median	13.100000000000051
deviation-center-line_median	0.35630012331903793
in-drivable-lane_median	2.700000000000019

other stats

agent_compute-ego_max	0.01693153805202908
agent_compute-ego_mean	0.016742092750520784
agent_compute-ego_median	0.016709713538487752
agent_compute-ego_min	0.016617405873078566
complete-iteration_max	0.18598109483718872
complete-iteration_mean	0.1748709275656276
complete-iteration_median	0.17167016254531012
complete-iteration_min	0.17016229033470154
deviation-center-line_max	0.7218735843005575
deviation-center-line_mean	0.40282852568861965
deviation-center-line_min	0.17684027181584527
deviation-heading_max	1.1365278687573817
deviation-heading_mean	0.9711951253794164
deviation-heading_median	0.967812175861682
deviation-heading_min	0.8126282810369196
driven_any_max	1.9399996348261344
driven_any_mean	1.4919667305801312
driven_any_median	1.6912084493259512
driven_any_min	0.6454503888424866
driven_lanedir_consec_max	1.9186853775917605
driven_lanedir_consec_mean	0.9784849058253248
driven_lanedir_consec_min	0.4132129847617136
driven_lanedir_max	1.9186853775917605
driven_lanedir_mean	0.9784849058253248
driven_lanedir_median	0.7910206304739127
driven_lanedir_min	0.4132129847617136
get_duckie_state_max	3.345277574327257e-06
get_duckie_state_mean	3.209592949630868e-06
get_duckie_state_median	3.2472610473632815e-06
get_duckie_state_min	2.9985721294696514e-06
get_robot_state_max	0.01153975009918213
get_robot_state_mean	0.011439893166733604
get_robot_state_median	0.011421625058875125
get_robot_state_min	0.011376572450002035
get_state_dump_max	0.012246383825937906
get_state_dump_mean	0.011973448006006387
get_state_dump_median	0.011913091356937702
get_state_dump_min	0.01182122548421224
get_ui_image_max	0.033013083934783936
get_ui_image_mean	0.031971432500415384
get_ui_image_median	0.03175884114371406
get_ui_image_min	0.03135496377944946
in-drivable-lane_max	9.500000000000089
in-drivable-lane_mean	3.725000000000032
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4424172638257804, "get_ui_image": 0.03153773837619358, "step_physics": 0.06603794627719456, "survival_time": 11.250000000000025, "driven_lanedir": 0.9389695775069216, "get_state_dump": 0.01182122548421224, "sim_render-ego": 0.00502298355102539, "get_robot_state": 0.011397216584947372, "get_duckie_state": 3.345277574327257e-06, "in-drivable-lane": 3.750000000000043, "agent_compute-ego": 0.01693153805202908, "deviation-heading": 0.8126282810369196, "complete-iteration": 0.17153486781650118, "set_robot_commands": 0.00453956921895345, "deviation-center-line": 0.7218735843005575, "driven_lanedir_consec": 0.9389695775069216, "sim_compute_sim_state": 0.02071735594007704, "sim_compute_performance-ego": 0.003397211498684353}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6454503888424866, "get_ui_image": 0.03135496377944946, "step_physics": 0.06668935830776508, "survival_time": 5.1999999999999895, "driven_lanedir": 0.4132129847617136, "get_state_dump": 0.011928597321877113, "sim_render-ego": 0.005180173195325411, "get_robot_state": 0.011446033532802876, "get_duckie_state": 2.9985721294696514e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.016617405873078566, "deviation-heading": 0.8842443267371751, "complete-iteration": 0.17016229033470154, "set_robot_commands": 0.004272937774658203, "deviation-center-line": 0.3181776078572893, "driven_lanedir_consec": 0.4132129847617136, "sim_compute_sim_state": 0.019078887425936185, "sim_compute_performance-ego": 0.0034661545203282284}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399996348261344, "get_ui_image": 0.031979943911234536, "step_physics": 0.06665627241134643, "survival_time": 14.950000000000076, "driven_lanedir": 0.6430716834409038, "get_state_dump": 0.01189758539199829, "sim_render-ego": 0.00507360855738322, "get_robot_state": 0.011376572450002035, "get_duckie_state": 3.256797790527344e-06, "in-drivable-lane": 9.500000000000089, "agent_compute-ego": 0.016730984052022297, "deviation-heading": 1.0513800249861889, "complete-iteration": 0.17180545727411906, "set_robot_commands": 0.004529705047607422, "deviation-center-line": 0.17684027181584527, "driven_lanedir_consec": 0.6430716834409038, "sim_compute_sim_state": 0.020036625067392982, "sim_compute_performance-ego": 0.003391247590382894}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939999634826122, "get_ui_image": 0.033013083934783936, "step_physics": 0.07629620869954427, "survival_time": 14.950000000000076, "driven_lanedir": 1.9186853775917605, "get_state_dump": 0.012246383825937906, "sim_render-ego": 0.0050312479337056475, "get_robot_state": 0.01153975009918213, "get_duckie_state": 3.2377243041992188e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016688443024953207, "deviation-heading": 1.1365278687573817, "complete-iteration": 0.18598109483718872, "set_robot_commands": 0.004330944220225016, "deviation-center-line": 0.3944226387807866, "driven_lanedir_consec": 1.9186853775917605, "sim_compute_sim_state": 0.023325053056081135, "sim_compute_performance-ego": 0.0033800339698791503}}
set_robot_commands_max	0.00453956921895345
set_robot_commands_mean	0.004418289065361023
set_robot_commands_median	0.004430324633916219
set_robot_commands_min	0.004272937774658203
sim_compute_performance-ego_max	0.0034661545203282284
sim_compute_performance-ego_mean	0.003408661894818657
sim_compute_performance-ego_median	0.0033942295445336234
sim_compute_performance-ego_min	0.0033800339698791503
sim_compute_sim_state_max	0.023325053056081135
sim_compute_sim_state_mean	0.020789480372371837
sim_compute_sim_state_median	0.020376990503735013
sim_compute_sim_state_min	0.019078887425936185
sim_render-ego_max	0.005180173195325411
sim_render-ego_mean	0.005077003309359917
sim_render-ego_median	0.005052428245544433
sim_render-ego_min	0.00502298355102539
simulation-passed	1
step_physics_max	0.07629620869954427
step_physics_mean	0.06891994642396258
step_physics_median	0.06667281535955576
step_physics_min	0.06603794627719456
survival_time_max	14.950000000000076
survival_time_mean	11.58750000000004
survival_time_min	5.1999999999999895

No reset possible

43872

11766

Ayman Shams 🇨🇦

sim-exercise-2

LFv-sim

failed

2020-11-28 13:19:26+00:00

2020-11-28 13:25:05+00:00

0:05:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 477 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43857

11763

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-28 05:15:17+00:00

2020-11-28 05:23:56+00:00

0:08:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6257840498627278
survival_time_median	14.950000000000076
deviation-center-line_median	0.2662297105297303
in-drivable-lane_median	11.225000000000072

other stats

agent_compute-ego_max	0.017272332509358723
agent_compute-ego_mean	0.016726403832435607
agent_compute-ego_median	0.016616246302922567
agent_compute-ego_min	0.016400790214538573
complete-iteration_max	0.1967672443389893
complete-iteration_mean	0.1857793688774109
complete-iteration_median	0.18308100938797
complete-iteration_min	0.18018821239471436
deviation-center-line_max	0.3129122111361171
deviation-center-line_mean	0.2537243146842394
deviation-center-line_min	0.16952562654137993
deviation-heading_max	1.775678642159245
deviation-heading_mean	1.0947456795208683
deviation-heading_median	0.960044733236402
deviation-heading_min	0.6832146094514256
driven_any_max	3.434053844023004
driven_any_mean	3.3683937039882736
driven_any_median	3.366264701859695
driven_any_min	3.3069915682107016
driven_lanedir_consec_max	0.7873381943878461
driven_lanedir_consec_mean	0.6182784518516063
driven_lanedir_consec_min	0.4342075132931238
driven_lanedir_max	0.7873381943878461
driven_lanedir_mean	0.6182784518516063
driven_lanedir_median	0.6257840498627278
driven_lanedir_min	0.4342075132931238
get_duckie_state_max	2.346038818359375e-06
get_duckie_state_mean	2.291997273763021e-06
get_duckie_state_median	2.2864341735839843e-06
get_duckie_state_min	2.2490819295247396e-06
get_robot_state_max	0.014153040250142416
get_robot_state_mean	0.01335704783598582
get_robot_state_median	0.013278987407684326
get_robot_state_min	0.01271717627843221
get_state_dump_max	0.012867545286814372
get_state_dump_mean	0.012747363845507304
get_state_dump_median	0.0127874223391215
get_state_dump_min	0.012547065416971842
get_ui_image_max	0.033814013799031574
get_ui_image_mean	0.032863151431083676
get_ui_image_median	0.03275093475977579
get_ui_image_min	0.03213672240575154
in-drivable-lane_max	12.450000000000076
in-drivable-lane_mean	11.512500000000076
in-drivable-lane_min	11.150000000000084
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.4088606165417996, "get_ui_image": 0.03213672240575154, "step_physics": 0.07006652116775512, "survival_time": 14.950000000000076, "driven_lanedir": 0.7873381943878461, "get_state_dump": 0.012547065416971842, "sim_render-ego": 0.005429012775421143, "get_robot_state": 0.014153040250142416, "get_duckie_state": 2.346038818359375e-06, "in-drivable-lane": 11.200000000000063, "agent_compute-ego": 0.016400790214538573, "deviation-heading": 0.8448278149844484, "complete-iteration": 0.18201247135798135, "set_robot_commands": 0.004731438954671224, "deviation-center-line": 0.3129122111361171, "driven_lanedir_consec": 0.7873381943878461, "sim_compute_sim_state": 0.022740076382954916, "sim_compute_performance-ego": 0.003677972157796224}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.3069915682107016, "get_ui_image": 0.03251980463663737, "step_physics": 0.0703216004371643, "survival_time": 14.950000000000076, "driven_lanedir": 0.6931134577918705, "get_state_dump": 0.012764746348063152, "sim_render-ego": 0.005298568407694499, "get_robot_state": 0.01271717627843221, "get_duckie_state": 2.2490819295247396e-06, "in-drivable-lane": 11.150000000000084, "agent_compute-ego": 0.01664202133814494, "deviation-heading": 1.0752616514883555, "complete-iteration": 0.18018821239471436, "set_robot_commands": 0.0042902191480000814, "deviation-center-line": 0.23855515534155036, "driven_lanedir_consec": 0.6931134577918705, "sim_compute_sim_state": 0.021938651402791345, "sim_compute_performance-ego": 0.0035678370793660484}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.434053844023004, "get_ui_image": 0.032982064882914226, "step_physics": 0.07077844381332397, "survival_time": 14.950000000000076, "driven_lanedir": 0.5584546419335852, "get_state_dump": 0.012867545286814372, "sim_render-ego": 0.005393163363138834, "get_robot_state": 0.013746357758839926, "get_duckie_state": 2.3070971171061196e-06, "in-drivable-lane": 11.250000000000082, "agent_compute-ego": 0.017272332509358723, "deviation-heading": 1.775678642159245, "complete-iteration": 0.18414954741795855, "set_robot_commands": 0.0046413826942443845, "deviation-center-line": 0.2939042657179103, "driven_lanedir_consec": 0.5584546419335852, "sim_compute_sim_state": 0.022715078194936116, "sim_compute_performance-ego": 0.003620712757110596}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.32366878717759, "get_ui_image": 0.033814013799031574, "step_physics": 0.08191334724426269, "survival_time": 14.950000000000076, "driven_lanedir": 0.4342075132931238, "get_state_dump": 0.01281009833017985, "sim_render-ego": 0.005188825925191243, "get_robot_state": 0.012811617056528729, "get_duckie_state": 2.265771230061849e-06, "in-drivable-lane": 12.450000000000076, "agent_compute-ego": 0.016590471267700194, "deviation-heading": 0.6832146094514256, "complete-iteration": 0.1967672443389893, "set_robot_commands": 0.004475735028584798, "deviation-center-line": 0.16952562654137993, "driven_lanedir_consec": 0.4342075132931238, "sim_compute_sim_state": 0.025490028858184813, "sim_compute_performance-ego": 0.00354081392288208}}
set_robot_commands_max	0.004731438954671224
set_robot_commands_mean	0.0045346939563751226
set_robot_commands_median	0.0045585588614145914
set_robot_commands_min	0.0042902191480000814
sim_compute_performance-ego_max	0.003677972157796224
sim_compute_performance-ego_mean	0.003601833979288737
sim_compute_performance-ego_median	0.003594274918238322
sim_compute_performance-ego_min	0.00354081392288208
sim_compute_sim_state_max	0.025490028858184813
sim_compute_sim_state_mean	0.023220958709716796
sim_compute_sim_state_median	0.022727577288945516
sim_compute_sim_state_min	0.021938651402791345
sim_render-ego_max	0.005429012775421143
sim_render-ego_mean	0.00532739261786143
sim_render-ego_median	0.005345865885416667
sim_render-ego_min	0.005188825925191243
simulation-passed	1
step_physics_max	0.08191334724426269
step_physics_mean	0.07326997816562653
step_physics_median	0.07055002212524414
step_physics_min	0.07006652116775512
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43827

11753

Étienne Boucher 🇨🇦

real-exercise-2

LFv-sim

success

2020-11-27 03:45:23+00:00

2020-11-27 03:54:09+00:00

0:08:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.337807977291653
survival_time_median	14.950000000000076
deviation-center-line_median	0.6988991102424551
in-drivable-lane_median	3.700000000000046

other stats

agent_compute-ego_max	0.017639148235321044
agent_compute-ego_mean	0.017057451009750365
agent_compute-ego_median	0.01694030523300171
agent_compute-ego_min	0.016710045337677
complete-iteration_max	0.2010907832781474
complete-iteration_mean	0.19123312989870703
complete-iteration_median	0.19086091637611388
complete-iteration_min	0.18211990356445312
deviation-center-line_max	1.2282589815255749
deviation-center-line_mean	0.6962699568073288
deviation-center-line_min	0.1590226252188303
deviation-heading_max	4.235347809304464
deviation-heading_mean	2.7728588240372822
deviation-heading_median	2.8984272864941305
deviation-heading_min	1.059232913856405
driven_any_max	1.939927360706658
driven_any_mean	1.938317566052914
driven_any_median	1.9398623428071828
driven_any_min	1.9336182178906325
driven_lanedir_consec_max	1.8719384803245964
driven_lanedir_consec_mean	1.2737879510345833
driven_lanedir_consec_min	0.5475973692304318
driven_lanedir_max	1.8719384803245964
driven_lanedir_mean	1.2765460393215935
driven_lanedir_median	1.3433241538656728
driven_lanedir_min	0.5475973692304318
get_duckie_state_max	2.464453379313151e-06
get_duckie_state_mean	2.403855323791504e-06
get_duckie_state_median	2.417564392089844e-06
get_duckie_state_min	2.315839131673177e-06
get_robot_state_max	0.014297649065653483
get_robot_state_mean	0.013999799887339275
get_robot_state_median	0.014048576354980469
get_robot_state_min	0.013604397773742677
get_state_dump_max	0.013199456532796224
get_state_dump_mean	0.012989880243937177
get_state_dump_median	0.013143568833669027
get_state_dump_min	0.01247292677561442
get_ui_image_max	0.03456921895345052
get_ui_image_mean	0.03351623594760895
get_ui_image_median	0.03367000778516134
get_ui_image_min	0.0321557092666626
in-drivable-lane_max	10.100000000000088
in-drivable-lane_mean	4.375000000000044
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336182178906325, "get_ui_image": 0.0321557092666626, "step_physics": 0.07147733608881633, "survival_time": 14.950000000000076, "driven_lanedir": 0.8995355018326334, "get_state_dump": 0.01247292677561442, "sim_render-ego": 0.005543867746988933, "get_robot_state": 0.013604397773742677, "get_duckie_state": 2.315839131673177e-06, "in-drivable-lane": 7.0500000000000895, "agent_compute-ego": 0.017149488131205242, "deviation-heading": 2.5903961295204843, "complete-iteration": 0.18211990356445312, "set_robot_commands": 0.004504115581512451, "deviation-center-line": 0.4423543112693721, "driven_lanedir_consec": 0.8885031486845933, "sim_compute_sim_state": 0.02137692928314209, "sim_compute_performance-ego": 0.0036835058530171713}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399097589724696, "get_ui_image": 0.033490479787190754, "step_physics": 0.07328340609868368, "survival_time": 14.950000000000076, "driven_lanedir": 1.7871128058987122, "get_state_dump": 0.013184642791748047, "sim_render-ego": 0.005582521756490072, "get_robot_state": 0.014297649065653483, "get_duckie_state": 2.464453379313151e-06, "in-drivable-lane": 0.3500000000000023, "agent_compute-ego": 0.016710045337677, "deviation-heading": 4.235347809304464, "complete-iteration": 0.18702844778696695, "set_robot_commands": 0.004632670879364014, "deviation-center-line": 1.2282589815255749, "driven_lanedir_consec": 1.7871128058987122, "sim_compute_sim_state": 0.021861798763275143, "sim_compute_performance-ego": 0.003820521036783854}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939814926641896, "get_ui_image": 0.03384953578313192, "step_physics": 0.07947281281153361, "survival_time": 14.950000000000076, "driven_lanedir": 0.5475973692304318, "get_state_dump": 0.013102494875590006, "sim_render-ego": 0.005716721216837565, "get_robot_state": 0.0139620836575826, "get_duckie_state": 2.4135907491048176e-06, "in-drivable-lane": 10.100000000000088, "agent_compute-ego": 0.017639148235321044, "deviation-heading": 1.059232913856405, "complete-iteration": 0.1946933849652608, "set_robot_commands": 0.004598469734191895, "deviation-center-line": 0.1590226252188303, "driven_lanedir_consec": 0.5475973692304318, "sim_compute_sim_state": 0.02238235870997111, "sim_compute_performance-ego": 0.003805542786916097}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939927360706658, "get_ui_image": 0.03456921895345052, "step_physics": 0.08262464046478271, "survival_time": 14.950000000000076, "driven_lanedir": 1.8719384803245964, "get_state_dump": 0.013199456532796224, "sim_render-ego": 0.005631929238637289, "get_robot_state": 0.014135069052378336, "get_duckie_state": 2.4215380350748697e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016731122334798176, "deviation-heading": 3.2064584434677763, "complete-iteration": 0.2010907832781474, "set_robot_commands": 0.004531672795613607, "deviation-center-line": 0.955443909215538, "driven_lanedir_consec": 1.8719384803245964, "sim_compute_sim_state": 0.025691418647766112, "sim_compute_performance-ego": 0.00380989948908488}}
set_robot_commands_max	0.004632670879364014
set_robot_commands_mean	0.004566732247670492
set_robot_commands_median	0.004565071264902751
set_robot_commands_min	0.004504115581512451
sim_compute_performance-ego_max	0.003820521036783854
sim_compute_performance-ego_mean	0.0037798672914505
sim_compute_performance-ego_median	0.003807721138000488
sim_compute_performance-ego_min	0.0036835058530171713
sim_compute_sim_state_max	0.025691418647766112
sim_compute_sim_state_mean	0.022828126351038616
sim_compute_sim_state_median	0.022122078736623127
sim_compute_sim_state_min	0.02137692928314209
sim_render-ego_max	0.005716721216837565
sim_render-ego_mean	0.005618759989738465
sim_render-ego_median	0.00560722549756368
sim_render-ego_min	0.005543867746988933
simulation-passed	1
step_physics_max	0.08262464046478271
step_physics_mean	0.07671454886595408
step_physics_median	0.07637810945510864
step_physics_min	0.07147733608881633
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43804

11749

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-27 01:42:58+00:00

2020-11-27 01:52:09+00:00

0:09:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.810014676075399
survival_time_median	14.950000000000076
deviation-center-line_median	0.6431667772422152
in-drivable-lane_median	6.025000000000013

other stats

agent_compute-ego_max	0.017265838781992594
agent_compute-ego_mean	0.017178345719973245
agent_compute-ego_median	0.01717423478762309
agent_compute-ego_min	0.017099074522654214
complete-iteration_max	0.1917069403330485
complete-iteration_mean	0.18540827890237171
complete-iteration_median	0.183679518699646
complete-iteration_min	0.1825671378771464
deviation-center-line_max	1.262519897302883
deviation-center-line_mean	0.6786813278784518
deviation-center-line_min	0.16587185972649418
deviation-heading_max	2.7763366972980794
deviation-heading_mean	1.9360282281047647
deviation-heading_median	2.04319622559935
deviation-heading_min	0.88138376392228
driven_any_max	3.841296403535681
driven_any_mean	3.356148378174271
driven_any_median	3.2774324963639625
driven_any_min	3.028432116433478
driven_lanedir_consec_max	3.664075018287421
driven_lanedir_consec_mean	1.984276423579508
driven_lanedir_consec_min	0.6530013238798134
driven_lanedir_max	3.664075018287421
driven_lanedir_mean	1.984276423579508
driven_lanedir_median	1.810014676075399
driven_lanedir_min	0.6530013238798134
get_duckie_state_max	2.2109349568684896e-06
get_duckie_state_mean	2.132852872212728e-06
get_duckie_state_median	2.1298726399739584e-06
get_duckie_state_min	2.060731252034505e-06
get_robot_state_max	0.013675572077433269
get_robot_state_mean	0.0132428111632665
get_robot_state_median	0.0131192942460378
get_robot_state_min	0.013057084083557128
get_state_dump_max	0.013298505147298178
get_state_dump_mean	0.013071484367052714
get_state_dump_median	0.013121574719746908
get_state_dump_min	0.012744282881418864
get_ui_image_max	0.033864644368489585
get_ui_image_mean	0.033312978545824684
get_ui_image_median	0.03342716097831726
get_ui_image_min	0.03253294785817464
in-drivable-lane_max	11.350000000000083
in-drivable-lane_mean	5.887500000000028
in-drivable-lane_min	0.15000000000000213
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.133918437263663, "get_ui_image": 0.03253294785817464, "step_physics": 0.06971397876739502, "survival_time": 14.950000000000076, "driven_lanedir": 0.6530013238798134, "get_state_dump": 0.013298505147298178, "sim_render-ego": 0.0055025474230448405, "get_robot_state": 0.013675572077433269, "get_duckie_state": 2.2109349568684896e-06, "in-drivable-lane": 11.350000000000083, "agent_compute-ego": 0.017099074522654214, "deviation-heading": 0.88138376392228, "complete-iteration": 0.18296043395996095, "set_robot_commands": 0.004523033301035563, "deviation-center-line": 0.16587185972649418, "driven_lanedir_consec": 0.6530013238798134, "sim_compute_sim_state": 0.02276730219523112, "sim_compute_performance-ego": 0.003710668881734213}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.4209465554642624, "get_ui_image": 0.033864644368489585, "step_physics": 0.07021005074183147, "survival_time": 14.950000000000076, "driven_lanedir": 2.3564355608601653, "get_state_dump": 0.01315579652786255, "sim_render-ego": 0.005289852619171143, "get_robot_state": 0.01305792252222697, "get_duckie_state": 2.1314620971679686e-06, "in-drivable-lane": 4.349999999999997, "agent_compute-ego": 0.017148531277974447, "deviation-heading": 2.106990610656373, "complete-iteration": 0.1825671378771464, "set_robot_commands": 0.004415873686472575, "deviation-center-line": 0.7088215383853712, "driven_lanedir_consec": 2.3564355608601653, "sim_compute_sim_state": 0.02175709962844849, "sim_compute_performance-ego": 0.003531601428985596}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.028432116433478, "get_ui_image": 0.03322478214899699, "step_physics": 0.07147716204325358, "survival_time": 14.950000000000076, "driven_lanedir": 1.2635937912906323, "get_state_dump": 0.012744282881418864, "sim_render-ego": 0.00543930451075236, "get_robot_state": 0.013180665969848631, "get_duckie_state": 2.1282831827799477e-06, "in-drivable-lane": 7.700000000000029, "agent_compute-ego": 0.017265838781992594, "deviation-heading": 2.7763366972980794, "complete-iteration": 0.1843986034393311, "set_robot_commands": 0.004432730674743653, "deviation-center-line": 0.5775120160990591, "driven_lanedir_consec": 1.2635937912906323, "sim_compute_sim_state": 0.022890547116597493, "sim_compute_performance-ego": 0.0036048070589701337}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.841296403535681, "get_ui_image": 0.03362953980763753, "step_physics": 0.07515829563140869, "survival_time": 14.950000000000076, "driven_lanedir": 3.664075018287421, "get_state_dump": 0.013087352911631269, "sim_render-ego": 0.005407646497090657, "get_robot_state": 0.013057084083557128, "get_duckie_state": 2.060731252034505e-06, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.01719993829727173, "deviation-heading": 1.9794018405423264, "complete-iteration": 0.1917069403330485, "set_robot_commands": 0.004460391203562419, "deviation-center-line": 1.262519897302883, "driven_lanedir_consec": 3.664075018287421, "sim_compute_sim_state": 0.025915261109670004, "sim_compute_performance-ego": 0.003655935923258463}}
set_robot_commands_max	0.004523033301035563
set_robot_commands_mean	0.004458007216453552
set_robot_commands_median	0.004446560939153035
set_robot_commands_min	0.004415873686472575
sim_compute_performance-ego_max	0.003710668881734213
sim_compute_performance-ego_mean	0.003625753323237102
sim_compute_performance-ego_median	0.0036303714911142984
sim_compute_performance-ego_min	0.003531601428985596
sim_compute_sim_state_max	0.025915261109670004
sim_compute_sim_state_mean	0.023332552512486775
sim_compute_sim_state_median	0.022828924655914302
sim_compute_sim_state_min	0.02175709962844849
sim_render-ego_max	0.0055025474230448405
sim_render-ego_mean	0.00540983776251475
sim_render-ego_median	0.005423475503921509
sim_render-ego_min	0.005289852619171143
simulation-passed	1
step_physics_max	0.07515829563140869
step_physics_mean	0.0716398717959722
step_physics_median	0.07084360639254253
step_physics_min	0.06971397876739502
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43791

11742

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 21:08:12+00:00

2020-11-26 21:16:42+00:00

0:08:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.483273464490283
survival_time_median	14.950000000000076
deviation-center-line_median	0.7979642262827069
in-drivable-lane_median	1.2750000000000008

other stats

agent_compute-ego_max	0.01730094830195109
agent_compute-ego_mean	0.016805344422658283
agent_compute-ego_median	0.016711267630259194
agent_compute-ego_min	0.016497894128163656
complete-iteration_max	0.19463542699813843
complete-iteration_mean	0.18788397709528604
complete-iteration_median	0.1862804440657298
complete-iteration_min	0.18433959325154625
deviation-center-line_max	1.1967245412216214
deviation-center-line_mean	0.8602024992980843
deviation-center-line_min	0.6481570034053019
deviation-heading_max	4.646550075095954
deviation-heading_mean	3.759414526030523
deviation-heading_median	3.773652076710166
deviation-heading_min	2.8438038756058055
driven_any_max	3.235586871594644
driven_any_mean	2.898123329827074
driven_any_median	2.9136570025714357
driven_any_min	2.5295924425707796
driven_lanedir_consec_max	3.060903395666574
driven_lanedir_consec_mean	2.496461034454343
driven_lanedir_consec_min	1.9583938131702316
driven_lanedir_max	3.060903395666574
driven_lanedir_mean	2.496461034454343
driven_lanedir_median	2.483273464490283
driven_lanedir_min	1.9583938131702316
get_duckie_state_max	3.370443979899089e-06
get_duckie_state_mean	3.272692362467448e-06
get_duckie_state_median	3.3100446065266926e-06
get_duckie_state_min	3.100236256917318e-06
get_robot_state_max	0.0147615647315979
get_robot_state_mean	0.013740153312683105
get_robot_state_median	0.013694821198781333
get_robot_state_min	0.01280940612157186
get_state_dump_max	0.012903338273366292
get_state_dump_mean	0.012673139572143556
get_state_dump_median	0.012733190854390465
get_state_dump_min	0.012322838306427004
get_ui_image_max	0.035779477755228675
get_ui_image_mean	0.03378475566705068
get_ui_image_median	0.0333454700311025
get_ui_image_min	0.03266860485076904
in-drivable-lane_max	4.20000000000006
in-drivable-lane_mean	1.775000000000015
in-drivable-lane_min	0.34999999999999876
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.136423293687378, "get_ui_image": 0.03266860485076904, "step_physics": 0.0704366103808085, "survival_time": 14.950000000000076, "driven_lanedir": 2.9769112527897477, "get_state_dump": 0.012803004582722982, "sim_render-ego": 0.005632285277048747, "get_robot_state": 0.014551595052083331, "get_duckie_state": 3.370443979899089e-06, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.0167883563041687, "deviation-heading": 3.3725000245354444, "complete-iteration": 0.18433959325154625, "set_robot_commands": 0.004802772998809815, "deviation-center-line": 0.8020429188992375, "driven_lanedir_consec": 2.9769112527897477, "sim_compute_sim_state": 0.022794331709543866, "sim_compute_performance-ego": 0.0037288077672322593}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.690890711455493, "get_ui_image": 0.035779477755228675, "step_physics": 0.07473261515299479, "survival_time": 14.950000000000076, "driven_lanedir": 1.9896356761908187, "get_state_dump": 0.012903338273366292, "sim_render-ego": 0.005313099225362142, "get_robot_state": 0.01283804734547933, "get_duckie_state": 3.2901763916015627e-06, "in-drivable-lane": 4.20000000000006, "agent_compute-ego": 0.01663417895634969, "deviation-heading": 4.174804128884888, "complete-iteration": 0.18799691279729208, "set_robot_commands": 0.004317154884338379, "deviation-center-line": 0.6481570034053019, "driven_lanedir_consec": 1.9896356761908187, "sim_compute_sim_state": 0.021781226793924968, "sim_compute_performance-ego": 0.0035639588038126626}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5295924425707796, "get_ui_image": 0.03320784330368042, "step_physics": 0.07359423160552979, "survival_time": 14.950000000000076, "driven_lanedir": 1.9583938131702316, "get_state_dump": 0.012663377126057944, "sim_render-ego": 0.005236125787099202, "get_robot_state": 0.01280940612157186, "get_duckie_state": 3.329912821451823e-06, "in-drivable-lane": 2.0499999999999945, "agent_compute-ego": 0.01730094830195109, "deviation-heading": 4.646550075095954, "complete-iteration": 0.1845639753341675, "set_robot_commands": 0.004484153588612874, "deviation-center-line": 1.1967245412216214, "driven_lanedir_consec": 1.9583938131702316, "sim_compute_sim_state": 0.021625778675079345, "sim_compute_performance-ego": 0.0035065499941507976}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.235586871594644, "get_ui_image": 0.03348309675852457, "step_physics": 0.0787382729848226, "survival_time": 14.950000000000076, "driven_lanedir": 3.060903395666574, "get_state_dump": 0.012322838306427004, "sim_render-ego": 0.0054140845934549965, "get_robot_state": 0.0147615647315979, "get_duckie_state": 3.100236256917318e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.016497894128163656, "deviation-heading": 2.8438038756058055, "complete-iteration": 0.19463542699813843, "set_robot_commands": 0.0046257718404134115, "deviation-center-line": 0.7938855336661763, "driven_lanedir_consec": 3.060903395666574, "sim_compute_sim_state": 0.025112797419230143, "sim_compute_performance-ego": 0.0035471455256144207}}
set_robot_commands_max	0.004802772998809815
set_robot_commands_mean	0.0045574633280436195
set_robot_commands_median	0.004554962714513142
set_robot_commands_min	0.004317154884338379
sim_compute_performance-ego_max	0.0037288077672322593
sim_compute_performance-ego_mean	0.0035866155227025354
sim_compute_performance-ego_median	0.0035555521647135414
sim_compute_performance-ego_min	0.0035065499941507976
sim_compute_sim_state_max	0.025112797419230143
sim_compute_sim_state_mean	0.02282853364944458
sim_compute_sim_state_median	0.02228777925173442
sim_compute_sim_state_min	0.021625778675079345
sim_render-ego_max	0.005632285277048747
sim_render-ego_mean	0.005398898720741272
sim_render-ego_median	0.005363591909408569
sim_render-ego_min	0.005236125787099202
simulation-passed	1
step_physics_max	0.0787382729848226
step_physics_mean	0.07437543253103893
step_physics_median	0.0741634233792623
step_physics_min	0.0704366103808085
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43772

11738

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 20:54:16+00:00

2020-11-26 21:01:20+00:00

0:07:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.114749471104984
survival_time_median	11.17500000000003
deviation-center-line_median	0.3852201448456969
in-drivable-lane_median	5.275000000000006

other stats

agent_compute-ego_max	0.0177893328666687
agent_compute-ego_mean	0.017680686613818903
agent_compute-ego_median	0.017715676890479194
agent_compute-ego_min	0.01750205980764853
complete-iteration_max	0.21410284815607844
complete-iteration_mean	0.20490120147262608
complete-iteration_median	0.2041768491268158
complete-iteration_min	0.19714825948079423
deviation-center-line_max	0.5188432061353012
deviation-center-line_mean	0.3679990257082507
deviation-center-line_min	0.18271260700630793
deviation-heading_max	3.71613478672371
deviation-heading_mean	2.1687512742287787
deviation-heading_median	2.0593472878124026
deviation-heading_min	0.8401757345665994
driven_any_max	5.299957670988671
driven_any_mean	3.833739927469936
driven_any_median	4.0350686323419565
driven_any_min	1.964864774207159
driven_lanedir_consec_max	2.326605724685829
driven_lanedir_consec_mean	1.9446146251941636
driven_lanedir_consec_min	1.2223538338808573
driven_lanedir_max	2.331720547403243
driven_lanedir_mean	1.9458933308735171
driven_lanedir_median	2.114749471104984
driven_lanedir_min	1.2223538338808573
get_duckie_state_max	2.6808844672309026e-06
get_duckie_state_mean	2.6028829293924053e-06
get_duckie_state_median	2.6015440622965496e-06
get_duckie_state_min	2.5275591257456186e-06
get_robot_state_max	0.015681500434875487
get_robot_state_mean	0.015471479973277531
get_robot_state_median	0.015497217339438362
get_robot_state_min	0.01520998477935791
get_state_dump_max	0.013595183690388998
get_state_dump_mean	0.013415471530175424
get_state_dump_median	0.013404098781379494
get_state_dump_min	0.01325850486755371
get_ui_image_max	0.036371541817982994
get_ui_image_mean	0.03534388344746094
get_ui_image_median	0.035323526751887685
get_ui_image_min	0.03435693846808539
in-drivable-lane_max	8.650000000000048
in-drivable-lane_mean	5.125000000000013
in-drivable-lane_min	1.2999999999999954
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.964864774207159, "get_ui_image": 0.03435693846808539, "step_physics": 0.07834745513068306, "survival_time": 4.499999999999992, "driven_lanedir": 1.2223538338808573, "get_state_dump": 0.013595183690388998, "sim_render-ego": 0.005907061364915636, "get_robot_state": 0.01520998477935791, "get_duckie_state": 2.6808844672309026e-06, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.017728540632459853, "deviation-heading": 0.8401757345665994, "complete-iteration": 0.19714825948079423, "set_robot_commands": 0.00479120413462321, "deviation-center-line": 0.18271260700630793, "driven_lanedir_consec": 1.2223538338808573, "sim_compute_sim_state": 0.023114538192749026, "sim_compute_performance-ego": 0.0039513376024034284}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.299957670988671, "get_ui_image": 0.03478068987528483, "step_physics": 0.07813864866892496, "survival_time": 14.950000000000076, "driven_lanedir": 2.331720547403243, "get_state_dump": 0.01325850486755371, "sim_render-ego": 0.005928601423899333, "get_robot_state": 0.01548712968826294, "get_duckie_state": 2.653598785400391e-06, "in-drivable-lane": 8.650000000000048, "agent_compute-ego": 0.017702813148498534, "deviation-heading": 2.8874724567751433, "complete-iteration": 0.1984348424275716, "set_robot_commands": 0.004826482931772868, "deviation-center-line": 0.5188432061353012, "driven_lanedir_consec": 2.326605724685829, "sim_compute_sim_state": 0.024167585372924804, "sim_compute_performance-ego": 0.0039992833137512205}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.067208557584409, "get_ui_image": 0.036371541817982994, "step_physics": 0.08563819726308187, "survival_time": 14.950000000000076, "driven_lanedir": 2.0981681880897503, "get_state_dump": 0.013406088352203367, "sim_render-ego": 0.006205395062764485, "get_robot_state": 0.015681500434875487, "get_duckie_state": 2.5494893391927083e-06, "in-drivable-lane": 8.20000000000002, "agent_compute-ego": 0.0177893328666687, "deviation-heading": 3.71613478672371, "complete-iteration": 0.20991885582606, "set_robot_commands": 0.004810081322987874, "deviation-center-line": 0.4822265470100282, "driven_lanedir_consec": 2.0981681880897503, "sim_compute_sim_state": 0.02577518065770467, "sim_compute_performance-ego": 0.004089400768280029}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0029287070995045, "get_ui_image": 0.03586636362849055, "step_physics": 0.08953053725732339, "survival_time": 7.399999999999982, "driven_lanedir": 2.131330754120218, "get_state_dump": 0.01340210921055562, "sim_render-ego": 0.00606421844379322, "get_robot_state": 0.015507304990613783, "get_duckie_state": 2.5275591257456186e-06, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.01750205980764853, "deviation-heading": 1.231222118849662, "complete-iteration": 0.21410284815607844, "set_robot_commands": 0.004659776752059524, "deviation-center-line": 0.2882137426813655, "driven_lanedir_consec": 2.131330754120218, "sim_compute_sim_state": 0.02746205877613377, "sim_compute_performance-ego": 0.003955630031791893}}
set_robot_commands_max	0.004826482931772868
set_robot_commands_mean	0.004771886285360869
set_robot_commands_median	0.004800642728805542
set_robot_commands_min	0.004659776752059524
sim_compute_performance-ego_max	0.004089400768280029
sim_compute_performance-ego_mean	0.003998912929056643
sim_compute_performance-ego_median	0.003977456672771556
sim_compute_performance-ego_min	0.0039513376024034284
sim_compute_sim_state_max	0.02746205877613377
sim_compute_sim_state_mean	0.025129840749878063
sim_compute_sim_state_median	0.024971383015314735
sim_compute_sim_state_min	0.023114538192749026
sim_render-ego_max	0.006205395062764485
sim_render-ego_mean	0.006026319073843168
sim_render-ego_median	0.005996409933846276
sim_render-ego_min	0.005907061364915636
simulation-passed	1
step_physics_max	0.08953053725732339
step_physics_mean	0.08291370958000333
step_physics_median	0.08199282619688247
step_physics_min	0.07813864866892496
survival_time_max	14.950000000000076
survival_time_mean	10.450000000000031
survival_time_min	4.499999999999992

No reset possible

43756

11733

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 20:41:55+00:00

2020-11-26 20:51:07+00:00

0:09:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.756862518473267
survival_time_median	14.950000000000076
deviation-center-line_median	0.7982272549782192
in-drivable-lane_median	4.700000000000031

other stats

agent_compute-ego_max	0.017974977493286134
agent_compute-ego_mean	0.017391356428464254
agent_compute-ego_median	0.017341893116633096
agent_compute-ego_min	0.016906661987304686
complete-iteration_max	0.21513914823532104
complete-iteration_mean	0.2015311167637507
complete-iteration_median	0.2004580016930898
complete-iteration_min	0.1900693154335022
deviation-center-line_max	0.8275445069138895
deviation-center-line_mean	0.7830495913680331
deviation-center-line_min	0.7081993486018041
deviation-heading_max	5.046755855263478
deviation-heading_mean	3.828312325991796
deviation-heading_median	3.5051441552196865
deviation-heading_min	3.256205138264332
driven_any_max	4.078777933361583
driven_any_mean	3.670071572521014
driven_any_median	3.820972435536267
driven_any_min	2.9595634856499373
driven_lanedir_consec_max	3.087982709240912
driven_lanedir_consec_mean	2.5360760695350706
driven_lanedir_consec_min	1.5425965319528354
driven_lanedir_max	3.087982709240912
driven_lanedir_mean	2.548264290370759
driven_lanedir_median	2.780511400678237
driven_lanedir_min	1.54405165088565
get_duckie_state_max	2.5765101114908854e-06
get_duckie_state_mean	2.3915370305379233e-06
get_duckie_state_median	2.409219741821289e-06
get_duckie_state_min	2.1711985270182293e-06
get_robot_state_max	0.015744431813557943
get_robot_state_mean	0.015315407911936444
get_robot_state_median	0.015354617436726888
get_robot_state_min	0.01480796496073405
get_state_dump_max	0.01353053092956543
get_state_dump_mean	0.013247214555740357
get_state_dump_median	0.013221555550893146
get_state_dump_min	0.0130152161916097
get_ui_image_max	0.03666418313980103
get_ui_image_mean	0.034996113181114195
get_ui_image_median	0.03505059719085693
get_ui_image_min	0.03321907520294189
in-drivable-lane_max	6.300000000000027
in-drivable-lane_mean	4.900000000000027
in-drivable-lane_min	3.90000000000002
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.781863486528351, "get_ui_image": 0.03321907520294189, "step_physics": 0.07436009804407756, "survival_time": 14.950000000000076, "driven_lanedir": 2.72171936539448, "get_state_dump": 0.0130152161916097, "sim_render-ego": 0.0056892776489257816, "get_robot_state": 0.01480796496073405, "get_duckie_state": 2.3929278055826824e-06, "in-drivable-lane": 4.7000000000000215, "agent_compute-ego": 0.017010773817698163, "deviation-heading": 3.728136606353025, "complete-iteration": 0.1900693154335022, "set_robot_commands": 0.004547720750172933, "deviation-center-line": 0.7997519688969927, "driven_lanedir_consec": 2.67442160098454, "sim_compute_sim_state": 0.023464494546254475, "sim_compute_performance-ego": 0.003814850648244222}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.078777933361583, "get_ui_image": 0.03364274183909098, "step_physics": 0.07359693209330241, "survival_time": 14.950000000000076, "driven_lanedir": 3.087982709240912, "get_state_dump": 0.01316749652226766, "sim_render-ego": 0.005767892996470133, "get_robot_state": 0.015011199315388996, "get_duckie_state": 2.1711985270182293e-06, "in-drivable-lane": 3.90000000000002, "agent_compute-ego": 0.016906661987304686, "deviation-heading": 3.2821517040863477, "complete-iteration": 0.19029362360636393, "set_robot_commands": 0.004741048812866211, "deviation-center-line": 0.8275445069138895, "driven_lanedir_consec": 3.087982709240912, "sim_compute_sim_state": 0.02346746842066447, "sim_compute_performance-ego": 0.003854464689890544}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9595634856499373, "get_ui_image": 0.03666418313980103, "step_physics": 0.08747385104497274, "survival_time": 14.950000000000076, "driven_lanedir": 1.54405165088565, "get_state_dump": 0.013275614579518636, "sim_render-ego": 0.006263971328735352, "get_robot_state": 0.015744431813557943, "get_duckie_state": 2.5765101114908854e-06, "in-drivable-lane": 6.300000000000027, "agent_compute-ego": 0.017673012415568033, "deviation-heading": 5.046755855263478, "complete-iteration": 0.21062237977981568, "set_robot_commands": 0.0051045600573221845, "deviation-center-line": 0.7081993486018041, "driven_lanedir_consec": 1.5425965319528354, "sim_compute_sim_state": 0.024138164520263673, "sim_compute_performance-ego": 0.004130516052246094}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.8600813845441833, "get_ui_image": 0.036458452542622886, "step_physics": 0.08718843380610149, "survival_time": 14.950000000000076, "driven_lanedir": 2.8393034359619937, "get_state_dump": 0.01353053092956543, "sim_render-ego": 0.006158130963643392, "get_robot_state": 0.015698035558064777, "get_duckie_state": 2.425511678059896e-06, "in-drivable-lane": 4.70000000000004, "agent_compute-ego": 0.017974977493286134, "deviation-heading": 3.256205138264332, "complete-iteration": 0.21513914823532104, "set_robot_commands": 0.004796880086263021, "deviation-center-line": 0.7967025410594457, "driven_lanedir_consec": 2.8393034359619937, "sim_compute_sim_state": 0.02898500919342041, "sim_compute_performance-ego": 0.004192495346069336}}
set_robot_commands_max	0.0051045600573221845
set_robot_commands_mean	0.004797552426656087
set_robot_commands_median	0.004768964449564616
set_robot_commands_min	0.004547720750172933
sim_compute_performance-ego_max	0.004192495346069336
sim_compute_performance-ego_mean	0.003998081684112548
sim_compute_performance-ego_median	0.003992490371068319
sim_compute_performance-ego_min	0.003814850648244222
sim_compute_sim_state_max	0.02898500919342041
sim_compute_sim_state_mean	0.025013784170150755
sim_compute_sim_state_median	0.02380281647046407
sim_compute_sim_state_min	0.023464494546254475
sim_render-ego_max	0.006263971328735352
sim_render-ego_mean	0.005969818234443664
sim_render-ego_median	0.005963011980056762
sim_render-ego_min	0.0056892776489257816
simulation-passed	1
step_physics_max	0.08747385104497274
step_physics_mean	0.08065482874711355
step_physics_median	0.08077426592508952
step_physics_min	0.07359693209330241
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43740

11727

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 20:14:37+00:00

2020-11-26 20:23:16+00:00

0:08:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.7807548671007367
survival_time_median	14.950000000000076
deviation-center-line_median	1.0016584035062714
in-drivable-lane_median	1.250000000000015

other stats

agent_compute-ego_max	0.017125113010406492
agent_compute-ego_mean	0.016648457845052082
agent_compute-ego_median	0.016543033917744955
agent_compute-ego_min	0.01638265053431193
complete-iteration_max	0.20046080986658732
complete-iteration_mean	0.18865409394105273
complete-iteration_median	0.1911883016427358
complete-iteration_min	0.1717789626121521
deviation-center-line_max	1.1005322135375746
deviation-center-line_mean	0.9840430806442472
deviation-center-line_min	0.8323233020268715
deviation-heading_max	7.004165238665089
deviation-heading_mean	6.709960791812835
deviation-heading_median	6.875832683435178
deviation-heading_min	6.084012561715896
driven_any_max	2.5266161995047964
driven_any_mean	2.2420045058453795
driven_any_median	2.2054672050061166
driven_any_min	2.0304674138644865
driven_lanedir_consec_max	1.8033441740627651
driven_lanedir_consec_mean	1.7106882819570643
driven_lanedir_consec_min	1.477899219564019
driven_lanedir_max	1.8033441740627651
driven_lanedir_mean	1.7106882819570643
driven_lanedir_median	1.7807548671007367
driven_lanedir_min	1.477899219564019
get_duckie_state_max	2.292792002360026e-06
get_duckie_state_mean	2.155303955078125e-06
get_duckie_state_median	2.186298370361328e-06
get_duckie_state_min	1.9558270772298177e-06
get_robot_state_max	0.014340084393819171
get_robot_state_mean	0.013549031813939412
get_robot_state_median	0.01418353279431661
get_robot_state_min	0.011488977273305258
get_state_dump_max	0.01311466375986735
get_state_dump_mean	0.012766238451004028
get_state_dump_median	0.013046693404515584
get_state_dump_min	0.011856903235117594
get_ui_image_max	0.03497392972310384
get_ui_image_mean	0.033719749053319294
get_ui_image_median	0.03438286026318868
get_ui_image_min	0.03113934596379598
in-drivable-lane_max	2.1000000000000156
in-drivable-lane_mean	1.3125000000000138
in-drivable-lane_min	0.6500000000000092
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.218443037541834, "get_ui_image": 0.03113934596379598, "step_physics": 0.06757062196731567, "survival_time": 14.950000000000076, "driven_lanedir": 1.785606738288274, "get_state_dump": 0.011856903235117594, "sim_render-ego": 0.004933397769927978, "get_robot_state": 0.011488977273305258, "get_duckie_state": 1.9558270772298177e-06, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.01651047150293986, "deviation-heading": 6.816632409529645, "complete-iteration": 0.1717789626121521, "set_robot_commands": 0.004320177237192789, "deviation-center-line": 1.0106239467445162, "driven_lanedir_consec": 1.785606738288274, "sim_compute_sim_state": 0.020526161193847654, "sim_compute_performance-ego": 0.003314355214436849}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.0304674138644865, "get_ui_image": 0.03424562056859334, "step_physics": 0.07286559661229451, "survival_time": 14.950000000000076, "driven_lanedir": 1.477899219564019, "get_state_dump": 0.013014134565989176, "sim_render-ego": 0.005551982720692953, "get_robot_state": 0.014285790920257568, "get_duckie_state": 2.292792002360026e-06, "in-drivable-lane": 1.7500000000000195, "agent_compute-ego": 0.01638265053431193, "deviation-heading": 7.004165238665089, "complete-iteration": 0.1864830708503723, "set_robot_commands": 0.004415476322174072, "deviation-center-line": 1.1005322135375746, "driven_lanedir_consec": 1.477899219564019, "sim_compute_sim_state": 0.021870427131652832, "sim_compute_performance-ego": 0.003717780907948812}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5266161995047964, "get_ui_image": 0.03497392972310384, "step_physics": 0.07920419851938884, "survival_time": 14.950000000000076, "driven_lanedir": 1.8033441740627651, "get_state_dump": 0.01311466375986735, "sim_render-ego": 0.005728617509206136, "get_robot_state": 0.014340084393819171, "get_duckie_state": 2.1616617838541666e-06, "in-drivable-lane": 2.1000000000000156, "agent_compute-ego": 0.017125113010406492, "deviation-heading": 6.084012561715896, "complete-iteration": 0.19589353243509927, "set_robot_commands": 0.004694812297821045, "deviation-center-line": 0.8323233020268715, "driven_lanedir_consec": 1.8033441740627651, "sim_compute_sim_state": 0.022782824834187827, "sim_compute_performance-ego": 0.003792425791422526}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.1924913724704, "get_ui_image": 0.03452009995778402, "step_physics": 0.08190005620320638, "survival_time": 14.950000000000076, "driven_lanedir": 1.7759029959131996, "get_state_dump": 0.013079252243041992, "sim_render-ego": 0.005590677261352539, "get_robot_state": 0.014081274668375651, "get_duckie_state": 2.2109349568684896e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.016575596332550048, "deviation-heading": 6.93503295734071, "complete-iteration": 0.20046080986658732, "set_robot_commands": 0.004599413871765137, "deviation-center-line": 0.9926928602680268, "driven_lanedir_consec": 1.7759029959131996, "sim_compute_sim_state": 0.026189968585968015, "sim_compute_performance-ego": 0.003783870538075765}}
set_robot_commands_max	0.004694812297821045
set_robot_commands_mean	0.004507469932238261
set_robot_commands_median	0.004507445096969605
set_robot_commands_min	0.004320177237192789
sim_compute_performance-ego_max	0.003792425791422526
sim_compute_performance-ego_mean	0.003652108112970988
sim_compute_performance-ego_median	0.003750825723012288
sim_compute_performance-ego_min	0.003314355214436849
sim_compute_sim_state_max	0.026189968585968015
sim_compute_sim_state_mean	0.02284234543641408
sim_compute_sim_state_median	0.02232662598292033
sim_compute_sim_state_min	0.020526161193847654
sim_render-ego_max	0.005728617509206136
sim_render-ego_mean	0.005451168815294902
sim_render-ego_median	0.005571329991022746
sim_render-ego_min	0.004933397769927978
simulation-passed	1
step_physics_max	0.08190005620320638
step_physics_mean	0.07538511832555135
step_physics_median	0.07603489756584167
step_physics_min	0.06757062196731567
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43715

11718

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 19:33:39+00:00

2020-11-26 19:41:49+00:00

0:08:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.113784237845453
survival_time_median	14.950000000000076
deviation-center-line_median	1.0593406178138969
in-drivable-lane_median	1.1000000000000072

other stats

agent_compute-ego_max	0.017617620627085367
agent_compute-ego_mean	0.017175303973177427
agent_compute-ego_median	0.01704363162799548
agent_compute-ego_min	0.016996332009633384
complete-iteration_max	0.2049055343033165
complete-iteration_mean	0.2009392721742712
complete-iteration_median	0.2009393286705017
complete-iteration_min	0.19697289705276488
deviation-center-line_max	1.2605668304437974
deviation-center-line_mean	0.9390673023392414
deviation-center-line_min	0.3770211432853753
deviation-heading_max	5.936253553237974
deviation-heading_mean	4.685518683828795
deviation-heading_median	5.393852930446988
deviation-heading_min	2.0181153211832297
driven_any_max	3.921620551997108
driven_any_mean	3.5183026474817747
driven_any_median	3.722622034492915
driven_any_min	2.7063459689441594
driven_lanedir_consec_max	3.215374501356553
driven_lanedir_consec_mean	2.887936944347203
driven_lanedir_consec_min	2.1088048003413524
driven_lanedir_max	3.215374501356553
driven_lanedir_mean	2.887936944347203
driven_lanedir_median	3.113784237845453
driven_lanedir_min	2.1088048003413524
get_duckie_state_max	2.7751922607421876e-06
get_duckie_state_mean	2.6914701666883244e-06
get_duckie_state_median	2.7231375376383464e-06
get_duckie_state_min	2.544413330734417e-06
get_robot_state_max	0.015701409180959067
get_robot_state_mean	0.015097752072477854
get_robot_state_median	0.015058743158976238
get_robot_state_min	0.014572112790999871
get_state_dump_max	0.01340534766515096
get_state_dump_mean	0.013236731656136052
get_state_dump_median	0.013273086547851564
get_state_dump_min	0.01299540586369012
get_ui_image_max	0.035398172537485756
get_ui_image_mean	0.034657677931170305
get_ui_image_median	0.0345956261952718
get_ui_image_min	0.03404128679665186
in-drivable-lane_max	1.6000000000000227
in-drivable-lane_mean	1.075000000000011
in-drivable-lane_min	0.5000000000000071
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.7775796675206905, "get_ui_image": 0.03412557522455851, "step_physics": 0.07831366777420044, "survival_time": 14.950000000000076, "driven_lanedir": 3.215374501356553, "get_state_dump": 0.01340534766515096, "sim_render-ego": 0.005811622142791748, "get_robot_state": 0.014812155564626058, "get_duckie_state": 2.7751922607421876e-06, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.016996332009633384, "deviation-heading": 5.651252627893653, "complete-iteration": 0.19697289705276488, "set_robot_commands": 0.004637742837270101, "deviation-center-line": 1.0583899143396351, "driven_lanedir_consec": 3.215374501356553, "sim_compute_sim_state": 0.024780441919962565, "sim_compute_performance-ego": 0.003939910729726156}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.667664401465141, "get_ui_image": 0.035398172537485756, "step_physics": 0.07927821556727091, "survival_time": 14.950000000000076, "driven_lanedir": 3.1319924118003186, "get_state_dump": 0.013293511072794596, "sim_render-ego": 0.006135163307189942, "get_robot_state": 0.015701409180959067, "get_duckie_state": 2.7680397033691405e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.01701903740564982, "deviation-heading": 5.936253553237974, "complete-iteration": 0.20047932624816897, "set_robot_commands": 0.004839260578155518, "deviation-center-line": 1.060291321288158, "driven_lanedir_consec": 3.1319924118003186, "sim_compute_sim_state": 0.02439588705698649, "sim_compute_performance-ego": 0.0042636577288309736}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.921620551997108, "get_ui_image": 0.035065677165985104, "step_physics": 0.08095433235168457, "survival_time": 14.950000000000076, "driven_lanedir": 3.0955760638905874, "get_state_dump": 0.01325266202290853, "sim_render-ego": 0.006086845397949219, "get_robot_state": 0.015305330753326416, "get_duckie_state": 2.678235371907552e-06, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.017617620627085367, "deviation-heading": 5.136453233000323, "complete-iteration": 0.20139933109283448, "set_robot_commands": 0.004682867527008056, "deviation-center-line": 1.2605668304437974, "driven_lanedir_consec": 3.0955760638905874, "sim_compute_sim_state": 0.02423232873280843, "sim_compute_performance-ego": 0.004050432840983073}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7063459689441594, "get_ui_image": 0.03404128679665186, "step_physics": 0.08536538385575818, "survival_time": 9.299999999999995, "driven_lanedir": 2.1088048003413524, "get_state_dump": 0.01299540586369012, "sim_render-ego": 0.005698498859200427, "get_robot_state": 0.014572112790999871, "get_duckie_state": 2.544413330734417e-06, "in-drivable-lane": 1.6000000000000163, "agent_compute-ego": 0.01706822585034114, "deviation-heading": 2.0181153211832297, "complete-iteration": 0.2049055343033165, "set_robot_commands": 0.004685505743949644, "deviation-center-line": 0.3770211432853753, "driven_lanedir_consec": 2.1088048003413524, "sim_compute_sim_state": 0.026397689696281187, "sim_compute_performance-ego": 0.003931617224088279}}
set_robot_commands_max	0.004839260578155518
set_robot_commands_mean	0.00471134417159583
set_robot_commands_median	0.00468418663547885
set_robot_commands_min	0.004637742837270101
sim_compute_performance-ego_max	0.0042636577288309736
sim_compute_performance-ego_mean	0.00404640463090712
sim_compute_performance-ego_median	0.003995171785354614
sim_compute_performance-ego_min	0.003931617224088279
sim_compute_sim_state_max	0.026397689696281187
sim_compute_sim_state_mean	0.02495158685150967
sim_compute_sim_state_median	0.024588164488474527
sim_compute_sim_state_min	0.02423232873280843
sim_render-ego_max	0.006135163307189942
sim_render-ego_mean	0.0059330324267828334
sim_render-ego_median	0.0059492337703704835
sim_render-ego_min	0.005698498859200427
simulation-passed	1
step_physics_max	0.08536538385575818
step_physics_mean	0.08097789988722853
step_physics_median	0.08011627395947774
step_physics_min	0.07831366777420044
survival_time_max	14.950000000000076
survival_time_mean	13.537500000000058
survival_time_min	9.299999999999995

No reset possible

43699

11719

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 19:23:36+00:00

2020-11-26 19:31:20+00:00

0:07:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.802248092089585
survival_time_median	11.825000000000031
deviation-center-line_median	0.682636132353545
in-drivable-lane_median	3.200000000000019

other stats

agent_compute-ego_max	0.017499451653215797
agent_compute-ego_mean	0.01706472410651507
agent_compute-ego_median	0.01708152400436251
agent_compute-ego_min	0.016596396764119465
complete-iteration_max	0.2039283733304129
complete-iteration_mean	0.1982482637909921
complete-iteration_median	0.1973734039832384
complete-iteration_min	0.19431787386707877
deviation-center-line_max	1.0200711184756224
deviation-center-line_mean	0.6881317703471965
deviation-center-line_min	0.3671836982060736
deviation-heading_max	5.099646007422241
deviation-heading_mean	3.537952179149467
deviation-heading_median	3.775546923237247
deviation-heading_min	1.5010688627011342
driven_any_max	4.511541833679999
driven_any_mean	3.4239975378167458
driven_any_median	3.4997873768547865
driven_any_min	2.1848735638774106
driven_lanedir_consec_max	2.7969256081784546
driven_lanedir_consec_mean	2.021120679633297
driven_lanedir_consec_min	1.6830609261755631
driven_lanedir_max	2.7969256081784546
driven_lanedir_mean	2.021120679633297
driven_lanedir_median	1.802248092089585
driven_lanedir_min	1.6830609261755631
get_duckie_state_max	2.7326437143179087e-06
get_duckie_state_mean	2.5713162414720983e-06
get_duckie_state_median	2.632860601301024e-06
get_duckie_state_min	2.286900048968436e-06
get_robot_state_max	0.015635982773007727
get_robot_state_mean	0.014896989527161848
get_robot_state_median	0.01523196258539606
get_robot_state_min	0.013488050164847538
get_state_dump_max	0.013449271049725231
get_state_dump_mean	0.013275662788025498
get_state_dump_median	0.01324843576254786
get_state_dump_min	0.013156508577281033
get_ui_image_max	0.035867121706040804
get_ui_image_mean	0.03462771007094963
get_ui_image_median	0.034539120592309173
get_ui_image_min	0.033565477393139365
in-drivable-lane_max	7.200000000000052
in-drivable-lane_mean	3.500000000000022
in-drivable-lane_min	0.4000000000000013
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.511541833679999, "get_ui_image": 0.035867121706040804, "step_physics": 0.08214853679057348, "survival_time": 14.950000000000076, "driven_lanedir": 1.847676813735362, "get_state_dump": 0.0131722134491273, "sim_render-ego": 0.006005695432324872, "get_robot_state": 0.015213003126673874, "get_duckie_state": 2.7326437143179087e-06, "in-drivable-lane": 7.200000000000052, "agent_compute-ego": 0.017499451653215797, "deviation-heading": 3.5653537810679015, "complete-iteration": 0.2039283733304129, "set_robot_commands": 0.005118188252018447, "deviation-center-line": 0.639842114965888, "driven_lanedir_consec": 1.847676813735362, "sim_compute_sim_state": 0.024720545197809023, "sim_compute_performance-ego": 0.004032051284177646}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.1848735638774106, "get_ui_image": 0.034930649593737, "step_physics": 0.07796008205978122, "survival_time": 8.449999999999985, "driven_lanedir": 1.6830609261755631, "get_state_dump": 0.013449271049725231, "sim_render-ego": 0.006103567823150454, "get_robot_state": 0.015635982773007727, "get_duckie_state": 2.7241791493793917e-06, "in-drivable-lane": 0.4000000000000013, "agent_compute-ego": 0.01693415218556421, "deviation-heading": 3.985740065406592, "complete-iteration": 0.1972972613114577, "set_robot_commands": 0.004727184419801249, "deviation-center-line": 0.7254301497412021, "driven_lanedir_consec": 1.6830609261755631, "sim_compute_sim_state": 0.023262241182948007, "sim_compute_performance-ego": 0.004139457228621082}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.14532323142314, "get_ui_image": 0.03414759159088135, "step_physics": 0.07862848838170369, "survival_time": 14.950000000000076, "driven_lanedir": 2.7969256081784546, "get_state_dump": 0.013324658075968424, "sim_render-ego": 0.0059445969263712565, "get_robot_state": 0.015250922044118246, "get_duckie_state": 2.5415420532226563e-06, "in-drivable-lane": 3.350000000000037, "agent_compute-ego": 0.017228895823160808, "deviation-heading": 5.099646007422241, "complete-iteration": 0.19744954665501913, "set_robot_commands": 0.004611060619354248, "deviation-center-line": 1.0200711184756224, "driven_lanedir_consec": 2.7969256081784546, "sim_compute_sim_state": 0.024201889832814533, "sim_compute_performance-ego": 0.003959518273671468}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8542515222864333, "get_ui_image": 0.033565477393139365, "step_physics": 0.07787831076260271, "survival_time": 8.699999999999989, "driven_lanedir": 1.7568193704438078, "get_state_dump": 0.013156508577281033, "sim_render-ego": 0.005476171942962997, "get_robot_state": 0.013488050164847538, "get_duckie_state": 2.286900048968436e-06, "in-drivable-lane": 3.0500000000000007, "agent_compute-ego": 0.016596396764119465, "deviation-heading": 1.5010688627011342, "complete-iteration": 0.19431787386707877, "set_robot_commands": 0.004442667138987574, "deviation-center-line": 0.3671836982060736, "driven_lanedir_consec": 1.7568193704438078, "sim_compute_sim_state": 0.02592043218941524, "sim_compute_performance-ego": 0.003649906180370813}}
set_robot_commands_max	0.005118188252018447
set_robot_commands_mean	0.00472477510754038
set_robot_commands_median	0.004669122519577748
set_robot_commands_min	0.004442667138987574
sim_compute_performance-ego_max	0.004139457228621082
sim_compute_performance-ego_mean	0.003945233241710252
sim_compute_performance-ego_median	0.003995784778924557
sim_compute_performance-ego_min	0.003649906180370813
sim_compute_sim_state_max	0.02592043218941524
sim_compute_sim_state_mean	0.024526277100746705
sim_compute_sim_state_median	0.02446121751531178
sim_compute_sim_state_min	0.023262241182948007
sim_render-ego_max	0.006103567823150454
sim_render-ego_mean	0.0058825080312023955
sim_render-ego_median	0.005975146179348065
sim_render-ego_min	0.005476171942962997
simulation-passed	1
step_physics_max	0.08214853679057348
step_physics_mean	0.07915385449866527
step_physics_median	0.07829428522074246
step_physics_min	0.07787831076260271
survival_time_max	14.950000000000076
survival_time_mean	11.762500000000031
survival_time_min	8.449999999999985

No reset possible

43675

11713

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 19:13:53+00:00

2020-11-26 19:21:55+00:00

0:08:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.257206835249561
survival_time_median	14.075000000000063
deviation-center-line_median	0.7071762525315232
in-drivable-lane_median	0.15000000000000213

other stats

agent_compute-ego_max	0.017456166744232178
agent_compute-ego_mean	0.01721702738501931
agent_compute-ego_median	0.017155565222104388
agent_compute-ego_min	0.017100812351636293
complete-iteration_max	0.2078811718245684
complete-iteration_mean	0.19473652115695345
complete-iteration_median	0.19308968424797057
complete-iteration_min	0.18488554430730417
deviation-center-line_max	1.2231071285444006
deviation-center-line_mean	0.7310382845342229
deviation-center-line_min	0.286693504529445
deviation-heading_max	5.33512047359817
deviation-heading_mean	3.767112739304668
deviation-heading_median	4.045035057207473
deviation-heading_min	1.643260369205555
driven_any_max	3.4630319531641884
driven_any_mean	2.973466066411868
driven_any_median	3.2053313619873167
driven_any_min	2.0201695885086504
driven_lanedir_consec_max	3.134517347333865
driven_lanedir_consec_mean	2.2094933543007076
driven_lanedir_consec_min	1.1890423993698436
driven_lanedir_max	3.134517347333865
driven_lanedir_mean	2.2094933543007076
driven_lanedir_median	2.257206835249561
driven_lanedir_min	1.1890423993698436
get_duckie_state_max	2.602736155192057e-06
get_duckie_state_mean	2.479370612637716e-06
get_duckie_state_median	2.5271426486430196e-06
get_duckie_state_min	2.260460998072769e-06
get_robot_state_max	0.015312955877875204
get_robot_state_mean	0.014721861082465452
get_robot_state_median	0.014934900999069214
get_robot_state_min	0.013704686453848177
get_state_dump_max	0.01358005205790202
get_state_dump_mean	0.013264819152029466
get_state_dump_median	0.013304583292222966
get_state_dump_min	0.012870057965769913
get_ui_image_max	0.03545152130773512
get_ui_image_mean	0.03400209478662757
get_ui_image_median	0.033996746937433875
get_ui_image_min	0.03256336396390742
in-drivable-lane_max	7.600000000000064
in-drivable-lane_mean	1.9750000000000172
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.358249356337248, "get_ui_image": 0.03256336396390742, "step_physics": 0.0713587502638499, "survival_time": 13.200000000000053, "driven_lanedir": 1.1890423993698436, "get_state_dump": 0.012870057965769913, "sim_render-ego": 0.005533464027173592, "get_robot_state": 0.013704686453848177, "get_duckie_state": 2.260460998072769e-06, "in-drivable-lane": 7.600000000000064, "agent_compute-ego": 0.017180790503819782, "deviation-heading": 1.643260369205555, "complete-iteration": 0.18488554430730417, "set_robot_commands": 0.004679648262081724, "deviation-center-line": 0.286693504529445, "driven_lanedir_consec": 1.1890423993698436, "sim_compute_sim_state": 0.023163568792921124, "sim_compute_performance-ego": 0.003699346022172408}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0524133676373855, "get_ui_image": 0.03349213282267253, "step_physics": 0.07272159258524577, "survival_time": 14.950000000000076, "driven_lanedir": 2.780791635347939, "get_state_dump": 0.01313847780227661, "sim_render-ego": 0.005753023624420166, "get_robot_state": 0.01492672046025594, "get_duckie_state": 2.602736155192057e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017130339940388997, "deviation-heading": 5.33512047359817, "complete-iteration": 0.1889288608233134, "set_robot_commands": 0.004708113670349121, "deviation-center-line": 0.8786372712162467, "driven_lanedir_consec": 2.780791635347939, "sim_compute_sim_state": 0.023101972738901775, "sim_compute_performance-ego": 0.0038187877337137856}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.4630319531641884, "get_ui_image": 0.03450136105219523, "step_physics": 0.07785492897033691, "survival_time": 14.950000000000076, "driven_lanedir": 3.134517347333865, "get_state_dump": 0.01358005205790202, "sim_render-ego": 0.005903295675913493, "get_robot_state": 0.014943081537882487, "get_duckie_state": 2.5542577107747395e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017456166744232178, "deviation-heading": 5.108018907819822, "complete-iteration": 0.19725050767262775, "set_robot_commands": 0.00479161262512207, "deviation-center-line": 1.2231071285444006, "driven_lanedir_consec": 3.134517347333865, "sim_compute_sim_state": 0.024176557064056397, "sim_compute_performance-ego": 0.003901553153991699}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0201695885086504, "get_ui_image": 0.03545152130773512, "step_physics": 0.08557100888699462, "survival_time": 8.84999999999999, "driven_lanedir": 1.7336220351511833, "get_state_dump": 0.01347068878216932, "sim_render-ego": 0.005856691780736891, "get_robot_state": 0.015312955877875204, "get_duckie_state": 2.5000275865112993e-06, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.017100812351636293, "deviation-heading": 2.982051206595124, "complete-iteration": 0.2078811718245684, "set_robot_commands": 0.00472820680693718, "deviation-center-line": 0.5357152338467996, "driven_lanedir_consec": 1.7336220351511833, "sim_compute_sim_state": 0.026347039109569485, "sim_compute_performance-ego": 0.0038999622151003046}}
set_robot_commands_max	0.00479161262512207
set_robot_commands_mean	0.0047268953411225235
set_robot_commands_median	0.00471816023864315
set_robot_commands_min	0.004679648262081724
sim_compute_performance-ego_max	0.003901553153991699
sim_compute_performance-ego_mean	0.0038299122812445498
sim_compute_performance-ego_median	0.003859374974407045
sim_compute_performance-ego_min	0.003699346022172408
sim_compute_sim_state_max	0.026347039109569485
sim_compute_sim_state_mean	0.024197284426362195
sim_compute_sim_state_median	0.02367006292848876
sim_compute_sim_state_min	0.023101972738901775
sim_render-ego_max	0.005903295675913493
sim_render-ego_mean	0.005761618777061035
sim_render-ego_median	0.005804857702578528
sim_render-ego_min	0.005533464027173592
simulation-passed	1
step_physics_max	0.08557100888699462
step_physics_mean	0.07687657017660679
step_physics_median	0.07528826077779134
step_physics_min	0.0713587502638499
survival_time_max	14.950000000000076
survival_time_mean	12.98750000000005
survival_time_min	8.84999999999999

No reset possible

43648

11705

brian wong

baseline-RL-sim-pytorch

LFv-sim

success

2020-11-26 15:26:06+00:00

2020-11-26 15:38:36+00:00

0:12:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.8847294013177645
survival_time_median	14.950000000000076
deviation-center-line_median	0.433712391928239
in-drivable-lane_median	5.525000000000036

other stats

agent_compute-ego_max	0.016024964650472005
agent_compute-ego_mean	0.015581332246462505
agent_compute-ego_median	0.015520511865615844
agent_compute-ego_min	0.01525934060414632
complete-iteration_max	0.18237627665201825
complete-iteration_mean	0.18042897204558056
complete-iteration_median	0.18057837565739948
complete-iteration_min	0.17818286021550497
deviation-center-line_max	0.5538634668158722
deviation-center-line_mean	0.42419498619180446
deviation-center-line_min	0.2754916940948675
deviation-heading_max	8.43692086133786
deviation-heading_mean	7.432222430615763
deviation-heading_median	7.703463315203518
deviation-heading_min	5.885042230718155
driven_any_max	3.1549201606862107
driven_any_mean	3.038304268095157
driven_any_median	3.0649205881415025
driven_any_min	2.868455735411412
driven_lanedir_consec_max	-0.7224286557717066
driven_lanedir_consec_mean	-0.8706290340962869
driven_lanedir_consec_min	-0.990628677977912
driven_lanedir_max	-0.8481467510299248
driven_lanedir_mean	-0.9577827432252052
driven_lanedir_median	-0.8847294013177645
driven_lanedir_min	-1.2135254192353675
get_duckie_state_max	2.228418986002604e-06
get_duckie_state_mean	2.1314620971679686e-06
get_duckie_state_median	2.1175543467203774e-06
get_duckie_state_min	2.0623207092285157e-06
get_robot_state_max	0.014335785706837972
get_robot_state_mean	0.013064581751823423
get_robot_state_median	0.012732604344685872
get_robot_state_min	0.012457332611083984
get_state_dump_max	0.012526217301686604
get_state_dump_mean	0.012311508059501647
get_state_dump_median	0.012347134749094643
get_state_dump_min	0.012025545438130695
get_ui_image_max	0.03371723254521688
get_ui_image_mean	0.033427659869194035
get_ui_image_median	0.03338473320007324
get_ui_image_min	0.03322394053141276
in-drivable-lane_max	8.100000000000046
in-drivable-lane_mean	5.900000000000037
in-drivable-lane_min	4.450000000000032
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.868455735411412, "get_ui_image": 0.03325099229812622, "step_physics": 0.0700944487253825, "survival_time": 14.950000000000076, "driven_lanedir": -0.8481467510299248, "get_state_dump": 0.012025545438130695, "sim_render-ego": 0.005411833127339681, "get_robot_state": 0.014335785706837972, "get_duckie_state": 2.228418986002604e-06, "in-drivable-lane": 4.450000000000032, "agent_compute-ego": 0.015394570827484131, "deviation-heading": 7.841441482699017, "complete-iteration": 0.1800368865331014, "set_robot_commands": 0.004553844928741455, "deviation-center-line": 0.4985062655019206, "driven_lanedir_consec": -0.7224286557717066, "sim_compute_sim_state": 0.021176822185516357, "sim_compute_performance-ego": 0.0036697936058044433}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1549201606862107, "get_ui_image": 0.03351847410202027, "step_physics": 0.071381676197052, "survival_time": 14.950000000000076, "driven_lanedir": -1.2135254192353675, "get_state_dump": 0.012418558597564695, "sim_render-ego": 0.005085870424906413, "get_robot_state": 0.012841617266337075, "get_duckie_state": 2.0623207092285157e-06, "in-drivable-lane": 5.850000000000037, "agent_compute-ego": 0.015646452903747558, "deviation-heading": 7.565485147708018, "complete-iteration": 0.17818286021550497, "set_robot_commands": 0.004328443209330241, "deviation-center-line": 0.5538634668158722, "driven_lanedir_consec": -0.990628677977912, "sim_compute_sim_state": 0.01941695054372152, "sim_compute_performance-ego": 0.0034205563863118488}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.023360905012092, "get_ui_image": 0.03322394053141276, "step_physics": 0.07470876534779866, "survival_time": 14.950000000000076, "driven_lanedir": -0.8936544738781907, "get_state_dump": 0.012275710900624593, "sim_render-ego": 0.005228549639383952, "get_robot_state": 0.012457332611083984, "get_duckie_state": 2.087752024332682e-06, "in-drivable-lane": 8.100000000000046, "agent_compute-ego": 0.016024964650472005, "deviation-heading": 5.885042230718155, "complete-iteration": 0.18237627665201825, "set_robot_commands": 0.004401586055755615, "deviation-center-line": 0.2754916940948675, "driven_lanedir_consec": -0.8936544738781907, "sim_compute_sim_state": 0.02043748776117961, "sim_compute_performance-ego": 0.0034875202178955077}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.106480271270913, "get_ui_image": 0.03371723254521688, "step_physics": 0.07043676296869913, "survival_time": 14.950000000000076, "driven_lanedir": -0.8758043287573383, "get_state_dump": 0.012526217301686604, "sim_render-ego": 0.005148900349934896, "get_robot_state": 0.012623591423034668, "get_duckie_state": 2.1473566691080727e-06, "in-drivable-lane": 5.200000000000036, "agent_compute-ego": 0.01525934060414632, "deviation-heading": 8.43692086133786, "complete-iteration": 0.1811198647816976, "set_robot_commands": 0.004389552275339762, "deviation-center-line": 0.3689185183545576, "driven_lanedir_consec": -0.8758043287573383, "sim_compute_sim_state": 0.02339259147644043, "sim_compute_performance-ego": 0.0034963798522949217}}
set_robot_commands_max	0.004553844928741455
set_robot_commands_mean	0.004418356617291768
set_robot_commands_median	0.004395569165547689
set_robot_commands_min	0.004328443209330241
sim_compute_performance-ego_max	0.0036697936058044433
sim_compute_performance-ego_mean	0.00351856251557668
sim_compute_performance-ego_median	0.0034919500350952147
sim_compute_performance-ego_min	0.0034205563863118488
sim_compute_sim_state_max	0.02339259147644043
sim_compute_sim_state_mean	0.02110596299171448
sim_compute_sim_state_median	0.02080715497334798
sim_compute_sim_state_min	0.01941695054372152
sim_render-ego_max	0.005411833127339681
sim_render-ego_mean	0.005218788385391235
sim_render-ego_median	0.005188724994659424
sim_render-ego_min	0.005085870424906413
simulation-passed	1
step_physics_max	0.07470876534779866
step_physics_mean	0.07165541330973307
step_physics_median	0.07090921958287558
step_physics_min	0.0700944487253825
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43615

11696

Bhavya Patwa 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 08:14:23+00:00

2020-11-26 08:23:14+00:00

0:08:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.4492951102436789
survival_time_median	14.950000000000076
deviation-center-line_median	0.36870603679060393
in-drivable-lane_median	1.275000000000018

other stats

agent_compute-ego_max	0.017643410364786782
agent_compute-ego_mean	0.01725046435991923
agent_compute-ego_median	0.017303249835968017
agent_compute-ego_min	0.0167519474029541
complete-iteration_max	0.2067405867576599
complete-iteration_mean	0.1963259196281433
complete-iteration_median	0.19836530327796936
complete-iteration_min	0.1818324851989746
deviation-center-line_max	0.6013935973807751
deviation-center-line_mean	0.4134376759370336
deviation-center-line_min	0.31494503278615155
deviation-heading_max	2.637834110841367
deviation-heading_mean	2.1600599798833446
deviation-heading_median	2.1921410016346305
deviation-heading_min	1.6181238054227487
driven_any_max	1.7035486258197552
driven_any_mean	1.653163993928234
driven_any_median	1.660666644680485
driven_any_min	1.587774060532212
driven_lanedir_consec_max	1.689046622701179
driven_lanedir_consec_mean	1.3460756054111405
driven_lanedir_consec_min	0.7966655784560254
driven_lanedir_max	1.689046622701179
driven_lanedir_mean	1.3460756054111405
driven_lanedir_median	1.4492951102436789
driven_lanedir_min	0.7966655784560254
get_duckie_state_max	2.609093983968099e-06
get_duckie_state_mean	2.5109450022379556e-06
get_duckie_state_median	2.5180975596110028e-06
get_duckie_state_min	2.398490905761719e-06
get_robot_state_max	0.015607276757558186
get_robot_state_mean	0.014894226392110188
get_robot_state_median	0.015310681263605751
get_robot_state_min	0.013348266283671062
get_state_dump_max	0.013735980987548828
get_state_dump_mean	0.013643662532170614
get_state_dump_median	0.01370174527168274
get_state_dump_min	0.013435178597768148
get_ui_image_max	0.03494155724843343
get_ui_image_mean	0.034098377426465355
get_ui_image_median	0.03440734028816223
get_ui_image_min	0.03263727188110352
in-drivable-lane_max	6.850000000000044
in-drivable-lane_mean	2.35000000000002
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.6841832234700584, "get_ui_image": 0.03417194922765096, "step_physics": 0.07586270809173584, "survival_time": 14.950000000000076, "driven_lanedir": 1.3321349966445242, "get_state_dump": 0.013693335056304932, "sim_render-ego": 0.00591828187306722, "get_robot_state": 0.015144779682159423, "get_duckie_state": 2.609093983968099e-06, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.017538026173909507, "deviation-heading": 2.2281555352229216, "complete-iteration": 0.19475610574086508, "set_robot_commands": 0.004788293838500977, "deviation-center-line": 0.31494503278615155, "driven_lanedir_consec": 1.3321349966445242, "sim_compute_sim_state": 0.02350622892379761, "sim_compute_performance-ego": 0.003983463446299235}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.587774060532212, "get_ui_image": 0.03263727188110352, "step_physics": 0.07048494895299276, "survival_time": 14.950000000000076, "driven_lanedir": 1.5664552238428335, "get_state_dump": 0.013435178597768148, "sim_render-ego": 0.0055286455154418945, "get_robot_state": 0.013348266283671062, "get_duckie_state": 2.398490905761719e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0167519474029541, "deviation-heading": 2.1561264680463395, "complete-iteration": 0.1818324851989746, "set_robot_commands": 0.004478938579559326, "deviation-center-line": 0.3284395535211966, "driven_lanedir_consec": 1.5664552238428335, "sim_compute_sim_state": 0.021323219935099284, "sim_compute_performance-ego": 0.0037062239646911623}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.6371500658909115, "get_ui_image": 0.0346427313486735, "step_physics": 0.08182252486546834, "survival_time": 14.950000000000076, "driven_lanedir": 0.7966655784560254, "get_state_dump": 0.013735980987548828, "sim_render-ego": 0.0060690863927205406, "get_robot_state": 0.015607276757558186, "get_duckie_state": 2.4628639221191406e-06, "in-drivable-lane": 6.850000000000044, "agent_compute-ego": 0.017643410364786782, "deviation-heading": 2.637834110841367, "complete-iteration": 0.20197450081507365, "set_robot_commands": 0.004837066332499186, "deviation-center-line": 0.6013935973807751, "driven_lanedir_consec": 0.7966655784560254, "sim_compute_sim_state": 0.023404760360717772, "sim_compute_performance-ego": 0.004062167803446452}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.7035486258197552, "get_ui_image": 0.03494155724843343, "step_physics": 0.08428545951843262, "survival_time": 14.950000000000076, "driven_lanedir": 1.689046622701179, "get_state_dump": 0.013710155487060546, "sim_render-ego": 0.005940461953481038, "get_robot_state": 0.015476582845052085, "get_duckie_state": 2.5733311971028645e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01706847349802653, "deviation-heading": 1.6181238054227487, "complete-iteration": 0.2067405867576599, "set_robot_commands": 0.004932467142740885, "deviation-center-line": 0.4089725200600113, "driven_lanedir_consec": 1.689046622701179, "sim_compute_sim_state": 0.02616709073384603, "sim_compute_performance-ego": 0.004068458875020345}}
set_robot_commands_max	0.004932467142740885
set_robot_commands_mean	0.004759191473325093
set_robot_commands_median	0.004812680085500082
set_robot_commands_min	0.004478938579559326
sim_compute_performance-ego_max	0.004068458875020345
sim_compute_performance-ego_mean	0.003955078522364298
sim_compute_performance-ego_median	0.0040228156248728435
sim_compute_performance-ego_min	0.0037062239646911623
sim_compute_sim_state_max	0.02616709073384603
sim_compute_sim_state_mean	0.023600324988365173
sim_compute_sim_state_median	0.023455494642257692
sim_compute_sim_state_min	0.021323219935099284
sim_render-ego_max	0.0060690863927205406
sim_render-ego_mean	0.005864118933677673
sim_render-ego_median	0.005929371913274129
sim_render-ego_min	0.0055286455154418945
simulation-passed	1
step_physics_max	0.08428545951843262
step_physics_mean	0.0781139103571574
step_physics_median	0.07884261647860209
step_physics_min	0.07048494895299276
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43592

11695

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 08:03:48+00:00

2020-11-26 08:12:49+00:00

0:09:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.310240855178831
survival_time_median	14.950000000000076
deviation-center-line_median	0.7312621093844156
in-drivable-lane_median	3.425000000000012

other stats

agent_compute-ego_max	0.017715051968892417
agent_compute-ego_mean	0.017280301849047344
agent_compute-ego_median	0.017200185457865398
agent_compute-ego_min	0.01700578451156616
complete-iteration_max	0.2080376362800598
complete-iteration_mean	0.2005446147918701
complete-iteration_median	0.2015617823600769
complete-iteration_min	0.19101725816726683
deviation-center-line_max	0.8426384523665131
deviation-center-line_mean	0.734081795565808
deviation-center-line_min	0.6311645111278876
deviation-heading_max	3.131624005456662
deviation-heading_mean	2.825484234876689
deviation-heading_median	2.830865142941911
deviation-heading_min	2.5085826481662736
driven_any_max	5.38059752999504
driven_any_mean	4.4709045951409525
driven_any_median	4.395293221620092
driven_any_min	3.7124344073285873
driven_lanedir_consec_max	4.0800966314122
driven_lanedir_consec_mean	3.267505035047574
driven_lanedir_consec_min	2.3694417984204343
driven_lanedir_max	4.0800966314122
driven_lanedir_mean	3.268328495862119
driven_lanedir_median	3.310240855178831
driven_lanedir_min	2.372735641678614
get_duckie_state_max	2.6591618855794273e-06
get_duckie_state_mean	2.607107162475586e-06
get_duckie_state_median	2.628167470296224e-06
get_duckie_state_min	2.5129318237304685e-06
get_robot_state_max	0.016181770165761312
get_robot_state_mean	0.015497957865397136
get_robot_state_median	0.015340777238210042
get_robot_state_min	0.015128506819407144
get_state_dump_max	0.013890519142150878
get_state_dump_mean	0.013659750223159793
get_state_dump_median	0.01360078533490499
get_state_dump_min	0.013546911080678304
get_ui_image_max	0.036048343181610105
get_ui_image_mean	0.03478977501392364
get_ui_image_median	0.03498529593149821
get_ui_image_min	0.03314016501108805
in-drivable-lane_max	7.05000000000009
in-drivable-lane_mean	3.4750000000000285
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.6082781489368205, "get_ui_image": 0.03415600379308065, "step_physics": 0.0761087163289388, "survival_time": 14.950000000000076, "driven_lanedir": 4.007091309822889, "get_state_dump": 0.013620232741038005, "sim_render-ego": 0.005771043300628662, "get_robot_state": 0.015128506819407144, "get_duckie_state": 2.6591618855794273e-06, "in-drivable-lane": 2.4500000000000117, "agent_compute-ego": 0.01727194547653198, "deviation-heading": 3.131624005456662, "complete-iteration": 0.19516648372014364, "set_robot_commands": 0.004761428038279216, "deviation-center-line": 0.7430625923317808, "driven_lanedir_consec": 4.007091309822889, "sim_compute_sim_state": 0.02430203119913737, "sim_compute_performance-ego": 0.0039033897717793784}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.182308294303363, "get_ui_image": 0.03314016501108805, "step_physics": 0.07360854943593344, "survival_time": 14.950000000000076, "driven_lanedir": 4.0800966314122, "get_state_dump": 0.013546911080678304, "sim_render-ego": 0.005852252642313639, "get_robot_state": 0.015371445814768474, "get_duckie_state": 2.6305516560872396e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01700578451156616, "deviation-heading": 2.948233892699562, "complete-iteration": 0.19101725816726683, "set_robot_commands": 0.004697797298431397, "deviation-center-line": 0.7194616264370503, "driven_lanedir_consec": 4.0800966314122, "sim_compute_sim_state": 0.023688395818074543, "sim_compute_performance-ego": 0.003959345817565918}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.7124344073285873, "get_ui_image": 0.03581458806991577, "step_physics": 0.08351563374201457, "survival_time": 14.950000000000076, "driven_lanedir": 2.6133904005347732, "get_state_dump": 0.013890519142150878, "sim_render-ego": 0.0062888471285502115, "get_robot_state": 0.016181770165761312, "get_duckie_state": 2.6257832845052084e-06, "in-drivable-lane": 4.400000000000012, "agent_compute-ego": 0.017715051968892417, "deviation-heading": 2.5085826481662736, "complete-iteration": 0.2080376362800598, "set_robot_commands": 0.0049064564704895015, "deviation-center-line": 0.8426384523665131, "driven_lanedir_consec": 2.6133904005347732, "sim_compute_sim_state": 0.02529569546381633, "sim_compute_performance-ego": 0.0042745089530944825}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.38059752999504, "get_ui_image": 0.036048343181610105, "step_physics": 0.08437009572982788, "survival_time": 14.950000000000076, "driven_lanedir": 2.372735641678614, "get_state_dump": 0.013581337928771971, "sim_render-ego": 0.005920212268829345, "get_robot_state": 0.015310108661651611, "get_duckie_state": 2.5129318237304685e-06, "in-drivable-lane": 7.05000000000009, "agent_compute-ego": 0.017128425439198812, "deviation-heading": 2.71349639318426, "complete-iteration": 0.20795708100001015, "set_robot_commands": 0.004686402479807536, "deviation-center-line": 0.6311645111278876, "driven_lanedir_consec": 2.3694417984204343, "sim_compute_sim_state": 0.026814583937327063, "sim_compute_performance-ego": 0.003949660460154216}}
set_robot_commands_max	0.0049064564704895015
set_robot_commands_mean	0.004763021071751913
set_robot_commands_median	0.004729612668355306
set_robot_commands_min	0.004686402479807536
sim_compute_performance-ego_max	0.0042745089530944825
sim_compute_performance-ego_mean	0.004021726250648498
sim_compute_performance-ego_median	0.003954503138860067
sim_compute_performance-ego_min	0.0039033897717793784
sim_compute_sim_state_max	0.026814583937327063
sim_compute_sim_state_mean	0.025025176604588827
sim_compute_sim_state_median	0.02479886333147685
sim_compute_sim_state_min	0.023688395818074543
sim_render-ego_max	0.0062888471285502115
sim_render-ego_mean	0.005958088835080464
sim_render-ego_median	0.005886232455571492
sim_render-ego_min	0.005771043300628662
simulation-passed	1
step_physics_max	0.08437009572982788
step_physics_mean	0.07940074880917868
step_physics_median	0.07981217503547669
step_physics_min	0.07360854943593344
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43563

11693

Mo Kleit 🇨🇦

real-exercise-2

LFv-sim

success

2020-11-26 07:38:04+00:00

2020-11-26 07:44:56+00:00

0:06:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.408778022254781
survival_time_median	11.950000000000037
deviation-center-line_median	0.4794955619541197
in-drivable-lane_median	1.875000000000008

other stats

agent_compute-ego_max	0.017750726427350726
agent_compute-ego_mean	0.01746711376960538
agent_compute-ego_median	0.01741773608351956
agent_compute-ego_min	0.01728225648403168
complete-iteration_max	0.20571296016375223
complete-iteration_mean	0.1999794130156688
complete-iteration_median	0.20068745923643352
complete-iteration_min	0.1928297734260559
deviation-center-line_max	0.6457648007725353
deviation-center-line_mean	0.4448345293999782
deviation-center-line_min	0.17458219291913818
deviation-heading_max	2.6478278969007443
deviation-heading_mean	1.7947528557676082
deviation-heading_median	2.101871222500521
deviation-heading_min	0.3274410811686465
driven_any_max	5.784690513101993
driven_any_mean	4.06012011321844
driven_any_median	4.608013186337353
driven_any_min	1.2397635670970597
driven_lanedir_consec_max	3.7658227560907376
driven_lanedir_consec_mean	2.4130254067201253
driven_lanedir_consec_min	1.0687228262802029
driven_lanedir_max	3.7658227560907376
driven_lanedir_mean	2.4130254067201253
driven_lanedir_median	2.408778022254781
driven_lanedir_min	1.0687228262802029
get_duckie_state_max	2.8814588274274553e-06
get_duckie_state_mean	2.5812317343319163e-06
get_duckie_state_median	2.5693775892925527e-06
get_duckie_state_min	2.304712931315104e-06
get_robot_state_max	0.01623274258204869
get_robot_state_mean	0.01559846136207674
get_robot_state_median	0.015793195771736924
get_robot_state_min	0.014574711322784425
get_state_dump_max	0.014131191798618862
get_state_dump_mean	0.01389207414844457
get_state_dump_median	0.013927783297390497
get_state_dump_min	0.013581538200378418
get_ui_image_max	0.03512858663286481
get_ui_image_mean	0.034275220740659564
get_ui_image_median	0.034146714256424196
get_ui_image_min	0.03367886781692505
in-drivable-lane_max	10.850000000000074
in-drivable-lane_mean	3.750000000000022
in-drivable-lane_min	0.3999999999999986
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.2397635670970597, "get_ui_image": 0.03512858663286481, "step_physics": 0.0815530572618757, "survival_time": 3.4999999999999956, "driven_lanedir": 1.0687228262802029, "get_state_dump": 0.014131191798618862, "sim_render-ego": 0.006451937130519322, "get_robot_state": 0.01623274258204869, "get_duckie_state": 2.8814588274274553e-06, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.017750726427350726, "deviation-heading": 0.3274410811686465, "complete-iteration": 0.2044050557272775, "set_robot_commands": 0.004899137360709054, "deviation-center-line": 0.17458219291913818, "driven_lanedir_consec": 1.0687228262802029, "sim_compute_sim_state": 0.023670356614249093, "sim_compute_performance-ego": 0.004408070019313267}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.592636867611051, "get_ui_image": 0.03378511577093301, "step_physics": 0.07590351084701154, "survival_time": 11.900000000000034, "driven_lanedir": 3.560182889245401, "get_state_dump": 0.014021569941224173, "sim_render-ego": 0.006144944359274472, "get_robot_state": 0.016005732432133008, "get_duckie_state": 2.6035709541384914e-06, "in-drivable-lane": 2.1500000000000092, "agent_compute-ego": 0.017370135844254696, "deviation-heading": 2.5163738728717227, "complete-iteration": 0.19696986274558956, "set_robot_commands": 0.005069598430345038, "deviation-center-line": 0.6457648007725353, "driven_lanedir_consec": 3.560182889245401, "sim_compute_sim_state": 0.024395649172678713, "sim_compute_performance-ego": 0.004104525101285021}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.784690513101993, "get_ui_image": 0.03367886781692505, "step_physics": 0.07603761434555054, "survival_time": 14.950000000000076, "driven_lanedir": 1.257373155264161, "get_state_dump": 0.013581538200378418, "sim_render-ego": 0.0058700052897135415, "get_robot_state": 0.014574711322784425, "get_duckie_state": 2.304712931315104e-06, "in-drivable-lane": 10.850000000000074, "agent_compute-ego": 0.017465336322784422, "deviation-heading": 1.6873685721293197, "complete-iteration": 0.1928297734260559, "set_robot_commands": 0.004871721267700195, "deviation-center-line": 0.3201075428466335, "driven_lanedir_consec": 1.257373155264161, "sim_compute_sim_state": 0.02269836187362671, "sim_compute_performance-ego": 0.0038870835304260255}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.623389505063655, "get_ui_image": 0.03450831274191538, "step_physics": 0.08187424242496491, "survival_time": 12.000000000000036, "driven_lanedir": 3.7658227560907376, "get_state_dump": 0.013833996653556824, "sim_render-ego": 0.005988702178001404, "get_robot_state": 0.01558065911134084, "get_duckie_state": 2.5351842244466145e-06, "in-drivable-lane": 1.6000000000000068, "agent_compute-ego": 0.01728225648403168, "deviation-heading": 2.6478278969007443, "complete-iteration": 0.20571296016375223, "set_robot_commands": 0.004835174481074015, "deviation-center-line": 0.6388835810616058, "driven_lanedir_consec": 3.7658227560907376, "sim_compute_sim_state": 0.027592142422993977, "sim_compute_performance-ego": 0.004050406813621521}}
set_robot_commands_max	0.005069598430345038
set_robot_commands_mean	0.004918907884957076
set_robot_commands_median	0.004885429314204624
set_robot_commands_min	0.004835174481074015
sim_compute_performance-ego_max	0.004408070019313267
sim_compute_performance-ego_mean	0.004112521366161459
sim_compute_performance-ego_median	0.004077465957453271
sim_compute_performance-ego_min	0.0038870835304260255
sim_compute_sim_state_max	0.027592142422993977
sim_compute_sim_state_mean	0.024589127520887124
sim_compute_sim_state_median	0.024033002893463905
sim_compute_sim_state_min	0.02269836187362671
sim_render-ego_max	0.006451937130519322
sim_render-ego_mean	0.006113897239377185
sim_render-ego_median	0.006066823268637937
sim_render-ego_min	0.0058700052897135415
simulation-passed	1
step_physics_max	0.08187424242496491
step_physics_mean	0.07884210621985067
step_physics_median	0.07879533580371312
step_physics_min	0.07590351084701154
survival_time_max	14.950000000000076
survival_time_mean	10.587500000000036
survival_time_min	3.4999999999999956

No reset possible

43549

11688

Bhavya Patwa 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 07:29:09+00:00

2020-11-26 07:37:47+00:00

0:08:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6763456665051066
survival_time_median	14.950000000000076
deviation-center-line_median	0.3584533503185324
in-drivable-lane_median	1.40000000000002

other stats

agent_compute-ego_max	0.01772543986638387
agent_compute-ego_mean	0.01705398380756378
agent_compute-ego_median	0.016866121689478555
agent_compute-ego_min	0.016758251984914145
complete-iteration_max	0.2053529890378316
complete-iteration_mean	0.1909431540966034
complete-iteration_median	0.19035044908523557
complete-iteration_min	0.17771872917811077
deviation-center-line_max	0.41818037718774226
deviation-center-line_mean	0.31259695349913313
deviation-center-line_min	0.11530073617172557
deviation-heading_max	3.147033016296344
deviation-heading_mean	2.4715330437827485
deviation-heading_median	2.857100100647341
deviation-heading_min	1.0248989575399667
driven_any_max	1.9399121120142049
driven_any_mean	1.93826584715164
driven_any_median	1.9397796031083572
driven_any_min	1.9335920703756408
driven_lanedir_consec_max	1.893078673564618
driven_lanedir_consec_mean	1.422254427278285
driven_lanedir_consec_min	0.4432477025383096
driven_lanedir_max	1.893078673564618
driven_lanedir_mean	1.422254427278285
driven_lanedir_median	1.6763456665051066
driven_lanedir_min	0.4432477025383096
get_duckie_state_max	2.3706754048665365e-06
get_duckie_state_mean	2.300143241882324e-06
get_duckie_state_median	2.2852420806884768e-06
get_duckie_state_min	2.2594134012858073e-06
get_robot_state_max	0.015652371247609456
get_robot_state_mean	0.014077991445859271
get_robot_state_median	0.014033716917037965
get_robot_state_min	0.012592160701751709
get_state_dump_max	0.01360033909479777
get_state_dump_mean	0.01324361801147461
get_state_dump_median	0.01332744042078654
get_state_dump_min	0.012719252109527589
get_ui_image_max	0.034974528948465984
get_ui_image_mean	0.033696227073669434
get_ui_image_median	0.033799901008605956
get_ui_image_min	0.03221057732899984
in-drivable-lane_max	10.900000000000084
in-drivable-lane_mean	3.425000000000031
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9335920703756408, "get_ui_image": 0.03221057732899984, "step_physics": 0.06814762036005656, "survival_time": 14.950000000000076, "driven_lanedir": 1.4633714937769513, "get_state_dump": 0.012719252109527589, "sim_render-ego": 0.005286402702331543, "get_robot_state": 0.012592160701751709, "get_duckie_state": 2.291997273763021e-06, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.01690877119700114, "deviation-heading": 3.147033016296344, "complete-iteration": 0.17771872917811077, "set_robot_commands": 0.004614839553833008, "deviation-center-line": 0.41818037718774226, "driven_lanedir_consec": 1.4633714937769513, "sim_compute_sim_state": 0.02152538299560547, "sim_compute_performance-ego": 0.00357942263285319}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399121120142049, "get_ui_image": 0.032885231971740723, "step_physics": 0.06967455387115479, "survival_time": 14.950000000000076, "driven_lanedir": 1.893078673564618, "get_state_dump": 0.013088031609853107, "sim_render-ego": 0.005584158102671305, "get_robot_state": 0.014154418309529624, "get_duckie_state": 2.2594134012858073e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016758251984914145, "deviation-heading": 2.8243880788960105, "complete-iteration": 0.18223007917404177, "set_robot_commands": 0.0046554780006408695, "deviation-center-line": 0.31841390938504305, "driven_lanedir_consec": 1.893078673564618, "sim_compute_sim_state": 0.02156670093536377, "sim_compute_performance-ego": 0.0037240441640218097}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9396622947272475, "get_ui_image": 0.03471457004547119, "step_physics": 0.08148304382960002, "survival_time": 14.950000000000076, "driven_lanedir": 0.4432477025383096, "get_state_dump": 0.01356684923171997, "sim_render-ego": 0.005906508763631185, "get_robot_state": 0.013913015524546305, "get_duckie_state": 2.3706754048665365e-06, "in-drivable-lane": 10.900000000000084, "agent_compute-ego": 0.01772543986638387, "deviation-heading": 1.0248989575399667, "complete-iteration": 0.19847081899642943, "set_robot_commands": 0.004593551158905029, "deviation-center-line": 0.11530073617172557, "driven_lanedir_consec": 0.4432477025383096, "sim_compute_sim_state": 0.022508271535237632, "sim_compute_performance-ego": 0.0039100837707519535}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9398969114894664, "get_ui_image": 0.034974528948465984, "step_physics": 0.08264417171478272, "survival_time": 14.950000000000076, "driven_lanedir": 1.8893198392332615, "get_state_dump": 0.01360033909479777, "sim_render-ego": 0.005959866841634114, "get_robot_state": 0.015652371247609456, "get_duckie_state": 2.2784868876139323e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016823472181955974, "deviation-heading": 2.889812122398672, "complete-iteration": 0.2053529890378316, "set_robot_commands": 0.004871989091237386, "deviation-center-line": 0.3984927912520218, "driven_lanedir_consec": 1.8893198392332615, "sim_compute_sim_state": 0.026705342133839925, "sim_compute_performance-ego": 0.00397236426671346}}
set_robot_commands_max	0.004871989091237386
set_robot_commands_mean	0.004683964451154073
set_robot_commands_median	0.004635158777236938
set_robot_commands_min	0.004593551158905029
sim_compute_performance-ego_max	0.00397236426671346
sim_compute_performance-ego_mean	0.003796478708585104
sim_compute_performance-ego_median	0.0038170639673868814
sim_compute_performance-ego_min	0.00357942263285319
sim_compute_sim_state_max	0.026705342133839925
sim_compute_sim_state_mean	0.023076424400011696
sim_compute_sim_state_median	0.0220374862353007
sim_compute_sim_state_min	0.02152538299560547
sim_render-ego_max	0.005959866841634114
sim_render-ego_mean	0.005684234102567036
sim_render-ego_median	0.005745333433151245
sim_render-ego_min	0.005286402702331543
simulation-passed	1
step_physics_max	0.08264417171478272
step_physics_mean	0.07548734744389853
step_physics_median	0.07557879885037741
step_physics_min	0.06814762036005656
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43529

11688

Bhavya Patwa 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 07:14:27+00:00

2020-11-26 07:23:33+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.641000543175384
survival_time_median	14.950000000000076
deviation-center-line_median	0.3712896958060591
in-drivable-lane_median	1.6500000000000234

other stats

agent_compute-ego_max	0.01842417716979981
agent_compute-ego_mean	0.017851560910542807
agent_compute-ego_median	0.01776519854863485
agent_compute-ego_min	0.017451669375101727
complete-iteration_max	0.2125119916598002
complete-iteration_mean	0.20312323868274687
complete-iteration_median	0.2028615093231201
complete-iteration_min	0.1942579444249471
deviation-center-line_max	0.5458530434921426
deviation-center-line_mean	0.3464936581411756
deviation-center-line_min	0.09754219746044174
deviation-heading_max	3.669411064690126
deviation-heading_mean	2.6606727310951137
deviation-heading_median	2.8973146970661645
deviation-heading_min	1.178650465558
driven_any_max	1.939870633925507
driven_any_mean	1.9365044986940063
driven_any_median	1.9397493367561085
driven_any_min	1.926648687338302
driven_lanedir_consec_max	1.8713882069859584
driven_lanedir_consec_mean	1.400569313736006
driven_lanedir_consec_min	0.44888796160729727
driven_lanedir_max	1.8713882069859584
driven_lanedir_mean	1.400569313736006
driven_lanedir_median	1.641000543175384
driven_lanedir_min	0.44888796160729727
get_duckie_state_max	3.789265950520833e-06
get_duckie_state_mean	3.7401914596557617e-06
get_duckie_state_median	3.753503163655599e-06
get_duckie_state_min	3.664493560791015e-06
get_robot_state_max	0.016251951853434244
get_robot_state_mean	0.01531900922457377
get_robot_state_median	0.015240387121836344
get_robot_state_min	0.01454331080118815
get_state_dump_max	0.013771363099416095
get_state_dump_mean	0.01357362449169159
get_state_dump_median	0.013558703660964963
get_state_dump_min	0.013405727545420328
get_ui_image_max	0.03618099689483643
get_ui_image_mean	0.03521467049916585
get_ui_image_median	0.03504154404004415
get_ui_image_min	0.034594597021738685
in-drivable-lane_max	10.850000000000083
in-drivable-lane_mean	3.5375000000000325
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.926648687338302, "get_ui_image": 0.03464887301127116, "step_physics": 0.07784598191579183, "survival_time": 14.950000000000076, "driven_lanedir": 1.41738515682475, "get_state_dump": 0.013426432609558106, "sim_render-ego": 0.005896733601888021, "get_robot_state": 0.015024567445119222, "get_duckie_state": 3.7479400634765622e-06, "in-drivable-lane": 3.300000000000047, "agent_compute-ego": 0.01764846404393514, "deviation-heading": 2.3577591184377824, "complete-iteration": 0.19710671663284304, "set_robot_commands": 0.004745418230692545, "deviation-center-line": 0.3887995036932934, "driven_lanedir_consec": 1.41738515682475, "sim_compute_sim_state": 0.023744653860727945, "sim_compute_performance-ego": 0.003976358572642009}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9398557076428156, "get_ui_image": 0.034594597021738685, "step_physics": 0.07644804716110229, "survival_time": 14.950000000000076, "driven_lanedir": 1.864615929526018, "get_state_dump": 0.013405727545420328, "sim_render-ego": 0.005886557896931966, "get_robot_state": 0.01454331080118815, "get_duckie_state": 3.664493560791015e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017451669375101727, "deviation-heading": 3.669411064690126, "complete-iteration": 0.1942579444249471, "set_robot_commands": 0.004592130978902181, "deviation-center-line": 0.3537798879188248, "driven_lanedir_consec": 1.864615929526018, "sim_compute_sim_state": 0.02324448823928833, "sim_compute_performance-ego": 0.003940086364746093}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9396429658694008, "get_ui_image": 0.03618099689483643, "step_physics": 0.08563388109207154, "survival_time": 14.950000000000076, "driven_lanedir": 0.44888796160729727, "get_state_dump": 0.013690974712371826, "sim_render-ego": 0.006349030335744222, "get_robot_state": 0.015456206798553468, "get_duckie_state": 3.789265950520833e-06, "in-drivable-lane": 10.850000000000083, "agent_compute-ego": 0.01842417716979981, "deviation-heading": 1.178650465558, "complete-iteration": 0.2086163020133972, "set_robot_commands": 0.004825135866800944, "deviation-center-line": 0.09754219746044174, "driven_lanedir_consec": 0.44888796160729727, "sim_compute_sim_state": 0.02374131202697754, "sim_compute_performance-ego": 0.004154834747314453}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939870633925507, "get_ui_image": 0.03543421506881714, "step_physics": 0.08598336140314738, "survival_time": 14.950000000000076, "driven_lanedir": 1.8713882069859584, "get_state_dump": 0.013771363099416095, "sim_render-ego": 0.0062150096893310545, "get_robot_state": 0.016251951853434244, "get_duckie_state": 3.759066263834635e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017881933053334555, "deviation-heading": 3.436870275694546, "complete-iteration": 0.2125119916598002, "set_robot_commands": 0.004911724726359049, "deviation-center-line": 0.5458530434921426, "driven_lanedir_consec": 1.8713882069859584, "sim_compute_sim_state": 0.0276688551902771, "sim_compute_performance-ego": 0.00423511266708374}}
set_robot_commands_max	0.004911724726359049
set_robot_commands_mean	0.00476860245068868
set_robot_commands_median	0.004785277048746745
set_robot_commands_min	0.004592130978902181
sim_compute_performance-ego_max	0.00423511266708374
sim_compute_performance-ego_mean	0.004076598087946574
sim_compute_performance-ego_median	0.004065596659978231
sim_compute_performance-ego_min	0.003940086364746093
sim_compute_sim_state_max	0.0276688551902771
sim_compute_sim_state_mean	0.024599827329317724
sim_compute_sim_state_median	0.023742982943852745
sim_compute_sim_state_min	0.02324448823928833
sim_render-ego_max	0.006349030335744222
sim_render-ego_mean	0.006086832880973816
sim_render-ego_median	0.006055871645609537
sim_render-ego_min	0.005886557896931966
simulation-passed	1
step_physics_max	0.08598336140314738
step_physics_mean	0.08147781789302826
step_physics_median	0.08173993150393169
step_physics_min	0.07644804716110229
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43516

11686

Philippe Reddy 🇨🇦

real-exercise-2

LFv-sim

success

2020-11-26 07:02:36+00:00

2020-11-26 07:10:36+00:00

0:08:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.5922847616266687
survival_time_median	14.950000000000076
deviation-center-line_median	0.7261659508133276
in-drivable-lane_median	1.850000000000013

other stats

agent_compute-ego_max	0.01755158503850301
agent_compute-ego_mean	0.0173721131153986
agent_compute-ego_median	0.017439133326212566
agent_compute-ego_min	0.017058600770666243
complete-iteration_max	0.1960202252611201
complete-iteration_mean	0.19020496000212136
complete-iteration_median	0.18887017925580343
complete-iteration_min	0.18705925623575848
deviation-center-line_max	0.8492807028090942
deviation-center-line_mean	0.7272232014109825
deviation-center-line_min	0.6072802012081809
deviation-heading_max	3.5977133043081557
deviation-heading_mean	3.046411845529758
deviation-heading_median	3.326660665376276
deviation-heading_min	1.934612747058328
driven_any_max	4.849512124598301
driven_any_mean	4.384919484531626
driven_any_median	4.841326373928269
driven_any_min	3.007513065671666
driven_lanedir_consec_max	4.3957181142810855
driven_lanedir_consec_mean	3.466723896043024
driven_lanedir_consec_min	2.2866079466376723
driven_lanedir_max	4.3957181142810855
driven_lanedir_mean	3.466723896043024
driven_lanedir_median	3.5922847616266687
driven_lanedir_min	2.2866079466376723
get_duckie_state_max	2.6798248291015626e-06
get_duckie_state_mean	2.537898138059792e-06
get_duckie_state_median	2.522865931193034e-06
get_duckie_state_min	2.4260358607515374e-06
get_robot_state_max	0.014531035423278807
get_robot_state_mean	0.013750658791961398
get_robot_state_median	0.013745749394098918
get_robot_state_min	0.012980100956368954
get_state_dump_max	0.01342567523320516
get_state_dump_mean	0.013350072080361926
get_state_dump_median	0.013414176702499388
get_state_dump_min	0.013146259683243773
get_ui_image_max	0.033515074151627564
get_ui_image_mean	0.03302148617751209
get_ui_image_median	0.0329180133342743
get_ui_image_min	0.03273484388987223
in-drivable-lane_max	4.150000000000029
in-drivable-lane_mean	2.112500000000016
in-drivable-lane_min	0.6000000000000085
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.833662951213288, "get_ui_image": 0.03273484388987223, "step_physics": 0.07228144407272338, "survival_time": 14.950000000000076, "driven_lanedir": 4.3957181142810855, "get_state_dump": 0.013409410317738853, "sim_render-ego": 0.005608669916788737, "get_robot_state": 0.013631838162740072, "get_duckie_state": 2.6798248291015626e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.01755158503850301, "deviation-heading": 3.5977133043081557, "complete-iteration": 0.1871749989191691, "set_robot_commands": 0.004485569000244141, "deviation-center-line": 0.8492807028090942, "driven_lanedir_consec": 4.3957181142810855, "sim_compute_sim_state": 0.023495972156524655, "sim_compute_performance-ego": 0.003828991254170736}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.849512124598301, "get_ui_image": 0.03283606052398682, "step_physics": 0.0722352663675944, "survival_time": 14.950000000000076, "driven_lanedir": 4.02740192289513, "get_state_dump": 0.013418943087259928, "sim_render-ego": 0.0056976524988810225, "get_robot_state": 0.013859660625457765, "get_duckie_state": 2.559820810953776e-06, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.01736974318822225, "deviation-heading": 3.114042532780336, "complete-iteration": 0.18705925623575848, "set_robot_commands": 0.004522027969360351, "deviation-center-line": 0.7819336612337409, "driven_lanedir_consec": 4.02740192289513, "sim_compute_sim_state": 0.023120826880137127, "sim_compute_performance-ego": 0.0038519843419392904}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.8489897966432505, "get_ui_image": 0.03299996614456177, "step_physics": 0.07394882361094157, "survival_time": 14.950000000000076, "driven_lanedir": 3.1571676003582065, "get_state_dump": 0.01342567523320516, "sim_render-ego": 0.005835215250651042, "get_robot_state": 0.014531035423278807, "get_duckie_state": 2.4859110514322915e-06, "in-drivable-lane": 4.150000000000029, "agent_compute-ego": 0.017508523464202883, "deviation-heading": 3.539278797972216, "complete-iteration": 0.19056535959243776, "set_robot_commands": 0.004694215456644694, "deviation-center-line": 0.6703982403929142, "driven_lanedir_consec": 3.1571676003582065, "sim_compute_sim_state": 0.023587663968404133, "sim_compute_performance-ego": 0.0038882001241048176}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.007513065671666, "get_ui_image": 0.033515074151627564, "step_physics": 0.08082965079774247, "survival_time": 9.4, "driven_lanedir": 2.2866079466376723, "get_state_dump": 0.013146259683243773, "sim_render-ego": 0.005327168931352331, "get_robot_state": 0.012980100956368954, "get_duckie_state": 2.4260358607515374e-06, "in-drivable-lane": 1.799999999999999, "agent_compute-ego": 0.017058600770666243, "deviation-heading": 1.934612747058328, "complete-iteration": 0.1960202252611201, "set_robot_commands": 0.004384333783007683, "deviation-center-line": 0.6072802012081809, "driven_lanedir_consec": 2.2866079466376723, "sim_compute_sim_state": 0.024984932960347928, "sim_compute_performance-ego": 0.0036538699839977506}}
set_robot_commands_max	0.004694215456644694
set_robot_commands_mean	0.004521536552314217
set_robot_commands_median	0.004503798484802246
set_robot_commands_min	0.004384333783007683
sim_compute_performance-ego_max	0.0038882001241048176
sim_compute_performance-ego_mean	0.003805761426053149
sim_compute_performance-ego_median	0.0038404877980550128
sim_compute_performance-ego_min	0.0036538699839977506
sim_compute_sim_state_max	0.024984932960347928
sim_compute_sim_state_mean	0.02379734899135346
sim_compute_sim_state_median	0.02354181806246439
sim_compute_sim_state_min	0.023120826880137127
sim_render-ego_max	0.005835215250651042
sim_render-ego_mean	0.005617176649418284
sim_render-ego_median	0.00565316120783488
sim_render-ego_min	0.005327168931352331
simulation-passed	1
step_physics_max	0.08082965079774247
step_physics_mean	0.07482379621225045
step_physics_median	0.07311513384183248
step_physics_min	0.0722352663675944
survival_time_max	14.950000000000076
survival_time_mean	13.56250000000006
survival_time_min	9.4

No reset possible

43488

11683

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

aborted

2020-11-26 06:45:49+00:00

2020-11-26 06:52:41+00:00

0:06:52

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43486

11681

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 06:30:24+00:00

2020-11-26 06:38:59+00:00

0:08:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.494107707719488
survival_time_median	14.950000000000076
deviation-center-line_median	0.6341898978990881
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.01709114631017049
agent_compute-ego_mean	0.016990982833964524
agent_compute-ego_median	0.016978295929159518
agent_compute-ego_min	0.01691619316736857
complete-iteration_max	0.2062958963346987
complete-iteration_mean	0.19083180863739324
complete-iteration_median	0.18699191212654115
complete-iteration_min	0.183047513961792
deviation-center-line_max	0.7562287657494067
deviation-center-line_mean	0.6314072697922618
deviation-center-line_min	0.5010205176214646
deviation-heading_max	4.529879928464897
deviation-heading_mean	2.7219859343975497
deviation-heading_median	2.208975874191493
deviation-heading_min	1.940112060742316
driven_any_max	3.215563184973643
driven_any_mean	2.740942353712746
driven_any_median	2.795349126192787
driven_any_min	2.1575079774917683
driven_lanedir_consec_max	3.1780789552612676
driven_lanedir_consec_mean	2.5550691951129765
driven_lanedir_consec_min	2.053982409751663
driven_lanedir_max	3.1780789552612676
driven_lanedir_mean	2.5550691951129765
driven_lanedir_median	2.494107707719488
driven_lanedir_min	2.053982409751663
get_duckie_state_max	2.699693044026693e-06
get_duckie_state_mean	2.5247165536150352e-06
get_duckie_state_median	2.5337197334100837e-06
get_duckie_state_min	2.331733703613281e-06
get_robot_state_max	0.014990532398223877
get_robot_state_mean	0.014301614535290164
get_robot_state_median	0.014462480887647792
get_robot_state_min	0.013290963967641194
get_state_dump_max	0.0137433769846131
get_state_dump_mean	0.013405783040925105
get_state_dump_median	0.013318650325139365
get_state_dump_min	0.013242454528808591
get_ui_image_max	0.03453204741326322
get_ui_image_mean	0.03333174971304176
get_ui_image_median	0.03306166887283325
get_ui_image_min	0.0326716136932373
in-drivable-lane_max	3.5500000000000504
in-drivable-lane_mean	0.8875000000000126
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.909382994645344, "get_ui_image": 0.032888219356536866, "step_physics": 0.07147856632868449, "survival_time": 14.950000000000076, "driven_lanedir": 2.8561355525674132, "get_state_dump": 0.013328266143798829, "sim_render-ego": 0.005702329476674398, "get_robot_state": 0.014990532398223877, "get_duckie_state": 2.699693044026693e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01691619316736857, "deviation-heading": 2.4014735473863893, "complete-iteration": 0.1869625949859619, "set_robot_commands": 0.004780577023824056, "deviation-center-line": 0.7117767376571517, "driven_lanedir_consec": 2.8561355525674132, "sim_compute_sim_state": 0.022925273577372233, "sim_compute_performance-ego": 0.0038075709342956544}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.215563184973643, "get_ui_image": 0.0326716136932373, "step_physics": 0.07099733750025432, "survival_time": 14.950000000000076, "driven_lanedir": 3.1780789552612676, "get_state_dump": 0.013242454528808591, "sim_render-ego": 0.005422093868255615, "get_robot_state": 0.013290963967641194, "get_duckie_state": 2.331733703613281e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01709114631017049, "deviation-heading": 2.016478200996597, "complete-iteration": 0.183047513961792, "set_robot_commands": 0.004437559445699056, "deviation-center-line": 0.5010205176214646, "driven_lanedir_consec": 3.1780789552612676, "sim_compute_sim_state": 0.02206966161727905, "sim_compute_performance-ego": 0.003683873017628987}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.1575079774917683, "get_ui_image": 0.03323511838912964, "step_physics": 0.07226239999135335, "survival_time": 14.950000000000076, "driven_lanedir": 2.053982409751663, "get_state_dump": 0.0133090345064799, "sim_render-ego": 0.0056424983342488605, "get_robot_state": 0.014713042577107748, "get_duckie_state": 2.510547637939453e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01701555331548055, "deviation-heading": 4.529879928464897, "complete-iteration": 0.18702122926712036, "set_robot_commands": 0.004598642985026042, "deviation-center-line": 0.7562287657494067, "driven_lanedir_consec": 2.053982409751663, "sim_compute_sim_state": 0.022305890719095865, "sim_compute_performance-ego": 0.0037932833035786945}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.68131525774023, "get_ui_image": 0.03453204741326322, "step_physics": 0.08604182455649224, "survival_time": 14.150000000000066, "driven_lanedir": 2.1320798628715623, "get_state_dump": 0.0137433769846131, "sim_render-ego": 0.005784317798412309, "get_robot_state": 0.014211919198187838, "get_duckie_state": 2.5568918288807144e-06, "in-drivable-lane": 3.5500000000000504, "agent_compute-ego": 0.016941038542838485, "deviation-heading": 1.940112060742316, "complete-iteration": 0.2062958963346987, "set_robot_commands": 0.004527589036382129, "deviation-center-line": 0.5566030581410245, "driven_lanedir_consec": 2.1320798628715623, "sim_compute_sim_state": 0.02642340205162237, "sim_compute_performance-ego": 0.003935594862004472}}
set_robot_commands_max	0.004780577023824056
set_robot_commands_mean	0.00458609212273282
set_robot_commands_median	0.004563116010704086
set_robot_commands_min	0.004437559445699056
sim_compute_performance-ego_max	0.003935594862004472
sim_compute_performance-ego_mean	0.003805080529376952
sim_compute_performance-ego_median	0.0038004271189371742
sim_compute_performance-ego_min	0.003683873017628987
sim_compute_sim_state_max	0.02642340205162237
sim_compute_sim_state_mean	0.02343105699134238
sim_compute_sim_state_median	0.02261558214823405
sim_compute_sim_state_min	0.02206966161727905
sim_render-ego_max	0.005784317798412309
sim_render-ego_mean	0.005637809869397796
sim_render-ego_median	0.005672413905461629
sim_render-ego_min	0.005422093868255615
simulation-passed	1
step_physics_max	0.08604182455649224
step_physics_mean	0.0751950320941961
step_physics_median	0.07187048316001893
step_physics_min	0.07099733750025432
survival_time_max	14.950000000000076
survival_time_mean	14.750000000000076
survival_time_min	14.150000000000066

No reset possible

43468

11677

Daniil Lisus

sim-exercise-2

LFv-sim

success

2020-11-26 05:25:16+00:00

2020-11-26 05:32:31+00:00

0:07:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.0080852867200827
survival_time_median	11.62500000000003
deviation-center-line_median	0.49487586748286194
in-drivable-lane_median	2.700000000000008

other stats

agent_compute-ego_max	0.017906124574424576
agent_compute-ego_mean	0.017633790778784585
agent_compute-ego_median	0.01774369679301618
agent_compute-ego_min	0.017141644954681397
complete-iteration_max	0.19276976872639484
complete-iteration_mean	0.18802762104818235
complete-iteration_median	0.18807303153395363
complete-iteration_min	0.18319465239842733
deviation-center-line_max	1.0157871098547444
deviation-center-line_mean	0.5547327853613288
deviation-center-line_min	0.2133922966248468
deviation-heading_max	3.047340375934827
deviation-heading_mean	1.822550291447325
deviation-heading_median	1.7552219339089066
deviation-heading_min	0.7324169220366601
driven_any_max	4.895006020342744
driven_any_mean	3.728249589868815
driven_any_median	3.688544854571006
driven_any_min	2.6409026299905056
driven_lanedir_consec_max	4.702986759627496
driven_lanedir_consec_mean	2.5315516666970255
driven_lanedir_consec_min	1.4070493337204404
driven_lanedir_max	4.702986759627496
driven_lanedir_mean	2.804085445767949
driven_lanedir_median	2.553152844861929
driven_lanedir_min	1.4070493337204404
get_duckie_state_max	2.5494893391927083e-06
get_duckie_state_mean	2.3936762664520277e-06
get_duckie_state_median	2.4469055398537297e-06
get_duckie_state_min	2.131404646907944e-06
get_robot_state_max	0.014159990923248067
get_robot_state_mean	0.013396787491612269
get_robot_state_median	0.013227872451146445
get_robot_state_min	0.012971414140908116
get_state_dump_max	0.01380624562284372
get_state_dump_mean	0.01340193286214442
get_state_dump_median	0.013352246428110514
get_state_dump_min	0.01309699296951294
get_ui_image_max	0.03315653085708618
get_ui_image_mean	0.032717328205190556
get_ui_image_median	0.03279804176982732
get_ui_image_min	0.0321166984240214
in-drivable-lane_max	4.04999999999999
in-drivable-lane_mean	2.512500000000001
in-drivable-lane_min	0.5999999999999979
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6409026299905056, "get_ui_image": 0.032656727045992, "step_physics": 0.07268129300026999, "survival_time": 6.849999999999984, "driven_lanedir": 1.4070493337204404, "get_state_dump": 0.01380624562284372, "sim_render-ego": 0.005674798993298607, "get_robot_state": 0.014159990923248067, "get_duckie_state": 2.547772261348084e-06, "in-drivable-lane": 2.84999999999999, "agent_compute-ego": 0.017906124574424576, "deviation-heading": 0.7324169220366601, "complete-iteration": 0.18903904761711177, "set_robot_commands": 0.0046303237441682465, "deviation-center-line": 0.2133922966248468, "driven_lanedir_consec": 1.4070493337204404, "sim_compute_sim_state": 0.023533716689061075, "sim_compute_performance-ego": 0.003832797934539127}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.895006020342744, "get_ui_image": 0.0321166984240214, "step_physics": 0.07004098494847616, "survival_time": 14.950000000000076, "driven_lanedir": 4.702986759627496, "get_state_dump": 0.013451924324035644, "sim_render-ego": 0.005456770261128743, "get_robot_state": 0.01347983439763387, "get_duckie_state": 2.5494893391927083e-06, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.017141644954681397, "deviation-heading": 2.553470467919488, "complete-iteration": 0.18319465239842733, "set_robot_commands": 0.004493683973948161, "deviation-center-line": 1.0157871098547444, "driven_lanedir_consec": 4.702986759627496, "sim_compute_sim_state": 0.02307349681854248, "sim_compute_performance-ego": 0.0037787501017252606}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.277345255151124, "get_ui_image": 0.03315653085708618, "step_physics": 0.07506106456120809, "survival_time": 14.950000000000076, "driven_lanedir": 3.573905064899289, "get_state_dump": 0.01309699296951294, "sim_render-ego": 0.005367704232533773, "get_robot_state": 0.012975910504659016, "get_duckie_state": 2.346038818359375e-06, "in-drivable-lane": 2.5500000000000265, "agent_compute-ego": 0.017687249183654784, "deviation-heading": 3.047340375934827, "complete-iteration": 0.1871070154507955, "set_robot_commands": 0.004573033650716146, "deviation-center-line": 0.6757670715359729, "driven_lanedir_consec": 2.483769948615596, "sim_compute_sim_state": 0.021398415565490724, "sim_compute_performance-ego": 0.003640060424804688}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.099744453990887, "get_ui_image": 0.03293935649366264, "step_physics": 0.07652398046240749, "survival_time": 8.299999999999983, "driven_lanedir": 1.5324006248245692, "get_state_dump": 0.013252568532185382, "sim_render-ego": 0.0053138632372201206, "get_robot_state": 0.012971414140908116, "get_duckie_state": 2.131404646907944e-06, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.017800144402377576, "deviation-heading": 0.9569733998983252, "complete-iteration": 0.19276976872639484, "set_robot_commands": 0.004446921578372817, "deviation-center-line": 0.313984663429751, "driven_lanedir_consec": 1.5324006248245692, "sim_compute_sim_state": 0.025682439287024808, "sim_compute_performance-ego": 0.0036944926503192943}}
set_robot_commands_max	0.0046303237441682465
set_robot_commands_mean	0.004535990736801342
set_robot_commands_median	0.004533358812332153
set_robot_commands_min	0.004446921578372817
sim_compute_performance-ego_max	0.003832797934539127
sim_compute_performance-ego_mean	0.0037365252778470926
sim_compute_performance-ego_median	0.0037366213760222774
sim_compute_performance-ego_min	0.003640060424804688
sim_compute_sim_state_max	0.025682439287024808
sim_compute_sim_state_mean	0.02342201709002977
sim_compute_sim_state_median	0.023303606753801775
sim_compute_sim_state_min	0.021398415565490724
sim_render-ego_max	0.005674798993298607
sim_render-ego_mean	0.005453284181045312
sim_render-ego_median	0.005412237246831258
sim_render-ego_min	0.0053138632372201206
simulation-passed	1
step_physics_max	0.07652398046240749
step_physics_mean	0.07357683074309043
step_physics_median	0.07387117878073904
step_physics_min	0.07004098494847616
survival_time_max	14.950000000000076
survival_time_mean	11.262500000000031
survival_time_min	6.849999999999984

No reset possible

43451

11673

Mo Kleit 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 05:11:35+00:00

2020-11-26 05:19:03+00:00

0:07:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.4496946000469313
survival_time_median	11.075000000000022
deviation-center-line_median	0.5237126154014349
in-drivable-lane_median	4.150000000000005

other stats

agent_compute-ego_max	0.0176681121190389
agent_compute-ego_mean	0.017552836979728405
agent_compute-ego_median	0.017630793290436014
agent_compute-ego_min	0.017281649219002694
complete-iteration_max	0.21002933022322928
complete-iteration_mean	0.19841922877862567
complete-iteration_median	0.19624359922355825
complete-iteration_min	0.191160386444157
deviation-center-line_max	0.6455223266121886
deviation-center-line_mean	0.5035789716035044
deviation-center-line_min	0.3213683289989593
deviation-heading_max	2.864673951458395
deviation-heading_mean	1.6778313042305315
deviation-heading_median	1.4618656955137967
deviation-heading_min	0.9229198744361382
driven_any_max	5.784624104101156
driven_any_mean	4.322286243594358
driven_any_median	4.2574011131274485
driven_any_min	2.9897186440213797
driven_lanedir_consec_max	3.3632853222609542
driven_lanedir_consec_mean	2.4887885541042816
driven_lanedir_consec_min	1.6924796940623097
driven_lanedir_max	3.3632853222609542
driven_lanedir_mean	2.4887885541042816
driven_lanedir_median	2.4496946000469313
driven_lanedir_min	1.6924796940623097
get_duckie_state_max	2.750555674235026e-06
get_duckie_state_mean	2.660934022069026e-06
get_duckie_state_median	2.6459862915370156e-06
get_duckie_state_min	2.6012078309670474e-06
get_robot_state_max	0.01497094472249349
get_robot_state_mean	0.014684385047694046
get_robot_state_median	0.014688707878816838
get_robot_state_min	0.014389179710649016
get_state_dump_max	0.01380964443444065
get_state_dump_mean	0.013658184744728867
get_state_dump_median	0.013663239328893295
get_state_dump_min	0.013496615886688232
get_ui_image_max	0.035190553422186785
get_ui_image_mean	0.03416322747834563
get_ui_image_median	0.03398823913204613
get_ui_image_min	0.03348587822710347
in-drivable-lane_max	7.250000000000047
in-drivable-lane_mean	4.275000000000013
in-drivable-lane_min	1.5499999999999945
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.004163538569972, "get_ui_image": 0.033850141689537816, "step_physics": 0.07489842204956347, "survival_time": 10.450000000000014, "driven_lanedir": 1.6924796940623097, "get_state_dump": 0.01380964443444065, "sim_render-ego": 0.005920017735239421, "get_robot_state": 0.014472532500490616, "get_duckie_state": 2.6648124439294258e-06, "in-drivable-lane": 5.649999999999998, "agent_compute-ego": 0.01764156715721605, "deviation-heading": 0.9229198744361382, "complete-iteration": 0.1937875850348952, "set_robot_commands": 0.0047320098968213825, "deviation-center-line": 0.4689359627603752, "driven_lanedir_consec": 1.6924796940623097, "sim_compute_sim_state": 0.02429029131620124, "sim_compute_performance-ego": 0.004020766208046361}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.510638687684924, "get_ui_image": 0.03348587822710347, "step_physics": 0.0736797426500891, "survival_time": 11.700000000000031, "driven_lanedir": 3.3632853222609542, "get_state_dump": 0.013665450943840874, "sim_render-ego": 0.005789173973931206, "get_robot_state": 0.014389179710649016, "get_duckie_state": 2.6012078309670474e-06, "in-drivable-lane": 2.650000000000012, "agent_compute-ego": 0.017620019423655976, "deviation-heading": 1.854401336007097, "complete-iteration": 0.191160386444157, "set_robot_commands": 0.004607264812176044, "deviation-center-line": 0.5784892680424945, "driven_lanedir_consec": 3.3632853222609542, "sim_compute_sim_state": 0.02387121396187024, "sim_compute_performance-ego": 0.003901855558411688}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.784624104101156, "get_ui_image": 0.034126336574554446, "step_physics": 0.0792134181658427, "survival_time": 14.950000000000076, "driven_lanedir": 2.5901284178094457, "get_state_dump": 0.013496615886688232, "sim_render-ego": 0.005916891892751058, "get_robot_state": 0.01497094472249349, "get_duckie_state": 2.750555674235026e-06, "in-drivable-lane": 7.250000000000047, "agent_compute-ego": 0.0176681121190389, "deviation-heading": 2.864673951458395, "complete-iteration": 0.19869961341222128, "set_robot_commands": 0.004673849741617838, "deviation-center-line": 0.6455223266121886, "driven_lanedir_consec": 2.5901284178094457, "sim_compute_sim_state": 0.024565726121266684, "sim_compute_performance-ego": 0.003917901515960693}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9897186440213797, "get_ui_image": 0.035190553422186785, "step_physics": 0.08735515965018303, "survival_time": 7.84999999999998, "driven_lanedir": 2.309260782284417, "get_state_dump": 0.013661027713945716, "sim_render-ego": 0.006033423599923492, "get_robot_state": 0.014904883257143058, "get_duckie_state": 2.627160139144606e-06, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.017281649219002694, "deviation-heading": 1.0693300550204965, "complete-iteration": 0.21002933022322928, "set_robot_commands": 0.0046960867134628785, "deviation-center-line": 0.3213683289989593, "driven_lanedir_consec": 2.309260782284417, "sim_compute_sim_state": 0.026664090004696207, "sim_compute_performance-ego": 0.00409072068086855}}
set_robot_commands_max	0.0047320098968213825
set_robot_commands_mean	0.004677302791019536
set_robot_commands_median	0.004684968227540358
set_robot_commands_min	0.004607264812176044
sim_compute_performance-ego_max	0.00409072068086855
sim_compute_performance-ego_mean	0.003982810990821824
sim_compute_performance-ego_median	0.003969333862003527
sim_compute_performance-ego_min	0.003901855558411688
sim_compute_sim_state_max	0.026664090004696207
sim_compute_sim_state_mean	0.02484783035100859
sim_compute_sim_state_median	0.02442800871873396
sim_compute_sim_state_min	0.02387121396187024
sim_render-ego_max	0.006033423599923492
sim_render-ego_mean	0.005914876800461295
sim_render-ego_median	0.005918454813995239
sim_render-ego_min	0.005789173973931206
simulation-passed	1
step_physics_max	0.08735515965018303
step_physics_mean	0.07878668562891958
step_physics_median	0.07705592010770308
step_physics_min	0.0736797426500891
survival_time_max	14.950000000000076
survival_time_mean	11.237500000000026
survival_time_min	7.84999999999998

No reset possible

43426

11671

Daniil Lisus

sim-exercise-2

LFv-sim

success

2020-11-26 05:01:41+00:00

2020-11-26 05:10:47+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.3099205987394544
survival_time_median	14.950000000000076
deviation-center-line_median	1.0544905308431511
in-drivable-lane_median	2.0749999999999957

other stats

agent_compute-ego_max	0.017912103124886506
agent_compute-ego_mean	0.017659905699002183
agent_compute-ego_median	0.017711267073949176
agent_compute-ego_min	0.017304985523223876
complete-iteration_max	0.20840248293127897
complete-iteration_mean	0.20285644756368368
complete-iteration_median	0.2032113754749298
complete-iteration_min	0.1966005563735962
deviation-center-line_max	1.178040961109731
deviation-center-line_mean	1.0208034020154977
deviation-center-line_min	0.7961915852659577
deviation-heading_max	4.272879657386979
deviation-heading_mean	3.4186637622312084
deviation-heading_median	3.672242382897617
deviation-heading_min	2.057290625742623
driven_any_max	4.75561182330514
driven_any_mean	4.325574491456627
driven_any_median	4.355427754716233
driven_any_min	3.835830633088902
driven_lanedir_consec_max	4.140002699294552
driven_lanedir_consec_mean	3.2650129904941103
driven_lanedir_consec_min	2.30020806520298
driven_lanedir_max	4.140002699294552
driven_lanedir_mean	3.4555723934668565
driven_lanedir_median	3.3099205987394544
driven_lanedir_min	3.0624456770939648
get_duckie_state_max	2.8634071350097656e-06
get_duckie_state_mean	2.726899362464253e-06
get_duckie_state_median	2.743774209140746e-06
get_duckie_state_min	2.556641896565755e-06
get_robot_state_max	0.016443437781215698
get_robot_state_mean	0.015797313860625273
get_robot_state_median	0.0156779150168101
get_robot_state_min	0.015389987627665202
get_state_dump_max	0.013907121232718476
get_state_dump_mean	0.013783657603355808
get_state_dump_median	0.01379802942276001
get_state_dump_min	0.013631450335184732
get_ui_image_max	0.036255347827249325
get_ui_image_mean	0.03513433419147471
get_ui_image_median	0.034861342112223304
get_ui_image_min	0.03455930471420288
in-drivable-lane_max	3.0500000000000185
in-drivable-lane_mean	2.0500000000000016
in-drivable-lane_min	0.9999999999999964
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.835830633088902, "get_ui_image": 0.036255347827249325, "step_physics": 0.08232541025177506, "survival_time": 12.100000000000035, "driven_lanedir": 3.194246024727505, "get_state_dump": 0.013907121232718476, "sim_render-ego": 0.006394933077914656, "get_robot_state": 0.016443437781215698, "get_duckie_state": 2.7004352285842265e-06, "in-drivable-lane": 1.3500000000000014, "agent_compute-ego": 0.017912103124886506, "deviation-heading": 2.057290625742623, "complete-iteration": 0.20840248293127897, "set_robot_commands": 0.004971304215675544, "deviation-center-line": 0.7961915852659577, "driven_lanedir_consec": 3.194246024727505, "sim_compute_sim_state": 0.025834627387937435, "sim_compute_performance-ego": 0.004201345207277408}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.713073730676408, "get_ui_image": 0.03471882820129395, "step_physics": 0.07892720937728882, "survival_time": 14.950000000000076, "driven_lanedir": 3.4255951727514034, "get_state_dump": 0.013796122868855794, "sim_render-ego": 0.0062307612101236975, "get_robot_state": 0.015389987627665202, "get_duckie_state": 2.7871131896972655e-06, "in-drivable-lane": 2.79999999999999, "agent_compute-ego": 0.017781089146931967, "deviation-heading": 4.2714700305410735, "complete-iteration": 0.2009841020901998, "set_robot_commands": 0.004851445357004802, "deviation-center-line": 1.031001056619221, "driven_lanedir_consec": 3.4255951727514034, "sim_compute_sim_state": 0.024842332204182943, "sim_compute_performance-ego": 0.0042915940284729}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.997781778756059, "get_ui_image": 0.03455930471420288, "step_physics": 0.07802131255467733, "survival_time": 14.950000000000076, "driven_lanedir": 3.0624456770939648, "get_state_dump": 0.013799935976664224, "sim_render-ego": 0.0059073980649312335, "get_robot_state": 0.01554035186767578, "get_duckie_state": 2.8634071350097656e-06, "in-drivable-lane": 3.0500000000000185, "agent_compute-ego": 0.01764144500096639, "deviation-heading": 4.272879657386979, "complete-iteration": 0.1966005563735962, "set_robot_commands": 0.004794703324635823, "deviation-center-line": 1.0779800050670814, "driven_lanedir_consec": 2.30020806520298, "sim_compute_sim_state": 0.022238484223683675, "sim_compute_performance-ego": 0.003946359157562256}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.75561182330514, "get_ui_image": 0.03500385602315267, "step_physics": 0.08082927068074544, "survival_time": 14.950000000000076, "driven_lanedir": 4.140002699294552, "get_state_dump": 0.013631450335184732, "sim_render-ego": 0.006006914774576823, "get_robot_state": 0.01581547816594442, "get_duckie_state": 2.556641896565755e-06, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.017304985523223876, "deviation-heading": 3.0730147352541595, "complete-iteration": 0.20543864885965984, "set_robot_commands": 0.004809737205505371, "deviation-center-line": 1.178040961109731, "driven_lanedir_consec": 4.140002699294552, "sim_compute_sim_state": 0.027847992579142253, "sim_compute_performance-ego": 0.00403918186823527}}
set_robot_commands_max	0.004971304215675544
set_robot_commands_mean	0.004856797525705385
set_robot_commands_median	0.0048305912812550865
set_robot_commands_min	0.004794703324635823
sim_compute_performance-ego_max	0.0042915940284729
sim_compute_performance-ego_mean	0.004119620065386959
sim_compute_performance-ego_median	0.004120263537756339
sim_compute_performance-ego_min	0.003946359157562256
sim_compute_sim_state_max	0.027847992579142253
sim_compute_sim_state_mean	0.025190859098736577
sim_compute_sim_state_median	0.025338479796060187
sim_compute_sim_state_min	0.022238484223683675
sim_render-ego_max	0.006394933077914656
sim_render-ego_mean	0.006135001781886602
sim_render-ego_median	0.00611883799235026
sim_render-ego_min	0.0059073980649312335
simulation-passed	1
step_physics_max	0.08232541025177506
step_physics_mean	0.08002580071612167
step_physics_median	0.07987824002901714
step_physics_min	0.07802131255467733
survival_time_max	14.950000000000076
survival_time_mean	14.237500000000068
survival_time_min	12.100000000000035

No reset possible

43405

11670

Mo Kleit 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 04:53:22+00:00

2020-11-26 05:00:49+00:00

0:07:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5572355532867728
survival_time_median	13.150000000000052
deviation-center-line_median	0.3964453662652619
in-drivable-lane_median	1.650000000000011

other stats

agent_compute-ego_max	0.017843942642211914
agent_compute-ego_mean	0.017408692560719724
agent_compute-ego_median	0.017337042335922072
agent_compute-ego_min	0.017116742928822835
complete-iteration_max	0.20721745070906988
complete-iteration_mean	0.19106451860449275
complete-iteration_median	0.18903606885887053
complete-iteration_min	0.17896848599116008
deviation-center-line_max	0.8165644252598924
deviation-center-line_mean	0.455651144379307
deviation-center-line_min	0.21314941972681173
deviation-heading_max	2.933627535933809
deviation-heading_mean	1.5996051462388765
deviation-heading_median	1.5165100653258363
deviation-heading_min	0.4317729183700252
driven_any_max	3.879784284802078
driven_any_mean	2.920549508664683
driven_any_median	3.4014905134452613
driven_any_min	0.9994327229661326
driven_lanedir_consec_max	3.772062271273855
driven_lanedir_consec_mean	1.876280872395211
driven_lanedir_consec_min	0.6185901117334434
driven_lanedir_max	3.772062271273855
driven_lanedir_mean	1.876280872395211
driven_lanedir_median	1.5572355532867728
driven_lanedir_min	0.6185901117334434
get_duckie_state_max	2.42727348603398e-06
get_duckie_state_mean	2.3754238460169513e-06
get_duckie_state_median	2.378496654583319e-06
get_duckie_state_min	2.3174285888671877e-06
get_robot_state_max	0.014350027764946354
get_robot_state_mean	0.01368579678621679
get_robot_state_median	0.013753110960305456
get_robot_state_min	0.012886937459309897
get_state_dump_max	0.013950798884931816
get_state_dump_mean	0.013403644904571002
get_state_dump_median	0.013393146298530344
get_state_dump_min	0.012877488136291504
get_ui_image_max	0.034754749961886634
get_ui_image_mean	0.03334180892214026
get_ui_image_median	0.03316797176996867
get_ui_image_min	0.03227654218673706
in-drivable-lane_max	11.35000000000008
in-drivable-lane_mean	3.6625000000000254
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.9994327229661326, "get_ui_image": 0.03260922431945801, "step_physics": 0.07034684089292963, "survival_time": 4.149999999999993, "driven_lanedir": 0.6185901117334434, "get_state_dump": 0.013950798884931816, "sim_render-ego": 0.00569108308079731, "get_robot_state": 0.013981856495501047, "get_duckie_state": 2.42727348603398e-06, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.017120978918420262, "deviation-heading": 0.4317729183700252, "complete-iteration": 0.18430230129195985, "set_robot_commands": 0.00460357551115105, "deviation-center-line": 0.2261344829400795, "driven_lanedir_consec": 0.6185901117334434, "sim_compute_sim_state": 0.02192984431622976, "sim_compute_performance-ego": 0.0039165738117263975}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879784284802078, "get_ui_image": 0.03227654218673706, "step_physics": 0.06861294905344645, "survival_time": 14.950000000000076, "driven_lanedir": 3.772062271273855, "get_state_dump": 0.012877488136291504, "sim_render-ego": 0.005299740632375081, "get_robot_state": 0.012886937459309897, "get_duckie_state": 2.3444493611653647e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017116742928822835, "deviation-heading": 2.933627535933809, "complete-iteration": 0.17896848599116008, "set_robot_commands": 0.004426829020182292, "deviation-center-line": 0.8165644252598924, "driven_lanedir_consec": 3.772062271273855, "sim_compute_sim_state": 0.021707770824432374, "sim_compute_performance-ego": 0.003626418908437093}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879265644613014, "get_ui_image": 0.03372671922047933, "step_physics": 0.07863995234171549, "survival_time": 14.950000000000076, "driven_lanedir": 0.7933284093769288, "get_state_dump": 0.013173985481262206, "sim_render-ego": 0.005550373395284017, "get_robot_state": 0.013524365425109864, "get_duckie_state": 2.3174285888671877e-06, "in-drivable-lane": 11.35000000000008, "agent_compute-ego": 0.017843942642211914, "deviation-heading": 0.8195112492269142, "complete-iteration": 0.19376983642578124, "set_robot_commands": 0.004591960906982422, "deviation-center-line": 0.21314941972681173, "driven_lanedir_consec": 0.7933284093769288, "sim_compute_sim_state": 0.022829476992289224, "sim_compute_performance-ego": 0.003744050661722819}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9237153822775097, "get_ui_image": 0.034754749961886634, "step_physics": 0.08618277075007098, "survival_time": 11.350000000000026, "driven_lanedir": 2.3211426971966165, "get_state_dump": 0.01361230711579848, "sim_render-ego": 0.00572813555007464, "get_robot_state": 0.014350027764946354, "get_duckie_state": 2.4125439480012735e-06, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.017553105753423885, "deviation-heading": 2.2135088814247585, "complete-iteration": 0.20721745070906988, "set_robot_commands": 0.004594227290888715, "deviation-center-line": 0.5667562495904442, "driven_lanedir_consec": 2.3211426971966165, "sim_compute_sim_state": 0.02645610397607745, "sim_compute_performance-ego": 0.0038368250304906906}}
set_robot_commands_max	0.00460357551115105
set_robot_commands_mean	0.00455414818230112
set_robot_commands_median	0.004593094098935569
set_robot_commands_min	0.004426829020182292
sim_compute_performance-ego_max	0.0039165738117263975
sim_compute_performance-ego_mean	0.00378096710309425
sim_compute_performance-ego_median	0.003790437846106755
sim_compute_performance-ego_min	0.003626418908437093
sim_compute_sim_state_max	0.02645610397607745
sim_compute_sim_state_mean	0.023230799027257203
sim_compute_sim_state_median	0.022379660654259493
sim_compute_sim_state_min	0.021707770824432374
sim_render-ego_max	0.00572813555007464
sim_render-ego_mean	0.005567333164632762
sim_render-ego_median	0.005620728238040664
sim_render-ego_min	0.005299740632375081
simulation-passed	1
step_physics_max	0.08618277075007098
step_physics_mean	0.07594562825954064
step_physics_median	0.07449339661732256
step_physics_min	0.06861294905344645
survival_time_max	14.950000000000076
survival_time_mean	11.350000000000044
survival_time_min	4.149999999999993

No reset possible

43403

11669

Bhavya Patwa 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 04:46:35+00:00

2020-11-26 04:52:12+00:00

0:05:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.794090072466072
survival_time_median	8.074999999999983
deviation-center-line_median	0.31457300335365485
in-drivable-lane_median	2.824999999999993

other stats

agent_compute-ego_max	0.017451869718956226
agent_compute-ego_mean	0.017320656340603896
agent_compute-ego_median	0.017321717151288215
agent_compute-ego_min	0.01718732134088293
complete-iteration_max	0.20596863103635385
complete-iteration_mean	0.19344518431461033
complete-iteration_median	0.18980379177656248
complete-iteration_min	0.18820452266896265
deviation-center-line_max	0.3732786738799138
deviation-center-line_mean	0.2831041179113813
deviation-center-line_min	0.12999179105830172
deviation-heading_max	2.241833227089995
deviation-heading_mean	1.6661828391807667
deviation-heading_median	1.8947679181259365
deviation-heading_min	0.6333622933811992
driven_any_max	1.972983042561496
driven_any_mean	1.629825602920314
driven_any_median	1.616851736598802
driven_any_min	1.3126158959221563
driven_lanedir_consec_max	0.9298973512737116
driven_lanedir_consec_mean	0.7208669140632351
driven_lanedir_consec_min	0.36539016004708513
driven_lanedir_max	0.9298973512737116
driven_lanedir_mean	0.7208669140632351
driven_lanedir_median	0.794090072466072
driven_lanedir_min	0.36539016004708513
get_duckie_state_max	2.534358532397778e-06
get_duckie_state_mean	2.428654529492677e-06
get_duckie_state_median	2.408874105419633e-06
get_duckie_state_min	2.362511374733665e-06
get_robot_state_max	0.015676467449634107
get_robot_state_mean	0.014693977744988068
get_robot_state_median	0.014550344802282908
get_robot_state_min	0.013998753925752358
get_state_dump_max	0.013743541457436302
get_state_dump_mean	0.013626716192828426
get_state_dump_median	0.013681447295405562
get_state_dump_min	0.01340042872306628
get_ui_image_max	0.035602381735137016
get_ui_image_mean	0.0342059663954736
get_ui_image_median	0.033947778124310796
get_ui_image_min	0.03332592759813581
in-drivable-lane_max	7.550000000000003
in-drivable-lane_mean	3.8249999999999953
in-drivable-lane_min	2.0999999999999925
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.5332505063182655, "get_ui_image": 0.03332592759813581, "step_physics": 0.0730133242421336, "survival_time": 7.699999999999981, "driven_lanedir": 0.8293306598435615, "get_state_dump": 0.013743541457436302, "sim_render-ego": 0.005904741101450734, "get_robot_state": 0.015676467449634107, "get_duckie_state": 2.534358532397778e-06, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.01718732134088293, "deviation-heading": 1.9707046511343336, "complete-iteration": 0.19095661113788556, "set_robot_commands": 0.004909530862585291, "deviation-center-line": 0.3034796884611116, "driven_lanedir_consec": 0.8293306598435615, "sim_compute_sim_state": 0.02311843711060363, "sim_compute_performance-ego": 0.003924927154144683}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.7004529668793382, "get_ui_image": 0.033667735094149435, "step_physics": 0.07267548205584463, "survival_time": 8.449999999999985, "driven_lanedir": 0.9298973512737116, "get_state_dump": 0.013628068054921528, "sim_render-ego": 0.00586213162664831, "get_robot_state": 0.013998753925752358, "get_duckie_state": 2.3968826384234006e-06, "in-drivable-lane": 2.9999999999999956, "agent_compute-ego": 0.017269423727453107, "deviation-heading": 2.241833227089995, "complete-iteration": 0.18820452266896265, "set_robot_commands": 0.004627308196570041, "deviation-center-line": 0.3732786738799138, "driven_lanedir_consec": 0.9298973512737116, "sim_compute_sim_state": 0.022367095100809132, "sim_compute_performance-ego": 0.003952293000983063}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.972983042561496, "get_ui_image": 0.034227821154472156, "step_physics": 0.07253891015664125, "survival_time": 9.750000000000004, "driven_lanedir": 0.36539016004708513, "get_state_dump": 0.01340042872306628, "sim_render-ego": 0.005845720340044071, "get_robot_state": 0.014922617643307415, "get_duckie_state": 2.4208655724158653e-06, "in-drivable-lane": 7.550000000000003, "agent_compute-ego": 0.017374010575123323, "deviation-heading": 0.6333622933811992, "complete-iteration": 0.18865097241523937, "set_robot_commands": 0.004598920773237179, "deviation-center-line": 0.12999179105830172, "driven_lanedir_consec": 0.36539016004708513, "sim_compute_sim_state": 0.021705431815905448, "sim_compute_performance-ego": 0.003881500928829878}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.3126158959221563, "get_ui_image": 0.035602381735137016, "step_physics": 0.08519120107997548, "survival_time": 6.5999999999999845, "driven_lanedir": 0.7588494850885825, "get_state_dump": 0.013734826535889595, "sim_render-ego": 0.00568035515871915, "get_robot_state": 0.014178071961258396, "get_duckie_state": 2.362511374733665e-06, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.017451869718956226, "deviation-heading": 1.81883118511754, "complete-iteration": 0.20596863103635385, "set_robot_commands": 0.0046852682576035, "deviation-center-line": 0.32566631824619807, "driven_lanedir_consec": 0.7588494850885825, "sim_compute_sim_state": 0.025371591250101726, "sim_compute_performance-ego": 0.003914675929329612}}
set_robot_commands_max	0.004909530862585291
set_robot_commands_mean	0.004705257022499003
set_robot_commands_median	0.004656288227086771
set_robot_commands_min	0.004598920773237179
sim_compute_performance-ego_max	0.003952293000983063
sim_compute_performance-ego_mean	0.0039183492533218095
sim_compute_performance-ego_median	0.003919801541737147
sim_compute_performance-ego_min	0.003881500928829878
sim_compute_sim_state_max	0.025371591250101726
sim_compute_sim_state_mean	0.023140638819354985
sim_compute_sim_state_median	0.02274276610570638
sim_compute_sim_state_min	0.021705431815905448
sim_render-ego_max	0.005904741101450734
sim_render-ego_mean	0.0058232370567155665
sim_render-ego_median	0.00585392598334619
sim_render-ego_min	0.00568035515871915
simulation-passed	1
step_physics_max	0.08519120107997548
step_physics_mean	0.07585472938364873
step_physics_median	0.07284440314898911
step_physics_min	0.07253891015664125
survival_time_max	9.750000000000004
survival_time_mean	8.12499999999999
survival_time_min	6.5999999999999845

No reset possible

43377

11665

Bhavya Patwa 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-26 04:33:03+00:00

2020-11-26 04:39:15+00:00

0:06:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.601995885401639
survival_time_median	9.074999999999996
deviation-center-line_median	0.2109009136897793
in-drivable-lane_median	2.575000000000014

other stats

agent_compute-ego_max	0.018105699957870855
agent_compute-ego_mean	0.017763653425849905
agent_compute-ego_median	0.017769655654539064
agent_compute-ego_min	0.017409602436450643
complete-iteration_max	0.2082712393772753
complete-iteration_mean	0.20091362395259896
complete-iteration_median	0.19901276921456068
complete-iteration_min	0.1973577180039992
deviation-center-line_max	0.27279312944109513
deviation-center-line_mean	0.20188151385213043
deviation-center-line_min	0.1129310985878681
deviation-heading_max	1.2110203665461003
deviation-heading_mean	0.8451481721578602
deviation-heading_median	0.8830892239434021
deviation-heading_min	0.40339387419853634
driven_any_max	3.34932458961687
driven_any_mean	2.550721740585259
driven_any_median	2.6232977455353024
driven_any_min	1.606966881653562
driven_lanedir_consec_max	1.934934587843674
driven_lanedir_consec_mean	1.4394490392764037
driven_lanedir_consec_min	0.6188697984586624
driven_lanedir_max	1.934934587843674
driven_lanedir_mean	1.4394490392764037
driven_lanedir_median	1.601995885401639
driven_lanedir_min	0.6188697984586624
get_duckie_state_max	3.9568734825204275e-06
get_duckie_state_mean	3.85739377873139e-06
get_duckie_state_median	3.894131161095858e-06
get_duckie_state_min	3.6844393102134145e-06
get_robot_state_max	0.015848711060314644
get_robot_state_mean	0.015487884356982713
get_robot_state_median	0.015467570033199127
get_robot_state_min	0.015167686301217951
get_state_dump_max	0.013865241216957022
get_state_dump_mean	0.013763801822875833
get_state_dump_median	0.013814579712952808
get_state_dump_min	0.013560806648640691
get_ui_image_max	0.035622635974159725
get_ui_image_mean	0.034985038350261496
get_ui_image_median	0.03494684353160708
get_ui_image_min	0.0344238303636721
in-drivable-lane_max	8.050000000000011
in-drivable-lane_mean	3.5375000000000094
in-drivable-lane_min	0.9499999999999966
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.606966881653562, "get_ui_image": 0.03468269383141754, "step_physics": 0.07750160541009465, "survival_time": 5.449999999999989, "driven_lanedir": 1.2993558647048316, "get_state_dump": 0.013865241216957022, "sim_render-ego": 0.005998729565821656, "get_robot_state": 0.01538366352746246, "get_duckie_state": 3.9568734825204275e-06, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.017409602436450643, "deviation-heading": 0.758348331495765, "complete-iteration": 0.1973577180039992, "set_robot_commands": 0.004709534688827095, "deviation-center-line": 0.1806181721228, "driven_lanedir_consec": 1.2993558647048316, "sim_compute_sim_state": 0.02362087232257248, "sim_compute_performance-ego": 0.004031900965839351}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8448766135737427, "get_ui_image": 0.0344238303636721, "step_physics": 0.0780381999665023, "survival_time": 10.650000000000016, "driven_lanedir": 1.934934587843674, "get_state_dump": 0.013774178957155611, "sim_render-ego": 0.006234745464414498, "get_robot_state": 0.015167686301217951, "get_duckie_state": 3.8784994205958405e-06, "in-drivable-lane": 3.700000000000033, "agent_compute-ego": 0.017793894933422965, "deviation-heading": 1.2110203665461003, "complete-iteration": 0.198849167622311, "set_robot_commands": 0.0047370133825311075, "deviation-center-line": 0.27279312944109513, "driven_lanedir_consec": 1.934934587843674, "sim_compute_sim_state": 0.024409102721953055, "sim_compute_performance-ego": 0.004111914567544427}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.34932458961687, "get_ui_image": 0.03521099323179663, "step_physics": 0.07708360625476372, "survival_time": 10.25000000000001, "driven_lanedir": 0.6188697984586624, "get_state_dump": 0.01385498046875, "sim_render-ego": 0.006172389518923876, "get_robot_state": 0.015848711060314644, "get_duckie_state": 3.6844393102134145e-06, "in-drivable-lane": 8.050000000000011, "agent_compute-ego": 0.018105699957870855, "deviation-heading": 0.40339387419853634, "complete-iteration": 0.19917637080681033, "set_robot_commands": 0.0049732906062428545, "deviation-center-line": 0.1129310985878681, "driven_lanedir_consec": 0.6188697984586624, "sim_compute_sim_state": 0.023642045695607256, "sim_compute_performance-ego": 0.004128715468616021}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.401718877496862, "get_ui_image": 0.035622635974159725, "step_physics": 0.08311342136769355, "survival_time": 7.89999999999998, "driven_lanedir": 1.9046359060984464, "get_state_dump": 0.013560806648640691, "sim_render-ego": 0.006243586540222168, "get_robot_state": 0.015551476538935792, "get_duckie_state": 3.909762901595876e-06, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.017745416375655163, "deviation-heading": 1.0078301163910393, "complete-iteration": 0.2082712393772753, "set_robot_commands": 0.004744460311117051, "deviation-center-line": 0.2411836552567586, "driven_lanedir_consec": 1.9046359060984464, "sim_compute_sim_state": 0.02740162384660938, "sim_compute_performance-ego": 0.004131292995018295}}
set_robot_commands_max	0.0049732906062428545
set_robot_commands_mean	0.004791074747179528
set_robot_commands_median	0.004740736846824079
set_robot_commands_min	0.004709534688827095
sim_compute_performance-ego_max	0.004131292995018295
sim_compute_performance-ego_mean	0.004100955999254523
sim_compute_performance-ego_median	0.004120315018080224
sim_compute_performance-ego_min	0.004031900965839351
sim_compute_sim_state_max	0.02740162384660938
sim_compute_sim_state_mean	0.024768411146685543
sim_compute_sim_state_median	0.02402557420878015
sim_compute_sim_state_min	0.02362087232257248
sim_render-ego_max	0.006243586540222168
sim_render-ego_mean	0.00616236277234555
sim_render-ego_median	0.006203567491669186
sim_render-ego_min	0.005998729565821656
simulation-passed	1
step_physics_max	0.08311342136769355
step_physics_mean	0.07893420824976356
step_physics_median	0.07776990268829848
step_physics_min	0.07708360625476372
survival_time_max	10.650000000000016
survival_time_mean	8.562499999999998
survival_time_min	5.449999999999989

No reset possible

43355

11664

Mo Kleit 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-26 04:26:05+00:00

2020-11-26 04:26:29+00:00

0:00:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43341

11660

sim-exercise-2

LFv-sim

success

2020-11-26 04:06:04+00:00

2020-11-26 04:15:32+00:00

0:09:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.5079014987061203
survival_time_median	14.950000000000076
deviation-center-line_median	0.7468160780866353
in-drivable-lane_median	1.500000000000021

other stats

agent_compute-ego_max	0.017371625900268556
agent_compute-ego_mean	0.01734657327334086
agent_compute-ego_median	0.01734434723854065
agent_compute-ego_min	0.01732597271601359
complete-iteration_max	0.19416643540064493
complete-iteration_mean	0.19262373467286428
complete-iteration_median	0.19324891726175944
complete-iteration_min	0.1898306687672933
deviation-center-line_max	1.0334410896557438
deviation-center-line_mean	0.7890480742337027
deviation-center-line_min	0.6291190511057964
deviation-heading_max	4.6218165400542865
deviation-heading_mean	3.408855074516898
deviation-heading_median	3.168328893513655
deviation-heading_min	2.676945970985996
driven_any_max	3.2415792966970143
driven_any_mean	3.064030127978297
driven_any_median	3.0855199111521294
driven_any_min	2.843501392911915
driven_lanedir_consec_max	2.9750168621890305
driven_lanedir_consec_mean	2.497562633512572
driven_lanedir_consec_min	1.9994306744490165
driven_lanedir_max	2.9750168621890305
driven_lanedir_mean	2.6122775977875263
driven_lanedir_median	2.737331427256029
driven_lanedir_min	1.9994306744490165
get_duckie_state_max	2.6051203409830727e-06
get_duckie_state_mean	2.5073687235514325e-06
get_duckie_state_median	2.5399525960286456e-06
get_duckie_state_min	2.3444493611653647e-06
get_robot_state_max	0.015350642999013266
get_robot_state_mean	0.01466693143049876
get_robot_state_median	0.015069193442662556
get_robot_state_min	0.013178695837656657
get_state_dump_max	0.01351764440536499
get_state_dump_mean	0.013397098382314046
get_state_dump_median	0.013392964601516722
get_state_dump_min	0.013284819920857747
get_ui_image_max	0.03394468784332275
get_ui_image_mean	0.03373182793458303
get_ui_image_median	0.033716505368550614
get_ui_image_min	0.03354961315790812
in-drivable-lane_max	3.2000000000000126
in-drivable-lane_mean	1.5500000000000138
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9734649487291582, "get_ui_image": 0.03372267325719198, "step_physics": 0.07441497325897217, "survival_time": 14.950000000000076, "driven_lanedir": 2.857863562351462, "get_state_dump": 0.01351764440536499, "sim_render-ego": 0.0058552018801371255, "get_robot_state": 0.01525363524754842, "get_duckie_state": 2.528826395670573e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017349890867869058, "deviation-heading": 3.3073949940190364, "complete-iteration": 0.19255974928538008, "set_robot_commands": 0.004718991120656332, "deviation-center-line": 0.7652937986950942, "driven_lanedir_consec": 2.857863562351462, "sim_compute_sim_state": 0.02360809087753296, "sim_compute_performance-ego": 0.0039712635676066085}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2415792966970143, "get_ui_image": 0.03354961315790812, "step_physics": 0.07337369918823242, "survival_time": 14.950000000000076, "driven_lanedir": 2.9750168621890305, "get_state_dump": 0.013284819920857747, "sim_render-ego": 0.005672759215037028, "get_robot_state": 0.014884751637776692, "get_duckie_state": 2.5510787963867186e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.01733880360921224, "deviation-heading": 2.676945970985996, "complete-iteration": 0.1898306687672933, "set_robot_commands": 0.0047736175855000815, "deviation-center-line": 0.7283383574781764, "driven_lanedir_consec": 2.9750168621890305, "sim_compute_sim_state": 0.022880018552144367, "sim_compute_performance-ego": 0.003923580646514892}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.843501392911915, "get_ui_image": 0.03394468784332275, "step_physics": 0.07601046323776245, "survival_time": 14.950000000000076, "driven_lanedir": 1.9994306744490165, "get_state_dump": 0.013454817136128745, "sim_render-ego": 0.005774655342102051, "get_robot_state": 0.015350642999013266, "get_duckie_state": 2.6051203409830727e-06, "in-drivable-lane": 3.2000000000000126, "agent_compute-ego": 0.017371625900268556, "deviation-heading": 4.6218165400542865, "complete-iteration": 0.1939380852381388, "set_robot_commands": 0.004710448582967122, "deviation-center-line": 1.0334410896557438, "driven_lanedir_consec": 1.9994306744490165, "sim_compute_sim_state": 0.023278579711914063, "sim_compute_performance-ego": 0.003895566463470459}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1975748735751006, "get_ui_image": 0.03371033747990926, "step_physics": 0.07759697914123535, "survival_time": 14.950000000000076, "driven_lanedir": 2.6167992921605965, "get_state_dump": 0.013331112066904705, "sim_render-ego": 0.005379191239674886, "get_robot_state": 0.013178695837656657, "get_duckie_state": 2.3444493611653647e-06, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.01732597271601359, "deviation-heading": 3.029262793008273, "complete-iteration": 0.19416643540064493, "set_robot_commands": 0.004488241672515869, "deviation-center-line": 0.6291190511057964, "driven_lanedir_consec": 2.1579394350607792, "sim_compute_sim_state": 0.025367989540100097, "sim_compute_performance-ego": 0.003647267818450928}}
set_robot_commands_max	0.0047736175855000815
set_robot_commands_mean	0.004672824740409851
set_robot_commands_median	0.004714719851811727
set_robot_commands_min	0.004488241672515869
sim_compute_performance-ego_max	0.0039712635676066085
sim_compute_performance-ego_mean	0.003859419624010722
sim_compute_performance-ego_median	0.0039095735549926755
sim_compute_performance-ego_min	0.003647267818450928
sim_compute_sim_state_max	0.025367989540100097
sim_compute_sim_state_mean	0.02378366967042287
sim_compute_sim_state_median	0.023443335294723512
sim_compute_sim_state_min	0.022880018552144367
sim_render-ego_max	0.0058552018801371255
sim_render-ego_mean	0.005670451919237773
sim_render-ego_median	0.00572370727856954
sim_render-ego_min	0.005379191239674886
simulation-passed	1
step_physics_max	0.07759697914123535
step_physics_mean	0.0753490287065506
step_physics_median	0.07521271824836731
step_physics_min	0.07337369918823242
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43328

11660

sim-exercise-2

LFv-sim

success

2020-11-26 03:55:24+00:00

2020-11-26 04:04:29+00:00

0:09:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.3182887706348483
survival_time_median	14.950000000000076
deviation-center-line_median	0.7476242992033615
in-drivable-lane_median	0.9250000000000131

other stats

agent_compute-ego_max	0.017361212571461997
agent_compute-ego_mean	0.016970585584640503
agent_compute-ego_median	0.01699195305506388
agent_compute-ego_min	0.016537223656972248
complete-iteration_max	0.19460012356440223
complete-iteration_mean	0.18738735258579256
complete-iteration_median	0.18697194774945575
complete-iteration_min	0.1810053912798564
deviation-center-line_max	0.9416120803343636
deviation-center-line_mean	0.7717424762808984
deviation-center-line_min	0.650109226382507
deviation-heading_max	4.1538009703995105
deviation-heading_mean	3.688777776211413
deviation-heading_median	3.586430640284296
deviation-heading_min	3.4284488538775486
driven_any_max	2.9784255982632017
driven_any_mean	2.8764972949153114
driven_any_median	2.864390500014725
driven_any_min	2.7987825813685947
driven_lanedir_consec_max	2.698845683278817
driven_lanedir_consec_mean	2.3034259531459376
driven_lanedir_consec_min	1.8782805880352376
driven_lanedir_max	2.698845683278817
driven_lanedir_mean	2.4296629231264313
driven_lanedir_median	2.5707627105958357
driven_lanedir_min	1.8782805880352376
get_duckie_state_max	2.3523966471354168e-06
get_duckie_state_mean	2.2524595260620117e-06
get_duckie_state_median	2.222855885823568e-06
get_duckie_state_min	2.211729685465495e-06
get_robot_state_max	0.014043172200520834
get_robot_state_mean	0.01367052972316742
get_robot_state_median	0.013705102602640788
get_robot_state_min	0.01322874148686727
get_state_dump_max	0.013320786158243817
get_state_dump_mean	0.013193511565526329
get_state_dump_median	0.013258957068125406
get_state_dump_min	0.012935345967610676
get_ui_image_max	0.033580451011657714
get_ui_image_mean	0.03304439961910248
get_ui_image_median	0.03303734978040059
get_ui_image_min	0.03252244790395101
in-drivable-lane_max	3.350000000000044
in-drivable-lane_mean	1.4375000000000195
in-drivable-lane_min	0.5500000000000078
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.7987825813685947, "get_ui_image": 0.032598320643107095, "step_physics": 0.07048956791559856, "survival_time": 14.950000000000076, "driven_lanedir": 2.562757140070007, "get_state_dump": 0.012935345967610676, "sim_render-ego": 0.005429087479909261, "get_robot_state": 0.014043172200520834, "get_duckie_state": 2.3523966471354168e-06, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.016537223656972248, "deviation-heading": 3.6371388982709374, "complete-iteration": 0.18324686686197916, "set_robot_commands": 0.0047031672795613605, "deviation-center-line": 0.9416120803343636, "driven_lanedir_consec": 2.562757140070007, "sim_compute_sim_state": 0.02274069865544637, "sim_compute_performance-ego": 0.003632353146870931}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9784255982632017, "get_ui_image": 0.03252244790395101, "step_physics": 0.06945342699686687, "survival_time": 14.950000000000076, "driven_lanedir": 2.698845683278817, "get_state_dump": 0.013219768206278484, "sim_render-ego": 0.005442122618357341, "get_robot_state": 0.01322874148686727, "get_duckie_state": 2.211729685465495e-06, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.016638704935709635, "deviation-heading": 3.4284488538775486, "complete-iteration": 0.1810053912798564, "set_robot_commands": 0.004439650376637776, "deviation-center-line": 0.6818377832097756, "driven_lanedir_consec": 2.698845683278817, "sim_compute_sim_state": 0.02225700537363688, "sim_compute_performance-ego": 0.003665966192881266}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.850480183741314, "get_ui_image": 0.03347637891769409, "step_physics": 0.07565114736557006, "survival_time": 14.950000000000076, "driven_lanedir": 1.8782805880352376, "get_state_dump": 0.013320786158243817, "sim_render-ego": 0.005651578108469646, "get_robot_state": 0.013964142799377442, "get_duckie_state": 2.23239262898763e-06, "in-drivable-lane": 3.350000000000044, "agent_compute-ego": 0.017361212571461997, "deviation-heading": 4.1538009703995105, "complete-iteration": 0.1906970286369324, "set_robot_commands": 0.004404034614562988, "deviation-center-line": 0.8134108151969472, "driven_lanedir_consec": 1.8782805880352376, "sim_compute_sim_state": 0.022916568120320637, "sim_compute_performance-ego": 0.003808739980061849}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8783008162881356, "get_ui_image": 0.033580451011657714, "step_physics": 0.07770602782567342, "survival_time": 14.950000000000076, "driven_lanedir": 2.5787682811216643, "get_state_dump": 0.01329814592997233, "sim_render-ego": 0.005355532964070638, "get_robot_state": 0.013446062405904137, "get_duckie_state": 2.213319142659505e-06, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.01734520117441813, "deviation-heading": 3.5357223822976547, "complete-iteration": 0.19460012356440223, "set_robot_commands": 0.00456085205078125, "deviation-center-line": 0.650109226382507, "driven_lanedir_consec": 2.0738204011996895, "sim_compute_sim_state": 0.0254697322845459, "sim_compute_performance-ego": 0.0036954347292582194}}
set_robot_commands_max	0.0047031672795613605
set_robot_commands_mean	0.004526926080385844
set_robot_commands_median	0.004500251213709513
set_robot_commands_min	0.004404034614562988
sim_compute_performance-ego_max	0.003808739980061849
sim_compute_performance-ego_mean	0.003700623512268066
sim_compute_performance-ego_median	0.0036807004610697426
sim_compute_performance-ego_min	0.003632353146870931
sim_compute_sim_state_max	0.0254697322845459
sim_compute_sim_state_mean	0.023346001108487446
sim_compute_sim_state_median	0.022828633387883504
sim_compute_sim_state_min	0.02225700537363688
sim_render-ego_max	0.005651578108469646
sim_render-ego_mean	0.005469580292701722
sim_render-ego_median	0.005435605049133301
sim_render-ego_min	0.005355532964070638
simulation-passed	1
step_physics_max	0.07770602782567342
step_physics_mean	0.07332504252592723
step_physics_median	0.07307035764058431
step_physics_min	0.06945342699686687
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43314

11658

Philippe Reddy 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 03:15:13+00:00

2020-11-26 03:23:51+00:00

0:08:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.6111907339879834
survival_time_median	14.950000000000076
deviation-center-line_median	0.7463842269182002
in-drivable-lane_median	1.5500000000000114

other stats

agent_compute-ego_max	0.017416929403940837
agent_compute-ego_mean	0.01726047322863624
agent_compute-ego_median	0.017340528283800397
agent_compute-ego_min	0.016943906943003337
complete-iteration_max	0.20859146260079883
complete-iteration_mean	0.19894108231578556
complete-iteration_median	0.20049862583478292
complete-iteration_min	0.18617561499277752
deviation-center-line_max	0.8569044118104671
deviation-center-line_mean	0.6526984938509909
deviation-center-line_min	0.2611211097570962
deviation-heading_max	4.229239074725077
deviation-heading_mean	3.076596581147746
deviation-heading_median	3.5714711794973417
deviation-heading_min	0.934204890871224
driven_any_max	4.8494506668718875
driven_any_mean	4.30191946688195
driven_any_median	4.841263975500777
driven_any_min	2.675699249654357
driven_lanedir_consec_max	4.14101921066157
driven_lanedir_consec_mean	3.3809505908002415
driven_lanedir_consec_min	2.1604016845634284
driven_lanedir_max	4.14101921066157
driven_lanedir_mean	3.3809505908002415
driven_lanedir_median	3.6111907339879834
driven_lanedir_min	2.1604016845634284
get_duckie_state_max	2.741018931070963e-06
get_duckie_state_mean	2.5487797600882396e-06
get_duckie_state_median	2.5138968513125466e-06
get_duckie_state_min	2.426306406656901e-06
get_robot_state_max	0.016073884963989257
get_robot_state_mean	0.01523324593192055
get_robot_state_median	0.015175701067561196
get_robot_state_min	0.014507696628570555
get_state_dump_max	0.013643333117167157
get_state_dump_mean	0.013509699943519773
get_state_dump_median	0.01357782094251542
get_state_dump_min	0.013239824771881103
get_ui_image_max	0.035266143935067315
get_ui_image_mean	0.03450697910218012
get_ui_image_median	0.034876896937688195
get_ui_image_min	0.033007978598276776
in-drivable-lane_max	3.7000000000000233
in-drivable-lane_mean	2.0625000000000115
in-drivable-lane_min	1.450000000000001
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.833583868671469, "get_ui_image": 0.035175385475158694, "step_physics": 0.07987207094828287, "survival_time": 14.950000000000076, "driven_lanedir": 3.991324493333637, "get_state_dump": 0.013643333117167157, "sim_render-ego": 0.006170641581217448, "get_robot_state": 0.016073884963989257, "get_duckie_state": 2.741018931070963e-06, "in-drivable-lane": 1.650000000000004, "agent_compute-ego": 0.017326954205830893, "deviation-heading": 3.6415461918316328, "complete-iteration": 0.20229388475418092, "set_robot_commands": 0.004775698184967041, "deviation-center-line": 0.7958722020146642, "driven_lanedir_consec": 3.991324493333637, "sim_compute_sim_state": 0.02503365675608317, "sim_compute_performance-ego": 0.004067881107330322}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.8494506668718875, "get_ui_image": 0.033007978598276776, "step_physics": 0.07133793830871582, "survival_time": 14.950000000000076, "driven_lanedir": 4.14101921066157, "get_state_dump": 0.013239824771881103, "sim_render-ego": 0.005621108214060465, "get_robot_state": 0.014507696628570555, "get_duckie_state": 2.426306406656901e-06, "in-drivable-lane": 1.4500000000000188, "agent_compute-ego": 0.016943906943003337, "deviation-heading": 3.5013961671630507, "complete-iteration": 0.18617561499277752, "set_robot_commands": 0.004595895608266194, "deviation-center-line": 0.8569044118104671, "driven_lanedir_consec": 4.14101921066157, "sim_compute_sim_state": 0.022973755995432537, "sim_compute_performance-ego": 0.003799088001251221}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.8489440823300844, "get_ui_image": 0.03457840840021769, "step_physics": 0.07843860785166422, "survival_time": 14.950000000000076, "driven_lanedir": 3.2310569746423297, "get_state_dump": 0.013519511222839356, "sim_render-ego": 0.005973914464314779, "get_robot_state": 0.015480461915334066, "get_duckie_state": 2.5471051534016928e-06, "in-drivable-lane": 3.7000000000000233, "agent_compute-ego": 0.017416929403940837, "deviation-heading": 4.229239074725077, "complete-iteration": 0.19870336691538493, "set_robot_commands": 0.004764922459920247, "deviation-center-line": 0.6968962518217361, "driven_lanedir_consec": 3.2310569746423297, "sim_compute_sim_state": 0.024403303464253744, "sim_compute_performance-ego": 0.0039724270502726235}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.675699249654357, "get_ui_image": 0.035266143935067315, "step_physics": 0.08645346476918175, "survival_time": 8.399999999999984, "driven_lanedir": 2.1604016845634284, "get_state_dump": 0.013636130662191482, "sim_render-ego": 0.005871217875253586, "get_robot_state": 0.014870940219788324, "get_duckie_state": 2.4806885492234004e-06, "in-drivable-lane": 1.450000000000001, "agent_compute-ego": 0.017354102361769902, "deviation-heading": 0.934204890871224, "complete-iteration": 0.20859146260079883, "set_robot_commands": 0.00466062483333406, "deviation-center-line": 0.2611211097570962, "driven_lanedir_consec": 2.1604016845634284, "sim_compute_sim_state": 0.02641126655396961, "sim_compute_performance-ego": 0.003912683044161115}}
set_robot_commands_max	0.004775698184967041
set_robot_commands_mean	0.004699285271621886
set_robot_commands_median	0.004712773646627154
set_robot_commands_min	0.004595895608266194
sim_compute_performance-ego_max	0.004067881107330322
sim_compute_performance-ego_mean	0.00393801980075382
sim_compute_performance-ego_median	0.00394255504721687
sim_compute_performance-ego_min	0.003799088001251221
sim_compute_sim_state_max	0.02641126655396961
sim_compute_sim_state_mean	0.024705495692434767
sim_compute_sim_state_median	0.02471848011016846
sim_compute_sim_state_min	0.022973755995432537
sim_render-ego_max	0.006170641581217448
sim_render-ego_mean	0.0059092205337115695
sim_render-ego_median	0.005922566169784182
sim_render-ego_min	0.005621108214060465
simulation-passed	1
step_physics_max	0.08645346476918175
step_physics_mean	0.07902552046946117
step_physics_median	0.07915533939997355
step_physics_min	0.07133793830871582
survival_time_max	14.950000000000076
survival_time_mean	13.312500000000057
survival_time_min	8.399999999999984

No reset possible

43289

11654

Dishank Bansal 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-26 02:55:52+00:00

2020-11-26 03:05:10+00:00

0:09:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.361302160772027
survival_time_median	14.950000000000076
deviation-center-line_median	0.6230244398234224
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.01782682736714681
agent_compute-ego_mean	0.01744582374890645
agent_compute-ego_median	0.01742429733276367
agent_compute-ego_min	0.01710787296295166
complete-iteration_max	0.2037589963277181
complete-iteration_mean	0.19725292444229128
complete-iteration_median	0.19606920520464577
complete-iteration_min	0.19311429103215536
deviation-center-line_max	0.7194200291613841
deviation-center-line_mean	0.6279231120724098
deviation-center-line_min	0.5462235394814101
deviation-heading_max	2.8316350216861963
deviation-heading_mean	2.172368741317055
deviation-heading_median	2.1088710437937688
deviation-heading_min	1.6400978559944863
driven_any_max	2.4313029900196
driven_any_mean	2.3149963234212376
driven_any_median	2.390476202820505
driven_any_min	2.0477298980243392
driven_lanedir_consec_max	2.3897796476041693
driven_lanedir_consec_mean	2.2776079534018288
driven_lanedir_consec_min	1.9980478444590917
driven_lanedir_max	2.3897796476041693
driven_lanedir_mean	2.2776079534018288
driven_lanedir_median	2.361302160772027
driven_lanedir_min	1.9980478444590917
get_duckie_state_max	2.6082992553710936e-06
get_duckie_state_mean	2.5147199630737303e-06
get_duckie_state_median	2.5033950805664062e-06
get_duckie_state_min	2.4437904357910156e-06
get_robot_state_max	0.015166130065917967
get_robot_state_mean	0.014365603526433311
get_robot_state_median	0.014270846843719483
get_robot_state_min	0.013754590352376302
get_state_dump_max	0.01386208693186442
get_state_dump_mean	0.013591710329055786
get_state_dump_median	0.013538575967152914
get_state_dump_min	0.013427602450052896
get_ui_image_max	0.03486419439315796
get_ui_image_mean	0.034434582193692526
get_ui_image_median	0.034518172343571976
get_ui_image_min	0.03383778969446818
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.366100744851757, "get_ui_image": 0.03383778969446818, "step_physics": 0.07512630065282186, "survival_time": 14.950000000000076, "driven_lanedir": 2.3332293005578135, "get_state_dump": 0.01386208693186442, "sim_render-ego": 0.005764497915903727, "get_robot_state": 0.01436284303665161, "get_duckie_state": 2.6082992553710936e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01782682736714681, "deviation-heading": 1.9613464258208977, "complete-iteration": 0.19311429103215536, "set_robot_commands": 0.004756910800933838, "deviation-center-line": 0.7194200291613841, "driven_lanedir_consec": 2.3332293005578135, "sim_compute_sim_state": 0.0235274863243103, "sim_compute_performance-ego": 0.003904429276784261}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.4313029900196, "get_ui_image": 0.03486419439315796, "step_physics": 0.07688877741495768, "survival_time": 14.950000000000076, "driven_lanedir": 2.3893750209862405, "get_state_dump": 0.013548370202382405, "sim_render-ego": 0.005871168772379557, "get_robot_state": 0.014178850650787354, "get_duckie_state": 2.5510787963867186e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017549800872802734, "deviation-heading": 2.2563956617666396, "complete-iteration": 0.194441503683726, "set_robot_commands": 0.004569202264149984, "deviation-center-line": 0.5759708036758394, "driven_lanedir_consec": 2.3893750209862405, "sim_compute_sim_state": 0.022860978444417316, "sim_compute_performance-ego": 0.003962810039520264}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.0477298980243392, "get_ui_image": 0.034709014892578126, "step_physics": 0.07888920307159424, "survival_time": 14.950000000000076, "driven_lanedir": 1.9980478444590917, "get_state_dump": 0.01352878173192342, "sim_render-ego": 0.005943653583526612, "get_robot_state": 0.015166130065917967, "get_duckie_state": 2.455711364746094e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017298793792724608, "deviation-heading": 2.8316350216861963, "complete-iteration": 0.1976969067255656, "set_robot_commands": 0.004832022984822591, "deviation-center-line": 0.5462235394814101, "driven_lanedir_consec": 1.9980478444590917, "sim_compute_sim_state": 0.023193990389506022, "sim_compute_performance-ego": 0.003991357485453288}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4148516607892527, "get_ui_image": 0.03432732979456583, "step_physics": 0.0846941073735555, "survival_time": 14.950000000000076, "driven_lanedir": 2.3897796476041693, "get_state_dump": 0.013427602450052896, "sim_render-ego": 0.005677587985992431, "get_robot_state": 0.013754590352376302, "get_duckie_state": 2.4437904357910156e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01710787296295166, "deviation-heading": 1.6400978559944863, "complete-iteration": 0.2037589963277181, "set_robot_commands": 0.0044707457224528, "deviation-center-line": 0.6700780759710054, "driven_lanedir_consec": 2.3897796476041693, "sim_compute_sim_state": 0.026350293159484863, "sim_compute_performance-ego": 0.003808310826619466}}
set_robot_commands_max	0.004832022984822591
set_robot_commands_mean	0.004657220443089803
set_robot_commands_median	0.00466305653254191
set_robot_commands_min	0.0044707457224528
sim_compute_performance-ego_max	0.003991357485453288
sim_compute_performance-ego_mean	0.0039167269070943195
sim_compute_performance-ego_median	0.003933619658152262
sim_compute_performance-ego_min	0.003808310826619466
sim_compute_sim_state_max	0.026350293159484863
sim_compute_sim_state_mean	0.023983187079429626
sim_compute_sim_state_median	0.02336073835690816
sim_compute_sim_state_min	0.022860978444417316
sim_render-ego_max	0.005943653583526612
sim_render-ego_mean	0.005814227064450582
sim_render-ego_median	0.005817833344141642
sim_render-ego_min	0.005677587985992431
simulation-passed	1
step_physics_max	0.0846941073735555
step_physics_mean	0.07889959712823232
step_physics_median	0.07788899024327596
step_physics_min	0.07512630065282186
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43269

11653

exercise_state_estimation

LFv-sim

success

2020-11-26 02:34:54+00:00

2020-11-26 02:44:09+00:00

0:09:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.385590556796587
survival_time_median	14.950000000000076
deviation-center-line_median	0.7479127773504748
in-drivable-lane_median	1.3000000000000127

other stats

agent_compute-ego_max	0.017570217450459797
agent_compute-ego_mean	0.017247086366017662
agent_compute-ego_median	0.017224322557449344
agent_compute-ego_min	0.016969482898712158
complete-iteration_max	0.197062619527181
complete-iteration_mean	0.18493395348389943
complete-iteration_median	0.18298713405927025
complete-iteration_min	0.1766989262898763
deviation-center-line_max	1.103305872399132
deviation-center-line_mean	0.8184183744884597
deviation-center-line_min	0.6745420708537574
deviation-heading_max	4.110862562757965
deviation-heading_mean	3.3729808412052287
deviation-heading_median	3.269248929991204
deviation-heading_min	2.8425629420805416
driven_any_max	3.154715109364325
driven_any_mean	2.985585580624536
driven_any_median	2.9509187479724206
driven_any_min	2.885789717188977
driven_lanedir_consec_max	3.012403335180123
driven_lanedir_consec_mean	2.4540829070268577
driven_lanedir_consec_min	2.032747179334134
driven_lanedir_max	3.012403335180123
driven_lanedir_mean	2.594435225354406
driven_lanedir_median	2.538298201950191
driven_lanedir_min	2.288741162337119
get_duckie_state_max	2.4215380350748697e-06
get_duckie_state_mean	2.3021300633748373e-06
get_duckie_state_median	2.3523966471354168e-06
get_duckie_state_min	2.0821889241536456e-06
get_robot_state_max	0.014826397895812988
get_robot_state_mean	0.013353901704152423
get_robot_state_median	0.013105762004852296
get_robot_state_min	0.012377684911092122
get_state_dump_max	0.013295877774556476
get_state_dump_mean	0.01285862704118093
get_state_dump_median	0.012781558434168498
get_state_dump_min	0.01257551352183024
get_ui_image_max	0.034170765876770016
get_ui_image_mean	0.032931804060935974
get_ui_image_median	0.03293384234110514
get_ui_image_min	0.031688765684763594
in-drivable-lane_max	2.6000000000000023
in-drivable-lane_mean	1.3625000000000078
in-drivable-lane_min	0.25000000000000355
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.922920270518449, "get_ui_image": 0.031688765684763594, "step_physics": 0.06823037942250569, "survival_time": 14.950000000000076, "driven_lanedir": 2.4824399512560547, "get_state_dump": 0.01257551352183024, "sim_render-ego": 0.005157864093780518, "get_robot_state": 0.012377684911092122, "get_duckie_state": 2.4215380350748697e-06, "in-drivable-lane": 1.750000000000013, "agent_compute-ego": 0.016969482898712158, "deviation-heading": 2.8425629420805416, "complete-iteration": 0.1766989262898763, "set_robot_commands": 0.004355992476145426, "deviation-center-line": 0.7958120314841058, "driven_lanedir_consec": 2.4824399512560547, "sim_compute_sim_state": 0.02167615493138631, "sim_compute_performance-ego": 0.0035346595446268717}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.154715109364325, "get_ui_image": 0.03221237818400065, "step_physics": 0.06797163089116415, "survival_time": 14.950000000000076, "driven_lanedir": 3.012403335180123, "get_state_dump": 0.012667319774627685, "sim_render-ego": 0.005230755011240641, "get_robot_state": 0.012405726114908854, "get_duckie_state": 2.0821889241536456e-06, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.017570217450459797, "deviation-heading": 2.960908476356604, "complete-iteration": 0.17710681994756064, "set_robot_commands": 0.004346873760223389, "deviation-center-line": 0.7000135232168436, "driven_lanedir_consec": 3.012403335180123, "sim_compute_sim_state": 0.021014326413472492, "sim_compute_performance-ego": 0.003555223941802978}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9789172254263923, "get_ui_image": 0.033655306498209636, "step_physics": 0.07338657220204671, "survival_time": 14.950000000000076, "driven_lanedir": 2.288741162337119, "get_state_dump": 0.01289579709370931, "sim_render-ego": 0.005590325991312663, "get_robot_state": 0.014826397895812988, "get_duckie_state": 2.3937225341796873e-06, "in-drivable-lane": 2.6000000000000023, "agent_compute-ego": 0.017299768924713136, "deviation-heading": 4.110862562757965, "complete-iteration": 0.1888674481709798, "set_robot_commands": 0.004794253508249919, "deviation-center-line": 1.103305872399132, "driven_lanedir_consec": 2.288741162337119, "sim_compute_sim_state": 0.022518149216969808, "sim_compute_performance-ego": 0.003761165936787923}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.885789717188977, "get_ui_image": 0.034170765876770016, "step_physics": 0.07905468384424845, "survival_time": 14.950000000000076, "driven_lanedir": 2.5941564526443273, "get_state_dump": 0.013295877774556476, "sim_render-ego": 0.005518702665964762, "get_robot_state": 0.013805797894795736, "get_duckie_state": 2.311070760091146e-06, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.017148876190185548, "deviation-heading": 3.577589383625805, "complete-iteration": 0.197062619527181, "set_robot_commands": 0.0044718090693155925, "deviation-center-line": 0.6745420708537574, "driven_lanedir_consec": 2.032747179334134, "sim_compute_sim_state": 0.025713816483815512, "sim_compute_performance-ego": 0.0037407978375752766}}
set_robot_commands_max	0.004794253508249919
set_robot_commands_mean	0.004492232203483581
set_robot_commands_median	0.00441390077273051
set_robot_commands_min	0.004346873760223389
sim_compute_performance-ego_max	0.003761165936787923
sim_compute_performance-ego_mean	0.0036479618151982625
sim_compute_performance-ego_median	0.003648010889689128
sim_compute_performance-ego_min	0.0035346595446268717
sim_compute_sim_state_max	0.025713816483815512
sim_compute_sim_state_mean	0.022730611761411033
sim_compute_sim_state_median	0.02209715207417806
sim_compute_sim_state_min	0.021014326413472492
sim_render-ego_max	0.005590325991312663
sim_render-ego_mean	0.005374411940574647
sim_render-ego_median	0.005374728838602702
sim_render-ego_min	0.005157864093780518
simulation-passed	1
step_physics_max	0.07905468384424845
step_physics_mean	0.07216081658999125
step_physics_median	0.0708084758122762
step_physics_min	0.06797163089116415
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43256

11650

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 02:13:36+00:00

2020-11-26 02:21:45+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.31382222551412
survival_time_median	14.950000000000076
deviation-center-line_median	0.5416476767028401
in-drivable-lane_median	2.374999999999997

other stats

agent_compute-ego_max	0.01767677625020345
agent_compute-ego_mean	0.017156371281180582
agent_compute-ego_median	0.017208019506203737
agent_compute-ego_min	0.01653266986211141
complete-iteration_max	0.18563793420791627
complete-iteration_mean	0.18104614951241185
complete-iteration_median	0.18111817479133607
complete-iteration_min	0.176310314259059
deviation-center-line_max	0.6913617226819185
deviation-center-line_mean	0.4910169855821507
deviation-center-line_min	0.18941086624100417
deviation-heading_max	2.4412651171384456
deviation-heading_mean	1.8142860206353788
deviation-heading_median	2.166004226414385
deviation-heading_min	0.4838705125743
driven_any_max	4.073621906242589
driven_any_mean	3.0688551734743648
driven_any_median	3.148517124844507
driven_any_min	1.904764537965856
driven_lanedir_consec_max	3.6203830698882022
driven_lanedir_consec_mean	2.3031868313295583
driven_lanedir_consec_min	0.964719804401791
driven_lanedir_max	3.6203830698882022
driven_lanedir_mean	2.3031868313295583
driven_lanedir_median	2.31382222551412
driven_lanedir_min	0.964719804401791
get_duckie_state_max	2.402654835875605e-06
get_duckie_state_mean	2.1791933847704963e-06
get_duckie_state_median	2.131064732869466e-06
get_duckie_state_min	2.051989237467448e-06
get_robot_state_max	0.012643832555958922
get_robot_state_mean	0.012461575118588728
get_robot_state_median	0.01246472438176473
get_robot_state_min	0.012273019154866536
get_state_dump_max	0.01282099099226401
get_state_dump_mean	0.01259996754742564
get_state_dump_median	0.012530553738276164
get_state_dump_min	0.01251777172088623
get_ui_image_max	0.033161486784617104
get_ui_image_mean	0.03233792716628509
get_ui_image_median	0.03240505456924439
get_ui_image_min	0.031380112742034484
in-drivable-lane_max	9.700000000000047
in-drivable-lane_mean	4.037500000000012
in-drivable-lane_min	1.7000000000000082
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.904764537965856, "get_ui_image": 0.031380112742034484, "step_physics": 0.06678439361948363, "survival_time": 7.099999999999983, "driven_lanedir": 1.210043113385496, "get_state_dump": 0.01282099099226401, "sim_render-ego": 0.005269969013375296, "get_robot_state": 0.012643832555958922, "get_duckie_state": 2.402654835875605e-06, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.017275363626614422, "deviation-heading": 0.4838705125743, "complete-iteration": 0.176310314259059, "set_robot_commands": 0.004547406250322369, "deviation-center-line": 0.18941086624100417, "driven_lanedir_consec": 1.210043113385496, "sim_compute_sim_state": 0.021853262270000617, "sim_compute_performance-ego": 0.003599999656139965}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.716933205545613, "get_ui_image": 0.031699586709340415, "step_physics": 0.06784644444783529, "survival_time": 14.950000000000076, "driven_lanedir": 3.417601337642744, "get_state_dump": 0.012533007462819415, "sim_render-ego": 0.0052418931325276695, "get_robot_state": 0.01240631103515625, "get_duckie_state": 2.108414967854818e-06, "in-drivable-lane": 1.7000000000000082, "agent_compute-ego": 0.01767677625020345, "deviation-heading": 2.4412651171384456, "complete-iteration": 0.17715341567993165, "set_robot_commands": 0.0045137747128804525, "deviation-center-line": 0.6913617226819185, "driven_lanedir_consec": 3.417601337642744, "sim_compute_sim_state": 0.021549036502838136, "sim_compute_performance-ego": 0.0035492968559265137}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.580101044143402, "get_ui_image": 0.03311052242914836, "step_physics": 0.07472755432128907, "survival_time": 14.950000000000076, "driven_lanedir": 0.964719804401791, "get_state_dump": 0.01251777172088623, "sim_render-ego": 0.0052932524681091305, "get_robot_state": 0.012523137728373207, "get_duckie_state": 2.051989237467448e-06, "in-drivable-lane": 9.700000000000047, "agent_compute-ego": 0.01714067538579305, "deviation-heading": 2.2264171951765896, "complete-iteration": 0.18508293390274047, "set_robot_commands": 0.0044040886561075845, "deviation-center-line": 0.43457257790532544, "driven_lanedir_consec": 0.964719804401791, "sim_compute_sim_state": 0.021685073375701903, "sim_compute_performance-ego": 0.0035448789596557615}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.073621906242589, "get_ui_image": 0.033161486784617104, "step_physics": 0.07328200022379558, "survival_time": 14.950000000000076, "driven_lanedir": 3.6203830698882022, "get_state_dump": 0.012528100013732913, "sim_render-ego": 0.00509283463160197, "get_robot_state": 0.012273019154866536, "get_duckie_state": 2.1537144978841146e-06, "in-drivable-lane": 1.850000000000004, "agent_compute-ego": 0.01653266986211141, "deviation-heading": 2.1055912576521805, "complete-iteration": 0.18563793420791627, "set_robot_commands": 0.004492051601409912, "deviation-center-line": 0.6487227755003547, "driven_lanedir_consec": 3.6203830698882022, "sim_compute_sim_state": 0.024661860466003417, "sim_compute_performance-ego": 0.0034774144490559897}}
set_robot_commands_max	0.004547406250322369
set_robot_commands_mean	0.00448933030518008
set_robot_commands_median	0.004502913157145182
set_robot_commands_min	0.0044040886561075845
sim_compute_performance-ego_max	0.003599999656139965
sim_compute_performance-ego_mean	0.003542897480194558
sim_compute_performance-ego_median	0.003547087907791138
sim_compute_performance-ego_min	0.0034774144490559897
sim_compute_sim_state_max	0.024661860466003417
sim_compute_sim_state_mean	0.022437308153636017
sim_compute_sim_state_median	0.02176916782285126
sim_compute_sim_state_min	0.021549036502838136
sim_render-ego_max	0.0052932524681091305
sim_render-ego_mean	0.005224487311403517
sim_render-ego_median	0.005255931072951483
sim_render-ego_min	0.00509283463160197
simulation-passed	1
step_physics_max	0.07472755432128907
step_physics_mean	0.0706600981531009
step_physics_median	0.07056422233581544
step_physics_min	0.06678439361948363
survival_time_max	14.950000000000076
survival_time_mean	12.987500000000054
survival_time_min	7.099999999999983

No reset possible

43247

11647

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 01:40:18+00:00

2020-11-26 01:47:34+00:00

0:07:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.614840969579131
survival_time_median	14.950000000000076
deviation-center-line_median	0.8658083822344222
in-drivable-lane_median	0.17499999999999938

other stats

agent_compute-ego_max	0.017200068632761637
agent_compute-ego_mean	0.01689472986219075
agent_compute-ego_median	0.016973054409027098
agent_compute-ego_min	0.016432741997947156
complete-iteration_max	0.19466751098632812
complete-iteration_mean	0.1860797684181464
complete-iteration_median	0.18442642370859785
complete-iteration_min	0.18079871526906188
deviation-center-line_max	1.0147572691685665
deviation-center-line_mean	0.7139742800344571
deviation-center-line_min	0.10952308650041769
deviation-heading_max	4.504192956377998
deviation-heading_mean	2.8046142382842403
deviation-heading_median	3.1171422270840066
deviation-heading_min	0.47997954259095055
driven_any_max	3.403550910745259
driven_any_mean	2.579121644891039
driven_any_median	2.95755174458931
driven_any_min	0.9978321796402784
driven_lanedir_consec_max	3.108702426437985
driven_lanedir_consec_mean	2.2957020659121765
driven_lanedir_consec_min	0.8444238980524599
driven_lanedir_max	3.108702426437985
driven_lanedir_mean	2.2957020659121765
driven_lanedir_median	2.614840969579131
driven_lanedir_min	0.8444238980524599
get_duckie_state_max	2.458061970455546e-06
get_duckie_state_mean	2.402456153726354e-06
get_duckie_state_median	2.404451370239258e-06
get_duckie_state_min	2.342859903971354e-06
get_robot_state_max	0.013459863797040053
get_robot_state_mean	0.013224292828443463
get_robot_state_median	0.013205248912175498
get_robot_state_min	0.013026809692382813
get_state_dump_max	0.013453423137396154
get_state_dump_mean	0.013286113727820311
get_state_dump_median	0.013285474379857382
get_state_dump_min	0.01312008301417033
get_ui_image_max	0.03347900946935018
get_ui_image_mean	0.03276319168543032
get_ui_image_median	0.032630196809768676
get_ui_image_min	0.03231336365283375
in-drivable-lane_max	1.7500000000000249
in-drivable-lane_mean	0.5250000000000059
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.9978321796402784, "get_ui_image": 0.03231336365283375, "step_physics": 0.06993749108113034, "survival_time": 3.5499999999999954, "driven_lanedir": 0.8444238980524599, "get_state_dump": 0.013453423137396154, "sim_render-ego": 0.00547001731227821, "get_robot_state": 0.013459863797040053, "get_duckie_state": 2.458061970455546e-06, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.016432741997947156, "deviation-heading": 0.47997954259095055, "complete-iteration": 0.18079871526906188, "set_robot_commands": 0.004493810761142784, "deviation-center-line": 0.10952308650041769, "driven_lanedir_consec": 0.8444238980524599, "sim_compute_sim_state": 0.021369238974342883, "sim_compute_performance-ego": 0.00372920573597223}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2132111927414373, "get_ui_image": 0.03236019690831502, "step_physics": 0.07028666019439697, "survival_time": 14.950000000000076, "driven_lanedir": 3.108702426437985, "get_state_dump": 0.01335919221242269, "sim_render-ego": 0.005500885645548502, "get_robot_state": 0.013133060137430827, "get_duckie_state": 2.342859903971354e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01704328934351603, "deviation-heading": 3.2080153414547294, "complete-iteration": 0.18191625992457072, "set_robot_commands": 0.004457315603892008, "deviation-center-line": 0.7430379634621868, "driven_lanedir_consec": 3.108702426437985, "sim_compute_sim_state": 0.021912156740824383, "sim_compute_performance-ego": 0.003727446397145589}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7018922964371814, "get_ui_image": 0.03290019671122233, "step_physics": 0.07448806524276734, "survival_time": 14.950000000000076, "driven_lanedir": 2.526752989735028, "get_state_dump": 0.013211756547292074, "sim_render-ego": 0.005529041290283203, "get_robot_state": 0.013277437686920166, "get_duckie_state": 2.4485588073730468e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017200068632761637, "deviation-heading": 4.504192956377998, "complete-iteration": 0.18693658749262493, "set_robot_commands": 0.004552590847015381, "deviation-center-line": 1.0147572691685665, "driven_lanedir_consec": 2.526752989735028, "sim_compute_sim_state": 0.02190474271774292, "sim_compute_performance-ego": 0.0037310274442036943}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.403550910745259, "get_ui_image": 0.03347900946935018, "step_physics": 0.07943431695302328, "survival_time": 14.950000000000076, "driven_lanedir": 2.7029289494232343, "get_state_dump": 0.01312008301417033, "sim_render-ego": 0.005343640645345052, "get_robot_state": 0.013026809692382813, "get_duckie_state": 2.360343933105469e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.01690281947453817, "deviation-heading": 3.0262691127132837, "complete-iteration": 0.19466751098632812, "set_robot_commands": 0.004449838002522786, "deviation-center-line": 0.9885788010066576, "driven_lanedir_consec": 2.7029289494232343, "sim_compute_sim_state": 0.02515564680099487, "sim_compute_performance-ego": 0.003617045084635417}}
set_robot_commands_max	0.004552590847015381
set_robot_commands_mean	0.00448838880364324
set_robot_commands_median	0.004475563182517396
set_robot_commands_min	0.004449838002522786
sim_compute_performance-ego_max	0.0037310274442036943
sim_compute_performance-ego_mean	0.003701181165489233
sim_compute_performance-ego_median	0.0037283260665589095
sim_compute_performance-ego_min	0.003617045084635417
sim_compute_sim_state_max	0.02515564680099487
sim_compute_sim_state_mean	0.022585446308476264
sim_compute_sim_state_median	0.02190844972928365
sim_compute_sim_state_min	0.021369238974342883
sim_render-ego_max	0.005529041290283203
sim_render-ego_mean	0.005460896223363741
sim_render-ego_median	0.005485451478913356
sim_render-ego_min	0.005343640645345052
simulation-passed	1
step_physics_max	0.07943431695302328
step_physics_mean	0.07353663336782948
step_physics_median	0.07238736271858215
step_physics_min	0.06993749108113034
survival_time_max	14.950000000000076
survival_time_mean	12.100000000000056
survival_time_min	3.5499999999999954

No reset possible

43237

11642

Mo Kleit 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 01:04:33+00:00

2020-11-26 01:13:17+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.7800425735008747
survival_time_median	14.950000000000076
deviation-center-line_median	0.7045120280382496
in-drivable-lane_median	2.500000000000011

other stats

agent_compute-ego_max	0.01780621846516927
agent_compute-ego_mean	0.017575139403343203
agent_compute-ego_median	0.017512095769246422
agent_compute-ego_min	0.017470147609710693
complete-iteration_max	0.20435298124949136
complete-iteration_mean	0.19843757152557373
complete-iteration_median	0.198626921971639
complete-iteration_min	0.19214346090952555
deviation-center-line_max	0.8630816244485429
deviation-center-line_mean	0.6205528313228907
deviation-center-line_min	0.21010564476652055
deviation-heading_max	3.682851892481976
deviation-heading_mean	2.407942755941297
deviation-heading_median	2.494014644213336
deviation-heading_min	0.9608898428565398
driven_any_max	3.879754844068223
driven_any_mean	3.8764662992038126
driven_any_median	3.8795288943581263
driven_any_min	3.867052564030774
driven_lanedir_consec_max	3.5454465072788546
driven_lanedir_consec_mean	2.4835685528567386
driven_lanedir_consec_min	0.8287425571463504
driven_lanedir_max	3.5454465072788546
driven_lanedir_mean	2.6369471107790337
driven_lanedir_median	3.0867996893454652
driven_lanedir_min	0.8287425571463504
get_duckie_state_max	2.6337305704752605e-06
get_duckie_state_mean	2.511342366536458e-06
get_duckie_state_median	2.5526682535807292e-06
get_duckie_state_min	2.3063023885091147e-06
get_robot_state_max	0.015823002656300864
get_robot_state_mean	0.015058177709579469
get_robot_state_median	0.01519665280977885
get_robot_state_min	0.01401640256245931
get_state_dump_max	0.01365273078282674
get_state_dump_mean	0.013416223327318828
get_state_dump_median	0.01343989133834839
get_state_dump_min	0.013132379849751793
get_ui_image_max	0.03449556589126587
get_ui_image_mean	0.03417392392953237
get_ui_image_median	0.0342732298374176
get_ui_image_min	0.0336536701520284
in-drivable-lane_max	11.15000000000008
in-drivable-lane_mean	4.187500000000028
in-drivable-lane_min	0.6000000000000085
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.867052564030774, "get_ui_image": 0.034387973149617515, "step_physics": 0.07926570812861125, "survival_time": 14.950000000000076, "driven_lanedir": 2.847328293771262, "get_state_dump": 0.013425375620524089, "sim_render-ego": 0.0058795770009358725, "get_robot_state": 0.015170532862345378, "get_duckie_state": 2.6337305704752605e-06, "in-drivable-lane": 3.450000000000009, "agent_compute-ego": 0.017506607373555503, "deviation-heading": 2.2170830071892307, "complete-iteration": 0.1969829797744751, "set_robot_commands": 0.004660437901814779, "deviation-center-line": 0.8630816244485429, "driven_lanedir_consec": 2.2338140620820814, "sim_compute_sim_state": 0.022598605950673423, "sim_compute_performance-ego": 0.003942093054453532}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879673856873375, "get_ui_image": 0.0336536701520284, "step_physics": 0.07513700326283773, "survival_time": 14.950000000000076, "driven_lanedir": 3.5454465072788546, "get_state_dump": 0.01345440705617269, "sim_render-ego": 0.005818739732106526, "get_robot_state": 0.01401640256245931, "get_duckie_state": 2.53756841023763e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.01780621846516927, "deviation-heading": 3.682851892481976, "complete-iteration": 0.19214346090952555, "set_robot_commands": 0.004625213940938314, "deviation-center-line": 0.8446295107259965, "driven_lanedir_consec": 3.5454465072788546, "sim_compute_sim_state": 0.023589561780293783, "sim_compute_performance-ego": 0.003891907533009847}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879383931842878, "get_ui_image": 0.03415848652521769, "step_physics": 0.08162304798762003, "survival_time": 14.950000000000076, "driven_lanedir": 0.8287425571463504, "get_state_dump": 0.013132379849751793, "sim_render-ego": 0.005902722676595052, "get_robot_state": 0.01522277275721232, "get_duckie_state": 2.3063023885091147e-06, "in-drivable-lane": 11.15000000000008, "agent_compute-ego": 0.017470147609710693, "deviation-heading": 0.9608898428565398, "complete-iteration": 0.2002708641688029, "set_robot_commands": 0.004672791957855225, "deviation-center-line": 0.21010564476652055, "driven_lanedir_consec": 0.8287425571463504, "sim_compute_sim_state": 0.02403299331665039, "sim_compute_performance-ego": 0.003908979098002116}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.879754844068223, "get_ui_image": 0.03449556589126587, "step_physics": 0.08061830441157024, "survival_time": 14.950000000000076, "driven_lanedir": 3.326271084919668, "get_state_dump": 0.01365273078282674, "sim_render-ego": 0.0059317445755004885, "get_robot_state": 0.015823002656300864, "get_duckie_state": 2.567768096923828e-06, "in-drivable-lane": 1.5500000000000131, "agent_compute-ego": 0.017517584164937337, "deviation-heading": 2.7709462812374412, "complete-iteration": 0.20435298124949136, "set_robot_commands": 0.004986841678619385, "deviation-center-line": 0.5643945453505028, "driven_lanedir_consec": 3.326271084919668, "sim_compute_sim_state": 0.02713766574859619, "sim_compute_performance-ego": 0.004036631584167481}}
set_robot_commands_max	0.004986841678619385
set_robot_commands_mean	0.0047363213698069255
set_robot_commands_median	0.004666614929835002
set_robot_commands_min	0.004625213940938314
sim_compute_performance-ego_max	0.004036631584167481
sim_compute_performance-ego_mean	0.003944902817408244
sim_compute_performance-ego_median	0.003925536076227824
sim_compute_performance-ego_min	0.003891907533009847
sim_compute_sim_state_max	0.02713766574859619
sim_compute_sim_state_mean	0.02433970669905345
sim_compute_sim_state_median	0.02381127754847209
sim_compute_sim_state_min	0.022598605950673423
sim_render-ego_max	0.0059317445755004885
sim_render-ego_mean	0.0058831959962844845
sim_render-ego_median	0.005891149838765462
sim_render-ego_min	0.005818739732106526
simulation-passed	1
step_physics_max	0.08162304798762003
step_physics_mean	0.07916101594765981
step_physics_median	0.07994200627009074
step_physics_min	0.07513700326283773
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43225

11640

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 00:39:00+00:00

2020-11-26 00:47:33+00:00

0:08:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.235938339924606
survival_time_median	14.950000000000076
deviation-center-line_median	0.6390290394092777
in-drivable-lane_median	2.575000000000009

other stats

agent_compute-ego_max	0.017149282296498616
agent_compute-ego_mean	0.017078812718391418
agent_compute-ego_median	0.01709164579709371
agent_compute-ego_min	0.016982676982879637
complete-iteration_max	0.19419326225916544
complete-iteration_mean	0.1888342523574829
complete-iteration_median	0.18954020460446672
complete-iteration_min	0.1820633379618327
deviation-center-line_max	0.8127901871053367
deviation-center-line_mean	0.5855618173260894
deviation-center-line_min	0.25139900338046545
deviation-heading_max	2.5918198219552764
deviation-heading_mean	2.3688357894395984
deviation-heading_median	2.394020582239005
deviation-heading_min	2.0954821713251075
driven_any_max	3.817103669401108
driven_any_mean	3.542133718570491
driven_any_median	3.765733533051917
driven_any_min	2.8199641387770225
driven_lanedir_consec_max	3.7187308345693504
driven_lanedir_consec_mean	2.762331756797125
driven_lanedir_consec_min	0.858719512769938
driven_lanedir_max	3.7187308345693504
driven_lanedir_mean	2.7624115631192976
driven_lanedir_median	3.236097952568951
driven_lanedir_min	0.858719512769938
get_duckie_state_max	2.65200932820638e-06
get_duckie_state_mean	2.417564392089844e-06
get_duckie_state_median	2.350807189941406e-06
get_duckie_state_min	2.3166338602701823e-06
get_robot_state_max	0.015091581344604492
get_robot_state_mean	0.013555454015731811
get_robot_state_median	0.013131180206934613
get_robot_state_min	0.012867874304453531
get_state_dump_max	0.013214205900828044
get_state_dump_mean	0.013095231254895527
get_state_dump_median	0.013120407660802203
get_state_dump_min	0.012925903797149658
get_ui_image_max	0.03386621952056885
get_ui_image_mean	0.033287032047907505
get_ui_image_median	0.033370846509933466
get_ui_image_min	0.032540215651194256
in-drivable-lane_max	10.450000000000085
in-drivable-lane_mean	3.9000000000000257
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.7504741751029376, "get_ui_image": 0.033128248850504555, "step_physics": 0.0726063338915507, "survival_time": 14.950000000000076, "driven_lanedir": 2.9160557235293627, "get_state_dump": 0.013214205900828044, "sim_render-ego": 0.00577773650487264, "get_robot_state": 0.015091581344604492, "get_duckie_state": 2.65200932820638e-06, "in-drivable-lane": 3.7500000000000178, "agent_compute-ego": 0.017052280902862548, "deviation-heading": 2.447804317969396, "complete-iteration": 0.1887806312243144, "set_robot_commands": 0.004722015062967936, "deviation-center-line": 0.5450799808970367, "driven_lanedir_consec": 2.9157364982406735, "sim_compute_sim_state": 0.023259992599487304, "sim_compute_performance-ego": 0.003791786034901937}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.817103669401108, "get_ui_image": 0.032540215651194256, "step_physics": 0.07070968468983968, "survival_time": 14.950000000000076, "driven_lanedir": 3.7187308345693504, "get_state_dump": 0.012925903797149658, "sim_render-ego": 0.005372854073842367, "get_robot_state": 0.013024829228719077, "get_duckie_state": 2.3595492045084635e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01713101069132487, "deviation-heading": 2.5918198219552764, "complete-iteration": 0.1820633379618327, "set_robot_commands": 0.004437674681345621, "deviation-center-line": 0.8127901871053367, "driven_lanedir_consec": 3.7187308345693504, "sim_compute_sim_state": 0.022201908429463704, "sim_compute_performance-ego": 0.003588097095489502}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8199641387770225, "get_ui_image": 0.03386621952056885, "step_physics": 0.07657908042271933, "survival_time": 14.950000000000076, "driven_lanedir": 0.858719512769938, "get_state_dump": 0.013199917475382489, "sim_render-ego": 0.005530632336934407, "get_robot_state": 0.013237531185150147, "get_duckie_state": 2.3166338602701823e-06, "in-drivable-lane": 10.450000000000085, "agent_compute-ego": 0.017149282296498616, "deviation-heading": 2.0954821713251075, "complete-iteration": 0.1902997779846191, "set_robot_commands": 0.004375311533610026, "deviation-center-line": 0.25139900338046545, "driven_lanedir_consec": 0.858719512769938, "sim_compute_sim_state": 0.02253061056137085, "sim_compute_performance-ego": 0.003694501717885335}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.7809928910008943, "get_ui_image": 0.033613444169362384, "step_physics": 0.0785789132118225, "survival_time": 14.950000000000076, "driven_lanedir": 3.556140181608539, "get_state_dump": 0.013040897846221923, "sim_render-ego": 0.0053662904103597, "get_robot_state": 0.012867874304453531, "get_duckie_state": 2.342065175374349e-06, "in-drivable-lane": 1.4000000000000004, "agent_compute-ego": 0.016982676982879637, "deviation-heading": 2.340236846508613, "complete-iteration": 0.19419326225916544, "set_robot_commands": 0.004507920742034912, "deviation-center-line": 0.7329780979215187, "driven_lanedir_consec": 3.556140181608539, "sim_compute_sim_state": 0.025470314820607503, "sim_compute_performance-ego": 0.003630520502726237}}
set_robot_commands_max	0.004722015062967936
set_robot_commands_mean	0.004510730504989624
set_robot_commands_median	0.004472797711690266
set_robot_commands_min	0.004375311533610026
sim_compute_performance-ego_max	0.003791786034901937
sim_compute_performance-ego_mean	0.003676226337750753
sim_compute_performance-ego_median	0.003662511110305786
sim_compute_performance-ego_min	0.003588097095489502
sim_compute_sim_state_max	0.025470314820607503
sim_compute_sim_state_mean	0.02336570660273234
sim_compute_sim_state_median	0.022895301580429076
sim_compute_sim_state_min	0.022201908429463704
sim_render-ego_max	0.00577773650487264
sim_render-ego_mean	0.005511878331502278
sim_render-ego_median	0.005451743205388387
sim_render-ego_min	0.0053662904103597
simulation-passed	1
step_physics_max	0.0785789132118225
step_physics_mean	0.07461850305398304
step_physics_median	0.07459270715713501
step_physics_min	0.07070968468983968
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43213

11636

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 00:01:21+00:00

2020-11-26 00:09:43+00:00

0:08:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.6135583112773553
survival_time_median	14.950000000000076
deviation-center-line_median	0.7680996810832594
in-drivable-lane_median	4.025000000000057

other stats

agent_compute-ego_max	0.017074623107910157
agent_compute-ego_mean	0.01668525954087575
agent_compute-ego_median	0.016593672037124634
agent_compute-ego_min	0.016479070981343588
complete-iteration_max	0.18843976497650147
complete-iteration_mean	0.1834838914871216
complete-iteration_median	0.18364967942237853
complete-iteration_min	0.1781964421272278
deviation-center-line_max	0.911260992475134
deviation-center-line_mean	0.7151071866783033
deviation-center-line_min	0.4129683920715602
deviation-heading_max	3.0864131523148317
deviation-heading_mean	2.542639296796794
deviation-heading_median	2.9046922843826275
deviation-heading_min	1.27475946610709
driven_any_max	3.6906079077282454
driven_any_mean	3.1676796411516928
driven_any_median	3.223967185366437
driven_any_min	2.532176286145652
driven_lanedir_consec_max	3.345083049622402
driven_lanedir_consec_mean	2.5408744812067834
driven_lanedir_consec_min	1.5912982526500217
driven_lanedir_max	3.345083049622402
driven_lanedir_mean	2.5408744812067834
driven_lanedir_median	2.6135583112773553
driven_lanedir_min	1.5912982526500217
get_duckie_state_max	3.559589385986328e-06
get_duckie_state_mean	3.4662087758382163e-06
get_duckie_state_median	3.5182634989420575e-06
get_duckie_state_min	3.268718719482422e-06
get_robot_state_max	0.013208581606547035
get_robot_state_mean	0.01260946810245514
get_robot_state_median	0.012557040055592855
get_robot_state_min	0.012115210692087808
get_state_dump_max	0.013433575630187988
get_state_dump_mean	0.012841131488482158
get_state_dump_median	0.012774263620376588
get_state_dump_min	0.012382423082987468
get_ui_image_max	0.03306511004765828
get_ui_image_mean	0.032712053457895914
get_ui_image_median	0.03284425894419352
get_ui_image_min	0.03209458589553833
in-drivable-lane_max	6.850000000000097
in-drivable-lane_mean	3.812500000000053
in-drivable-lane_min	0.34999999999999876
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.6906079077282454, "get_ui_image": 0.0326622748374939, "step_physics": 0.07180224100748699, "survival_time": 14.950000000000076, "driven_lanedir": 3.151409312079337, "get_state_dump": 0.013433575630187988, "sim_render-ego": 0.005482168197631836, "get_robot_state": 0.013208581606547035, "get_duckie_state": 3.52780024210612e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.017074623107910157, "deviation-heading": 2.9042327494792683, "complete-iteration": 0.184818061987559, "set_robot_commands": 0.004455246925354004, "deviation-center-line": 0.8927776730943874, "driven_lanedir_consec": 3.151409312079337, "sim_compute_sim_state": 0.022871517340342203, "sim_compute_performance-ego": 0.003680229981740316}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5038281195758083, "get_ui_image": 0.03209458589553833, "step_physics": 0.06896783987681071, "survival_time": 14.950000000000076, "driven_lanedir": 3.345083049622402, "get_state_dump": 0.012740119298299154, "sim_render-ego": 0.005279125372568767, "get_robot_state": 0.012648309071858724, "get_duckie_state": 3.559589385986328e-06, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.016479070981343588, "deviation-heading": 3.0864131523148317, "complete-iteration": 0.1781964421272278, "set_robot_commands": 0.0044921334584554036, "deviation-center-line": 0.911260992475134, "driven_lanedir_consec": 3.345083049622402, "sim_compute_sim_state": 0.021767184734344483, "sim_compute_performance-ego": 0.0035877346992492674}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.532176286145652, "get_ui_image": 0.03302624305089315, "step_physics": 0.07409787178039551, "survival_time": 14.950000000000076, "driven_lanedir": 1.5912982526500217, "get_state_dump": 0.012382423082987468, "sim_render-ego": 0.005099644660949707, "get_robot_state": 0.012115210692087808, "get_duckie_state": 3.268718719482422e-06, "in-drivable-lane": 6.3000000000000895, "agent_compute-ego": 0.016552383104960124, "deviation-heading": 2.905151819285986, "complete-iteration": 0.18248129685719808, "set_robot_commands": 0.004389189084370931, "deviation-center-line": 0.6434216890721315, "driven_lanedir_consec": 1.5912982526500217, "sim_compute_sim_state": 0.021265583833058675, "sim_compute_performance-ego": 0.0034147183100382487}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.944106251157065, "get_ui_image": 0.03306511004765828, "step_physics": 0.07525968472162882, "survival_time": 14.950000000000076, "driven_lanedir": 2.075707310475374, "get_state_dump": 0.01280840794245402, "sim_render-ego": 0.00521268367767334, "get_robot_state": 0.012465771039326983, "get_duckie_state": 3.508726755777995e-06, "in-drivable-lane": 6.850000000000097, "agent_compute-ego": 0.016634960969289143, "deviation-heading": 1.27475946610709, "complete-iteration": 0.18843976497650147, "set_robot_commands": 0.004354728857676188, "deviation-center-line": 0.4129683920715602, "driven_lanedir_consec": 2.075707310475374, "sim_compute_sim_state": 0.024946600596110025, "sim_compute_performance-ego": 0.003550700346628825}}
set_robot_commands_max	0.0044921334584554036
set_robot_commands_mean	0.004422824581464132
set_robot_commands_median	0.0044222180048624675
set_robot_commands_min	0.004354728857676188
sim_compute_performance-ego_max	0.003680229981740316
sim_compute_performance-ego_mean	0.003558345834414164
sim_compute_performance-ego_median	0.003569217522939046
sim_compute_performance-ego_min	0.0034147183100382487
sim_compute_sim_state_max	0.024946600596110025
sim_compute_sim_state_mean	0.022712721625963845
sim_compute_sim_state_median	0.022319351037343345
sim_compute_sim_state_min	0.021265583833058675
sim_render-ego_max	0.005482168197631836
sim_render-ego_mean	0.005268405477205913
sim_render-ego_median	0.005245904525121053
sim_render-ego_min	0.005099644660949707
simulation-passed	1
step_physics_max	0.07525968472162882
step_physics_mean	0.0725319093465805
step_physics_median	0.07295005639394125
step_physics_min	0.06896783987681071
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43204

11633

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 23:40:56+00:00

2020-11-25 23:49:03+00:00

0:08:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6819068116248177
survival_time_median	14.950000000000076
deviation-center-line_median	0.2576887702583582
in-drivable-lane_median	6.100000000000048

other stats

agent_compute-ego_max	0.017679183483123778
agent_compute-ego_mean	0.017472923662927416
agent_compute-ego_median	0.017446241908603242
agent_compute-ego_min	0.017320027351379396
complete-iteration_max	0.19632255872090656
complete-iteration_mean	0.18973002480136025
complete-iteration_median	0.189088595310847
complete-iteration_min	0.18442034986284045
deviation-center-line_max	0.6545779343332833
deviation-center-line_mean	0.3339786334088809
deviation-center-line_min	0.16595905878552394
deviation-heading_max	2.6011083997256623
deviation-heading_mean	1.608108119275331
deviation-heading_median	1.6099826443464171
deviation-heading_min	0.6113587886828279
driven_any_max	3.9391815890811506
driven_any_mean	3.197074989442184
driven_any_median	3.2495153439514213
driven_any_min	2.3500876807847404
driven_lanedir_consec_max	3.61897292673012
driven_lanedir_consec_mean	1.9460195015317925
driven_lanedir_consec_min	0.8012914561474145
driven_lanedir_max	3.61897292673012
driven_lanedir_mean	1.9460195015317925
driven_lanedir_median	1.6819068116248177
driven_lanedir_min	0.8012914561474145
get_duckie_state_max	3.4666061401367185e-06
get_duckie_state_mean	3.418193923102485e-06
get_duckie_state_median	3.419054879082574e-06
get_duckie_state_min	3.368059794108073e-06
get_robot_state_max	0.014711756706237792
get_robot_state_mean	0.013896982272466024
get_robot_state_median	0.013866599003473918
get_robot_state_min	0.013142974376678466
get_state_dump_max	0.013141356309254964
get_state_dump_mean	0.013070337706142002
get_state_dump_median	0.013067145744959511
get_state_dump_min	0.013005703025394015
get_ui_image_max	0.03355777104695638
get_ui_image_mean	0.033243888550334506
get_ui_image_median	0.033249401913748845
get_ui_image_min	0.03291897932688395
in-drivable-lane_max	10.80000000000008
in-drivable-lane_mean	6.162500000000044
in-drivable-lane_min	1.650000000000003
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3500876807847404, "get_ui_image": 0.032943961355421277, "step_physics": 0.06963964303334554, "survival_time": 8.999999999999993, "driven_lanedir": 1.3791178241500202, "get_state_dump": 0.013005703025394015, "sim_render-ego": 0.0055754052268134225, "get_robot_state": 0.014467287063598632, "get_duckie_state": 3.463692135281033e-06, "in-drivable-lane": 4.300000000000002, "agent_compute-ego": 0.017445376184251574, "deviation-heading": 0.6113587886828279, "complete-iteration": 0.18442034986284045, "set_robot_commands": 0.004715420140160455, "deviation-center-line": 0.16595905878552394, "driven_lanedir_consec": 1.3791178241500202, "sim_compute_sim_state": 0.022772100236680772, "sim_compute_performance-ego": 0.003722308741675483}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.3553845172115597, "get_ui_image": 0.03291897932688395, "step_physics": 0.07315351645151774, "survival_time": 14.950000000000076, "driven_lanedir": 1.9846957990996148, "get_state_dump": 0.013085562388102214, "sim_render-ego": 0.005472770531972249, "get_robot_state": 0.013265910943349205, "get_duckie_state": 3.4666061401367185e-06, "in-drivable-lane": 7.9000000000000945, "agent_compute-ego": 0.017447107632954914, "deviation-heading": 1.241286076805289, "complete-iteration": 0.18638309081395468, "set_robot_commands": 0.004556695620218913, "deviation-center-line": 0.2764240717265252, "driven_lanedir_consec": 1.9846957990996148, "sim_compute_sim_state": 0.02265959660212199, "sim_compute_performance-ego": 0.003686693509419759}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.143646170691283, "get_ui_image": 0.03355777104695638, "step_physics": 0.07795232693354288, "survival_time": 14.950000000000076, "driven_lanedir": 0.8012914561474145, "get_state_dump": 0.013141356309254964, "sim_render-ego": 0.005597694714864095, "get_robot_state": 0.013142974376678466, "get_duckie_state": 3.374417622884115e-06, "in-drivable-lane": 10.80000000000008, "agent_compute-ego": 0.017679183483123778, "deviation-heading": 1.9786792118875456, "complete-iteration": 0.1917940998077393, "set_robot_commands": 0.0044700821240743005, "deviation-center-line": 0.23895346879019116, "driven_lanedir_consec": 0.8012914561474145, "sim_compute_sim_state": 0.02246241251627604, "sim_compute_performance-ego": 0.003654646078745524}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.9391815890811506, "get_ui_image": 0.033554842472076414, "step_physics": 0.07751397132873535, "survival_time": 14.950000000000076, "driven_lanedir": 3.61897292673012, "get_state_dump": 0.013048729101816814, "sim_render-ego": 0.005605381329854329, "get_robot_state": 0.014711756706237792, "get_duckie_state": 3.368059794108073e-06, "in-drivable-lane": 1.650000000000003, "agent_compute-ego": 0.017320027351379396, "deviation-heading": 2.6011083997256623, "complete-iteration": 0.19632255872090656, "set_robot_commands": 0.004730658531188965, "deviation-center-line": 0.6545779343332833, "driven_lanedir_consec": 3.61897292673012, "sim_compute_sim_state": 0.02598006248474121, "sim_compute_performance-ego": 0.0037216750780741377}}
set_robot_commands_max	0.004730658531188965
set_robot_commands_mean	0.0046182141039106585
set_robot_commands_median	0.004636057880189684
set_robot_commands_min	0.0044700821240743005
sim_compute_performance-ego_max	0.003722308741675483
sim_compute_performance-ego_mean	0.0036963308519787257
sim_compute_performance-ego_median	0.003704184293746948
sim_compute_performance-ego_min	0.003654646078745524
sim_compute_sim_state_max	0.02598006248474121
sim_compute_sim_state_mean	0.023468542959955
sim_compute_sim_state_median	0.02271584841940138
sim_compute_sim_state_min	0.02246241251627604
sim_render-ego_max	0.005605381329854329
sim_render-ego_mean	0.005562812950876024
sim_render-ego_median	0.005586549970838759
sim_render-ego_min	0.005472770531972249
simulation-passed	1
step_physics_max	0.07795232693354288
step_physics_mean	0.07456486443678537
step_physics_median	0.07533374389012654
step_physics_min	0.06963964303334554
survival_time_max	14.950000000000076
survival_time_mean	13.462500000000055
survival_time_min	8.999999999999993

No reset possible

43192

11629

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 23:16:06+00:00

2020-11-25 23:24:24+00:00

0:08:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9953045832855687
survival_time_median	14.950000000000076
deviation-center-line_median	0.45918141636561094
in-drivable-lane_median	4.55000000000005

other stats

agent_compute-ego_max	0.017703193028767904
agent_compute-ego_mean	0.017286892452510395
agent_compute-ego_median	0.017228306370322306
agent_compute-ego_min	0.01698776404062907
complete-iteration_max	0.1928469610412091
complete-iteration_mean	0.18294043342767088
complete-iteration_median	0.1816089681784312
complete-iteration_min	0.1756968363126119
deviation-center-line_max	0.5667061838901956
deviation-center-line_mean	0.433920689356869
deviation-center-line_min	0.2506137408060585
deviation-heading_max	3.199382765603115
deviation-heading_mean	2.1580578342420913
deviation-heading_median	2.076120857277353
deviation-heading_min	1.2806068568105449
driven_any_max	3.0626073149455957
driven_any_mean	2.762075417583781
driven_any_median	2.720075492730392
driven_any_min	2.545543369928746
driven_lanedir_consec_max	2.9706662619004827
driven_lanedir_consec_mean	1.98747285771706
driven_lanedir_consec_min	0.988616002396621
driven_lanedir_max	2.9706662619004827
driven_lanedir_mean	1.98747285771706
driven_lanedir_median	1.9953045832855687
driven_lanedir_min	0.988616002396621
get_duckie_state_max	2.2482872009277343e-06
get_duckie_state_mean	2.17550523053561e-06
get_duckie_state_median	2.1722620123814416e-06
get_duckie_state_min	2.1092096964518227e-06
get_robot_state_max	0.012428219318389892
get_robot_state_mean	0.012240305141459528
get_robot_state_median	0.012213287742635852
get_robot_state_min	0.012106425762176512
get_state_dump_max	0.012789907455444336
get_state_dump_mean	0.012667312124952736
get_state_dump_median	0.012723146080146356
get_state_dump_min	0.012433048884073893
get_ui_image_max	0.033539034024313776
get_ui_image_mean	0.032408276273666735
get_ui_image_median	0.032329539060592646
get_ui_image_min	0.031434992949167885
in-drivable-lane_max	9.450000000000063
in-drivable-lane_mean	4.63750000000004
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.545543369928746, "get_ui_image": 0.031854567527770994, "step_physics": 0.0696919822692871, "survival_time": 14.950000000000076, "driven_lanedir": 1.371925373579091, "get_state_dump": 0.012711258729298907, "sim_render-ego": 0.0051336940129597984, "get_robot_state": 0.012297979990641276, "get_duckie_state": 2.23239262898763e-06, "in-drivable-lane": 8.600000000000092, "agent_compute-ego": 0.01711501677831014, "deviation-heading": 1.2806068568105449, "complete-iteration": 0.1790959358215332, "set_robot_commands": 0.004514427979787191, "deviation-center-line": 0.2506137408060585, "driven_lanedir_consec": 1.371925373579091, "sim_compute_sim_state": 0.0221536922454834, "sim_compute_performance-ego": 0.0034925341606140137}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0626073149455957, "get_ui_image": 0.031434992949167885, "step_physics": 0.0672811492284139, "survival_time": 14.950000000000076, "driven_lanedir": 2.9706662619004827, "get_state_dump": 0.012789907455444336, "sim_render-ego": 0.005216525395711263, "get_robot_state": 0.012428219318389892, "get_duckie_state": 2.2482872009277343e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01698776404062907, "deviation-heading": 3.199382765603115, "complete-iteration": 0.1756968363126119, "set_robot_commands": 0.00453642209370931, "deviation-center-line": 0.5667061838901956, "driven_lanedir_consec": 2.9706662619004827, "sim_compute_sim_state": 0.02131745417912801, "sim_compute_performance-ego": 0.0035706106821695965}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.685088826425528, "get_ui_image": 0.032804510593414306, "step_physics": 0.07459004163742065, "survival_time": 14.950000000000076, "driven_lanedir": 0.988616002396621, "get_state_dump": 0.012433048884073893, "sim_render-ego": 0.005132871468861898, "get_robot_state": 0.012106425762176512, "get_duckie_state": 2.1092096964518227e-06, "in-drivable-lane": 9.450000000000063, "agent_compute-ego": 0.017703193028767904, "deviation-heading": 2.4204113421410303, "complete-iteration": 0.1841220005353292, "set_robot_commands": 0.00447798490524292, "deviation-center-line": 0.3554660741161939, "driven_lanedir_consec": 0.988616002396621, "sim_compute_sim_state": 0.0213252321879069, "sim_compute_performance-ego": 0.003417042891184489}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.755062159035256, "get_ui_image": 0.033539034024313776, "step_physics": 0.07951634355600444, "survival_time": 12.050000000000036, "driven_lanedir": 2.618683792992046, "get_state_dump": 0.012735033430993805, "sim_render-ego": 0.005051668254171664, "get_robot_state": 0.012128595494630426, "get_duckie_state": 2.112131395775253e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.01734159596233447, "deviation-heading": 1.731830372413676, "complete-iteration": 0.1928469610412091, "set_robot_commands": 0.004476418633678642, "deviation-center-line": 0.562896758615028, "driven_lanedir_consec": 2.618683792992046, "sim_compute_sim_state": 0.024467871891512415, "sim_compute_performance-ego": 0.003459967023604144}}
set_robot_commands_max	0.00453642209370931
set_robot_commands_mean	0.004501313403104516
set_robot_commands_median	0.004496206442515055
set_robot_commands_min	0.004476418633678642
sim_compute_performance-ego_max	0.0035706106821695965
sim_compute_performance-ego_mean	0.003485038689393061
sim_compute_performance-ego_median	0.003476250592109079
sim_compute_performance-ego_min	0.003417042891184489
sim_compute_sim_state_max	0.024467871891512415
sim_compute_sim_state_mean	0.02231606262600768
sim_compute_sim_state_median	0.02173946221669515
sim_compute_sim_state_min	0.02131745417912801
sim_render-ego_max	0.005216525395711263
sim_render-ego_mean	0.005133689782926156
sim_render-ego_median	0.005133282740910848
sim_render-ego_min	0.005051668254171664
simulation-passed	1
step_physics_max	0.07951634355600444
step_physics_mean	0.07276987917278153
step_physics_median	0.07214101195335387
step_physics_min	0.0672811492284139
survival_time_max	14.950000000000076
survival_time_mean	14.225000000000067
survival_time_min	12.050000000000036

No reset possible

43170

11624

Anthony Courchesne 🇨🇦

TNetR1

LFv-sim

host-error

2020-11-25 22:55:41+00:00

2020-11-25 23:00:38+00:00

0:04:57

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 943, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [d8d4c2521bf260f582a81b3c6d64bf29bc8813ac24ef450c71e07b808c8ec11e]
│      services: dict[4]
│                │ solution:
│                │ dict[5]
│                │ │ image: docker.io/courchesnea/aido-submissions@sha256:3f5dc720a9259b85b87c081661c4aa41e279de5a69cae00a3934f869145e2d64
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_11_25_22_48_18@sha256:3f5dc720a9259b85b87c081661c4aa41e279de5a69cae00a3934f869145e2d64
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:48f0b2f34825d15848c3060740ab95a99254d233959586b75aeedf03f1ed5832
│                │ │ environment:
│                │ │ dict[8]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 15.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_11_25_22_48_18@sha256:3f5dc720a9259b85b87c081661c4aa41e279de5a69cae00a3934f869145e2d64
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ ports: [10123]
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:953ba9f1437e3f267db1f4ff2e58340de33f6c207283f26def16fc8612b9506e
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_11_25_22_48_18@sha256:3f5dc720a9259b85b87c081661c4aa41e279de5a69cae00a3934f869145e2d64
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:1562e17ba46090cdedbe68b8584827f1b3730f2786f6abd52e8790b4f0f1e63c
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- ETHZ_autolab_technical_track
│                │ │ │ |scenarios_per_map: 4
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/courchesnea/aido-submissions:2020_11_25_22_48_18@sha256:3f5dc720a9259b85b87c081661c4aa41e279de5a69cae00a3934f869145e2d64
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11624/LFv-sim-mont05-135adf15fff1-1-job43170-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {evaluator: d8d4c2521bf260f582a81b3c6d64bf29bc8813ac24ef450c71e07b808c8ec11e}
│         names: dict[1]
│                │ d8d4c2521bf260f582a81b3c6d64bf29bc8813ac24ef450c71e07b808c8ec11e: mont05-135adf15fff1-1-job43170-305324_evaluator_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43154

11622

sim-exercise-2

LFv-sim

error

2020-11-25 22:34:07+00:00

2020-11-25 22:40:40+00:00

0:06:33

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43132

11616

sim-exercise-2

LFv-sim

success

2020-11-25 21:18:07+00:00

2020-11-25 21:26:39+00:00

0:08:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.6836475105471935
survival_time_median	14.950000000000076
deviation-center-line_median	0.646089101594615
in-drivable-lane_median	0.30000000000000293

other stats

agent_compute-ego_max	0.017093131368644394
agent_compute-ego_mean	0.016795680082164047
agent_compute-ego_median	0.01683612863222758
agent_compute-ego_min	0.01641733169555664
complete-iteration_max	0.19731316621276151
complete-iteration_mean	0.19243961228721443
complete-iteration_median	0.1917160753409068
complete-iteration_min	0.18901313225428265
deviation-center-line_max	0.7385843508130354
deviation-center-line_mean	0.6090084042451305
deviation-center-line_min	0.405271062978257
deviation-heading_max	1.9746561655476236
deviation-heading_mean	1.502736617481215
deviation-heading_median	1.4772536691184892
deviation-heading_min	1.0817829661402565
driven_any_max	3.2836793473985244
driven_any_mean	2.86692779745221
driven_any_median	2.790342119460531
driven_any_min	2.603347603489252
driven_lanedir_consec_max	3.2638521364608293
driven_lanedir_consec_mean	2.690818828945964
driven_lanedir_consec_min	2.13212815822864
driven_lanedir_max	3.2638521364608293
driven_lanedir_mean	2.690818828945964
driven_lanedir_median	2.6836475105471935
driven_lanedir_min	2.13212815822864
get_duckie_state_max	2.475579579671224e-06
get_duckie_state_mean	2.2931299903840395e-06
get_duckie_state_median	2.276500066121419e-06
get_duckie_state_min	2.1439402496220967e-06
get_robot_state_max	0.014725153446197507
get_robot_state_mean	0.013944791685575726
get_robot_state_median	0.014327372709910077
get_robot_state_min	0.012399267876285246
get_state_dump_max	0.01322468360265096
get_state_dump_mean	0.013112637542216714
get_state_dump_median	0.01320993423461914
get_state_dump_min	0.012805998096977614
get_ui_image_max	0.034660876592000324
get_ui_image_mean	0.0340608845702533
get_ui_image_median	0.03410212408537153
get_ui_image_min	0.03337841351826986
in-drivable-lane_max	2.7000000000000384
in-drivable-lane_mean	0.8250000000000111
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9583006568918657, "get_ui_image": 0.03337841351826986, "step_physics": 0.07343026240666707, "survival_time": 14.950000000000076, "driven_lanedir": 2.8019578884363714, "get_state_dump": 0.01322468360265096, "sim_render-ego": 0.005703601837158203, "get_robot_state": 0.01429487466812134, "get_duckie_state": 2.475579579671224e-06, "in-drivable-lane": 0.6000000000000059, "agent_compute-ego": 0.01685986280441284, "deviation-heading": 1.6293972954834754, "complete-iteration": 0.18901313225428265, "set_robot_commands": 0.004654369354248047, "deviation-center-line": 0.7385843508130354, "driven_lanedir_consec": 2.8019578884363714, "sim_compute_sim_state": 0.02347926457722982, "sim_compute_performance-ego": 0.003842833042144775}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2836793473985244, "get_ui_image": 0.03409175634384155, "step_physics": 0.07454270601272583, "survival_time": 14.950000000000076, "driven_lanedir": 3.2638521364608293, "get_state_dump": 0.01321548620859782, "sim_render-ego": 0.005636502106984457, "get_robot_state": 0.014359870751698813, "get_duckie_state": 2.307891845703125e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01641733169555664, "deviation-heading": 1.3251100427535027, "complete-iteration": 0.18929900566736857, "set_robot_commands": 0.004556454022725423, "deviation-center-line": 0.7225348957308878, "driven_lanedir_consec": 3.2638521364608293, "sim_compute_sim_state": 0.022550296783447263, "sim_compute_performance-ego": 0.0037882192929585778}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.603347603489252, "get_ui_image": 0.034660876592000324, "step_physics": 0.07720868746439616, "survival_time": 14.950000000000076, "driven_lanedir": 2.5653371326580157, "get_state_dump": 0.013204382260640465, "sim_render-ego": 0.005859127839406331, "get_robot_state": 0.014725153446197507, "get_duckie_state": 2.2451082865397134e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016812394460042318, "deviation-heading": 1.9746561655476236, "complete-iteration": 0.19413314501444495, "set_robot_commands": 0.004745859305063884, "deviation-center-line": 0.5696433074583421, "driven_lanedir_consec": 2.5653371326580157, "sim_compute_sim_state": 0.022917261123657228, "sim_compute_performance-ego": 0.003858051300048828}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.622383582029197, "get_ui_image": 0.03411249182690149, "step_physics": 0.08280447707779107, "survival_time": 13.05000000000005, "driven_lanedir": 2.13212815822864, "get_state_dump": 0.012805998096977614, "sim_render-ego": 0.005190137702386498, "get_robot_state": 0.012399267876285246, "get_duckie_state": 2.1439402496220967e-06, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.017093131368644394, "deviation-heading": 1.0817829661402565, "complete-iteration": 0.19731316621276151, "set_robot_commands": 0.004514353485399736, "deviation-center-line": 0.405271062978257, "driven_lanedir_consec": 2.13212815822864, "sim_compute_sim_state": 0.024723266733103787, "sim_compute_performance-ego": 0.003535424155750494}}
set_robot_commands_max	0.004745859305063884
set_robot_commands_mean	0.004617759041859272
set_robot_commands_median	0.004605411688486735
set_robot_commands_min	0.004514353485399736
sim_compute_performance-ego_max	0.003858051300048828
sim_compute_performance-ego_mean	0.003756131947725669
sim_compute_performance-ego_median	0.003815526167551676
sim_compute_performance-ego_min	0.003535424155750494
sim_compute_sim_state_max	0.024723266733103787
sim_compute_sim_state_mean	0.023417522304359527
sim_compute_sim_state_median	0.023198262850443525
sim_compute_sim_state_min	0.022550296783447263
sim_render-ego_max	0.005859127839406331
sim_render-ego_mean	0.005597342371483872
sim_render-ego_median	0.00567005197207133
sim_render-ego_min	0.005190137702386498
simulation-passed	1
step_physics_max	0.08280447707779107
step_physics_mean	0.07699653324039503
step_physics_median	0.075875696738561
step_physics_min	0.07343026240666707
survival_time_max	14.950000000000076
survival_time_mean	14.475000000000072
survival_time_min	13.05000000000005

No reset possible

43121

11610

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 20:48:22+00:00

2020-11-25 20:56:47+00:00

0:08:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.610854928817571
survival_time_median	14.950000000000076
deviation-center-line_median	0.5337563844320131
in-drivable-lane_median	3.4000000000000483

other stats

agent_compute-ego_max	0.01768490711847941
agent_compute-ego_mean	0.016960964600245154
agent_compute-ego_median	0.01686276396115621
agent_compute-ego_min	0.0164334233601888
complete-iteration_max	0.19135648806889852
complete-iteration_mean	0.18445386191209157
complete-iteration_median	0.18393199324607848
complete-iteration_min	0.1785949730873108
deviation-center-line_max	0.6048787322111655
deviation-center-line_mean	0.4821163918189265
deviation-center-line_min	0.25607406620051426
deviation-heading_max	2.836635719456503
deviation-heading_mean	2.3231794949678584
deviation-heading_median	2.261266631925139
deviation-heading_min	1.9335489965646515
driven_any_max	3.695372677061155
driven_any_mean	3.413498175403562
driven_any_median	3.418180886124967
driven_any_min	3.122258252303159
driven_lanedir_consec_max	3.6202932201920857
driven_lanedir_consec_mean	2.393454086370532
driven_lanedir_consec_min	0.7318132676549003
driven_lanedir_max	3.6202932201920857
driven_lanedir_mean	2.393454086370532
driven_lanedir_median	2.610854928817571
driven_lanedir_min	0.7318132676549003
get_duckie_state_max	2.179145812988282e-06
get_duckie_state_mean	2.109805742899577e-06
get_duckie_state_median	2.10881233215332e-06
get_duckie_state_min	2.0424524943033858e-06
get_robot_state_max	0.012984315554300943
get_robot_state_mean	0.0126943169037501
get_robot_state_median	0.012709025144577026
get_robot_state_min	0.01237490177154541
get_state_dump_max	0.012800215085347491
get_state_dump_mean	0.012685938278834024
get_state_dump_median	0.012730221350987753
get_state_dump_min	0.012483095328013102
get_ui_image_max	0.03333328564961751
get_ui_image_mean	0.03264257311820984
get_ui_image_median	0.03253503799438477
get_ui_image_min	0.03216693083445231
in-drivable-lane_max	10.850000000000062
in-drivable-lane_mean	4.41250000000004
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.4918575698266254, "get_ui_image": 0.03236261367797852, "step_physics": 0.07018191655476888, "survival_time": 14.950000000000076, "driven_lanedir": 3.045251707460782, "get_state_dump": 0.012800215085347491, "sim_render-ego": 0.00534094492594401, "get_robot_state": 0.012984315554300943, "get_duckie_state": 2.179145812988282e-06, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.016824413935343424, "deviation-heading": 2.836635719456503, "complete-iteration": 0.18145944356918337, "set_robot_commands": 0.004485793113708496, "deviation-center-line": 0.6048787322111655, "driven_lanedir_consec": 3.045251707460782, "sim_compute_sim_state": 0.022759771347045897, "sim_compute_performance-ego": 0.003585983117421468}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.695372677061155, "get_ui_image": 0.03216693083445231, "step_physics": 0.06937337716420491, "survival_time": 14.950000000000076, "driven_lanedir": 3.6202932201920857, "get_state_dump": 0.012784224351247151, "sim_render-ego": 0.005285215377807617, "get_robot_state": 0.012682197093963624, "get_duckie_state": 2.0917256673177084e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0164334233601888, "deviation-heading": 2.325867628300698, "complete-iteration": 0.1785949730873108, "set_robot_commands": 0.004439935684204101, "deviation-center-line": 0.56456568704815, "driven_lanedir_consec": 3.6202932201920857, "sim_compute_sim_state": 0.021781030495961508, "sim_compute_performance-ego": 0.00351330041885376}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.344504202423309, "get_ui_image": 0.03333328564961751, "step_physics": 0.07945078293482463, "survival_time": 14.950000000000076, "driven_lanedir": 0.7318132676549003, "get_state_dump": 0.012676218350728352, "sim_render-ego": 0.005315993626912435, "get_robot_state": 0.01273585319519043, "get_duckie_state": 2.0424524943033858e-06, "in-drivable-lane": 10.850000000000062, "agent_compute-ego": 0.01768490711847941, "deviation-heading": 2.1966656355495804, "complete-iteration": 0.19135648806889852, "set_robot_commands": 0.004408215681711833, "deviation-center-line": 0.25607406620051426, "driven_lanedir_consec": 0.7318132676549003, "sim_compute_sim_state": 0.022089494069417317, "sim_compute_performance-ego": 0.0035291139284769693}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.122258252303159, "get_ui_image": 0.03270746231079102, "step_physics": 0.07338416417439779, "survival_time": 14.950000000000076, "driven_lanedir": 2.1764581501743603, "get_state_dump": 0.012483095328013102, "sim_render-ego": 0.005159898598988851, "get_robot_state": 0.01237490177154541, "get_duckie_state": 2.125898996988932e-06, "in-drivable-lane": 5.4500000000000774, "agent_compute-ego": 0.016901113986968995, "deviation-heading": 1.9335489965646515, "complete-iteration": 0.1864045429229736, "set_robot_commands": 0.004471633434295654, "deviation-center-line": 0.5029470818158762, "driven_lanedir_consec": 2.1764581501743603, "sim_compute_sim_state": 0.02532493034998576, "sim_compute_performance-ego": 0.00346407413482666}}
set_robot_commands_max	0.004485793113708496
set_robot_commands_mean	0.004451394478480021
set_robot_commands_median	0.004455784559249878
set_robot_commands_min	0.004408215681711833
sim_compute_performance-ego_max	0.003585983117421468
sim_compute_performance-ego_mean	0.003523117899894714
sim_compute_performance-ego_median	0.0035212071736653644
sim_compute_performance-ego_min	0.00346407413482666
sim_compute_sim_state_max	0.02532493034998576
sim_compute_sim_state_mean	0.02298880656560262
sim_compute_sim_state_median	0.022424632708231605
sim_compute_sim_state_min	0.021781030495961508
sim_render-ego_max	0.00534094492594401
sim_render-ego_mean	0.005275513132413228
sim_render-ego_median	0.0053006045023600255
sim_render-ego_min	0.005159898598988851
simulation-passed	1
step_physics_max	0.07945078293482463
step_physics_mean	0.07309756020704905
step_physics_median	0.07178304036458333
step_physics_min	0.06937337716420491
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43117

11608

exercise_state_estimation

LFv-sim

success

2020-11-25 20:23:54+00:00

2020-11-25 20:32:55+00:00

0:09:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6695114909401694
survival_time_median	14.950000000000076
deviation-center-line_median	0.4130188823107499
in-drivable-lane_median	1.3750000000000044

other stats

agent_compute-ego_max	0.01755298932393392
agent_compute-ego_mean	0.017303626934687295
agent_compute-ego_median	0.017272054354349774
agent_compute-ego_min	0.01711740970611572
complete-iteration_max	0.20084750493367512
complete-iteration_mean	0.19635286033153532
complete-iteration_median	0.1959574369589488
complete-iteration_min	0.19264906247456867
deviation-center-line_max	0.9287208393887276
deviation-center-line_mean	0.5083896615672303
deviation-center-line_min	0.27880004225869354
deviation-heading_max	3.501369115869344
deviation-heading_mean	2.698672601804384
deviation-heading_median	2.762578928710085
deviation-heading_min	1.768163433928022
driven_any_max	1.9399386678749144
driven_any_mean	1.9383321104832612
driven_any_median	1.939870436579368
driven_any_min	1.933648900899393
driven_lanedir_consec_max	1.9066669038034805
driven_lanedir_consec_mean	1.651203505729502
driven_lanedir_consec_min	1.359124137234189
driven_lanedir_max	1.9066669038034805
driven_lanedir_mean	1.651203505729502
driven_lanedir_median	1.6695114909401694
driven_lanedir_min	1.359124137234189
get_duckie_state_max	2.6273727416992182e-06
get_duckie_state_mean	2.5618076324462893e-06
get_duckie_state_median	2.599557240804036e-06
get_duckie_state_min	2.420743306477865e-06
get_robot_state_max	0.015544414520263672
get_robot_state_mean	0.014905090928077696
get_robot_state_median	0.0148362664381663
get_robot_state_min	0.014403416315714518
get_state_dump_max	0.013701860109965007
get_state_dump_mean	0.013353840708732606
get_state_dump_median	0.013352319399515788
get_state_dump_min	0.013008863925933836
get_ui_image_max	0.03526496887207031
get_ui_image_mean	0.03453158358732859
get_ui_image_median	0.03449892322222392
get_ui_image_min	0.033863519032796226
in-drivable-lane_max	4.0500000000000576
in-drivable-lane_mean	1.7000000000000166
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933648900899393, "get_ui_image": 0.03440578699111938, "step_physics": 0.07605056762695313, "survival_time": 14.950000000000076, "driven_lanedir": 1.359124137234189, "get_state_dump": 0.013701860109965007, "sim_render-ego": 0.005770646731058757, "get_robot_state": 0.014403416315714518, "get_duckie_state": 2.6241938273111977e-06, "in-drivable-lane": 4.0500000000000576, "agent_compute-ego": 0.017400954564412433, "deviation-heading": 1.768163433928022, "complete-iteration": 0.19385251998901368, "set_robot_commands": 0.004472331206003825, "deviation-center-line": 0.30442288099667686, "driven_lanedir_consec": 1.359124137234189, "sim_compute_sim_state": 0.023588361740112303, "sim_compute_performance-ego": 0.0039075771967569985}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.939907805676844, "get_ui_image": 0.03459205945332845, "step_physics": 0.07554350058237712, "survival_time": 14.950000000000076, "driven_lanedir": 1.877057974622716, "get_state_dump": 0.013267900149027506, "sim_render-ego": 0.0059619140625, "get_robot_state": 0.014790717760721843, "get_duckie_state": 2.574920654296875e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01714315414428711, "deviation-heading": 3.20447647975952, "complete-iteration": 0.19264906247456867, "set_robot_commands": 0.004620106220245362, "deviation-center-line": 0.27880004225869354, "driven_lanedir_consec": 1.877057974622716, "sim_compute_sim_state": 0.02259599765141805, "sim_compute_performance-ego": 0.003983750343322754}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9398330674818929, "get_ui_image": 0.03526496887207031, "step_physics": 0.08066930135091145, "survival_time": 14.950000000000076, "driven_lanedir": 1.461965007257623, "get_state_dump": 0.01343673865000407, "sim_render-ego": 0.006041274070739746, "get_robot_state": 0.015544414520263672, "get_duckie_state": 2.6273727416992182e-06, "in-drivable-lane": 2.750000000000009, "agent_compute-ego": 0.01755298932393392, "deviation-heading": 3.501369115869344, "complete-iteration": 0.20084750493367512, "set_robot_commands": 0.004738223552703857, "deviation-center-line": 0.9287208393887276, "driven_lanedir_consec": 1.461965007257623, "sim_compute_sim_state": 0.023414151668548586, "sim_compute_performance-ego": 0.004032285213470459}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399386678749144, "get_ui_image": 0.033863519032796226, "step_physics": 0.07980307499567668, "survival_time": 14.950000000000076, "driven_lanedir": 1.9066669038034805, "get_state_dump": 0.013008863925933836, "sim_render-ego": 0.005574058691660563, "get_robot_state": 0.014881815115610758, "get_duckie_state": 2.420743306477865e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01711740970611572, "deviation-heading": 2.3206813776606494, "complete-iteration": 0.19806235392888388, "set_robot_commands": 0.004661550521850586, "deviation-center-line": 0.5216148836248229, "driven_lanedir_consec": 1.9066669038034805, "sim_compute_sim_state": 0.025222843488057457, "sim_compute_performance-ego": 0.0037872099876403807}}
set_robot_commands_max	0.004738223552703857
set_robot_commands_mean	0.004623052875200907
set_robot_commands_median	0.004640828371047973
set_robot_commands_min	0.004472331206003825
sim_compute_performance-ego_max	0.004032285213470459
sim_compute_performance-ego_mean	0.003927705685297649
sim_compute_performance-ego_median	0.003945663770039876
sim_compute_performance-ego_min	0.0037872099876403807
sim_compute_sim_state_max	0.025222843488057457
sim_compute_sim_state_mean	0.0237053386370341
sim_compute_sim_state_median	0.023501256704330446
sim_compute_sim_state_min	0.02259599765141805
sim_render-ego_max	0.006041274070739746
sim_render-ego_mean	0.005836973388989766
sim_render-ego_median	0.005866280396779378
sim_render-ego_min	0.005574058691660563
simulation-passed	1
step_physics_max	0.08066930135091145
step_physics_mean	0.07801661113897959
step_physics_median	0.0779268213113149
step_physics_min	0.07554350058237712
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43089

11603

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 20:12:18+00:00

2020-11-25 20:20:43+00:00

0:08:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.7965089994156986
survival_time_median	14.075000000000063
deviation-center-line_median	0.5426384624771781
in-drivable-lane_median	5.075000000000011

other stats

agent_compute-ego_max	0.017799020373205625
agent_compute-ego_mean	0.017641351299691903
agent_compute-ego_median	0.017679988145828246
agent_compute-ego_min	0.01740640853390549
complete-iteration_max	0.2045269454970504
complete-iteration_mean	0.20142953081424553
complete-iteration_median	0.20155125975608823
complete-iteration_min	0.1980886582477552
deviation-center-line_max	0.9388686613311672
deviation-center-line_mean	0.5876568096174308
deviation-center-line_min	0.32648165218420006
deviation-heading_max	5.911599283756856
deviation-heading_mean	3.460992268872615
deviation-heading_median	3.0589977035211637
deviation-heading_min	1.8143743846912777
driven_any_max	3.573265433437282
driven_any_mean	3.20061667651077
driven_any_median	3.353658317087324
driven_any_min	2.5218846384311493
driven_lanedir_consec_max	2.732495680668905
driven_lanedir_consec_mean	1.8576166934261973
driven_lanedir_consec_min	1.1049530942044865
driven_lanedir_max	2.732495680668905
driven_lanedir_mean	1.8576166934261973
driven_lanedir_median	1.7965089994156986
driven_lanedir_min	1.1049530942044865
get_duckie_state_max	2.6861826578776044e-06
get_duckie_state_mean	2.506607447838712e-06
get_duckie_state_median	2.5191217520986923e-06
get_duckie_state_min	2.3020036292798593e-06
get_robot_state_max	0.015859254995981852
get_robot_state_mean	0.01534369529311188
get_robot_state_median	0.015355308344869902
get_robot_state_min	0.014804909486725856
get_state_dump_max	0.01365105390548706
get_state_dump_mean	0.013466072501380167
get_state_dump_median	0.013477935382457965
get_state_dump_min	0.013257365335117687
get_ui_image_max	0.03531791682534374
get_ui_image_mean	0.03489739007805842
get_ui_image_median	0.03479466136657831
get_ui_image_min	0.034682320753733314
in-drivable-lane_max	5.950000000000045
in-drivable-lane_mean	4.462500000000023
in-drivable-lane_min	1.7500000000000249
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5616870424563287, "get_ui_image": 0.03488143603006999, "step_physics": 0.08135352214177449, "survival_time": 14.950000000000076, "driven_lanedir": 2.0087180335347914, "get_state_dump": 0.01365105390548706, "sim_render-ego": 0.006168790658315023, "get_robot_state": 0.015859254995981852, "get_duckie_state": 2.6861826578776044e-06, "in-drivable-lane": 5.500000000000008, "agent_compute-ego": 0.017686172326405843, "deviation-heading": 3.40165886509705, "complete-iteration": 0.20367985248565673, "set_robot_commands": 0.004826114972432454, "deviation-center-line": 0.6599940534988273, "driven_lanedir_consec": 2.0087180335347914, "sim_compute_sim_state": 0.02497622410456339, "sim_compute_performance-ego": 0.004126859505971273}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.573265433437282, "get_ui_image": 0.034682320753733314, "step_physics": 0.0783229684829712, "survival_time": 14.950000000000076, "driven_lanedir": 2.732495680668905, "get_state_dump": 0.013644991715749104, "sim_render-ego": 0.006122721036275228, "get_robot_state": 0.015758793354034423, "get_duckie_state": 2.5510787963867186e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.017673803965250652, "deviation-heading": 5.911599283756856, "complete-iteration": 0.19942266702651976, "set_robot_commands": 0.0049449475606282555, "deviation-center-line": 0.9388686613311672, "driven_lanedir_consec": 2.732495680668905, "sim_compute_sim_state": 0.023996387322743732, "sim_compute_performance-ego": 0.004124769369761149}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5218846384311493, "get_ui_image": 0.03531791682534374, "step_physics": 0.07880474368171513, "survival_time": 10.650000000000016, "driven_lanedir": 1.1049530942044865, "get_state_dump": 0.013310879049166826, "sim_render-ego": 0.005919815788806324, "get_robot_state": 0.014804909486725856, "get_duckie_state": 2.487164707810666e-06, "in-drivable-lane": 4.650000000000014, "agent_compute-ego": 0.017799020373205625, "deviation-heading": 2.716336541945277, "complete-iteration": 0.1980886582477552, "set_robot_commands": 0.00472395744681918, "deviation-center-line": 0.32648165218420006, "driven_lanedir_consec": 1.1049530942044865, "sim_compute_sim_state": 0.023282357784504062, "sim_compute_performance-ego": 0.003976902491609815}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1456295917183192, "get_ui_image": 0.034707886703086624, "step_physics": 0.08295064983945905, "survival_time": 13.200000000000053, "driven_lanedir": 1.584299965296606, "get_state_dump": 0.013257365335117687, "sim_render-ego": 0.005798734498746468, "get_robot_state": 0.01495182333570538, "get_duckie_state": 2.3020036292798593e-06, "in-drivable-lane": 5.950000000000045, "agent_compute-ego": 0.01740640853390549, "deviation-heading": 1.8143743846912777, "complete-iteration": 0.2045269454970504, "set_robot_commands": 0.0047181853742310495, "deviation-center-line": 0.4252828714555289, "driven_lanedir_consec": 1.584299965296606, "sim_compute_sim_state": 0.02670923326954697, "sim_compute_performance-ego": 0.0038797304485783434}}
set_robot_commands_max	0.0049449475606282555
set_robot_commands_mean	0.004803301338527735
set_robot_commands_median	0.004775036209625817
set_robot_commands_min	0.0047181853742310495
sim_compute_performance-ego_max	0.004126859505971273
sim_compute_performance-ego_mean	0.004027065453980145
sim_compute_performance-ego_median	0.004050835930685483
sim_compute_performance-ego_min	0.0038797304485783434
sim_compute_sim_state_max	0.02670923326954697
sim_compute_sim_state_mean	0.024741050620339537
sim_compute_sim_state_median	0.024486305713653563
sim_compute_sim_state_min	0.023282357784504062
sim_render-ego_max	0.006168790658315023
sim_render-ego_mean	0.006002515495535761
sim_render-ego_median	0.006021268412540776
sim_render-ego_min	0.005798734498746468
simulation-passed	1
step_physics_max	0.08295064983945905
step_physics_mean	0.08035797103647997
step_physics_median	0.08007913291174482
step_physics_min	0.0783229684829712
survival_time_max	14.950000000000076
survival_time_mean	13.437500000000057
survival_time_min	10.650000000000016

No reset possible

43075

11600

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 20:04:15+00:00

2020-11-25 20:11:37+00:00

0:07:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1225308965113094
survival_time_median	14.950000000000076
deviation-center-line_median	0.7450421765980603
in-drivable-lane_median	1.375000000000012

other stats

agent_compute-ego_max	0.017189779281616212
agent_compute-ego_mean	0.01688916985065706
agent_compute-ego_median	0.016921024719874063
agent_compute-ego_min	0.016524850681263914
complete-iteration_max	0.1949206773440043
complete-iteration_mean	0.18223176815817432
complete-iteration_median	0.18081477361340675
complete-iteration_min	0.17237684806187947
deviation-center-line_max	0.8719694657340666
deviation-center-line_mean	0.6422250344666915
deviation-center-line_min	0.20684631893657912
deviation-heading_max	4.300140879271832
deviation-heading_mean	3.1285461514382007
deviation-heading_median	3.7579546135377178
deviation-heading_min	0.6981344994055363
driven_any_max	3.263624656116101
driven_any_mean	2.5953516543572928
driven_any_median	2.8865006860644273
driven_any_min	1.3447805891842144
driven_lanedir_consec_max	2.902963477435188
driven_lanedir_consec_mean	2.0390092289516173
driven_lanedir_consec_min	1.0080116453486616
driven_lanedir_max	2.9490220777275766
driven_lanedir_mean	2.1991336801178676
driven_lanedir_median	2.419750498697616
driven_lanedir_min	1.0080116453486616
get_duckie_state_max	2.1637126963625674e-06
get_duckie_state_mean	2.056475608579574e-06
get_duckie_state_median	2.036889394124349e-06
get_duckie_state_min	1.9884109497070312e-06
get_robot_state_max	0.013948542277018227
get_robot_state_mean	0.0126855940780332
get_robot_state_median	0.012691900960860711
get_robot_state_min	0.011410032113393148
get_state_dump_max	0.012797652880350749
get_state_dump_mean	0.012347981038913932
get_state_dump_median	0.012336677517942204
get_state_dump_min	0.011920916239420572
get_ui_image_max	0.03362844705581665
get_ui_image_mean	0.03246685127417247
get_ui_image_median	0.0323497192064921
get_ui_image_min	0.031539519627889
in-drivable-lane_max	3.000000000000042
in-drivable-lane_mean	1.625000000000019
in-drivable-lane_min	0.7500000000000107
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.3447805891842144, "get_ui_image": 0.031539519627889, "step_physics": 0.06744769568084388, "survival_time": 4.6499999999999915, "driven_lanedir": 1.0080116453486616, "get_state_dump": 0.012143663180771695, "sim_render-ego": 0.005127929872082126, "get_robot_state": 0.011807777548349031, "get_duckie_state": 2.1637126963625674e-06, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.016524850681263914, "deviation-heading": 0.6981344994055363, "complete-iteration": 0.17298487181304603, "set_robot_commands": 0.004540161419940251, "deviation-center-line": 0.20684631893657912, "driven_lanedir_consec": 1.0080116453486616, "sim_compute_sim_state": 0.020227009250271703, "sim_compute_performance-ego": 0.003493301330074187}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.263624656116101, "get_ui_image": 0.03154313007990519, "step_physics": 0.06687846024831136, "survival_time": 14.950000000000076, "driven_lanedir": 2.902963477435188, "get_state_dump": 0.011920916239420572, "sim_render-ego": 0.005041522185007731, "get_robot_state": 0.011410032113393148, "get_duckie_state": 1.9884109497070312e-06, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.01701682964960734, "deviation-heading": 3.299994033986336, "complete-iteration": 0.17237684806187947, "set_robot_commands": 0.0044431591033935545, "deviation-center-line": 0.6753737115534181, "driven_lanedir_consec": 2.902963477435188, "sim_compute_sim_state": 0.02060272773106893, "sim_compute_performance-ego": 0.003394020398457845}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.516509097882065, "get_ui_image": 0.03315630833307902, "step_physics": 0.07605407953262329, "survival_time": 14.950000000000076, "driven_lanedir": 1.936537519960044, "get_state_dump": 0.012529691855112712, "sim_render-ego": 0.005509146849314372, "get_robot_state": 0.013948542277018227, "get_duckie_state": 2.0114580790201825e-06, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.017189779281616212, "deviation-heading": 4.215915193089098, "complete-iteration": 0.1886446754137675, "set_robot_commands": 0.0045389191309611, "deviation-center-line": 0.8147106416427025, "driven_lanedir_consec": 1.936537519960044, "sim_compute_sim_state": 0.021912525494893392, "sim_compute_performance-ego": 0.0036740970611572263}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.25649227424679, "get_ui_image": 0.03362844705581665, "step_physics": 0.07874524672826132, "survival_time": 14.950000000000076, "driven_lanedir": 2.9490220777275766, "get_state_dump": 0.012797652880350749, "sim_render-ego": 0.005435160795847575, "get_robot_state": 0.013576024373372396, "get_duckie_state": 2.0623207092285157e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.01682521979014079, "deviation-heading": 4.300140879271832, "complete-iteration": 0.1949206773440043, "set_robot_commands": 0.004522678057352702, "deviation-center-line": 0.8719694657340666, "driven_lanedir_consec": 2.308524273062575, "sim_compute_sim_state": 0.025541382630666097, "sim_compute_performance-ego": 0.003712123235066731}}
set_robot_commands_max	0.004540161419940251
set_robot_commands_mean	0.004511229427911902
set_robot_commands_median	0.004530798594156902
set_robot_commands_min	0.0044431591033935545
sim_compute_performance-ego_max	0.003712123235066731
sim_compute_performance-ego_mean	0.0035683855061889973
sim_compute_performance-ego_median	0.003583699195615707
sim_compute_performance-ego_min	0.003394020398457845
sim_compute_sim_state_max	0.025541382630666097
sim_compute_sim_state_mean	0.02207091127672503
sim_compute_sim_state_median	0.02125762661298116
sim_compute_sim_state_min	0.020227009250271703
sim_render-ego_max	0.005509146849314372
sim_render-ego_mean	0.00527843992556295
sim_render-ego_median	0.005281545333964851
sim_render-ego_min	0.005041522185007731
simulation-passed	1
step_physics_max	0.07874524672826132
step_physics_mean	0.07228137054750997
step_physics_median	0.0717508876067336
step_physics_min	0.06687846024831136
survival_time_max	14.950000000000076
survival_time_mean	12.375000000000057
survival_time_min	4.6499999999999915

No reset possible

43070

11599

Yishu Malhotra 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-25 19:43:31+00:00

2020-11-25 19:51:20+00:00

0:07:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1768056152616575
survival_time_median	14.950000000000076
deviation-center-line_median	0.6130289771791356
in-drivable-lane_median	1.5000000000000036

other stats

agent_compute-ego_max	0.017360692024230958
agent_compute-ego_mean	0.016999463508326467
agent_compute-ego_median	0.016973031897939556
agent_compute-ego_min	0.0166910982131958
complete-iteration_max	0.20154876788457235
complete-iteration_mean	0.1942068752359757
complete-iteration_median	0.19391967986254083
complete-iteration_min	0.18743937333424887
deviation-center-line_max	0.828453182592786
deviation-center-line_mean	0.5637201418116234
deviation-center-line_min	0.2003694302954363
deviation-heading_max	3.990920943847714
deviation-heading_mean	2.9223050051265886
deviation-heading_median	3.262472227863272
deviation-heading_min	1.1733546209320975
driven_any_max	3.3329761856392515
driven_any_mean	2.932935597846329
driven_any_median	3.1680838710501344
driven_any_min	2.062598463645794
driven_lanedir_consec_max	3.1978500739193016
driven_lanedir_consec_mean	2.2216909033381307
driven_lanedir_consec_min	1.3353023089099056
driven_lanedir_max	3.1978500739193016
driven_lanedir_mean	2.29932360961639
driven_lanedir_median	2.332071027818176
driven_lanedir_min	1.3353023089099056
get_duckie_state_max	2.6257832845052084e-06
get_duckie_state_mean	2.4225821164363713e-06
get_duckie_state_median	2.380710853559592e-06
get_duckie_state_min	2.3031234741210938e-06
get_robot_state_max	0.01589139035884166
get_robot_state_mean	0.01511957479403323
get_robot_state_median	0.014978692531585694
get_robot_state_min	0.014629523754119873
get_state_dump_max	0.013993664875926588
get_state_dump_mean	0.01342277176561505
get_state_dump_median	0.013260122537612915
get_state_dump_min	0.01317717711130778
get_ui_image_max	0.03414466619491577
get_ui_image_mean	0.03349706982339522
get_ui_image_median	0.03370703419049581
get_ui_image_min	0.03242954471767349
in-drivable-lane_max	4.95000000000007
in-drivable-lane_mean	1.9875000000000191
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.062598463645794, "get_ui_image": 0.03242954471767349, "step_physics": 0.07184678756150624, "survival_time": 7.449999999999981, "driven_lanedir": 1.3353023089099056, "get_state_dump": 0.013993664875926588, "sim_render-ego": 0.005831624037467393, "get_robot_state": 0.01589139035884166, "get_duckie_state": 2.414588160162804e-06, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.016910356163178514, "deviation-heading": 1.1733546209320975, "complete-iteration": 0.18881051012333608, "set_robot_commands": 0.004657239721925467, "deviation-center-line": 0.2003694302954363, "driven_lanedir_consec": 1.3353023089099056, "sim_compute_sim_state": 0.02320560672939224, "sim_compute_performance-ego": 0.003892756148472728}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.3329761856392515, "get_ui_image": 0.03331473668416341, "step_physics": 0.07277207454045613, "survival_time": 14.950000000000076, "driven_lanedir": 3.1978500739193016, "get_state_dump": 0.01317717711130778, "sim_render-ego": 0.005779391924540202, "get_robot_state": 0.014629523754119873, "get_duckie_state": 2.6257832845052084e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0166910982131958, "deviation-heading": 3.6301694940732414, "complete-iteration": 0.18743937333424887, "set_robot_commands": 0.004627638657887776, "deviation-center-line": 0.8171855611775038, "driven_lanedir_consec": 3.1978500739193016, "sim_compute_sim_state": 0.022565596103668213, "sim_compute_performance-ego": 0.003728798230489095}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.23525805699145, "get_ui_image": 0.03414466619491577, "step_physics": 0.08133715232213339, "survival_time": 14.950000000000076, "driven_lanedir": 1.8308864784819336, "get_state_dump": 0.013301200866699218, "sim_render-ego": 0.005759070714314779, "get_robot_state": 0.015117368698120116, "get_duckie_state": 2.3468335469563803e-06, "in-drivable-lane": 4.95000000000007, "agent_compute-ego": 0.017360692024230958, "deviation-heading": 2.8947749616533027, "complete-iteration": 0.1990288496017456, "set_robot_commands": 0.004682261943817139, "deviation-center-line": 0.40887239318076735, "driven_lanedir_consec": 1.8308864784819336, "sim_compute_sim_state": 0.023308459122975668, "sim_compute_performance-ego": 0.003865785598754883}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1009096851088187, "get_ui_image": 0.03409933169682821, "step_physics": 0.08180474122365315, "survival_time": 14.950000000000076, "driven_lanedir": 2.833255577154419, "get_state_dump": 0.013219044208526612, "sim_render-ego": 0.0057416145006815595, "get_robot_state": 0.01484001636505127, "get_duckie_state": 2.3031234741210938e-06, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.0170357076327006, "deviation-heading": 3.990920943847714, "complete-iteration": 0.20154876788457235, "set_robot_commands": 0.004556978543599446, "deviation-center-line": 0.828453182592786, "driven_lanedir_consec": 2.522724752041382, "sim_compute_sim_state": 0.026229416529337565, "sim_compute_performance-ego": 0.003869948387145996}}
set_robot_commands_max	0.004682261943817139
set_robot_commands_mean	0.004631029716807457
set_robot_commands_median	0.004642439189906622
set_robot_commands_min	0.004556978543599446
sim_compute_performance-ego_max	0.003892756148472728
sim_compute_performance-ego_mean	0.0038393220912156753
sim_compute_performance-ego_median	0.003867866992950439
sim_compute_performance-ego_min	0.003728798230489095
sim_compute_sim_state_max	0.026229416529337565
sim_compute_sim_state_mean	0.023827269621343423
sim_compute_sim_state_median	0.023257032926183953
sim_compute_sim_state_min	0.022565596103668213
sim_render-ego_max	0.005831624037467393
sim_render-ego_mean	0.005777925294250983
sim_render-ego_median	0.005769231319427491
sim_render-ego_min	0.0057416145006815595
simulation-passed	1
step_physics_max	0.08180474122365315
step_physics_mean	0.07694018891193723
step_physics_median	0.07705461343129476
step_physics_min	0.07184678756150624
survival_time_max	14.950000000000076
survival_time_mean	13.075000000000053
survival_time_min	7.449999999999981

No reset possible

43047

11592

real-exercise-2

LFv-sim

error

2020-11-25 19:05:51+00:00

2020-11-25 19:10:20+00:00

0:04:29

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42986

11577

exercise_state_estimation

LFv-sim

success

2020-11-25 14:04:47+00:00

2020-11-25 14:12:55+00:00

0:08:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6156126161103588
survival_time_median	14.950000000000076
deviation-center-line_median	0.6031859498397207
in-drivable-lane_median	2.050000000000029

other stats

agent_compute-ego_max	0.016937662760416666
agent_compute-ego_mean	0.01645849068959554
agent_compute-ego_median	0.016480129957199094
agent_compute-ego_min	0.0159360400835673
complete-iteration_max	0.18539145231246948
complete-iteration_mean	0.17653383870919545
complete-iteration_median	0.17480483571688332
complete-iteration_min	0.17113423109054565
deviation-center-line_max	0.8222629481381224
deviation-center-line_mean	0.5879394572353658
deviation-center-line_min	0.32312298112389914
deviation-heading_max	4.086396925308918
deviation-heading_mean	2.9876948767660867
deviation-heading_median	2.835712772473892
deviation-heading_min	2.192957036807646
driven_any_max	1.9399302050352096
driven_any_mean	1.9383050456109272
driven_any_median	1.9398321910545824
driven_any_min	1.9336255952993355
driven_lanedir_consec_max	1.8929035936122465
driven_lanedir_consec_mean	1.5725293458168277
driven_lanedir_consec_min	1.1659885574343465
driven_lanedir_max	1.8929035936122465
driven_lanedir_mean	1.5725293458168277
driven_lanedir_median	1.6156126161103588
driven_lanedir_min	1.1659885574343465
get_duckie_state_max	2.1187464396158854e-06
get_duckie_state_mean	2.054770787556966e-06
get_duckie_state_median	2.0535786946614583e-06
get_duckie_state_min	1.9931793212890624e-06
get_robot_state_max	0.011844576199849449
get_robot_state_mean	0.011641861200332644
get_robot_state_median	0.011625606218973796
get_robot_state_min	0.011471656163533527
get_state_dump_max	0.012244416872660318
get_state_dump_mean	0.012108978629112244
get_state_dump_median	0.012144790887832642
get_state_dump_min	0.011901915868123373
get_ui_image_max	0.03316141525904338
get_ui_image_mean	0.03225526213645935
get_ui_image_median	0.03210363149642945
get_ui_image_min	0.03165237029393514
in-drivable-lane_max	4.600000000000012
in-drivable-lane_mean	2.1750000000000176
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336255952993355, "get_ui_image": 0.03165237029393514, "step_physics": 0.06652672211329143, "survival_time": 14.950000000000076, "driven_lanedir": 1.3434735655633625, "get_state_dump": 0.012244416872660318, "sim_render-ego": 0.005031570593516032, "get_robot_state": 0.011844576199849449, "get_duckie_state": 2.1187464396158854e-06, "in-drivable-lane": 4.100000000000058, "agent_compute-ego": 0.016365556716918944, "deviation-heading": 2.192957036807646, "complete-iteration": 0.1726634661356608, "set_robot_commands": 0.0044896523157755535, "deviation-center-line": 0.32312298112389914, "driven_lanedir_consec": 1.3434735655633625, "sim_compute_sim_state": 0.020936419169108073, "sim_compute_performance-ego": 0.003436443010965983}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399047146498145, "get_ui_image": 0.03198145707448324, "step_physics": 0.0657556430498759, "survival_time": 14.950000000000076, "driven_lanedir": 1.8877516666573553, "get_state_dump": 0.012129940191904704, "sim_render-ego": 0.005009550253550212, "get_robot_state": 0.011475642522176107, "get_duckie_state": 1.9931793212890624e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016937662760416666, "deviation-heading": 2.989387902850456, "complete-iteration": 0.17113423109054565, "set_robot_commands": 0.004492595195770264, "deviation-center-line": 0.5471958673946012, "driven_lanedir_consec": 1.8877516666573553, "sim_compute_sim_state": 0.01983218749364217, "sim_compute_performance-ego": 0.003384574254353841}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9397596674593505, "get_ui_image": 0.03222580591837565, "step_physics": 0.07033535798390707, "survival_time": 14.950000000000076, "driven_lanedir": 1.1659885574343465, "get_state_dump": 0.01215964158376058, "sim_render-ego": 0.005105203787485759, "get_robot_state": 0.011775569915771484, "get_duckie_state": 2.0503997802734374e-06, "in-drivable-lane": 4.600000000000012, "agent_compute-ego": 0.016594703197479247, "deviation-heading": 4.086396925308918, "complete-iteration": 0.17694620529810587, "set_robot_commands": 0.004489874839782715, "deviation-center-line": 0.8222629481381224, "driven_lanedir_consec": 1.1659885574343465, "sim_compute_sim_state": 0.02069376548131307, "sim_compute_performance-ego": 0.0034303760528564455}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399302050352096, "get_ui_image": 0.03316141525904338, "step_physics": 0.07684977690378825, "survival_time": 14.950000000000076, "driven_lanedir": 1.8929035936122465, "get_state_dump": 0.011901915868123373, "sim_render-ego": 0.004958161513010661, "get_robot_state": 0.011471656163533527, "get_duckie_state": 2.0567576090494792e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0159360400835673, "deviation-heading": 2.6820376420973275, "complete-iteration": 0.18539145231246948, "set_robot_commands": 0.004329037666320801, "deviation-center-line": 0.6591760322848403, "driven_lanedir_consec": 1.8929035936122465, "sim_compute_sim_state": 0.02326354503631592, "sim_compute_performance-ego": 0.003383833567301432}}
set_robot_commands_max	0.004492595195770264
set_robot_commands_mean	0.004450290004412333
set_robot_commands_median	0.004489763577779134
set_robot_commands_min	0.004329037666320801
sim_compute_performance-ego_max	0.003436443010965983
sim_compute_performance-ego_mean	0.0034088067213694255
sim_compute_performance-ego_median	0.003407475153605143
sim_compute_performance-ego_min	0.003383833567301432
sim_compute_sim_state_max	0.02326354503631592
sim_compute_sim_state_mean	0.02118147929509481
sim_compute_sim_state_median	0.02081509232521057
sim_compute_sim_state_min	0.01983218749364217
sim_render-ego_max	0.005105203787485759
sim_render-ego_mean	0.005026121536890666
sim_render-ego_median	0.005020560423533122
sim_render-ego_min	0.004958161513010661
simulation-passed	1
step_physics_max	0.07684977690378825
step_physics_mean	0.06986687501271566
step_physics_median	0.06843104004859925
step_physics_min	0.0657556430498759
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42965

11574

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFv-sim

success

2020-11-25 12:46:56+00:00

2020-11-25 12:57:16+00:00

0:10:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.656672841133555
survival_time_median	14.950000000000076
deviation-center-line_median	0.67981070340838
in-drivable-lane_median	6.9750000000000485

other stats

agent_compute-ego_max	0.019332074324289957
agent_compute-ego_mean	0.018836300174395245
agent_compute-ego_median	0.018745578130086264
agent_compute-ego_min	0.01852197011311849
complete-iteration_max	0.19496034065882364
complete-iteration_mean	0.18997086505095165
complete-iteration_median	0.1894061319033305
complete-iteration_min	0.18611085573832195
deviation-center-line_max	1.254049156822492
deviation-center-line_mean	0.6768555311663336
deviation-center-line_min	0.09375156102608248
deviation-heading_max	2.6481914725723215
deviation-heading_mean	1.6212224650340634
deviation-heading_median	1.7315300977824015
deviation-heading_min	0.37363819199912873
driven_any_max	5.407480401557125
driven_any_mean	3.0796002851597297
driven_any_median	3.179364421396717
driven_any_min	0.5521918962883594
driven_lanedir_consec_max	3.8854424184321665
driven_lanedir_consec_mean	2.420925709569022
driven_lanedir_consec_min	0.4849147375768128
driven_lanedir_max	3.8854424184321665
driven_lanedir_mean	2.420925709569022
driven_lanedir_median	2.656672841133555
driven_lanedir_min	0.4849147375768128
get_duckie_state_max	2.319018046061198e-06
get_duckie_state_mean	2.244710922241211e-06
get_duckie_state_median	2.234776814778646e-06
get_duckie_state_min	2.1902720133463543e-06
get_robot_state_max	0.013858141899108887
get_robot_state_mean	0.01366450389226278
get_robot_state_median	0.013669463793436688
get_robot_state_min	0.013460946083068848
get_state_dump_max	0.013068854808807371
get_state_dump_mean	0.012855495015780132
get_state_dump_median	0.012843329509099326
get_state_dump_min	0.012666466236114502
get_ui_image_max	0.03369856913884481
get_ui_image_mean	0.033330170114835106
get_ui_image_median	0.03346230824788411
get_ui_image_min	0.03269749482472738
in-drivable-lane_max	13.150000000000077
in-drivable-lane_mean	7.550000000000047
in-drivable-lane_min	3.100000000000012
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5521918962883594, "get_ui_image": 0.03343127091725667, "step_physics": 0.07135740280151368, "survival_time": 14.950000000000076, "driven_lanedir": 0.4849147375768128, "get_state_dump": 0.012666466236114502, "sim_render-ego": 0.005553085009256999, "get_robot_state": 0.013858141899108887, "get_duckie_state": 2.265771230061849e-06, "in-drivable-lane": 13.150000000000077, "agent_compute-ego": 0.01852197011311849, "deviation-heading": 0.37363819199912873, "complete-iteration": 0.18611085573832195, "set_robot_commands": 0.004395843346913656, "deviation-center-line": 0.09375156102608248, "driven_lanedir_consec": 0.4849147375768128, "sim_compute_sim_state": 0.02246554692586263, "sim_compute_performance-ego": 0.0037208239237467447}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.07499277757938, "get_ui_image": 0.03269749482472738, "step_physics": 0.07149607896804809, "survival_time": 14.950000000000076, "driven_lanedir": 1.7074372333487575, "get_state_dump": 0.013068854808807371, "sim_render-ego": 0.005555830001831055, "get_robot_state": 0.013591580390930176, "get_duckie_state": 2.1902720133463543e-06, "in-drivable-lane": 9.650000000000087, "agent_compute-ego": 0.019332074324289957, "deviation-heading": 0.8322307468753577, "complete-iteration": 0.1866382869084676, "set_robot_commands": 0.0043144702911376955, "deviation-center-line": 0.3537339002080254, "driven_lanedir_consec": 1.7074372333487575, "sim_compute_sim_state": 0.022727523644765216, "sim_compute_performance-ego": 0.003710199197133382}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.283736065214055, "get_ui_image": 0.03369856913884481, "step_physics": 0.07539363145828247, "survival_time": 14.950000000000076, "driven_lanedir": 3.6059084489183526, "get_state_dump": 0.012745075225830078, "sim_render-ego": 0.005634900728861491, "get_robot_state": 0.013747347195943196, "get_duckie_state": 2.319018046061198e-06, "in-drivable-lane": 3.100000000000012, "agent_compute-ego": 0.018821322123209635, "deviation-heading": 2.6481914725723215, "complete-iteration": 0.19217397689819335, "set_robot_commands": 0.0043734383583068845, "deviation-center-line": 1.254049156822492, "driven_lanedir_consec": 3.6059084489183526, "sim_compute_sim_state": 0.023860684235890703, "sim_compute_performance-ego": 0.0037527791659037273}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.407480401557125, "get_ui_image": 0.03349334557851156, "step_physics": 0.07535772879918416, "survival_time": 14.950000000000076, "driven_lanedir": 3.8854424184321665, "get_state_dump": 0.012941583792368571, "sim_render-ego": 0.005533072153727213, "get_robot_state": 0.013460946083068848, "get_duckie_state": 2.203782399495443e-06, "in-drivable-lane": 4.30000000000001, "agent_compute-ego": 0.018669834136962892, "deviation-heading": 2.630829448689446, "complete-iteration": 0.19496034065882364, "set_robot_commands": 0.004380204677581787, "deviation-center-line": 1.0058875066087345, "driven_lanedir_consec": 3.8854424184321665, "sim_compute_sim_state": 0.027271053791046145, "sim_compute_performance-ego": 0.0037081313133239743}}
set_robot_commands_max	0.004395843346913656
set_robot_commands_mean	0.004365989168485006
set_robot_commands_median	0.004376821517944336
set_robot_commands_min	0.0043144702911376955
sim_compute_performance-ego_max	0.0037527791659037273
sim_compute_performance-ego_mean	0.0037229834000269578
sim_compute_performance-ego_median	0.003715511560440064
sim_compute_performance-ego_min	0.0037081313133239743
sim_compute_sim_state_max	0.027271053791046145
sim_compute_sim_state_mean	0.024081202149391176
sim_compute_sim_state_median	0.02329410394032796
sim_compute_sim_state_min	0.02246554692586263
sim_render-ego_max	0.005634900728861491
sim_render-ego_mean	0.00556922197341919
sim_render-ego_median	0.005554457505544027
sim_render-ego_min	0.005533072153727213
simulation-passed	1
step_physics_max	0.07539363145828247
step_physics_mean	0.0734012105067571
step_physics_median	0.07342690388361613
step_physics_min	0.07135740280151368
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42952

11570

Bhavya Patwa 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-25 07:41:13+00:00

2020-11-25 07:48:30+00:00

0:07:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4204085553559743
survival_time_median	14.950000000000076
deviation-center-line_median	0.23038623328801985
in-drivable-lane_median	9.375000000000076

other stats

agent_compute-ego_max	0.017508875528971353
agent_compute-ego_mean	0.017059364947704
agent_compute-ego_median	0.017062191234086997
agent_compute-ego_min	0.016604201793670656
complete-iteration_max	0.1949002480506897
complete-iteration_mean	0.1861071906614741
complete-iteration_median	0.18579977355965785
complete-iteration_min	0.17792896747589113
deviation-center-line_max	0.3851535065666875
deviation-center-line_mean	0.2482668903171711
deviation-center-line_min	0.14714158812595726
deviation-heading_max	3.3934937794149023
deviation-heading_mean	1.8326683754766664
deviation-heading_median	1.4571220693445832
deviation-heading_min	1.0229355838025986
driven_any_max	1.9399908350981323
driven_any_mean	1.6230750463412165
driven_any_median	1.936834783259365
driven_any_min	0.6786397837480028
driven_lanedir_consec_max	0.567866545838466
driven_lanedir_consec_mean	0.4148134442928571
driven_lanedir_consec_min	0.250570120621014
driven_lanedir_max	0.567866545838466
driven_lanedir_mean	0.4148134442928571
driven_lanedir_median	0.4204085553559743
driven_lanedir_min	0.250570120621014
get_duckie_state_max	2.2602081298828126e-06
get_duckie_state_mean	2.19962830208128e-06
get_duckie_state_median	2.239184277502404e-06
get_duckie_state_min	2.0599365234375e-06
get_robot_state_max	0.014759687582651776
get_robot_state_mean	0.013477983609616577
get_robot_state_median	0.013398165575225784
get_robot_state_min	0.012355915705362956
get_state_dump_max	0.013319359620412191
get_state_dump_mean	0.013065818785162876
get_state_dump_median	0.013166333116158068
get_state_dump_min	0.012611249287923176
get_ui_image_max	0.03434167226155599
get_ui_image_mean	0.03310836479022233
get_ui_image_median	0.03301044831582166
get_ui_image_min	0.03207089026769002
in-drivable-lane_max	12.000000000000076
in-drivable-lane_mean	8.425000000000054
in-drivable-lane_min	2.9499999999999895
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336789449476444, "get_ui_image": 0.03207089026769002, "step_physics": 0.06869547764460246, "survival_time": 14.950000000000076, "driven_lanedir": 0.567866545838466, "get_state_dump": 0.012611249287923176, "sim_render-ego": 0.005318476359049479, "get_robot_state": 0.012692747910817464, "get_duckie_state": 2.2602081298828126e-06, "in-drivable-lane": 8.700000000000061, "agent_compute-ego": 0.016604201793670656, "deviation-heading": 3.3934937794149023, "complete-iteration": 0.17792896747589113, "set_robot_commands": 0.004409189224243164, "deviation-center-line": 0.3851535065666875, "driven_lanedir_consec": 0.567866545838466, "sim_compute_sim_state": 0.02183083693186442, "sim_compute_performance-ego": 0.0035667451222737632}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399908350981323, "get_ui_image": 0.03434167226155599, "step_physics": 0.07944877862930298, "survival_time": 14.950000000000076, "driven_lanedir": 0.5608760974193663, "get_state_dump": 0.01322065273920695, "sim_render-ego": 0.0058234127362569174, "get_robot_state": 0.014759687582651776, "get_duckie_state": 2.2451082865397134e-06, "in-drivable-lane": 10.050000000000086, "agent_compute-ego": 0.017187684377034506, "deviation-heading": 1.4880221170047658, "complete-iteration": 0.1949002480506897, "set_robot_commands": 0.0046511530876159664, "deviation-center-line": 0.2594177742344038, "driven_lanedir_consec": 0.5608760974193663, "sim_compute_sim_state": 0.021503924528757733, "sim_compute_performance-ego": 0.0038275218009948737}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.6786397837480028, "get_ui_image": 0.03297400255815698, "step_physics": 0.06911812572304261, "survival_time": 5.449999999999989, "driven_lanedir": 0.250570120621014, "get_state_dump": 0.013112013493109188, "sim_render-ego": 0.005624882671811165, "get_robot_state": 0.014103583239634102, "get_duckie_state": 2.2332602684650945e-06, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.01693669809113949, "deviation-heading": 1.0229355838025986, "complete-iteration": 0.18121034070986128, "set_robot_commands": 0.004658458429739016, "deviation-center-line": 0.14714158812595726, "driven_lanedir_consec": 0.250570120621014, "sim_compute_sim_state": 0.02081842816204106, "sim_compute_performance-ego": 0.0037317625973202766}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939990621571086, "get_ui_image": 0.03304689407348633, "step_physics": 0.07731825908025106, "survival_time": 14.950000000000076, "driven_lanedir": 0.27994101329258236, "get_state_dump": 0.013319359620412191, "sim_render-ego": 0.0051806012789408365, "get_robot_state": 0.012355915705362956, "get_duckie_state": 2.0599365234375e-06, "in-drivable-lane": 12.000000000000076, "agent_compute-ego": 0.017508875528971353, "deviation-heading": 1.4262220216844006, "complete-iteration": 0.1903892064094543, "set_robot_commands": 0.004509133497873942, "deviation-center-line": 0.2013546923416358, "driven_lanedir_consec": 0.27994101329258236, "sim_compute_sim_state": 0.02354222774505615, "sim_compute_performance-ego": 0.0034808349609375}}
set_robot_commands_max	0.004658458429739016
set_robot_commands_mean	0.004556983559868022
set_robot_commands_median	0.004580143292744954
set_robot_commands_min	0.004409189224243164
sim_compute_performance-ego_max	0.0038275218009948737
sim_compute_performance-ego_mean	0.0036517161203816033
sim_compute_performance-ego_median	0.00364925385979702
sim_compute_performance-ego_min	0.0034808349609375
sim_compute_sim_state_max	0.02354222774505615
sim_compute_sim_state_mean	0.02192385434192984
sim_compute_sim_state_median	0.021667380730311075
sim_compute_sim_state_min	0.02081842816204106
sim_render-ego_max	0.0058234127362569174
sim_render-ego_mean	0.0054868432615146
sim_render-ego_median	0.005471679515430322
sim_render-ego_min	0.0051806012789408365
simulation-passed	1
step_physics_max	0.07944877862930298
step_physics_mean	0.07364516026929976
step_physics_median	0.07321819240164684
step_physics_min	0.06869547764460246
survival_time_max	14.950000000000076
survival_time_mean	12.575000000000056
survival_time_min	5.449999999999989

No reset possible

42938

11569

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 07:22:44+00:00

2020-11-25 07:29:07+00:00

0:06:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.754904761603122
survival_time_median	8.974999999999993
deviation-center-line_median	0.27438405800585375
in-drivable-lane_median	2.700000000000007

other stats

agent_compute-ego_max	0.017071368426260863
agent_compute-ego_mean	0.016614918555961613
agent_compute-ego_median	0.016590649219818447
agent_compute-ego_min	0.016207007357948704
complete-iteration_max	0.18564203787132127
complete-iteration_mean	0.18033307473923985
complete-iteration_median	0.18155807639423172
complete-iteration_min	0.17257410829717462
deviation-center-line_max	0.7270027170123633
deviation-center-line_mean	0.3757721050662328
deviation-center-line_min	0.2273175872408603
deviation-heading_max	4.658054020007951
deviation-heading_mean	1.8299636591836173
deviation-heading_median	1.002776170393093
deviation-heading_min	0.6562482759403321
driven_any_max	3.6397170050869834
driven_any_mean	2.7588731571314917
driven_any_median	2.5793373194226654
driven_any_min	2.237100984593652
driven_lanedir_consec_max	1.9202161403913585
driven_lanedir_consec_mean	1.7516697717631224
driven_lanedir_consec_min	1.576653423454886
driven_lanedir_max	1.9202161403913585
driven_lanedir_mean	1.7516697717631224
driven_lanedir_median	1.754904761603122
driven_lanedir_min	1.576653423454886
get_duckie_state_max	2.3785427477232805e-06
get_duckie_state_mean	2.2660310017869107e-06
get_duckie_state_median	2.2466925831584188e-06
get_duckie_state_min	2.192196093107525e-06
get_robot_state_max	0.01426205409349069
get_robot_state_mean	0.012603755381544311
get_robot_state_median	0.012170336100093104
get_robot_state_min	0.01181229523250035
get_state_dump_max	0.013052085447593554
get_state_dump_mean	0.012562335105698944
get_state_dump_median	0.012501883569516634
get_state_dump_min	0.012193487836168958
get_ui_image_max	0.032727151227420606
get_ui_image_mean	0.032357333255285274
get_ui_image_median	0.03250966256124932
get_ui_image_min	0.031682856671221844
in-drivable-lane_max	5.849999999999995
in-drivable-lane_mean	3.125000000000001
in-drivable-lane_min	1.2499999999999956
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.375182782783851, "get_ui_image": 0.032727151227420606, "step_physics": 0.07165475709903875, "survival_time": 8.449999999999985, "driven_lanedir": 1.651984896683964, "get_state_dump": 0.013052085447593554, "sim_render-ego": 0.005567224773429555, "get_robot_state": 0.01426205409349069, "get_duckie_state": 2.3785427477232805e-06, "in-drivable-lane": 2.4999999999999982, "agent_compute-ego": 0.017071368426260863, "deviation-heading": 0.6562482759403321, "complete-iteration": 0.18564203787132127, "set_robot_commands": 0.004506026499370146, "deviation-center-line": 0.2855629350645144, "driven_lanedir_consec": 1.651984896683964, "sim_compute_sim_state": 0.02280782947878866, "sim_compute_performance-ego": 0.0038533817381548457}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.237100984593652, "get_ui_image": 0.031682856671221844, "step_physics": 0.06657608608146767, "survival_time": 7.699999999999981, "driven_lanedir": 1.8578246265222804, "get_state_dump": 0.012193487836168958, "sim_render-ego": 0.005177177392043077, "get_robot_state": 0.01181229523250035, "get_duckie_state": 2.2355612222250405e-06, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.01653692629430201, "deviation-heading": 1.0567239870980154, "complete-iteration": 0.17257410829717462, "set_robot_commands": 0.004519104957580566, "deviation-center-line": 0.2273175872408603, "driven_lanedir_consec": 1.8578246265222804, "sim_compute_sim_state": 0.020435243457942814, "sim_compute_performance-ego": 0.0035113421353426847}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.6397170050869834, "get_ui_image": 0.032484334309895835, "step_physics": 0.06969791412353515, "survival_time": 14.950000000000076, "driven_lanedir": 1.576653423454886, "get_state_dump": 0.01266362428665161, "sim_render-ego": 0.005224572022755941, "get_robot_state": 0.012425407568613689, "get_duckie_state": 2.257823944091797e-06, "in-drivable-lane": 5.849999999999995, "agent_compute-ego": 0.01664437214533488, "deviation-heading": 4.658054020007951, "complete-iteration": 0.17922529935836792, "set_robot_commands": 0.004278202056884766, "deviation-center-line": 0.7270027170123633, "driven_lanedir_consec": 1.576653423454886, "sim_compute_sim_state": 0.02216157039006551, "sim_compute_performance-ego": 0.0035125080744425456}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7834918560614796, "get_ui_image": 0.0325349908126028, "step_physics": 0.07384274633307206, "survival_time": 9.5, "driven_lanedir": 1.9202161403913585, "get_state_dump": 0.012340142852381657, "sim_render-ego": 0.0050132575787995995, "get_robot_state": 0.011915264631572522, "get_duckie_state": 2.192196093107525e-06, "in-drivable-lane": 2.9000000000000155, "agent_compute-ego": 0.016207007357948704, "deviation-heading": 0.9488283536881708, "complete-iteration": 0.18389085343009548, "set_robot_commands": 0.004306321395070929, "deviation-center-line": 0.26320518094719314, "driven_lanedir_consec": 1.9202161403913585, "sim_compute_sim_state": 0.024227248994927657, "sim_compute_performance-ego": 0.00338077796132941}}
set_robot_commands_max	0.004519104957580566
set_robot_commands_mean	0.004402413727226602
set_robot_commands_median	0.0044061739472205375
set_robot_commands_min	0.004278202056884766
sim_compute_performance-ego_max	0.0038533817381548457
sim_compute_performance-ego_mean	0.0035645024773173716
sim_compute_performance-ego_median	0.0035119251048926154
sim_compute_performance-ego_min	0.00338077796132941
sim_compute_sim_state_max	0.024227248994927657
sim_compute_sim_state_mean	0.022407973080431163
sim_compute_sim_state_median	0.022484699934427085
sim_compute_sim_state_min	0.020435243457942814
sim_render-ego_max	0.005567224773429555
sim_render-ego_mean	0.005245557941757043
sim_render-ego_median	0.005200874707399508
sim_render-ego_min	0.0050132575787995995
simulation-passed	1
step_physics_max	0.07384274633307206
step_physics_mean	0.07044287590927842
step_physics_median	0.07067633561128694
step_physics_min	0.06657608608146767
survival_time_max	14.950000000000076
survival_time_mean	10.150000000000013
survival_time_min	7.699999999999981

No reset possible

42927

11566

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 06:46:05+00:00

2020-11-25 06:54:37+00:00

0:08:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1886091909549927
survival_time_median	14.950000000000076
deviation-center-line_median	0.7319585282485965
in-drivable-lane_median	6.925000000000029

other stats

agent_compute-ego_max	0.017100958824157714
agent_compute-ego_mean	0.016875624457995096
agent_compute-ego_median	0.01685562332471212
agent_compute-ego_min	0.01669029235839844
complete-iteration_max	0.1925516668955485
complete-iteration_mean	0.18007774531841278
complete-iteration_median	0.1777971601486206
complete-iteration_min	0.17216499408086142
deviation-center-line_max	0.9797513531176302
deviation-center-line_mean	0.7178673652949097
deviation-center-line_min	0.42780105156481535
deviation-heading_max	2.3426857949834896
deviation-heading_mean	1.5242760057270877
deviation-heading_median	1.5443172114958328
deviation-heading_min	0.6657838049331952
driven_any_max	3.7786489009711866
driven_any_mean	3.634734784112807
driven_any_median	3.656473161644512
driven_any_min	3.4473439121910183
driven_lanedir_consec_max	2.4771394359528807
driven_lanedir_consec_mean	2.034911541808619
driven_lanedir_consec_min	1.2852883493716107
driven_lanedir_max	2.4771394359528807
driven_lanedir_mean	2.034911541808619
driven_lanedir_median	2.1886091909549927
driven_lanedir_min	1.2852883493716107
get_duckie_state_max	2.283255259195963e-06
get_duckie_state_mean	2.162655194600423e-06
get_duckie_state_median	2.1620591481526693e-06
get_duckie_state_min	2.0432472229003907e-06
get_robot_state_max	0.012934476534525553
get_robot_state_mean	0.012237269083658853
get_robot_state_median	0.012281375726064046
get_robot_state_min	0.01145184834798177
get_state_dump_max	0.012960569063822428
get_state_dump_mean	0.012369169195493062
get_state_dump_median	0.012297879457473754
get_state_dump_min	0.011920348803202313
get_ui_image_max	0.03358513911565145
get_ui_image_mean	0.032331717212994895
get_ui_image_median	0.03216281096140544
get_ui_image_min	0.03141610781351725
in-drivable-lane_max	8.500000000000089
in-drivable-lane_mean	6.975000000000051
in-drivable-lane_min	5.550000000000059
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.7786489009711866, "get_ui_image": 0.03141610781351725, "step_physics": 0.06700696706771851, "survival_time": 14.950000000000076, "driven_lanedir": 2.4771394359528807, "get_state_dump": 0.01201253652572632, "sim_render-ego": 0.005140600204467774, "get_robot_state": 0.011635576089223226, "get_duckie_state": 2.110799153645834e-06, "in-drivable-lane": 5.8999999999999915, "agent_compute-ego": 0.01669029235839844, "deviation-heading": 1.9075957636445957, "complete-iteration": 0.17357933362325031, "set_robot_commands": 0.004303826491038005, "deviation-center-line": 0.9797513531176302, "driven_lanedir_consec": 2.4771394359528807, "sim_compute_sim_state": 0.02180328845977783, "sim_compute_performance-ego": 0.0034430495897928874}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.4473439121910183, "get_ui_image": 0.03157334009806315, "step_physics": 0.06692549228668213, "survival_time": 14.950000000000076, "driven_lanedir": 2.425165637828059, "get_state_dump": 0.011920348803202313, "sim_render-ego": 0.005040938059488932, "get_robot_state": 0.01145184834798177, "get_duckie_state": 2.0432472229003907e-06, "in-drivable-lane": 5.550000000000059, "agent_compute-ego": 0.016770330270131428, "deviation-heading": 1.18103865934707, "complete-iteration": 0.17216499408086142, "set_robot_commands": 0.004276578426361084, "deviation-center-line": 0.963753812758225, "driven_lanedir_consec": 2.425165637828059, "sim_compute_sim_state": 0.020734721819559737, "sim_compute_performance-ego": 0.003345036506652832}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.702800553217268, "get_ui_image": 0.03275228182474772, "step_physics": 0.07052371978759765, "survival_time": 14.950000000000076, "driven_lanedir": 1.2852883493716107, "get_state_dump": 0.012583222389221192, "sim_render-ego": 0.0053951724370320635, "get_robot_state": 0.012927175362904868, "get_duckie_state": 2.213319142659505e-06, "in-drivable-lane": 7.950000000000066, "agent_compute-ego": 0.017100958824157714, "deviation-heading": 2.3426857949834896, "complete-iteration": 0.18201498667399088, "set_robot_commands": 0.0045389366149902344, "deviation-center-line": 0.5001632437389681, "driven_lanedir_consec": 1.2852883493716107, "sim_compute_sim_state": 0.022443520228068035, "sim_compute_performance-ego": 0.00361377477645874}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.610145770071755, "get_ui_image": 0.03358513911565145, "step_physics": 0.07687515497207642, "survival_time": 14.950000000000076, "driven_lanedir": 1.952052744081926, "get_state_dump": 0.012960569063822428, "sim_render-ego": 0.005373102823893229, "get_robot_state": 0.012934476534525553, "get_duckie_state": 2.283255259195963e-06, "in-drivable-lane": 8.500000000000089, "agent_compute-ego": 0.016940916379292806, "deviation-heading": 0.6657838049331952, "complete-iteration": 0.1925516668955485, "set_robot_commands": 0.0043654115994771325, "deviation-center-line": 0.42780105156481535, "driven_lanedir_consec": 1.952052744081926, "sim_compute_sim_state": 0.02575120210647583, "sim_compute_performance-ego": 0.003629123369852702}}
set_robot_commands_max	0.0045389366149902344
set_robot_commands_mean	0.0043711882829666135
set_robot_commands_median	0.004334619045257568
set_robot_commands_min	0.004276578426361084
sim_compute_performance-ego_max	0.003629123369852702
sim_compute_performance-ego_mean	0.0035077460606892904
sim_compute_performance-ego_median	0.003528412183125814
sim_compute_performance-ego_min	0.003345036506652832
sim_compute_sim_state_max	0.02575120210647583
sim_compute_sim_state_mean	0.022683183153470357
sim_compute_sim_state_median	0.02212340434392293
sim_compute_sim_state_min	0.020734721819559737
sim_render-ego_max	0.0053951724370320635
sim_render-ego_mean	0.005237453381220499
sim_render-ego_median	0.005256851514180502
sim_render-ego_min	0.005040938059488932
simulation-passed	1
step_physics_max	0.07687515497207642
step_physics_mean	0.07033283352851867
step_physics_median	0.06876534342765808
step_physics_min	0.06692549228668213
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42919

11563

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

failed

2020-11-25 06:02:27+00:00

2020-11-25 06:06:06+00:00

0:03:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 162 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42886

11555

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

2020-11-25 03:03:46+00:00

2020-11-25 03:10:16+00:00

0:06:30

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 571 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42880

11551

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

failed

2020-11-25 02:31:02+00:00

2020-11-25 02:39:07+00:00

0:08:05

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 854 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42807

11539

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-24 23:18:04+00:00

2020-11-24 23:26:45+00:00

0:08:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.213494910158499
survival_time_median	14.950000000000076
deviation-center-line_median	0.30490221714284
in-drivable-lane_median	7.600000000000049

other stats

agent_compute-ego_max	0.017961113452911376
agent_compute-ego_mean	0.017731354278261943
agent_compute-ego_median	0.017695513252289064
agent_compute-ego_min	0.01757327715555827
complete-iteration_max	0.2081129240989685
complete-iteration_mean	0.20285848798931289
complete-iteration_median	0.2026485542969037
complete-iteration_min	0.19802391926447552
deviation-center-line_max	0.8344653589855908
deviation-center-line_mean	0.3782095076504058
deviation-center-line_min	0.06856823733035249
deviation-heading_max	2.892776525162956
deviation-heading_mean	1.7240686644240444
deviation-heading_median	1.7496316302013828
deviation-heading_min	0.5042348721304565
driven_any_max	3.57346279068664
driven_any_mean	3.414561333696045
driven_any_median	3.56755405754594
driven_any_min	2.9496744290056593
driven_lanedir_consec_max	3.0453933171697027
driven_lanedir_consec_mean	1.3990390022523926
driven_lanedir_consec_min	0.12377287152286932
driven_lanedir_max	3.0453933171697027
driven_lanedir_mean	1.4192009065506883
driven_lanedir_median	1.2538187187550909
driven_lanedir_min	0.12377287152286932
get_duckie_state_max	2.591609954833984e-06
get_duckie_state_mean	2.5229909086740145e-06
get_duckie_state_median	2.540202550990607e-06
get_duckie_state_min	2.4199485778808595e-06
get_robot_state_max	0.015882822775071668
get_robot_state_mean	0.015087645874228528
get_robot_state_median	0.014959560632705688
get_robot_state_min	0.01454863945643107
get_state_dump_max	0.013516808709790627
get_state_dump_mean	0.01344407150181391
get_state_dump_median	0.013444564739863078
get_state_dump_min	0.013370347817738852
get_ui_image_max	0.035476579666137695
get_ui_image_mean	0.035034432215716255
get_ui_image_median	0.03503917933151286
get_ui_image_min	0.03458279053370158
in-drivable-lane_max	13.900000000000077
in-drivable-lane_mean	7.662500000000043
in-drivable-lane_min	1.5499999999999965
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5617761169093822, "get_ui_image": 0.034611050287882486, "step_physics": 0.07877507130304973, "survival_time": 14.950000000000076, "driven_lanedir": 3.0453933171697027, "get_state_dump": 0.013472717603047689, "sim_render-ego": 0.005924687385559082, "get_robot_state": 0.014630924065907797, "get_duckie_state": 2.57412592569987e-06, "in-drivable-lane": 1.5499999999999965, "agent_compute-ego": 0.01773171901702881, "deviation-heading": 2.892776525162956, "complete-iteration": 0.19802391926447552, "set_robot_commands": 0.004639722506205241, "deviation-center-line": 0.8344653589855908, "driven_lanedir_consec": 3.0453933171697027, "sim_compute_sim_state": 0.024136815865834552, "sim_compute_performance-ego": 0.003941294352213542}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9496744290056593, "get_ui_image": 0.03546730837514324, "step_physics": 0.08156149041268133, "survival_time": 12.40000000000004, "driven_lanedir": 0.2669500450935295, "get_state_dump": 0.013516808709790627, "sim_render-ego": 0.0062145100485893985, "get_robot_state": 0.015882822775071668, "get_duckie_state": 2.5062791762813444e-06, "in-drivable-lane": 9.850000000000025, "agent_compute-ego": 0.01765930748754932, "deviation-heading": 2.3221888084480606, "complete-iteration": 0.20304069211406092, "set_robot_commands": 0.004824584530245873, "deviation-center-line": 0.16759933168028335, "driven_lanedir_consec": 0.18630242790034576, "sim_compute_sim_state": 0.023562467867328275, "sim_compute_performance-ego": 0.004188530868099582}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5733319981824976, "get_ui_image": 0.03458279053370158, "step_physics": 0.08158896684646606, "survival_time": 14.950000000000076, "driven_lanedir": 0.12377287152286932, "get_state_dump": 0.013416411876678467, "sim_render-ego": 0.005922369956970215, "get_robot_state": 0.01528819719950358, "get_duckie_state": 2.591609954833984e-06, "in-drivable-lane": 13.900000000000077, "agent_compute-ego": 0.017961113452911376, "deviation-heading": 0.5042348721304565, "complete-iteration": 0.2022564164797465, "set_robot_commands": 0.0047542206446329754, "deviation-center-line": 0.06856823733035249, "driven_lanedir_consec": 0.12377287152286932, "sim_compute_sim_state": 0.024647816022237146, "sim_compute_performance-ego": 0.0039345169067382816}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.57346279068664, "get_ui_image": 0.035476579666137695, "step_physics": 0.08540250142415365, "survival_time": 14.950000000000076, "driven_lanedir": 2.2406873924166524, "get_state_dump": 0.013370347817738852, "sim_render-ego": 0.005946458180745443, "get_robot_state": 0.01454863945643107, "get_duckie_state": 2.4199485778808595e-06, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.01757327715555827, "deviation-heading": 1.177074451954705, "complete-iteration": 0.2081129240989685, "set_robot_commands": 0.004607224464416504, "deviation-center-line": 0.44220510260539664, "driven_lanedir_consec": 2.2406873924166524, "sim_compute_sim_state": 0.02704732100168864, "sim_compute_performance-ego": 0.003980058828989665}}
set_robot_commands_max	0.004824584530245873
set_robot_commands_mean	0.004706438036375148
set_robot_commands_median	0.004696971575419108
set_robot_commands_min	0.004607224464416504
sim_compute_performance-ego_max	0.004188530868099582
sim_compute_performance-ego_mean	0.004011100239010268
sim_compute_performance-ego_median	0.003960676590601604
sim_compute_performance-ego_min	0.0039345169067382816
sim_compute_sim_state_max	0.02704732100168864
sim_compute_sim_state_mean	0.024848605189272153
sim_compute_sim_state_median	0.024392315944035847
sim_compute_sim_state_min	0.023562467867328275
sim_render-ego_max	0.0062145100485893985
sim_render-ego_mean	0.006002006392966034
sim_render-ego_median	0.005935572783152262
sim_render-ego_min	0.005922369956970215
simulation-passed	1
step_physics_max	0.08540250142415365
step_physics_mean	0.0818320074965877
step_physics_median	0.0815752286295737
step_physics_min	0.07877507130304973
survival_time_max	14.950000000000076
survival_time_mean	14.312500000000068
survival_time_min	12.40000000000004

No reset possible

42783

11537

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-24 23:06:57+00:00

2020-11-24 23:16:03+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.473236296304445
survival_time_median	14.950000000000076
deviation-center-line_median	0.7334274801562506
in-drivable-lane_median	2.000000000000008

other stats

agent_compute-ego_max	0.01800489823023478
agent_compute-ego_mean	0.017405098676681517
agent_compute-ego_median	0.01728421727816264
agent_compute-ego_min	0.017047061920166015
complete-iteration_max	0.2055431127548218
complete-iteration_mean	0.1994312318166097
complete-iteration_median	0.2002181037267049
complete-iteration_min	0.1917456070582072
deviation-center-line_max	0.8955831949350219
deviation-center-line_mean	0.671858774184249
deviation-center-line_min	0.3249969414894729
deviation-heading_max	4.005661739348484
deviation-heading_mean	2.8379311624758214
deviation-heading_median	2.7544295551098448
deviation-heading_min	1.8372038003351117
driven_any_max	3.0630360575893163
driven_any_mean	3.0605023824765873
driven_any_median	3.062942271003746
driven_any_min	3.0530889303095408
driven_lanedir_consec_max	2.7839437643622977
driven_lanedir_consec_mean	2.4289334594313363
driven_lanedir_consec_min	1.9853174807541576
driven_lanedir_max	2.7839437643622977
driven_lanedir_mean	2.4289334594313363
driven_lanedir_median	2.473236296304445
driven_lanedir_min	1.9853174807541576
get_duckie_state_max	3.759066263834635e-06
get_duckie_state_mean	3.654956817626953e-06
get_duckie_state_median	3.6299228668212894e-06
get_duckie_state_min	3.600915273030599e-06
get_robot_state_max	0.015540902614593503
get_robot_state_mean	0.014825125535329182
get_robot_state_median	0.014807196855545044
get_robot_state_min	0.014145205815633138
get_state_dump_max	0.013444703420003257
get_state_dump_mean	0.013337626059850055
get_state_dump_median	0.013355527321497598
get_state_dump_min	0.013194746176401774
get_ui_image_max	0.03544964869817098
get_ui_image_mean	0.03457009633382162
get_ui_image_median	0.03459066390991211
get_ui_image_min	0.03364940881729126
in-drivable-lane_max	4.7500000000000675
in-drivable-lane_mean	2.4125000000000236
in-drivable-lane_min	0.900000000000011
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0530889303095408, "get_ui_image": 0.03364940881729126, "step_physics": 0.07449424743652344, "survival_time": 14.950000000000076, "driven_lanedir": 2.7839437643622977, "get_state_dump": 0.013194746176401774, "sim_render-ego": 0.005855074723561605, "get_robot_state": 0.014850102265675862, "get_duckie_state": 3.600915273030599e-06, "in-drivable-lane": 0.900000000000011, "agent_compute-ego": 0.017047061920166015, "deviation-heading": 2.3309669504873964, "complete-iteration": 0.1917456070582072, "set_robot_commands": 0.004749892552693685, "deviation-center-line": 0.8528918353144349, "driven_lanedir_consec": 2.7839437643622977, "sim_compute_sim_state": 0.023851331075032553, "sim_compute_performance-ego": 0.0039067490895589195}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.062983775350943, "get_ui_image": 0.034523906707763674, "step_physics": 0.07726520379384359, "survival_time": 14.950000000000076, "driven_lanedir": 2.6207169220864897, "get_state_dump": 0.013413017590840655, "sim_render-ego": 0.005894393126169841, "get_robot_state": 0.014764291445414223, "get_duckie_state": 3.6207834879557298e-06, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.01713407834370931, "deviation-heading": 3.177892159732293, "complete-iteration": 0.19519524494806925, "set_robot_commands": 0.004642438093821207, "deviation-center-line": 0.6139631249980664, "driven_lanedir_consec": 2.6207169220864897, "sim_compute_sim_state": 0.02343139171600342, "sim_compute_performance-ego": 0.003977726300557455}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.062900766656549, "get_ui_image": 0.03544964869817098, "step_physics": 0.08363318284352621, "survival_time": 14.950000000000076, "driven_lanedir": 2.3257556705224003, "get_state_dump": 0.013298037052154542, "sim_render-ego": 0.00617311954498291, "get_robot_state": 0.015540902614593503, "get_duckie_state": 3.759066263834635e-06, "in-drivable-lane": 2.4499999999999944, "agent_compute-ego": 0.017434356212615968, "deviation-heading": 4.005661739348484, "complete-iteration": 0.20524096250534055, "set_robot_commands": 0.004809748331705729, "deviation-center-line": 0.8955831949350219, "driven_lanedir_consec": 2.3257556705224003, "sim_compute_sim_state": 0.024652052720387774, "sim_compute_performance-ego": 0.004087103207906087}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0630360575893163, "get_ui_image": 0.03465742111206055, "step_physics": 0.08368197202682495, "survival_time": 14.950000000000076, "driven_lanedir": 1.9853174807541576, "get_state_dump": 0.013444703420003257, "sim_render-ego": 0.005798228581746419, "get_robot_state": 0.014145205815633138, "get_duckie_state": 3.639062245686849e-06, "in-drivable-lane": 4.7500000000000675, "agent_compute-ego": 0.01800489823023478, "deviation-heading": 1.8372038003351117, "complete-iteration": 0.2055431127548218, "set_robot_commands": 0.004575397173563639, "deviation-center-line": 0.3249969414894729, "driven_lanedir_consec": 1.9853174807541576, "sim_compute_sim_state": 0.02717215061187744, "sim_compute_performance-ego": 0.003911215464274089}}
set_robot_commands_max	0.004809748331705729
set_robot_commands_mean	0.004694369037946065
set_robot_commands_median	0.0046961653232574455
set_robot_commands_min	0.004575397173563639
sim_compute_performance-ego_max	0.004087103207906087
sim_compute_performance-ego_mean	0.003970698515574137
sim_compute_performance-ego_median	0.003944470882415772
sim_compute_performance-ego_min	0.0039067490895589195
sim_compute_sim_state_max	0.02717215061187744
sim_compute_sim_state_mean	0.024776731530825297
sim_compute_sim_state_median	0.024251691897710165
sim_compute_sim_state_min	0.02343139171600342
sim_render-ego_max	0.00617311954498291
sim_render-ego_mean	0.005930203994115193
sim_render-ego_median	0.005874733924865722
sim_render-ego_min	0.005798228581746419
simulation-passed	1
step_physics_max	0.08368197202682495
step_physics_mean	0.07976865152517956
step_physics_median	0.0804491933186849
step_physics_min	0.07449424743652344
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42777

11535

exercise_state_estimation

LFv-sim

success

2020-11-24 22:28:57+00:00

2020-11-24 22:37:06+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5164701010931076
survival_time_median	14.950000000000076
deviation-center-line_median	0.6906158188613678
in-drivable-lane_median	0.975000000000014

other stats

agent_compute-ego_max	0.017582400639851888
agent_compute-ego_mean	0.01670185148715973
agent_compute-ego_median	0.016461981534957884
agent_compute-ego_min	0.016301042238871258
complete-iteration_max	0.1848749057451884
complete-iteration_mean	0.18191230018933613
complete-iteration_median	0.1822657811641693
complete-iteration_min	0.17824273268381757
deviation-center-line_max	0.8971538124860617
deviation-center-line_mean	0.5925357053500464
deviation-center-line_min	0.09175737119138808
deviation-heading_max	2.8955070325268717
deviation-heading_mean	2.1943644353298635
deviation-heading_median	2.2340816654750304
deviation-heading_min	1.4137873778425205
driven_any_max	1.939934481082244
driven_any_mean	1.93832427678944
driven_any_median	1.939911823653099
driven_any_min	1.933538978769319
driven_lanedir_consec_max	1.8549379254356364
driven_lanedir_consec_mean	1.336840685435475
driven_lanedir_consec_min	0.4594846141200488
driven_lanedir_max	1.8549379254356364
driven_lanedir_mean	1.4523893474490834
driven_lanedir_median	1.7475674251203244
driven_lanedir_min	0.4594846141200488
get_duckie_state_max	2.463658650716146e-06
get_duckie_state_mean	2.2260348002115884e-06
get_duckie_state_median	2.2415320078531903e-06
get_duckie_state_min	1.9574165344238283e-06
get_robot_state_max	0.013079234759012858
get_robot_state_mean	0.012373783588409425
get_robot_state_median	0.012518381277720134
get_robot_state_min	0.01137913703918457
get_state_dump_max	0.012841316064198811
get_state_dump_mean	0.012526859641075134
get_state_dump_median	0.012603236834208172
get_state_dump_min	0.012059648831685385
get_ui_image_max	0.0326378067334493
get_ui_image_mean	0.03239009122053782
get_ui_image_median	0.03235989729563395
get_ui_image_min	0.03220276355743408
in-drivable-lane_max	10.700000000000085
in-drivable-lane_mean	3.2500000000000293
in-drivable-lane_min	0.350000000000005
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933538978769319, "get_ui_image": 0.03241047779719035, "step_physics": 0.07257061163584391, "survival_time": 14.950000000000076, "driven_lanedir": 1.662970696716553, "get_state_dump": 0.012841316064198811, "sim_render-ego": 0.005500041643778483, "get_robot_state": 0.0130648938814799, "get_duckie_state": 2.463658650716146e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.016441961129506428, "deviation-heading": 2.8955070325268717, "complete-iteration": 0.18289692640304567, "set_robot_commands": 0.004381863276163737, "deviation-center-line": 0.7008429620945884, "driven_lanedir_consec": 1.2007760486621193, "sim_compute_sim_state": 0.021883230209350586, "sim_compute_performance-ego": 0.003667302131652832}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399086333884736, "get_ui_image": 0.03230931679407756, "step_physics": 0.06891883691151937, "survival_time": 14.950000000000076, "driven_lanedir": 1.832164153524096, "get_state_dump": 0.01282169262568156, "sim_render-ego": 0.005448014736175537, "get_robot_state": 0.013079234759012858, "get_duckie_state": 2.2459030151367187e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.016482001940409344, "deviation-heading": 2.5308008167335343, "complete-iteration": 0.17824273268381757, "set_robot_commands": 0.004375902016957601, "deviation-center-line": 0.8971538124860617, "driven_lanedir_consec": 1.832164153524096, "sim_compute_sim_state": 0.02103730916976929, "sim_compute_performance-ego": 0.003633224964141846}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399150139177244, "get_ui_image": 0.03220276355743408, "step_physics": 0.0733815352121989, "survival_time": 14.950000000000076, "driven_lanedir": 0.4594846141200488, "get_state_dump": 0.012384781042734782, "sim_render-ego": 0.005262680053710937, "get_robot_state": 0.011971868673960369, "get_duckie_state": 2.2371610005696613e-06, "in-drivable-lane": 10.700000000000085, "agent_compute-ego": 0.017582400639851888, "deviation-heading": 1.4137873778425205, "complete-iteration": 0.18163463592529297, "set_robot_commands": 0.004320785204569499, "deviation-center-line": 0.09175737119138808, "driven_lanedir_consec": 0.4594846141200488, "sim_compute_sim_state": 0.020914429823557536, "sim_compute_performance-ego": 0.0034812466303507485}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939934481082244, "get_ui_image": 0.0326378067334493, "step_physics": 0.07681843996047974, "survival_time": 14.950000000000076, "driven_lanedir": 1.8549379254356364, "get_state_dump": 0.012059648831685385, "sim_render-ego": 0.0049296927452087405, "get_robot_state": 0.01137913703918457, "get_duckie_state": 1.9574165344238283e-06, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.016301042238871258, "deviation-heading": 1.937362514216527, "complete-iteration": 0.1848749057451884, "set_robot_commands": 0.00432121992111206, "deviation-center-line": 0.6803886756281473, "driven_lanedir_consec": 1.8549379254356364, "sim_compute_sim_state": 0.022970445156097412, "sim_compute_performance-ego": 0.0033335574467976887}}
set_robot_commands_max	0.004381863276163737
set_robot_commands_mean	0.004349942604700724
set_robot_commands_median	0.004348560969034831
set_robot_commands_min	0.004320785204569499
sim_compute_performance-ego_max	0.003667302131652832
sim_compute_performance-ego_mean	0.0035288327932357787
sim_compute_performance-ego_median	0.003557235797246298
sim_compute_performance-ego_min	0.0033335574467976887
sim_compute_sim_state_max	0.022970445156097412
sim_compute_sim_state_mean	0.021701353589693703
sim_compute_sim_state_median	0.021460269689559937
sim_compute_sim_state_min	0.020914429823557536
sim_render-ego_max	0.005500041643778483
sim_render-ego_mean	0.005285107294718425
sim_render-ego_median	0.005355347394943238
sim_render-ego_min	0.0049296927452087405
simulation-passed	1
step_physics_max	0.07681843996047974
step_physics_mean	0.07292235593001048
step_physics_median	0.0729760734240214
step_physics_min	0.06891883691151937
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42758

11529

sim-exercise-2

LFv-sim

success

2020-11-24 21:08:18+00:00

2020-11-24 21:16:32+00:00

0:08:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.232333772904772
survival_time_median	14.950000000000076
deviation-center-line_median	0.8010603473935355
in-drivable-lane_median	1.625000000000023

other stats

agent_compute-ego_max	0.017298092047373453
agent_compute-ego_mean	0.017096257011095684
agent_compute-ego_median	0.01723358631134033
agent_compute-ego_min	0.016619763374328612
complete-iteration_max	0.1886718002955119
complete-iteration_mean	0.17687116165955863
complete-iteration_median	0.17369110743204752
complete-iteration_min	0.17143063147862753
deviation-center-line_max	1.1760359931484232
deviation-center-line_mean	0.8047889811534368
deviation-center-line_min	0.4409992366782529
deviation-heading_max	3.789391241022719
deviation-heading_mean	2.0598503487148845
deviation-heading_median	1.6901928509628896
deviation-heading_min	1.0696244519110405
driven_any_max	2.5525932370990216
driven_any_mean	2.550490217392993
driven_any_median	2.552548036332118
driven_any_min	2.544271559808714
driven_lanedir_consec_max	2.415438725383586
driven_lanedir_consec_mean	2.2198563896317154
driven_lanedir_consec_min	1.9993192873337324
driven_lanedir_max	2.415438725383586
driven_lanedir_mean	2.2198563896317154
driven_lanedir_median	2.232333772904772
driven_lanedir_min	1.9993192873337324
get_duckie_state_max	2.2991498311360675e-06
get_duckie_state_mean	2.038280169169108e-06
get_duckie_state_median	1.9713242848714195e-06
get_duckie_state_min	1.9113222757975262e-06
get_robot_state_max	0.011526302496592204
get_robot_state_mean	0.01143173098564148
get_robot_state_median	0.011455403566360474
get_robot_state_min	0.011289814313252766
get_state_dump_max	0.011913004716237388
get_state_dump_mean	0.011878801981608072
get_state_dump_median	0.011876329580942788
get_state_dump_min	0.011849544048309324
get_ui_image_max	0.03336848735809326
get_ui_image_mean	0.03215580860773722
get_ui_image_median	0.03190394202868144
get_ui_image_min	0.03144686301549276
in-drivable-lane_max	3.0500000000000433
in-drivable-lane_mean	1.5750000000000224
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.544271559808714, "get_ui_image": 0.03144686301549276, "step_physics": 0.06603942394256591, "survival_time": 14.950000000000076, "driven_lanedir": 2.2189907421028425, "get_state_dump": 0.011849544048309324, "sim_render-ego": 0.0050278393427530925, "get_robot_state": 0.011526302496592204, "get_duckie_state": 2.2991498311360675e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.016619763374328612, "deviation-heading": 1.6270883294789578, "complete-iteration": 0.17143063147862753, "set_robot_commands": 0.004419029553731283, "deviation-center-line": 0.8863458952237149, "driven_lanedir_consec": 2.2189907421028425, "sim_compute_sim_state": 0.0209906530380249, "sim_compute_performance-ego": 0.003381037712097168}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.5525932370990216, "get_ui_image": 0.03167729298273722, "step_physics": 0.06660749514897664, "survival_time": 14.950000000000076, "driven_lanedir": 2.245676803706701, "get_state_dump": 0.011913004716237388, "sim_render-ego": 0.005015108585357666, "get_robot_state": 0.011289814313252766, "get_duckie_state": 1.9113222757975262e-06, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.017298092047373453, "deviation-heading": 1.7532973724468215, "complete-iteration": 0.17168371280034384, "set_robot_commands": 0.00431132157643636, "deviation-center-line": 0.7157747995633561, "driven_lanedir_consec": 2.245676803706701, "sim_compute_sim_state": 0.020092012882232665, "sim_compute_performance-ego": 0.0033530950546264648}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5525349173120593, "get_ui_image": 0.03213059107462565, "step_physics": 0.0690358058611552, "survival_time": 14.950000000000076, "driven_lanedir": 2.415438725383586, "get_state_dump": 0.011861101786295573, "sim_render-ego": 0.004941063721974691, "get_robot_state": 0.011502890586853028, "get_duckie_state": 1.9884109497070312e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017222917874654135, "deviation-heading": 3.789391241022719, "complete-iteration": 0.17569850206375123, "set_robot_commands": 0.00458708922068278, "deviation-center-line": 1.1760359931484232, "driven_lanedir_consec": 2.415438725383586, "sim_compute_sim_state": 0.02089914957682292, "sim_compute_performance-ego": 0.0033883301417032877}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.5525611553521768, "get_ui_image": 0.03336848735809326, "step_physics": 0.07857558091481527, "survival_time": 14.950000000000076, "driven_lanedir": 1.9993192873337324, "get_state_dump": 0.011891557375590006, "sim_render-ego": 0.004948198000590006, "get_robot_state": 0.01140791654586792, "get_duckie_state": 1.954237620035807e-06, "in-drivable-lane": 3.0500000000000433, "agent_compute-ego": 0.01724425474802653, "deviation-heading": 1.0696244519110405, "complete-iteration": 0.1886718002955119, "set_robot_commands": 0.004426338672637939, "deviation-center-line": 0.4409992366782529, "driven_lanedir_consec": 1.9993192873337324, "sim_compute_sim_state": 0.023355932235717775, "sim_compute_performance-ego": 0.0033259256680806476}}
set_robot_commands_max	0.00458708922068278
set_robot_commands_mean	0.0044359447558720904
set_robot_commands_median	0.004422684113184611
set_robot_commands_min	0.00431132157643636
sim_compute_performance-ego_max	0.0033883301417032877
sim_compute_performance-ego_mean	0.0033620971441268924
sim_compute_performance-ego_median	0.0033670663833618164
sim_compute_performance-ego_min	0.0033259256680806476
sim_compute_sim_state_max	0.023355932235717775
sim_compute_sim_state_mean	0.021334436933199565
sim_compute_sim_state_median	0.020944901307423908
sim_compute_sim_state_min	0.020092012882232665
sim_render-ego_max	0.0050278393427530925
sim_render-ego_mean	0.004983052412668864
sim_render-ego_median	0.004981653292973836
sim_render-ego_min	0.004941063721974691
simulation-passed	1
step_physics_max	0.07857558091481527
step_physics_mean	0.07006457646687825
step_physics_median	0.06782165050506592
step_physics_min	0.06603942394256591
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42745

11526

exercise_state_estimation

LFv-sim

success

2020-11-24 18:31:38+00:00

2020-11-24 18:39:59+00:00

0:08:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.781474270444275
survival_time_median	14.950000000000076
deviation-center-line_median	0.6526719823032539
in-drivable-lane_median	3.925000000000039

other stats

agent_compute-ego_max	0.017127042611440022
agent_compute-ego_mean	0.016861056089401243
agent_compute-ego_median	0.01684730569521586
agent_compute-ego_min	0.016622570355733234
complete-iteration_max	0.19495457887649537
complete-iteration_mean	0.18607837776343028
complete-iteration_median	0.1854338939984639
complete-iteration_min	0.17849114418029785
deviation-center-line_max	0.9163346425805324
deviation-center-line_mean	0.6315615139068008
deviation-center-line_min	0.30456744844016337
deviation-heading_max	5.811226935345423
deviation-heading_mean	4.302264850413106
deviation-heading_median	4.286492910257577
deviation-heading_min	2.824846645791846
driven_any_max	1.9399153231800204
driven_any_mean	1.934714757079255
driven_any_median	1.9394169980535456
driven_any_min	1.9201097090299095
driven_lanedir_consec_max	1.6701765748127146
driven_lanedir_consec_mean	0.8375614194804841
driven_lanedir_consec_min	0.11712056222067169
driven_lanedir_max	1.6746506506195802
driven_lanedir_mean	1.0420149707991313
driven_lanedir_median	1.1205079991380376
driven_lanedir_min	0.2523932343008699
get_duckie_state_max	2.315839131673177e-06
get_duckie_state_mean	2.283255259195963e-06
get_duckie_state_median	2.2951761881510417e-06
get_duckie_state_min	2.2268295288085937e-06
get_robot_state_max	0.013195195198059085
get_robot_state_mean	0.012860230803489688
get_robot_state_median	0.012803746859232586
get_robot_state_min	0.012638234297434488
get_state_dump_max	0.012941196759541827
get_state_dump_mean	0.01271383802096049
get_state_dump_median	0.012685826222101848
get_state_dump_min	0.012542502880096435
get_ui_image_max	0.03387522141138712
get_ui_image_mean	0.033283673127492266
get_ui_image_median	0.03346801082293192
get_ui_image_min	0.032323449452718096
in-drivable-lane_max	10.900000000000086
in-drivable-lane_mean	5.050000000000046
in-drivable-lane_min	1.4500000000000206
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9201097090299095, "get_ui_image": 0.032323449452718096, "step_physics": 0.06946282545725505, "survival_time": 14.950000000000076, "driven_lanedir": 1.4688960645392977, "get_state_dump": 0.01277098576227824, "sim_render-ego": 0.005304957230885823, "get_robot_state": 0.01266568660736084, "get_duckie_state": 2.3134549458821614e-06, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.016622570355733234, "deviation-heading": 4.909259323514178, "complete-iteration": 0.17849114418029785, "set_robot_commands": 0.004465039571126302, "deviation-center-line": 0.8073215790221266, "driven_lanedir_consec": 1.1444978770821654, "sim_compute_sim_state": 0.021189348697662355, "sim_compute_performance-ego": 0.0035418200492858885}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.939163642619797, "get_ui_image": 0.03314720869064331, "step_physics": 0.07279803117116292, "survival_time": 14.950000000000076, "driven_lanedir": 0.7721199337367772, "get_state_dump": 0.012542502880096435, "sim_render-ego": 0.005369992256164551, "get_robot_state": 0.012638234297434488, "get_duckie_state": 2.315839131673177e-06, "in-drivable-lane": 6.300000000000056, "agent_compute-ego": 0.016988141536712645, "deviation-heading": 5.811226935345423, "complete-iteration": 0.18145299673080445, "set_robot_commands": 0.004461564222971598, "deviation-center-line": 0.9163346425805324, "driven_lanedir_consec": 0.4184506638063845, "sim_compute_sim_state": 0.01977929910024007, "sim_compute_performance-ego": 0.0035805567105611164}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9396703534872943, "get_ui_image": 0.03387522141138712, "step_physics": 0.07809951543807983, "survival_time": 14.950000000000076, "driven_lanedir": 0.2523932343008699, "get_state_dump": 0.012600666681925455, "sim_render-ego": 0.00547863245010376, "get_robot_state": 0.01294180711110433, "get_duckie_state": 2.2268295288085937e-06, "in-drivable-lane": 10.900000000000086, "agent_compute-ego": 0.017127042611440022, "deviation-heading": 3.663726497000976, "complete-iteration": 0.18941479126612343, "set_robot_commands": 0.004414920806884766, "deviation-center-line": 0.30456744844016337, "driven_lanedir_consec": 0.11712056222067169, "sim_compute_sim_state": 0.0210850993792216, "sim_compute_performance-ego": 0.0036349876721700034}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399153231800204, "get_ui_image": 0.03378881295522054, "step_physics": 0.0801658805211385, "survival_time": 14.950000000000076, "driven_lanedir": 1.6746506506195802, "get_state_dump": 0.012941196759541827, "sim_render-ego": 0.005340028603871664, "get_robot_state": 0.013195195198059085, "get_duckie_state": 2.276897430419922e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.016706469853719076, "deviation-heading": 2.824846645791846, "complete-iteration": 0.19495457887649537, "set_robot_commands": 0.004441252549489339, "deviation-center-line": 0.49802238558438094, "driven_lanedir_consec": 1.6701765748127146, "sim_compute_sim_state": 0.02455507198969523, "sim_compute_performance-ego": 0.003664639790852865}}
set_robot_commands_max	0.004465039571126302
set_robot_commands_mean	0.0044456942876180015
set_robot_commands_median	0.004451408386230468
set_robot_commands_min	0.004414920806884766
sim_compute_performance-ego_max	0.003664639790852865
sim_compute_performance-ego_mean	0.003605501055717468
sim_compute_performance-ego_median	0.00360777219136556
sim_compute_performance-ego_min	0.0035418200492858885
sim_compute_sim_state_max	0.02455507198969523
sim_compute_sim_state_mean	0.02165220479170481
sim_compute_sim_state_median	0.021137224038441975
sim_compute_sim_state_min	0.01977929910024007
sim_render-ego_max	0.00547863245010376
sim_render-ego_mean	0.00537340263525645
sim_render-ego_median	0.005355010430018107
sim_render-ego_min	0.005304957230885823
simulation-passed	1
step_physics_max	0.0801658805211385
step_physics_mean	0.07513156314690908
step_physics_median	0.07544877330462138
step_physics_min	0.06946282545725505
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42736

11521

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-24 17:45:33+00:00

2020-11-24 17:54:19+00:00

0:08:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.5815799690681764
survival_time_median	14.950000000000076
deviation-center-line_median	1.0615609611000618
in-drivable-lane_median	1.7500000000000036

other stats

agent_compute-ego_max	0.017064024607340494
agent_compute-ego_mean	0.016920332377800204
agent_compute-ego_median	0.016933093996145038
agent_compute-ego_min	0.016751116911570232
complete-iteration_max	0.21481815276255137
complete-iteration_mean	0.2024461609564968
complete-iteration_median	0.19919856429100036
complete-iteration_min	0.1965693624814351
deviation-center-line_max	1.2102105819439646
deviation-center-line_mean	1.064026642102721
deviation-center-line_min	0.9227740642667944
deviation-heading_max	4.702754654903184
deviation-heading_mean	3.7490581542836425
deviation-heading_median	3.610824479142922
deviation-heading_min	3.0718290039455405
driven_any_max	3.5734682803766025
driven_any_mean	3.4573317319205623
driven_any_median	3.5675002384053087
driven_any_min	3.1208581704950293
driven_lanedir_consec_max	3.1497987943296657
driven_lanedir_consec_mean	2.6086460319077065
driven_lanedir_consec_min	2.1216253951648074
driven_lanedir_max	3.1497987943296657
driven_lanedir_mean	2.7200606365258464
driven_lanedir_median	2.7097865278091233
driven_lanedir_min	2.3108706961554715
get_duckie_state_max	2.795855204264323e-06
get_duckie_state_mean	2.649356694015231e-06
get_duckie_state_median	2.647498788421087e-06
get_duckie_state_min	2.506573994954427e-06
get_robot_state_max	0.015612006187438965
get_robot_state_mean	0.01521640779256214
get_robot_state_median	0.015374538534470189
get_robot_state_min	0.01450454791386922
get_state_dump_max	0.013552288972694455
get_state_dump_mean	0.013411813766598396
get_state_dump_median	0.013460516134897868
get_state_dump_min	0.0131739338239034
get_ui_image_max	0.036783010905025566
get_ui_image_mean	0.035349218036988914
get_ui_image_median	0.0350448215007782
get_ui_image_min	0.0345242182413737
in-drivable-lane_max	3.850000000000027
in-drivable-lane_mean	2.125000000000009
in-drivable-lane_min	1.1500000000000024
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.56183667785338, "get_ui_image": 0.034802717367808024, "step_physics": 0.07818057219187419, "survival_time": 14.950000000000076, "driven_lanedir": 2.9494950010302103, "get_state_dump": 0.0131739338239034, "sim_render-ego": 0.005932590166727702, "get_robot_state": 0.01518263339996338, "get_duckie_state": 2.5804837544759117e-06, "in-drivable-lane": 1.9500000000000108, "agent_compute-ego": 0.017064024607340494, "deviation-heading": 3.0718290039455405, "complete-iteration": 0.19762553373972577, "set_robot_commands": 0.004817659854888916, "deviation-center-line": 0.9227740642667944, "driven_lanedir_consec": 2.9494950010302103, "sim_compute_sim_state": 0.024364277521769204, "sim_compute_performance-ego": 0.003966316382090251}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5734682803766025, "get_ui_image": 0.03528692563374837, "step_physics": 0.0805133851369222, "survival_time": 14.950000000000076, "driven_lanedir": 3.1497987943296657, "get_state_dump": 0.01348501205444336, "sim_render-ego": 0.006156914234161377, "get_robot_state": 0.015612006187438965, "get_duckie_state": 2.795855204264323e-06, "in-drivable-lane": 1.1500000000000024, "agent_compute-ego": 0.016751116911570232, "deviation-heading": 3.1970773505554857, "complete-iteration": 0.200771594842275, "set_robot_commands": 0.004768020311991374, "deviation-center-line": 1.2102105819439646, "driven_lanedir_consec": 3.1497987943296657, "sim_compute_sim_state": 0.023972068627675373, "sim_compute_performance-ego": 0.004080062707265218}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.1208581704950293, "get_ui_image": 0.036783010905025566, "step_physics": 0.09262798487685107, "survival_time": 13.100000000000051, "driven_lanedir": 2.4700780545880363, "get_state_dump": 0.013552288972694455, "sim_render-ego": 0.006244420095254446, "get_robot_state": 0.015566443668976996, "get_duckie_state": 2.714513822366263e-06, "in-drivable-lane": 1.5499999999999965, "agent_compute-ego": 0.016912060839529255, "deviation-heading": 4.024571607730358, "complete-iteration": 0.21481815276255137, "set_robot_commands": 0.0048558657405940635, "deviation-center-line": 1.116158221856483, "driven_lanedir_consec": 2.2136649371061425, "sim_compute_sim_state": 0.02398485263795343, "sim_compute_performance-ego": 0.004139127622123893}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5731637989572373, "get_ui_image": 0.0345242182413737, "step_physics": 0.07922076145807902, "survival_time": 14.950000000000076, "driven_lanedir": 2.3108706961554715, "get_state_dump": 0.013436020215352376, "sim_render-ego": 0.005702955722808838, "get_robot_state": 0.01450454791386922, "get_duckie_state": 2.506573994954427e-06, "in-drivable-lane": 3.850000000000027, "agent_compute-ego": 0.016954127152760824, "deviation-heading": 4.702754654903184, "complete-iteration": 0.1965693624814351, "set_robot_commands": 0.0046033310890197755, "deviation-center-line": 1.0069637003436405, "driven_lanedir_consec": 2.1216253951648074, "sim_compute_sim_state": 0.02363608280817668, "sim_compute_performance-ego": 0.0038458649317423504}}
set_robot_commands_max	0.0048558657405940635
set_robot_commands_mean	0.004761219249123532
set_robot_commands_median	0.004792840083440145
set_robot_commands_min	0.0046033310890197755
sim_compute_performance-ego_max	0.004139127622123893
sim_compute_performance-ego_mean	0.004007842910805429
sim_compute_performance-ego_median	0.004023189544677735
sim_compute_performance-ego_min	0.0038458649317423504
sim_compute_sim_state_max	0.024364277521769204
sim_compute_sim_state_mean	0.023989320398893673
sim_compute_sim_state_median	0.0239784606328144
sim_compute_sim_state_min	0.02363608280817668
sim_render-ego_max	0.006244420095254446
sim_render-ego_mean	0.006009220054738092
sim_render-ego_median	0.00604475220044454
sim_render-ego_min	0.005702955722808838
simulation-passed	1
step_physics_max	0.09262798487685107
step_physics_mean	0.08263567591593163
step_physics_median	0.07986707329750062
step_physics_min	0.07818057219187419
survival_time_max	14.950000000000076
survival_time_mean	14.487500000000072
survival_time_min	13.100000000000051

No reset possible

42724

11519

sim-exercise-2

LFv-sim

error

2020-11-24 17:32:01+00:00

2020-11-24 17:39:03+00:00

0:07:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42705

11512

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-24 16:10:17+00:00

2020-11-24 16:17:01+00:00

0:06:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8157091186701246
survival_time_median	14.950000000000076
deviation-center-line_median	0.30925262404979836
in-drivable-lane_median	4.875000000000018

other stats

agent_compute-ego_max	0.01744030714035034
agent_compute-ego_mean	0.016877680931005393
agent_compute-ego_median	0.016827542384465537
agent_compute-ego_min	0.016415331814740156
complete-iteration_max	0.18324320634206137
complete-iteration_mean	0.17394894377605336
complete-iteration_median	0.17234976132710775
complete-iteration_min	0.16785304610793655
deviation-center-line_max	0.696396524628561
deviation-center-line_mean	0.34528404433933396
deviation-center-line_min	0.06623440462917785
deviation-heading_max	3.563092575509027
deviation-heading_mean	1.9299154691713585
deviation-heading_median	1.7742411722916338
deviation-heading_min	0.6080869565931392
driven_any_max	5.101573835597889
driven_any_mean	3.95317244211832
driven_any_median	5.093534646344779
driven_any_min	0.5240466401858359
driven_lanedir_consec_max	4.304712627124783
driven_lanedir_consec_mean	1.518234763618049
driven_lanedir_consec_min	0.1368081900071647
driven_lanedir_max	4.304712627124783
driven_lanedir_mean	1.6673302602845803
driven_lanedir_median	1.1106500524117355
driven_lanedir_min	0.1433083091900671
get_duckie_state_max	3.5309791564941407e-06
get_duckie_state_mean	3.3682423668938713e-06
get_duckie_state_median	3.33941734588898e-06
get_duckie_state_min	3.2631556193033856e-06
get_robot_state_max	0.01180303970972697
get_robot_state_mean	0.011393595370086464
get_robot_state_median	0.011501042048136394
get_robot_state_min	0.0107692576743461
get_state_dump_max	0.012194077173868816
get_state_dump_mean	0.011715440637356526
get_state_dump_median	0.011888111035029094
get_state_dump_min	0.010891463305499102
get_ui_image_max	0.032667006651560464
get_ui_image_mean	0.03175012296384519
get_ui_image_median	0.03148779563001684
get_ui_image_min	0.03135789394378662
in-drivable-lane_max	13.45000000000007
in-drivable-lane_mean	6.000000000000027
in-drivable-lane_min	0.8000000000000006
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.088111742648983, "get_ui_image": 0.03138481378555298, "step_physics": 0.06620668570200602, "survival_time": 14.950000000000076, "driven_lanedir": 4.304712627124783, "get_state_dump": 0.012194077173868816, "sim_render-ego": 0.005070919990539551, "get_robot_state": 0.01180303970972697, "get_duckie_state": 3.5309791564941407e-06, "in-drivable-lane": 1.5000000000000098, "agent_compute-ego": 0.01666993776957194, "deviation-heading": 3.563092575509027, "complete-iteration": 0.17306364059448243, "set_robot_commands": 0.0045032127698262535, "deviation-center-line": 0.696396524628561, "driven_lanedir_consec": 4.304712627124783, "sim_compute_sim_state": 0.021686456203460693, "sim_compute_performance-ego": 0.00341171662012736}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.098957550040575, "get_ui_image": 0.03135789394378662, "step_physics": 0.06595657904942831, "survival_time": 14.950000000000076, "driven_lanedir": 1.8882909623017308, "get_state_dump": 0.011914929548899332, "sim_render-ego": 0.004965506394704183, "get_robot_state": 0.01151528835296631, "get_duckie_state": 3.4054120381673177e-06, "in-drivable-lane": 8.250000000000025, "agent_compute-ego": 0.01698514699935913, "deviation-heading": 2.8904203118674885, "complete-iteration": 0.17163588205973307, "set_robot_commands": 0.004340793291727702, "deviation-center-line": 0.4901581354761662, "driven_lanedir_consec": 1.298409094818509, "sim_compute_sim_state": 0.021127830346425375, "sim_compute_performance-ego": 0.003341406186421712}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.5240466401858359, "get_ui_image": 0.031590777474480705, "step_physics": 0.06611938734312316, "survival_time": 1.850000000000001, "driven_lanedir": 0.1433083091900671, "get_state_dump": 0.010891463305499102, "sim_render-ego": 0.004852327140601906, "get_robot_state": 0.0107692576743461, "get_duckie_state": 3.273422653610642e-06, "in-drivable-lane": 0.8000000000000006, "agent_compute-ego": 0.016415331814740156, "deviation-heading": 0.658062032715779, "complete-iteration": 0.16785304610793655, "set_robot_commands": 0.004423457223015862, "deviation-center-line": 0.06623440462917785, "driven_lanedir_consec": 0.1368081900071647, "sim_compute_sim_state": 0.019329998944256757, "sim_compute_performance-ego": 0.003333697447905669}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.101573835597889, "get_ui_image": 0.032667006651560464, "step_physics": 0.07288780371348064, "survival_time": 14.950000000000076, "driven_lanedir": 0.3330091425217403, "get_state_dump": 0.011861292521158856, "sim_render-ego": 0.005017061233520508, "get_robot_state": 0.011486795743306478, "get_duckie_state": 3.2631556193033856e-06, "in-drivable-lane": 13.45000000000007, "agent_compute-ego": 0.01744030714035034, "deviation-heading": 0.6080869565931392, "complete-iteration": 0.18324320634206137, "set_robot_commands": 0.0043728049596150715, "deviation-center-line": 0.12834711262343051, "driven_lanedir_consec": 0.3330091425217403, "sim_compute_sim_state": 0.024003543059031168, "sim_compute_performance-ego": 0.0033750041325887044}}
set_robot_commands_max	0.0045032127698262535
set_robot_commands_mean	0.004410067061046222
set_robot_commands_median	0.004398131091315467
set_robot_commands_min	0.004340793291727702
sim_compute_performance-ego_max	0.00341171662012736
sim_compute_performance-ego_mean	0.0033654560967608617
sim_compute_performance-ego_median	0.003358205159505208
sim_compute_performance-ego_min	0.003333697447905669
sim_compute_sim_state_max	0.024003543059031168
sim_compute_sim_state_mean	0.021536957138293497
sim_compute_sim_state_median	0.021407143274943034
sim_compute_sim_state_min	0.019329998944256757
sim_render-ego_max	0.005070919990539551
sim_render-ego_mean	0.004976453689841537
sim_render-ego_median	0.004991283814112346
sim_render-ego_min	0.004852327140601906
simulation-passed	1
step_physics_max	0.07288780371348064
step_physics_mean	0.06779261395200953
step_physics_median	0.06616303652256458
step_physics_min	0.06595657904942831
survival_time_max	14.950000000000076
survival_time_mean	11.675000000000058
survival_time_min	1.850000000000001

No reset possible

42695

11508

sim-exercise-2

LFv-sim

error

2020-11-24 15:51:48+00:00

2020-11-24 15:56:33+00:00

0:04:45

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42678

11504

sim-exercise-2

LFv-sim

success

2020-11-24 15:10:43+00:00

2020-11-24 15:18:26+00:00

0:07:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.253141797711947
survival_time_median	14.950000000000076
deviation-center-line_median	0.43885347778291733
in-drivable-lane_median	2.250000000000032

other stats

agent_compute-ego_max	0.016881039142608644
agent_compute-ego_mean	0.016595930886384634
agent_compute-ego_median	0.016511558691660565
agent_compute-ego_min	0.01647956701960877
complete-iteration_max	0.19923330545425416
complete-iteration_mean	0.18897242875284817
complete-iteration_median	0.18616135659589095
complete-iteration_min	0.1843336963653565
deviation-center-line_max	0.7218904354516867
deviation-center-line_mean	0.4570222483484523
deviation-center-line_min	0.22849160237628777
deviation-heading_max	2.052265162540392
deviation-heading_mean	1.40631467523527
deviation-heading_median	1.2951263639251214
deviation-heading_min	0.9827408105504448
driven_any_max	4.0619328644163915
driven_any_mean	3.37918438502109
driven_any_median	3.8094976621945897
driven_any_min	1.8358093512787896
driven_lanedir_consec_max	3.7077784828310487
driven_lanedir_consec_mean	2.719666101755314
driven_lanedir_consec_min	0.6646023287663133
driven_lanedir_max	3.7077784828310487
driven_lanedir_mean	2.7197897337303085
driven_lanedir_median	3.253141797711947
driven_lanedir_min	0.6650968566662897
get_duckie_state_max	2.476374308268229e-06
get_duckie_state_mean	2.456603259065725e-06
get_duckie_state_median	2.4626608892658913e-06
get_duckie_state_min	2.4247169494628906e-06
get_robot_state_max	0.014894285341248896
get_robot_state_mean	0.014541239971952138
get_robot_state_median	0.014646798372268677
get_robot_state_min	0.013977077802022298
get_state_dump_max	0.013260555963446625
get_state_dump_mean	0.013016785557252646
get_state_dump_median	0.012993902762730917
get_state_dump_min	0.012818780740102132
get_ui_image_max	0.0344120979309082
get_ui_image_mean	0.03363480773140334
get_ui_image_median	0.033692102960136396
get_ui_image_min	0.032742927074432375
in-drivable-lane_max	3.4999999999999876
in-drivable-lane_mean	2.375000000000018
in-drivable-lane_min	1.500000000000021
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8326260822789817, "get_ui_image": 0.032742927074432375, "step_physics": 0.07209240118662516, "survival_time": 14.950000000000076, "driven_lanedir": 3.1003282842330093, "get_state_dump": 0.012818780740102132, "sim_render-ego": 0.005534997781117757, "get_robot_state": 0.013977077802022298, "get_duckie_state": 2.4247169494628906e-06, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.016881039142608644, "deviation-heading": 1.1876746523988089, "complete-iteration": 0.1850701864560445, "set_robot_commands": 0.004576079845428467, "deviation-center-line": 0.3213092272342303, "driven_lanedir_consec": 3.1003282842330093, "sim_compute_sim_state": 0.0226141365369161, "sim_compute_performance-ego": 0.003697965939839681}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.786369242110198, "get_ui_image": 0.0329761012395223, "step_physics": 0.07123174508412679, "survival_time": 14.950000000000076, "driven_lanedir": 3.4059553111908856, "get_state_dump": 0.01282645304997762, "sim_render-ego": 0.0056072878837585445, "get_robot_state": 0.01460562229156494, "get_duckie_state": 2.476374308268229e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.016507128874460857, "deviation-heading": 2.052265162540392, "complete-iteration": 0.1843336963653565, "set_robot_commands": 0.004649181365966797, "deviation-center-line": 0.7218904354516867, "driven_lanedir_consec": 3.4059553111908856, "sim_compute_sim_state": 0.022062053680419923, "sim_compute_performance-ego": 0.003735667069753011}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.8358093512787896, "get_ui_image": 0.03440810468075049, "step_physics": 0.07171281584858025, "survival_time": 6.849999999999984, "driven_lanedir": 0.6650968566662897, "get_state_dump": 0.013260555963446625, "sim_render-ego": 0.005833728470071389, "get_robot_state": 0.014894285341248896, "get_duckie_state": 2.471199870979699e-06, "in-drivable-lane": 3.4999999999999876, "agent_compute-ego": 0.01647956701960877, "deviation-heading": 0.9827408105504448, "complete-iteration": 0.18725252673573736, "set_robot_commands": 0.004673917798230248, "deviation-center-line": 0.22849160237628777, "driven_lanedir_consec": 0.6646023287663133, "sim_compute_sim_state": 0.021939192375127415, "sim_compute_performance-ego": 0.003910833901732507}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.0619328644163915, "get_ui_image": 0.0344120979309082, "step_physics": 0.0796717119216919, "survival_time": 14.950000000000076, "driven_lanedir": 3.7077784828310487, "get_state_dump": 0.013161352475484212, "sim_render-ego": 0.0056353203455607095, "get_robot_state": 0.014687974452972413, "get_duckie_state": 2.4541219075520833e-06, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.01651598850886027, "deviation-heading": 1.402578075451434, "complete-iteration": 0.19923330545425416, "set_robot_commands": 0.004678749243418376, "deviation-center-line": 0.5563977283316044, "driven_lanedir_consec": 3.7077784828310487, "sim_compute_sim_state": 0.026516873836517334, "sim_compute_performance-ego": 0.00381077766418457}}
set_robot_commands_max	0.004678749243418376
set_robot_commands_mean	0.004644482063260972
set_robot_commands_median	0.004661549582098523
set_robot_commands_min	0.004576079845428467
sim_compute_performance-ego_max	0.003910833901732507
sim_compute_performance-ego_mean	0.003788811143877442
sim_compute_performance-ego_median	0.0037732223669687905
sim_compute_performance-ego_min	0.003697965939839681
sim_compute_sim_state_max	0.026516873836517334
sim_compute_sim_state_mean	0.023283064107245195
sim_compute_sim_state_median	0.02233809510866801
sim_compute_sim_state_min	0.021939192375127415
sim_render-ego_max	0.005833728470071389
sim_render-ego_mean	0.0056528336201271
sim_render-ego_median	0.005621304114659627
sim_render-ego_min	0.005534997781117757
simulation-passed	1
step_physics_max	0.0796717119216919
step_physics_mean	0.07367716851025602
step_physics_median	0.0719026085176027
step_physics_min	0.07123174508412679
survival_time_max	14.950000000000076
survival_time_mean	12.925000000000054
survival_time_min	6.849999999999984

No reset possible

42669

11501

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-24 10:27:48+00:00

2020-11-24 10:36:19+00:00

0:08:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.519073948156126
survival_time_median	14.950000000000076
deviation-center-line_median	0.6615756264608879
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.017560888131459555
agent_compute-ego_mean	0.01726816614468893
agent_compute-ego_median	0.017239675919214888
agent_compute-ego_min	0.017032424608866375
complete-iteration_max	0.19059559265772505
complete-iteration_mean	0.18297597746054337
complete-iteration_median	0.18089422384897869
complete-iteration_min	0.17951986948649087
deviation-center-line_max	0.7534564067722938
deviation-center-line_mean	0.650952034042928
deviation-center-line_min	0.5272004764776427
deviation-heading_max	3.281924115507923
deviation-heading_mean	2.073740399870539
deviation-heading_median	1.8552828152507237
deviation-heading_min	1.302471853472785
driven_any_max	2.9476119583846914
driven_any_mean	2.685774781398465
driven_any_median	2.776293950773221
driven_any_min	2.242899265662727
driven_lanedir_consec_max	2.93010285092248
driven_lanedir_consec_mean	2.510550148393868
driven_lanedir_consec_min	2.0739498463407404
driven_lanedir_max	2.93010285092248
driven_lanedir_mean	2.510550148393868
driven_lanedir_median	2.519073948156126
driven_lanedir_min	2.0739498463407404
get_duckie_state_max	2.4024645487467447e-06
get_duckie_state_mean	2.3041168848673502e-06
get_duckie_state_median	2.361933390299479e-06
get_duckie_state_min	2.090136210123698e-06
get_robot_state_max	0.012900660037994383
get_robot_state_mean	0.012506593863169352
get_robot_state_median	0.012670674721399945
get_robot_state_min	0.011784365971883138
get_state_dump_max	0.013005282878875733
get_state_dump_mean	0.012662913004557292
get_state_dump_median	0.012687879006067913
get_state_dump_min	0.01227061112721761
get_ui_image_max	0.03291188478469849
get_ui_image_mean	0.03242947936058045
get_ui_image_median	0.03243237853050232
get_ui_image_min	0.031941275596618655
in-drivable-lane_max	4.4000000000000625
in-drivable-lane_mean	1.1000000000000156
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9476119583846914, "get_ui_image": 0.031980446974436444, "step_physics": 0.06946893850962321, "survival_time": 14.950000000000076, "driven_lanedir": 2.93010285092248, "get_state_dump": 0.012831077575683594, "sim_render-ego": 0.0052741750081380205, "get_robot_state": 0.012839970588684082, "get_duckie_state": 2.4024645487467447e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017181479930877687, "deviation-heading": 1.302471853472785, "complete-iteration": 0.17994508743286133, "set_robot_commands": 0.004527460734049479, "deviation-center-line": 0.5272004764776427, "driven_lanedir_consec": 2.93010285092248, "sim_compute_sim_state": 0.0221087376276652, "sim_compute_performance-ego": 0.0035984166463216144}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.898960625360239, "get_ui_image": 0.031941275596618655, "step_physics": 0.06930593331654866, "survival_time": 14.950000000000076, "driven_lanedir": 2.873360443808852, "get_state_dump": 0.013005282878875733, "sim_render-ego": 0.005376534461975098, "get_robot_state": 0.012900660037994383, "get_duckie_state": 2.3277600606282553e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017297871907552085, "deviation-heading": 1.883839659113981, "complete-iteration": 0.17951986948649087, "set_robot_commands": 0.0045089785257975265, "deviation-center-line": 0.5947076305175807, "driven_lanedir_consec": 2.873360443808852, "sim_compute_sim_state": 0.021421868801116944, "sim_compute_performance-ego": 0.0036206587155659994}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.242899265662727, "get_ui_image": 0.03291188478469849, "step_physics": 0.07171208063761393, "survival_time": 14.950000000000076, "driven_lanedir": 2.1647874525034, "get_state_dump": 0.01254468043645223, "sim_render-ego": 0.005246634483337402, "get_robot_state": 0.012501378854115805, "get_duckie_state": 2.3961067199707033e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017032424608866375, "deviation-heading": 3.281924115507923, "complete-iteration": 0.18184336026509604, "set_robot_commands": 0.004546805222829183, "deviation-center-line": 0.728443622404195, "driven_lanedir_consec": 2.1647874525034, "sim_compute_sim_state": 0.021643004417419433, "sim_compute_performance-ego": 0.003567476272583008}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6536272761862025, "get_ui_image": 0.0328843100865682, "step_physics": 0.07929695367813111, "survival_time": 14.950000000000076, "driven_lanedir": 2.0739498463407404, "get_state_dump": 0.01227061112721761, "sim_render-ego": 0.0050896819432576495, "get_robot_state": 0.011784365971883138, "get_duckie_state": 2.090136210123698e-06, "in-drivable-lane": 4.4000000000000625, "agent_compute-ego": 0.017560888131459555, "deviation-heading": 1.8267259713874664, "complete-iteration": 0.19059559265772505, "set_robot_commands": 0.004465689659118652, "deviation-center-line": 0.7534564067722938, "driven_lanedir_consec": 2.0739498463407404, "sim_compute_sim_state": 0.023662316799163818, "sim_compute_performance-ego": 0.003445568084716797}}
set_robot_commands_max	0.004546805222829183
set_robot_commands_mean	0.004512233535448711
set_robot_commands_median	0.004518219629923503
set_robot_commands_min	0.004465689659118652
sim_compute_performance-ego_max	0.0036206587155659994
sim_compute_performance-ego_mean	0.003558029929796855
sim_compute_performance-ego_median	0.0035829464594523113
sim_compute_performance-ego_min	0.003445568084716797
sim_compute_sim_state_max	0.023662316799163818
sim_compute_sim_state_mean	0.02220898191134135
sim_compute_sim_state_median	0.021875871022542317
sim_compute_sim_state_min	0.021421868801116944
sim_render-ego_max	0.005376534461975098
sim_render-ego_mean	0.005246756474177043
sim_render-ego_median	0.005260404745737711
sim_render-ego_min	0.0050896819432576495
simulation-passed	1
step_physics_max	0.07929695367813111
step_physics_mean	0.07244597653547923
step_physics_median	0.07059050957361857
step_physics_min	0.06930593331654866
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42648

11498

sim-exercise-2

LFv-sim

success

2020-11-24 04:50:24+00:00

2020-11-24 04:58:38+00:00

0:08:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.005284759859733
survival_time_median	14.950000000000076
deviation-center-line_median	0.6085478500641552
in-drivable-lane_median	4.07500000000001

other stats

agent_compute-ego_max	0.017410771052042643
agent_compute-ego_mean	0.017216510518341308
agent_compute-ego_median	0.01718934365898181
agent_compute-ego_min	0.017076583703358968
complete-iteration_max	0.20289878924687704
complete-iteration_mean	0.1948458057667293
complete-iteration_median	0.19612017313639324
complete-iteration_min	0.1842440875472537
deviation-center-line_max	0.7976679604614608
deviation-center-line_mean	0.525530857308087
deviation-center-line_min	0.08735976864257669
deviation-heading_max	2.219457274274986
deviation-heading_mean	1.5425054949659271
deviation-heading_median	1.7564842349574374
deviation-heading_min	0.43759623567384753
driven_any_max	4.065421200361849
driven_any_mean	3.6780188909247906
driven_any_median	4.014142079021551
driven_any_min	2.618370205294213
driven_lanedir_consec_max	3.7489722837788806
driven_lanedir_consec_mean	2.6082874985445743
driven_lanedir_consec_min	0.6736081906799519
driven_lanedir_max	3.7489722837788806
driven_lanedir_mean	2.6082874985445743
driven_lanedir_median	3.005284759859733
driven_lanedir_min	0.6736081906799519
get_duckie_state_max	2.718766530354818e-06
get_duckie_state_mean	2.5296730094148347e-06
get_duckie_state_median	2.5758191531883936e-06
get_duckie_state_min	2.2482872009277343e-06
get_robot_state_max	0.015603725115458171
get_robot_state_mean	0.014361672279941048
get_robot_state_median	0.014445508872880552
get_robot_state_min	0.012951946258544922
get_state_dump_max	0.013558348019917808
get_state_dump_mean	0.01327627938644142
get_state_dump_median	0.01328136606327794
get_state_dump_min	0.012984037399291992
get_ui_image_max	0.03526758591334025
get_ui_image_mean	0.03412188612478301
get_ui_image_median	0.03392847975095113
get_ui_image_min	0.03336299908388952
in-drivable-lane_max	5.50000000000005
in-drivable-lane_mean	3.662500000000021
in-drivable-lane_min	1.0000000000000142
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.984199576820463, "get_ui_image": 0.03526758591334025, "step_physics": 0.08108047564824422, "survival_time": 14.950000000000076, "driven_lanedir": 2.5737833984442364, "get_state_dump": 0.013425478140513102, "sim_render-ego": 0.006226254304250081, "get_robot_state": 0.015603725115458171, "get_duckie_state": 2.6186307271321613e-06, "in-drivable-lane": 5.50000000000005, "agent_compute-ego": 0.017410771052042643, "deviation-heading": 1.4629856759688622, "complete-iteration": 0.20289878924687704, "set_robot_commands": 0.004878902435302734, "deviation-center-line": 0.6210364686669322, "driven_lanedir_consec": 2.5737833984442364, "sim_compute_sim_state": 0.02475352923075358, "sim_compute_performance-ego": 0.004104916254679362}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.065421200361849, "get_ui_image": 0.03441703716913859, "step_physics": 0.07861090739568075, "survival_time": 14.950000000000076, "driven_lanedir": 3.43678612127523, "get_state_dump": 0.013558348019917808, "sim_render-ego": 0.006050566037495931, "get_robot_state": 0.015255201657613118, "get_duckie_state": 2.718766530354818e-06, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.017076583703358968, "deviation-heading": 2.219457274274986, "complete-iteration": 0.19825727224349976, "set_robot_commands": 0.005009479522705078, "deviation-center-line": 0.5960592314613783, "driven_lanedir_consec": 3.43678612127523, "sim_compute_sim_state": 0.024010634422302245, "sim_compute_performance-ego": 0.0041204587618509925}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.618370205294213, "get_ui_image": 0.03336299908388952, "step_physics": 0.0712580741590755, "survival_time": 7.84999999999998, "driven_lanedir": 0.6736081906799519, "get_state_dump": 0.013137253986042777, "sim_render-ego": 0.005551950187440131, "get_robot_state": 0.013635816088147984, "get_duckie_state": 2.533007579244626e-06, "in-drivable-lane": 5.449999999999981, "agent_compute-ego": 0.01710231440841772, "deviation-heading": 0.43759623567384753, "complete-iteration": 0.1842440875472537, "set_robot_commands": 0.004533688733532171, "deviation-center-line": 0.08735976864257669, "driven_lanedir_consec": 0.6736081906799519, "sim_compute_sim_state": 0.02186085919665683, "sim_compute_performance-ego": 0.003662385758320997}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.044084581222638, "get_ui_image": 0.033439922332763675, "step_physics": 0.0776336121559143, "survival_time": 14.950000000000076, "driven_lanedir": 3.7489722837788806, "get_state_dump": 0.012984037399291992, "sim_render-ego": 0.005387026468912761, "get_robot_state": 0.012951946258544922, "get_duckie_state": 2.2482872009277343e-06, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.0172763729095459, "deviation-heading": 2.049982793946013, "complete-iteration": 0.1939830740292867, "set_robot_commands": 0.004430032571156819, "deviation-center-line": 0.7976679604614608, "driven_lanedir_consec": 3.7489722837788806, "sim_compute_sim_state": 0.026083521048227944, "sim_compute_performance-ego": 0.003663770357767741}}
set_robot_commands_max	0.005009479522705078
set_robot_commands_mean	0.004713025815674201
set_robot_commands_median	0.004706295584417453
set_robot_commands_min	0.004430032571156819
sim_compute_performance-ego_max	0.0041204587618509925
sim_compute_performance-ego_mean	0.003887882783154773
sim_compute_performance-ego_median	0.003884343306223551
sim_compute_performance-ego_min	0.003662385758320997
sim_compute_sim_state_max	0.026083521048227944
sim_compute_sim_state_mean	0.02417713597448515
sim_compute_sim_state_median	0.024382081826527912
sim_compute_sim_state_min	0.02186085919665683
sim_render-ego_max	0.006226254304250081
sim_render-ego_mean	0.0058039492495247265
sim_render-ego_median	0.0058012581124680315
sim_render-ego_min	0.005387026468912761
simulation-passed	1
step_physics_max	0.08108047564824422
step_physics_mean	0.0771457673397287
step_physics_median	0.07812225977579752
step_physics_min	0.0712580741590755
survival_time_max	14.950000000000076
survival_time_mean	13.175000000000054
survival_time_min	7.84999999999998

No reset possible

42619

11497

sim-exercise-2

LFv-sim

error

2020-11-24 04:39:27+00:00

2020-11-24 04:46:10+00:00

0:06:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42611

11494

sim-exercise-2

LFv-sim

success

2020-11-24 04:24:10+00:00

2020-11-24 04:33:07+00:00

0:08:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.15877341711293
survival_time_median	14.950000000000076
deviation-center-line_median	0.7464011976842753
in-drivable-lane_median	1.3000000000000154

other stats

agent_compute-ego_max	0.017838005224863687
agent_compute-ego_mean	0.017434249520301818
agent_compute-ego_median	0.017339604298273723
agent_compute-ego_min	0.01721978425979614
complete-iteration_max	0.19647642771402996
complete-iteration_mean	0.18620789786179864
complete-iteration_median	0.18519544442494712
complete-iteration_min	0.17796427488327027
deviation-center-line_max	0.987245571848492
deviation-center-line_mean	0.7225784284693323
deviation-center-line_min	0.41026574666028665
deviation-heading_max	2.759841086325456
deviation-heading_mean	2.0456357603862214
deviation-heading_median	2.2184635481423536
deviation-heading_min	0.9857748589347228
driven_any_max	3.935423319046492
driven_any_mean	3.5684715600624437
driven_any_median	3.5276913117459916
driven_any_min	3.2830802977112996
driven_lanedir_consec_max	3.8912689911446945
driven_lanedir_consec_mean	3.0961087844598545
driven_lanedir_consec_min	2.1756193124688643
driven_lanedir_max	3.8912689911446945
driven_lanedir_mean	3.0961087844598545
driven_lanedir_median	3.15877341711293
driven_lanedir_min	2.1756193124688643
get_duckie_state_max	3.535747528076172e-06
get_duckie_state_mean	3.348787625630697e-06
get_duckie_state_median	3.3060709635416668e-06
get_duckie_state_min	3.247261047363281e-06
get_robot_state_max	0.014544257322947184
get_robot_state_mean	0.012816429734230042
get_robot_state_median	0.01269964853922526
get_robot_state_min	0.01132216453552246
get_state_dump_max	0.013288869063059488
get_state_dump_mean	0.012665295799573264
get_state_dump_median	0.01277399738629659
get_state_dump_min	0.01182431936264038
get_ui_image_max	0.033946216106414795
get_ui_image_mean	0.03284820318222046
get_ui_image_median	0.032706376711527506
get_ui_image_min	0.03203384319941203
in-drivable-lane_max	6.050000000000086
in-drivable-lane_mean	2.162500000000029
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.647535511471839, "get_ui_image": 0.0331976858774821, "step_physics": 0.07291171391805013, "survival_time": 14.950000000000076, "driven_lanedir": 3.310262901762621, "get_state_dump": 0.013288869063059488, "sim_render-ego": 0.005539881388346354, "get_robot_state": 0.014544257322947184, "get_duckie_state": 3.535747528076172e-06, "in-drivable-lane": 1.0500000000000087, "agent_compute-ego": 0.017240842978159587, "deviation-heading": 2.5288198408409213, "complete-iteration": 0.1891248631477356, "set_robot_commands": 0.004524263540903727, "deviation-center-line": 0.807117577132726, "driven_lanedir_consec": 3.310262901762621, "sim_compute_sim_state": 0.023971141974131267, "sim_compute_performance-ego": 0.003768614927927653}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.935423319046492, "get_ui_image": 0.03221506754557291, "step_physics": 0.0710173257191976, "survival_time": 14.950000000000076, "driven_lanedir": 3.8912689911446945, "get_state_dump": 0.012718014717102053, "sim_render-ego": 0.005268247127532959, "get_robot_state": 0.01262475331624349, "get_duckie_state": 3.360907236735026e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01743836561838786, "deviation-heading": 1.908107255443786, "complete-iteration": 0.1812660257021586, "set_robot_commands": 0.004442737897237142, "deviation-center-line": 0.6856848182358244, "driven_lanedir_consec": 3.8912689911446945, "sim_compute_sim_state": 0.021884770393371583, "sim_compute_performance-ego": 0.0035211324691772463}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.407847112020145, "get_ui_image": 0.03203384319941203, "step_physics": 0.07025771697362264, "survival_time": 14.950000000000076, "driven_lanedir": 3.007283932463239, "get_state_dump": 0.01182431936264038, "sim_render-ego": 0.005068464279174805, "get_robot_state": 0.01132216453552246, "get_duckie_state": 3.247261047363281e-06, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.017838005224863687, "deviation-heading": 2.759841086325456, "complete-iteration": 0.17796427488327027, "set_robot_commands": 0.004599461555480957, "deviation-center-line": 0.987245571848492, "driven_lanedir_consec": 3.007283932463239, "sim_compute_sim_state": 0.02151509443918864, "sim_compute_performance-ego": 0.003377401034037272}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.2830802977112996, "get_ui_image": 0.033946216106414795, "step_physics": 0.08063935200373332, "survival_time": 14.950000000000076, "driven_lanedir": 2.1756193124688643, "get_state_dump": 0.01282998005549113, "sim_render-ego": 0.005331072807312012, "get_robot_state": 0.012774543762207031, "get_duckie_state": 3.2512346903483073e-06, "in-drivable-lane": 6.050000000000086, "agent_compute-ego": 0.01721978425979614, "deviation-heading": 0.9857748589347228, "complete-iteration": 0.19647642771402996, "set_robot_commands": 0.004425665537516276, "deviation-center-line": 0.41026574666028665, "driven_lanedir_consec": 2.1756193124688643, "sim_compute_sim_state": 0.025570112069447835, "sim_compute_performance-ego": 0.003605327606201172}}
set_robot_commands_max	0.004599461555480957
set_robot_commands_mean	0.0044980321327845255
set_robot_commands_median	0.004483500719070435
set_robot_commands_min	0.004425665537516276
sim_compute_performance-ego_max	0.003768614927927653
sim_compute_performance-ego_mean	0.0035681190093358357
sim_compute_performance-ego_median	0.003563230037689209
sim_compute_performance-ego_min	0.003377401034037272
sim_compute_sim_state_max	0.025570112069447835
sim_compute_sim_state_mean	0.02323527971903483
sim_compute_sim_state_median	0.022927956183751423
sim_compute_sim_state_min	0.02151509443918864
sim_render-ego_max	0.005539881388346354
sim_render-ego_mean	0.0053019164005915324
sim_render-ego_median	0.005299659967422486
sim_render-ego_min	0.005068464279174805
simulation-passed	1
step_physics_max	0.08063935200373332
step_physics_mean	0.07370652715365092
step_physics_median	0.07196451981862387
step_physics_min	0.07025771697362264
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42587

11491

sim-exercise-2

LFv-sim

error

2020-11-24 04:15:29+00:00

2020-11-24 04:22:10+00:00

0:06:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42579

11488

sim-exercise-2

LFv-sim

success

2020-11-24 03:46:05+00:00

2020-11-24 03:54:31+00:00

0:08:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.3611117538756705
survival_time_median	14.950000000000076
deviation-center-line_median	0.7693151806726628
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.017494322458902995
agent_compute-ego_mean	0.01728415928145712
agent_compute-ego_median	0.017233105934867564
agent_compute-ego_min	0.017176102797190347
complete-iteration_max	0.1994771857594335
complete-iteration_mean	0.18980388550795327
complete-iteration_median	0.1881302034854889
complete-iteration_min	0.18347794930140177
deviation-center-line_max	0.9115877285374272
deviation-center-line_mean	0.6950722107583981
deviation-center-line_min	0.3300707531508397
deviation-heading_max	2.9258443191879384
deviation-heading_mean	2.0119595571106528
deviation-heading_median	2.0601595038782285
deviation-heading_min	1.001674901498217
driven_any_max	3.900744335942194
driven_any_mean	3.3492162026365224
driven_any_median	3.438935689718301
driven_any_min	2.618249095167293
driven_lanedir_consec_max	3.8598265431984142
driven_lanedir_consec_mean	3.1949967846337315
driven_lanedir_consec_min	2.1979370875851707
driven_lanedir_max	3.8598265431984142
driven_lanedir_mean	3.1949967846337315
driven_lanedir_median	3.3611117538756705
driven_lanedir_min	2.1979370875851707
get_duckie_state_max	2.5574366251627604e-06
get_duckie_state_mean	2.437922381615454e-06
get_duckie_state_median	2.458280371141064e-06
get_duckie_state_min	2.277692159016927e-06
get_robot_state_max	0.013957962195078532
get_robot_state_mean	0.013327926937923874
get_robot_state_median	0.013260641781858696
get_robot_state_min	0.012832461992899577
get_state_dump_max	0.013475100994110109
get_state_dump_mean	0.013123907525410023
get_state_dump_median	0.013099515992541643
get_state_dump_min	0.012821497122446696
get_ui_image_max	0.033793943981791655
get_ui_image_mean	0.03319280889145164
get_ui_image_median	0.03316945989926656
get_ui_image_min	0.03263837178548177
in-drivable-lane_max	1.7500000000000249
in-drivable-lane_mean	0.4375000000000062
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.590463014856344, "get_ui_image": 0.03331349929173787, "step_physics": 0.07473889827728271, "survival_time": 14.950000000000076, "driven_lanedir": 3.520783646539437, "get_state_dump": 0.013475100994110109, "sim_render-ego": 0.005760973294576009, "get_robot_state": 0.013957962195078532, "get_duckie_state": 2.5574366251627604e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017494322458902995, "deviation-heading": 2.241363833794969, "complete-iteration": 0.19165700435638428, "set_robot_commands": 0.0045928478240966795, "deviation-center-line": 0.8327721102515283, "driven_lanedir_consec": 3.520783646539437, "sim_compute_sim_state": 0.024308056831359864, "sim_compute_performance-ego": 0.0038726409276326496}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.900744335942194, "get_ui_image": 0.03263837178548177, "step_physics": 0.07041637023289998, "survival_time": 14.950000000000076, "driven_lanedir": 3.8598265431984142, "get_state_dump": 0.013183188438415528, "sim_render-ego": 0.005486589272816976, "get_robot_state": 0.013492786089579264, "get_duckie_state": 2.547899881998698e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017176102797190347, "deviation-heading": 1.8789551739614887, "complete-iteration": 0.18347794930140177, "set_robot_commands": 0.004446267286936442, "deviation-center-line": 0.7058582510937972, "driven_lanedir_consec": 3.8598265431984142, "sim_compute_sim_state": 0.02280670166015625, "sim_compute_performance-ego": 0.003691716194152832}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.287408364580258, "get_ui_image": 0.033025420506795244, "step_physics": 0.07228147745132446, "survival_time": 14.950000000000076, "driven_lanedir": 3.201439861211904, "get_state_dump": 0.012821497122446696, "sim_render-ego": 0.005350799560546875, "get_robot_state": 0.012832461992899577, "get_duckie_state": 2.277692159016927e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01724483092625936, "deviation-heading": 2.9258443191879384, "complete-iteration": 0.18460340261459351, "set_robot_commands": 0.004509571393330892, "deviation-center-line": 0.9115877285374272, "driven_lanedir_consec": 3.201439861211904, "sim_compute_sim_state": 0.022791306177775063, "sim_compute_performance-ego": 0.003608983357747396}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.618249095167293, "get_ui_image": 0.033793943981791655, "step_physics": 0.08354811003041822, "survival_time": 10.750000000000018, "driven_lanedir": 2.1979370875851707, "get_state_dump": 0.013015843546667764, "sim_render-ego": 0.005292618551919627, "get_robot_state": 0.013028497474138126, "get_duckie_state": 2.36866086028343e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.017221380943475768, "deviation-heading": 1.001674901498217, "complete-iteration": 0.1994771857594335, "set_robot_commands": 0.004413602518480877, "deviation-center-line": 0.3300707531508397, "driven_lanedir_consec": 2.1979370875851707, "sim_compute_sim_state": 0.025402623553608734, "sim_compute_performance-ego": 0.003622582901355832}}
set_robot_commands_max	0.0045928478240966795
set_robot_commands_mean	0.004490572255711223
set_robot_commands_median	0.004477919340133666
set_robot_commands_min	0.004413602518480877
sim_compute_performance-ego_max	0.0038726409276326496
sim_compute_performance-ego_mean	0.003698980845222177
sim_compute_performance-ego_median	0.003657149547754332
sim_compute_performance-ego_min	0.003608983357747396
sim_compute_sim_state_max	0.025402623553608734
sim_compute_sim_state_mean	0.02382717205572498
sim_compute_sim_state_median	0.023557379245758056
sim_compute_sim_state_min	0.022791306177775063
sim_render-ego_max	0.005760973294576009
sim_render-ego_mean	0.005472745169964872
sim_render-ego_median	0.005418694416681925
sim_render-ego_min	0.005292618551919627
simulation-passed	1
step_physics_max	0.08354811003041822
step_physics_mean	0.07524621399798134
step_physics_median	0.07351018786430358
step_physics_min	0.07041637023289998
survival_time_max	14.950000000000076
survival_time_mean	13.900000000000064
survival_time_min	10.750000000000018

No reset possible

42556

11486

sim-exercise-2

LFv-sim

error

2020-11-24 02:21:16+00:00

2020-11-24 02:27:45+00:00

0:06:29

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42551

11484

sim-exercise-2

LFv-sim

error

2020-11-24 02:07:00+00:00

2020-11-24 02:13:38+00:00

0:06:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42543

11484

sim-exercise-2

LFv-sim

error

2020-11-24 02:00:35+00:00

2020-11-24 02:02:39+00:00

0:02:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42525

11479

sim-exercise-2

LFv-sim

error

2020-11-23 23:41:48+00:00

2020-11-23 23:49:08+00:00

0:07:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42511

11474

Vincenzo Polizzi 🇮🇹

baseline-duckietown

LFv-sim

success

2020-11-23 17:48:47+00:00

2020-11-23 17:56:40+00:00

0:07:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3462356244041447
survival_time_median	14.950000000000076
deviation-center-line_median	0.3981495862139789
in-drivable-lane_median	7.025000000000038

other stats

agent_compute-ego_max	0.01691120942433675
agent_compute-ego_mean	0.016355436444282532
agent_compute-ego_median	0.016485997835795085
agent_compute-ego_min	0.015538540681203208
complete-iteration_max	0.17968844254811606
complete-iteration_mean	0.17624832987785338
complete-iteration_median	0.17640817840894063
complete-iteration_min	0.17248852014541627
deviation-center-line_max	0.9368248172384692
deviation-center-line_mean	0.4810171592677319
deviation-center-line_min	0.19094464740450073
deviation-heading_max	5.929744421136349
deviation-heading_mean	5.144592094781196
deviation-heading_median	5.719488028099841
deviation-heading_min	3.209647901788752
driven_any_max	1.0208582606109464
driven_any_mean	1.0200136865531166
driven_any_median	1.020833196361269
driven_any_min	1.0175300928789823
driven_lanedir_consec_max	0.49824700803904487
driven_lanedir_consec_mean	0.3510516505433655
driven_lanedir_consec_min	0.21348834532612793
driven_lanedir_max	0.49824700803904487
driven_lanedir_mean	0.3510516505433655
driven_lanedir_median	0.3462356244041447
driven_lanedir_min	0.21348834532612793
get_duckie_state_max	3.623167673746745e-06
get_duckie_state_mean	3.522634506225586e-06
get_duckie_state_median	3.5019715627034503e-06
get_duckie_state_min	3.463427225748698e-06
get_robot_state_max	0.011564873854319254
get_robot_state_mean	0.011431018114089968
get_robot_state_median	0.011440398295720418
get_robot_state_min	0.011278402010599773
get_state_dump_max	0.012104930877685547
get_state_dump_mean	0.011903099020322164
get_state_dump_median	0.011896922588348388
get_state_dump_min	0.01171362002690633
get_ui_image_max	0.03287007649739583
get_ui_image_mean	0.0324368025859197
get_ui_image_median	0.03238460779190064
get_ui_image_min	0.03210791826248169
in-drivable-lane_max	10.100000000000032
in-drivable-lane_mean	7.287500000000024
in-drivable-lane_min	4.9999999999999885
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.0175300928789823, "get_ui_image": 0.03210791826248169, "step_physics": 0.06795030991236369, "survival_time": 14.950000000000076, "driven_lanedir": 0.49824700803904487, "get_state_dump": 0.01171362002690633, "sim_render-ego": 0.004995199044545492, "get_robot_state": 0.011426067352294922, "get_duckie_state": 3.463427225748698e-06, "in-drivable-lane": 4.9999999999999885, "agent_compute-ego": 0.016306814352671305, "deviation-heading": 5.929744421136349, "complete-iteration": 0.17248852014541627, "set_robot_commands": 0.004508588314056396, "deviation-center-line": 0.4914110580072097, "driven_lanedir_consec": 0.49824700803904487, "sim_compute_sim_state": 0.01997915267944336, "sim_compute_performance-ego": 0.003370771408081055}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.0208344237862177, "get_ui_image": 0.032605069478352865, "step_physics": 0.07346404631932577, "survival_time": 14.950000000000076, "driven_lanedir": 0.29121715675354887, "get_state_dump": 0.01180514891942342, "sim_render-ego": 0.005044441223144531, "get_robot_state": 0.011278402010599773, "get_duckie_state": 3.4777323404947915e-06, "in-drivable-lane": 7.900000000000046, "agent_compute-ego": 0.016665181318918865, "deviation-heading": 5.520395505565406, "complete-iteration": 0.17697740316390992, "set_robot_commands": 0.004354557991027832, "deviation-center-line": 0.19094464740450073, "driven_lanedir_consec": 0.29121715675354887, "sim_compute_sim_state": 0.018277849356333416, "sim_compute_performance-ego": 0.0033566466967264812}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.0208582606109464, "get_ui_image": 0.032164146105448405, "step_physics": 0.07014886379241943, "survival_time": 14.950000000000076, "driven_lanedir": 0.21348834532612793, "get_state_dump": 0.011988696257273355, "sim_render-ego": 0.004936051368713379, "get_robot_state": 0.011454729239145915, "get_duckie_state": 3.623167673746745e-06, "in-drivable-lane": 10.100000000000032, "agent_compute-ego": 0.01691120942433675, "deviation-heading": 3.209647901788752, "complete-iteration": 0.17583895365397134, "set_robot_commands": 0.004712454477945964, "deviation-center-line": 0.30488811442074815, "driven_lanedir_consec": 0.21348834532612793, "sim_compute_sim_state": 0.01999510844548543, "sim_compute_performance-ego": 0.003390703201293945}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.0208319689363197, "get_ui_image": 0.03287007649739583, "step_physics": 0.07254326661427815, "survival_time": 14.950000000000076, "driven_lanedir": 0.4012540920547405, "get_state_dump": 0.012104930877685547, "sim_render-ego": 0.004911298751831055, "get_robot_state": 0.011564873854319254, "get_duckie_state": 3.526210784912109e-06, "in-drivable-lane": 6.15000000000003, "agent_compute-ego": 0.015538540681203208, "deviation-heading": 5.9185805506342755, "complete-iteration": 0.17968844254811606, "set_robot_commands": 0.004540497461954752, "deviation-center-line": 0.9368248172384692, "driven_lanedir_consec": 0.4012540920547405, "sim_compute_sim_state": 0.022123769919077555, "sim_compute_performance-ego": 0.0033581129709879557}}
set_robot_commands_max	0.004712454477945964
set_robot_commands_mean	0.004529024561246236
set_robot_commands_median	0.004524542888005575
set_robot_commands_min	0.004354557991027832
sim_compute_performance-ego_max	0.003390703201293945
sim_compute_performance-ego_mean	0.0033690585692723596
sim_compute_performance-ego_median	0.0033644421895345053
sim_compute_performance-ego_min	0.0033566466967264812
sim_compute_sim_state_max	0.022123769919077555
sim_compute_sim_state_mean	0.02009397010008494
sim_compute_sim_state_median	0.019987130562464397
sim_compute_sim_state_min	0.018277849356333416
sim_render-ego_max	0.005044441223144531
sim_render-ego_mean	0.004971747597058614
sim_render-ego_median	0.004965625206629435
sim_render-ego_min	0.004911298751831055
simulation-passed	1
step_physics_max	0.07346404631932577
step_physics_mean	0.07102662165959675
step_physics_median	0.0713460652033488
step_physics_min	0.06795030991236369
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42506

11472

Raphael Jean

sim-exercise-2

LFv-sim

success

2020-11-23 14:31:22+00:00

2020-11-23 14:39:34+00:00

0:08:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.3071094952840746
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.01696795384089152
agent_compute-ego_mean	0.016466609636942547
agent_compute-ego_median	0.016367613474527996
agent_compute-ego_min	0.016163257757822673
complete-iteration_max	0.19895584026972452
complete-iteration_mean	0.18280537366867067
complete-iteration_median	0.17767819205919902
complete-iteration_min	0.17690927028656006
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.35998819605511767
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.6586762301304627
deviation-heading_median	1.2113904039371066
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	6.950391439969185e-14
driven_any_median	7.057320516147632e-14
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	4.455447196960449e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	4.455447196960449e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	2.2490819295247396e-06
get_duckie_state_mean	2.23239262898763e-06
get_duckie_state_median	2.233982086181641e-06
get_duckie_state_min	2.2125244140625e-06
get_robot_state_max	0.013305041790008545
get_robot_state_mean	0.013037937680880228
get_robot_state_median	0.012969488700230916
get_robot_state_min	0.012907731533050536
get_state_dump_max	0.012875246206919351
get_state_dump_mean	0.012813834349314372
get_state_dump_median	0.0128373654683431
get_state_dump_min	0.012705360253651935
get_ui_image_max	0.03379876295725504
get_ui_image_mean	0.03279357373714447
get_ui_image_median	0.03271181186040242
get_ui_image_min	0.031951908270517984
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.031951908270517984, "step_physics": 0.06793256680170695, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012705360253651935, "sim_render-ego": 0.005414586861928304, "get_robot_state": 0.013305041790008545, "get_duckie_state": 2.2125244140625e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01696795384089152, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.17775994221369426, "set_robot_commands": 0.004584927558898926, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021118950843811036, "sim_compute_performance-ego": 0.003633766969045003}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03315896908442179, "step_physics": 0.06822915077209472, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012844590346018474, "sim_render-ego": 0.005332676569620768, "get_robot_state": 0.012978577613830566, "get_duckie_state": 2.2490819295247396e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016163257757822673, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.17690927028656006, "set_robot_commands": 0.004510016441345215, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01994982878367106, "sim_compute_performance-ego": 0.00359605073928833}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.032264654636383054, "step_physics": 0.06896062453587849, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.012830140590667723, "sim_render-ego": 0.005401719411214193, "get_robot_state": 0.012907731533050536, "get_duckie_state": 2.2188822428385417e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01634111483891805, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.17759644190470378, "set_robot_commands": 0.004494715531667074, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.0206323234240214, "sim_compute_performance-ego": 0.003615529537200927}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.03379876295725504, "step_physics": 0.0858975609143575, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012875246206919351, "sim_render-ego": 0.00527253786722819, "get_robot_state": 0.012960399786631266, "get_duckie_state": 2.2490819295247396e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01639411211013794, "deviation-heading": 0.486072248607516, "complete-iteration": 0.19895584026972452, "set_robot_commands": 0.00453650712966919, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023465228875478108, "sim_compute_performance-ego": 0.003609356880187988}}
set_robot_commands_max	0.004584927558898926
set_robot_commands_mean	0.004531541665395102
set_robot_commands_median	0.0045232617855072025
set_robot_commands_min	0.004494715531667074
sim_compute_performance-ego_max	0.003633766969045003
sim_compute_performance-ego_mean	0.0036136760314305623
sim_compute_performance-ego_median	0.003612443208694458
sim_compute_performance-ego_min	0.00359605073928833
sim_compute_sim_state_max	0.023465228875478108
sim_compute_sim_state_mean	0.0212915829817454
sim_compute_sim_state_median	0.02087563713391622
sim_compute_sim_state_min	0.01994982878367106
sim_render-ego_max	0.005414586861928304
sim_render-ego_mean	0.0053553801774978635
sim_render-ego_median	0.00536719799041748
sim_render-ego_min	0.00527253786722819
simulation-passed	1
step_physics_max	0.0858975609143575
step_physics_mean	0.07275497575600942
step_physics_median	0.06859488765398661
step_physics_min	0.06793256680170695
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42502

11471

Riccardo Tresa 🇮🇹

template-random

LFv-sim

success