Evaluator 1169

2019-05-17 11:20:06+00:00

2019-05-17 11:20:34+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11772218205910091
error_L2	0.02143953392240987

No reset possible

23080

3557

Amaury Camus 🇨🇭

Running the real lane following -- without challenge container

step1-simulation

error

yes

2019-05-17 09:54:34+00:00

2019-05-17 10:00:26+00:00

0:05:52

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23035

2410

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-05-17 05:55:20+00:00

2019-05-17 06:02:32+00:00

0:07:12

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23028

2369

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

yes

2019-05-17 05:27:18+00:00

2019-05-17 05:53:54+00:00

0:26:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6202968959903497
survival_time_median	6.8999999999999835
deviation-center-line_median	0.2968973039399582
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1572352233140365
agent_compute-ego_mean	0.13595605158548665
agent_compute-ego_median	0.14215392689053102
agent_compute-ego_min	0.11347536731966966
deviation-center-line_max	1.2578907011919125
deviation-center-line_mean	0.392559795052945
deviation-center-line_min	0.20837582250812192
deviation-heading_max	1.7338651399303977
deviation-heading_mean	0.922434565822337
deviation-heading_median	0.801279189692507
deviation-heading_min	0.48740885281046914
driven_any_max	1.7560498171261352
driven_any_mean	0.8746411422725543
driven_any_median	0.9886852216355494
driven_any_min	0.278862430643389
driven_lanedir_consec_max	1.7523714592470048
driven_lanedir_consec_mean	0.6813457664348396
driven_lanedir_consec_min	0.2720172605900939
driven_lanedir_max	1.7523714592470048
driven_lanedir_mean	0.6813457664348396
driven_lanedir_median	0.6202968959903497
driven_lanedir_min	0.2720172605900939
in-drivable-lane_max	6.400000000000029
in-drivable-lane_mean	1.1100000000000017
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.09592242721173404, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05675690637218009, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14215392689053102, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.08941711453225115, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03627225649442605, "sim_compute_performance-ego": 0.06306760945766092, "sim_compute_robot_state-ego": 0.06449515184910178}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.10474487372807094, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.06167295319693429, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.15474269390106202, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.09371257850102016, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.03902083124433245, "sim_compute_performance-ego": 0.07011977093560355, "sim_compute_robot_state-ego": 0.07493132012231009}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.10455013381110298, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.059004624684651695, "in-drivable-lane": 0, "agent_compute-ego": 0.13749078114827473, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.0893472671508789, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.037511253356933595, "sim_compute_performance-ego": 0.06856992509629992, "sim_compute_robot_state-ego": 0.0674175845252143}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.11872415698092915, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.06429152644198874, "in-drivable-lane": 0, "agent_compute-ego": 0.1572352233140365, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.09909786089606908, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.04774820545445318, "sim_compute_performance-ego": 0.06934194720309714, "sim_compute_robot_state-ego": 0.078100077483965}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.09829109553332742, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.05859089986374389, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.14517880901354088, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.08882008404492243, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.036927811086994326, "sim_compute_performance-ego": 0.0633139773590924, "sim_compute_robot_state-ego": 0.06981341479575798}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.10342088767460414, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.056389151300702774, "in-drivable-lane": 0, "agent_compute-ego": 0.1458723613194057, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.09143108640398298, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.037063281876700264, "sim_compute_performance-ego": 0.06354445048740932, "sim_compute_robot_state-ego": 0.06783135277884347}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.10041950118373816, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.05765419778689533, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.14354698087128115, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.0922200427928441, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.036962492365232656, "sim_compute_performance-ego": 0.06592633186931342, "sim_compute_robot_state-ego": 0.06831178195039991}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.09780183564061704, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.05558329561482305, "in-drivable-lane": 0, "agent_compute-ego": 0.13129594533339792, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.08958671403967816, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.03305868480516517, "sim_compute_performance-ego": 0.061823860458705734, "sim_compute_robot_state-ego": 0.06403073538904605}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.10506605307261148, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.05691059695349799, "in-drivable-lane": 0, "agent_compute-ego": 0.14426073763105604, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.0891358560985989, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.03685417970021566, "sim_compute_performance-ego": 0.06366237004597981, "sim_compute_robot_state-ego": 0.06947972244686551}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.11021935248720471, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.05833298572595569, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14963838155718817, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.08930477197619452, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.037501677222873855, "sim_compute_performance-ego": 0.06739770502283954, "sim_compute_robot_state-ego": 0.06942608045495074}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.07781702115995075, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.045892590776495976, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.11602749518298228, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.06958249512068722, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.029007212831339703, "sim_compute_performance-ego": 0.04869504806098588, "sim_compute_robot_state-ego": 0.05025367889929255}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.0832856794198354, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.04538893368509081, "in-drivable-lane": 0, "agent_compute-ego": 0.12249159150653416, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.06773063871595594, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.02775459819369846, "sim_compute_performance-ego": 0.04950284626748827, "sim_compute_robot_state-ego": 0.05155957738558451}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.07296421373490806, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.044202648478446245, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11347536731966966, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.07290187327981852, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.029274124035732353, "sim_compute_performance-ego": 0.054119302214478415, "sim_compute_robot_state-ego": 0.05181171739701745}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.07929427340879279, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.0458046662605415, "in-drivable-lane": 0, "agent_compute-ego": 0.1195574938240698, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.07083348500526558, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.03083896232863604, "sim_compute_performance-ego": 0.0504585605556682, "sim_compute_robot_state-ego": 0.05017844701217393}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.07290810074548998, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.04633278767597626, "in-drivable-lane": 0, "agent_compute-ego": 0.11637298496926968, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.07000570772099791, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.029946607178177577, "sim_compute_performance-ego": 0.05035975859867586, "sim_compute_robot_state-ego": 0.05093941550037178}}
set_robot_commands_max	0.09909786089606908
set_robot_commands_mean	0.0842085050852777
set_robot_commands_median	0.08930477197619452
set_robot_commands_min	0.06773063871595594
sim_compute_performance-ego_max	0.07011977093560355
sim_compute_performance-ego_mean	0.06066023090888657
sim_compute_performance-ego_median	0.0633139773590924
sim_compute_performance-ego_min	0.04869504806098588
sim_compute_robot_state-ego_max	0.078100077483965
sim_compute_robot_state-ego_mean	0.06323867053272632
sim_compute_robot_state-ego_median	0.0674175845252143
sim_compute_robot_state-ego_min	0.05017844701217393
sim_compute_sim_state_max	0.04774820545445318
sim_compute_sim_state_mean	0.03504947854499409
sim_compute_sim_state_median	0.03685417970021566
sim_compute_sim_state_min	0.02775459819369846
sim_physics_max	0.11872415698092915
sim_physics_mean	0.09502864038619444
sim_physics_median	0.09829109553332742
sim_physics_min	0.07290810074548998
sim_render-ego_max	0.06429152644198874
sim_render-ego_mean	0.05418725098786162
sim_render-ego_median	0.05675690637218009
sim_render-ego_min	0.044202648478446245
simulation-passed	1
survival_time_max	12.050000000000036
survival_time_mean	6.166666666666666
survival_time_min	2.25

No reset possible

23020

2378

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

yes

2019-05-17 05:17:03+00:00

2019-05-17 05:26:48+00:00

0:09:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6707441932890994
survival_time_median	3.649999999999995
deviation-center-line_median	0.14435558631904788
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.06552887601511818
agent_compute-ego_mean	0.06280630281722203
agent_compute-ego_median	0.0628955066204071
agent_compute-ego_min	0.06104443967342377
deviation-center-line_max	0.2085822874042474
deviation-center-line_mean	0.1589542518908908
deviation-center-line_min	0.10686452122645386
deviation-heading_max	0.6191860504142408
deviation-heading_mean	0.523857550127959
deviation-heading_median	0.5156622477370731
deviation-heading_min	0.42218734391092383
driven_any_max	1.5798273185720382
driven_any_mean	0.9978358087547315
driven_any_median	0.9948273195001778
driven_any_min	0.3798605253583843
driven_lanedir_consec_max	1.2017887891468408
driven_lanedir_consec_mean	0.7740609626522831
driven_lanedir_consec_min	0.366714522485295
driven_lanedir_max	1.2017887891468408
driven_lanedir_mean	0.7740609626522831
driven_lanedir_median	0.6707441932890994
driven_lanedir_min	0.366714522485295
in-drivable-lane_max	1.1999999999999955
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.1640774321882692, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.05986731999540982, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0631806687132953, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.08712793049746997, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03477472475130264, "sim_compute_performance-ego": 0.06583667454654224, "sim_compute_robot_state-ego": 0.0684784569152414, "sim_compute_robot_state-npc0": 0.06456412681161541, "sim_compute_robot_state-npc1": 0.06558044642618258, "sim_compute_robot_state-npc2": 0.06576648150404839, "sim_compute_robot_state-npc3": 0.06109000232121716}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.17349733533086004, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.05897752014366356, "in-drivable-lane": 0, "agent_compute-ego": 0.061382023063865865, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.08884826866356102, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03321682440268027, "sim_compute_performance-ego": 0.06234375206199852, "sim_compute_robot_state-ego": 0.06749632551863387, "sim_compute_robot_state-npc0": 0.06552347621402226, "sim_compute_robot_state-npc1": 0.06344219800588247, "sim_compute_robot_state-npc2": 0.06538413666390083, "sim_compute_robot_state-npc3": 0.06129148844126109}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.1820920216185706, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.06386107632092067, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06552887601511818, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.0962388515472412, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.03943673201969692, "sim_compute_performance-ego": 0.06948624125548772, "sim_compute_robot_state-ego": 0.07826523695673261, "sim_compute_robot_state-npc0": 0.06734562984534673, "sim_compute_robot_state-npc1": 0.06924572374139513, "sim_compute_robot_state-npc2": 0.07068343673433576, "sim_compute_robot_state-npc3": 0.07058608319078173}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.16953263325350626, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.057742342352867126, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06104443967342377, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.08694963157176971, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03599854665143149, "sim_compute_performance-ego": 0.06488257433686938, "sim_compute_robot_state-ego": 0.06835811691624778, "sim_compute_robot_state-npc0": 0.06591954827308655, "sim_compute_robot_state-npc1": 0.06403729958193642, "sim_compute_robot_state-npc2": 0.06547597476414271, "sim_compute_robot_state-npc3": 0.06387626699038915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.18048782646656036, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.06472700834274292, "in-drivable-lane": 0, "agent_compute-ego": 0.0628955066204071, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.09321898221969604, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.04040811210870743, "sim_compute_performance-ego": 0.06805245578289032, "sim_compute_robot_state-ego": 0.07599849998950958, "sim_compute_robot_state-npc0": 0.07263916730880737, "sim_compute_robot_state-npc1": 0.06910749524831772, "sim_compute_robot_state-npc2": 0.0684482529759407, "sim_compute_robot_state-npc3": 0.07227946817874908}}
set_robot_commands_max	0.0962388515472412
set_robot_commands_mean	0.0904767328999476
set_robot_commands_median	0.08884826866356102
set_robot_commands_min	0.08694963157176971
sim_compute_performance-ego_max	0.06948624125548772
sim_compute_performance-ego_mean	0.06612033959675764
sim_compute_performance-ego_median	0.06583667454654224
sim_compute_performance-ego_min	0.06234375206199852
sim_compute_robot_state-ego_max	0.07826523695673261
sim_compute_robot_state-ego_mean	0.07171932725927305
sim_compute_robot_state-ego_median	0.0684784569152414
sim_compute_robot_state-ego_min	0.06749632551863387
sim_compute_robot_state-npc0_max	0.07263916730880737
sim_compute_robot_state-npc0_mean	0.06719838969057565
sim_compute_robot_state-npc0_median	0.06591954827308655
sim_compute_robot_state-npc0_min	0.06456412681161541
sim_compute_robot_state-npc1_max	0.06924572374139513
sim_compute_robot_state-npc1_mean	0.06628263260074287
sim_compute_robot_state-npc1_median	0.06558044642618258
sim_compute_robot_state-npc1_min	0.06344219800588247
sim_compute_robot_state-npc2_max	0.07068343673433576
sim_compute_robot_state-npc2_mean	0.06715165652847369
sim_compute_robot_state-npc2_median	0.06576648150404839
sim_compute_robot_state-npc2_min	0.06538413666390083
sim_compute_robot_state-npc3_max	0.07227946817874908
sim_compute_robot_state-npc3_mean	0.06582466182447963
sim_compute_robot_state-npc3_median	0.06387626699038915
sim_compute_robot_state-npc3_min	0.06109000232121716
sim_compute_sim_state_max	0.04040811210870743
sim_compute_sim_state_mean	0.03676698798676375
sim_compute_sim_state_median	0.03599854665143149
sim_compute_sim_state_min	0.03321682440268027
sim_physics_max	0.1820920216185706
sim_physics_mean	0.1739374497715533
sim_physics_median	0.17349733533086004
sim_physics_min	0.1640774321882692
sim_render-ego_max	0.06472700834274292
sim_render-ego_mean	0.06103505343112081
sim_render-ego_median	0.05986731999540982
sim_render-ego_min	0.057742342352867126
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.6599999999999944
survival_time_min	1.6000000000000008

No reset possible

23005

2406

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-05-17 05:01:21+00:00

2019-05-17 05:16:26+00:00

0:15:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07491694695314322
survival_time_median	1.2000000000000004
deviation-center-line_median	0.05640650632522012
in-drivable-lane_median	0.15000000000000013

other stats

agent_compute-ego_max	0.18514677194448617
agent_compute-ego_mean	0.15781646682479547
agent_compute-ego_median	0.15999878020513625
agent_compute-ego_min	0.118154915896329
deviation-center-line_max	0.08992127954448668
deviation-center-line_mean	0.06199087358005375
deviation-center-line_min	0.029898656059950363
deviation-heading_max	0.7793216720398054
deviation-heading_mean	0.6351662554476409
deviation-heading_median	0.627212219486254
deviation-heading_min	0.44897143643374027
driven_any_max	0.24030167248186943
driven_any_mean	0.1637581090455199
driven_any_median	0.15335033954569677
driven_any_min	0.10719505692270384
driven_lanedir_consec_max	0.1105641789865821
driven_lanedir_consec_mean	0.0816277105454037
driven_lanedir_consec_min	0.04884938601700406
driven_lanedir_max	0.1105641789865821
driven_lanedir_mean	0.0816277105454037
driven_lanedir_median	0.07491694695314322
driven_lanedir_min	0.04884938601700406
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.2400000000000002
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.21834837244228128, "sim_physics": 0.1967623450539329, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08907174895440817, "sim_render-ego": 0.06126224633419153, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16764759294914475, "deviation-heading": 0.627212219486254, "set_robot_commands": 0.09312995997342197, "deviation-center-line": 0.05640650632522012, "driven_lanedir_consec": 0.08907174895440817, "sim_compute_sim_state": 0.03755643873503714, "sim_compute_performance-ego": 0.0652910362590443, "sim_compute_robot_state-ego": 0.06922458879875415, "sim_compute_robot_state-npc0": 0.06928756742766409, "sim_compute_robot_state-npc1": 0.06901670224738843, "sim_compute_robot_state-npc2": 0.06910524946270567, "sim_compute_robot_state-npc3": 0.06384660258437648}, "udem1-1-0": {"driven_any": 0.2045346177376563, "sim_physics": 0.21124045848846432, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06362435804351518, "sim_render-ego": 0.05997539361317952, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15187825361887614, "deviation-heading": 0.7701213375122605, "set_robot_commands": 0.08562199274698894, "deviation-center-line": 0.052454023176684954, "driven_lanedir_consec": 0.06362435804351518, "sim_compute_sim_state": 0.03502531051635742, "sim_compute_performance-ego": 0.06684813499450684, "sim_compute_robot_state-ego": 0.07066365083058675, "sim_compute_robot_state-npc0": 0.06501454512278239, "sim_compute_robot_state-npc1": 0.06799400647481282, "sim_compute_robot_state-npc2": 0.0674485445022583, "sim_compute_robot_state-npc3": 0.0671061118443807}, "udem1-2-0": {"driven_any": 0.13473286612834703, "sim_physics": 0.21655885378519693, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10476909761056152, "sim_render-ego": 0.05189629963466099, "in-drivable-lane": 0, "agent_compute-ego": 0.15094499360947383, "deviation-heading": 0.44897143643374027, "set_robot_commands": 0.0914754413423084, "deviation-center-line": 0.08931524869683488, "driven_lanedir_consec": 0.10476909761056152, "sim_compute_sim_state": 0.0371892565772647, "sim_compute_performance-ego": 0.05950264703659784, "sim_compute_robot_state-ego": 0.06116531008765811, "sim_compute_robot_state-npc0": 0.06933429127647764, "sim_compute_robot_state-npc1": 0.06236848377046131, "sim_compute_robot_state-npc2": 0.06178171294076102, "sim_compute_robot_state-npc3": 0.06307389622642881}, "udem1-3-0": {"driven_any": 0.14291483300418928, "sim_physics": 0.20723029700192536, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10912498173282748, "sim_render-ego": 0.06438488310033624, "in-drivable-lane": 0, "agent_compute-ego": 0.15604416890577835, "deviation-heading": 0.4972118822697814, "set_robot_commands": 0.07843211564150723, "deviation-center-line": 0.08992127954448668, "driven_lanedir_consec": 0.10912498173282748, "sim_compute_sim_state": 0.03280678662386807, "sim_compute_performance-ego": 0.061022400856018066, "sim_compute_robot_state-ego": 0.06718773191625421, "sim_compute_robot_state-npc0": 0.058065143498507416, "sim_compute_robot_state-npc1": 0.06463762846860019, "sim_compute_robot_state-npc2": 0.05942730470137163, "sim_compute_robot_state-npc3": 0.06262124668468129}, "udem1-4-0": {"driven_any": 0.14178276315110397, "sim_physics": 0.14299599329630533, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0693188667294804, "sim_render-ego": 0.04609111944834391, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1261963744958242, "deviation-heading": 0.680313885491405, "set_robot_commands": 0.0747896134853363, "deviation-center-line": 0.03890204995911767, "driven_lanedir_consec": 0.0693188667294804, "sim_compute_sim_state": 0.029874682426452637, "sim_compute_performance-ego": 0.04906908671061198, "sim_compute_robot_state-ego": 0.04971322417259216, "sim_compute_robot_state-npc0": 0.04903501272201538, "sim_compute_robot_state-npc1": 0.04909228285153707, "sim_compute_robot_state-npc2": 0.04815538724263509, "sim_compute_robot_state-npc3": 0.04800178607304891}, "udem1-5-0": {"driven_any": 0.24030167248186943, "sim_physics": 0.19300576713350084, "survival_time": 1.800000000000001, "driven_lanedir": 0.1105641789865821, "sim_render-ego": 0.062014374468061656, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17956925100750393, "deviation-heading": 0.711522804791074, "set_robot_commands": 0.10417728953891332, "deviation-center-line": 0.05306794922646514, "driven_lanedir_consec": 0.1105641789865821, "sim_compute_sim_state": 0.03960512081782023, "sim_compute_performance-ego": 0.06972606976826985, "sim_compute_robot_state-ego": 0.07638699478573269, "sim_compute_robot_state-npc0": 0.07075058751636082, "sim_compute_robot_state-npc1": 0.07029742002487183, "sim_compute_robot_state-npc2": 0.07434869474834865, "sim_compute_robot_state-npc3": 0.06719831625620525}, "udem1-6-0": {"driven_any": 0.11270150939795494, "sim_physics": 0.19045411348342897, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06620947043494141, "sim_render-ego": 0.058862042427062986, "in-drivable-lane": 0, "agent_compute-ego": 0.15037866830825805, "deviation-heading": 0.574895069984359, "set_robot_commands": 0.08213498592376708, "deviation-center-line": 0.07065463836309144, "driven_lanedir_consec": 0.06620947043494141, "sim_compute_sim_state": 0.03247301578521729, "sim_compute_performance-ego": 0.06199867725372314, "sim_compute_robot_state-ego": 0.06565209627151489, "sim_compute_robot_state-npc0": 0.060965991020202635, "sim_compute_robot_state-npc1": 0.06060079336166382, "sim_compute_robot_state-npc2": 0.05721924304962158, "sim_compute_robot_state-npc3": 0.05729689598083496}, "udem1-7-0": {"driven_any": 0.1336149242666562, "sim_physics": 0.21235532561937967, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0899961456494276, "sim_render-ego": 0.05789129932721456, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16155225038528442, "deviation-heading": 0.60752994107739, "set_robot_commands": 0.09001559019088745, "deviation-center-line": 0.0882865571900123, "driven_lanedir_consec": 0.0899961456494276, "sim_compute_sim_state": 0.04108725984891256, "sim_compute_performance-ego": 0.06840490301450093, "sim_compute_robot_state-ego": 0.06754019856452942, "sim_compute_robot_state-npc0": 0.06690749526023865, "sim_compute_robot_state-npc1": 0.06699289878209432, "sim_compute_robot_state-npc2": 0.06943117578824361, "sim_compute_robot_state-npc3": 0.06530254085858662}, "udem1-8-0": {"driven_any": 0.20575347714638212, "sim_physics": 0.18548818677663803, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09245911790688988, "sim_render-ego": 0.05860523134469986, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15143319219350815, "deviation-heading": 0.6593124368300722, "set_robot_commands": 0.0878848284482956, "deviation-center-line": 0.033001617047254836, "driven_lanedir_consec": 0.09245911790688988, "sim_compute_sim_state": 0.03576713055372238, "sim_compute_performance-ego": 0.06470448523759842, "sim_compute_robot_state-ego": 0.06826051324605942, "sim_compute_robot_state-npc0": 0.06687108427286148, "sim_compute_robot_state-npc1": 0.06426393985748291, "sim_compute_robot_state-npc2": 0.06699295341968536, "sim_compute_robot_state-npc3": 0.07018020749092102}, "udem1-9-0": {"driven_any": 0.17686662190033278, "sim_physics": 0.2169735176222665, "survival_time": 1.4000000000000006, "driven_lanedir": 0.04884938601700406, "sim_render-ego": 0.0617398875100272, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.1668195469038827, "deviation-heading": 0.6923571091860621, "set_robot_commands": 0.09687695332935878, "deviation-center-line": 0.029898656059950363, "driven_lanedir_consec": 0.04884938601700406, "sim_compute_sim_state": 0.04075289624077933, "sim_compute_performance-ego": 0.06619696957724434, "sim_compute_robot_state-ego": 0.07085728645324707, "sim_compute_robot_state-npc0": 0.06189301184245518, "sim_compute_robot_state-npc1": 0.06631543806621007, "sim_compute_robot_state-npc2": 0.06424848522458758, "sim_compute_robot_state-npc3": 0.06439448254449028}, "udem1-10-0": {"driven_any": 0.15335033954569677, "sim_physics": 0.2030539313952128, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07491694695314322, "sim_render-ego": 0.057423253854115806, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17715569337209067, "deviation-heading": 0.7793216720398054, "set_robot_commands": 0.10232097903887433, "deviation-center-line": 0.04275711231950694, "driven_lanedir_consec": 0.07491694695314322, "sim_compute_sim_state": 0.033921251694361367, "sim_compute_performance-ego": 0.060446312030156456, "sim_compute_robot_state-ego": 0.07092122236887614, "sim_compute_robot_state-npc0": 0.06298848986625671, "sim_compute_robot_state-npc1": 0.061445653438568115, "sim_compute_robot_state-npc2": 0.06188386678695679, "sim_compute_robot_state-npc3": 0.05842725435892741}, "udem1-11-0": {"driven_any": 0.10719505692270384, "sim_physics": 0.21713595163254512, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0674366373970412, "sim_render-ego": 0.05815075692676362, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15999878020513625, "deviation-heading": 0.5780098992841516, "set_robot_commands": 0.09121677989051456, "deviation-center-line": 0.08622719415032296, "driven_lanedir_consec": 0.0674366373970412, "sim_compute_sim_state": 0.04015445709228515, "sim_compute_performance-ego": 0.06592631340026855, "sim_compute_robot_state-ego": 0.07653329485938662, "sim_compute_robot_state-npc0": 0.06967479842049736, "sim_compute_robot_state-npc1": 0.06270709491911389, "sim_compute_robot_state-npc2": 0.0628298010144915, "sim_compute_robot_state-npc3": 0.06476589611598424}, "udem1-12-0": {"driven_any": 0.20919584393940505, "sim_physics": 0.2149935469907873, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07322233861989269, "sim_render-ego": 0.06237471804899328, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16432654857635498, "deviation-heading": 0.6127680654042019, "set_robot_commands": 0.09123527302461512, "deviation-center-line": 0.05481453918108437, "driven_lanedir_consec": 0.07322233861989269, "sim_compute_sim_state": 0.037078331498538744, "sim_compute_performance-ego": 0.06237503360299503, "sim_compute_robot_state-ego": 0.066009521484375, "sim_compute_robot_state-npc0": 0.06444218579460592, "sim_compute_robot_state-npc1": 0.07045869266285616, "sim_compute_robot_state-npc2": 0.063881516456604, "sim_compute_robot_state-npc3": 0.06285198295817655}, "udem1-13-0": {"driven_any": 0.11094558254280916, "sim_physics": 0.1505636410279707, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05763463362986565, "sim_render-ego": 0.04346928813240745, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.118154915896329, "deviation-heading": 0.591563002444139, "set_robot_commands": 0.0661415620283647, "deviation-center-line": 0.0738916195200361, "driven_lanedir_consec": 0.05763463362986565, "sim_compute_sim_state": 0.025178356604142624, "sim_compute_performance-ego": 0.044275337999517266, "sim_compute_robot_state-ego": 0.04792765053835782, "sim_compute_robot_state-npc0": 0.04482061212713069, "sim_compute_robot_state-npc1": 0.04463608698411421, "sim_compute_robot_state-npc2": 0.04669378020546653, "sim_compute_robot_state-npc3": 0.04427168586037376}, "udem1-14-0": {"driven_any": 0.16413315507541087, "sim_physics": 0.1957005262374878, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10721774951547491, "sim_render-ego": 0.058618820630587064, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18514677194448617, "deviation-heading": 0.6963830694799161, "set_robot_commands": 0.0939657504741962, "deviation-center-line": 0.07026411294073753, "driven_lanedir_consec": 0.10721774951547491, "sim_compute_sim_state": 0.03878279832693247, "sim_compute_performance-ego": 0.06641199038578914, "sim_compute_robot_state-ego": 0.0687640355183528, "sim_compute_robot_state-npc0": 0.06968150689051701, "sim_compute_robot_state-npc1": 0.06584469171670768, "sim_compute_robot_state-npc2": 0.06341825998746432, "sim_compute_robot_state-npc3": 0.06728531764103816}}
set_robot_commands_max	0.10417728953891332
set_robot_commands_mean	0.08862794100515665
set_robot_commands_median	0.09121677989051456
set_robot_commands_min	0.0661415620283647
sim_compute_performance-ego_max	0.06972606976826985
sim_compute_performance-ego_mean	0.06214662654178948
sim_compute_performance-ego_median	0.06470448523759842
sim_compute_performance-ego_min	0.044275337999517266
sim_compute_robot_state-ego_max	0.07653329485938662
sim_compute_robot_state-ego_mean	0.06645382132641849
sim_compute_robot_state-ego_median	0.06826051324605942
sim_compute_robot_state-ego_min	0.04792765053835782
sim_compute_robot_state-npc0_max	0.07075058751636082
sim_compute_robot_state-npc0_mean	0.0633154882039049
sim_compute_robot_state-npc0_median	0.06501454512278239
sim_compute_robot_state-npc0_min	0.04482061212713069
sim_compute_robot_state-npc1_max	0.07045869266285616
sim_compute_robot_state-npc1_mean	0.06311145424176552
sim_compute_robot_state-npc1_median	0.06463762846860019
sim_compute_robot_state-npc1_min	0.04463608698411421
sim_compute_robot_state-npc2_max	0.07434869474834865
sim_compute_robot_state-npc2_mean	0.06245773170208012
sim_compute_robot_state-npc2_median	0.06341825998746432
sim_compute_robot_state-npc2_min	0.04669378020546653
sim_compute_robot_state-npc3_max	0.07018020749092102
sim_compute_robot_state-npc3_mean	0.06177494823189696
sim_compute_robot_state-npc3_median	0.06384660258437648
sim_compute_robot_state-npc3_min	0.04427168586037376
sim_compute_sim_state_max	0.04108725984891256
sim_compute_sim_state_mean	0.03581687288944614
sim_compute_sim_state_median	0.037078331498538744
sim_compute_sim_state_min	0.025178356604142624
sim_physics_max	0.21713595163254512
sim_physics_mean	0.19696749703633615
sim_physics_median	0.2030539313952128
sim_physics_min	0.14299599329630533
sim_render-ego_max	0.06438488310033624
sim_render-ego_mean	0.05751730765337639
sim_render-ego_median	0.058618820630587064
sim_render-ego_min	0.04346928813240745
simulation-passed	1
survival_time_max	1.800000000000001
survival_time_mean	1.323333333333334
survival_time_min	1.0000000000000002

No reset possible

22991

2412

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-05-17 04:47:40+00:00

2019-05-17 05:00:55+00:00

0:13:15

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22988

2417

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

yes

2019-05-17 04:41:20+00:00

2019-05-17 04:47:05+00:00

0:05:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.14468092254445522
agent_compute-ego_mean	0.1308318340220193
agent_compute-ego_median	0.1295960302706118
agent_compute-ego_min	0.12213953803567323
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1076204600157561, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05772285991244846, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1295960302706118, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09321753184000652, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037863987463491934, "sim_compute_performance-ego": 0.06376502690491853, "sim_compute_robot_state-ego": 0.07028130690256755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10682015325508866, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05676682790120443, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12731181873994715, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08656997306674134, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.035748107760560276, "sim_compute_performance-ego": 0.06023240556903914, "sim_compute_robot_state-ego": 0.06740412525102205}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10718690647798426, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.053937336977790386, "in-drivable-lane": 0, "agent_compute-ego": 0.12213953803567323, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08536829667932846, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03676623456618365, "sim_compute_performance-ego": 0.06134493210736443, "sim_compute_robot_state-ego": 0.07186105672050924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11015021324157714, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05966569900512695, "in-drivable-lane": 0, "agent_compute-ego": 0.1304308605194092, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08796448707580566, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03649927139282227, "sim_compute_performance-ego": 0.06304806709289551, "sim_compute_robot_state-ego": 0.06287601470947266}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10528943206690534, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06073552143724659, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14468092254445522, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09367075751099406, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03727357598799694, "sim_compute_performance-ego": 0.06319448917726928, "sim_compute_robot_state-ego": 0.0722095272209071}}
set_robot_commands_max	0.09367075751099406
set_robot_commands_mean	0.08935820923457521
set_robot_commands_median	0.08796448707580566
set_robot_commands_min	0.08536829667932846
sim_compute_performance-ego_max	0.06376502690491853
sim_compute_performance-ego_mean	0.06231698417029737
sim_compute_performance-ego_median	0.06304806709289551
sim_compute_performance-ego_min	0.06023240556903914
sim_compute_robot_state-ego_max	0.0722095272209071
sim_compute_robot_state-ego_mean	0.06892640616089571
sim_compute_robot_state-ego_median	0.07028130690256755
sim_compute_robot_state-ego_min	0.06287601470947266
sim_compute_sim_state_max	0.037863987463491934
sim_compute_sim_state_mean	0.03683023543421101
sim_compute_sim_state_median	0.03676623456618365
sim_compute_sim_state_min	0.035748107760560276
sim_physics_max	0.11015021324157714
sim_physics_mean	0.1074134330114623
sim_physics_median	0.10718690647798426
sim_physics_min	0.10528943206690534
sim_render-ego_max	0.06073552143724659
sim_render-ego_mean	0.05776564904676336
sim_render-ego_median	0.05772285991244846
sim_render-ego_min	0.053937336977790386
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

22969

2447

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-05-17 04:17:59+00:00

2019-05-17 04:40:45+00:00

0:22:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.339366254383536
survival_time_median	14.950000000000076
deviation-center-line_median	1.4012763877174623
in-drivable-lane_median	2.500000000000013

other stats

agent_compute-ego_max	0.16230473359425862
agent_compute-ego_mean	0.15666086371739704
agent_compute-ego_median	0.1584425481160482
agent_compute-ego_min	0.14875588655471805
deviation-center-line_max	1.5195321274570266
deviation-center-line_mean	1.174486624766163
deviation-center-line_min	0.26894128230124625
deviation-heading_max	8.502617994731201
deviation-heading_mean	7.58692926837743
deviation-heading_median	8.166880118443489
deviation-heading_min	5.592005976497815
driven_any_max	4.378506444052819
driven_any_mean	4.37850644405281
driven_any_median	4.37850644405281
driven_any_min	4.378506444052802
driven_lanedir_consec_max	-1.3108775667725403
driven_lanedir_consec_mean	-1.3430087925060197
driven_lanedir_consec_min	-1.375791811242363
driven_lanedir_max	-1.339366254383536
driven_lanedir_mean	-2.3543334685387003
driven_lanedir_median	-2.5973993077066466
driven_lanedir_min	-2.7107548643537447
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	3.5700000000000194
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.10768850644429524, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.060281148751576745, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15947402318318685, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09014412641525268, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.037864320278167725, "sim_compute_performance-ego": 0.06637497266133627, "sim_compute_robot_state-ego": 0.07115665753682454}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052802, "sim_physics": 0.11003500620524088, "survival_time": 14.950000000000076, "driven_lanedir": -2.44752976847699, "sim_render-ego": 0.05879507621129354, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.1584425481160482, "deviation-heading": 7.300247877354016, "set_robot_commands": 0.08890501578648885, "deviation-center-line": 1.1660826179431367, "driven_lanedir_consec": -1.375791811242363, "sim_compute_sim_state": 0.03743621031443278, "sim_compute_performance-ego": 0.0655603035291036, "sim_compute_robot_state-ego": 0.07081924597422282}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.09606300354003906, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.06144879897435506, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.14875588655471805, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.08191430568695068, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.03447505394617716, "sim_compute_performance-ego": 0.05969450871149699, "sim_compute_robot_state-ego": 0.0660016663869222}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052819, "sim_physics": 0.1097927474975586, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725837, "sim_render-ego": 0.0574702262878418, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.1543271271387736, "deviation-heading": 8.502617994731201, "set_robot_commands": 0.08922839403152466, "deviation-center-line": 1.516600708411943, "driven_lanedir_consec": -1.3215500552073602, "sim_compute_sim_state": 0.03897859255472819, "sim_compute_performance-ego": 0.06676249265670776, "sim_compute_robot_state-ego": 0.07030021508534749}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052814, "sim_physics": 0.10564478079477946, "survival_time": 14.950000000000076, "driven_lanedir": -2.5973993077066466, "sim_render-ego": 0.05999253829320272, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.16230473359425862, "deviation-heading": 8.166880118443489, "set_robot_commands": 0.09055798371632894, "deviation-center-line": 1.4012763877174623, "driven_lanedir_consec": -1.3674582749242976, "sim_compute_sim_state": 0.03919533252716065, "sim_compute_performance-ego": 0.06788738489151001, "sim_compute_robot_state-ego": 0.07092122157414754}}
set_robot_commands_max	0.09055798371632894
set_robot_commands_mean	0.08814996512730916
set_robot_commands_median	0.08922839403152466
set_robot_commands_min	0.08191430568695068
sim_compute_performance-ego_max	0.06788738489151001
sim_compute_performance-ego_mean	0.06525593249003094
sim_compute_performance-ego_median	0.06637497266133627
sim_compute_performance-ego_min	0.05969450871149699
sim_compute_robot_state-ego_max	0.07115665753682454
sim_compute_robot_state-ego_mean	0.06983980131149292
sim_compute_robot_state-ego_median	0.07081924597422282
sim_compute_robot_state-ego_min	0.0660016663869222
sim_compute_sim_state_max	0.03919533252716065
sim_compute_sim_state_mean	0.0375899019241333
sim_compute_sim_state_median	0.037864320278167725
sim_compute_sim_state_min	0.03447505394617716
sim_physics_max	0.11003500620524088
sim_physics_mean	0.10584480889638263
sim_physics_median	0.10768850644429524
sim_physics_min	0.09606300354003906
sim_render-ego_max	0.06144879897435506
sim_render-ego_mean	0.05959755770365397
sim_render-ego_median	0.05999253829320272
sim_render-ego_min	0.0574702262878418
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22955

2472

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-17 04:09:11+00:00

2019-05-17 04:17:21+00:00

0:08:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.14565808243221706
agent_compute-ego_mean	0.13631657833298827
agent_compute-ego_median	0.13562668800354005
agent_compute-ego_min	0.12634257893813283
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.15821173014464202, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05563365088568793, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14565808243221706, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08642429334146005, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.036166513407671894, "sim_compute_performance-ego": 0.06291518387971101, "sim_compute_robot_state-ego": 0.06601080188044796, "sim_compute_robot_state-npc0": 0.06401440832349989, "sim_compute_robot_state-npc1": 0.06293187318024812, "sim_compute_robot_state-npc2": 0.06268769723397714, "sim_compute_robot_state-npc3": 0.061932259135776095}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1606271457672119, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.054636049270629886, "in-drivable-lane": 0, "agent_compute-ego": 0.13562668800354005, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09244461059570312, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03521843910217285, "sim_compute_performance-ego": 0.05779995918273926, "sim_compute_robot_state-ego": 0.05590242385864258, "sim_compute_robot_state-npc0": 0.06620275497436523, "sim_compute_robot_state-npc1": 0.08011174201965332, "sim_compute_robot_state-npc2": 0.06284611701965331, "sim_compute_robot_state-npc3": 0.0591876220703125}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12700644292329488, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.04688173532485962, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.12634257893813283, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08046422506633558, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.029713737337212817, "sim_compute_performance-ego": 0.052965989238337466, "sim_compute_robot_state-ego": 0.055323748212111626, "sim_compute_robot_state-npc0": 0.05610183979335584, "sim_compute_robot_state-npc1": 0.05460271709843686, "sim_compute_robot_state-npc2": 0.05724144295642251, "sim_compute_robot_state-npc3": 0.0546414946254931}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18573508383352547, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05700436724892145, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13899476316910755, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08832041824920268, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03740670711179323, "sim_compute_performance-ego": 0.06295156177086166, "sim_compute_robot_state-ego": 0.066396752490273, "sim_compute_robot_state-npc0": 0.06496730031846445, "sim_compute_robot_state-npc1": 0.06433687934392615, "sim_compute_robot_state-npc2": 0.06893576247782647, "sim_compute_robot_state-npc3": 0.06463940535919575}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1558683259146554, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05609491041728428, "in-drivable-lane": 0, "agent_compute-ego": 0.13496077912194387, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08738267421722412, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03717180660792759, "sim_compute_performance-ego": 0.06099998950958252, "sim_compute_robot_state-ego": 0.06271012340273176, "sim_compute_robot_state-npc0": 0.06099933385848999, "sim_compute_robot_state-npc1": 0.08293798140117101, "sim_compute_robot_state-npc2": 0.06154865026473999, "sim_compute_robot_state-npc3": 0.06306268487657819}}
set_robot_commands_max	0.09244461059570312
set_robot_commands_mean	0.08700724429398511
set_robot_commands_median	0.08738267421722412
set_robot_commands_min	0.08046422506633558
sim_compute_performance-ego_max	0.06295156177086166
sim_compute_performance-ego_mean	0.05952653671624638
sim_compute_performance-ego_median	0.06099998950958252
sim_compute_performance-ego_min	0.052965989238337466
sim_compute_robot_state-ego_max	0.066396752490273
sim_compute_robot_state-ego_mean	0.06126876996884138
sim_compute_robot_state-ego_median	0.06271012340273176
sim_compute_robot_state-ego_min	0.055323748212111626
sim_compute_robot_state-npc0_max	0.06620275497436523
sim_compute_robot_state-npc0_mean	0.062457127453635075
sim_compute_robot_state-npc0_median	0.06401440832349989
sim_compute_robot_state-npc0_min	0.05610183979335584
sim_compute_robot_state-npc1_max	0.08293798140117101
sim_compute_robot_state-npc1_mean	0.0689842386086871
sim_compute_robot_state-npc1_median	0.06433687934392615
sim_compute_robot_state-npc1_min	0.05460271709843686
sim_compute_robot_state-npc2_max	0.06893576247782647
sim_compute_robot_state-npc2_mean	0.06265193399052389
sim_compute_robot_state-npc2_median	0.06268769723397714
sim_compute_robot_state-npc2_min	0.05724144295642251
sim_compute_robot_state-npc3_max	0.06463940535919575
sim_compute_robot_state-npc3_mean	0.06069269321347113
sim_compute_robot_state-npc3_median	0.061932259135776095
sim_compute_robot_state-npc3_min	0.0546414946254931
sim_compute_sim_state_max	0.03740670711179323
sim_compute_sim_state_mean	0.035135440713355684
sim_compute_sim_state_median	0.036166513407671894
sim_compute_sim_state_min	0.029713737337212817
sim_physics_max	0.18573508383352547
sim_physics_mean	0.1574897457166659
sim_physics_median	0.15821173014464202
sim_physics_min	0.12700644292329488
sim_render-ego_max	0.05700436724892145
sim_render-ego_mean	0.054050142629476626
sim_render-ego_median	0.05563365088568793
sim_render-ego_min	0.04688173532485962
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

22950

2484

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 04:07:15+00:00

2019-05-17 04:08:37+00:00

0:01:22

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22935

2503

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

yes

2019-05-17 04:06:01+00:00

2019-05-17 04:06:50+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22920

2512

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

yes

2019-05-17 04:04:30+00:00

2019-05-17 04:05:25+00:00

0:00:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22914

2528

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

yes

2019-05-17 04:01:04+00:00

2019-05-17 04:04:10+00:00

0:03:06

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22900

2551

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

yes

2019-05-17 03:49:08+00:00

2019-05-17 04:00:45+00:00

0:11:37

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22894

2561

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

yes

2019-05-17 03:43:13+00:00

2019-05-17 03:48:45+00:00

0:05:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.1166759393545397
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.07335840100827425
agent_compute-ego_mean	0.06896229195626642
agent_compute-ego_median	0.07018094261487325
agent_compute-ego_min	0.06239583889643351
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871981
deviation-heading_mean	0.4194004386292103
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829774
driven_any_max	0.922682252912863
driven_any_mean	0.6324710235085378
driven_any_median	0.609146202404747
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572027
driven_lanedir_consec_mean	0.4245071231796042
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572027
driven_lanedir_mean	0.4245071231796042
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11121665256124148, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.060719469903220594, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.068386198769153, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09335710632968956, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0394919623791332, "sim_compute_performance-ego": 0.06682284113386987, "sim_compute_robot_state-ego": 0.07330119777733171}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.10624462763468424, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.0564763863881429, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06239583889643351, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.0862854798634847, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.037352542082468666, "sim_compute_performance-ego": 0.061874922116597494, "sim_compute_robot_state-ego": 0.06756792465845744}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.14028200236233798, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06270514835010875, "in-drivable-lane": 0, "agent_compute-ego": 0.0704900784925981, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09526532346552068, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.03897812149741433, "sim_compute_performance-ego": 0.07625582001426003, "sim_compute_robot_state-ego": 0.0899157307364724}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.11159890393416089, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05581318338712057, "in-drivable-lane": 0, "agent_compute-ego": 0.07018094261487325, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0944691151380539, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03677787880102793, "sim_compute_performance-ego": 0.06092542906602224, "sim_compute_robot_state-ego": 0.06812359889348348}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.10988779689954677, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.058256284050319504, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07335840100827425, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.0874632337818975, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.0365890938302745, "sim_compute_performance-ego": 0.06198041853697404, "sim_compute_robot_state-ego": 0.06775163567584494}}
set_robot_commands_max	0.09526532346552068
set_robot_commands_mean	0.09136805171572927
set_robot_commands_median	0.09335710632968956
set_robot_commands_min	0.0862854798634847
sim_compute_performance-ego_max	0.07625582001426003
sim_compute_performance-ego_mean	0.06557188617354473
sim_compute_performance-ego_median	0.06198041853697404
sim_compute_performance-ego_min	0.06092542906602224
sim_compute_robot_state-ego_max	0.0899157307364724
sim_compute_robot_state-ego_mean	0.073332017548318
sim_compute_robot_state-ego_median	0.06812359889348348
sim_compute_robot_state-ego_min	0.06756792465845744
sim_compute_sim_state_max	0.0394919623791332
sim_compute_sim_state_mean	0.03783791971806373
sim_compute_sim_state_median	0.037352542082468666
sim_compute_sim_state_min	0.0365890938302745
sim_physics_max	0.14028200236233798
sim_physics_mean	0.11584599667839428
sim_physics_median	0.11121665256124148
sim_physics_min	0.10624462763468424
sim_render-ego_max	0.06270514835010875
sim_render-ego_mean	0.05879409441578246
sim_render-ego_median	0.058256284050319504
sim_render-ego_min	0.05581318338712057
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

22864

2612

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

yes

2019-05-17 03:18:10+00:00

2019-05-17 03:42:43+00:00

0:24:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2875407694053156
survival_time_median	2.849999999999998
deviation-center-line_median	0.11031194850197353
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.1182025764502731
agent_compute-ego_mean	0.07218527742849506
agent_compute-ego_median	0.06858522464067508
agent_compute-ego_min	0.055423399981330425
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.13746050030700233
deviation-center-line_min	0.07113819587235681
deviation-heading_max	1.4854398920276677
deviation-heading_mean	0.7236995121312619
deviation-heading_median	0.6953408166028192
deviation-heading_min	0.3118646573709166
driven_any_max	1.934434121703833
driven_any_mean	0.806757806634148
driven_any_median	0.8072381933001392
driven_any_min	0.20912585880423715
driven_lanedir_consec_max	0.7222251056746308
driven_lanedir_consec_mean	0.3962831867516217
driven_lanedir_consec_min	0.1917983424483971
driven_lanedir_max	0.7287863177121016
driven_lanedir_mean	0.3975640776898326
driven_lanedir_median	0.2875407694053156
driven_lanedir_min	0.1917983424483971
in-drivable-lane_max	4.04999999999999
in-drivable-lane_mean	1.2133333333333305
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.17883500133652286, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0584233381662024, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.06463591449231987, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.08577713334416769, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.037531683243900896, "sim_compute_performance-ego": 0.06391948389719768, "sim_compute_robot_state-ego": 0.07123779676046717, "sim_compute_robot_state-npc0": 0.06489387764988175, "sim_compute_robot_state-npc1": 0.06331586550517254, "sim_compute_robot_state-npc2": 0.06257144514336643, "sim_compute_robot_state-npc3": 0.06279304515884583}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.23798551382841887, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06869525379604763, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07832737322206851, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.1071468989054362, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04101046809443721, "sim_compute_performance-ego": 0.07112035044917354, "sim_compute_robot_state-ego": 0.07480189535352919, "sim_compute_robot_state-npc0": 0.07268694595054344, "sim_compute_robot_state-npc1": 0.07303886943393284, "sim_compute_robot_state-npc2": 0.07496632470024957, "sim_compute_robot_state-npc3": 0.07361095039932816}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.1974443105550913, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06241538891425499, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.06858522464067508, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.08893310718047313, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.037116472537700944, "sim_compute_performance-ego": 0.06509231604062594, "sim_compute_robot_state-ego": 0.07130264318906344, "sim_compute_robot_state-npc0": 0.06616582931616367, "sim_compute_robot_state-npc1": 0.06552791901123829, "sim_compute_robot_state-npc2": 0.06631394227345784, "sim_compute_robot_state-npc3": 0.065575394874964}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.20377247375354432, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06002271802801835, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.06670985723796644, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.08838319778442383, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.036127918644955286, "sim_compute_performance-ego": 0.06419750263816432, "sim_compute_robot_state-ego": 0.06676478971514785, "sim_compute_robot_state-npc0": 0.06667746159068325, "sim_compute_robot_state-npc1": 0.06615903503016422, "sim_compute_robot_state-npc2": 0.06477302417420504, "sim_compute_robot_state-npc3": 0.06414328541672021}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.1984773718792459, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.05932931278062904, "in-drivable-lane": 0, "agent_compute-ego": 0.07181513827780019, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.09556900936624278, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.0350753639055335, "sim_compute_performance-ego": 0.06727783576301906, "sim_compute_robot_state-ego": 0.07390937597855278, "sim_compute_robot_state-npc0": 0.06843996047973633, "sim_compute_robot_state-npc1": 0.06818456235139267, "sim_compute_robot_state-npc2": 0.18459471412326975, "sim_compute_robot_state-npc3": 0.06369316059610118}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.16499077806285783, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.05248020677005544, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.1182025764502731, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.08117310439839083, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.033624880454119516, "sim_compute_performance-ego": 0.05637503839006611, "sim_compute_robot_state-ego": 0.060294730990540744, "sim_compute_robot_state-npc0": 0.060158736565533805, "sim_compute_robot_state-npc1": 0.05897352742213829, "sim_compute_robot_state-npc2": 0.05925734837849935, "sim_compute_robot_state-npc3": 0.060294177017959895}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.16780497006007605, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.05462495258876256, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.06246045657566616, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.0823299561228071, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03312497309276036, "sim_compute_performance-ego": 0.0610404542514256, "sim_compute_robot_state-ego": 0.06297503198896136, "sim_compute_robot_state-npc0": 0.059922095707484656, "sim_compute_robot_state-npc1": 0.06074068716594151, "sim_compute_robot_state-npc2": 0.05891319683619907, "sim_compute_robot_state-npc3": 0.05983597721372332}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.20091888675950975, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.05903211358475358, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06831390890356613, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.09137611519800472, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.036463574187396326, "sim_compute_performance-ego": 0.06679608070687072, "sim_compute_robot_state-ego": 0.07907395166893529, "sim_compute_robot_state-npc0": 0.07055724810247552, "sim_compute_robot_state-npc1": 0.06620511943346834, "sim_compute_robot_state-npc2": 0.06762623460325476, "sim_compute_robot_state-npc3": 0.06700992910829309}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.19624717291011368, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06219665948734727, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.0715740530989891, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.0979364555935527, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.039325689160546594, "sim_compute_performance-ego": 0.06728293452151986, "sim_compute_robot_state-ego": 0.07608327754708223, "sim_compute_robot_state-npc0": 0.07211226917976557, "sim_compute_robot_state-npc1": 0.07026178060575973, "sim_compute_robot_state-npc2": 0.06738817414572072, "sim_compute_robot_state-npc3": 0.06714277489240779}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.21634794198549712, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06582980889540452, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07020743993612436, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.09335700365213248, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.03265473475823036, "sim_compute_performance-ego": 0.06209869568164532, "sim_compute_robot_state-ego": 0.06267233078296368, "sim_compute_robot_state-npc0": 0.06574597725501427, "sim_compute_robot_state-npc1": 0.06554730121905987, "sim_compute_robot_state-npc2": 0.06354972032400277, "sim_compute_robot_state-npc3": 0.06097202117626484}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.17440004666646322, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.05832966486612956, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06714889526367188, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09157020568847656, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.037905941009521486, "sim_compute_performance-ego": 0.06643189748128255, "sim_compute_robot_state-ego": 0.06670793533325195, "sim_compute_robot_state-npc0": 0.06693431536356607, "sim_compute_robot_state-npc1": 0.06619016647338867, "sim_compute_robot_state-npc2": 0.06830972989400227, "sim_compute_robot_state-npc3": 0.06821299235026042}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.16676324889773414, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.05391951969691685, "in-drivable-lane": 0, "agent_compute-ego": 0.06054502441769555, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.08312990551903135, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.031479869570050924, "sim_compute_performance-ego": 0.05435985610598609, "sim_compute_robot_state-ego": 0.05537143207731701, "sim_compute_robot_state-npc0": 0.05798929078238351, "sim_compute_robot_state-npc1": 0.056662616275605704, "sim_compute_robot_state-npc2": 0.0566919417608352, "sim_compute_robot_state-npc3": 0.058520566849481495}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.19464606462522996, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.05476085529770962, "in-drivable-lane": 1.15, "agent_compute-ego": 0.08149958211322163, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.08734471298927485, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.031736872916997866, "sim_compute_performance-ego": 0.05632791408272677, "sim_compute_robot_state-ego": 0.0803770242735397, "sim_compute_robot_state-npc0": 0.06277882775595021, "sim_compute_robot_state-npc1": 0.07397959398668866, "sim_compute_robot_state-npc2": 0.06278911856717842, "sim_compute_robot_state-npc3": 0.05542041534601256}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.1639129945210048, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.04902153355734689, "in-drivable-lane": 0, "agent_compute-ego": 0.07733031681605748, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.07930760724203927, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04580478157315936, "sim_compute_performance-ego": 0.05222690956933158, "sim_compute_robot_state-ego": 0.05570435523986816, "sim_compute_robot_state-npc0": 0.053854167461395264, "sim_compute_robot_state-npc1": 0.05543012278420584, "sim_compute_robot_state-npc2": 0.0686456561088562, "sim_compute_robot_state-npc3": 0.08756314856665474}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.1665807705299527, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.047918268278533335, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.055423399981330425, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0752409112219717, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.029193798700968426, "sim_compute_performance-ego": 0.05081833577623554, "sim_compute_robot_state-ego": 0.053795333002127854, "sim_compute_robot_state-npc0": 0.05575078608942967, "sim_compute_robot_state-npc1": 0.05264792722814223, "sim_compute_robot_state-npc2": 0.05182823012856876, "sim_compute_robot_state-npc3": 0.05162605117349064}}
set_robot_commands_max	0.1071468989054362
set_robot_commands_mean	0.08857168828042836
set_robot_commands_median	0.08838319778442383
set_robot_commands_min	0.0752409112219717
sim_compute_performance-ego_max	0.07112035044917354
sim_compute_performance-ego_mean	0.06169104035701805
sim_compute_performance-ego_median	0.06391948389719768
sim_compute_performance-ego_min	0.05081833577623554
sim_compute_robot_state-ego_max	0.0803770242735397
sim_compute_robot_state-ego_mean	0.06740479359342322
sim_compute_robot_state-ego_median	0.06676478971514785
sim_compute_robot_state-ego_min	0.053795333002127854
sim_compute_robot_state-npc0_max	0.07268694595054344
sim_compute_robot_state-npc0_mean	0.06431118595000046
sim_compute_robot_state-npc0_median	0.06574597725501427
sim_compute_robot_state-npc0_min	0.053854167461395264
sim_compute_robot_state-npc1_max	0.07397959398668866
sim_compute_robot_state-npc1_mean	0.0641910062617533
sim_compute_robot_state-npc1_median	0.06554730121905987
sim_compute_robot_state-npc1_min	0.05264792722814223
sim_compute_robot_state-npc2_max	0.18459471412326975
sim_compute_robot_state-npc2_mean	0.07188125341077775
sim_compute_robot_state-npc2_median	0.06477302417420504
sim_compute_robot_state-npc2_min	0.05182823012856876
sim_compute_robot_state-npc3_max	0.08756314856665474
sim_compute_robot_state-npc3_mean	0.06442759267603389
sim_compute_robot_state-npc3_median	0.06369316059610118
sim_compute_robot_state-npc3_min	0.05162605117349064
sim_compute_sim_state_max	0.04580478157315936
sim_compute_sim_state_mean	0.03587846812335193
sim_compute_sim_state_median	0.036127918644955286
sim_compute_sim_state_min	0.029193798700968426
sim_physics_max	0.23798551382841887
sim_physics_mean	0.1886085030914175
sim_physics_median	0.19464606462522996
sim_physics_min	0.1639129945210048
sim_render-ego_max	0.06869525379604763
sim_render-ego_mean	0.0577999729805408
sim_render-ego_median	0.0584233381662024
sim_render-ego_min	0.047918268278533335
simulation-passed	1
survival_time_max	6.999999999999983
survival_time_mean	3.043333333333329
survival_time_min	1.0500000000000005

No reset possible

22859

2621

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-17 03:09:29+00:00

2019-05-17 03:17:43+00:00

0:08:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.1534561061859131
agent_compute-ego_mean	0.1414709274175197
agent_compute-ego_median	0.14478258396449842
agent_compute-ego_min	0.11568454333714076
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16723294169814498, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06265779336293538, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14904036786821154, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09616708755493164, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.039799902174207896, "sim_compute_performance-ego": 0.06770446123900237, "sim_compute_robot_state-ego": 0.07606213181107133, "sim_compute_robot_state-npc0": 0.06834197044372559, "sim_compute_robot_state-npc1": 0.06981298217067013, "sim_compute_robot_state-npc2": 0.06802170806460911, "sim_compute_robot_state-npc3": 0.06818524554923729}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1938871192932129, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06411319732666015, "in-drivable-lane": 0, "agent_compute-ego": 0.1534561061859131, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.0921469497680664, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.0388402271270752, "sim_compute_performance-ego": 0.06790167808532716, "sim_compute_robot_state-ego": 0.07621310234069824, "sim_compute_robot_state-npc0": 0.06792044639587402, "sim_compute_robot_state-npc1": 0.06836292266845703, "sim_compute_robot_state-npc2": 0.06869984626770019, "sim_compute_robot_state-npc3": 0.06871854782104492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17380189895629883, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05855465562720048, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14478258396449842, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08797462676700793, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03692041572771574, "sim_compute_performance-ego": 0.06629693194439537, "sim_compute_robot_state-ego": 0.06878463531795301, "sim_compute_robot_state-npc0": 0.06442823221808985, "sim_compute_robot_state-npc1": 0.06438963350496794, "sim_compute_robot_state-npc2": 0.06297585525010761, "sim_compute_robot_state-npc3": 0.0636587425282127}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.17755194253559353, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05686872518515285, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1443910357318347, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09232374988024748, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03674666791022578, "sim_compute_performance-ego": 0.06376471096956277, "sim_compute_robot_state-ego": 0.06789554523516304, "sim_compute_robot_state-npc0": 0.06666616548465777, "sim_compute_robot_state-npc1": 0.06476785563215424, "sim_compute_robot_state-npc2": 0.0658590944507454, "sim_compute_robot_state-npc3": 0.06617600404763524}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.12418924910681588, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04441388164247785, "in-drivable-lane": 0, "agent_compute-ego": 0.11568454333714076, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07291548592703682, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.02986724036080497, "sim_compute_performance-ego": 0.049084254673549106, "sim_compute_robot_state-ego": 0.09195435898644584, "sim_compute_robot_state-npc0": 0.050221996647971015, "sim_compute_robot_state-npc1": 0.05239453486033848, "sim_compute_robot_state-npc2": 0.05204435757228306, "sim_compute_robot_state-npc3": 0.05192406688417707}}
set_robot_commands_max	0.09616708755493164
set_robot_commands_mean	0.08830557997945807
set_robot_commands_median	0.0921469497680664
set_robot_commands_min	0.07291548592703682
sim_compute_performance-ego_max	0.06790167808532716
sim_compute_performance-ego_mean	0.06295040738236736
sim_compute_performance-ego_median	0.06629693194439537
sim_compute_performance-ego_min	0.049084254673549106
sim_compute_robot_state-ego_max	0.09195435898644584
sim_compute_robot_state-ego_mean	0.07618195473826629
sim_compute_robot_state-ego_median	0.07606213181107133
sim_compute_robot_state-ego_min	0.06789554523516304
sim_compute_robot_state-npc0_max	0.06834197044372559
sim_compute_robot_state-npc0_mean	0.06351576223806364
sim_compute_robot_state-npc0_median	0.06666616548465777
sim_compute_robot_state-npc0_min	0.050221996647971015
sim_compute_robot_state-npc1_max	0.06981298217067013
sim_compute_robot_state-npc1_mean	0.06394558576731757
sim_compute_robot_state-npc1_median	0.06476785563215424
sim_compute_robot_state-npc1_min	0.05239453486033848
sim_compute_robot_state-npc2_max	0.06869984626770019
sim_compute_robot_state-npc2_mean	0.06352017232108907
sim_compute_robot_state-npc2_median	0.0658590944507454
sim_compute_robot_state-npc2_min	0.05204435757228306
sim_compute_robot_state-npc3_max	0.06871854782104492
sim_compute_robot_state-npc3_mean	0.06373252136606143
sim_compute_robot_state-npc3_median	0.06617600404763524
sim_compute_robot_state-npc3_min	0.05192406688417707
sim_compute_sim_state_max	0.039799902174207896
sim_compute_sim_state_mean	0.03643489066000592
sim_compute_sim_state_median	0.03692041572771574
sim_compute_sim_state_min	0.02986724036080497
sim_physics_max	0.1938871192932129
sim_physics_mean	0.1673326303180132
sim_physics_median	0.17380189895629883
sim_physics_min	0.12418924910681588
sim_render-ego_max	0.06411319732666015
sim_render-ego_mean	0.057321650628885334
sim_render-ego_median	0.05855465562720048
sim_render-ego_min	0.04441388164247785
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

22846

2633

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-17 03:00:54+00:00

2019-05-17 03:09:08+00:00

0:08:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.17755488838468278
agent_compute-ego_mean	0.15240288644407302
agent_compute-ego_median	0.14812106132507324
agent_compute-ego_min	0.1389357198642779
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1474917906301993, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05718990166982015, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14799557350299977, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08671904934777154, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037823504871792264, "sim_compute_performance-ego": 0.06051652078275328, "sim_compute_robot_state-ego": 0.06581000487009685, "sim_compute_robot_state-npc0": 0.06700247746926767, "sim_compute_robot_state-npc1": 0.06862560466483787, "sim_compute_robot_state-npc2": 0.06452735265096028, "sim_compute_robot_state-npc3": 0.06447519637920239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1798582363128662, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0553582763671875, "in-drivable-lane": 0, "agent_compute-ego": 0.14812106132507324, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09095892906188964, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.041527013778686526, "sim_compute_performance-ego": 0.05951970100402832, "sim_compute_robot_state-ego": 0.06276653289794921, "sim_compute_robot_state-npc0": 0.06634442329406738, "sim_compute_robot_state-npc1": 0.0697330379486084, "sim_compute_robot_state-npc2": 0.07164067268371582, "sim_compute_robot_state-npc3": 0.06951704025268554}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1732350368248789, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.061908085095255, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14940718914333145, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08969562618356001, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0374992991748609, "sim_compute_performance-ego": 0.07082227970424451, "sim_compute_robot_state-ego": 0.07192142699894152, "sim_compute_robot_state-npc0": 0.0634148120880127, "sim_compute_robot_state-npc1": 0.0668225696212367, "sim_compute_robot_state-npc2": 0.06538675019615575, "sim_compute_robot_state-npc3": 0.06416409894039757}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.17432209208041807, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05549545227726803, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1389357198642779, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0860226848457433, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0353407980520514, "sim_compute_performance-ego": 0.06215010111844992, "sim_compute_robot_state-ego": 0.06773116316976427, "sim_compute_robot_state-npc0": 0.06430658811255346, "sim_compute_robot_state-npc1": 0.06344874901107594, "sim_compute_robot_state-npc2": 0.063851552673533, "sim_compute_robot_state-npc3": 0.06429938726787325}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1675068395478385, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05958873885018485, "in-drivable-lane": 0, "agent_compute-ego": 0.17755488838468278, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0904221705027989, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.039251361574445455, "sim_compute_performance-ego": 0.06594703027180263, "sim_compute_robot_state-ego": 0.07235567910330636, "sim_compute_robot_state-npc0": 0.06686457565852574, "sim_compute_robot_state-npc1": 0.06242257356643677, "sim_compute_robot_state-npc2": 0.06847038439341954, "sim_compute_robot_state-npc3": 0.07189409221921648}}
set_robot_commands_max	0.09095892906188964
set_robot_commands_mean	0.08876369198835268
set_robot_commands_median	0.08969562618356001
set_robot_commands_min	0.0860226848457433
sim_compute_performance-ego_max	0.07082227970424451
sim_compute_performance-ego_mean	0.06379112657625574
sim_compute_performance-ego_median	0.06215010111844992
sim_compute_performance-ego_min	0.05951970100402832
sim_compute_robot_state-ego_max	0.07235567910330636
sim_compute_robot_state-ego_mean	0.06811696140801164
sim_compute_robot_state-ego_median	0.06773116316976427
sim_compute_robot_state-ego_min	0.06276653289794921
sim_compute_robot_state-npc0_max	0.06700247746926767
sim_compute_robot_state-npc0_mean	0.06558657532448539
sim_compute_robot_state-npc0_median	0.06634442329406738
sim_compute_robot_state-npc0_min	0.0634148120880127
sim_compute_robot_state-npc1_max	0.0697330379486084
sim_compute_robot_state-npc1_mean	0.06621050696243913
sim_compute_robot_state-npc1_median	0.0668225696212367
sim_compute_robot_state-npc1_min	0.06242257356643677
sim_compute_robot_state-npc2_max	0.07164067268371582
sim_compute_robot_state-npc2_mean	0.06677534251955689
sim_compute_robot_state-npc2_median	0.06538675019615575
sim_compute_robot_state-npc2_min	0.063851552673533
sim_compute_robot_state-npc3_max	0.07189409221921648
sim_compute_robot_state-npc3_mean	0.06686996301187505
sim_compute_robot_state-npc3_median	0.06447519637920239
sim_compute_robot_state-npc3_min	0.06416409894039757
sim_compute_sim_state_max	0.041527013778686526
sim_compute_sim_state_mean	0.038288395490367305
sim_compute_sim_state_median	0.037823504871792264
sim_compute_sim_state_min	0.0353407980520514
sim_physics_max	0.1798582363128662
sim_physics_mean	0.1684827990792402
sim_physics_median	0.1732350368248789
sim_physics_min	0.1474917906301993
sim_render-ego_max	0.061908085095255
sim_render-ego_mean	0.05790809085194311
sim_render-ego_median	0.05718990166982015
sim_render-ego_min	0.0553582763671875
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

22840

2656

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 02:45:15+00:00

2019-05-17 03:00:17+00:00

0:15:02

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22838

2664

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

yes

2019-05-17 02:44:05+00:00

2019-05-17 02:44:41+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22836

2668

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

yes

2019-05-17 02:43:11+00:00

2019-05-17 02:43:48+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22834

2669

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

yes

2019-05-17 02:42:11+00:00

2019-05-17 02:42:49+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22833

2672

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

yes

2019-05-17 02:41:13+00:00

2019-05-17 02:41:50+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22832

2673

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

yes

2019-05-17 02:39:15+00:00

2019-05-17 02:40:05+00:00

0:00:50

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22814

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

yes

2019-05-17 02:07:29+00:00

2019-05-17 02:38:42+00:00

0:31:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9602362195441052
survival_time_median	14.950000000000076
deviation-center-line_median	1.021174797456825
in-drivable-lane_median	2.000000000000014

other stats

agent_compute-ego_max	0.0938571432362432
agent_compute-ego_mean	0.09003650160916912
agent_compute-ego_median	0.09168352444966632
agent_compute-ego_min	0.08523769060770671
deviation-center-line_max	1.1865681824346217
deviation-center-line_mean	0.8422476215084849
deviation-center-line_min	0.22683483670237156
deviation-heading_max	7.407076536464438
deviation-heading_mean	5.131962918230649
deviation-heading_median	6.918808897111082
deviation-heading_min	1.7999697601183915
driven_any_max	2.3486040874619123
driven_any_mean	1.8037203711095755
driven_any_median	2.34853514961698
driven_any_min	0.870297727821699
driven_lanedir_consec_max	1.1675097080656451
driven_lanedir_consec_mean	0.8914021715212262
driven_lanedir_consec_min	0.4567130552402529
driven_lanedir_max	1.6272722403920228
driven_lanedir_mean	1.2062607784220605
driven_lanedir_median	1.3949694402438109
driven_lanedir_min	0.4567130552402529
in-drivable-lane_max	2.9000000000000163
in-drivable-lane_mean	1.790000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.102609716283609, "sim_physics": 0.19969594478607175, "survival_time": 7.299999999999982, "driven_lanedir": 0.9926581727749428, "sim_render-ego": 0.06827630245522277, "in-drivable-lane": 0, "agent_compute-ego": 0.08733000983930614, "deviation-heading": 2.356275461590165, "set_robot_commands": 0.1067028911146399, "deviation-center-line": 0.6919579175542566, "driven_lanedir_consec": 0.9926581727749428, "sim_compute_sim_state": 0.04228615760803223, "sim_compute_performance-ego": 0.07619614143894143, "sim_compute_robot_state-ego": 0.0840391165589633, "sim_compute_robot_state-npc0": 0.07720329826825285, "sim_compute_robot_state-npc1": 0.07738273437709024, "sim_compute_robot_state-npc2": 0.07755920495072456, "sim_compute_robot_state-npc3": 0.07746556033826854}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3486040874619123, "sim_physics": 0.18007017135620118, "survival_time": 14.950000000000076, "driven_lanedir": 1.6272722403920228, "sim_render-ego": 0.06299665768941244, "in-drivable-lane": 2.000000000000014, "agent_compute-ego": 0.08523769060770671, "deviation-heading": 6.918808897111082, "set_robot_commands": 0.1002035148938497, "deviation-center-line": 1.021174797456825, "driven_lanedir_consec": 1.1675097080656451, "sim_compute_sim_state": 0.039476267496744794, "sim_compute_performance-ego": 0.07073665301005046, "sim_compute_robot_state-ego": 0.07598819335301717, "sim_compute_robot_state-npc0": 0.07347880125045776, "sim_compute_robot_state-npc1": 0.06996205965677897, "sim_compute_robot_state-npc2": 0.0703823455174764, "sim_compute_robot_state-npc3": 0.0801578942934672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34853514961698, "sim_physics": 0.21263033787409463, "survival_time": 14.950000000000076, "driven_lanedir": 1.559690983459272, "sim_render-ego": 0.0698622989654541, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.09207413991292318, "deviation-heading": 7.177683935869171, "set_robot_commands": 0.116681067943573, "deviation-center-line": 1.1865681824346217, "driven_lanedir_consec": 0.9602362195441052, "sim_compute_sim_state": 0.04474099079767863, "sim_compute_performance-ego": 0.07698423067728678, "sim_compute_robot_state-ego": 0.08749618291854859, "sim_compute_robot_state-npc0": 0.07919610897699991, "sim_compute_robot_state-npc1": 0.08090429147084555, "sim_compute_robot_state-npc2": 0.07916534662246705, "sim_compute_robot_state-npc3": 0.08194517612457275}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485551743636783, "sim_physics": 0.215033225218455, "survival_time": 14.950000000000076, "driven_lanedir": 1.3949694402438109, "sim_render-ego": 0.06965188423792522, "in-drivable-lane": 2.9000000000000163, "agent_compute-ego": 0.09168352444966632, "deviation-heading": 7.407076536464438, "set_robot_commands": 0.110607004960378, "deviation-center-line": 1.0847023733943495, "driven_lanedir_consec": 0.8798937019811857, "sim_compute_sim_state": 0.04389683961868286, "sim_compute_performance-ego": 0.0781196101506551, "sim_compute_robot_state-ego": 0.08688937584559123, "sim_compute_robot_state-npc0": 0.07749598105748494, "sim_compute_robot_state-npc1": 0.07634430329004924, "sim_compute_robot_state-npc2": 0.07618060191472371, "sim_compute_robot_state-npc3": 0.07653478066126505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.870297727821699, "sim_physics": 0.2109789869059687, "survival_time": 5.749999999999988, "driven_lanedir": 0.4567130552402529, "sim_render-ego": 0.07200115452642027, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0938571432362432, "deviation-heading": 1.7999697601183915, "set_robot_commands": 0.11676840574845024, "deviation-center-line": 0.22683483670237156, "driven_lanedir_consec": 0.4567130552402529, "sim_compute_sim_state": 0.045192871923032014, "sim_compute_performance-ego": 0.07922624090443486, "sim_compute_robot_state-ego": 0.08332344967385998, "sim_compute_robot_state-npc0": 0.07942629067794137, "sim_compute_robot_state-npc1": 0.0771606673365054, "sim_compute_robot_state-npc2": 0.07840663661127505, "sim_compute_robot_state-npc3": 0.0770810894344164}}
set_robot_commands_max	0.11676840574845024
set_robot_commands_mean	0.11019257693217815
set_robot_commands_median	0.110607004960378
set_robot_commands_min	0.1002035148938497
sim_compute_performance-ego_max	0.07922624090443486
sim_compute_performance-ego_mean	0.07625257523627373
sim_compute_performance-ego_median	0.07698423067728678
sim_compute_performance-ego_min	0.07073665301005046
sim_compute_robot_state-ego_max	0.08749618291854859
sim_compute_robot_state-ego_mean	0.08354726366999606
sim_compute_robot_state-ego_median	0.0840391165589633
sim_compute_robot_state-ego_min	0.07598819335301717
sim_compute_robot_state-npc0_max	0.07942629067794137
sim_compute_robot_state-npc0_mean	0.07736009604622737
sim_compute_robot_state-npc0_median	0.07749598105748494
sim_compute_robot_state-npc0_min	0.07347880125045776
sim_compute_robot_state-npc1_max	0.08090429147084555
sim_compute_robot_state-npc1_mean	0.07635081122625388
sim_compute_robot_state-npc1_median	0.0771606673365054
sim_compute_robot_state-npc1_min	0.06996205965677897
sim_compute_robot_state-npc2_max	0.07916534662246705
sim_compute_robot_state-npc2_mean	0.07633882712333336
sim_compute_robot_state-npc2_median	0.07755920495072456
sim_compute_robot_state-npc2_min	0.0703823455174764
sim_compute_robot_state-npc3_max	0.08194517612457275
sim_compute_robot_state-npc3_mean	0.07863690017039798
sim_compute_robot_state-npc3_median	0.07746556033826854
sim_compute_robot_state-npc3_min	0.07653478066126505
sim_compute_sim_state_max	0.045192871923032014
sim_compute_sim_state_mean	0.043118625488834106
sim_compute_sim_state_median	0.04389683961868286
sim_compute_sim_state_min	0.039476267496744794
sim_physics_max	0.215033225218455
sim_physics_mean	0.20368173322815825
sim_physics_median	0.2109789869059687
sim_physics_min	0.18007017135620118
sim_render-ego_max	0.07200115452642027
sim_render-ego_mean	0.06855765957488695
sim_render-ego_median	0.06965188423792522
sim_render-ego_min	0.06299665768941244
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.58000000000004
survival_time_min	5.749999999999988

No reset possible

22804

2727

test for ppo

step1-simulation

error

yes

2019-05-17 02:04:14+00:00

2019-05-17 02:07:20+00:00

0:03:06

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22797

2742

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

yes

2019-05-17 02:02:12+00:00

2019-05-17 02:04:07+00:00

0:01:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22783

2770

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 01:53:54+00:00

2019-05-17 02:01:39+00:00

0:07:45

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22779

2778

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

yes

2019-05-17 01:52:37+00:00

2019-05-17 01:53:25+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22769

2792

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

yes

2019-05-17 01:50:38+00:00

2019-05-17 01:52:17+00:00

0:01:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22763

2809

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

yes

2019-05-17 01:41:48+00:00

2019-05-17 01:50:26+00:00

0:08:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.1559074350765773
agent_compute-ego_mean	0.1499730514809082
agent_compute-ego_median	0.1486142309088456
agent_compute-ego_min	0.14205538749694824
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14510134414390283, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05809372442739981, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14748904440138075, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09429979765856708, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03778462498276322, "sim_compute_performance-ego": 0.061406736020688656, "sim_compute_robot_state-ego": 0.06499405701955159, "sim_compute_robot_state-npc0": 0.07010740704006618, "sim_compute_robot_state-npc1": 0.06767352863594338, "sim_compute_robot_state-npc2": 0.06557511841809308, "sim_compute_robot_state-npc3": 0.06733031184585006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.16853354454040528, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.059233083724975585, "in-drivable-lane": 0, "agent_compute-ego": 0.14205538749694824, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08395487785339356, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03897865295410157, "sim_compute_performance-ego": 0.06436549186706543, "sim_compute_robot_state-ego": 0.07243961334228516, "sim_compute_robot_state-npc0": 0.06808126449584961, "sim_compute_robot_state-npc1": 0.06930939674377441, "sim_compute_robot_state-npc2": 0.06777627944946289, "sim_compute_robot_state-npc3": 0.07024139404296875}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17166478696622348, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06126999541332847, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1486142309088456, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09309128083680804, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03787882077066522, "sim_compute_performance-ego": 0.06754340309845774, "sim_compute_robot_state-ego": 0.07014299066443193, "sim_compute_robot_state-npc0": 0.06648039817810059, "sim_compute_robot_state-npc1": 0.06371013428035535, "sim_compute_robot_state-npc2": 0.06884633239946868, "sim_compute_robot_state-npc3": 0.06831363941493787}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18433020990106125, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06066191950930825, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15579915952078904, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09552024587800231, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03861528408678272, "sim_compute_performance-ego": 0.06733104247081129, "sim_compute_robot_state-ego": 0.07582670223863819, "sim_compute_robot_state-npc0": 0.07070825069765502, "sim_compute_robot_state-npc1": 0.06713490848299823, "sim_compute_robot_state-npc2": 0.06675769105742249, "sim_compute_robot_state-npc3": 0.0690347242958938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.14658770390919276, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05775103398731777, "in-drivable-lane": 0, "agent_compute-ego": 0.1559074350765773, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08932435512542725, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.035695944513593404, "sim_compute_performance-ego": 0.06526746068681989, "sim_compute_robot_state-ego": 0.07160726615360805, "sim_compute_robot_state-npc0": 0.07116939340318952, "sim_compute_robot_state-npc1": 0.06779411009379796, "sim_compute_robot_state-npc2": 0.06299062286104475, "sim_compute_robot_state-npc3": 0.06655628340584892}}
set_robot_commands_max	0.09552024587800231
set_robot_commands_mean	0.09123811147043966
set_robot_commands_median	0.09309128083680804
set_robot_commands_min	0.08395487785339356
sim_compute_performance-ego_max	0.06754340309845774
sim_compute_performance-ego_mean	0.0651828268287686
sim_compute_performance-ego_median	0.06526746068681989
sim_compute_performance-ego_min	0.061406736020688656
sim_compute_robot_state-ego_max	0.07582670223863819
sim_compute_robot_state-ego_mean	0.07100212588370299
sim_compute_robot_state-ego_median	0.07160726615360805
sim_compute_robot_state-ego_min	0.06499405701955159
sim_compute_robot_state-npc0_max	0.07116939340318952
sim_compute_robot_state-npc0_mean	0.06930934276297218
sim_compute_robot_state-npc0_median	0.07010740704006618
sim_compute_robot_state-npc0_min	0.06648039817810059
sim_compute_robot_state-npc1_max	0.06930939674377441
sim_compute_robot_state-npc1_mean	0.06712441564737386
sim_compute_robot_state-npc1_median	0.06767352863594338
sim_compute_robot_state-npc1_min	0.06371013428035535
sim_compute_robot_state-npc2_max	0.06884633239946868
sim_compute_robot_state-npc2_mean	0.06638920883709838
sim_compute_robot_state-npc2_median	0.06675769105742249
sim_compute_robot_state-npc2_min	0.06299062286104475
sim_compute_robot_state-npc3_max	0.07024139404296875
sim_compute_robot_state-npc3_mean	0.06829527060109988
sim_compute_robot_state-npc3_median	0.06831363941493787
sim_compute_robot_state-npc3_min	0.06655628340584892
sim_compute_sim_state_max	0.03897865295410157
sim_compute_sim_state_mean	0.037790665461581226
sim_compute_sim_state_median	0.03787882077066522
sim_compute_sim_state_min	0.035695944513593404
sim_physics_max	0.18433020990106125
sim_physics_mean	0.1632435178921571
sim_physics_median	0.16853354454040528
sim_physics_min	0.14510134414390283
sim_render-ego_max	0.06126999541332847
sim_render-ego_mean	0.05940195141246598
sim_render-ego_median	0.059233083724975585
sim_render-ego_min	0.05775103398731777
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

22760

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-17 01:35:33+00:00

2019-05-17 01:41:00+00:00

0:05:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15226617513918408
agent_compute-ego_mean	0.14444131860046333
agent_compute-ego_median	0.14464850425720216
agent_compute-ego_min	0.13723482805139878
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10430833145424172, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05900004616490117, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1487106791249028, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09096628648263436, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03971023912783022, "sim_compute_performance-ego": 0.06606966919369167, "sim_compute_robot_state-ego": 0.07431791888342963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10403157215492398, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060144840502271465, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15226617513918408, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08579170002656825, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03728515494103525, "sim_compute_performance-ego": 0.06455132540534525, "sim_compute_robot_state-ego": 0.06786246860728544}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10839073798235724, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05524265064912684, "in-drivable-lane": 0, "agent_compute-ego": 0.13723482805139878, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0963271084953757, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0372778247384464, "sim_compute_performance-ego": 0.05286411678089815, "sim_compute_robot_state-ego": 0.06323925186606015}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11692477226257324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.055064363479614256, "in-drivable-lane": 0, "agent_compute-ego": 0.14464850425720216, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08280410766601562, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03682717323303222, "sim_compute_performance-ego": 0.06430780410766601, "sim_compute_robot_state-ego": 0.06965743064880371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09983240199994438, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05774584902992731, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13934640642962878, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08488985858386076, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03511207314986217, "sim_compute_performance-ego": 0.06217827978013437, "sim_compute_robot_state-ego": 0.06558218786988078}}
set_robot_commands_max	0.0963271084953757
set_robot_commands_mean	0.08815581225089093
set_robot_commands_median	0.08579170002656825
set_robot_commands_min	0.08280410766601562
sim_compute_performance-ego_max	0.06606966919369167
sim_compute_performance-ego_mean	0.06199423905354708
sim_compute_performance-ego_median	0.06430780410766601
sim_compute_performance-ego_min	0.05286411678089815
sim_compute_robot_state-ego_max	0.07431791888342963
sim_compute_robot_state-ego_mean	0.06813185157509194
sim_compute_robot_state-ego_median	0.06786246860728544
sim_compute_robot_state-ego_min	0.06323925186606015
sim_compute_sim_state_max	0.03971023912783022
sim_compute_sim_state_mean	0.03724249303804125
sim_compute_sim_state_median	0.0372778247384464
sim_compute_sim_state_min	0.03511207314986217
sim_physics_max	0.11692477226257324
sim_physics_mean	0.10669756317080813
sim_physics_median	0.10430833145424172
sim_physics_min	0.09983240199994438
sim_render-ego_max	0.060144840502271465
sim_render-ego_mean	0.0574395499651682
sim_render-ego_median	0.05774584902992731
sim_render-ego_min	0.055064363479614256
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

22754

2823

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-17 01:26:57+00:00

2019-05-17 01:35:03+00:00

0:08:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.15595546855202205
agent_compute-ego_mean	0.14596976042591217
agent_compute-ego_median	0.14207749707358225
agent_compute-ego_min	0.13884836656075936
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1458232800165812, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05868619018130832, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13884836656075936, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09211504017865216, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037284268273247614, "sim_compute_performance-ego": 0.06601948649794967, "sim_compute_robot_state-ego": 0.0673741411279749, "sim_compute_robot_state-npc0": 0.06222545659100568, "sim_compute_robot_state-npc1": 0.06492252703066226, "sim_compute_robot_state-npc2": 0.0637532737520006, "sim_compute_robot_state-npc3": 0.06451940978014911}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.18890170097351075, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.060622606277465824, "in-drivable-lane": 0, "agent_compute-ego": 0.15157960891723632, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08953378677368164, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.035479459762573246, "sim_compute_performance-ego": 0.0655416202545166, "sim_compute_robot_state-ego": 0.0664102840423584, "sim_compute_robot_state-npc0": 0.06467576026916504, "sim_compute_robot_state-npc1": 0.06622018814086914, "sim_compute_robot_state-npc2": 0.06514637947082519, "sim_compute_robot_state-npc3": 0.06683792114257812}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.15931676563463712, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05520483067161158, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14138786102596082, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08366188250089947, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03713033701244153, "sim_compute_performance-ego": 0.061776895272104365, "sim_compute_robot_state-ego": 0.0678449178996839, "sim_compute_robot_state-npc0": 0.06307367588344373, "sim_compute_robot_state-npc1": 0.06254569166585018, "sim_compute_robot_state-npc2": 0.06476194921292756, "sim_compute_robot_state-npc3": 0.06156619912699649}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18522678749470772, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.061763896217829066, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15595546855202205, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09329423723341544, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03887544704388968, "sim_compute_performance-ego": 0.06996500642993782, "sim_compute_robot_state-ego": 0.07591260234011879, "sim_compute_robot_state-npc0": 0.0686301792724223, "sim_compute_robot_state-npc1": 0.06718306601802006, "sim_compute_robot_state-npc2": 0.07018521465832674, "sim_compute_robot_state-npc3": 0.06788197650185114}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.16896741730826242, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06107671771730695, "in-drivable-lane": 0, "agent_compute-ego": 0.14207749707358225, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08752220017569405, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.050330093928745816, "sim_compute_performance-ego": 0.06659397057124547, "sim_compute_robot_state-ego": 0.07504447868892125, "sim_compute_robot_state-npc0": 0.06805997235434395, "sim_compute_robot_state-npc1": 0.07056593894958496, "sim_compute_robot_state-npc2": 0.07016749041421073, "sim_compute_robot_state-npc3": 0.07104979242597308}}
set_robot_commands_max	0.09329423723341544
set_robot_commands_mean	0.08922542937246855
set_robot_commands_median	0.08953378677368164
set_robot_commands_min	0.08366188250089947
sim_compute_performance-ego_max	0.06996500642993782
sim_compute_performance-ego_mean	0.06597939580515078
sim_compute_performance-ego_median	0.06601948649794967
sim_compute_performance-ego_min	0.061776895272104365
sim_compute_robot_state-ego_max	0.07591260234011879
sim_compute_robot_state-ego_mean	0.07051728481981145
sim_compute_robot_state-ego_median	0.0678449178996839
sim_compute_robot_state-ego_min	0.0664102840423584
sim_compute_robot_state-npc0_max	0.0686301792724223
sim_compute_robot_state-npc0_mean	0.06533300887407614
sim_compute_robot_state-npc0_median	0.06467576026916504
sim_compute_robot_state-npc0_min	0.06222545659100568
sim_compute_robot_state-npc1_max	0.07056593894958496
sim_compute_robot_state-npc1_mean	0.06628748236099732
sim_compute_robot_state-npc1_median	0.06622018814086914
sim_compute_robot_state-npc1_min	0.06254569166585018
sim_compute_robot_state-npc2_max	0.07018521465832674
sim_compute_robot_state-npc2_mean	0.06680286150165816
sim_compute_robot_state-npc2_median	0.06514637947082519
sim_compute_robot_state-npc2_min	0.0637532737520006
sim_compute_robot_state-npc3_max	0.07104979242597308
sim_compute_robot_state-npc3_mean	0.06637105979550958
sim_compute_robot_state-npc3_median	0.06683792114257812
sim_compute_robot_state-npc3_min	0.06156619912699649
sim_compute_sim_state_max	0.050330093928745816
sim_compute_sim_state_mean	0.039819921204179584
sim_compute_sim_state_median	0.037284268273247614
sim_compute_sim_state_min	0.035479459762573246
sim_physics_max	0.18890170097351075
sim_physics_mean	0.16964719028553987
sim_physics_median	0.16896741730826242
sim_physics_min	0.1458232800165812
sim_render-ego_max	0.061763896217829066
sim_render-ego_mean	0.05947084821310435
sim_render-ego_median	0.060622606277465824
sim_render-ego_min	0.05520483067161158
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

22749

2832

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 01:26:00+00:00

2019-05-17 01:26:32+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22745

2835

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 01:25:14+00:00

2019-05-17 01:25:46+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22743

2844

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 01:24:20+00:00

2019-05-17 01:24:59+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22741

2851

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 01:22:51+00:00

2019-05-17 01:23:24+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22739

2851

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 01:22:03+00:00

2019-05-17 01:22:36+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22738

2852

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-17 01:20:30+00:00

2019-05-17 01:21:14+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22725

2881

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

yes

2019-05-17 01:02:36+00:00

2019-05-17 01:20:15+00:00

0:17:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6591401084474304
survival_time_median	6.949999999999983
deviation-center-line_median	0.33899838427143014
in-drivable-lane_median	1.999999999999993

other stats

agent_compute-ego_max	0.1482979797181629
agent_compute-ego_mean	0.14588299976676952
agent_compute-ego_median	0.14574089797411097
agent_compute-ego_min	0.14342349038707267
deviation-center-line_max	0.4843179558881834
deviation-center-line_mean	0.3389764450725529
deviation-center-line_min	0.22729035014002288
deviation-heading_max	1.1492236283129806
deviation-heading_mean	0.9399487053044556
deviation-heading_median	1.0007157377877205
deviation-heading_min	0.7390440083021812
driven_any_max	1.6381859911990262
driven_any_mean	1.0096556470575024
driven_any_median	0.9900915586687412
driven_any_min	0.4167848967141688
driven_lanedir_consec_max	1.2206700211390982
driven_lanedir_consec_mean	0.7159598687953472
driven_lanedir_consec_min	0.3888322247827789
driven_lanedir_max	1.2206700211390982
driven_lanedir_mean	0.7159598687953472
driven_lanedir_median	0.6591401084474304
driven_lanedir_min	0.3888322247827789
in-drivable-lane_max	4.85000000000004
in-drivable-lane_mean	1.8200000000000132
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.15695819237249362, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05963070101017574, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14342349038707267, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.08734116794394074, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03668187333525513, "sim_compute_performance-ego": 0.0650164789433102, "sim_compute_robot_state-ego": 0.07090188616471325, "sim_compute_robot_state-npc0": 0.06577892783734439, "sim_compute_robot_state-npc1": 0.06411214698132851, "sim_compute_robot_state-npc2": 0.06558819468930471, "sim_compute_robot_state-npc3": 0.06437573330007869}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.1766417102208213, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.05932898748488653, "in-drivable-lane": 0, "agent_compute-ego": 0.1482979797181629, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.08988079570588611, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.037908160497271824, "sim_compute_performance-ego": 0.07130238744947645, "sim_compute_robot_state-ego": 0.07214847443595765, "sim_compute_robot_state-npc0": 0.0702479188404386, "sim_compute_robot_state-npc1": 0.0703021004086449, "sim_compute_robot_state-npc2": 0.06627434775942848, "sim_compute_robot_state-npc3": 0.06407720323592897}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.1603261555565728, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.05931348058912489, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.14522811147901746, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.0909968736436632, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.0376341003841824, "sim_compute_performance-ego": 0.06510992262098525, "sim_compute_robot_state-ego": 0.06911187065972223, "sim_compute_robot_state-npc0": 0.06749868922763401, "sim_compute_robot_state-npc1": 0.06374116155836318, "sim_compute_robot_state-npc2": 0.06320112970140246, "sim_compute_robot_state-npc3": 0.06395583682590061}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.16556838031188684, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.05902793550271592, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.14574089797411097, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.08951417751575945, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.03741940704908239, "sim_compute_performance-ego": 0.06456921507136613, "sim_compute_robot_state-ego": 0.07045380640689129, "sim_compute_robot_state-npc0": 0.06675630121187132, "sim_compute_robot_state-npc1": 0.06694721406505953, "sim_compute_robot_state-npc2": 0.0642062244327387, "sim_compute_robot_state-npc3": 0.06531034636607368}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.1529825528462728, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.05588086446126302, "in-drivable-lane": 0, "agent_compute-ego": 0.14672451927548363, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.08554129751901778, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.034632868236965604, "sim_compute_performance-ego": 0.06459725849212163, "sim_compute_robot_state-ego": 0.06810735899304586, "sim_compute_robot_state-npc0": 0.06509120880611359, "sim_compute_robot_state-npc1": 0.06304209194486103, "sim_compute_robot_state-npc2": 0.06112901369730631, "sim_compute_robot_state-npc3": 0.0610498171004038}}
set_robot_commands_max	0.0909968736436632
set_robot_commands_mean	0.08865486246565346
set_robot_commands_median	0.08951417751575945
set_robot_commands_min	0.08554129751901778
sim_compute_performance-ego_max	0.07130238744947645
sim_compute_performance-ego_mean	0.06611905251545193
sim_compute_performance-ego_median	0.0650164789433102
sim_compute_performance-ego_min	0.06456921507136613
sim_compute_robot_state-ego_max	0.07214847443595765
sim_compute_robot_state-ego_mean	0.07014467933206606
sim_compute_robot_state-ego_median	0.07045380640689129
sim_compute_robot_state-ego_min	0.06810735899304586
sim_compute_robot_state-npc0_max	0.0702479188404386
sim_compute_robot_state-npc0_mean	0.06707460918468038
sim_compute_robot_state-npc0_median	0.06675630121187132
sim_compute_robot_state-npc0_min	0.06509120880611359
sim_compute_robot_state-npc1_max	0.0703021004086449
sim_compute_robot_state-npc1_mean	0.06562894299165144
sim_compute_robot_state-npc1_median	0.06411214698132851
sim_compute_robot_state-npc1_min	0.06304209194486103
sim_compute_robot_state-npc2_max	0.06627434775942848
sim_compute_robot_state-npc2_mean	0.06407978205603614
sim_compute_robot_state-npc2_median	0.0642062244327387
sim_compute_robot_state-npc2_min	0.06112901369730631
sim_compute_robot_state-npc3_max	0.06531034636607368
sim_compute_robot_state-npc3_mean	0.06375378736567715
sim_compute_robot_state-npc3_median	0.06407720323592897
sim_compute_robot_state-npc3_min	0.0610498171004038
sim_compute_sim_state_max	0.037908160497271824
sim_compute_sim_state_mean	0.03685528190055147
sim_compute_sim_state_median	0.03741940704908239
sim_compute_sim_state_min	0.034632868236965604
sim_physics_max	0.1766417102208213
sim_physics_mean	0.16249539826160947
sim_physics_median	0.1603261555565728
sim_physics_min	0.1529825528462728
sim_render-ego_max	0.05963070101017574
sim_render-ego_mean	0.058636393809633224
sim_render-ego_median	0.05931348058912489
sim_render-ego_min	0.05588086446126302
simulation-passed	1
survival_time_max	11.250000000000025
survival_time_mean	7.070000000000005
survival_time_min	3.149999999999997

No reset possible

22684

2977

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

error

yes

2019-05-17 00:16:00+00:00

2019-05-17 01:02:15+00:00

0:46:15

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22677

2989

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

yes

2019-05-17 00:09:45+00:00

2019-05-17 00:15:53+00:00

0:06:08

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22673

3002

challenge-aido_LF-template-tensorflow

step1-simulation

error

yes

2019-05-17 00:09:05+00:00

2019-05-17 00:09:31+00:00

0:00:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22666

3003

challenge-aido_LF-template-tensorflow

step1-simulation

error

yes

2019-05-17 00:08:08+00:00

2019-05-17 00:08:36+00:00

0:00:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22658

3019

challenge-aido_LF-template-pytorch

step1-simulation

error

yes

2019-05-17 00:06:27+00:00

2019-05-17 00:07:10+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22647

3031

challenge-aido_LF-template-pytorch

step1-simulation

error

yes

2019-05-17 00:04:42+00:00

2019-05-17 00:06:12+00:00

0:01:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22632

3051

challenge-aido_LF-template-tensorflow

step1-simulation

error

yes

2019-05-17 00:00:42+00:00

2019-05-17 00:04:34+00:00

0:03:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22626

3078

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

error

yes

2019-05-16 23:52:01+00:00

2019-05-17 00:00:14+00:00

0:08:13

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22605

3114

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-05-16 23:24:24+00:00

2019-05-16 23:51:27+00:00

0:27:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.185353061495548
survival_time_median	14.950000000000076
deviation-center-line_median	0.9435008220616988
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.28572375535964967
agent_compute-ego_mean	0.2666672357657017
agent_compute-ego_median	0.256938803990682
agent_compute-ego_min	0.25221720774968465
deviation-center-line_max	0.9822461139602914
deviation-center-line_mean	0.8606329948319832
deviation-center-line_min	0.5558214411706502
deviation-heading_max	3.2600620014175123
deviation-heading_mean	2.7476538296717954
deviation-heading_median	2.654186664499502
deviation-heading_min	2.334890485276209
driven_any_max	2.3249545528410955
driven_any_mean	2.168326033245046
driven_any_median	2.226723976325144
driven_any_min	1.9668256472301673
driven_lanedir_consec_max	2.27781394553347
driven_lanedir_consec_mean	2.0950503876198985
driven_lanedir_consec_min	1.8348894432223557
driven_lanedir_max	2.27781394553347
driven_lanedir_mean	2.0950503876198985
driven_lanedir_median	2.185353061495548
driven_lanedir_min	1.8348894432223557
in-drivable-lane_max	1.0000000000000142
in-drivable-lane_mean	0.20000000000000284
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9668256472301673, "sim_physics": 0.12550162919711716, "survival_time": 13.65000000000006, "driven_lanedir": 1.899485956723519, "sim_render-ego": 0.06567252075279152, "in-drivable-lane": 0, "agent_compute-ego": 0.28487812555753267, "deviation-heading": 2.93529075502866, "set_robot_commands": 0.09840394376398442, "deviation-center-line": 0.5558214411706502, "driven_lanedir_consec": 1.899485956723519, "sim_compute_sim_state": 0.04072246184715858, "sim_compute_performance-ego": 0.0730905864701603, "sim_compute_robot_state-ego": 0.07988009610018887}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.321044713767219, "sim_physics": 0.11436676184336345, "survival_time": 14.950000000000076, "driven_lanedir": 2.2777095311245996, "sim_render-ego": 0.0660379449526469, "in-drivable-lane": 0, "agent_compute-ego": 0.28572375535964967, "deviation-heading": 2.5538392421370943, "set_robot_commands": 0.1003089435895284, "deviation-center-line": 0.9709933754294416, "driven_lanedir_consec": 2.2777095311245996, "sim_compute_sim_state": 0.04115877389907837, "sim_compute_performance-ego": 0.07202286799748739, "sim_compute_robot_state-ego": 0.08049248774846395}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3249545528410955, "sim_physics": 0.10777249972025552, "survival_time": 14.950000000000076, "driven_lanedir": 2.27781394553347, "sim_render-ego": 0.057764697869618735, "in-drivable-lane": 0, "agent_compute-ego": 0.256938803990682, "deviation-heading": 2.654186664499502, "set_robot_commands": 0.09034234126408897, "deviation-center-line": 0.9435008220616988, "driven_lanedir_consec": 2.27781394553347, "sim_compute_sim_state": 0.03809483289718628, "sim_compute_performance-ego": 0.06409759998321533, "sim_compute_robot_state-ego": 0.06853599468866985}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0020812760616047, "sim_physics": 0.10309399843215944, "survival_time": 14.950000000000076, "driven_lanedir": 1.8348894432223557, "sim_render-ego": 0.05772845347722371, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.25221720774968465, "deviation-heading": 3.2600620014175123, "set_robot_commands": 0.08923460880915324, "deviation-center-line": 0.8506032215378343, "driven_lanedir_consec": 1.8348894432223557, "sim_compute_sim_state": 0.03678608973821004, "sim_compute_performance-ego": 0.0691389004389445, "sim_compute_robot_state-ego": 0.07210917949676514}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.226723976325144, "sim_physics": 0.10789947907129924, "survival_time": 14.950000000000076, "driven_lanedir": 2.185353061495548, "sim_render-ego": 0.06056863069534302, "in-drivable-lane": 0, "agent_compute-ego": 0.25357828617095945, "deviation-heading": 2.334890485276209, "set_robot_commands": 0.09022313435872396, "deviation-center-line": 0.9822461139602914, "driven_lanedir_consec": 2.185353061495548, "sim_compute_sim_state": 0.037215991020202635, "sim_compute_performance-ego": 0.0681192684173584, "sim_compute_robot_state-ego": 0.07108312129974365}}
set_robot_commands_max	0.1003089435895284
set_robot_commands_mean	0.0937025943570958
set_robot_commands_median	0.09034234126408897
set_robot_commands_min	0.08923460880915324
sim_compute_performance-ego_max	0.0730905864701603
sim_compute_performance-ego_mean	0.06929384466143318
sim_compute_performance-ego_median	0.0691389004389445
sim_compute_performance-ego_min	0.06409759998321533
sim_compute_robot_state-ego_max	0.08049248774846395
sim_compute_robot_state-ego_mean	0.07442017586676629
sim_compute_robot_state-ego_median	0.07210917949676514
sim_compute_robot_state-ego_min	0.06853599468866985
sim_compute_sim_state_max	0.04115877389907837
sim_compute_sim_state_mean	0.03879562988036718
sim_compute_sim_state_median	0.03809483289718628
sim_compute_sim_state_min	0.03678608973821004
sim_physics_max	0.12550162919711716
sim_physics_mean	0.11172687365283895
sim_physics_median	0.10789947907129924
sim_physics_min	0.10309399843215944
sim_render-ego_max	0.0660379449526469
sim_render-ego_mean	0.061554449549524784
sim_render-ego_median	0.06056863069534302
sim_render-ego_min	0.05772845347722371
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.690000000000072
survival_time_min	13.65000000000006

No reset possible

22591

3129

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-05-16 23:02:18+00:00

2019-05-16 23:23:52+00:00

0:21:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.16856000774427
survival_time_median	6.349999999999985
deviation-center-line_median	0.261454195067992
in-drivable-lane_median	1.2499999999999956

other stats

agent_compute-ego_max	0.317485676037045
agent_compute-ego_mean	0.2834679131972922
agent_compute-ego_median	0.27834692892137464
agent_compute-ego_min	0.26769306109501767
deviation-center-line_max	0.9937739318733424
deviation-center-line_mean	0.3858564961356631
deviation-center-line_min	0.1812231171505083
deviation-heading_max	3.8466902743659857
deviation-heading_mean	1.4336950455195177
deviation-heading_median	0.9695337732365992
deviation-heading_min	0.6082458187507025
driven_any_max	3.676583339028152
driven_any_mean	1.7037200613580763
driven_any_median	1.6279652113260263
driven_any_min	0.4131691185990866
driven_lanedir_consec_max	3.343597617415085
driven_lanedir_consec_mean	1.3788437844171837
driven_lanedir_consec_min	0.3826134589156941
driven_lanedir_max	3.343597617415085
driven_lanedir_mean	1.3845739374030934
driven_lanedir_median	1.181930880706367
driven_lanedir_min	0.3826134589156941
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	1.049999999999999
in-drivable-lane_min	0.04999999999999982
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1318692695106831, "sim_physics": 0.17917161721449631, "survival_time": 4.549999999999992, "driven_lanedir": 0.7628928668010202, "sim_render-ego": 0.06362644394675454, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.27834692892137464, "deviation-heading": 0.6082458187507025, "set_robot_commands": 0.09718789897122226, "deviation-center-line": 0.18672340840732257, "driven_lanedir_consec": 0.7628928668010202, "sim_compute_sim_state": 0.04096486542251084, "sim_compute_performance-ego": 0.06959338502569513, "sim_compute_robot_state-ego": 0.07444040329901727, "sim_compute_robot_state-npc0": 0.07453418302012015, "sim_compute_robot_state-npc1": 0.07145873530880435, "sim_compute_robot_state-npc2": 0.06739550894433326, "sim_compute_robot_state-npc3": 0.07110863203530783}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.676583339028152, "sim_physics": 0.19607020457585653, "survival_time": 14.950000000000076, "driven_lanedir": 3.343597617415085, "sim_render-ego": 0.06474701960881551, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.2859421396255493, "deviation-heading": 3.8466902743659857, "set_robot_commands": 0.09752729574839274, "deviation-center-line": 0.9937739318733424, "driven_lanedir_consec": 3.343597617415085, "sim_compute_sim_state": 0.039962621529897054, "sim_compute_performance-ego": 0.07278361638387044, "sim_compute_robot_state-ego": 0.07829826593399047, "sim_compute_robot_state-npc0": 0.0723578929901123, "sim_compute_robot_state-npc1": 0.07154470761617025, "sim_compute_robot_state-npc2": 0.07185405254364013, "sim_compute_robot_state-npc3": 0.07172663370768229}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6690133683264354, "sim_physics": 0.170373876278217, "survival_time": 6.499999999999985, "driven_lanedir": 1.181930880706367, "sim_render-ego": 0.06336484872377836, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.26769306109501767, "deviation-heading": 0.9695337732365992, "set_robot_commands": 0.09318355596982517, "deviation-center-line": 0.261454195067992, "driven_lanedir_consec": 1.16856000774427, "sim_compute_sim_state": 0.038661749546344465, "sim_compute_performance-ego": 0.07028356882242057, "sim_compute_robot_state-ego": 0.0740081475331233, "sim_compute_robot_state-npc0": 0.06866020606114315, "sim_compute_robot_state-npc1": 0.06780773126162015, "sim_compute_robot_state-npc2": 0.06831292189084566, "sim_compute_robot_state-npc3": 0.06916013864370493}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6279652113260263, "sim_physics": 0.19669378273130403, "survival_time": 6.349999999999985, "driven_lanedir": 1.2518348631773013, "sim_render-ego": 0.0663460915482889, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.317485676037045, "deviation-heading": 1.076518730305054, "set_robot_commands": 0.0970139954033799, "deviation-center-line": 0.30610782817915033, "driven_lanedir_consec": 1.236554971209848, "sim_compute_sim_state": 0.04111687217171737, "sim_compute_performance-ego": 0.07763962858305203, "sim_compute_robot_state-ego": 0.08117839858287901, "sim_compute_robot_state-npc0": 0.07106538644925815, "sim_compute_robot_state-npc1": 0.07153979061156746, "sim_compute_robot_state-npc2": 0.07328325556957815, "sim_compute_robot_state-npc3": 0.07432144270168514}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4131691185990866, "sim_physics": 0.1824802946537099, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3826134589156941, "sim_render-ego": 0.06134634829582052, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.26787176030747434, "deviation-heading": 0.6674866309392474, "set_robot_commands": 0.0917362152261937, "deviation-center-line": 0.1812231171505083, "driven_lanedir_consec": 0.3826134589156941, "sim_compute_sim_state": 0.03951794035891269, "sim_compute_performance-ego": 0.07144335482982879, "sim_compute_robot_state-ego": 0.07529659981423235, "sim_compute_robot_state-npc0": 0.07196412187941531, "sim_compute_robot_state-npc1": 0.0716857707246821, "sim_compute_robot_state-npc2": 0.06979329535301695, "sim_compute_robot_state-npc3": 0.06791410547621707}}
set_robot_commands_max	0.09752729574839274
set_robot_commands_mean	0.09532979226380275
set_robot_commands_median	0.0970139954033799
set_robot_commands_min	0.0917362152261937
sim_compute_performance-ego_max	0.07763962858305203
sim_compute_performance-ego_mean	0.07234871072897339
sim_compute_performance-ego_median	0.07144335482982879
sim_compute_performance-ego_min	0.06959338502569513
sim_compute_robot_state-ego_max	0.08117839858287901
sim_compute_robot_state-ego_mean	0.07664436303264849
sim_compute_robot_state-ego_median	0.07529659981423235
sim_compute_robot_state-ego_min	0.0740081475331233
sim_compute_robot_state-npc0_max	0.07453418302012015
sim_compute_robot_state-npc0_mean	0.07171635808000981
sim_compute_robot_state-npc0_median	0.07196412187941531
sim_compute_robot_state-npc0_min	0.06866020606114315
sim_compute_robot_state-npc1_max	0.0716857707246821
sim_compute_robot_state-npc1_mean	0.07080734710456886
sim_compute_robot_state-npc1_median	0.07153979061156746
sim_compute_robot_state-npc1_min	0.06780773126162015
sim_compute_robot_state-npc2_max	0.07328325556957815
sim_compute_robot_state-npc2_mean	0.07012780686028283
sim_compute_robot_state-npc2_median	0.06979329535301695
sim_compute_robot_state-npc2_min	0.06739550894433326
sim_compute_robot_state-npc3_max	0.07432144270168514
sim_compute_robot_state-npc3_mean	0.07084619051291945
sim_compute_robot_state-npc3_median	0.07110863203530783
sim_compute_robot_state-npc3_min	0.06791410547621707
sim_compute_sim_state_max	0.04111687217171737
sim_compute_sim_state_mean	0.04004480980587648
sim_compute_sim_state_median	0.039962621529897054
sim_compute_sim_state_min	0.038661749546344465
sim_physics_max	0.19669378273130403
sim_physics_mean	0.18495795509071672
sim_physics_median	0.1824802946537099
sim_physics_min	0.170373876278217
sim_render-ego_max	0.0663460915482889
sim_render-ego_mean	0.06388615042469156
sim_render-ego_median	0.06362644394675454
sim_render-ego_min	0.06134634829582052
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.940000000000009
survival_time_min	2.3499999999999996

No reset possible

22552

3185

First test - TH

step1-simulation

error

yes

2019-05-16 22:32:04+00:00

2019-05-16 23:01:51+00:00

0:29:47

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22541

3195

Anastasiya Nikolskaya 🇷🇺

NN Solution

step1-simulation

success

yes

2019-05-16 22:23:42+00:00

2019-05-16 22:31:49+00:00

0:08:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6920724731953904
survival_time_median	3.999999999999994
deviation-center-line_median	0.2344202649171729
in-drivable-lane_median	0.6999999999999975

other stats

agent_compute-ego_max	0.11095846110376818
agent_compute-ego_mean	0.10805905903605165
agent_compute-ego_median	0.10989526682679758
agent_compute-ego_min	0.10198181867599489
deviation-center-line_max	0.6179791521957764
deviation-center-line_mean	0.28226346712945316
deviation-center-line_min	0.12321310762075308
deviation-heading_max	1.3808930492427236
deviation-heading_mean	0.7404860802660196
deviation-heading_median	0.585094901543844
deviation-heading_min	0.2909049870120278
driven_any_max	2.128820712372678
driven_any_mean	0.9941443397815296
driven_any_median	1.0247402910688082
driven_any_min	0.312040871215342
driven_lanedir_consec_max	1.6140708931485974
driven_lanedir_consec_mean	0.7506079719491037
driven_lanedir_consec_min	0.3063101498086782
driven_lanedir_max	1.6140708931485974
driven_lanedir_mean	0.7506079719491037
driven_lanedir_median	0.6920724731953904
driven_lanedir_min	0.3063101498086782
in-drivable-lane_max	1.5499999999999945
in-drivable-lane_mean	0.7299999999999974
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0953025972027035, "sim_physics": 0.12091727866682896, "survival_time": 4.299999999999993, "driven_lanedir": 0.6920724731953904, "sim_render-ego": 0.06806608133537825, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.10995813580446465, "deviation-heading": 0.3443619430804727, "set_robot_commands": 0.10368213819902997, "deviation-center-line": 0.2344202649171729, "driven_lanedir_consec": 0.6920724731953904, "sim_compute_sim_state": 0.04178746633751448, "sim_compute_performance-ego": 0.07154757754747258, "sim_compute_robot_state-ego": 0.07671415528585744}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0247402910688082, "sim_physics": 0.11499017775058748, "survival_time": 3.999999999999994, "driven_lanedir": 0.7527271628855262, "sim_render-ego": 0.06318644285202027, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.10198181867599489, "deviation-heading": 1.1011755204510298, "set_robot_commands": 0.11489853858947754, "deviation-center-line": 0.2881328674723111, "driven_lanedir_consec": 0.7527271628855262, "sim_compute_sim_state": 0.04066879153251648, "sim_compute_performance-ego": 0.07649149596691132, "sim_compute_robot_state-ego": 0.0788007915019989}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.312040871215342, "sim_physics": 0.13957401801799907, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3063101498086782, "sim_render-ego": 0.06597886414363466, "in-drivable-lane": 0, "agent_compute-ego": 0.11095846110376818, "deviation-heading": 0.2909049870120278, "set_robot_commands": 0.10233324971692316, "deviation-center-line": 0.14757194344125227, "driven_lanedir_consec": 0.3063101498086782, "sim_compute_sim_state": 0.04384497938484981, "sim_compute_performance-ego": 0.0752502885358087, "sim_compute_robot_state-ego": 0.08258096925143538}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4098172270481152, "sim_physics": 0.13124869267145792, "survival_time": 1.800000000000001, "driven_lanedir": 0.3878591807073266, "sim_render-ego": 0.06691813468933105, "in-drivable-lane": 0, "agent_compute-ego": 0.10750161276923284, "deviation-heading": 0.585094901543844, "set_robot_commands": 0.11168216996722752, "deviation-center-line": 0.12321310762075308, "driven_lanedir_consec": 0.3878591807073266, "sim_compute_sim_state": 0.04315455092324151, "sim_compute_performance-ego": 0.07439152399698894, "sim_compute_robot_state-ego": 0.08240810367796156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.128820712372678, "sim_physics": 0.12075197321813812, "survival_time": 7.94999999999998, "driven_lanedir": 1.6140708931485974, "sim_render-ego": 0.06879470633260859, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10989526682679758, "deviation-heading": 1.3808930492427236, "set_robot_commands": 0.10756664006215222, "deviation-center-line": 0.6179791521957764, "driven_lanedir_consec": 1.6140708931485974, "sim_compute_sim_state": 0.04432784236452115, "sim_compute_performance-ego": 0.07552501840411492, "sim_compute_robot_state-ego": 0.08393438507176046}}
set_robot_commands_max	0.11489853858947754
set_robot_commands_mean	0.10803254730696207
set_robot_commands_median	0.10756664006215222
set_robot_commands_min	0.10233324971692316
sim_compute_performance-ego_max	0.07649149596691132
sim_compute_performance-ego_mean	0.07464118089025928
sim_compute_performance-ego_median	0.0752502885358087
sim_compute_performance-ego_min	0.07154757754747258
sim_compute_robot_state-ego_max	0.08393438507176046
sim_compute_robot_state-ego_mean	0.08088768095780274
sim_compute_robot_state-ego_median	0.08240810367796156
sim_compute_robot_state-ego_min	0.07671415528585744
sim_compute_sim_state_max	0.04432784236452115
sim_compute_sim_state_mean	0.04275672610852869
sim_compute_sim_state_median	0.04315455092324151
sim_compute_sim_state_min	0.04066879153251648
sim_physics_max	0.13957401801799907
sim_physics_mean	0.1254964280650023
sim_physics_median	0.12091727866682896
sim_physics_min	0.11499017775058748
sim_render-ego_max	0.06879470633260859
sim_render-ego_mean	0.06658884587059456
sim_render-ego_median	0.06691813468933105
sim_render-ego_min	0.06318644285202027
simulation-passed	1
survival_time_max	7.94999999999998
survival_time_mean	3.8999999999999937
survival_time_min	1.4500000000000006

No reset possible

22532

3206

Masaya Kambara 🇯🇵

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-16 22:06:34+00:00

2019-05-16 22:23:20+00:00

0:16:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.1786513749290915
agent_compute-ego_mean	0.15511499553906033
agent_compute-ego_median	0.15421850802534717
agent_compute-ego_min	0.11623128822871616
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13090297469386347, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06537042282245777, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1634766569843999, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10200279730337636, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04054001525596336, "sim_compute_performance-ego": 0.07363123363918728, "sim_compute_robot_state-ego": 0.08463266160753039}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12238131317437864, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06139179304534314, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15154617907954196, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.097060666364782, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04071442753660912, "sim_compute_performance-ego": 0.0688319112740311, "sim_compute_robot_state-ego": 0.07585417523103602}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14113751579733455, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07002411169164321, "in-drivable-lane": 0, "agent_compute-ego": 0.1786513749290915, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10744397780474496, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04417044976178337, "sim_compute_performance-ego": 0.07728802456575282, "sim_compute_robot_state-ego": 0.0939787836635814}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13242959022521972, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05832149505615234, "in-drivable-lane": 0, "agent_compute-ego": 0.15406731605529786, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09924959182739258, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03535835266113281, "sim_compute_performance-ego": 0.06810334205627441, "sim_compute_robot_state-ego": 0.07241825103759765}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12005576604529272, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06051766721508171, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1570009249675123, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10113134565232676, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03917969631243356, "sim_compute_performance-ego": 0.07023061076297035, "sim_compute_robot_state-ego": 0.0783809136740769}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1183214284935776, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06255046688780493, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15386468050431232, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09103096747884944, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.038152159476766784, "sim_compute_performance-ego": 0.06904157327145946, "sim_compute_robot_state-ego": 0.07460363057194924}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.11440151504107884, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06487809334482465, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1778689750603267, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10350126028060912, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.04193691270692008, "sim_compute_performance-ego": 0.07234878199441093, "sim_compute_robot_state-ego": 0.08581473997661046}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13488984107971191, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06528980391366142, "in-drivable-lane": 0, "agent_compute-ego": 0.16036438941955566, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10076136816115606, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.043496892565772646, "sim_compute_performance-ego": 0.07254217919849214, "sim_compute_robot_state-ego": 0.08162582488287062}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11515435525926492, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0646961907208976, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15421850802534717, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.1007219169099452, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.039628259206222274, "sim_compute_performance-ego": 0.06549430701692226, "sim_compute_robot_state-ego": 0.06895461324918067}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.11664018630981446, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06300766251303933, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1502367539839311, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09209509329362348, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.0407971902327104, "sim_compute_performance-ego": 0.0679886211048473, "sim_compute_robot_state-ego": 0.07497472763061523}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.11014222479485848, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05945420574832272, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15672748119800123, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10148693679215072, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.039686298989630366, "sim_compute_performance-ego": 0.06494466979782303, "sim_compute_robot_state-ego": 0.06995265205185135}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12621081726891653, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.043009979384286065, "in-drivable-lane": 0, "agent_compute-ego": 0.11623128822871616, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.07045072317123413, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.02983286551066807, "sim_compute_performance-ego": 0.05280645404543195, "sim_compute_robot_state-ego": 0.05368912220001221}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10853787964465572, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05786459586199592, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1476902073504878, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.1026014206456203, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04034359314862419, "sim_compute_performance-ego": 0.06512239867565679, "sim_compute_robot_state-ego": 0.07003468158198338}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09216491381327312, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05247796906365289, "in-drivable-lane": 0, "agent_compute-ego": 0.1407825681898329, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.07400597466362847, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03179698520236545, "sim_compute_performance-ego": 0.05449600572939272, "sim_compute_robot_state-ego": 0.06576668774640118}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.1217414187450035, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06764821678984399, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16399762910955093, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10235999612247244, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04244034196816239, "sim_compute_performance-ego": 0.07420291152654909, "sim_compute_robot_state-ego": 0.08231404949637021}}
set_robot_commands_max	0.10744397780474496
set_robot_commands_mean	0.09639360243146082
set_robot_commands_median	0.10076136816115606
set_robot_commands_min	0.07045072317123413
sim_compute_performance-ego_max	0.07728802456575282
sim_compute_performance-ego_mean	0.06780486831061344
sim_compute_performance-ego_median	0.0688319112740311
sim_compute_performance-ego_min	0.05280645404543195
sim_compute_robot_state-ego_max	0.0939787836635814
sim_compute_robot_state-ego_mean	0.07553303430677778
sim_compute_robot_state-ego_median	0.07497472763061523
sim_compute_robot_state-ego_min	0.05368912220001221
sim_compute_sim_state_max	0.04417044976178337
sim_compute_sim_state_mean	0.03920496270238432
sim_compute_sim_state_median	0.04034359314862419
sim_compute_sim_state_min	0.02983286551066807
sim_physics_max	0.14113751579733455
sim_physics_mean	0.12034078269241628
sim_physics_median	0.12005576604529272
sim_physics_min	0.09216491381327312
sim_render-ego_max	0.07002411169164321
sim_render-ego_mean	0.06110017827060051
sim_render-ego_median	0.06255046688780493
sim_render-ego_min	0.043009979384286065
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

22524

3213

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-16 22:00:55+00:00

2019-05-16 22:06:05+00:00

0:05:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1523418192769967
agent_compute-ego_mean	0.1255693496385237
agent_compute-ego_median	0.11704172134399414
agent_compute-ego_min	0.10625041232389562
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0715391856652719, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.045529060893588595, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.10837856045475712, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08159289095136854, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03139298492007785, "sim_compute_performance-ego": 0.053111632664998375, "sim_compute_robot_state-ego": 0.04936827553643121}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10686406434751024, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060640970865885414, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1523418192769967, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09730026768703089, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0385898001053754, "sim_compute_performance-ego": 0.06931004337235994, "sim_compute_robot_state-ego": 0.06845976324642405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0823670275071088, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.04233037724214442, "in-drivable-lane": 0, "agent_compute-ego": 0.10625041232389562, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07123013103709501, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.029606931349810434, "sim_compute_performance-ego": 0.04578675943262437, "sim_compute_robot_state-ego": 0.04991796437431784}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07517236709594727, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.044176855087280274, "in-drivable-lane": 0, "agent_compute-ego": 0.11704172134399414, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08052803993225098, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.028458967208862304, "sim_compute_performance-ego": 0.047406549453735354, "sim_compute_robot_state-ego": 0.05383511543273926}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10986017275460158, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0643488334704049, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14383423479297494, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09211137626744524, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03770142567308643, "sim_compute_performance-ego": 0.06857167316388481, "sim_compute_robot_state-ego": 0.07225940800920318}}
set_robot_commands_max	0.09730026768703089
set_robot_commands_mean	0.08455254117503813
set_robot_commands_median	0.08159289095136854
set_robot_commands_min	0.07123013103709501
sim_compute_performance-ego_max	0.06931004337235994
sim_compute_performance-ego_mean	0.05683733161752057
sim_compute_performance-ego_median	0.053111632664998375
sim_compute_performance-ego_min	0.04578675943262437
sim_compute_robot_state-ego_max	0.07225940800920318
sim_compute_robot_state-ego_mean	0.05876810531982311
sim_compute_robot_state-ego_median	0.05383511543273926
sim_compute_robot_state-ego_min	0.04936827553643121
sim_compute_sim_state_max	0.0385898001053754
sim_compute_sim_state_mean	0.03315002185144249
sim_compute_sim_state_median	0.03139298492007785
sim_compute_sim_state_min	0.028458967208862304
sim_physics_max	0.10986017275460158
sim_physics_mean	0.08916056347408795
sim_physics_median	0.0823670275071088
sim_physics_min	0.0715391856652719
sim_render-ego_max	0.0643488334704049
sim_render-ego_mean	0.05140521951186072
sim_render-ego_median	0.045529060893588595
sim_render-ego_min	0.04233037724214442
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

22522

3220

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

error

yes

2019-05-16 21:54:12+00:00

2019-05-16 22:00:25+00:00

0:06:13

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22513

3226

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

step1-simulation

success

yes

2019-05-16 21:44:14+00:00

2019-05-16 21:53:58+00:00

0:09:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6482690555669561
survival_time_median	4.799999999999991
deviation-center-line_median	0.33137449973274535
in-drivable-lane_median	0.6000000000000001

other stats

agent_compute-ego_max	0.10008593227552331
agent_compute-ego_mean	0.08257744671541331
agent_compute-ego_median	0.08585424201433049
agent_compute-ego_min	0.06445349817690642
deviation-center-line_max	0.8629816460472337
deviation-center-line_mean	0.4052350147373122
deviation-center-line_min	0.1232226529796871
deviation-heading_max	2.5270421322989316
deviation-heading_mean	1.6944073723452333
deviation-heading_median	1.3114128255977453
deviation-heading_min	1.2772414530099196
driven_any_max	2.547563587267358
driven_any_mean	1.2489296114351005
driven_any_median	1.0806560931556195
driven_any_min	0.48079344307760785
driven_lanedir_consec_max	2.030429428861149
driven_lanedir_consec_mean	0.8410103149601313
driven_lanedir_consec_min	0.14330318763051497
driven_lanedir_max	2.030429428861149
driven_lanedir_mean	0.8968134692823696
driven_lanedir_median	0.7507516272566102
driven_lanedir_min	0.19840401404062505
in-drivable-lane_max	1.949999999999993
in-drivable-lane_mean	0.829999999999998
in-drivable-lane_min	0.29999999999999893
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0806560931556195, "sim_physics": 0.1112196445465088, "survival_time": 4.799999999999991, "driven_lanedir": 0.7507516272566102, "sim_render-ego": 0.0632547711332639, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09027464936176936, "deviation-heading": 2.5270421322989316, "set_robot_commands": 0.1148828516403834, "deviation-center-line": 0.33137449973274535, "driven_lanedir_consec": 0.6482690555669561, "sim_compute_sim_state": 0.04267106205224991, "sim_compute_performance-ego": 0.06957327822844188, "sim_compute_robot_state-ego": 0.07245216518640518}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.48080622790521776, "sim_physics": 0.1674722899561343, "survival_time": 2.3, "driven_lanedir": 0.19840401404062505, "sim_render-ego": 0.06491121520166812, "in-drivable-lane": 0.6000000000000001, "agent_compute-ego": 0.10008593227552331, "deviation-heading": 1.2800259505804874, "set_robot_commands": 0.11440334112747856, "deviation-center-line": 0.1232226529796871, "driven_lanedir_consec": 0.14330318763051497, "sim_compute_sim_state": 0.04254971379819124, "sim_compute_performance-ego": 0.0759600660075312, "sim_compute_robot_state-ego": 0.08566067529761273}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.547563587267358, "sim_physics": 0.12529881277749705, "survival_time": 10.750000000000018, "driven_lanedir": 2.030429428861149, "sim_render-ego": 0.0645471173663472, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.08585424201433049, "deviation-heading": 1.2772414530099196, "set_robot_commands": 0.11549674743829771, "deviation-center-line": 0.8629816460472337, "driven_lanedir_consec": 2.030429428861149, "sim_compute_sim_state": 0.04396556920783464, "sim_compute_performance-ego": 0.07288735079210858, "sim_compute_robot_state-ego": 0.08039799512818802}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6548287057696982, "sim_physics": 0.094287912610551, "survival_time": 7.099999999999983, "driven_lanedir": 1.2596261670471434, "sim_render-ego": 0.05527513799533038, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.07221891174853688, "deviation-heading": 2.0763145002390835, "set_robot_commands": 0.09694066685690007, "deviation-center-line": 0.558399371643866, "driven_lanedir_consec": 1.228205201818661, "sim_compute_sim_state": 0.03685598642053738, "sim_compute_performance-ego": 0.06083144604320258, "sim_compute_robot_state-ego": 0.0652010591936783}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.48079344307760785, "sim_physics": 0.09346389770507812, "survival_time": 2.3, "driven_lanedir": 0.24485610920632128, "sim_render-ego": 0.04644012451171875, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.06445349817690642, "deviation-heading": 1.3114128255977453, "set_robot_commands": 0.08780003630596658, "deviation-center-line": 0.1501969032830292, "driven_lanedir_consec": 0.154844700923376, "sim_compute_sim_state": 0.03197144943734874, "sim_compute_performance-ego": 0.05303421227828316, "sim_compute_robot_state-ego": 0.05722616548123567}}
set_robot_commands_max	0.11549674743829771
set_robot_commands_mean	0.10590472867380528
set_robot_commands_median	0.11440334112747856
set_robot_commands_min	0.08780003630596658
sim_compute_performance-ego_max	0.0759600660075312
sim_compute_performance-ego_mean	0.06645727066991347
sim_compute_performance-ego_median	0.06957327822844188
sim_compute_performance-ego_min	0.05303421227828316
sim_compute_robot_state-ego_max	0.08566067529761273
sim_compute_robot_state-ego_mean	0.07218761205742398
sim_compute_robot_state-ego_median	0.07245216518640518
sim_compute_robot_state-ego_min	0.05722616548123567
sim_compute_sim_state_max	0.04396556920783464
sim_compute_sim_state_mean	0.03960275618323238
sim_compute_sim_state_median	0.04254971379819124
sim_compute_sim_state_min	0.03197144943734874
sim_physics_max	0.1674722899561343
sim_physics_mean	0.11834851151915383
sim_physics_median	0.1112196445465088
sim_physics_min	0.09346389770507812
sim_render-ego_max	0.06491121520166812
sim_render-ego_mean	0.05888567324166567
sim_render-ego_median	0.0632547711332639
sim_render-ego_min	0.04644012451171875
simulation-passed	1
survival_time_max	10.750000000000018
survival_time_mean	5.449999999999998
survival_time_min	2.3

No reset possible

22501

3236

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

step1-simulation

success

yes

2019-05-16 21:27:14+00:00

2019-05-16 21:44:06+00:00

0:16:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8585602455264372
survival_time_median	8.14999999999998
deviation-center-line_median	0.7394696972120545
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09078086619396286
agent_compute-ego_mean	0.08750102503842552
agent_compute-ego_median	0.08810589479845624
agent_compute-ego_min	0.08190862386504565
deviation-center-line_max	1.330102370170228
deviation-center-line_mean	0.7757390305529259
deviation-center-line_min	0.156616058950106
deviation-heading_max	2.931919980092094
deviation-heading_mean	1.6699672337849407
deviation-heading_median	1.651951162872906
deviation-heading_min	0.33411079807072414
driven_any_max	3.574678085296573
driven_any_mean	1.9851000130474856
driven_any_median	1.9116486550772611
driven_any_min	0.4441832066089127
driven_lanedir_consec_max	2.9865400109974503
driven_lanedir_consec_mean	1.743345148237858
driven_lanedir_consec_min	0.42357196576766665
driven_lanedir_max	2.9865400109974503
driven_lanedir_mean	1.743345148237858
driven_lanedir_median	1.8585602455264372
driven_lanedir_min	0.42357196576766665
in-drivable-lane_max	1.8500000000000263
in-drivable-lane_mean	0.6800000000000088
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9515731520694257, "sim_physics": 0.13011445482093167, "survival_time": 12.450000000000042, "driven_lanedir": 2.4083866619267673, "sim_render-ego": 0.0655557764581887, "in-drivable-lane": 1.5500000000000176, "agent_compute-ego": 0.09078086619396286, "deviation-heading": 2.931919980092094, "set_robot_commands": 0.11337530660820772, "deviation-center-line": 1.1071364179412364, "driven_lanedir_consec": 2.4083866619267673, "sim_compute_sim_state": 0.043550624426110206, "sim_compute_performance-ego": 0.07248600994247988, "sim_compute_robot_state-ego": 0.08021995724444408}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9116486550772611, "sim_physics": 0.11311910196316025, "survival_time": 8.14999999999998, "driven_lanedir": 1.8585602455264372, "sim_render-ego": 0.06138913470543235, "in-drivable-lane": 0, "agent_compute-ego": 0.08190862386504565, "deviation-heading": 1.651951162872906, "set_robot_commands": 0.11235505817857988, "deviation-center-line": 0.7394696972120545, "driven_lanedir_consec": 1.8585602455264372, "sim_compute_sim_state": 0.043208561060618766, "sim_compute_performance-ego": 0.06687280005472569, "sim_compute_robot_state-ego": 0.07257761984515043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0434169661852573, "sim_physics": 0.12795669617860214, "survival_time": 4.599999999999992, "driven_lanedir": 1.039666856970968, "sim_render-ego": 0.06676072400549184, "in-drivable-lane": 0, "agent_compute-ego": 0.08970581707747086, "deviation-heading": 0.33411079807072414, "set_robot_commands": 0.1253545750742373, "deviation-center-line": 0.5453706084910053, "driven_lanedir_consec": 1.039666856970968, "sim_compute_sim_state": 0.044272422790527344, "sim_compute_performance-ego": 0.0744995785796124, "sim_compute_robot_state-ego": 0.08745465330455614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4441832066089127, "sim_physics": 0.1279981857122377, "survival_time": 2.1500000000000004, "driven_lanedir": 0.42357196576766665, "sim_render-ego": 0.06724884898163551, "in-drivable-lane": 0, "agent_compute-ego": 0.08810589479845624, "deviation-heading": 0.6350053948141431, "set_robot_commands": 0.1116138779839804, "deviation-center-line": 0.156616058950106, "driven_lanedir_consec": 0.42357196576766665, "sim_compute_sim_state": 0.04400884827902151, "sim_compute_performance-ego": 0.07449071906333746, "sim_compute_robot_state-ego": 0.07890796661376953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.574678085296573, "sim_physics": 0.108406978448232, "survival_time": 14.950000000000076, "driven_lanedir": 2.9865400109974503, "sim_render-ego": 0.061812231540679934, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.08700392325719197, "deviation-heading": 2.796848833074837, "set_robot_commands": 0.11447627941767374, "deviation-center-line": 1.330102370170228, "driven_lanedir_consec": 2.9865400109974503, "sim_compute_sim_state": 0.04303218841552734, "sim_compute_performance-ego": 0.07070357958475748, "sim_compute_robot_state-ego": 0.07434128046035766}}
set_robot_commands_max	0.1253545750742373
set_robot_commands_mean	0.1154350194525358
set_robot_commands_median	0.11337530660820772
set_robot_commands_min	0.1116138779839804
sim_compute_performance-ego_max	0.0744995785796124
sim_compute_performance-ego_mean	0.07181053744498259
sim_compute_performance-ego_median	0.07248600994247988
sim_compute_performance-ego_min	0.06687280005472569
sim_compute_robot_state-ego_max	0.08745465330455614
sim_compute_robot_state-ego_mean	0.07870029549365556
sim_compute_robot_state-ego_median	0.07890796661376953
sim_compute_robot_state-ego_min	0.07257761984515043
sim_compute_sim_state_max	0.044272422790527344
sim_compute_sim_state_mean	0.04361452899436104
sim_compute_sim_state_median	0.043550624426110206
sim_compute_sim_state_min	0.04303218841552734
sim_physics_max	0.13011445482093167
sim_physics_mean	0.12151908342463276
sim_physics_median	0.12795669617860214
sim_physics_min	0.108406978448232
sim_render-ego_max	0.06724884898163551
sim_render-ego_mean	0.06455334313828567
sim_render-ego_median	0.0655557764581887
sim_render-ego_min	0.06138913470543235
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.460000000000019
survival_time_min	2.1500000000000004

No reset possible

22499

3238

Second test - TH

step1-simulation

error

yes

2019-05-16 21:26:28+00:00

2019-05-16 21:26:59+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22492

3248

Brian Chuang

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-16 21:20:51+00:00

2019-05-16 21:25:59+00:00

0:05:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.14806357552023494
agent_compute-ego_mean	0.13165739632433948
agent_compute-ego_median	0.1288252274195353
agent_compute-ego_min	0.11186427116394045
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0875094422587642, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05218831698099772, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1288252274195353, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08165085315704346, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03477229895415129, "sim_compute_performance-ego": 0.05629045874984176, "sim_compute_robot_state-ego": 0.05844326372499819}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.08829712400249407, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04918077412773581, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12705770193361768, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0726468048843683, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.033991121778301166, "sim_compute_performance-ego": 0.05434441566467285, "sim_compute_robot_state-ego": 0.05536261726828182}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11748273232403925, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05948803004096536, "in-drivable-lane": 0, "agent_compute-ego": 0.14806357552023494, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09703836721532486, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04054150861852309, "sim_compute_performance-ego": 0.063217653947718, "sim_compute_robot_state-ego": 0.07143064106211942}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.08561182022094727, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04756854057312012, "in-drivable-lane": 0, "agent_compute-ego": 0.11186427116394045, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07453076362609863, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.02890833854675293, "sim_compute_performance-ego": 0.05135771751403809, "sim_compute_robot_state-ego": 0.05411564826965332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11329761939712718, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05827133866805065, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14247620558436913, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08844134777407103, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03665709193748764, "sim_compute_performance-ego": 0.06503508362589003, "sim_compute_robot_state-ego": 0.0723754484442216}}
set_robot_commands_max	0.09703836721532486
set_robot_commands_mean	0.08286162733138125
set_robot_commands_median	0.08165085315704346
set_robot_commands_min	0.0726468048843683
sim_compute_performance-ego_max	0.06503508362589003
sim_compute_performance-ego_mean	0.05804906590043215
sim_compute_performance-ego_median	0.05629045874984176
sim_compute_performance-ego_min	0.05135771751403809
sim_compute_robot_state-ego_max	0.0723754484442216
sim_compute_robot_state-ego_mean	0.06234552375385487
sim_compute_robot_state-ego_median	0.05844326372499819
sim_compute_robot_state-ego_min	0.05411564826965332
sim_compute_sim_state_max	0.04054150861852309
sim_compute_sim_state_mean	0.034974071967043226
sim_compute_sim_state_median	0.03477229895415129
sim_compute_sim_state_min	0.02890833854675293
sim_physics_max	0.11748273232403925
sim_physics_mean	0.0984397476406744
sim_physics_median	0.08829712400249407
sim_physics_min	0.08561182022094727
sim_render-ego_max	0.05948803004096536
sim_render-ego_mean	0.05333940007817393
sim_render-ego_median	0.05218831698099772
sim_render-ego_min	0.04756854057312012
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

22479

3268

Artem Ioselevskii

SSegm

step1-simulation

success

yes

2019-05-16 21:03:01+00:00

2019-05-16 21:20:03+00:00

0:17:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2305190031201856
survival_time_median	8.899999999999991
deviation-center-line_median	0.5771458850482323
in-drivable-lane_median	1.6999999999999955

other stats

agent_compute-ego_max	0.10172563172428986
agent_compute-ego_mean	0.0989053062811897
agent_compute-ego_median	0.09892491330491736
agent_compute-ego_min	0.09690403247225111
deviation-center-line_max	1.1488111156355547
deviation-center-line_mean	0.6488031212511529
deviation-center-line_min	0.34884787027557723
deviation-heading_max	3.61599883232021
deviation-heading_mean	1.7260666402917764
deviation-heading_median	1.4218969858349213
deviation-heading_min	0.3112599289821271
driven_any_max	3.4035761096508277
driven_any_mean	1.8946471986219724
driven_any_median	2.0834330562964634
driven_any_min	0.7621458305230319
driven_lanedir_consec_max	2.786543911691145
driven_lanedir_consec_mean	1.4692902725397083
driven_lanedir_consec_min	0.758467835111603
driven_lanedir_max	2.786543911691145
driven_lanedir_mean	1.4692902725397083
driven_lanedir_median	1.2305190031201856
driven_lanedir_min	0.758467835111603
in-drivable-lane_max	2.800000000000005
in-drivable-lane_mean	1.34
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0834330562964634, "sim_physics": 0.11412759577290396, "survival_time": 8.899999999999991, "driven_lanedir": 1.2305190031201856, "sim_render-ego": 0.061742475863253134, "in-drivable-lane": 2.800000000000005, "agent_compute-ego": 0.09720663140329082, "deviation-heading": 2.1694395159240227, "set_robot_commands": 0.09528927320844673, "deviation-center-line": 0.5771458850482323, "driven_lanedir_consec": 1.2305190031201856, "sim_compute_sim_state": 0.03827882348821404, "sim_compute_performance-ego": 0.06992528947551599, "sim_compute_robot_state-ego": 0.07240149814091372}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0678561329190914, "sim_physics": 0.11921270857466028, "survival_time": 4.699999999999991, "driven_lanedir": 0.8981067716987119, "sim_render-ego": 0.06484188932053586, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.09892491330491736, "deviation-heading": 1.1117379383976007, "set_robot_commands": 0.10449194400868515, "deviation-center-line": 0.34884787027557723, "driven_lanedir_consec": 0.8981067716987119, "sim_compute_sim_state": 0.040589669917492154, "sim_compute_performance-ego": 0.07760083675384521, "sim_compute_robot_state-ego": 0.08545771304597245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7621458305230319, "sim_physics": 0.11311588080033012, "survival_time": 3.4499999999999957, "driven_lanedir": 0.758467835111603, "sim_render-ego": 0.061401014742643936, "in-drivable-lane": 0, "agent_compute-ego": 0.09690403247225111, "deviation-heading": 0.3112599289821271, "set_robot_commands": 0.09756624871406004, "deviation-center-line": 0.41225298137550304, "driven_lanedir_consec": 0.758467835111603, "sim_compute_sim_state": 0.03884257095447485, "sim_compute_performance-ego": 0.06795479249263155, "sim_compute_robot_state-ego": 0.07825438181559245}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4035761096508277, "sim_physics": 0.11565114908051072, "survival_time": 14.250000000000068, "driven_lanedir": 2.786543911691145, "sim_render-ego": 0.06242092366804156, "in-drivable-lane": 1.7000000000000002, "agent_compute-ego": 0.0997653225011993, "deviation-heading": 3.61599883232021, "set_robot_commands": 0.09614342053731284, "deviation-center-line": 1.1488111156355547, "driven_lanedir_consec": 2.786543911691145, "sim_compute_sim_state": 0.03905590626231411, "sim_compute_performance-ego": 0.07031122676113195, "sim_compute_robot_state-ego": 0.07502928114773934}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1562248637204484, "sim_physics": 0.1180384341484862, "survival_time": 9.149999999999997, "driven_lanedir": 1.672813841076897, "sim_render-ego": 0.06259278912361854, "in-drivable-lane": 1.6999999999999955, "agent_compute-ego": 0.10172563172428986, "deviation-heading": 1.4218969858349213, "set_robot_commands": 0.09687611314116933, "deviation-center-line": 0.7569577539208971, "driven_lanedir_consec": 1.672813841076897, "sim_compute_sim_state": 0.04012774118308812, "sim_compute_performance-ego": 0.06982239608556196, "sim_compute_robot_state-ego": 0.07419703436679527}}
set_robot_commands_max	0.10449194400868515
set_robot_commands_mean	0.0980733999219348
set_robot_commands_median	0.09687611314116933
set_robot_commands_min	0.09528927320844673
sim_compute_performance-ego_max	0.07760083675384521
sim_compute_performance-ego_mean	0.07112290831373733
sim_compute_performance-ego_median	0.06992528947551599
sim_compute_performance-ego_min	0.06795479249263155
sim_compute_robot_state-ego_max	0.08545771304597245
sim_compute_robot_state-ego_mean	0.07706798170340265
sim_compute_robot_state-ego_median	0.07502928114773934
sim_compute_robot_state-ego_min	0.07240149814091372
sim_compute_sim_state_max	0.040589669917492154
sim_compute_sim_state_mean	0.03937894236111666
sim_compute_sim_state_median	0.03905590626231411
sim_compute_sim_state_min	0.03827882348821404
sim_physics_max	0.11921270857466028
sim_physics_mean	0.11602915367537828
sim_physics_median	0.11565114908051072
sim_physics_min	0.11311588080033012
sim_render-ego_max	0.06484188932053586
sim_render-ego_mean	0.06259981854361861
sim_render-ego_median	0.06242092366804156
sim_render-ego_min	0.061401014742643936
simulation-passed	1
survival_time_max	14.250000000000068
survival_time_mean	8.090000000000009
survival_time_min	3.4499999999999957

No reset possible

22454

3335

FANG MEIYI 🇸🇬

test

step1-simulation

error

yes

2019-05-16 20:40:58+00:00

2019-05-16 21:02:27+00:00

0:21:29

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22446

3295

Artem Ioselevskii

SSegm

step1-simulation

success

yes

2019-05-16 20:31:19+00:00

2019-05-16 20:40:19+00:00

0:09:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6665613794166414
survival_time_median	4.449999999999992
deviation-center-line_median	0.27506318261736495
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.13133786827005367
agent_compute-ego_mean	0.10958869698914982
agent_compute-ego_median	0.10602452641441708
agent_compute-ego_min	0.09961463896076332
deviation-center-line_max	0.5405466971129735
deviation-center-line_mean	0.29571370825500976
deviation-center-line_min	0.14577080707330664
deviation-heading_max	1.1772769095730584
deviation-heading_mean	0.6219946012733388
deviation-heading_median	0.5979885370116356
deviation-heading_min	0.3130597775476315
driven_any_max	1.6793181334201532
driven_any_mean	0.909008083111998
driven_any_median	1.0067176412812215
driven_any_min	0.3830463924283936
driven_lanedir_consec_max	1.2866980510543735
driven_lanedir_consec_mean	0.7030867622842658
driven_lanedir_consec_min	0.3783827855885713
driven_lanedir_max	1.2866980510543735
driven_lanedir_mean	0.7030867622842658
driven_lanedir_median	0.6665613794166414
driven_lanedir_min	0.3783827855885713
in-drivable-lane_max	1.5499999999999945
in-drivable-lane_mean	0.7399999999999973
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0439998689644476, "sim_physics": 0.13015370471503146, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6665613794166414, "sim_render-ego": 0.07065531258941979, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.13133786827005367, "deviation-heading": 0.37092426295100417, "set_robot_commands": 0.11001646646889308, "deviation-center-line": 0.27506318261736495, "driven_lanedir_consec": 0.6665613794166414, "sim_compute_sim_state": 0.04295575746925928, "sim_compute_performance-ego": 0.07345034999232139, "sim_compute_robot_state-ego": 0.08779208890853389}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0067176412812215, "sim_physics": 0.13158570514636092, "survival_time": 4.449999999999992, "driven_lanedir": 0.7726470000832769, "sim_render-ego": 0.06766855046990213, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09961463896076332, "deviation-heading": 1.1772769095730584, "set_robot_commands": 0.10496531443649464, "deviation-center-line": 0.3156839638895037, "driven_lanedir_consec": 0.7726470000832769, "sim_compute_sim_state": 0.04170803273661753, "sim_compute_performance-ego": 0.07615993531902185, "sim_compute_robot_state-ego": 0.08146597026439195}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3830463924283936, "sim_physics": 0.13339745370965256, "survival_time": 1.900000000000001, "driven_lanedir": 0.3783827855885713, "sim_render-ego": 0.06137202915392424, "in-drivable-lane": 0, "agent_compute-ego": 0.1026848554611206, "deviation-heading": 0.3130597775476315, "set_robot_commands": 0.10008700270401805, "deviation-center-line": 0.20150389058190016, "driven_lanedir_consec": 0.3783827855885713, "sim_compute_sim_state": 0.041579522584614, "sim_compute_performance-ego": 0.07098876175127532, "sim_compute_robot_state-ego": 0.07685181969090511}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4319583794657741, "sim_physics": 0.124965162504287, "survival_time": 2.1000000000000005, "driven_lanedir": 0.4111445952784658, "sim_render-ego": 0.06486619654155913, "in-drivable-lane": 0, "agent_compute-ego": 0.10602452641441708, "deviation-heading": 0.6507235192833651, "set_robot_commands": 0.10434051354726157, "deviation-center-line": 0.14577080707330664, "driven_lanedir_consec": 0.4111445952784658, "sim_compute_sim_state": 0.040420061066037134, "sim_compute_performance-ego": 0.06979412691933769, "sim_compute_robot_state-ego": 0.07560365540640694}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6793181334201532, "sim_physics": 0.12437489794360268, "survival_time": 7.199999999999982, "driven_lanedir": 1.2866980510543735, "sim_render-ego": 0.06501300467385186, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10828159583939446, "deviation-heading": 0.5979885370116356, "set_robot_commands": 0.10258388353718652, "deviation-center-line": 0.5405466971129735, "driven_lanedir_consec": 1.2866980510543735, "sim_compute_sim_state": 0.04086485008398691, "sim_compute_performance-ego": 0.07392720381418864, "sim_compute_robot_state-ego": 0.08219448394245571}}
set_robot_commands_max	0.11001646646889308
set_robot_commands_mean	0.10439863613877076
set_robot_commands_median	0.10434051354726157
set_robot_commands_min	0.10008700270401805
sim_compute_performance-ego_max	0.07615993531902185
sim_compute_performance-ego_mean	0.07286407555922898
sim_compute_performance-ego_median	0.07345034999232139
sim_compute_performance-ego_min	0.06979412691933769
sim_compute_robot_state-ego_max	0.08779208890853389
sim_compute_robot_state-ego_mean	0.08078160364253872
sim_compute_robot_state-ego_median	0.08146597026439195
sim_compute_robot_state-ego_min	0.07560365540640694
sim_compute_sim_state_max	0.04295575746925928
sim_compute_sim_state_mean	0.041505644788102966
sim_compute_sim_state_median	0.041579522584614
sim_compute_sim_state_min	0.040420061066037134
sim_physics_max	0.13339745370965256
sim_physics_mean	0.12889538480378693
sim_physics_median	0.13015370471503146
sim_physics_min	0.12437489794360268
sim_render-ego_max	0.07065531258941979
sim_render-ego_mean	0.06591501868573144
sim_render-ego_median	0.06501300467385186
sim_render-ego_min	0.06137202915392424
simulation-passed	1
survival_time_max	7.199999999999982
survival_time_mean	4.059999999999993
survival_time_min	1.900000000000001

No reset possible

22440

3300

Artem Ioselevskii

SSegm

step1-simulation

success

yes

2019-05-16 20:22:23+00:00

2019-05-16 20:30:57+00:00

0:08:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4108623025159917
survival_time_median	2.2
deviation-center-line_median	0.17608683739206069
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1161846626888622
agent_compute-ego_mean	0.1065970033854839
agent_compute-ego_median	0.10513032807244196
agent_compute-ego_min	0.09789851132561178
deviation-center-line_max	0.553006586721707
deviation-center-line_mean	0.25167707733840106
deviation-center-line_min	0.1230563934255246
deviation-heading_max	1.353610693525513
deviation-heading_mean	0.8401519300419471
deviation-heading_median	0.7074316092927606
deviation-heading_min	0.3145163536332646
driven_any_max	1.1657013383876025
driven_any_mean	0.63752855441504
driven_any_median	0.4447815158042768
driven_any_min	0.3341398229437414
driven_lanedir_consec_max	1.0434182104988623
driven_lanedir_consec_mean	0.5573910485118122
driven_lanedir_consec_min	0.3284215252184426
driven_lanedir_max	1.0434182104988623
driven_lanedir_mean	0.5573910485118122
driven_lanedir_median	0.4108623025159917
driven_lanedir_min	0.3284215252184426
in-drivable-lane_max	0.4999999999999982
in-drivable-lane_mean	0.1399999999999995
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4447815158042768, "sim_physics": 0.14357539740475742, "survival_time": 2.2, "driven_lanedir": 0.4108623025159917, "sim_render-ego": 0.06835265593095259, "in-drivable-lane": 0, "agent_compute-ego": 0.1161846626888622, "deviation-heading": 0.7063746991018894, "set_robot_commands": 0.1107547554102811, "deviation-center-line": 0.15953890453813732, "driven_lanedir_consec": 0.4108623025159917, "sim_compute_sim_state": 0.042578009041872894, "sim_compute_performance-ego": 0.0821873437274586, "sim_compute_robot_state-ego": 0.08426532962105492}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8844282098528133, "sim_physics": 0.12575247016134142, "survival_time": 3.949999999999994, "driven_lanedir": 0.6753190495150517, "sim_render-ego": 0.06606724896008455, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1007549702366696, "deviation-heading": 1.1188262946563077, "set_robot_commands": 0.1018355949015557, "deviation-center-line": 0.24669666461457568, "driven_lanedir_consec": 0.6753190495150517, "sim_compute_sim_state": 0.040934843353078336, "sim_compute_performance-ego": 0.0750313076791884, "sim_compute_robot_state-ego": 0.07969949215273314}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3341398229437414, "sim_physics": 0.121652554063236, "survival_time": 1.7000000000000008, "driven_lanedir": 0.328934154810713, "sim_render-ego": 0.06535426308127011, "in-drivable-lane": 0, "agent_compute-ego": 0.09789851132561178, "deviation-heading": 0.3145163536332646, "set_robot_commands": 0.09681362965527704, "deviation-center-line": 0.17608683739206069, "driven_lanedir_consec": 0.328934154810713, "sim_compute_sim_state": 0.04149777749005486, "sim_compute_performance-ego": 0.0757823341033038, "sim_compute_robot_state-ego": 0.07920744839836569}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3585918850867666, "sim_physics": 0.1465895242161221, "survival_time": 1.800000000000001, "driven_lanedir": 0.3284215252184426, "sim_render-ego": 0.07163292169570923, "in-drivable-lane": 0, "agent_compute-ego": 0.10513032807244196, "deviation-heading": 0.7074316092927606, "set_robot_commands": 0.1057207120789422, "deviation-center-line": 0.1230563934255246, "driven_lanedir_consec": 0.3284215252184426, "sim_compute_sim_state": 0.04634696907467312, "sim_compute_performance-ego": 0.07658784919314915, "sim_compute_robot_state-ego": 0.08306401305728489}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1657013383876025, "sim_physics": 0.1416974792293474, "survival_time": 5.09999999999999, "driven_lanedir": 1.0434182104988623, "sim_render-ego": 0.06556390079797483, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.11301654460383397, "deviation-heading": 1.353610693525513, "set_robot_commands": 0.1080380491181916, "deviation-center-line": 0.553006586721707, "driven_lanedir_consec": 1.0434182104988623, "sim_compute_sim_state": 0.04353268240012374, "sim_compute_performance-ego": 0.07612160140392828, "sim_compute_robot_state-ego": 0.0833505345325844}}
set_robot_commands_max	0.1107547554102811
set_robot_commands_mean	0.10463254823284954
set_robot_commands_median	0.1057207120789422
set_robot_commands_min	0.09681362965527704
sim_compute_performance-ego_max	0.0821873437274586
sim_compute_performance-ego_mean	0.07714208722140564
sim_compute_performance-ego_median	0.07612160140392828
sim_compute_performance-ego_min	0.0750313076791884
sim_compute_robot_state-ego_max	0.08426532962105492
sim_compute_robot_state-ego_mean	0.08191736355240462
sim_compute_robot_state-ego_median	0.08306401305728489
sim_compute_robot_state-ego_min	0.07920744839836569
sim_compute_sim_state_max	0.04634696907467312
sim_compute_sim_state_mean	0.042978056271960594
sim_compute_sim_state_median	0.042578009041872894
sim_compute_sim_state_min	0.040934843353078336
sim_physics_max	0.1465895242161221
sim_physics_mean	0.13585348501496086
sim_physics_median	0.1416974792293474
sim_physics_min	0.121652554063236
sim_render-ego_max	0.07163292169570923
sim_render-ego_mean	0.06739419809319827
sim_render-ego_median	0.06606724896008455
sim_render-ego_min	0.06535426308127011
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.949999999999997
survival_time_min	1.7000000000000008

No reset possible

22425

3312

Angel Woo 🇭🇰

Roasted duck

step1-simulation

success

yes

2019-05-16 20:05:13+00:00

2019-05-16 20:21:47+00:00

0:16:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3496541027899869
survival_time_median	5.299999999999989
deviation-center-line_median	0.29817832962587804
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.2677252552726052
agent_compute-ego_mean	0.22035048683258687
agent_compute-ego_median	0.2103179175898714
agent_compute-ego_min	0.18094515582742213
deviation-center-line_max	0.8910330182524215
deviation-center-line_mean	0.4264780459482808
deviation-center-line_min	0.28077402334016544
deviation-heading_max	2.0821930316740573
deviation-heading_mean	1.7659753763307156
deviation-heading_median	1.8813395939057316
deviation-heading_min	1.0820895466826623
driven_any_max	1.1012533152257715
driven_any_mean	0.5689374927274462
driven_any_median	0.39804664955665897
driven_any_min	0.1893884857933168
driven_lanedir_consec_max	1.0649032250946142
driven_lanedir_consec_mean	0.5019902993930894
driven_lanedir_consec_min	0.1722477218334686
driven_lanedir_max	1.0649032250946142
driven_lanedir_mean	0.5019902993930894
driven_lanedir_median	0.3496541027899869
driven_lanedir_min	0.1722477218334686
in-drivable-lane_max	1.7500000000000249
in-drivable-lane_mean	0.4700000000000054
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1012533152257715, "sim_physics": 0.09658172845840454, "survival_time": 14.950000000000076, "driven_lanedir": 1.0649032250946142, "sim_render-ego": 0.05737500429153442, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.18985747098922728, "deviation-heading": 2.0821930316740573, "set_robot_commands": 0.0832806921005249, "deviation-center-line": 0.8910330182524215, "driven_lanedir_consec": 1.0649032250946142, "sim_compute_sim_state": 0.03434476534525553, "sim_compute_performance-ego": 0.060694024562835694, "sim_compute_robot_state-ego": 0.0643535057703654}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8532875463606754, "sim_physics": 0.08834603496882469, "survival_time": 10.95000000000002, "driven_lanedir": 0.6785838987704491, "sim_render-ego": 0.05195739280143285, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.18094515582742213, "deviation-heading": 1.8813395939057316, "set_robot_commands": 0.08122290541592254, "deviation-center-line": 0.3717255384421089, "driven_lanedir_consec": 0.6785838987704491, "sim_compute_sim_state": 0.034273477449809034, "sim_compute_performance-ego": 0.0581164784627418, "sim_compute_robot_state-ego": 0.06008780492495184}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1893884857933168, "sim_physics": 0.1053327343680642, "survival_time": 2.7499999999999982, "driven_lanedir": 0.1722477218334686, "sim_render-ego": 0.057742977142333986, "in-drivable-lane": 0, "agent_compute-ego": 0.2677252552726052, "deviation-heading": 1.0820895466826623, "set_robot_commands": 0.0925160451368852, "deviation-center-line": 0.29817832962587804, "driven_lanedir_consec": 0.1722477218334686, "sim_compute_sim_state": 0.03598507967862216, "sim_compute_performance-ego": 0.06122544462030584, "sim_compute_robot_state-ego": 0.06192522482438521}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.302711466700808, "sim_physics": 0.08022321006398142, "survival_time": 4.049999999999994, "driven_lanedir": 0.2445625484769285, "sim_render-ego": 0.06316284191461256, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.25290663448380835, "deviation-heading": 1.9969904799270992, "set_robot_commands": 0.06967232551103757, "deviation-center-line": 0.28077402334016544, "driven_lanedir_consec": 0.2445625484769285, "sim_compute_sim_state": 0.04143663394598313, "sim_compute_performance-ego": 0.065232147405177, "sim_compute_robot_state-ego": 0.05850335992412803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.39804664955665897, "sim_physics": 0.11368137710499314, "survival_time": 5.299999999999989, "driven_lanedir": 0.3496541027899869, "sim_render-ego": 0.05758777429472725, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2103179175898714, "deviation-heading": 1.7872642294640269, "set_robot_commands": 0.09248955519694202, "deviation-center-line": 0.29067932008082964, "driven_lanedir_consec": 0.3496541027899869, "sim_compute_sim_state": 0.03839026082236812, "sim_compute_performance-ego": 0.06169818707232205, "sim_compute_robot_state-ego": 0.06745851264809663}}
set_robot_commands_max	0.0925160451368852
set_robot_commands_mean	0.08383630467226245
set_robot_commands_median	0.0832806921005249
set_robot_commands_min	0.06967232551103757
sim_compute_performance-ego_max	0.065232147405177
sim_compute_performance-ego_mean	0.06139325642467648
sim_compute_performance-ego_median	0.06122544462030584
sim_compute_performance-ego_min	0.0581164784627418
sim_compute_robot_state-ego_max	0.06745851264809663
sim_compute_robot_state-ego_mean	0.062465681618385414
sim_compute_robot_state-ego_median	0.06192522482438521
sim_compute_robot_state-ego_min	0.05850335992412803
sim_compute_sim_state_max	0.04143663394598313
sim_compute_sim_state_mean	0.0368860434484076
sim_compute_sim_state_median	0.03598507967862216
sim_compute_sim_state_min	0.034273477449809034
sim_physics_max	0.11368137710499314
sim_physics_mean	0.0968330169928536
sim_physics_median	0.09658172845840454
sim_physics_min	0.08022321006398142
sim_render-ego_max	0.06316284191461256
sim_render-ego_mean	0.05756519808892822
sim_render-ego_median	0.05758777429472725
sim_render-ego_min	0.05195739280143285
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.600000000000016
survival_time_min	2.7499999999999982

No reset possible

22419

3319

RL - TH - shi

step1-simulation

error

yes

2019-05-16 20:03:11+00:00

2019-05-16 20:04:31+00:00

0:01:20

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22405

3330

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

step1-simulation

error

yes

2019-05-16 19:42:12+00:00

2019-05-16 20:02:51+00:00

0:20:39

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22390

3342

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

step1-simulation

success

yes

2019-05-16 19:06:07+00:00

2019-05-16 19:41:43+00:00

0:35:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.6061195165241595
survival_time_median	14.950000000000076
deviation-center-line_median	0.9158554167971322
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.3332826638221741
agent_compute-ego_mean	0.3065102955500285
agent_compute-ego_median	0.3126683608690898
agent_compute-ego_min	0.2709287230173747
deviation-center-line_max	1.3900540864280544
deviation-center-line_mean	1.0478876261231291
deviation-center-line_min	0.8170491003396274
deviation-heading_max	3.2814669740520683
deviation-heading_mean	2.280953131159643
deviation-heading_median	2.235364113960447
deviation-heading_min	1.2850574087601645
driven_any_max	2.878026120260703
driven_any_mean	2.713939627368959
driven_any_median	2.667858048351088
driven_any_min	2.5107444223692195
driven_lanedir_consec_max	2.7234767923157013
driven_lanedir_consec_mean	2.5578402399429794
driven_lanedir_consec_min	2.26727702033328
driven_lanedir_max	2.7234767923157013
driven_lanedir_mean	2.5578402399429794
driven_lanedir_median	2.6061195165241595
driven_lanedir_min	2.26727702033328
in-drivable-lane_max	2.150000000000002
in-drivable-lane_mean	0.8000000000000034
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5107444223692195, "sim_physics": 0.15085184176762895, "survival_time": 14.950000000000076, "driven_lanedir": 2.26727702033328, "sim_render-ego": 0.07198540846506754, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.2709287230173747, "deviation-heading": 3.2814669740520683, "set_robot_commands": 0.12256356239318848, "deviation-center-line": 0.8170491003396274, "driven_lanedir_consec": 2.26727702033328, "sim_compute_sim_state": 0.046000825564066566, "sim_compute_performance-ego": 0.07941846927007039, "sim_compute_robot_state-ego": 0.09270612637201946}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.8519477342001416, "sim_physics": 0.15287224610646566, "survival_time": 14.950000000000076, "driven_lanedir": 2.7234767923157013, "sim_render-ego": 0.07266729990641276, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.3332826638221741, "deviation-heading": 2.139728816373815, "set_robot_commands": 0.12005263408025106, "deviation-center-line": 1.3900540864280544, "driven_lanedir_consec": 2.7234767923157013, "sim_compute_sim_state": 0.0458188247680664, "sim_compute_performance-ego": 0.08290475447972616, "sim_compute_robot_state-ego": 0.0951720635096232}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.878026120260703, "sim_physics": 0.13622482776641845, "survival_time": 14.950000000000076, "driven_lanedir": 2.5775981565066965, "sim_render-ego": 0.07277334849039714, "in-drivable-lane": 2.150000000000002, "agent_compute-ego": 0.3126683608690898, "deviation-heading": 1.2850574087601645, "set_robot_commands": 0.11943259477615356, "deviation-center-line": 1.2397826767779554, "driven_lanedir_consec": 2.5775981565066965, "sim_compute_sim_state": 0.04607876062393188, "sim_compute_performance-ego": 0.08166768789291382, "sim_compute_robot_state-ego": 0.0933917530377706}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.667858048351088, "sim_physics": 0.1460714817047119, "survival_time": 14.950000000000076, "driven_lanedir": 2.61472971403506, "sim_render-ego": 0.07214704672495524, "in-drivable-lane": 0, "agent_compute-ego": 0.2984927678108215, "deviation-heading": 2.4631483426517207, "set_robot_commands": 0.11639736175537108, "deviation-center-line": 0.876696850272876, "driven_lanedir_consec": 2.61472971403506, "sim_compute_sim_state": 0.045822412967681886, "sim_compute_performance-ego": 0.08229336659113566, "sim_compute_robot_state-ego": 0.0901212708155314}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6611218116636426, "sim_physics": 0.14282263278961185, "survival_time": 14.950000000000076, "driven_lanedir": 2.6061195165241595, "sim_render-ego": 0.07049689054489136, "in-drivable-lane": 0, "agent_compute-ego": 0.31717896223068237, "deviation-heading": 2.235364113960447, "set_robot_commands": 0.1152267034848531, "deviation-center-line": 0.9158554167971322, "driven_lanedir_consec": 2.6061195165241595, "sim_compute_sim_state": 0.046239012082417805, "sim_compute_performance-ego": 0.08189732869466146, "sim_compute_robot_state-ego": 0.08969166278839111}}
set_robot_commands_max	0.12256356239318848
set_robot_commands_mean	0.11873457129796346
set_robot_commands_median	0.11943259477615356
set_robot_commands_min	0.1152267034848531
sim_compute_performance-ego_max	0.08290475447972616
sim_compute_performance-ego_mean	0.0816363213857015
sim_compute_performance-ego_median	0.08189732869466146
sim_compute_performance-ego_min	0.07941846927007039
sim_compute_robot_state-ego_max	0.0951720635096232
sim_compute_robot_state-ego_mean	0.09221657530466716
sim_compute_robot_state-ego_median	0.09270612637201946
sim_compute_robot_state-ego_min	0.08969166278839111
sim_compute_sim_state_max	0.046239012082417805
sim_compute_sim_state_mean	0.04599196720123291
sim_compute_sim_state_median	0.046000825564066566
sim_compute_sim_state_min	0.0458188247680664
sim_physics_max	0.15287224610646566
sim_physics_mean	0.14576860602696734
sim_physics_median	0.1460714817047119
sim_physics_min	0.13622482776641845
sim_render-ego_max	0.07277334849039714
sim_render-ego_mean	0.07201399882634481
sim_render-ego_median	0.07214704672495524
sim_render-ego_min	0.07049689054489136
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22386

3344

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

step1-simulation

error

yes

2019-05-16 19:02:10+00:00

2019-05-16 19:03:31+00:00

0:01:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22382

3347

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

step1-simulation

error

yes

2019-05-16 18:55:46+00:00

2019-05-16 19:01:29+00:00

0:05:43

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22374

3363

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-05-16 18:38:47+00:00

2019-05-16 18:55:22+00:00

0:16:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.17625309983078313
agent_compute-ego_mean	0.15459522755965524
agent_compute-ego_median	0.15913964252845914
agent_compute-ego_min	0.11782347679138185
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10983236630757648, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059388447690893104, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14248813081670691, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08965456485748291, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037076989809672035, "sim_compute_performance-ego": 0.06754017759252477, "sim_compute_robot_state-ego": 0.07998771137661403}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10508386761534448, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.059158442067165, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1466529416102989, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09053615027782964, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03900088048448749, "sim_compute_performance-ego": 0.06624575222239774, "sim_compute_robot_state-ego": 0.07221005944644704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.08880361388711368, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0493316650390625, "in-drivable-lane": 0, "agent_compute-ego": 0.1291334208320169, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07567940038793228, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03082150571486529, "sim_compute_performance-ego": 0.06274975047392004, "sim_compute_robot_state-ego": 0.06573097846087288}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07724232673645019, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.048953218460083006, "in-drivable-lane": 0, "agent_compute-ego": 0.11782347679138185, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08277896881103515, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.029877471923828124, "sim_compute_performance-ego": 0.05374107360839843, "sim_compute_robot_state-ego": 0.05405324935913086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10078196284137196, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0524642799474016, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13160768038109888, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08093705961975871, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.033087911485116694, "sim_compute_performance-ego": 0.05503167985360834, "sim_compute_robot_state-ego": 0.06110450587695158}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1323069747613401, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.08080041651823083, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.17625309983078313, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10486830497274592, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04270637278654137, "sim_compute_performance-ego": 0.07426549950424506, "sim_compute_robot_state-ego": 0.0872695591984963}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12183875271252224, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.0678783016545432, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1536087989807129, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08759051987103053, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.09751888683864048, "sim_compute_performance-ego": 0.08345099432127816, "sim_compute_robot_state-ego": 0.07750268919127327}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.14024296261015393, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06504759334382557, "in-drivable-lane": 0, "agent_compute-ego": 0.15718892642429896, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10432834852309454, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04183324178059896, "sim_compute_performance-ego": 0.07316789172944568, "sim_compute_robot_state-ego": 0.08615052132379442}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.13296533439118982, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0676324286703336, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16495981458890235, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10585327875816215, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04138175107664981, "sim_compute_performance-ego": 0.0708601111072605, "sim_compute_robot_state-ego": 0.07635310948905298}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12120715921575372, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06971504471518776, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1628161083568226, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10491611740805884, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04113696705211293, "sim_compute_performance-ego": 0.07315218665383079, "sim_compute_robot_state-ego": 0.0805058089169589}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.1356029293753884, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06802021683036506, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17218447660470937, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.112020443012188, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04333586197394829, "sim_compute_performance-ego": 0.08476135637853052, "sim_compute_robot_state-ego": 0.08814864344411082}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.15191222088677542, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.07176744086401803, "in-drivable-lane": 0, "agent_compute-ego": 0.17163033144814627, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10452603442328316, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.0447989957673209, "sim_compute_performance-ego": 0.08191582134791783, "sim_compute_robot_state-ego": 0.09024468490055627}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11540967810387703, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06473155115164962, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15913964252845914, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.0994402333801868, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04328115313660865, "sim_compute_performance-ego": 0.06938658508599974, "sim_compute_robot_state-ego": 0.07348286404329188}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12501410201743798, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0639389091067844, "in-drivable-lane": 0, "agent_compute-ego": 0.16648387025903771, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10176829938535337, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04093382093641493, "sim_compute_performance-ego": 0.06913186885692456, "sim_compute_robot_state-ego": 0.07721867384733977}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12180633872163062, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06943307203405044, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16695769394145293, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.104967851264804, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04252606513453465, "sim_compute_performance-ego": 0.07723571973688462, "sim_compute_robot_state-ego": 0.08720116054310519}}
set_robot_commands_max	0.112020443012188
set_robot_commands_mean	0.09665770499686306
set_robot_commands_median	0.10176829938535337
set_robot_commands_min	0.07567940038793228
sim_compute_performance-ego_max	0.08476135637853052
sim_compute_performance-ego_mean	0.07084243123154448
sim_compute_performance-ego_median	0.0708601111072605
sim_compute_performance-ego_min	0.05374107360839843
sim_compute_robot_state-ego_max	0.09024468490055627
sim_compute_robot_state-ego_mean	0.07714428129453307
sim_compute_robot_state-ego_median	0.07750268919127327
sim_compute_robot_state-ego_min	0.05405324935913086
sim_compute_sim_state_max	0.09751888683864048
sim_compute_sim_state_mean	0.04328785839342271
sim_compute_sim_state_median	0.04138175107664981
sim_compute_sim_state_min	0.029877471923828124
sim_physics_max	0.15191222088677542
sim_physics_mean	0.11867003934559509
sim_physics_median	0.12180633872163062
sim_physics_min	0.07724232673645019
sim_render-ego_max	0.08080041651823083
sim_render-ego_mean	0.06388406853957292
sim_render-ego_median	0.06504759334382557
sim_render-ego_min	0.048953218460083006
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

22357

3386

RL-TH-shi

step1-simulation

success

yes

2019-05-16 18:01:30+00:00

2019-05-16 18:38:19+00:00

0:36:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.0961941803608934
survival_time_median	14.950000000000076
deviation-center-line_median	0.9555568126403592
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17341103792190551
agent_compute-ego_mean	0.16679463847478232
agent_compute-ego_median	0.16866087039311728
agent_compute-ego_min	0.15788953145345053
deviation-center-line_max	1.2876072210642098
deviation-center-line_mean	0.8275123667626163
deviation-center-line_min	0.4165220148816433
deviation-heading_max	16.99759519832536
deviation-heading_mean	6.125951093256273
deviation-heading_median	3.163097478713258
deviation-heading_min	1.8789318174933505
driven_any_max	3.9707506625282454
driven_any_mean	2.750455990614764
driven_any_median	3.166379558689082
driven_any_min	0.1357204919218267
driven_lanedir_consec_max	3.9062146074302166
driven_lanedir_consec_mean	2.556285663248601
driven_lanedir_consec_min	0.12068109296077888
driven_lanedir_max	3.9062146074302166
driven_lanedir_mean	2.6884372731658495
driven_lanedir_median	3.0963689487710204
driven_lanedir_min	0.12068109296077888
in-drivable-lane_max	4.25000000000006
in-drivable-lane_mean	0.8900000000000127
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.630389718202428, "sim_physics": 0.17873452186584474, "survival_time": 14.950000000000076, "driven_lanedir": 2.5423281923934073, "sim_render-ego": 0.055167959531148274, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.15788953145345053, "deviation-heading": 5.632204681719905, "set_robot_commands": 0.08382343133290608, "deviation-center-line": 0.9555568126403592, "driven_lanedir_consec": 2.3094997466357805, "sim_compute_sim_state": 0.035568127632141115, "sim_compute_performance-ego": 0.06035219351450602, "sim_compute_robot_state-ego": 0.0652646787961324, "sim_compute_robot_state-npc0": 0.06238325675328573, "sim_compute_robot_state-npc1": 0.062117741107940674, "sim_compute_robot_state-npc2": 0.06113009611765544, "sim_compute_robot_state-npc3": 0.06056814750035604}, "udem1-1-0": {"driven_any": 0.1357204919218267, "sim_physics": 0.2028897205988566, "survival_time": 14.950000000000076, "driven_lanedir": 0.12068109296077888, "sim_render-ego": 0.061084957122802735, "in-drivable-lane": 0, "agent_compute-ego": 0.1722736994425456, "deviation-heading": 16.99759519832536, "set_robot_commands": 0.08945998986562093, "deviation-center-line": 0.4165220148816433, "driven_lanedir_consec": 0.12068109296077888, "sim_compute_sim_state": 0.036806494394938154, "sim_compute_performance-ego": 0.06343329826990764, "sim_compute_robot_state-ego": 0.06873017152150472, "sim_compute_robot_state-npc0": 0.06524298906326294, "sim_compute_robot_state-npc1": 0.06480679035186768, "sim_compute_robot_state-npc2": 0.06442842245101929, "sim_compute_robot_state-npc3": 0.06496115287144978}, "udem1-2-0": {"driven_any": 3.849039521732238, "sim_physics": 0.1942102289199829, "survival_time": 14.950000000000076, "driven_lanedir": 3.776593524273823, "sim_render-ego": 0.06043704350789388, "in-drivable-lane": 0, "agent_compute-ego": 0.17341103792190551, "deviation-heading": 3.163097478713258, "set_robot_commands": 0.09244399070739746, "deviation-center-line": 1.2876072210642098, "driven_lanedir_consec": 3.348838688855335, "sim_compute_sim_state": 0.036699516773223875, "sim_compute_performance-ego": 0.06569170951843262, "sim_compute_robot_state-ego": 0.07259090026219686, "sim_compute_robot_state-npc0": 0.06773422718048096, "sim_compute_robot_state-npc1": 0.06733093659083049, "sim_compute_robot_state-npc2": 0.06589390595753987, "sim_compute_robot_state-npc3": 0.06584122737248739}, "udem1-3-0": {"driven_any": 3.9707506625282454, "sim_physics": 0.1954219388961792, "survival_time": 14.950000000000076, "driven_lanedir": 3.9062146074302166, "sim_render-ego": 0.0598202363650004, "in-drivable-lane": 0, "agent_compute-ego": 0.16866087039311728, "deviation-heading": 2.95792629002949, "set_robot_commands": 0.09247800906499228, "deviation-center-line": 1.0349443222002073, "driven_lanedir_consec": 3.9062146074302166, "sim_compute_sim_state": 0.03599563121795654, "sim_compute_performance-ego": 0.06641101757685343, "sim_compute_robot_state-ego": 0.07093421300252278, "sim_compute_robot_state-npc0": 0.06557390213012695, "sim_compute_robot_state-npc1": 0.06434804677963257, "sim_compute_robot_state-npc2": 0.06417282660802205, "sim_compute_robot_state-npc3": 0.06414253870646158}, "udem1-4-0": {"driven_any": 3.166379558689082, "sim_physics": 0.17110615412394206, "survival_time": 14.950000000000076, "driven_lanedir": 3.0963689487710204, "sim_render-ego": 0.05771746953328451, "in-drivable-lane": 4.25000000000006, "agent_compute-ego": 0.16173805316289266, "deviation-heading": 1.8789318174933505, "set_robot_commands": 0.09154293696085612, "deviation-center-line": 0.4429314630266619, "driven_lanedir_consec": 3.0961941803608934, "sim_compute_sim_state": 0.035366469224294025, "sim_compute_performance-ego": 0.06258252302805582, "sim_compute_robot_state-ego": 0.06580291191736858, "sim_compute_robot_state-npc0": 0.06336495796839396, "sim_compute_robot_state-npc1": 0.06352715333302816, "sim_compute_robot_state-npc2": 0.061151315371195475, "sim_compute_robot_state-npc3": 0.06241880178451538}}
set_robot_commands_max	0.09247800906499228
set_robot_commands_mean	0.08994967158635457
set_robot_commands_median	0.09154293696085612
set_robot_commands_min	0.08382343133290608
sim_compute_performance-ego_max	0.06641101757685343
sim_compute_performance-ego_mean	0.0636941483815511
sim_compute_performance-ego_median	0.06343329826990764
sim_compute_performance-ego_min	0.06035219351450602
sim_compute_robot_state-ego_max	0.07259090026219686
sim_compute_robot_state-ego_mean	0.06866457509994507
sim_compute_robot_state-ego_median	0.06873017152150472
sim_compute_robot_state-ego_min	0.0652646787961324
sim_compute_robot_state-npc0_max	0.06773422718048096
sim_compute_robot_state-npc0_mean	0.06485986661911011
sim_compute_robot_state-npc0_median	0.06524298906326294
sim_compute_robot_state-npc0_min	0.06238325675328573
sim_compute_robot_state-npc1_max	0.06733093659083049
sim_compute_robot_state-npc1_mean	0.06442613363265992
sim_compute_robot_state-npc1_median	0.06434804677963257
sim_compute_robot_state-npc1_min	0.062117741107940674
sim_compute_robot_state-npc2_max	0.06589390595753987
sim_compute_robot_state-npc2_mean	0.06335531330108642
sim_compute_robot_state-npc2_median	0.06417282660802205
sim_compute_robot_state-npc2_min	0.06113009611765544
sim_compute_robot_state-npc3_max	0.06584122737248739
sim_compute_robot_state-npc3_mean	0.06358637364705402
sim_compute_robot_state-npc3_median	0.06414253870646158
sim_compute_robot_state-npc3_min	0.06056814750035604
sim_compute_sim_state_max	0.036806494394938154
sim_compute_sim_state_mean	0.03608724784851074
sim_compute_sim_state_median	0.03599563121795654
sim_compute_sim_state_min	0.035366469224294025
sim_physics_max	0.2028897205988566
sim_physics_mean	0.1884725128809611
sim_physics_median	0.1942102289199829
sim_physics_min	0.17110615412394206
sim_render-ego_max	0.061084957122802735
sim_render-ego_mean	0.05884553321202596
sim_render-ego_median	0.0598202363650004
sim_render-ego_min	0.055167959531148274
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22342

3397

RL-TH-shi

step1-simulation

error

yes

2019-05-16 17:04:35+00:00

2019-05-16 18:01:22+00:00

0:56:47

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22339

3399

RL - TH -xyz

step1-simulation

error

yes

2019-05-16 17:03:38+00:00

2019-05-16 17:04:16+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22329

3409

RL - TH -hhk

step1-simulation

error

yes

2019-05-16 16:45:35+00:00

2019-05-16 17:03:30+00:00

0:17:55

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22327

3411

RL - TH -xyz

step1-simulation

error

yes

2019-05-16 16:44:54+00:00

2019-05-16 16:45:27+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22320

3417

RL - TH -xyz

step1-simulation

success

yes

2019-05-16 16:32:19+00:00

2019-05-16 16:44:20+00:00

0:12:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1990896621369949
survival_time_median	8.549999999999986
deviation-center-line_median	0.27984287863563906
in-drivable-lane_median	1.1999999999999955

other stats

agent_compute-ego_max	0.1624285991375263
agent_compute-ego_mean	0.15493356553984156
agent_compute-ego_median	0.15610548885919714
agent_compute-ego_min	0.14761669454518814
deviation-center-line_max	0.5867373025751078
deviation-center-line_mean	0.329920399140803
deviation-center-line_min	0.18228241241353563
deviation-heading_max	1.4726043676634242
deviation-heading_mean	1.1330413833210462
deviation-heading_median	1.0470324603828471
deviation-heading_min	0.8392455185368155
driven_any_max	1.9784423091100856
driven_any_mean	1.4691073891236293
driven_any_median	1.611422185622498
driven_any_min	0.5427627763159826
driven_lanedir_consec_max	1.4342644357938217
driven_lanedir_consec_mean	1.0156611891593452
driven_lanedir_consec_min	0.5028995304197132
driven_lanedir_max	1.4342644357938217
driven_lanedir_mean	1.0156611891593452
driven_lanedir_median	1.1990896621369949
driven_lanedir_min	0.5028995304197132
in-drivable-lane_max	4.949999999999991
in-drivable-lane_mean	1.880000000000002
in-drivable-lane_min	0.09999999999999964
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9784423091100856, "sim_physics": 0.09543951213011267, "survival_time": 8.549999999999986, "driven_lanedir": 0.731133519841413, "sim_render-ego": 0.05136656621743363, "in-drivable-lane": 4.949999999999991, "agent_compute-ego": 0.14761669454518814, "deviation-heading": 1.3078445591894818, "set_robot_commands": 0.08489760320786147, "deviation-center-line": 0.20443047512808832, "driven_lanedir_consec": 0.731133519841413, "sim_compute_sim_state": 0.03352126043442397, "sim_compute_performance-ego": 0.05846241761369315, "sim_compute_robot_state-ego": 0.062159041912235015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5427627763159826, "sim_physics": 0.10609556344839242, "survival_time": 3.2499999999999964, "driven_lanedir": 0.5028995304197132, "sim_render-ego": 0.064739440037654, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1624285991375263, "deviation-heading": 0.8392455185368155, "set_robot_commands": 0.08852981053865873, "deviation-center-line": 0.18228241241353563, "driven_lanedir_consec": 0.5028995304197132, "sim_compute_sim_state": 0.03605962900015024, "sim_compute_performance-ego": 0.0631716801570012, "sim_compute_robot_state-ego": 0.0710330266218919}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6004115710229994, "sim_physics": 0.095704436983381, "survival_time": 8.74999999999999, "driven_lanedir": 1.4342644357938217, "sim_render-ego": 0.05364257676260812, "in-drivable-lane": 0.9500000000000092, "agent_compute-ego": 0.14961215700422015, "deviation-heading": 1.0470324603828471, "set_robot_commands": 0.08118879863194058, "deviation-center-line": 0.5867373025751078, "driven_lanedir_consec": 1.4342644357938217, "sim_compute_sim_state": 0.03518272399902344, "sim_compute_performance-ego": 0.0597028078351702, "sim_compute_robot_state-ego": 0.062009216036115374}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.611422185622498, "sim_physics": 0.09981834247548094, "survival_time": 9.299999999999995, "driven_lanedir": 1.210918797604784, "sim_render-ego": 0.05737256234691989, "in-drivable-lane": 2.2000000000000144, "agent_compute-ego": 0.15610548885919714, "deviation-heading": 1.4726043676634242, "set_robot_commands": 0.08433630389551963, "deviation-center-line": 0.3963089269516444, "driven_lanedir_consec": 1.210918797604784, "sim_compute_sim_state": 0.0362281709588984, "sim_compute_performance-ego": 0.062062096852128226, "sim_compute_robot_state-ego": 0.06656066961185907}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6124981035465813, "sim_physics": 0.10289881706237793, "survival_time": 6.249999999999986, "driven_lanedir": 1.1990896621369949, "sim_render-ego": 0.05704084396362305, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.15890488815307618, "deviation-heading": 0.9984800108326628, "set_robot_commands": 0.08485345077514649, "deviation-center-line": 0.27984287863563906, "driven_lanedir_consec": 1.1990896621369949, "sim_compute_sim_state": 0.03516554641723633, "sim_compute_performance-ego": 0.06255588150024415, "sim_compute_robot_state-ego": 0.06437260437011719}}
set_robot_commands_max	0.08852981053865873
set_robot_commands_mean	0.08476119340982538
set_robot_commands_median	0.08485345077514649
set_robot_commands_min	0.08118879863194058
sim_compute_performance-ego_max	0.0631716801570012
sim_compute_performance-ego_mean	0.06119097679164739
sim_compute_performance-ego_median	0.062062096852128226
sim_compute_performance-ego_min	0.05846241761369315
sim_compute_robot_state-ego_max	0.0710330266218919
sim_compute_robot_state-ego_mean	0.0652269117104437
sim_compute_robot_state-ego_median	0.06437260437011719
sim_compute_robot_state-ego_min	0.062009216036115374
sim_compute_sim_state_max	0.0362281709588984
sim_compute_sim_state_mean	0.03523146616194648
sim_compute_sim_state_median	0.03518272399902344
sim_compute_sim_state_min	0.03352126043442397
sim_physics_max	0.10609556344839242
sim_physics_mean	0.09999133441994898
sim_physics_median	0.09981834247548094
sim_physics_min	0.09543951213011267
sim_render-ego_max	0.064739440037654
sim_render-ego_mean	0.056832397865647734
sim_render-ego_median	0.05704084396362305
sim_render-ego_min	0.05136656621743363
simulation-passed	1
survival_time_max	9.299999999999995
survival_time_mean	7.21999999999999
survival_time_min	3.2499999999999964

No reset possible

22311

3425

RL-TH-shi

step1-simulation

success

yes

2019-05-16 16:02:22+00:00

2019-05-16 16:31:37+00:00

0:29:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.4789233115106395
survival_time_median	14.950000000000076
deviation-center-line_median	0.8146285309217326
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1705783176422119
agent_compute-ego_mean	0.16478800010681152
agent_compute-ego_median	0.16434234937032063
agent_compute-ego_min	0.15866530338923138
deviation-center-line_max	1.2012396017870604
deviation-center-line_mean	0.7501260074558616
deviation-center-line_min	0.09089593761882547
deviation-heading_max	6.751529529551556
deviation-heading_mean	3.400992125160336
deviation-heading_median	3.427825313648924
deviation-heading_min	0.5354470537706654
driven_any_max	3.0602502735561883
driven_any_mean	2.3595528287629848
driven_any_median	2.747648771459853
driven_any_min	0.3817472176788552
driven_lanedir_consec_max	3.0094047492365696
driven_lanedir_consec_mean	2.1861404317235182
driven_lanedir_consec_min	0.3169746578615049
driven_lanedir_max	3.0094047492365696
driven_lanedir_mean	2.1861404317235182
driven_lanedir_median	2.4789233115106395
driven_lanedir_min	0.3169746578615049
in-drivable-lane_max	1.1999999999999955
in-drivable-lane_mean	0.24999999999999917
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5549718370774266, "sim_physics": 0.1532482536633809, "survival_time": 14.950000000000076, "driven_lanedir": 2.4789233115106395, "sim_render-ego": 0.057849442958831786, "in-drivable-lane": 0, "agent_compute-ego": 0.15866530338923138, "deviation-heading": 3.764395459495874, "set_robot_commands": 0.09113444010416669, "deviation-center-line": 0.915717854733624, "driven_lanedir_consec": 2.4789233115106395, "sim_compute_sim_state": 0.035156273047129316, "sim_compute_performance-ego": 0.0603924838701884, "sim_compute_robot_state-ego": 0.06471064408620199, "sim_compute_robot_state-npc0": 0.06319768269856771, "sim_compute_robot_state-npc1": 0.06814368565877278, "sim_compute_robot_state-npc2": 0.06147315343221029, "sim_compute_robot_state-npc3": 0.06128411134084066}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3817472176788552, "sim_physics": 0.1742067813873291, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3169746578615049, "sim_render-ego": 0.05756244659423828, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1705783176422119, "deviation-heading": 0.5354470537706654, "set_robot_commands": 0.09034584999084472, "deviation-center-line": 0.09089593761882547, "driven_lanedir_consec": 0.3169746578615049, "sim_compute_sim_state": 0.041628999710083006, "sim_compute_performance-ego": 0.06301189422607421, "sim_compute_robot_state-ego": 0.06833938598632812, "sim_compute_robot_state-npc0": 0.0647934627532959, "sim_compute_robot_state-npc1": 0.06505700111389161, "sim_compute_robot_state-npc2": 0.06329429626464844, "sim_compute_robot_state-npc3": 0.06462483406066895}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.053146044042598, "sim_physics": 0.1655573852856954, "survival_time": 14.950000000000076, "driven_lanedir": 2.9731439422185693, "sim_render-ego": 0.05644808689753215, "in-drivable-lane": 0, "agent_compute-ego": 0.16434234937032063, "deviation-heading": 3.427825313648924, "set_robot_commands": 0.09247412919998169, "deviation-center-line": 0.8146285309217326, "driven_lanedir_consec": 2.9731439422185693, "sim_compute_sim_state": 0.036865094502766926, "sim_compute_performance-ego": 0.06655084292093913, "sim_compute_robot_state-ego": 0.06864944775899251, "sim_compute_robot_state-npc0": 0.06681225220362345, "sim_compute_robot_state-npc1": 0.06554112911224365, "sim_compute_robot_state-npc2": 0.06293324947357178, "sim_compute_robot_state-npc3": 0.06550121068954468}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0602502735561883, "sim_physics": 0.1594786524772644, "survival_time": 14.950000000000076, "driven_lanedir": 3.0094047492365696, "sim_render-ego": 0.058335607846577965, "in-drivable-lane": 0, "agent_compute-ego": 0.16205903132756552, "deviation-heading": 2.5257632693346603, "set_robot_commands": 0.09020399808883668, "deviation-center-line": 0.7281481122180655, "driven_lanedir_consec": 3.0094047492365696, "sim_compute_sim_state": 0.037278894583384195, "sim_compute_performance-ego": 0.06412381649017335, "sim_compute_robot_state-ego": 0.06947394847869873, "sim_compute_robot_state-npc0": 0.06753857533137003, "sim_compute_robot_state-npc1": 0.06515476226806641, "sim_compute_robot_state-npc2": 0.06511690457661946, "sim_compute_robot_state-npc3": 0.06483456214269002}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.747648771459853, "sim_physics": 0.15322364966074625, "survival_time": 14.950000000000076, "driven_lanedir": 2.1522554977903083, "sim_render-ego": 0.058053767681121825, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.1682949988047282, "deviation-heading": 6.751529529551556, "set_robot_commands": 0.08714262088139851, "deviation-center-line": 1.2012396017870604, "driven_lanedir_consec": 2.1522554977903083, "sim_compute_sim_state": 0.03667447566986084, "sim_compute_performance-ego": 0.06472389777501424, "sim_compute_robot_state-ego": 0.06963449875513712, "sim_compute_robot_state-npc0": 0.06588028748830159, "sim_compute_robot_state-npc1": 0.06497968196868896, "sim_compute_robot_state-npc2": 0.06372095425923666, "sim_compute_robot_state-npc3": 0.06542930761973063}}
set_robot_commands_max	0.09247412919998169
set_robot_commands_mean	0.09026020765304564
set_robot_commands_median	0.09034584999084472
set_robot_commands_min	0.08714262088139851
sim_compute_performance-ego_max	0.06655084292093913
sim_compute_performance-ego_mean	0.06376058705647787
sim_compute_performance-ego_median	0.06412381649017335
sim_compute_performance-ego_min	0.0603924838701884
sim_compute_robot_state-ego_max	0.06963449875513712
sim_compute_robot_state-ego_mean	0.0681615850130717
sim_compute_robot_state-ego_median	0.06864944775899251
sim_compute_robot_state-ego_min	0.06471064408620199
sim_compute_robot_state-npc0_max	0.06753857533137003
sim_compute_robot_state-npc0_mean	0.06564445209503174
sim_compute_robot_state-npc0_median	0.06588028748830159
sim_compute_robot_state-npc0_min	0.06319768269856771
sim_compute_robot_state-npc1_max	0.06814368565877278
sim_compute_robot_state-npc1_mean	0.06577525202433268
sim_compute_robot_state-npc1_median	0.06515476226806641
sim_compute_robot_state-npc1_min	0.06497968196868896
sim_compute_robot_state-npc2_max	0.06511690457661946
sim_compute_robot_state-npc2_mean	0.06330771160125732
sim_compute_robot_state-npc2_median	0.06329429626464844
sim_compute_robot_state-npc2_min	0.06147315343221029
sim_compute_robot_state-npc3_max	0.06550121068954468
sim_compute_robot_state-npc3_mean	0.06433480517069498
sim_compute_robot_state-npc3_median	0.06483456214269002
sim_compute_robot_state-npc3_min	0.06128411134084066
sim_compute_sim_state_max	0.041628999710083006
sim_compute_sim_state_mean	0.037520747502644856
sim_compute_sim_state_median	0.036865094502766926
sim_compute_sim_state_min	0.035156273047129316
sim_physics_max	0.1742067813873291
sim_physics_mean	0.16114294449488323
sim_physics_median	0.1594786524772644
sim_physics_min	0.15322364966074625
sim_render-ego_max	0.058335607846577965
sim_render-ego_mean	0.0576498703956604
sim_render-ego_median	0.057849442958831786
sim_render-ego_min	0.05644808689753215
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.21000000000006
survival_time_min	1.2500000000000004

No reset possible

22290

3441

RL-TH-shi

step1-simulation

error

yes

2019-05-16 15:24:57+00:00

2019-05-16 16:01:48+00:00

0:36:51

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22278

3486

Eric Lu

Testing the RL solution

step1-simulation

success

yes

2019-05-16 15:01:17+00:00

2019-05-17 18:26:17+00:00

1 day, 3:25:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0005547867508171045
survival_time_median	14.950000000000076
deviation-center-line_median	0.44901648578509457
in-drivable-lane_median	7.600000000000044

other stats

agent_compute-ego_max	0.13974887609481812
agent_compute-ego_mean	0.13582511425018312
agent_compute-ego_median	0.13518306334813435
agent_compute-ego_min	0.13214000940322876
deviation-center-line_max	0.5610133203215761
deviation-center-line_mean	0.3827485453764907
deviation-center-line_min	0.13860669343031343
deviation-heading_max	5.876680788839771
deviation-heading_mean	5.630778146323924
deviation-heading_median	5.657649106857695
deviation-heading_min	5.445457843647878
driven_any_max	0.026478672834056367
driven_any_mean	0.02486423959225153
driven_any_median	0.02593019554121306
driven_any_min	0.022165452661374756
driven_lanedir_consec_max	0.0021599934447711355
driven_lanedir_consec_mean	-0.00046586963337973407
driven_lanedir_consec_min	-0.003361806018059577
driven_lanedir_max	0.0021599934447711355
driven_lanedir_mean	-0.00046586963337973407
driven_lanedir_median	-0.0005547867508171045
driven_lanedir_min	-0.003361806018059577
in-drivable-lane_max	7.700000000000042
in-drivable-lane_mean	7.620000000000043
in-drivable-lane_min	7.550000000000042
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.05732198238372803, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.055813541412353514, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.13691158930460612, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.07645061731338501, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.03842011133829753, "sim_compute_performance-ego": 0.05994773387908935, "sim_compute_robot_state-ego": 0.060551739533742266}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02593019554121306, "sim_physics": 0.05751355727513631, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.05726299206415812, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.13214000940322876, "deviation-heading": 5.445457843647878, "set_robot_commands": 0.07328295866648356, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.03870032946268717, "sim_compute_performance-ego": 0.06123881101608277, "sim_compute_robot_state-ego": 0.06217957894007365}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672438047, "sim_physics": 0.056215430895487466, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021181059556472093, "sim_render-ego": 0.055637897650400794, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.13518306334813435, "deviation-heading": 5.876680788839771, "set_robot_commands": 0.07563153425852458, "deviation-center-line": 0.4784517475259532, "driven_lanedir_consec": 0.0021181059556472093, "sim_compute_sim_state": 0.03721019744873047, "sim_compute_performance-ego": 0.06136019468307495, "sim_compute_robot_state-ego": 0.06056402047475179}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661374756, "sim_physics": 0.05505349636077881, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.055478870073954266, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.13974887609481812, "deviation-heading": 5.721005148732661, "set_robot_commands": 0.07707885185877482, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.037121593952178955, "sim_compute_performance-ego": 0.05965781688690185, "sim_compute_robot_state-ego": 0.06000970760981242}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252175396, "sim_physics": 0.05798179785410563, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.05569203456242879, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.13514203310012818, "deviation-heading": 5.453097843541612, "set_robot_commands": 0.07498233874638875, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.038775881131490074, "sim_compute_performance-ego": 0.05958258549372355, "sim_compute_robot_state-ego": 0.06081244150797526}}
set_robot_commands_max	0.07707885185877482
set_robot_commands_mean	0.07548526016871135
set_robot_commands_median	0.07563153425852458
set_robot_commands_min	0.07328295866648356
sim_compute_performance-ego_max	0.06136019468307495
sim_compute_performance-ego_mean	0.06035742839177449
sim_compute_performance-ego_median	0.05994773387908935
sim_compute_performance-ego_min	0.05958258549372355
sim_compute_robot_state-ego_max	0.06217957894007365
sim_compute_robot_state-ego_mean	0.06082349761327107
sim_compute_robot_state-ego_median	0.06056402047475179
sim_compute_robot_state-ego_min	0.06000970760981242
sim_compute_sim_state_max	0.038775881131490074
sim_compute_sim_state_mean	0.03804562266667684
sim_compute_sim_state_median	0.03842011133829753
sim_compute_sim_state_min	0.037121593952178955
sim_physics_max	0.05798179785410563
sim_physics_mean	0.05681725295384725
sim_physics_median	0.05732198238372803
sim_physics_min	0.05505349636077881
sim_render-ego_max	0.05726299206415812
sim_render-ego_mean	0.0559770671526591
sim_render-ego_median	0.05569203456242879
sim_render-ego_min	0.055478870073954266
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22270

3491

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

error

yes

2019-05-16 14:47:09+00:00

2019-05-17 19:02:28+00:00

1 day, 4:15:19

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22262

3516

Second test - TH-jp

step1-simulation

success

yes

2019-05-16 14:25:18+00:00

2019-05-16 14:46:33+00:00

0:21:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0328325337918964
survival_time_median	14.950000000000076
deviation-center-line_median	0.8392144281375854
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16511745850245158
agent_compute-ego_mean	0.15846323702253767
agent_compute-ego_median	0.15900044712593886
agent_compute-ego_min	0.14799310440240904
deviation-center-line_max	1.57377995654447
deviation-center-line_mean	0.865559805771654
deviation-center-line_min	0.18496563734886728
deviation-heading_max	4.004765313771469
deviation-heading_mean	2.0308289158991455
deviation-heading_median	1.7642265469798744
deviation-heading_min	0.948149445292733
driven_any_max	1.9219346725617432
driven_any_mean	1.4991572119331416
driven_any_median	1.7528162542818746
driven_any_min	0.9524352508948164
driven_lanedir_consec_max	1.6401451217007263
driven_lanedir_consec_mean	1.0398631418425317
driven_lanedir_consec_min	0.5423023023607837
driven_lanedir_max	1.6401451217007263
driven_lanedir_mean	1.0601325192632054
driven_lanedir_median	1.0328325337918964
driven_lanedir_min	0.5423023023607837
in-drivable-lane_max	6.049999999999988
in-drivable-lane_mean	1.5899999999999963
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.792479434189623, "sim_physics": 0.09462983802307484, "survival_time": 8.599999999999987, "driven_lanedir": 0.7364170368464507, "sim_render-ego": 0.054211482059123905, "in-drivable-lane": 6.049999999999988, "agent_compute-ego": 0.14799310440240904, "deviation-heading": 0.948149445292733, "set_robot_commands": 0.08400636218314947, "deviation-center-line": 0.18496563734886728, "driven_lanedir_consec": 0.7364170368464507, "sim_compute_sim_state": 0.0360064756038577, "sim_compute_performance-ego": 0.06024790503257929, "sim_compute_robot_state-ego": 0.0637306903683862}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9524352508948164, "sim_physics": 0.11037824710210165, "survival_time": 14.950000000000076, "driven_lanedir": 0.5423023023607837, "sim_render-ego": 0.060856415430704754, "in-drivable-lane": 0, "agent_compute-ego": 0.16135262250900267, "deviation-heading": 1.7642265469798744, "set_robot_commands": 0.0910523557662964, "deviation-center-line": 0.8392144281375854, "driven_lanedir_consec": 0.5423023023607837, "sim_compute_sim_state": 0.03752377986907959, "sim_compute_performance-ego": 0.0661162288983663, "sim_compute_robot_state-ego": 0.07178863445917766}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9219346725617432, "sim_physics": 0.09823384046554566, "survival_time": 14.950000000000076, "driven_lanedir": 1.6401451217007263, "sim_render-ego": 0.0595707114537557, "in-drivable-lane": 0, "agent_compute-ego": 0.15885255257288614, "deviation-heading": 2.255800088849635, "set_robot_commands": 0.09126749833424888, "deviation-center-line": 1.2687407568495153, "driven_lanedir_consec": 1.6401451217007263, "sim_compute_sim_state": 0.037908584276835126, "sim_compute_performance-ego": 0.06760000467300414, "sim_compute_robot_state-ego": 0.07124161720275879}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0761204477376498, "sim_physics": 0.10611399014790852, "survival_time": 6.149999999999986, "driven_lanedir": 1.0328325337918964, "sim_render-ego": 0.0591616921308564, "in-drivable-lane": 0, "agent_compute-ego": 0.15900044712593886, "deviation-heading": 1.1812031846020177, "set_robot_commands": 0.08911367354354238, "deviation-center-line": 0.461098249977832, "driven_lanedir_consec": 1.0328325337918964, "sim_compute_sim_state": 0.03668747103311182, "sim_compute_performance-ego": 0.06675238919451953, "sim_compute_robot_state-ego": 0.07439405355996233}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7528162542818746, "sim_physics": 0.10247782150904336, "survival_time": 14.950000000000076, "driven_lanedir": 1.348965601616169, "sim_render-ego": 0.05954940319061279, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.16511745850245158, "deviation-heading": 4.004765313771469, "set_robot_commands": 0.09373553117116291, "deviation-center-line": 1.57377995654447, "driven_lanedir_consec": 1.2476187145128013, "sim_compute_sim_state": 0.038272020816802976, "sim_compute_performance-ego": 0.06743561347325643, "sim_compute_robot_state-ego": 0.07263184626897176}}
set_robot_commands_max	0.09373553117116291
set_robot_commands_mean	0.08983508419968
set_robot_commands_median	0.0910523557662964
set_robot_commands_min	0.08400636218314947
sim_compute_performance-ego_max	0.06760000467300414
sim_compute_performance-ego_mean	0.06563042825434515
sim_compute_performance-ego_median	0.06675238919451953
sim_compute_performance-ego_min	0.06024790503257929
sim_compute_robot_state-ego_max	0.07439405355996233
sim_compute_robot_state-ego_mean	0.07075736837185134
sim_compute_robot_state-ego_median	0.07178863445917766
sim_compute_robot_state-ego_min	0.0637306903683862
sim_compute_sim_state_max	0.038272020816802976
sim_compute_sim_state_mean	0.03727966631993744
sim_compute_sim_state_median	0.03752377986907959
sim_compute_sim_state_min	0.0360064756038577
sim_physics_max	0.11037824710210165
sim_physics_mean	0.1023667474495348
sim_physics_median	0.10247782150904336
sim_physics_min	0.09462983802307484
sim_render-ego_max	0.060856415430704754
sim_render-ego_mean	0.05866994085301071
sim_render-ego_median	0.05954940319061279
sim_render-ego_min	0.054211482059123905
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.92000000000004
survival_time_min	6.149999999999986

No reset possible

22258

3517

Bea Baselines 🐤

Straight max

step1-simulation

success

yes

2019-05-16 14:19:32+00:00

2019-05-16 14:24:27+00:00

0:04:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6618324868125249
survival_time_median	2.1000000000000005
deviation-center-line_median	0.09250602665006584
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.15481834642348752
agent_compute-ego_mean	0.14717569689565008
agent_compute-ego_median	0.14553618431091309
agent_compute-ego_min	0.13904554503304617
deviation-center-line_max	0.21439068356235536
deviation-center-line_mean	0.12258369343422797
deviation-center-line_min	0.0744010530149505
deviation-heading_max	0.5686442582449269
deviation-heading_mean	0.3103675930817716
deviation-heading_median	0.25395078679676
deviation-heading_min	0.17582209342949345
driven_any_max	1.575892401948956
driven_any_mean	0.8642098067399473
driven_any_median	1.0038564958116647
driven_any_min	0.26972689326339405
driven_lanedir_consec_max	1.1723086623342591
driven_lanedir_consec_mean	0.6830346826605466
driven_lanedir_consec_min	0.2605911739016977
driven_lanedir_max	1.1723086623342591
driven_lanedir_mean	0.6830346826605466
driven_lanedir_median	0.6618324868125249
driven_lanedir_min	0.2605911739016977
in-drivable-lane_max	0.6999999999999975
in-drivable-lane_mean	0.2699999999999994
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0038564958116647, "sim_physics": 0.10020028409503756, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6618324868125249, "sim_render-ego": 0.0599254880632673, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.15136638141813732, "deviation-heading": 0.25395078679676, "set_robot_commands": 0.08784676733471099, "deviation-center-line": 0.09250602665006584, "driven_lanedir_consec": 0.6618324868125249, "sim_compute_sim_state": 0.03492116928100586, "sim_compute_performance-ego": 0.060641669091724214, "sim_compute_robot_state-ego": 0.06804553667704265}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0061450567009285, "sim_physics": 0.10005232833680652, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8764382022560809, "sim_render-ego": 0.05957605725242978, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13904554503304617, "deviation-heading": 0.5686442582449269, "set_robot_commands": 0.08526499498458136, "deviation-center-line": 0.1563855108175075, "driven_lanedir_consec": 0.8764382022560809, "sim_compute_sim_state": 0.03659413542066302, "sim_compute_performance-ego": 0.06708971659342448, "sim_compute_robot_state-ego": 0.06778626214890253}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26972689326339405, "sim_physics": 0.10705603659152985, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2605911739016977, "sim_render-ego": 0.05854539573192597, "in-drivable-lane": 0, "agent_compute-ego": 0.14553618431091309, "deviation-heading": 0.20274263769041717, "set_robot_commands": 0.09283143281936646, "deviation-center-line": 0.07523519312626054, "driven_lanedir_consec": 0.2605911739016977, "sim_compute_sim_state": 0.03548361361026764, "sim_compute_performance-ego": 0.06418916583061218, "sim_compute_robot_state-ego": 0.06696945428848267}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4654281859747942, "sim_physics": 0.10759379552758258, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4440028879981699, "sim_render-ego": 0.06204308634218962, "in-drivable-lane": 0, "agent_compute-ego": 0.14511202729266623, "deviation-heading": 0.3506781892472603, "set_robot_commands": 0.08788836520651112, "deviation-center-line": 0.0744010530149505, "driven_lanedir_consec": 0.4440028879981699, "sim_compute_sim_state": 0.03489448713219684, "sim_compute_performance-ego": 0.06701747230861498, "sim_compute_robot_state-ego": 0.07161693987639053}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575892401948956, "sim_physics": 0.10876998593730312, "survival_time": 3.099999999999997, "driven_lanedir": 1.1723086623342591, "sim_render-ego": 0.0625239456853559, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.15481834642348752, "deviation-heading": 0.17582209342949345, "set_robot_commands": 0.09637498471044724, "deviation-center-line": 0.21439068356235536, "driven_lanedir_consec": 1.1723086623342591, "sim_compute_sim_state": 0.04016650492145169, "sim_compute_performance-ego": 0.07596082072104177, "sim_compute_robot_state-ego": 0.07402391587534259}}
set_robot_commands_max	0.09637498471044724
set_robot_commands_mean	0.09004130901112344
set_robot_commands_median	0.08788836520651112
set_robot_commands_min	0.08526499498458136
sim_compute_performance-ego_max	0.07596082072104177
sim_compute_performance-ego_mean	0.06697976890908353
sim_compute_performance-ego_median	0.06701747230861498
sim_compute_performance-ego_min	0.060641669091724214
sim_compute_robot_state-ego_max	0.07402391587534259
sim_compute_robot_state-ego_mean	0.06968842177323219
sim_compute_robot_state-ego_median	0.06804553667704265
sim_compute_robot_state-ego_min	0.06696945428848267
sim_compute_sim_state_max	0.04016650492145169
sim_compute_sim_state_mean	0.03641198207311701
sim_compute_sim_state_median	0.03548361361026764
sim_compute_sim_state_min	0.03489448713219684
sim_physics_max	0.10876998593730312
sim_physics_mean	0.10473448609765192
sim_physics_median	0.10705603659152985
sim_physics_min	0.10005232833680652
sim_render-ego_max	0.0625239456853559
sim_render-ego_mean	0.06052279461503371
sim_render-ego_median	0.0599254880632673
sim_render-ego_min	0.05854539573192597
simulation-passed	1
survival_time_max	3.099999999999997
survival_time_mean	1.8499999999999996
survival_time_min	0.8000000000000002

No reset possible

22252

3512

Bea Baselines 🐤

challenge-aido_LF-template-pytorch

step1-simulation

success

yes

2019-05-16 14:03:39+00:00

2019-05-16 14:19:15+00:00

0:15:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.12739082416299574
survival_time_median	1.3000000000000005
deviation-center-line_median	0.08166444632038598
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18476768462888657
agent_compute-ego_mean	0.16376106652265052
agent_compute-ego_median	0.15784091949462892
agent_compute-ego_min	0.1470374365647634
deviation-center-line_max	0.10535131406181696
deviation-center-line_mean	0.07920742144300794
deviation-center-line_min	0.04917145582597334
deviation-heading_max	0.8944037859209665
deviation-heading_mean	0.6835739505179455
deviation-heading_median	0.7143094752986094
deviation-heading_min	0.43743511397729734
driven_any_max	0.27551261256002413
driven_any_mean	0.18207307865933367
driven_any_median	0.1694214624294807
driven_any_min	0.1291760435692988
driven_lanedir_consec_max	0.16044635668179685
driven_lanedir_consec_mean	0.11784383872015912
driven_lanedir_consec_min	0.04857885231725145
driven_lanedir_max	0.16044635668179685
driven_lanedir_mean	0.11784383872015912
driven_lanedir_median	0.12739082416299574
driven_lanedir_min	0.04857885231725145
in-drivable-lane_max	0.6500000000000005
in-drivable-lane_mean	0.09333333333333342
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.22820709281725776, "sim_physics": 0.1834951639175415, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13280530497373566, "sim_render-ego": 0.0544139305750529, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15784091949462892, "deviation-heading": 0.8433953108880111, "set_robot_commands": 0.09036743640899658, "deviation-center-line": 0.08166444632038598, "driven_lanedir_consec": 0.13280530497373566, "sim_compute_sim_state": 0.036406358083089195, "sim_compute_performance-ego": 0.060034624735514325, "sim_compute_robot_state-ego": 0.06399655342102051, "sim_compute_robot_state-npc0": 0.06115816434224446, "sim_compute_robot_state-npc1": 0.06027337710062663, "sim_compute_robot_state-npc2": 0.056591184933980306, "sim_compute_robot_state-npc3": 0.057327795028686526}, "udem1-1-0": {"driven_any": 0.20266776554092908, "sim_physics": 0.2099245861172676, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04857885231725145, "sim_render-ego": 0.058185845613479614, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.15606805682182312, "deviation-heading": 0.7143094752986094, "set_robot_commands": 0.08968508243560791, "deviation-center-line": 0.04917145582597334, "driven_lanedir_consec": 0.04857885231725145, "sim_compute_sim_state": 0.03775376081466675, "sim_compute_performance-ego": 0.06416727602481842, "sim_compute_robot_state-ego": 0.06575394421815872, "sim_compute_robot_state-npc0": 0.062373265624046326, "sim_compute_robot_state-npc1": 0.06619405746459961, "sim_compute_robot_state-npc2": 0.06731273233890533, "sim_compute_robot_state-npc3": 0.06713659316301346}, "udem1-2-0": {"driven_any": 0.16108849671358594, "sim_physics": 0.2465995450814565, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13188257778266976, "sim_render-ego": 0.05705118179321289, "in-drivable-lane": 0, "agent_compute-ego": 0.15444488326708475, "deviation-heading": 0.45036973196732893, "set_robot_commands": 0.0851011872291565, "deviation-center-line": 0.10535131406181696, "driven_lanedir_consec": 0.13188257778266976, "sim_compute_sim_state": 0.036276797453562416, "sim_compute_performance-ego": 0.06125849485397339, "sim_compute_robot_state-ego": 0.07144211729367574, "sim_compute_robot_state-npc0": 0.06509377559026082, "sim_compute_robot_state-npc1": 0.06627131501833598, "sim_compute_robot_state-npc2": 0.06189813216527303, "sim_compute_robot_state-npc3": 0.0652672251065572}, "udem1-3-0": {"driven_any": 0.153655082107214, "sim_physics": 0.2216716508070628, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1255962524250125, "sim_render-ego": 0.06339550018310547, "in-drivable-lane": 0, "agent_compute-ego": 0.17390645543734232, "deviation-heading": 0.46834646323296336, "set_robot_commands": 0.09079898397127788, "deviation-center-line": 0.1030498142655799, "driven_lanedir_consec": 0.1255962524250125, "sim_compute_sim_state": 0.03971850872039795, "sim_compute_performance-ego": 0.06715959310531616, "sim_compute_robot_state-ego": 0.07341389854749043, "sim_compute_robot_state-npc0": 0.0682414174079895, "sim_compute_robot_state-npc1": 0.06819952527681987, "sim_compute_robot_state-npc2": 0.06979599595069885, "sim_compute_robot_state-npc3": 0.07064475615819295}, "udem1-4-0": {"driven_any": 0.13981664554712356, "sim_physics": 0.1873867304428764, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07507866194597557, "sim_render-ego": 0.05360462354577106, "in-drivable-lane": 0, "agent_compute-ego": 0.1537732041400412, "deviation-heading": 0.8402456780060235, "set_robot_commands": 0.0822650556978972, "deviation-center-line": 0.05739454977041497, "driven_lanedir_consec": 0.07507866194597557, "sim_compute_sim_state": 0.03527833067852518, "sim_compute_performance-ego": 0.05989587825277577, "sim_compute_robot_state-ego": 0.06680842067884363, "sim_compute_robot_state-npc0": 0.060166545536207115, "sim_compute_robot_state-npc1": 0.062391923821490745, "sim_compute_robot_state-npc2": 0.0617777679277503, "sim_compute_robot_state-npc3": 0.062472809915957245}, "udem1-5-0": {"driven_any": 0.23020312238328677, "sim_physics": 0.1799452006816864, "survival_time": 1.6000000000000008, "driven_lanedir": 0.14795033168175253, "sim_render-ego": 0.05333881825208664, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16148369014263153, "deviation-heading": 0.8944037859209665, "set_robot_commands": 0.08640874177217484, "deviation-center-line": 0.07849734496098351, "driven_lanedir_consec": 0.14795033168175253, "sim_compute_sim_state": 0.034599244594573975, "sim_compute_performance-ego": 0.06113458424806595, "sim_compute_robot_state-ego": 0.0637613832950592, "sim_compute_robot_state-npc0": 0.06151715666055679, "sim_compute_robot_state-npc1": 0.06007233262062073, "sim_compute_robot_state-npc2": 0.05678988993167877, "sim_compute_robot_state-npc3": 0.059908583760261536}, "udem1-6-0": {"driven_any": 0.13739141656015158, "sim_physics": 0.2450716599174168, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09810265379317862, "sim_render-ego": 0.06367431516232698, "in-drivable-lane": 0, "agent_compute-ego": 0.17728295533553415, "deviation-heading": 0.6108547854404713, "set_robot_commands": 0.0936152105746062, "deviation-center-line": 0.08590157493301563, "driven_lanedir_consec": 0.09810265379317862, "sim_compute_sim_state": 0.04091674348582392, "sim_compute_performance-ego": 0.07417300473088803, "sim_compute_robot_state-ego": 0.07740012459132982, "sim_compute_robot_state-npc0": 0.07035036708997644, "sim_compute_robot_state-npc1": 0.07043027877807617, "sim_compute_robot_state-npc2": 0.07130860245746115, "sim_compute_robot_state-npc3": 0.07309508323669434}, "udem1-7-0": {"driven_any": 0.1694214624294807, "sim_physics": 0.21872691007760856, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1354027287524724, "sim_render-ego": 0.06375100979438195, "in-drivable-lane": 0, "agent_compute-ego": 0.1842745267427885, "deviation-heading": 0.5525010321613538, "set_robot_commands": 0.09460028318258432, "deviation-center-line": 0.0949205639516543, "driven_lanedir_consec": 0.1354027287524724, "sim_compute_sim_state": 0.04129774753863995, "sim_compute_performance-ego": 0.06762821857745831, "sim_compute_robot_state-ego": 0.07003931815807636, "sim_compute_robot_state-npc0": 0.06882540996258076, "sim_compute_robot_state-npc1": 0.0661164980668288, "sim_compute_robot_state-npc2": 0.06576743492713341, "sim_compute_robot_state-npc3": 0.0720811073596661}, "udem1-8-0": {"driven_any": 0.2256162089827095, "sim_physics": 0.20383083435796925, "survival_time": 1.5500000000000007, "driven_lanedir": 0.16044635668179685, "sim_render-ego": 0.08630955603814894, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18476768462888657, "deviation-heading": 0.8103928587691155, "set_robot_commands": 0.10080790519714355, "deviation-center-line": 0.06310404878870934, "driven_lanedir_consec": 0.16044635668179685, "sim_compute_sim_state": 0.041854712270921274, "sim_compute_performance-ego": 0.07348091371597783, "sim_compute_robot_state-ego": 0.07741732751169512, "sim_compute_robot_state-npc0": 0.07033335008928852, "sim_compute_robot_state-npc1": 0.06813362336927845, "sim_compute_robot_state-npc2": 0.07089711004687894, "sim_compute_robot_state-npc3": 0.0700593763782132}, "udem1-9-0": {"driven_any": 0.20596055415287937, "sim_physics": 0.21258903466738188, "survival_time": 1.3000000000000005, "driven_lanedir": 0.147810754938138, "sim_render-ego": 0.06223408992473896, "in-drivable-lane": 0, "agent_compute-ego": 0.16989333813007065, "deviation-heading": 0.7948395610973749, "set_robot_commands": 0.09164064664107102, "deviation-center-line": 0.07148292926011672, "driven_lanedir_consec": 0.147810754938138, "sim_compute_sim_state": 0.03518346639779898, "sim_compute_performance-ego": 0.05952900189619798, "sim_compute_robot_state-ego": 0.0678318922336285, "sim_compute_robot_state-npc0": 0.06877581889812763, "sim_compute_robot_state-npc1": 0.06732782033773568, "sim_compute_robot_state-npc2": 0.06256372195023757, "sim_compute_robot_state-npc3": 0.06251335144042969}, "udem1-10-0": {"driven_any": 0.1578030648975387, "sim_physics": 0.1920095185438792, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09526607341585414, "sim_render-ego": 0.056928286949793495, "in-drivable-lane": 0, "agent_compute-ego": 0.1470374365647634, "deviation-heading": 0.8862955888299321, "set_robot_commands": 0.08811499675114949, "deviation-center-line": 0.061250469156920714, "driven_lanedir_consec": 0.09526607341585414, "sim_compute_sim_state": 0.03323671221733093, "sim_compute_performance-ego": 0.06305602192878723, "sim_compute_robot_state-ego": 0.06821711858113606, "sim_compute_robot_state-npc0": 0.063358207543691, "sim_compute_robot_state-npc1": 0.06131940086682638, "sim_compute_robot_state-npc2": 0.06275618076324463, "sim_compute_robot_state-npc3": 0.06009323398272196}, "udem1-11-0": {"driven_any": 0.13793227142857434, "sim_physics": 0.19893321990966795, "survival_time": 1.0000000000000002, "driven_lanedir": 0.11048060583341623, "sim_render-ego": 0.05994168519973755, "in-drivable-lane": 0, "agent_compute-ego": 0.15378785133361816, "deviation-heading": 0.43743511397729734, "set_robot_commands": 0.08749377727508545, "deviation-center-line": 0.08821708648511872, "driven_lanedir_consec": 0.11048060583341623, "sim_compute_sim_state": 0.03764940500259399, "sim_compute_performance-ego": 0.06956921815872193, "sim_compute_robot_state-ego": 0.06914379596710205, "sim_compute_robot_state-npc0": 0.06340347528457642, "sim_compute_robot_state-npc1": 0.06586630344390869, "sim_compute_robot_state-npc2": 0.06317163705825805, "sim_compute_robot_state-npc3": 0.06167234182357788}, "udem1-12-0": {"driven_any": 0.27551261256002413, "sim_physics": 0.20536517485594136, "survival_time": 1.950000000000001, "driven_lanedir": 0.12739082416299574, "sim_render-ego": 0.0622259286733774, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15656353265811235, "deviation-heading": 0.74269506660919, "set_robot_commands": 0.09189469997699444, "deviation-center-line": 0.07470024164204528, "driven_lanedir_consec": 0.12739082416299574, "sim_compute_sim_state": 0.03925157815982134, "sim_compute_performance-ego": 0.06508259284190643, "sim_compute_robot_state-ego": 0.06824753834651066, "sim_compute_robot_state-npc0": 0.06805254862858699, "sim_compute_robot_state-npc1": 0.06465753530844665, "sim_compute_robot_state-npc2": 0.06743106475243202, "sim_compute_robot_state-npc3": 0.06574153288816795}, "udem1-13-0": {"driven_any": 0.1291760435692988, "sim_physics": 0.23081208311993143, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0942065850756637, "sim_render-ego": 0.06618307984393576, "in-drivable-lane": 0, "agent_compute-ego": 0.1679232535154923, "deviation-heading": 0.5577150912322762, "set_robot_commands": 0.09401935079823368, "deviation-center-line": 0.09018753673738882, "driven_lanedir_consec": 0.0942065850756637, "sim_compute_sim_state": 0.04008720232092816, "sim_compute_performance-ego": 0.07644500939742378, "sim_compute_robot_state-ego": 0.08027637523153554, "sim_compute_robot_state-npc0": 0.0705157466556715, "sim_compute_robot_state-npc1": 0.07382007267164148, "sim_compute_robot_state-npc2": 0.07391806270765222, "sim_compute_robot_state-npc3": 0.0680133467135222}, "udem1-14-0": {"driven_any": 0.1766443401999513, "sim_physics": 0.17793035507202148, "survival_time": 1.3500000000000003, "driven_lanedir": 0.13665901702247374, "sim_render-ego": 0.052847614994755494, "in-drivable-lane": 0, "agent_compute-ego": 0.15736820962693956, "deviation-heading": 0.6498097143382661, "set_robot_commands": 0.08727086031878437, "deviation-center-line": 0.08321794548499498, "driven_lanedir_consec": 0.13665901702247374, "sim_compute_sim_state": 0.03515297395211679, "sim_compute_performance-ego": 0.05821320745680067, "sim_compute_robot_state-ego": 0.06405391516508879, "sim_compute_robot_state-npc0": 0.06519661126313386, "sim_compute_robot_state-npc1": 0.06736838376080548, "sim_compute_robot_state-npc2": 0.06322754753960504, "sim_compute_robot_state-npc3": 0.06369072419625742}}
set_robot_commands_max	0.10080790519714355
set_robot_commands_mean	0.09027228121538423
set_robot_commands_median	0.09036743640899658
set_robot_commands_min	0.0822650556978972
sim_compute_performance-ego_max	0.07644500939742378
sim_compute_performance-ego_mean	0.06538850932830843
sim_compute_performance-ego_median	0.06416727602481842
sim_compute_performance-ego_min	0.05821320745680067
sim_compute_robot_state-ego_max	0.08027637523153554
sim_compute_robot_state-ego_mean	0.06985358154935675
sim_compute_robot_state-ego_median	0.06824753834651066
sim_compute_robot_state-ego_min	0.0637613832950592
sim_compute_robot_state-npc0_max	0.0705157466556715
sim_compute_robot_state-npc0_mean	0.06582412403846255
sim_compute_robot_state-npc0_median	0.06519661126313386
sim_compute_robot_state-npc0_min	0.060166545536207115
sim_compute_robot_state-npc1_max	0.07382007267164148
sim_compute_robot_state-npc1_mean	0.06589616319373609
sim_compute_robot_state-npc1_median	0.06619405746459961
sim_compute_robot_state-npc1_min	0.06007233262062073
sim_compute_robot_state-npc2_max	0.07391806270765222
sim_compute_robot_state-npc2_mean	0.06501380436341264
sim_compute_robot_state-npc2_median	0.06322754753960504
sim_compute_robot_state-npc2_min	0.056591184933980306
sim_compute_robot_state-npc3_max	0.07309508323669434
sim_compute_robot_state-npc3_mean	0.06531452407679465
sim_compute_robot_state-npc3_median	0.0652672251065572
sim_compute_robot_state-npc3_min	0.057327795028686526
sim_compute_sim_state_max	0.041854712270921274
sim_compute_sim_state_mean	0.03764423611271939
sim_compute_sim_state_median	0.03764940500259399
sim_compute_sim_state_min	0.03323671221733093
sim_physics_max	0.2465995450814565
sim_physics_mean	0.20761944450464723
sim_physics_median	0.20536517485594136
sim_physics_min	0.17793035507202148
sim_render-ego_max	0.08630955603814894
sim_render-ego_mean	0.06093903110292701
sim_render-ego_median	0.05994168519973755
sim_render-ego_min	0.052847614994755494
simulation-passed	1
survival_time_max	1.950000000000001
survival_time_mean	1.3466666666666671
survival_time_min	1.0000000000000002

No reset possible

22246

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

yes

2019-05-16 14:01:14+00:00

2019-05-16 14:02:57+00:00

0:01:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22242

2516

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

yes

2019-05-16 14:00:32+00:00

2019-05-16 14:01:05+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22227

2894

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

error

yes