Evaluator 1291

step1-simulation

success

yes

2019-08-13 23:16:12+00:00

2019-08-13 23:20:05+00:00

0:03:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2390767607415909
survival_time_median	1.7000000000000008
deviation-center-line_median	0.08731774378025493
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16627474088926572
agent_compute-ego_mean	0.1313293596330848
agent_compute-ego_median	0.12806763819285802
agent_compute-ego_min	0.09928670796481046
deviation-center-line_max	0.12054118396669132
deviation-center-line_mean	0.0943806886453727
deviation-center-line_min	0.07236157409992623
deviation-heading_max	0.8395823312464852
deviation-heading_mean	0.6952558053777387
deviation-heading_median	0.7189552202610832
deviation-heading_min	0.45739388058973846
driven_any_max	0.3749492126045942
driven_any_mean	0.2776285226328782
driven_any_median	0.3017614212335563
driven_any_min	0.17025356377144965
driven_lanedir_consec_max	0.3270190082975084
driven_lanedir_consec_mean	0.22965679021530988
driven_lanedir_consec_min	0.14686490694733578
driven_lanedir_max	0.3270190082975084
driven_lanedir_mean	0.22965679021530988
driven_lanedir_median	0.2390767607415909
driven_lanedir_min	0.14686490694733578
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3749492126045942, "sim_physics": 0.12693515339413206, "survival_time": 1.850000000000001, "driven_lanedir": 0.3270190082975084, "sim_render-ego": 0.06605729541263065, "in-drivable-lane": 0, "agent_compute-ego": 0.16627474088926572, "deviation-heading": 0.7189552202610832, "set_robot_commands": 0.09236621212314916, "deviation-center-line": 0.12054118396669132, "driven_lanedir_consec": 0.3270190082975084, "sim_compute_sim_state": 0.04001455049257021, "sim_compute_performance-ego": 0.07290745425868679, "sim_compute_robot_state-ego": 0.07285991874901024}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3017614212335563, "sim_physics": 0.08956792074091294, "survival_time": 1.7000000000000008, "driven_lanedir": 0.2564287352724717, "sim_render-ego": 0.052202484186957866, "in-drivable-lane": 0, "agent_compute-ego": 0.13587720955119414, "deviation-heading": 0.6733187045960338, "set_robot_commands": 0.07599426718319163, "deviation-center-line": 0.07236157409992623, "driven_lanedir_consec": 0.2564287352724717, "sim_compute_sim_state": 0.0335771686890546, "sim_compute_performance-ego": 0.061313993790570426, "sim_compute_robot_state-ego": 0.06306799019084257}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17025356377144965, "sim_physics": 0.07938455451618541, "survival_time": 1.1000000000000003, "driven_lanedir": 0.14686490694733578, "sim_render-ego": 0.042021328752691094, "in-drivable-lane": 0, "agent_compute-ego": 0.09928670796481046, "deviation-heading": 0.45739388058973846, "set_robot_commands": 0.056093421849337494, "deviation-center-line": 0.10546361989156476, "driven_lanedir_consec": 0.14686490694733578, "sim_compute_sim_state": 0.027623111551458187, "sim_compute_performance-ego": 0.04570894891565496, "sim_compute_robot_state-ego": 0.04802670262076638}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23782365344564824, "sim_physics": 0.08705323083060128, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1788945398176427, "sim_render-ego": 0.047928035259246826, "in-drivable-lane": 0, "agent_compute-ego": 0.12806763819285802, "deviation-heading": 0.8395823312464852, "set_robot_commands": 0.07527873345783778, "deviation-center-line": 0.08621932148842626, "driven_lanedir_consec": 0.1788945398176427, "sim_compute_sim_state": 0.03158831596374512, "sim_compute_performance-ego": 0.05270154135567801, "sim_compute_robot_state-ego": 0.05596248592649187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3033547621091426, "sim_physics": 0.07809444155011858, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2390767607415909, "sim_render-ego": 0.0470867361341204, "in-drivable-lane": 0, "agent_compute-ego": 0.12714050156729562, "deviation-heading": 0.7870288901953529, "set_robot_commands": 0.07119325229099818, "deviation-center-line": 0.08731774378025493, "driven_lanedir_consec": 0.2390767607415909, "sim_compute_sim_state": 0.02933272634233747, "sim_compute_performance-ego": 0.05213925497872489, "sim_compute_robot_state-ego": 0.06471589633396693}}
set_robot_commands_max	0.09236621212314916
set_robot_commands_mean	0.07418517738090284
set_robot_commands_median	0.07527873345783778
set_robot_commands_min	0.056093421849337494
sim_compute_performance-ego_max	0.07290745425868679
sim_compute_performance-ego_mean	0.05695423865986302
sim_compute_performance-ego_median	0.05270154135567801
sim_compute_performance-ego_min	0.04570894891565496
sim_compute_robot_state-ego_max	0.07285991874901024
sim_compute_robot_state-ego_mean	0.0609265987642156
sim_compute_robot_state-ego_median	0.06306799019084257
sim_compute_robot_state-ego_min	0.04802670262076638
sim_compute_sim_state_max	0.04001455049257021
sim_compute_sim_state_mean	0.03242717460783312
sim_compute_sim_state_median	0.03158831596374512
sim_compute_sim_state_min	0.027623111551458187
sim_physics_max	0.12693515339413206
sim_physics_mean	0.09220706020639004
sim_physics_median	0.08705323083060128
sim_physics_min	0.07809444155011858
sim_render-ego_max	0.06605729541263065
sim_render-ego_mean	0.05105917594912936
sim_render-ego_median	0.047928035259246826
sim_render-ego_min	0.042021328752691094
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.5600000000000007
survival_time_min	1.1000000000000003

No reset possible

24242

4033

Frank (Chude) Qian 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

yes

2019-08-13 23:01:24+00:00

2019-08-13 23:15:46+00:00

0:14:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4126113388371666
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11871775985231396
in-drivable-lane_median	0.9499999999999976

other stats

agent_compute-ego_max	0.08625599054189828
agent_compute-ego_mean	0.06545590483320625
agent_compute-ego_median	0.06711106300354004
agent_compute-ego_min	0.05170397247586932
deviation-center-line_max	0.2616199012603187
deviation-center-line_mean	0.12663752615997417
deviation-center-line_min	0.07143676193760398
deviation-heading_max	1.4563581054905994
deviation-heading_mean	0.5551840294909584
deviation-heading_median	0.55940705176748
deviation-heading_min	0.2596285487829774
driven_any_max	1.6839250134630197
driven_any_mean	0.7327294413370017
driven_any_median	0.7309130538792373
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.9416535020294268
driven_lanedir_consec_mean	0.4469104002974222
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.9416535020294268
driven_lanedir_mean	0.4469104002974222
driven_lanedir_median	0.4126113388371666
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.8233333333333307
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1152582974501059, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06141374144755619, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07228640435447156, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.08963692020362532, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03723813446474747, "sim_compute_performance-ego": 0.06911584692941584, "sim_compute_robot_state-ego": 0.0728284305250141}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.10965328613917032, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05989002386728923, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06711106300354004, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09171077410380044, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.03891295989354451, "sim_compute_performance-ego": 0.06470248699188233, "sim_compute_robot_state-ego": 0.07342348098754883}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11428345333446156, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06141300634904341, "in-drivable-lane": 0, "agent_compute-ego": 0.0644609819759022, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09197779135270552, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.039153792641379616, "sim_compute_performance-ego": 0.06963430751453746, "sim_compute_robot_state-ego": 0.07346431775526567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.12053691347440083, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06152849396069845, "in-drivable-lane": 0, "agent_compute-ego": 0.06888946890830994, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0911272217830022, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03807920217514038, "sim_compute_performance-ego": 0.06891987224419911, "sim_compute_robot_state-ego": 0.06644616027673085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12105796129807182, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06257574454597804, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07804710968681004, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09984223220659338, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.0419939082601796, "sim_compute_performance-ego": 0.06749126703842827, "sim_compute_robot_state-ego": 0.07498586177825928}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.10813112060228984, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.0538142720858256, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06173714995384216, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.08492747942606609, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.035684674978256226, "sim_compute_performance-ego": 0.057745675245920815, "sim_compute_robot_state-ego": 0.06469250718752544}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.11351568882281964, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.06516244472601475, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.06772094812148656, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.088167178325164, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.038558366971138194, "sim_compute_performance-ego": 0.075775574415158, "sim_compute_robot_state-ego": 0.06782164023472713}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.0795491806098393, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.04486587217875889, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.05170397247586932, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.07026986139161247, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.02878409624099731, "sim_compute_performance-ego": 0.04810681939125061, "sim_compute_robot_state-ego": 0.05069054450307574}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.08206461489885702, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.045274304247450554, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.05246536485080061, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.07070483284435053, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.029729881505856568, "sim_compute_performance-ego": 0.0508778067840927, "sim_compute_robot_state-ego": 0.05319372264818213}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.08666576688939875, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.04753606536171653, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.05828435204245828, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.07354183413765647, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.03192270018837669, "sim_compute_performance-ego": 0.0510006080974232, "sim_compute_robot_state-ego": 0.05258553678339178}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.08706937233606975, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.04745560884475708, "in-drivable-lane": 0, "agent_compute-ego": 0.05345945556958517, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.07471247514088948, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.03272449970245361, "sim_compute_performance-ego": 0.05435901880264282, "sim_compute_robot_state-ego": 0.0534152090549469}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.09923049072166544, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.05137330525881284, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.062483385011747286, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.07960305585489645, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.03313115045621798, "sim_compute_performance-ego": 0.056381002649084314, "sim_compute_robot_state-ego": 0.059746373783458366}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.10831332206726074, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.05624489784240723, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06821502685546875, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.08412778854370118, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.03808627605438233, "sim_compute_performance-ego": 0.06167109966278076, "sim_compute_robot_state-ego": 0.06277284145355225}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.12679200906019944, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06066429615020752, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08625599054189828, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.09967133632073036, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.049069918118990384, "sim_compute_performance-ego": 0.06791069874396691, "sim_compute_robot_state-ego": 0.07237301422999455}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.1129042042626275, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.058872624679848, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.06871789914590341, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.0855096490294845, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.03541923893822564, "sim_compute_performance-ego": 0.06428851463176587, "sim_compute_robot_state-ego": 0.07162940943682636}}
set_robot_commands_max	0.09984223220659338
set_robot_commands_mean	0.08503536204428523
set_robot_commands_median	0.0855096490294845
set_robot_commands_min	0.07026986139161247
sim_compute_performance-ego_max	0.075775574415158
sim_compute_performance-ego_mean	0.061865373276169935
sim_compute_performance-ego_median	0.06428851463176587
sim_compute_performance-ego_min	0.04810681939125061
sim_compute_robot_state-ego_max	0.07498586177825928
sim_compute_robot_state-ego_mean	0.06467127004256662
sim_compute_robot_state-ego_median	0.06644616027673085
sim_compute_robot_state-ego_min	0.05069054450307574
sim_compute_sim_state_max	0.049069918118990384
sim_compute_sim_state_mean	0.03656592003932577
sim_compute_sim_state_median	0.03723813446474747
sim_compute_sim_state_min	0.02878409624099731
sim_physics_max	0.12679200906019944
sim_physics_mean	0.10566837879781588
sim_physics_median	0.10965328613917032
sim_physics_min	0.0795491806098393
sim_render-ego_max	0.06516244472601475
sim_render-ego_mean	0.055872313436424285
sim_render-ego_median	0.058872624679848
sim_render-ego_min	0.04486587217875889
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	2.7766666666666637
survival_time_min	1.1000000000000003

No reset possible

24239

4040

Frank (Chude) Qian 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

yes

2019-08-13 22:53:25+00:00

2019-08-13 23:00:55+00:00

0:07:30

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24238

4043

Riza Velioglu 🇩🇪

PredictorLast

step1-simulation

success

2019-08-13 22:51:07+00:00

2019-08-13 22:52:44+00:00

0:01:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11146035845548724
error_L2	0.019208026578897232

No reset possible

24230

4024

Scott Hixson

PredictorLast

step1-simulation

success

2019-07-29 00:29:53+00:00

2019-07-29 00:30:20+00:00

0:00:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11549356909288
error_L2	0.021365875461778584

No reset possible

24224

4014

Andrew Vennekotter 🇺🇸

challenge-aido_LF-template-pytorch

step1-simulation

error

yes

aido2-LFVI-sim-testing-offseason

2019-07-26 23:04:12+00:00

2019-07-26 23:04:55+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24222

4019

Andrew Vennekotter 🇺🇸

challenge-aido_LF-template-pytorch

step1-simulation

error

yes

2019-07-26 23:02:40+00:00

2019-07-26 23:04:04+00:00

0:01:24

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24216

4010

Kenechukwu Nnodu 🇨🇦

CNN-48by96-less-one-50-aug

step1-simulation

failed

yes

2019-07-19 04:43:19+00:00

2019-07-19 04:46:15+00:00

0:02:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 52, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 15, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.NotFoundError: Op type not registered 'ImageProjectiveTransformV2' in binary running on ef0495743c75. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) `tf.contrib.resampler` should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24215

4009

Kenechukwu Nnodu 🇨🇦

CNN-8logs-60by80-latest

step1-simulation

success

yes

2019-07-19 00:07:39+00:00

2019-07-19 00:24:16+00:00

0:16:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1952234028445328
survival_time_median	13.00000000000005
deviation-center-line_median	0.3256618704452082
in-drivable-lane_median	2.3999999999999915

other stats

agent_compute-ego_max	0.11907339737965512
agent_compute-ego_mean	0.11830892618638418
agent_compute-ego_median	0.11829149421257308
agent_compute-ego_min	0.11766454068625844
deviation-center-line_max	0.5344984645986883
deviation-center-line_mean	0.33373860704654085
deviation-center-line_min	0.14378333683408742
deviation-heading_max	1.562809565076711
deviation-heading_mean	1.229904356455272
deviation-heading_median	1.1186705479884342
deviation-heading_min	0.9454037442742542
driven_any_max	1.7446467209804262
driven_any_mean	1.255517800327618
driven_any_median	1.611251704928607
driven_any_min	0.22880056343648816
driven_lanedir_consec_max	1.7367392886938515
driven_lanedir_consec_mean	0.9961459420709204
driven_lanedir_consec_min	0.1995007661685579
driven_lanedir_max	1.7367392886938515
driven_lanedir_mean	0.9961885494729422
driven_lanedir_median	1.195436439854642
driven_lanedir_min	0.1995007661685579
in-drivable-lane_max	3.100000000000044
in-drivable-lane_mean	1.6900000000000155
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9923053585059056, "sim_physics": 0.09173779698866832, "survival_time": 7.89999999999998, "driven_lanedir": 0.647504007011475, "sim_render-ego": 0.0354262273522872, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.11829149421257308, "deviation-heading": 0.999382388975032, "set_robot_commands": 0.054936648924139485, "deviation-center-line": 0.34252413548837746, "driven_lanedir_consec": 0.647504007011475, "sim_compute_sim_state": 0.02239957489544832, "sim_compute_performance-ego": 0.03832693190514287, "sim_compute_robot_state-ego": 0.04036252558985843, "sim_compute_robot_state-npc0": 0.03986259502700613, "sim_compute_robot_state-npc1": 0.03904065452044523, "sim_compute_robot_state-npc2": 0.038914840432662, "sim_compute_robot_state-npc3": 0.03902263279202618}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7446467209804262, "sim_physics": 0.09826469580332438, "survival_time": 14.950000000000076, "driven_lanedir": 1.7367392886938515, "sim_render-ego": 0.035647926330566404, "in-drivable-lane": 0, "agent_compute-ego": 0.11859069267908733, "deviation-heading": 1.1186705479884342, "set_robot_commands": 0.054910106658935545, "deviation-center-line": 0.5344984645986883, "driven_lanedir_consec": 1.7367392886938515, "sim_compute_sim_state": 0.022767698764801024, "sim_compute_performance-ego": 0.03853987455368042, "sim_compute_robot_state-ego": 0.04069352626800537, "sim_compute_robot_state-npc0": 0.041070401668548584, "sim_compute_robot_state-npc1": 0.03950678110122681, "sim_compute_robot_state-npc2": 0.039288843472798665, "sim_compute_robot_state-npc3": 0.039430228074391685}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.611251704928607, "sim_physics": 0.0900276746505346, "survival_time": 13.65000000000006, "driven_lanedir": 1.2017622456361838, "sim_render-ego": 0.03520317916031722, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.11792450597434692, "deviation-heading": 1.562809565076711, "set_robot_commands": 0.05486709032303248, "deviation-center-line": 0.32222522786634267, "driven_lanedir_consec": 1.2017622456361838, "sim_compute_sim_state": 0.022816099090017243, "sim_compute_performance-ego": 0.03990311413020878, "sim_compute_robot_state-ego": 0.04070883530836839, "sim_compute_robot_state-npc0": 0.042579586252624736, "sim_compute_robot_state-npc1": 0.039325075708466134, "sim_compute_robot_state-npc2": 0.0391649964091542, "sim_compute_robot_state-npc3": 0.03942370589399512}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.700584653786663, "sim_physics": 0.08992650967377883, "survival_time": 13.00000000000005, "driven_lanedir": 1.195436439854642, "sim_render-ego": 0.035550045967102054, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.11907339737965512, "deviation-heading": 1.5232555359619275, "set_robot_commands": 0.054250281590681806, "deviation-center-line": 0.3256618704452082, "driven_lanedir_consec": 1.1952234028445328, "sim_compute_sim_state": 0.02248762112397414, "sim_compute_performance-ego": 0.038557898998260495, "sim_compute_robot_state-ego": 0.040445626699007475, "sim_compute_robot_state-npc0": 0.04002711314421434, "sim_compute_robot_state-npc1": 0.039264647777263934, "sim_compute_robot_state-npc2": 0.03924060051257794, "sim_compute_robot_state-npc3": 0.04049841073843149}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22880056343648816, "sim_physics": 0.09023163958293635, "survival_time": 2.0500000000000007, "driven_lanedir": 0.1995007661685579, "sim_render-ego": 0.03497586017701684, "in-drivable-lane": 0, "agent_compute-ego": 0.11766454068625844, "deviation-heading": 0.9454037442742542, "set_robot_commands": 0.053757958295868664, "deviation-center-line": 0.14378333683408742, "driven_lanedir_consec": 0.1995007661685579, "sim_compute_sim_state": 0.022427209993688073, "sim_compute_performance-ego": 0.037980957729060474, "sim_compute_robot_state-ego": 0.040193778712575026, "sim_compute_robot_state-npc0": 0.03968077171139601, "sim_compute_robot_state-npc1": 0.03895214127331245, "sim_compute_robot_state-npc2": 0.03878805695510492, "sim_compute_robot_state-npc3": 0.03891725074954149}}
set_robot_commands_max	0.054936648924139485
set_robot_commands_mean	0.05454441715853159
set_robot_commands_median	0.05486709032303248
set_robot_commands_min	0.053757958295868664
sim_compute_performance-ego_max	0.03990311413020878
sim_compute_performance-ego_mean	0.03866175546327061
sim_compute_performance-ego_median	0.03853987455368042
sim_compute_performance-ego_min	0.037980957729060474
sim_compute_robot_state-ego_max	0.04070883530836839
sim_compute_robot_state-ego_mean	0.040480858515562934
sim_compute_robot_state-ego_median	0.040445626699007475
sim_compute_robot_state-ego_min	0.040193778712575026
sim_compute_robot_state-npc0_max	0.042579586252624736
sim_compute_robot_state-npc0_mean	0.04064409356075795
sim_compute_robot_state-npc0_median	0.04002711314421434
sim_compute_robot_state-npc0_min	0.03968077171139601
sim_compute_robot_state-npc1_max	0.03950678110122681
sim_compute_robot_state-npc1_mean	0.03921786007614291
sim_compute_robot_state-npc1_median	0.039264647777263934
sim_compute_robot_state-npc1_min	0.03895214127331245
sim_compute_robot_state-npc2_max	0.039288843472798665
sim_compute_robot_state-npc2_mean	0.039079467556459545
sim_compute_robot_state-npc2_median	0.0391649964091542
sim_compute_robot_state-npc2_min	0.03878805695510492
sim_compute_robot_state-npc3_max	0.04049841073843149
sim_compute_robot_state-npc3_mean	0.0394584456496772
sim_compute_robot_state-npc3_median	0.03942370589399512
sim_compute_robot_state-npc3_min	0.03891725074954149
sim_compute_sim_state_max	0.022816099090017243
sim_compute_sim_state_mean	0.022579640773585756
sim_compute_sim_state_median	0.02248762112397414
sim_compute_sim_state_min	0.02239957489544832
sim_physics_max	0.09826469580332438
sim_physics_mean	0.09203766333984847
sim_physics_median	0.09023163958293635
sim_physics_min	0.08992650967377883
sim_render-ego_max	0.035647926330566404
sim_render-ego_mean	0.03536064779745794
sim_render-ego_median	0.0354262273522872
sim_render-ego_min	0.03497586017701684
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.310000000000034
survival_time_min	2.0500000000000007

No reset possible

24214

4008

Junghyun Seo 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-18 22:34:49+00:00

2019-07-18 22:43:25+00:00

0:08:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.15983003669304985
survival_time_median	4.149999999999993
deviation-center-line_median	0.0703502703414475
in-drivable-lane_median	1.7999999999999974

other stats

agent_compute-ego_max	0.09613393624623616
agent_compute-ego_mean	0.0952625260891794
agent_compute-ego_median	0.0955228460840432
agent_compute-ego_min	0.09408488980046024
deviation-center-line_max	0.6960955385806167
deviation-center-line_mean	0.28487389184774126
deviation-center-line_min	0.021871844335814388
deviation-heading_max	5.983722633208984
deviation-heading_mean	2.918648007643378
deviation-heading_median	1.5654975982633557
deviation-heading_min	0.5967098075182897
driven_any_max	1.889158590404872
driven_any_mean	0.869731362762467
driven_any_median	0.4651432691953716
driven_any_min	0.0980990159131188
driven_lanedir_consec_max	0.6425970163950665
driven_lanedir_consec_mean	0.2774269639310317
driven_lanedir_consec_min	0.034697835002273525
driven_lanedir_max	0.6425970163950665
driven_lanedir_mean	0.2774269639310317
driven_lanedir_median	0.15983003669304985
driven_lanedir_min	0.034697835002273525
in-drivable-lane_max	7.600000000000042
in-drivable-lane_mean	3.510000000000015
in-drivable-lane_min	0.4500000000000003
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.889158590404872, "sim_physics": 0.055369951725006104, "survival_time": 14.950000000000076, "driven_lanedir": 0.6425970163950665, "sim_render-ego": 0.035343929926554364, "in-drivable-lane": 7.100000000000034, "agent_compute-ego": 0.0960918672879537, "deviation-heading": 5.983722633208984, "set_robot_commands": 0.05422401905059814, "deviation-center-line": 0.6960955385806167, "driven_lanedir_consec": 0.6425970163950665, "sim_compute_sim_state": 0.02259062925974528, "sim_compute_performance-ego": 0.038076802889506024, "sim_compute_robot_state-ego": 0.04011547088623047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1541454437653466, "sim_physics": 0.0586084057303036, "survival_time": 1.7000000000000008, "driven_lanedir": 0.04181350773923831, "sim_render-ego": 0.034477198825163, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09447909102720373, "deviation-heading": 0.6183887112259263, "set_robot_commands": 0.053534255308263445, "deviation-center-line": 0.021871844335814388, "driven_lanedir_consec": 0.04181350773923831, "sim_compute_sim_state": 0.022742636063519645, "sim_compute_performance-ego": 0.038333920871510226, "sim_compute_robot_state-ego": 0.040275952395270855}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.0980990159131188, "sim_physics": 0.05540929900275336, "survival_time": 1.3500000000000003, "driven_lanedir": 0.034697835002273525, "sim_render-ego": 0.03404392136467828, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.09408488980046024, "deviation-heading": 0.5967098075182897, "set_robot_commands": 0.0537840172096535, "deviation-center-line": 0.07026661260266032, "driven_lanedir_consec": 0.034697835002273525, "sim_compute_sim_state": 0.022600747920848704, "sim_compute_performance-ego": 0.0380075595996998, "sim_compute_robot_state-ego": 0.040156134852656615}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7421104945336263, "sim_physics": 0.05637174208958944, "survival_time": 14.950000000000076, "driven_lanedir": 0.5081964238255305, "sim_render-ego": 0.03531768639882406, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.09613393624623616, "deviation-heading": 5.828921288000335, "set_robot_commands": 0.05439356486002604, "deviation-center-line": 0.5657851933781672, "driven_lanedir_consec": 0.5081964238255305, "sim_compute_sim_state": 0.022633309364318847, "sim_compute_performance-ego": 0.03806220849355062, "sim_compute_robot_state-ego": 0.04006751139958699}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4651432691953716, "sim_physics": 0.05886568218828684, "survival_time": 4.149999999999993, "driven_lanedir": 0.15983003669304985, "sim_render-ego": 0.03531084290469985, "in-drivable-lane": 1.7999999999999974, "agent_compute-ego": 0.0955228460840432, "deviation-heading": 1.5654975982633557, "set_robot_commands": 0.054625232535672474, "deviation-center-line": 0.0703502703414475, "driven_lanedir_consec": 0.15983003669304985, "sim_compute_sim_state": 0.02272988514727857, "sim_compute_performance-ego": 0.038458209439932584, "sim_compute_robot_state-ego": 0.039753181388579216}}
set_robot_commands_max	0.054625232535672474
set_robot_commands_mean	0.05411221779284272
set_robot_commands_median	0.05422401905059814
set_robot_commands_min	0.053534255308263445
sim_compute_performance-ego_max	0.038458209439932584
sim_compute_performance-ego_mean	0.03818774025883985
sim_compute_performance-ego_median	0.038076802889506024
sim_compute_performance-ego_min	0.0380075595996998
sim_compute_robot_state-ego_max	0.040275952395270855
sim_compute_robot_state-ego_mean	0.040073650184464835
sim_compute_robot_state-ego_median	0.04011547088623047
sim_compute_robot_state-ego_min	0.039753181388579216
sim_compute_sim_state_max	0.022742636063519645
sim_compute_sim_state_mean	0.02265944155114221
sim_compute_sim_state_median	0.022633309364318847
sim_compute_sim_state_min	0.02259062925974528
sim_physics_max	0.05886568218828684
sim_physics_mean	0.05692501614718788
sim_physics_median	0.05637174208958944
sim_physics_min	0.055369951725006104
sim_render-ego_max	0.035343929926554364
sim_render-ego_mean	0.03489871588398391
sim_render-ego_median	0.03531084290469985
sim_render-ego_min	0.03404392136467828
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.42000000000003
survival_time_min	1.3500000000000003

No reset possible

24213

4007

Inderpal Singh 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-18 21:54:13+00:00

2019-07-18 21:54:38+00:00

0:00:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24212

4006

Junghyun Seo 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-18 21:45:12+00:00

2019-07-18 21:49:50+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07579582448250355
survival_time_median	1.6000000000000008
deviation-center-line_median	0.08009172848177352
in-drivable-lane_median	0.5500000000000005

other stats

agent_compute-ego_max	0.09601959871209186
agent_compute-ego_mean	0.0949256401643521
agent_compute-ego_median	0.09500908106565475
agent_compute-ego_min	0.093785938463713
deviation-center-line_max	0.2405417869685169
deviation-center-line_mean	0.09169309380908088
deviation-center-line_min	0.024549257963551625
deviation-heading_max	4.617564995557
deviation-heading_mean	1.5644167646288392
deviation-heading_median	0.5550325578631559
deviation-heading_min	0.5438538878239981
driven_any_max	1.4816910427797223
driven_any_mean	0.495176833085527
driven_any_median	0.18694509205844767
driven_any_min	0.09880002889701386
driven_lanedir_consec_max	0.49519261333171904
driven_lanedir_consec_mean	0.17250946715992693
driven_lanedir_consec_min	0.06472982378274272
driven_lanedir_max	0.49519261333171904
driven_lanedir_mean	0.17250946715992693
driven_lanedir_median	0.07579582448250355
driven_lanedir_min	0.06472982378274272
in-drivable-lane_max	5.400000000000016
in-drivable-lane_mean	1.660000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4816910427797223, "sim_physics": 0.056865911898405654, "survival_time": 11.500000000000028, "driven_lanedir": 0.49519261333171904, "sim_render-ego": 0.035276695956354555, "in-drivable-lane": 5.400000000000016, "agent_compute-ego": 0.09601959871209186, "deviation-heading": 4.617564995557, "set_robot_commands": 0.054113337268000064, "deviation-center-line": 0.2405417869685169, "driven_lanedir_consec": 0.49519261333171904, "sim_compute_sim_state": 0.02241007970727008, "sim_compute_performance-ego": 0.037818044164906375, "sim_compute_robot_state-ego": 0.03979926212974216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18694509205844767, "sim_physics": 0.05601000785827637, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07579582448250355, "sim_render-ego": 0.034890249371528625, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09500908106565475, "deviation-heading": 0.5513759756100111, "set_robot_commands": 0.054661400616168976, "deviation-center-line": 0.024549257963551625, "driven_lanedir_consec": 0.07579582448250355, "sim_compute_sim_state": 0.02267883718013763, "sim_compute_performance-ego": 0.0376165583729744, "sim_compute_robot_state-ego": 0.04014083743095398}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09880002889701386, "sim_physics": 0.05664123986896716, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06756661795490837, "sim_render-ego": 0.0344741846385755, "in-drivable-lane": 0, "agent_compute-ego": 0.093785938463713, "deviation-heading": 0.5550325578631559, "set_robot_commands": 0.05422968613473993, "deviation-center-line": 0.08312789178633377, "driven_lanedir_consec": 0.06756661795490837, "sim_compute_sim_state": 0.022804473575792815, "sim_compute_performance-ego": 0.03830104125173468, "sim_compute_robot_state-ego": 0.03982152436908923}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5263936149096982, "sim_physics": 0.05797784841513332, "survival_time": 3.949999999999994, "driven_lanedir": 0.15926245624776092, "sim_render-ego": 0.03561568561988541, "in-drivable-lane": 1.8499999999999983, "agent_compute-ego": 0.09532391874096062, "deviation-heading": 1.554256406290032, "set_robot_commands": 0.05461578127704089, "deviation-center-line": 0.08009172848177352, "driven_lanedir_consec": 0.15926245624776092, "sim_compute_sim_state": 0.02261855028852632, "sim_compute_performance-ego": 0.03783848617650286, "sim_compute_robot_state-ego": 0.04013185259662097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1820543867827529, "sim_physics": 0.05938730388879776, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06472982378274272, "sim_render-ego": 0.03480908274650574, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.0944896638393402, "deviation-heading": 0.5438538878239981, "set_robot_commands": 0.054827980697155, "deviation-center-line": 0.0301548038452286, "driven_lanedir_consec": 0.06472982378274272, "sim_compute_sim_state": 0.023577839136123657, "sim_compute_performance-ego": 0.037807755172252655, "sim_compute_robot_state-ego": 0.043960362672805786}}
set_robot_commands_max	0.054827980697155
set_robot_commands_mean	0.05448963719862097
set_robot_commands_median	0.05461578127704089
set_robot_commands_min	0.054113337268000064
sim_compute_performance-ego_max	0.03830104125173468
sim_compute_performance-ego_mean	0.03787637702767419
sim_compute_performance-ego_median	0.037818044164906375
sim_compute_performance-ego_min	0.0376165583729744
sim_compute_robot_state-ego_max	0.043960362672805786
sim_compute_robot_state-ego_mean	0.040770767839842424
sim_compute_robot_state-ego_median	0.04013185259662097
sim_compute_robot_state-ego_min	0.03979926212974216
sim_compute_sim_state_max	0.023577839136123657
sim_compute_sim_state_mean	0.022817955977570106
sim_compute_sim_state_median	0.02267883718013763
sim_compute_sim_state_min	0.02241007970727008
sim_physics_max	0.05938730388879776
sim_physics_mean	0.05737646238591605
sim_physics_median	0.056865911898405654
sim_physics_min	0.05601000785827637
sim_render-ego_max	0.03561568561988541
sim_render-ego_mean	0.035013179666569964
sim_render-ego_median	0.034890249371528625
sim_render-ego_min	0.0344741846385755
simulation-passed	1
survival_time_max	11.500000000000028
survival_time_mean	3.9200000000000057
survival_time_min	0.9500000000000004

No reset possible

24211

4005

Junghyun Seo 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-18 21:38:10+00:00

2019-07-18 21:41:03+00:00

0:02:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0772679506413414
survival_time_median	1.6000000000000008
deviation-center-line_median	0.0613513324699074
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.09663986414670944
agent_compute-ego_mean	0.0958702497830367
agent_compute-ego_median	0.09591157812821238
agent_compute-ego_min	0.09439153671264648
deviation-center-line_max	0.08345382407618472
deviation-center-line_mean	0.058419638662448946
deviation-center-line_min	0.026443558539094345
deviation-heading_max	0.9218048369594884
deviation-heading_mean	0.719622609823016
deviation-heading_median	0.6997052138594824
deviation-heading_min	0.6227713704254445
driven_any_max	0.20250596105814983
driven_any_mean	0.17867700914822263
driven_any_median	0.19996483831105633
driven_any_min	0.09531884518035684
driven_lanedir_consec_max	0.11241693563678412
driven_lanedir_consec_mean	0.08370788016267627
driven_lanedir_consec_min	0.05478240813622692
driven_lanedir_max	0.11241693563678412
driven_lanedir_mean	0.08370788016267627
driven_lanedir_median	0.0772679506413414
driven_lanedir_min	0.05478240813622692
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.3200000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20250596105814983, "sim_physics": 0.05838939121791294, "survival_time": 1.7500000000000009, "driven_lanedir": 0.06884443029429255, "sim_render-ego": 0.035469654628208704, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.0966219765799386, "deviation-heading": 0.6997052138594824, "set_robot_commands": 0.053894846779959545, "deviation-center-line": 0.0613513324699074, "driven_lanedir_consec": 0.06884443029429255, "sim_compute_sim_state": 0.022397940499441965, "sim_compute_performance-ego": 0.03811454772949219, "sim_compute_robot_state-ego": 0.040408781596592495}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19996483831105633, "sim_physics": 0.05308730942862375, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0772679506413414, "sim_render-ego": 0.03483869688851493, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09439153671264648, "deviation-heading": 0.6227713704254445, "set_robot_commands": 0.05404246875217983, "deviation-center-line": 0.026443558539094345, "driven_lanedir_consec": 0.0772679506413414, "sim_compute_sim_state": 0.022618559428623744, "sim_compute_performance-ego": 0.03792435782296317, "sim_compute_robot_state-ego": 0.04007571084158761}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09531884518035684, "sim_physics": 0.057345264836361536, "survival_time": 0.9500000000000004, "driven_lanedir": 0.05478240813622692, "sim_render-ego": 0.0344429518047132, "in-drivable-lane": 0, "agent_compute-ego": 0.09591157812821238, "deviation-heading": 0.6228573861704099, "set_robot_commands": 0.05313186896474738, "deviation-center-line": 0.08345382407618472, "driven_lanedir_consec": 0.05478240813622692, "sim_compute_sim_state": 0.02287936210632324, "sim_compute_performance-ego": 0.03819581081992701, "sim_compute_robot_state-ego": 0.04053026751468056}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20016427696693792, "sim_physics": 0.061871004104614255, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11241693563678412, "sim_render-ego": 0.03550979296366374, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.0957862933476766, "deviation-heading": 0.9218048369594884, "set_robot_commands": 0.05368614196777344, "deviation-center-line": 0.06879476900788264, "driven_lanedir_consec": 0.11241693563678412, "sim_compute_sim_state": 0.02270797888437907, "sim_compute_performance-ego": 0.03782270749409993, "sim_compute_robot_state-ego": 0.04026153087615967}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19543112422461217, "sim_physics": 0.06400367617607117, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10522767610473638, "sim_render-ego": 0.036433689296245575, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09663986414670944, "deviation-heading": 0.7309742417002549, "set_robot_commands": 0.05451656132936478, "deviation-center-line": 0.052054709219175606, "driven_lanedir_consec": 0.10522767610473638, "sim_compute_sim_state": 0.023417800664901733, "sim_compute_performance-ego": 0.0393063947558403, "sim_compute_robot_state-ego": 0.04083704948425293}}
set_robot_commands_max	0.05451656132936478
set_robot_commands_mean	0.05385437755880499
set_robot_commands_median	0.053894846779959545
set_robot_commands_min	0.05313186896474738
sim_compute_performance-ego_max	0.0393063947558403
sim_compute_performance-ego_mean	0.03827276372446452
sim_compute_performance-ego_median	0.03811454772949219
sim_compute_performance-ego_min	0.03782270749409993
sim_compute_robot_state-ego_max	0.04083704948425293
sim_compute_robot_state-ego_mean	0.040422668062654654
sim_compute_robot_state-ego_median	0.040408781596592495
sim_compute_robot_state-ego_min	0.04007571084158761
sim_compute_sim_state_max	0.023417800664901733
sim_compute_sim_state_mean	0.02280432831673395
sim_compute_sim_state_median	0.02270797888437907
sim_compute_sim_state_min	0.022397940499441965
sim_physics_max	0.06400367617607117
sim_physics_mean	0.058939329152716734
sim_physics_median	0.05838939121791294
sim_physics_min	0.05308730942862375
sim_render-ego_max	0.036433689296245575
sim_render-ego_mean	0.03533895711626923
sim_render-ego_median	0.035469654628208704
sim_render-ego_min	0.0344429518047132
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.510000000000001
survival_time_min	0.9500000000000004

No reset possible

24206

4000

Inderpal Singh 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-18 20:40:59+00:00

2019-07-18 20:41:27+00:00

0:00:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24205

3999

Inderpal Singh 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-18 20:37:22+00:00

2019-07-18 20:37:50+00:00

0:00:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24203

3998

Inderpal Singh 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

host-error

yes

aido2-LFVI-sim-testing-offseason

2019-07-18 19:59:17+00:00

2019-07-18 20:00:52+00:00

0:01:35

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 759, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1100, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 286, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1344, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation-offseason/submission3998/step1-simulation-ip-172-31-42-167-7227-job24203': '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation-offseason/submission3998/step1-simulation-ip-172-31-42-167-7227-job24203'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24193

3989

Junghyun Seo 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-18 04:48:00+00:00

2019-07-18 05:00:27+00:00

0:12:27

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24190

3984

Junghyun Seo 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-18 04:42:57+00:00

2019-07-18 04:47:45+00:00

0:04:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.11925280990562026
survival_time_median	1.4500000000000006
deviation-center-line_median	0.07598570357684653
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18854566278128787
agent_compute-ego_mean	0.16184220244334488
agent_compute-ego_median	0.15700873874482654
agent_compute-ego_min	0.14333097751323992
deviation-center-line_max	0.10027282357584272
deviation-center-line_mean	0.07734860649591588
deviation-center-line_min	0.06045013765355835
deviation-heading_max	0.9068035029186574
deviation-heading_mean	0.7515052271859106
deviation-heading_median	0.7204652740850678
deviation-heading_min	0.5367230331073389
driven_any_max	0.21468146773583277
driven_any_mean	0.1922058536396188
driven_any_median	0.2072449185087261
driven_any_min	0.13932120481015925
driven_lanedir_consec_max	0.1559987034744572
driven_lanedir_consec_mean	0.1287179576015225
driven_lanedir_consec_min	0.10830944814629584
driven_lanedir_max	0.1559987034744572
driven_lanedir_mean	0.1287179576015225
driven_lanedir_median	0.11925280990562026
driven_lanedir_min	0.10830944814629584
in-drivable-lane_max	0.15000000000000013
in-drivable-lane_mean	0.030000000000000027
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20878554467107727, "sim_physics": 0.10555112746454054, "survival_time": 1.5500000000000007, "driven_lanedir": 0.11018191257811603, "sim_render-ego": 0.05691415263760474, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15350837092245778, "deviation-heading": 0.8784138376717667, "set_robot_commands": 0.08129599017481651, "deviation-center-line": 0.08186327107034987, "driven_lanedir_consec": 0.11018191257811603, "sim_compute_sim_state": 0.03465456347311697, "sim_compute_performance-ego": 0.06270694732666016, "sim_compute_robot_state-ego": 0.06790360327689879}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2072449185087261, "sim_physics": 0.11194923828388084, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1498469139031231, "sim_render-ego": 0.05767253349567282, "in-drivable-lane": 0, "agent_compute-ego": 0.16681726225491228, "deviation-heading": 0.7204652740850678, "set_robot_commands": 0.08830396060285897, "deviation-center-line": 0.06045013765355835, "driven_lanedir_consec": 0.1498469139031231, "sim_compute_sim_state": 0.03733583976482523, "sim_compute_performance-ego": 0.06955302994826744, "sim_compute_robot_state-ego": 0.07014833647629311}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13932120481015925, "sim_physics": 0.10933848789760044, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10830944814629584, "sim_render-ego": 0.06103466805957612, "in-drivable-lane": 0, "agent_compute-ego": 0.15700873874482654, "deviation-heading": 0.5367230331073389, "set_robot_commands": 0.08222117878141857, "deviation-center-line": 0.10027282357584272, "driven_lanedir_consec": 0.10830944814629584, "sim_compute_sim_state": 0.03948378562927246, "sim_compute_performance-ego": 0.06559086981273833, "sim_compute_robot_state-ego": 0.06546919686453682}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19099613247229863, "sim_physics": 0.10698398259969856, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11925280990562026, "sim_render-ego": 0.0559467077255249, "in-drivable-lane": 0, "agent_compute-ego": 0.14333097751323992, "deviation-heading": 0.9068035029186574, "set_robot_commands": 0.08338176287137546, "deviation-center-line": 0.07598570357684653, "driven_lanedir_consec": 0.11925280990562026, "sim_compute_sim_state": 0.03615858921637902, "sim_compute_performance-ego": 0.0623777096088116, "sim_compute_robot_state-ego": 0.06540194841531607}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21468146773583277, "sim_physics": 0.11789335875675595, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1559987034744572, "sim_render-ego": 0.06605066924259581, "in-drivable-lane": 0, "agent_compute-ego": 0.18854566278128787, "deviation-heading": 0.7151204881467224, "set_robot_commands": 0.09931351398599558, "deviation-center-line": 0.06817109660298196, "driven_lanedir_consec": 0.1559987034744572, "sim_compute_sim_state": 0.03906979231998838, "sim_compute_performance-ego": 0.07097945542171083, "sim_compute_robot_state-ego": 0.07861217959173794}}
set_robot_commands_max	0.09931351398599558
set_robot_commands_mean	0.08690328128329303
set_robot_commands_median	0.08338176287137546
set_robot_commands_min	0.08129599017481651
sim_compute_performance-ego_max	0.07097945542171083
sim_compute_performance-ego_mean	0.06624160242363768
sim_compute_performance-ego_median	0.06559086981273833
sim_compute_performance-ego_min	0.0623777096088116
sim_compute_robot_state-ego_max	0.07861217959173794
sim_compute_robot_state-ego_mean	0.06950705292495656
sim_compute_robot_state-ego_median	0.06790360327689879
sim_compute_robot_state-ego_min	0.06540194841531607
sim_compute_sim_state_max	0.03948378562927246
sim_compute_sim_state_mean	0.03734051408071641
sim_compute_sim_state_median	0.03733583976482523
sim_compute_sim_state_min	0.03465456347311697
sim_physics_max	0.11789335875675595
sim_physics_mean	0.11034323900049528
sim_physics_median	0.10933848789760044
sim_physics_min	0.10555112746454054
sim_render-ego_max	0.06605066924259581
sim_render-ego_mean	0.05952374623219488
sim_render-ego_median	0.05767253349567282
sim_render-ego_min	0.0559467077255249
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3600000000000003
survival_time_min	1.0500000000000005

No reset possible

24187

3979

Kenechukwu Nnodu 🇨🇦

CNN-More-Less-One-200-1607

step1-simulation

success

yes

2019-07-17 03:33:10+00:00

2019-07-17 03:42:16+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5023434565289406
survival_time_median	4.199999999999993
deviation-center-line_median	0.17507015629058817
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.11996814182826453
agent_compute-ego_mean	0.11802581095016124
agent_compute-ego_median	0.11788666248321532
agent_compute-ego_min	0.11695061789618598
deviation-center-line_max	0.6460659939847264
deviation-center-line_mean	0.25618809798806963
deviation-center-line_min	0.07931830581813651
deviation-heading_max	1.932506820469996
deviation-heading_mean	1.3814352340891929
deviation-heading_median	1.4178669878324306
deviation-heading_min	0.8737860689832767
driven_any_max	1.046072237588788
driven_any_mean	0.5354377268924694
driven_any_median	0.5434824197914987
driven_any_min	0.1653078317781185
driven_lanedir_consec_max	0.970354015928126
driven_lanedir_consec_mean	0.4777915741225094
driven_lanedir_consec_min	0.117287795145798
driven_lanedir_max	0.970354015928126
driven_lanedir_mean	0.4777915741225094
driven_lanedir_median	0.5023434565289406
driven_lanedir_min	0.117287795145798
in-drivable-lane_max	0.10000000000000142
in-drivable-lane_mean	0.020000000000000285
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.046072237588788, "sim_physics": 0.09292284695498916, "survival_time": 8.299999999999983, "driven_lanedir": 0.970354015928126, "sim_render-ego": 0.03603935816201819, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.11824099414319876, "deviation-heading": 1.932506820469996, "set_robot_commands": 0.054944651672639046, "deviation-center-line": 0.6460659939847264, "driven_lanedir_consec": 0.970354015928126, "sim_compute_sim_state": 0.022699883185237288, "sim_compute_performance-ego": 0.038999831820108806, "sim_compute_robot_state-ego": 0.04149222230336752, "sim_compute_robot_state-npc0": 0.04031713899359646, "sim_compute_robot_state-npc1": 0.03980569523501109, "sim_compute_robot_state-npc2": 0.03966030586196716, "sim_compute_robot_state-npc3": 0.0396460854863546}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.26011787173774675, "sim_physics": 0.09008729722764756, "survival_time": 2.25, "driven_lanedir": 0.19512641186752824, "sim_render-ego": 0.03647498024834527, "in-drivable-lane": 0, "agent_compute-ego": 0.11695061789618598, "deviation-heading": 1.4178669878324306, "set_robot_commands": 0.054578505622016056, "deviation-center-line": 0.1565201674570823, "driven_lanedir_consec": 0.19512641186752824, "sim_compute_sim_state": 0.022826284832424583, "sim_compute_performance-ego": 0.03861703872680664, "sim_compute_robot_state-ego": 0.04081703291998969, "sim_compute_robot_state-npc0": 0.04034141434563531, "sim_compute_robot_state-npc1": 0.03964693811204698, "sim_compute_robot_state-npc2": 0.0395911799536811, "sim_compute_robot_state-npc3": 0.03957157135009766}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6622082735661947, "sim_physics": 0.09127032106572933, "survival_time": 5.4999999999999885, "driven_lanedir": 0.6038461911421544, "sim_render-ego": 0.03614023598757657, "in-drivable-lane": 0, "agent_compute-ego": 0.11788666248321532, "deviation-heading": 1.610511938167705, "set_robot_commands": 0.055853204293684525, "deviation-center-line": 0.2239658663898147, "driven_lanedir_consec": 0.6038461911421544, "sim_compute_sim_state": 0.022744063897566363, "sim_compute_performance-ego": 0.038734514063054865, "sim_compute_robot_state-ego": 0.041424166072498665, "sim_compute_robot_state-npc0": 0.040476020899685945, "sim_compute_robot_state-npc1": 0.03985693237998269, "sim_compute_robot_state-npc2": 0.03962564034895463, "sim_compute_robot_state-npc3": 0.03992493369362571}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5434824197914987, "sim_physics": 0.09146126679011754, "survival_time": 4.199999999999993, "driven_lanedir": 0.5023434565289406, "sim_render-ego": 0.03600750934510004, "in-drivable-lane": 0, "agent_compute-ego": 0.11996814182826453, "deviation-heading": 1.0725043549925544, "set_robot_commands": 0.054271590142023, "deviation-center-line": 0.17507015629058817, "driven_lanedir_consec": 0.5023434565289406, "sim_compute_sim_state": 0.02256264573051816, "sim_compute_performance-ego": 0.03905048540660313, "sim_compute_robot_state-ego": 0.040814073312850224, "sim_compute_robot_state-npc0": 0.04030875932602655, "sim_compute_robot_state-npc1": 0.03937436285473052, "sim_compute_robot_state-npc2": 0.03935809930165609, "sim_compute_robot_state-npc3": 0.03950704279400054}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1653078317781185, "sim_physics": 0.08979256664003644, "survival_time": 1.4000000000000006, "driven_lanedir": 0.117287795145798, "sim_render-ego": 0.035984422479357035, "in-drivable-lane": 0, "agent_compute-ego": 0.11708263839994158, "deviation-heading": 0.8737860689832767, "set_robot_commands": 0.05464962550571987, "deviation-center-line": 0.07931830581813651, "driven_lanedir_consec": 0.117287795145798, "sim_compute_sim_state": 0.022635800497872487, "sim_compute_performance-ego": 0.03843822649547032, "sim_compute_robot_state-ego": 0.0411829948425293, "sim_compute_robot_state-npc0": 0.04060364621026175, "sim_compute_robot_state-npc1": 0.040178963116237094, "sim_compute_robot_state-npc2": 0.03979051113128662, "sim_compute_robot_state-npc3": 0.03995045593806675}}
set_robot_commands_max	0.055853204293684525
set_robot_commands_mean	0.0548595154472165
set_robot_commands_median	0.05464962550571987
set_robot_commands_min	0.054271590142023
sim_compute_performance-ego_max	0.03905048540660313
sim_compute_performance-ego_mean	0.03876801930240875
sim_compute_performance-ego_median	0.038734514063054865
sim_compute_performance-ego_min	0.03843822649547032
sim_compute_robot_state-ego_max	0.04149222230336752
sim_compute_robot_state-ego_mean	0.04114609789024708
sim_compute_robot_state-ego_median	0.0411829948425293
sim_compute_robot_state-ego_min	0.040814073312850224
sim_compute_robot_state-npc0_max	0.04060364621026175
sim_compute_robot_state-npc0_mean	0.04040939595504121
sim_compute_robot_state-npc0_median	0.04034141434563531
sim_compute_robot_state-npc0_min	0.04030875932602655
sim_compute_robot_state-npc1_max	0.040178963116237094
sim_compute_robot_state-npc1_mean	0.03977257833960167
sim_compute_robot_state-npc1_median	0.03980569523501109
sim_compute_robot_state-npc1_min	0.03937436285473052
sim_compute_robot_state-npc2_max	0.03979051113128662
sim_compute_robot_state-npc2_mean	0.03960514731950912
sim_compute_robot_state-npc2_median	0.03962564034895463
sim_compute_robot_state-npc2_min	0.03935809930165609
sim_compute_robot_state-npc3_max	0.03995045593806675
sim_compute_robot_state-npc3_mean	0.039720017852429054
sim_compute_robot_state-npc3_median	0.0396460854863546
sim_compute_robot_state-npc3_min	0.03950704279400054
sim_compute_sim_state_max	0.022826284832424583
sim_compute_sim_state_mean	0.02269373562872378
sim_compute_sim_state_median	0.022699883185237288
sim_compute_sim_state_min	0.02256264573051816
sim_physics_max	0.09292284695498916
sim_physics_mean	0.091106859735704
sim_physics_median	0.09127032106572933
sim_physics_min	0.08979256664003644
sim_render-ego_max	0.03647498024834527
sim_render-ego_mean	0.036129301244479425
sim_render-ego_median	0.03603935816201819
sim_render-ego_min	0.035984422479357035
simulation-passed	1
survival_time_max	8.299999999999983
survival_time_mean	4.329999999999993
survival_time_min	1.4000000000000006

No reset possible

24182

3974

Kun Ni 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-17 00:03:56+00:00

2019-07-17 00:08:39+00:00

0:04:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06454460099062675
survival_time_median	1.6000000000000008
deviation-center-line_median	0.04275896688221893
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.10264609271082384
agent_compute-ego_mean	0.09701086434879004
agent_compute-ego_median	0.09594948830143098
agent_compute-ego_min	0.09362062285928165
deviation-center-line_max	0.13718448071669845
deviation-center-line_mean	0.0684921545577323
deviation-center-line_min	0.03871162596530647
deviation-heading_max	2.735299351096212
deviation-heading_mean	1.1074335531278754
deviation-heading_median	0.7042447910838436
deviation-heading_min	0.6427699281071828
driven_any_max	0.8942512637639648
driven_any_mean	0.31095777816370673
driven_any_median	0.18824557338854264
driven_any_min	0.08996491052944253
driven_lanedir_consec_max	0.2292061820947371
driven_lanedir_consec_mean	0.09472789098805764
driven_lanedir_consec_min	0.04478126069436117
driven_lanedir_max	0.2292061820947371
driven_lanedir_mean	0.09472789098805764
driven_lanedir_median	0.06454460099062675
driven_lanedir_min	0.04478126069436117
in-drivable-lane_max	3.5999999999999917
in-drivable-lane_mean	1.0099999999999985
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8942512637639648, "sim_physics": 0.06372406071630017, "survival_time": 7.249999999999982, "driven_lanedir": 0.2292061820947371, "sim_render-ego": 0.03942658490148084, "in-drivable-lane": 3.5999999999999917, "agent_compute-ego": 0.10264609271082384, "deviation-heading": 2.735299351096212, "set_robot_commands": 0.057690580959977776, "deviation-center-line": 0.13718448071669845, "driven_lanedir_consec": 0.2292061820947371, "sim_compute_sim_state": 0.025390330676374764, "sim_compute_performance-ego": 0.04287418990299619, "sim_compute_robot_state-ego": 0.044683568230990706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19438136117780877, "sim_physics": 0.05683975359972786, "survival_time": 1.7000000000000008, "driven_lanedir": 0.08715643071703483, "sim_render-ego": 0.0353010191636927, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09362062285928165, "deviation-heading": 0.6989631533120237, "set_robot_commands": 0.05336518147412468, "deviation-center-line": 0.03871162596530647, "driven_lanedir_consec": 0.08715643071703483, "sim_compute_sim_state": 0.024535312372095445, "sim_compute_performance-ego": 0.038845034206614774, "sim_compute_robot_state-ego": 0.04095963870777803}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08996491052944253, "sim_physics": 0.05967116355895996, "survival_time": 0.9500000000000004, "driven_lanedir": 0.0479509804435283, "sim_render-ego": 0.03548543076766165, "in-drivable-lane": 0, "agent_compute-ego": 0.095776357148823, "deviation-heading": 0.6427699281071828, "set_robot_commands": 0.05353345369037829, "deviation-center-line": 0.08216877498149172, "driven_lanedir_consec": 0.0479509804435283, "sim_compute_sim_state": 0.023606363095735248, "sim_compute_performance-ego": 0.03907295277244166, "sim_compute_robot_state-ego": 0.0411552253522371}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.187945781958775, "sim_physics": 0.06090966612100601, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04478126069436117, "sim_render-ego": 0.03618890792131424, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09706176072359084, "deviation-heading": 0.7558905420401153, "set_robot_commands": 0.057833969593048096, "deviation-center-line": 0.04275896688221893, "driven_lanedir_consec": 0.04478126069436117, "sim_compute_sim_state": 0.02339804172515869, "sim_compute_performance-ego": 0.03862155228853226, "sim_compute_robot_state-ego": 0.04078549146652222}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18824557338854264, "sim_physics": 0.06394163254768617, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06454460099062675, "sim_render-ego": 0.03665424162341702, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09594948830143098, "deviation-heading": 0.7042447910838436, "set_robot_commands": 0.05346919644263483, "deviation-center-line": 0.041636924242946, "driven_lanedir_consec": 0.06454460099062675, "sim_compute_sim_state": 0.023623074254681988, "sim_compute_performance-ego": 0.03946469676110052, "sim_compute_robot_state-ego": 0.04122935571978169}}
set_robot_commands_max	0.057833969593048096
set_robot_commands_mean	0.05517847643203273
set_robot_commands_median	0.05353345369037829
set_robot_commands_min	0.05336518147412468
sim_compute_performance-ego_max	0.04287418990299619
sim_compute_performance-ego_mean	0.03977568518633708
sim_compute_performance-ego_median	0.03907295277244166
sim_compute_performance-ego_min	0.03862155228853226
sim_compute_robot_state-ego_max	0.044683568230990706
sim_compute_robot_state-ego_mean	0.04176265589546194
sim_compute_robot_state-ego_median	0.0411552253522371
sim_compute_robot_state-ego_min	0.04078549146652222
sim_compute_sim_state_max	0.025390330676374764
sim_compute_sim_state_mean	0.024110624424809227
sim_compute_sim_state_median	0.023623074254681988
sim_compute_sim_state_min	0.02339804172515869
sim_physics_max	0.06394163254768617
sim_physics_mean	0.06101725530873603
sim_physics_median	0.06090966612100601
sim_physics_min	0.05683975359972786
sim_render-ego_max	0.03942658490148084
sim_render-ego_mean	0.036611236875513285
sim_render-ego_median	0.03618890792131424
sim_render-ego_min	0.0353010191636927
simulation-passed	1
survival_time_max	7.249999999999982
survival_time_mean	2.609999999999997
survival_time_min	0.9500000000000004

No reset possible

24179

3971

Kenechukwu Nnodu 🇨🇦

CNN-More-Less-One-200-1607

step1-simulation

failed

yes

2019-07-16 23:56:06+00:00

2019-07-16 23:56:53+00:00

0:00:47

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4608) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24177

3969

Kenechukwu Nnodu 🇨🇦

CNN-More-Less-One-200-1607

step1-simulation

failed

yes

2019-07-16 23:46:40+00:00

2019-07-16 23:49:11+00:00

0:02:31

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4800) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24172

3961

Junghyun Seo 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-16 22:43:31+00:00

2019-07-16 23:00:52+00:00

0:17:21

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24171

3966

Kun Ni 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-16 22:42:30+00:00

2019-07-16 22:43:05+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24169

3962

Junghyun Seo 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-16 22:35:00+00:00

2019-07-16 22:42:03+00:00

0:07:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07551485562861782
survival_time_median	1.4500000000000006
deviation-center-line_median	0.09362617382590456
in-drivable-lane_median	0.4000000000000003

other stats

agent_compute-ego_max	0.21044018350798507
agent_compute-ego_mean	0.16529575799844107
agent_compute-ego_median	0.15773930420746674
agent_compute-ego_min	0.14487847915062538
deviation-center-line_max	0.10260554899178596
deviation-center-line_mean	0.07679947183624983
deviation-center-line_min	0.03603645325283269
deviation-heading_max	1.854935730405859
deviation-heading_mean	0.883917892491068
deviation-heading_median	0.6356811413845974
deviation-heading_min	0.5751540795888518
driven_any_max	0.5182735884865612
driven_any_mean	0.2271955674033622
driven_any_median	0.15661494768192794
driven_any_min	0.11434936553255484
driven_lanedir_consec_max	0.16492648525961995
driven_lanedir_consec_mean	0.08926978947100114
driven_lanedir_consec_min	0.05751065867736016
driven_lanedir_max	0.16492648525961995
driven_lanedir_mean	0.08926978947100114
driven_lanedir_median	0.07551485562861782
driven_lanedir_min	0.05751065867736016
in-drivable-lane_max	1.9999999999999971
in-drivable-lane_mean	0.6599999999999997
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2162076641094172, "sim_physics": 0.17249367043778702, "survival_time": 1.850000000000001, "driven_lanedir": 0.060893961810018826, "sim_render-ego": 0.06005472750277133, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.15773930420746674, "deviation-heading": 0.6183161015648596, "set_robot_commands": 0.09144973754882812, "deviation-center-line": 0.05549402521811258, "driven_lanedir_consec": 0.060893961810018826, "sim_compute_sim_state": 0.036435024158374685, "sim_compute_performance-ego": 0.06896498396589949, "sim_compute_robot_state-ego": 0.06950143865636878, "sim_compute_robot_state-npc0": 0.06540289440670528, "sim_compute_robot_state-npc1": 0.06594462652464171, "sim_compute_robot_state-npc2": 0.06822528065861883, "sim_compute_robot_state-npc3": 0.06705717138341956}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5182735884865612, "sim_physics": 0.16015451333739542, "survival_time": 4.399999999999992, "driven_lanedir": 0.16492648525961995, "sim_render-ego": 0.06261696056886153, "in-drivable-lane": 1.9999999999999971, "agent_compute-ego": 0.15538633953441272, "deviation-heading": 1.854935730405859, "set_robot_commands": 0.09187248078259556, "deviation-center-line": 0.0962351578926134, "driven_lanedir_consec": 0.16492648525961995, "sim_compute_sim_state": 0.03823161937973716, "sim_compute_performance-ego": 0.06774818626317111, "sim_compute_robot_state-ego": 0.07197147878733548, "sim_compute_robot_state-npc0": 0.06710418516939337, "sim_compute_robot_state-npc1": 0.06846741925586354, "sim_compute_robot_state-npc2": 0.06601326844908974, "sim_compute_robot_state-npc3": 0.0649129558693279}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11434936553255484, "sim_physics": 0.16921517252922058, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07551485562861782, "sim_render-ego": 0.0635385513305664, "in-drivable-lane": 0, "agent_compute-ego": 0.15803448359171549, "deviation-heading": 0.6356811413845974, "set_robot_commands": 0.09147721529006958, "deviation-center-line": 0.10260554899178596, "driven_lanedir_consec": 0.07551485562861782, "sim_compute_sim_state": 0.038631935914357506, "sim_compute_performance-ego": 0.06741986672083537, "sim_compute_robot_state-ego": 0.07049128413200378, "sim_compute_robot_state-npc0": 0.06994844476381938, "sim_compute_robot_state-npc1": 0.060924917459487915, "sim_compute_robot_state-npc2": 0.06348322828610738, "sim_compute_robot_state-npc3": 0.06721251209576924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13053227120634986, "sim_physics": 0.17430565907404974, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08750298597938899, "sim_render-ego": 0.054193927691533014, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14487847915062538, "deviation-heading": 0.5751540795888518, "set_robot_commands": 0.08117404350867638, "deviation-center-line": 0.09362617382590456, "driven_lanedir_consec": 0.08750298597938899, "sim_compute_sim_state": 0.03716414708357591, "sim_compute_performance-ego": 0.06306320887345535, "sim_compute_robot_state-ego": 0.06506070723900428, "sim_compute_robot_state-npc0": 0.06549240992619441, "sim_compute_robot_state-npc1": 0.06359499234419602, "sim_compute_robot_state-npc2": 0.060685579593365006, "sim_compute_robot_state-npc3": 0.06601856305049016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15661494768192794, "sim_physics": 0.18751576851154195, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05751065867736016, "sim_render-ego": 0.06519345579476192, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.21044018350798507, "deviation-heading": 0.7355024095111723, "set_robot_commands": 0.10136878901514514, "deviation-center-line": 0.03603645325283269, "driven_lanedir_consec": 0.05751065867736016, "sim_compute_sim_state": 0.04110631449469205, "sim_compute_performance-ego": 0.07505028001193342, "sim_compute_robot_state-ego": 0.07901070035737136, "sim_compute_robot_state-npc0": 0.06968087163464777, "sim_compute_robot_state-npc1": 0.0711324379361909, "sim_compute_robot_state-npc2": 0.07002425193786621, "sim_compute_robot_state-npc3": 0.07170964109486547}}
set_robot_commands_max	0.10136878901514514
set_robot_commands_mean	0.09146845322906295
set_robot_commands_median	0.09147721529006958
set_robot_commands_min	0.08117404350867638
sim_compute_performance-ego_max	0.07505028001193342
sim_compute_performance-ego_mean	0.06844930516705895
sim_compute_performance-ego_median	0.06774818626317111
sim_compute_performance-ego_min	0.06306320887345535
sim_compute_robot_state-ego_max	0.07901070035737136
sim_compute_robot_state-ego_mean	0.07120712183441673
sim_compute_robot_state-ego_median	0.07049128413200378
sim_compute_robot_state-ego_min	0.06506070723900428
sim_compute_robot_state-npc0_max	0.06994844476381938
sim_compute_robot_state-npc0_mean	0.06752576118015205
sim_compute_robot_state-npc0_median	0.06710418516939337
sim_compute_robot_state-npc0_min	0.06540289440670528
sim_compute_robot_state-npc1_max	0.0711324379361909
sim_compute_robot_state-npc1_mean	0.06601287870407602
sim_compute_robot_state-npc1_median	0.06594462652464171
sim_compute_robot_state-npc1_min	0.060924917459487915
sim_compute_robot_state-npc2_max	0.07002425193786621
sim_compute_robot_state-npc2_mean	0.06568632178500942
sim_compute_robot_state-npc2_median	0.06601326844908974
sim_compute_robot_state-npc2_min	0.060685579593365006
sim_compute_robot_state-npc3_max	0.07170964109486547
sim_compute_robot_state-npc3_mean	0.06738216869877448
sim_compute_robot_state-npc3_median	0.06705717138341956
sim_compute_robot_state-npc3_min	0.0649129558693279
sim_compute_sim_state_max	0.04110631449469205
sim_compute_sim_state_mean	0.03831380820614746
sim_compute_sim_state_median	0.03823161937973716
sim_compute_sim_state_min	0.036435024158374685
sim_physics_max	0.18751576851154195
sim_physics_mean	0.17273695677799894
sim_physics_median	0.17249367043778702
sim_physics_min	0.16015451333739542
sim_render-ego_max	0.06519345579476192
sim_render-ego_mean	0.06111952457769885
sim_render-ego_median	0.06261696056886153
sim_render-ego_min	0.054193927691533014
simulation-passed	1
survival_time_max	4.399999999999992
survival_time_mean	2.0399999999999987
survival_time_min	1.2000000000000004

No reset possible

24154

3944

Inderpal Singh 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-14 02:04:37+00:00

2019-07-14 02:10:06+00:00

0:05:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08313679214764313
survival_time_median	1.1500000000000004
deviation-center-line_median	0.05876755694249432
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1322025838105575
agent_compute-ego_mean	0.11348315787557256
agent_compute-ego_median	0.11086433584039862
agent_compute-ego_min	0.09711940629141672
deviation-center-line_max	0.0954786649471541
deviation-center-line_mean	0.0712095432582611
deviation-center-line_min	0.05147641233064459
deviation-heading_max	0.822270867916417
deviation-heading_mean	0.627217952569668
deviation-heading_median	0.6947115697194624
deviation-heading_min	0.4579813273097649
driven_any_max	0.2192646210647059
driven_any_mean	0.1668771647442949
driven_any_median	0.1505766847907309
driven_any_min	0.13394597652044343
driven_lanedir_consec_max	0.12025014518972688
driven_lanedir_consec_mean	0.08779264078422662
driven_lanedir_consec_min	0.050553337459390946
driven_lanedir_max	0.12025014518972688
driven_lanedir_mean	0.08779264078422662
driven_lanedir_median	0.08313679214764313
driven_lanedir_min	0.050553337459390946
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.2400000000000002
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2192646210647059, "sim_physics": 0.09794654846191406, "survival_time": 1.7500000000000009, "driven_lanedir": 0.08313679214764313, "sim_render-ego": 0.0365788459777832, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09711940629141672, "deviation-heading": 0.6947115697194624, "set_robot_commands": 0.0547999586377825, "deviation-center-line": 0.05876755694249432, "driven_lanedir_consec": 0.08313679214764313, "sim_compute_sim_state": 0.022591045924595425, "sim_compute_performance-ego": 0.0385108402797154, "sim_compute_robot_state-ego": 0.040706239427839006, "sim_compute_robot_state-npc0": 0.03998299326215472, "sim_compute_robot_state-npc1": 0.039105074746268134, "sim_compute_robot_state-npc2": 0.03918213163103376, "sim_compute_robot_state-npc3": 0.039157928739275254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1915377963714012, "sim_physics": 0.11220358264061712, "survival_time": 1.5500000000000007, "driven_lanedir": 0.050553337459390946, "sim_render-ego": 0.03869945772232548, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.10825558631650864, "deviation-heading": 0.6972776593519882, "set_robot_commands": 0.05981957527898973, "deviation-center-line": 0.05147641233064459, "driven_lanedir_consec": 0.050553337459390946, "sim_compute_sim_state": 0.024571134198096492, "sim_compute_performance-ego": 0.04232408154395319, "sim_compute_robot_state-ego": 0.04705765170435752, "sim_compute_robot_state-npc0": 0.04559149280671151, "sim_compute_robot_state-npc1": 0.04363249963329685, "sim_compute_robot_state-npc2": 0.04406344506048387, "sim_compute_robot_state-npc3": 0.04362785431646531}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1390607449741929, "sim_physics": 0.12688942389054733, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10659137206139936, "sim_render-ego": 0.04551098563454368, "in-drivable-lane": 0, "agent_compute-ego": 0.11086433584039862, "deviation-heading": 0.4579813273097649, "set_robot_commands": 0.06134886091405695, "deviation-center-line": 0.0954786649471541, "driven_lanedir_consec": 0.10659137206139936, "sim_compute_sim_state": 0.025090412660078568, "sim_compute_performance-ego": 0.04613850333473899, "sim_compute_robot_state-ego": 0.04889296401630749, "sim_compute_robot_state-npc0": 0.04711407964879816, "sim_compute_robot_state-npc1": 0.04357458244670521, "sim_compute_robot_state-npc2": 0.04197911782698198, "sim_compute_robot_state-npc3": 0.04244598475369541}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1505766847907309, "sim_physics": 0.141264241674672, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12025014518972688, "sim_render-ego": 0.04531386624211851, "in-drivable-lane": 0, "agent_compute-ego": 0.1189738771189814, "deviation-heading": 0.4638483385507074, "set_robot_commands": 0.0656194894210152, "deviation-center-line": 0.09311933836637463, "driven_lanedir_consec": 0.12025014518972688, "sim_compute_sim_state": 0.0289258334947669, "sim_compute_performance-ego": 0.05029367363971213, "sim_compute_robot_state-ego": 0.053218654964281166, "sim_compute_robot_state-npc0": 0.0503316651219907, "sim_compute_robot_state-npc1": 0.05206584930419922, "sim_compute_robot_state-npc2": 0.04978123955104662, "sim_compute_robot_state-npc3": 0.04938323601432469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13394597652044343, "sim_physics": 0.11948242394820505, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07843155706297278, "sim_render-ego": 0.04875115726305091, "in-drivable-lane": 0, "agent_compute-ego": 0.1322025838105575, "deviation-heading": 0.822270867916417, "set_robot_commands": 0.07180532165195631, "deviation-center-line": 0.057205743704637824, "driven_lanedir_consec": 0.07843155706297278, "sim_compute_sim_state": 0.029245127802309784, "sim_compute_performance-ego": 0.05332376645958942, "sim_compute_robot_state-ego": 0.05393238689588464, "sim_compute_robot_state-npc0": 0.05342482483905295, "sim_compute_robot_state-npc1": 0.05180203396341075, "sim_compute_robot_state-npc2": 0.05104405983634617, "sim_compute_robot_state-npc3": 0.05008102499920389}}
set_robot_commands_max	0.07180532165195631
set_robot_commands_mean	0.06267864118076014
set_robot_commands_median	0.06134886091405695
set_robot_commands_min	0.0547999586377825
sim_compute_performance-ego_max	0.05332376645958942
sim_compute_performance-ego_mean	0.046118173051541825
sim_compute_performance-ego_median	0.04613850333473899
sim_compute_performance-ego_min	0.0385108402797154
sim_compute_robot_state-ego_max	0.05393238689588464
sim_compute_robot_state-ego_mean	0.048761579401733965
sim_compute_robot_state-ego_median	0.04889296401630749
sim_compute_robot_state-ego_min	0.040706239427839006
sim_compute_robot_state-npc0_max	0.05342482483905295
sim_compute_robot_state-npc0_mean	0.0472890111357416
sim_compute_robot_state-npc0_median	0.04711407964879816
sim_compute_robot_state-npc0_min	0.03998299326215472
sim_compute_robot_state-npc1_max	0.05206584930419922
sim_compute_robot_state-npc1_mean	0.04603600801877603
sim_compute_robot_state-npc1_median	0.04363249963329685
sim_compute_robot_state-npc1_min	0.039105074746268134
sim_compute_robot_state-npc2_max	0.05104405983634617
sim_compute_robot_state-npc2_mean	0.04520999878117848
sim_compute_robot_state-npc2_median	0.04406344506048387
sim_compute_robot_state-npc2_min	0.03918213163103376
sim_compute_robot_state-npc3_max	0.05008102499920389
sim_compute_robot_state-npc3_mean	0.044939205764592906
sim_compute_robot_state-npc3_median	0.04362785431646531
sim_compute_robot_state-npc3_min	0.039157928739275254
sim_compute_sim_state_max	0.029245127802309784
sim_compute_sim_state_mean	0.026084710815969435
sim_compute_sim_state_median	0.025090412660078568
sim_compute_sim_state_min	0.022591045924595425
sim_physics_max	0.141264241674672
sim_physics_mean	0.1195572441231911
sim_physics_median	0.11948242394820505
sim_physics_min	0.09794654846191406
sim_render-ego_max	0.04875115726305091
sim_render-ego_mean	0.042970862567964355
sim_render-ego_median	0.04531386624211851
sim_render-ego_min	0.0365788459777832
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.3400000000000003
survival_time_min	1.1000000000000003

No reset possible

24150

3940

Kenechukwu Nnodu 🇨🇦

CNN-Adam-More-Data-Less-One-400

step1-simulation

error

yes

aido2-LFVI-sim-testing-offseason

2019-07-14 00:38:30+00:00

2019-07-14 00:42:42+00:00

0:04:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24143

3936

Kenechukwu Nnodu 🇨🇦

CNN-Adam-More-Data-Less-One-300

step1-simulation

error

yes

2019-07-13 23:22:27+00:00

2019-07-14 00:00:20+00:00

0:37:53

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24141

3928

Gabriel Descoteaux 🇨🇦

aido_LF-tensorflow_modif

step1-simulation

success

yes

2019-07-13 19:07:36+00:00

2019-07-13 19:21:40+00:00

0:14:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0
survival_time_median	14.950000000000076
deviation-center-line_median	0.8791250519425075
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07758502960205078
agent_compute-ego_mean	0.07594386688868204
agent_compute-ego_median	0.07615749994913737
agent_compute-ego_min	0.07480955441792805
deviation-center-line_max	1.1518259299248657
deviation-center-line_mean	0.7501216125180884
deviation-center-line_min	0.25213161298160436
deviation-heading_max	4.612311799738734
deviation-heading_mean	2.597716698919712
deviation-heading_median	2.4213367613149206
deviation-heading_min	1.055344347110816
driven_any_max	1.328474932138796e-13
driven_any_mean	2.6569498642775922e-14
driven_any_median	0
driven_any_min	0
driven_lanedir_consec_max	0
driven_lanedir_consec_mean	0
driven_lanedir_consec_min	0
driven_lanedir_max	0
driven_lanedir_mean	0
driven_lanedir_median	0
driven_lanedir_min	0
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.328474932138796e-13, "sim_physics": 0.054884865283966064, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.036498675346374514, "in-drivable-lane": 0, "agent_compute-ego": 0.07492612361907959, "deviation-heading": 1.3094334271540409, "set_robot_commands": 0.054569859504699704, "deviation-center-line": 1.1518259299248657, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02300134261449178, "sim_compute_performance-ego": 0.03879517237345378, "sim_compute_robot_state-ego": 0.04059458573659261}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0, "sim_physics": 0.05530176957448323, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.035991378625233966, "in-drivable-lane": 0, "agent_compute-ego": 0.07615749994913737, "deviation-heading": 2.4213367613149206, "set_robot_commands": 0.053935476144154865, "deviation-center-line": 0.25213161298160436, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02387633005777995, "sim_compute_performance-ego": 0.03908871094385783, "sim_compute_robot_state-ego": 0.04032535711924235}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0, "sim_physics": 0.054826050599416094, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.035448341369628905, "in-drivable-lane": 0, "agent_compute-ego": 0.07480955441792805, "deviation-heading": 3.590157159280048, "set_robot_commands": 0.0554386830329895, "deviation-center-line": 0.8791250519425075, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02298421541849772, "sim_compute_performance-ego": 0.03877959648768107, "sim_compute_robot_state-ego": 0.04022638479868571}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0, "sim_physics": 0.057835851510365806, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03584970633188884, "in-drivable-lane": 0, "agent_compute-ego": 0.07624112685521443, "deviation-heading": 4.612311799738734, "set_robot_commands": 0.054311936696370446, "deviation-center-line": 0.9357839616685772, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.022914016246795656, "sim_compute_performance-ego": 0.03859936396280925, "sim_compute_robot_state-ego": 0.04024292627970378}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0, "sim_physics": 0.05806056976318359, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03616939465204875, "in-drivable-lane": 0, "agent_compute-ego": 0.07758502960205078, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.055087499618530274, "deviation-center-line": 0.5317415060728867, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02302017688751221, "sim_compute_performance-ego": 0.03873713175455729, "sim_compute_robot_state-ego": 0.04032743295033773}}
set_robot_commands_max	0.0554386830329895
set_robot_commands_mean	0.05466869099934896
set_robot_commands_median	0.054569859504699704
set_robot_commands_min	0.053935476144154865
sim_compute_performance-ego_max	0.03908871094385783
sim_compute_performance-ego_mean	0.03879999510447184
sim_compute_performance-ego_median	0.03877959648768107
sim_compute_performance-ego_min	0.03859936396280925
sim_compute_robot_state-ego_max	0.04059458573659261
sim_compute_robot_state-ego_mean	0.04034333737691243
sim_compute_robot_state-ego_median	0.04032535711924235
sim_compute_robot_state-ego_min	0.04022638479868571
sim_compute_sim_state_max	0.02387633005777995
sim_compute_sim_state_mean	0.023159216245015463
sim_compute_sim_state_median	0.02300134261449178
sim_compute_sim_state_min	0.022914016246795656
sim_physics_max	0.05806056976318359
sim_physics_mean	0.056181821346282954
sim_physics_median	0.05530176957448323
sim_physics_min	0.054826050599416094
sim_render-ego_max	0.036498675346374514
sim_render-ego_mean	0.03599149926503499
sim_render-ego_median	0.035991378625233966
sim_render-ego_min	0.035448341369628905
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24136

3919

Kun Ni 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-11 22:59:24+00:00

2019-07-11 23:00:11+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24135

3925

Kun Ni 🇨🇦

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-11 22:57:05+00:00

2019-07-11 22:59:09+00:00

0:02:04

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24131

3916

Gabriel Descoteaux 🇨🇦

aido_LF-tensorflow_modif

step1-simulation

error

yes

2019-07-11 00:34:56+00:00

2019-07-11 00:35:42+00:00

0:00:46

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24130

3915

Gabriel Descoteaux 🇨🇦

aido_LF-tensorflow_modif

step1-simulation

error

yes

2019-07-11 00:29:30+00:00

2019-07-11 00:30:17+00:00

0:00:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24127

3912

Gabriel Descoteaux 🇨🇦

challenge-aido_LF-template-tensorflow

step1-simulation

error

yes

2019-07-11 00:14:15+00:00

2019-07-11 00:16:31+00:00

0:02:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24106

3901

Gabriel Descoteaux 🇨🇦

challenge-aido_LF-template-tensorflow

step1-simulation

error

yes

2019-07-05 23:34:25+00:00

2019-07-05 23:35:35+00:00

0:01:10

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24102

3904

Gabriel Descoteaux 🇨🇦

challenge-aido_LF-template-tensorflow

step1-simulation

error

yes

2019-07-05 23:31:02+00:00

2019-07-05 23:34:10+00:00

0:03:08

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24096

3894

Chuyj Submission

step1-simulation

failed

yes

2019-07-05 07:58:03+00:00

2019-07-05 07:58:47+00:00

0:00:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24091

3889

Kenechukwu Nnodu 🇨🇦

ResNet-Dropout-GDS

step1-simulation

success

yes

2019-07-04 15:42:37+00:00

2019-07-04 15:52:57+00:00

0:10:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.45666589362836785
survival_time_median	5.449999999999989
deviation-center-line_median	0.25332645511657703
in-drivable-lane_median	1.7499999999999938

other stats

agent_compute-ego_max	0.10970165068844714
agent_compute-ego_mean	0.10797798669116215
agent_compute-ego_median	0.10751995252906728
agent_compute-ego_min	0.10630135938345668
deviation-center-line_max	0.4425928614168368
deviation-center-line_mean	0.2608568329442013
deviation-center-line_min	0.13996123501341126
deviation-heading_max	2.4759093115044557
deviation-heading_mean	1.3592444529938548
deviation-heading_median	1.0383502495387735
deviation-heading_min	0.8804169749426534
driven_any_max	1.0912724466754036
driven_any_mean	0.8134022489246592
driven_any_median	0.7715990675788054
driven_any_min	0.5869546514040958
driven_lanedir_consec_max	0.686747113215187
driven_lanedir_consec_mean	0.4646650979244666
driven_lanedir_consec_min	0.27134103181085756
driven_lanedir_max	0.6897013567087782
driven_lanedir_mean	0.46584152187477573
driven_lanedir_median	0.45666589362836785
driven_lanedir_min	0.27134103181085756
in-drivable-lane_max	2.3499999999999917
in-drivable-lane_mean	1.8299999999999936
in-drivable-lane_min	1.3499999999999952
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0912724466754036, "sim_physics": 0.08685293855338261, "survival_time": 7.249999999999982, "driven_lanedir": 0.6370399227084125, "sim_render-ego": 0.03625481046479324, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.1068322494112212, "deviation-heading": 1.3970386661756726, "set_robot_commands": 0.05478235935342723, "deviation-center-line": 0.3227088214526142, "driven_lanedir_consec": 0.6341120464504577, "sim_compute_sim_state": 0.023101074942227063, "sim_compute_performance-ego": 0.038954968288027005, "sim_compute_robot_state-ego": 0.041509669402550006, "sim_compute_robot_state-npc0": 0.040779094038338494, "sim_compute_robot_state-npc1": 0.040366661137547985, "sim_compute_robot_state-npc2": 0.04013377222521552, "sim_compute_robot_state-npc3": 0.04015175885167615}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7715990675788054, "sim_physics": 0.09906378142330624, "survival_time": 5.449999999999989, "driven_lanedir": 0.45666589362836785, "sim_render-ego": 0.036337299084444656, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.10751995252906728, "deviation-heading": 0.8804169749426534, "set_robot_commands": 0.056602659575436094, "deviation-center-line": 0.25332645511657703, "driven_lanedir_consec": 0.45666589362836785, "sim_compute_sim_state": 0.023046224489124544, "sim_compute_performance-ego": 0.03904854923213294, "sim_compute_robot_state-ego": 0.04160633218397788, "sim_compute_robot_state-npc0": 0.041497832044548946, "sim_compute_robot_state-npc1": 0.04037978452280027, "sim_compute_robot_state-npc2": 0.04032363804108506, "sim_compute_robot_state-npc3": 0.04037997700752468}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5870196211677848, "sim_physics": 0.084742609276829, "survival_time": 4.149999999999993, "driven_lanedir": 0.27134103181085756, "sim_render-ego": 0.03555839320263231, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10630135938345668, "deviation-heading": 1.0383502495387735, "set_robot_commands": 0.053939555064741386, "deviation-center-line": 0.14569479172156735, "driven_lanedir_consec": 0.27134103181085756, "sim_compute_sim_state": 0.023113948753081173, "sim_compute_performance-ego": 0.03875514685389507, "sim_compute_robot_state-ego": 0.04140622931790639, "sim_compute_robot_state-npc0": 0.040646981043987965, "sim_compute_robot_state-npc1": 0.040715415793729115, "sim_compute_robot_state-npc2": 0.03999407607388784, "sim_compute_robot_state-npc3": 0.04013380372380636}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5869546514040958, "sim_physics": 0.08696071498365288, "survival_time": 4.149999999999993, "driven_lanedir": 0.2744594045174624, "sim_render-ego": 0.03662548294986587, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10970165068844714, "deviation-heading": 1.0045070628077175, "set_robot_commands": 0.05427464232387313, "deviation-center-line": 0.13996123501341126, "driven_lanedir_consec": 0.2744594045174624, "sim_compute_sim_state": 0.02354213128606957, "sim_compute_performance-ego": 0.03947412249553634, "sim_compute_robot_state-ego": 0.04214339371187141, "sim_compute_robot_state-npc0": 0.0413097559687603, "sim_compute_robot_state-npc1": 0.041119397404682206, "sim_compute_robot_state-npc2": 0.04079440990126276, "sim_compute_robot_state-npc3": 0.04087833324110651}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0301654577972064, "sim_physics": 0.08793604719466057, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6897013567087782, "sim_render-ego": 0.03670671884564386, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10953472144361856, "deviation-heading": 2.4759093115044557, "set_robot_commands": 0.05552416953487672, "deviation-center-line": 0.4425928614168368, "driven_lanedir_consec": 0.686747113215187, "sim_compute_sim_state": 0.02330841707146686, "sim_compute_performance-ego": 0.039201212965923805, "sim_compute_robot_state-ego": 0.041675386221512505, "sim_compute_robot_state-npc0": 0.041089653968811035, "sim_compute_robot_state-npc1": 0.04058444327202397, "sim_compute_robot_state-npc2": 0.04051257389179175, "sim_compute_robot_state-npc3": 0.040469242178875466}}
set_robot_commands_max	0.056602659575436094
set_robot_commands_mean	0.05502467717047091
set_robot_commands_median	0.05478235935342723
set_robot_commands_min	0.053939555064741386
sim_compute_performance-ego_max	0.03947412249553634
sim_compute_performance-ego_mean	0.03908679996710303
sim_compute_performance-ego_median	0.03904854923213294
sim_compute_performance-ego_min	0.03875514685389507
sim_compute_robot_state-ego_max	0.04214339371187141
sim_compute_robot_state-ego_mean	0.04166820216756364
sim_compute_robot_state-ego_median	0.04160633218397788
sim_compute_robot_state-ego_min	0.04140622931790639
sim_compute_robot_state-npc0_max	0.041497832044548946
sim_compute_robot_state-npc0_mean	0.04106466341288935
sim_compute_robot_state-npc0_median	0.041089653968811035
sim_compute_robot_state-npc0_min	0.040646981043987965
sim_compute_robot_state-npc1_max	0.041119397404682206
sim_compute_robot_state-npc1_mean	0.040633140426156705
sim_compute_robot_state-npc1_median	0.04058444327202397
sim_compute_robot_state-npc1_min	0.040366661137547985
sim_compute_robot_state-npc2_max	0.04079440990126276
sim_compute_robot_state-npc2_mean	0.04035169402664858
sim_compute_robot_state-npc2_median	0.04032363804108506
sim_compute_robot_state-npc2_min	0.03999407607388784
sim_compute_robot_state-npc3_max	0.04087833324110651
sim_compute_robot_state-npc3_mean	0.04040262300059783
sim_compute_robot_state-npc3_median	0.04037997700752468
sim_compute_robot_state-npc3_min	0.04013380372380636
sim_compute_sim_state_max	0.02354213128606957
sim_compute_sim_state_mean	0.023222359308393843
sim_compute_sim_state_median	0.023113948753081173
sim_compute_sim_state_min	0.023046224489124544
sim_physics_max	0.09906378142330624
sim_physics_mean	0.08911121828636627
sim_physics_median	0.08696071498365288
sim_physics_min	0.084742609276829
sim_render-ego_max	0.03670671884564386
sim_render-ego_mean	0.03629654090947598
sim_render-ego_median	0.036337299084444656
sim_render-ego_min	0.03555839320263231
simulation-passed	1
survival_time_max	7.249999999999982
survival_time_mean	5.5799999999999885
survival_time_min	4.149999999999993

No reset possible

24090

3881

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-07-04 14:04:45+00:00

2019-07-04 14:13:13+00:00

0:08:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09300630371175034
survival_time_median	1.3500000000000003
deviation-center-line_median	0.07026189516599242
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14801534016927084
agent_compute-ego_mean	0.1253962636023895
agent_compute-ego_median	0.12913731166294642
agent_compute-ego_min	0.10698240995407104
deviation-center-line_max	0.10994671013441548
deviation-center-line_mean	0.07308725720183315
deviation-center-line_min	0.036299447868137776
deviation-heading_max	0.8879303311639637
deviation-heading_mean	0.7031357916312373
deviation-heading_median	0.7370462562658814
deviation-heading_min	0.44449776512206174
driven_any_max	0.2469379752413027
driven_any_mean	0.16418076521060082
driven_any_median	0.16197115773273257
driven_any_min	0.10289015653777456
driven_lanedir_consec_max	0.13014387086739854
driven_lanedir_consec_mean	0.09023606361011167
driven_lanedir_consec_min	0.06403097401086644
driven_lanedir_max	0.13014387086739854
driven_lanedir_mean	0.09023606361011167
driven_lanedir_median	0.09300630371175034
driven_lanedir_min	0.06403097401086644
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.2033333333333335
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2469379752413027, "sim_physics": 0.086747828282808, "survival_time": 1.900000000000001, "driven_lanedir": 0.11354785188431515, "sim_render-ego": 0.046632547127573115, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.13183859774940893, "deviation-heading": 0.7856156369263251, "set_robot_commands": 0.07214874970285516, "deviation-center-line": 0.07026189516599242, "driven_lanedir_consec": 0.11354785188431515, "sim_compute_sim_state": 0.029638911548413728, "sim_compute_performance-ego": 0.04857612283606278, "sim_compute_robot_state-ego": 0.05137309902592709}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19572712360742137, "sim_physics": 0.07790074926434142, "survival_time": 1.6500000000000008, "driven_lanedir": 0.10740086241935388, "sim_render-ego": 0.0467098770719586, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12172386863014915, "deviation-heading": 0.7370462562658814, "set_robot_commands": 0.07589691335504706, "deviation-center-line": 0.045483793290576384, "driven_lanedir_consec": 0.10740086241935388, "sim_compute_sim_state": 0.029599348704020183, "sim_compute_performance-ego": 0.05294145959796327, "sim_compute_robot_state-ego": 0.05197790174773245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10584939081680976, "sim_physics": 0.07113023996353149, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06829141196592747, "sim_render-ego": 0.03653477430343628, "in-drivable-lane": 0, "agent_compute-ego": 0.10811865329742432, "deviation-heading": 0.6178428375857117, "set_robot_commands": 0.06227314472198486, "deviation-center-line": 0.09007528077482532, "driven_lanedir_consec": 0.06829141196592747, "sim_compute_sim_state": 0.02512909173965454, "sim_compute_performance-ego": 0.04211246967315674, "sim_compute_robot_state-ego": 0.04441527128219605}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19981989687228763, "sim_physics": 0.08635971695184708, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07162783241331594, "sim_render-ego": 0.039785005152225494, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.10698240995407104, "deviation-heading": 0.8879303311639637, "set_robot_commands": 0.059373125433921814, "deviation-center-line": 0.056089002240840825, "driven_lanedir_consec": 0.07162783241331594, "sim_compute_sim_state": 0.02523992210626602, "sim_compute_performance-ego": 0.04368913173675537, "sim_compute_robot_state-ego": 0.0512683242559433}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1882671163422387, "sim_physics": 0.09761250681347317, "survival_time": 1.800000000000001, "driven_lanedir": 0.0710868958526154, "sim_render-ego": 0.05024376180436877, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.13688632514741686, "deviation-heading": 0.6237244123429082, "set_robot_commands": 0.0745668543709649, "deviation-center-line": 0.036299447868137776, "driven_lanedir_consec": 0.0710868958526154, "sim_compute_sim_state": 0.04544980658425225, "sim_compute_performance-ego": 0.05491766002443102, "sim_compute_robot_state-ego": 0.056443783971998424}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.20666279677098, "sim_physics": 0.07772032419840495, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06403097401086644, "sim_render-ego": 0.04247909603696881, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1133374734358354, "deviation-heading": 0.8799366941227552, "set_robot_commands": 0.06122269774928237, "deviation-center-line": 0.05992367774039761, "driven_lanedir_consec": 0.06403097401086644, "sim_compute_sim_state": 0.026656663779056435, "sim_compute_performance-ego": 0.044763312195286606, "sim_compute_robot_state-ego": 0.04626092766270493}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.14433723356179745, "sim_physics": 0.08459572281156268, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1040498411435844, "sim_render-ego": 0.043480822018214633, "in-drivable-lane": 0, "agent_compute-ego": 0.12913731166294642, "deviation-heading": 0.7314277977076952, "set_robot_commands": 0.06925622054508754, "deviation-center-line": 0.10599987205296645, "driven_lanedir_consec": 0.1040498411435844, "sim_compute_sim_state": 0.02863689831324986, "sim_compute_performance-ego": 0.04932528734207153, "sim_compute_robot_state-ego": 0.05071265356881278}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10289015653777456, "sim_physics": 0.07960901762309827, "survival_time": 0.9500000000000004, "driven_lanedir": 0.0678830990979673, "sim_render-ego": 0.05772904345863744, "in-drivable-lane": 0, "agent_compute-ego": 0.13322172666850843, "deviation-heading": 0.5648891662813488, "set_robot_commands": 0.06689288741663883, "deviation-center-line": 0.0795382497762156, "driven_lanedir_consec": 0.0678830990979673, "sim_compute_sim_state": 0.0344229120957224, "sim_compute_performance-ego": 0.06015332121598093, "sim_compute_robot_state-ego": 0.05611028169330798}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14464565765338278, "sim_physics": 0.08210282855563694, "survival_time": 1.3500000000000003, "driven_lanedir": 0.0758055641320925, "sim_render-ego": 0.05060914710715965, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.13717630174424914, "deviation-heading": 0.7936379391592215, "set_robot_commands": 0.07092245419820149, "deviation-center-line": 0.0488344749801295, "driven_lanedir_consec": 0.0758055641320925, "sim_compute_sim_state": 0.032085816065470375, "sim_compute_performance-ego": 0.05226207662511755, "sim_compute_robot_state-ego": 0.05526671586213289}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1328319597501586, "sim_physics": 0.09062718351682028, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09366638770493108, "sim_render-ego": 0.0475704570611318, "in-drivable-lane": 0, "agent_compute-ego": 0.14801534016927084, "deviation-heading": 0.626366363066711, "set_robot_commands": 0.07677748799324036, "deviation-center-line": 0.08333870695408575, "driven_lanedir_consec": 0.09366638770493108, "sim_compute_sim_state": 0.030582964420318604, "sim_compute_performance-ego": 0.048565427462259926, "sim_compute_robot_state-ego": 0.05036798119544983}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16197115773273257, "sim_physics": 0.0935445785522461, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13014387086739854, "sim_render-ego": 0.048301477432250974, "in-drivable-lane": 0, "agent_compute-ego": 0.1326344108581543, "deviation-heading": 0.5084743744419903, "set_robot_commands": 0.07192572593688965, "deviation-center-line": 0.10994671013441548, "driven_lanedir_consec": 0.13014387086739854, "sim_compute_sim_state": 0.03314057350158692, "sim_compute_performance-ego": 0.05167938232421875, "sim_compute_robot_state-ego": 0.0529127025604248}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.12374095271042829, "sim_physics": 0.08472345272699992, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06771510962277494, "sim_render-ego": 0.0476699968179067, "in-drivable-lane": 0, "agent_compute-ego": 0.11551529169082642, "deviation-heading": 0.8089737931429815, "set_robot_commands": 0.06218854586283366, "deviation-center-line": 0.07620363543986901, "driven_lanedir_consec": 0.06771510962277494, "sim_compute_sim_state": 0.02895253896713257, "sim_compute_performance-ego": 0.05052704612414042, "sim_compute_robot_state-ego": 0.054268101851145424}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2262700823731645, "sim_physics": 0.07529842853546143, "survival_time": 1.800000000000001, "driven_lanedir": 0.10983855690349932, "sim_render-ego": 0.043977591726515025, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.11579836739434136, "deviation-heading": 0.7654963773468593, "set_robot_commands": 0.060591565238104925, "deviation-center-line": 0.061983761828166874, "driven_lanedir_consec": 0.10983855690349932, "sim_compute_sim_state": 0.028356975979275174, "sim_compute_performance-ego": 0.049280908372667104, "sim_compute_robot_state-ego": 0.05036523607042101}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16596450105613075, "sim_physics": 0.08287342071533203, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11544639242128252, "sim_render-ego": 0.04659250259399414, "in-drivable-lane": 0, "agent_compute-ego": 0.1295858383178711, "deviation-heading": 0.7711771297921475, "set_robot_commands": 0.07684094429016114, "deviation-center-line": 0.06353009651971579, "driven_lanedir_consec": 0.11544639242128252, "sim_compute_sim_state": 0.03306610107421875, "sim_compute_performance-ego": 0.0525583553314209, "sim_compute_robot_state-ego": 0.05170239448547363}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.11679547713240308, "sim_physics": 0.08638334274291992, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09300630371175034, "sim_render-ego": 0.04657817970622669, "in-drivable-lane": 0, "agent_compute-ego": 0.12097203731536864, "deviation-heading": 0.44449776512206174, "set_robot_commands": 0.06690068678422408, "deviation-center-line": 0.10880025326116258, "driven_lanedir_consec": 0.09300630371175034, "sim_compute_sim_state": 0.03095875003121116, "sim_compute_performance-ego": 0.05211740190332586, "sim_compute_robot_state-ego": 0.05258902636441318}}
set_robot_commands_max	0.07684094429016114
set_robot_commands_mean	0.06851853357329586
set_robot_commands_median	0.06925622054508754
set_robot_commands_min	0.059373125433921814
sim_compute_performance-ego_max	0.06015332121598093
sim_compute_performance-ego_mean	0.05023129085099058
sim_compute_performance-ego_median	0.05052704612414042
sim_compute_performance-ego_min	0.04211246967315674
sim_compute_robot_state-ego_max	0.056443783971998424
sim_compute_robot_state-ego_mean	0.051735626773205576
sim_compute_robot_state-ego_median	0.05170239448547363
sim_compute_robot_state-ego_min	0.04441527128219605
sim_compute_sim_state_max	0.04544980658425225
sim_compute_sim_state_mean	0.030794484993989936
sim_compute_sim_state_median	0.029638911548413728
sim_compute_sim_state_min	0.02512909173965454
sim_physics_max	0.09761250681347317
sim_physics_mean	0.08381528941696557
sim_physics_median	0.08459572281156268
sim_physics_min	0.07113023996353149
sim_render-ego_max	0.05772904345863744
sim_render-ego_mean	0.04632628529457121
sim_render-ego_median	0.046632547127573115
sim_render-ego_min	0.03653477430343628
simulation-passed	1
survival_time_max	1.900000000000001
survival_time_mean	1.4066666666666672
survival_time_min	0.9500000000000004

No reset possible

24085

3888

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-07-04 13:58:38+00:00

2019-07-04 14:04:09+00:00

0:05:31

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24084

3879

Chuyj Submission

step1-simulation

error

yes

2019-07-04 13:48:39+00:00

2019-07-04 13:50:31+00:00

0:01:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24074

3869

Kenechukwu Nnodu 🇨🇦

Baseline-IL-logs-tensorflow

step1-simulation

success

yes

2019-06-29 13:37:20+00:00

2019-06-29 13:52:43+00:00

0:15:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.45636437422784915
survival_time_median	8.649999999999988
deviation-center-line_median	0.4311785162839246
in-drivable-lane_median	2.299999999999992

other stats

agent_compute-ego_max	0.12268276634456228
agent_compute-ego_mean	0.12208369441902012
agent_compute-ego_median	0.1225238087576187
agent_compute-ego_min	0.12077296675974232
deviation-center-line_max	0.9088854268142452
deviation-center-line_mean	0.5986365356813155
deviation-center-line_min	0.37564804861275336
deviation-heading_max	4.201945109163213
deviation-heading_mean	2.4228734465614012
deviation-heading_median	2.2302979057944925
deviation-heading_min	1.1336786145374231
driven_any_max	0.8955257816530534
driven_any_mean	0.5880326060855007
driven_any_median	0.5278877561210948
driven_any_min	0.4705143843374088
driven_lanedir_consec_max	0.5152090074378766
driven_lanedir_consec_mean	0.3627920394806733
driven_lanedir_consec_min	0.17480460052515134
driven_lanedir_max	0.5152090074378766
driven_lanedir_mean	0.36608941005895024
driven_lanedir_median	0.45636437422784915
driven_lanedir_min	0.17480460052515134
in-drivable-lane_max	5.5500000000000655
in-drivable-lane_mean	2.4000000000000083
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5024128743307011, "sim_physics": 0.08547406290706835, "survival_time": 7.599999999999981, "driven_lanedir": 0.17480460052515134, "sim_render-ego": 0.03583336660736486, "in-drivable-lane": 4.149999999999985, "agent_compute-ego": 0.12258098627391614, "deviation-heading": 1.1336786145374231, "set_robot_commands": 0.055266813228004856, "deviation-center-line": 0.37564804861275336, "driven_lanedir_consec": 0.17480460052515134, "sim_compute_sim_state": 0.022465840766304417, "sim_compute_performance-ego": 0.038641499845605144, "sim_compute_robot_state-ego": 0.04036120678249158, "sim_compute_robot_state-npc0": 0.04006241183531912, "sim_compute_robot_state-npc1": 0.03942519269491497, "sim_compute_robot_state-npc2": 0.039244541996403745, "sim_compute_robot_state-npc3": 0.03939867333361977}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5438222339852451, "sim_physics": 0.08745535755656776, "survival_time": 9.55, "driven_lanedir": 0.5152090074378766, "sim_render-ego": 0.03503860104146428, "in-drivable-lane": 0, "agent_compute-ego": 0.12185794395926113, "deviation-heading": 2.735425563790408, "set_robot_commands": 0.055516565033278543, "deviation-center-line": 0.9088854268142452, "driven_lanedir_consec": 0.5152090074378766, "sim_compute_sim_state": 0.02241874739761752, "sim_compute_performance-ego": 0.0384227493046466, "sim_compute_robot_state-ego": 0.040321315146241515, "sim_compute_robot_state-npc0": 0.04046992481691051, "sim_compute_robot_state-npc1": 0.0393408767840001, "sim_compute_robot_state-npc2": 0.039136850397000135, "sim_compute_robot_state-npc3": 0.039288167554046474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8955257816530534, "sim_physics": 0.08792518456158471, "survival_time": 12.850000000000048, "driven_lanedir": 0.4592920284641715, "sim_render-ego": 0.03523501904558115, "in-drivable-lane": 5.5500000000000655, "agent_compute-ego": 0.1225238087576187, "deviation-heading": 2.2302979057944925, "set_robot_commands": 0.054407366518844424, "deviation-center-line": 0.4311785162839246, "driven_lanedir_consec": 0.4592920284641715, "sim_compute_sim_state": 0.022443917938707404, "sim_compute_performance-ego": 0.03845612733744462, "sim_compute_robot_state-ego": 0.04053906522372353, "sim_compute_robot_state-npc0": 0.040240739570053634, "sim_compute_robot_state-npc1": 0.03952933007177212, "sim_compute_robot_state-npc2": 0.03916288164339177, "sim_compute_robot_state-npc3": 0.03936556526659064}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5278877561210948, "sim_physics": 0.08301354654180179, "survival_time": 7.94999999999998, "driven_lanedir": 0.22477703963970264, "sim_render-ego": 0.03539052999244546, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.12268276634456228, "deviation-heading": 4.201945109163213, "set_robot_commands": 0.05447112389330594, "deviation-center-line": 0.38406107755178015, "driven_lanedir_consec": 0.208290186748318, "sim_compute_sim_state": 0.022604126600349474, "sim_compute_performance-ego": 0.03846659150513463, "sim_compute_robot_state-ego": 0.04017748622774328, "sim_compute_robot_state-npc0": 0.04011150276136098, "sim_compute_robot_state-npc1": 0.03938994167735742, "sim_compute_robot_state-npc2": 0.03919571150773726, "sim_compute_robot_state-npc3": 0.03969250085218897}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4705143843374088, "sim_physics": 0.0838875577628957, "survival_time": 8.649999999999988, "driven_lanedir": 0.45636437422784915, "sim_render-ego": 0.03565651695163264, "in-drivable-lane": 0, "agent_compute-ego": 0.12077296675974232, "deviation-heading": 1.8130200395214708, "set_robot_commands": 0.05521230752757519, "deviation-center-line": 0.8934096091438738, "driven_lanedir_consec": 0.45636437422784915, "sim_compute_sim_state": 0.022390546137197855, "sim_compute_performance-ego": 0.03819861853053804, "sim_compute_robot_state-ego": 0.04011638316115892, "sim_compute_robot_state-npc0": 0.03984622872633741, "sim_compute_robot_state-npc1": 0.03920341916166978, "sim_compute_robot_state-npc2": 0.03895784251262687, "sim_compute_robot_state-npc3": 0.03974945558977954}}
set_robot_commands_max	0.055516565033278543
set_robot_commands_mean	0.05497483524020179
set_robot_commands_median	0.05521230752757519
set_robot_commands_min	0.054407366518844424
sim_compute_performance-ego_max	0.038641499845605144
sim_compute_performance-ego_mean	0.03843711730467381
sim_compute_performance-ego_median	0.03845612733744462
sim_compute_performance-ego_min	0.03819861853053804
sim_compute_robot_state-ego_max	0.04053906522372353
sim_compute_robot_state-ego_mean	0.04030309130827177
sim_compute_robot_state-ego_median	0.040321315146241515
sim_compute_robot_state-ego_min	0.04011638316115892
sim_compute_robot_state-npc0_max	0.04046992481691051
sim_compute_robot_state-npc0_mean	0.04014616154199633
sim_compute_robot_state-npc0_median	0.04011150276136098
sim_compute_robot_state-npc0_min	0.03984622872633741
sim_compute_robot_state-npc1_max	0.03952933007177212
sim_compute_robot_state-npc1_mean	0.03937775207794288
sim_compute_robot_state-npc1_median	0.03938994167735742
sim_compute_robot_state-npc1_min	0.03920341916166978
sim_compute_robot_state-npc2_max	0.039244541996403745
sim_compute_robot_state-npc2_mean	0.03913956561143196
sim_compute_robot_state-npc2_median	0.03916288164339177
sim_compute_robot_state-npc2_min	0.03895784251262687
sim_compute_robot_state-npc3_max	0.03974945558977954
sim_compute_robot_state-npc3_mean	0.03949887251924508
sim_compute_robot_state-npc3_median	0.03939867333361977
sim_compute_robot_state-npc3_min	0.039288167554046474
sim_compute_sim_state_max	0.022604126600349474
sim_compute_sim_state_mean	0.022464635768035333
sim_compute_sim_state_median	0.022443917938707404
sim_compute_sim_state_min	0.022390546137197855
sim_physics_max	0.08792518456158471
sim_physics_mean	0.08555114186598367
sim_physics_median	0.08547406290706835
sim_physics_min	0.08301354654180179
sim_render-ego_max	0.03583336660736486
sim_render-ego_mean	0.035430806727697675
sim_render-ego_median	0.03539052999244546
sim_render-ego_min	0.03503860104146428
simulation-passed	1
survival_time_max	12.850000000000048
survival_time_mean	9.32
survival_time_min	7.599999999999981

No reset possible

24073

3868

Kenechukwu Nnodu 🇨🇦

Baseline-IL-logs-tensorflow-kene

step1-simulation

failed

yes

2019-06-29 03:24:33+00:00

2019-06-29 03:25:17+00:00

0:00:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24071

3866

Kenechukwu Nnodu 🇨🇦

Baseline-IL-logs-tensorflow-kene

step1-simulation

failed

yes

2019-06-28 23:10:45+00:00

2019-06-28 23:13:38+00:00

0:02:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24069

3861

Kenechukwu Nnodu 🇨🇦

Baseline-IL-logs-tensorflow-kene

step1-simulation

failed

yes

2019-06-28 22:50:30+00:00

2019-06-28 22:51:36+00:00

0:01:06

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24065

3865

Kenechukwu Nnodu 🇨🇦

Baseline-IL-logs-tensorflow-kene

step1-simulation

failed

yes

2019-06-28 22:46:59+00:00

2019-06-28 22:50:06+00:00

0:03:07

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24064

3856

Kenechukwu Nnodu 🇨🇦

Baseline-IL-logs-tensorflow-kene

step1-simulation

failed

yes

2019-06-28 21:42:37+00:00

2019-06-28 21:45:28+00:00

0:02:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24057

3848

Junghyun Seo 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

host-error

yes

2019-06-27 23:51:27+00:00

2019-06-28 00:00:03+00:00

0:08:36

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1361, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1408, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing-offseason/submission3848/step1-simulation-ip-172-31-42-167-7227-job24057/tmp/tmpl1qgv5wi/episodes/ETHZ_autolab_technical_track-6-0/camera.mp4']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24056

3849

Junghyun Seo 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

yes

2019-06-27 23:46:24+00:00

2019-06-27 23:50:50+00:00

0:04:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.11625373188552056
survival_time_median	1.4500000000000006
deviation-center-line_median	0.07024506747576006
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.16975932285703463
agent_compute-ego_mean	0.16086828715734824
agent_compute-ego_median	0.16106406334907775
agent_compute-ego_min	0.15250553908171477
deviation-center-line_max	0.09965909160382908
deviation-center-line_mean	0.07785012798678762
deviation-center-line_min	0.06382064595539545
deviation-heading_max	0.968269231110289
deviation-heading_mean	0.8318545652290827
deviation-heading_median	0.885486168547169
deviation-heading_min	0.5016197567471753
driven_any_max	0.2094901948184788
driven_any_mean	0.1845683090371713
driven_any_median	0.19574639516462844
driven_any_min	0.14206951858565578
driven_lanedir_consec_max	0.14082402440929165
driven_lanedir_consec_mean	0.11325795992373412
driven_lanedir_consec_min	0.06858394686549474
driven_lanedir_max	0.14082402440929165
driven_lanedir_mean	0.11325795992373412
driven_lanedir_median	0.11625373188552056
driven_lanedir_min	0.06858394686549474
in-drivable-lane_max	0.15000000000000013
in-drivable-lane_mean	0.05000000000000005
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19574639516462844, "sim_physics": 0.11965363601158405, "survival_time": 1.4500000000000006, "driven_lanedir": 0.10427155634647356, "sim_render-ego": 0.06520772802418676, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16975932285703463, "deviation-heading": 0.9630529380006068, "set_robot_commands": 0.0872659601014236, "deviation-center-line": 0.08810099620917924, "driven_lanedir_consec": 0.10427155634647356, "sim_compute_sim_state": 0.04211558144668053, "sim_compute_performance-ego": 0.07047092503514783, "sim_compute_robot_state-ego": 0.0753754500685067}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2093992838752257, "sim_physics": 0.11730228700945454, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14082402440929165, "sim_render-ego": 0.060718513304187406, "in-drivable-lane": 0, "agent_compute-ego": 0.16106406334907775, "deviation-heading": 0.885486168547169, "set_robot_commands": 0.09277856734491163, "deviation-center-line": 0.0674248386897742, "driven_lanedir_consec": 0.14082402440929165, "sim_compute_sim_state": 0.037933741846392234, "sim_compute_performance-ego": 0.06854627978417181, "sim_compute_robot_state-ego": 0.07176111590477728}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14206951858565578, "sim_physics": 0.11170458793640135, "survival_time": 1.0500000000000005, "driven_lanedir": 0.11625373188552056, "sim_render-ego": 0.05927668298993792, "in-drivable-lane": 0, "agent_compute-ego": 0.1664267721630278, "deviation-heading": 0.5016197567471753, "set_robot_commands": 0.0913049266451881, "deviation-center-line": 0.09965909160382908, "driven_lanedir_consec": 0.11625373188552056, "sim_compute_sim_state": 0.03948166256859189, "sim_compute_performance-ego": 0.06645964440845308, "sim_compute_robot_state-ego": 0.07321344103131976}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16613615274186797, "sim_physics": 0.1152166525522868, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06858394686549474, "sim_render-ego": 0.055583450529310435, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15250553908171477, "deviation-heading": 0.968269231110289, "set_robot_commands": 0.08067478073967828, "deviation-center-line": 0.06382064595539545, "driven_lanedir_consec": 0.06858394686549474, "sim_compute_sim_state": 0.038197075879132306, "sim_compute_performance-ego": 0.06488500701056586, "sim_compute_robot_state-ego": 0.06500245023656774}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2094901948184788, "sim_physics": 0.11443663412524809, "survival_time": 1.5500000000000007, "driven_lanedir": 0.13635654011189002, "sim_render-ego": 0.05997775446984076, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15458573833588632, "deviation-heading": 0.8408447317401738, "set_robot_commands": 0.08502098052732406, "deviation-center-line": 0.07024506747576006, "driven_lanedir_consec": 0.13635654011189002, "sim_compute_sim_state": 0.03761930619516681, "sim_compute_performance-ego": 0.06656668263096963, "sim_compute_robot_state-ego": 0.07040172238503734}}
set_robot_commands_max	0.09277856734491163
set_robot_commands_mean	0.08740904307170513
set_robot_commands_median	0.0872659601014236
set_robot_commands_min	0.08067478073967828
sim_compute_performance-ego_max	0.07047092503514783
sim_compute_performance-ego_mean	0.06738570777386163
sim_compute_performance-ego_median	0.06656668263096963
sim_compute_performance-ego_min	0.06488500701056586
sim_compute_robot_state-ego_max	0.0753754500685067
sim_compute_robot_state-ego_mean	0.07115083592524177
sim_compute_robot_state-ego_median	0.07176111590477728
sim_compute_robot_state-ego_min	0.06500245023656774
sim_compute_sim_state_max	0.04211558144668053
sim_compute_sim_state_mean	0.039069473587192746
sim_compute_sim_state_median	0.038197075879132306
sim_compute_sim_state_min	0.03761930619516681
sim_physics_max	0.11965363601158405
sim_physics_mean	0.11566275952699497
sim_physics_median	0.1152166525522868
sim_physics_min	0.11170458793640135
sim_render-ego_max	0.06520772802418676
sim_render-ego_mean	0.06015282586349265
sim_render-ego_median	0.05997775446984076
sim_render-ego_min	0.055583450529310435
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3900000000000006
survival_time_min	1.0500000000000005

No reset possible

24054

3852

Junghyun Seo 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

yes

2019-06-27 23:38:36+00:00

2019-06-27 23:45:50+00:00

0:07:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0819383221144574
survival_time_median	1.3000000000000005
deviation-center-line_median	0.07077390798309896
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.17414705506686506
agent_compute-ego_mean	0.15810703215069807
agent_compute-ego_median	0.15347544046548697
agent_compute-ego_min	0.14671557396650314
deviation-center-line_max	0.09800504654144594
deviation-center-line_mean	0.07045069903959204
deviation-center-line_min	0.030135435176982937
deviation-heading_max	0.8551283501446498
deviation-heading_mean	0.6719909238299641
deviation-heading_median	0.6870076329772088
deviation-heading_min	0.4521897011097954
driven_any_max	0.20041782579608844
driven_any_mean	0.16516350978113747
driven_any_median	0.14502263548424654
driven_any_min	0.1423779403214888
driven_lanedir_consec_max	0.11509937785817526
driven_lanedir_consec_mean	0.08240530779959436
driven_lanedir_consec_min	0.05282981528380293
driven_lanedir_max	0.11509937785817526
driven_lanedir_mean	0.08240530779959436
driven_lanedir_median	0.0819383221144574
driven_lanedir_min	0.05282981528380293
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.2100000000000002
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19560426654016289, "sim_physics": 0.20608437472376331, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0819383221144574, "sim_render-ego": 0.06778819807644548, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17414705506686506, "deviation-heading": 0.8551283501446498, "set_robot_commands": 0.09356327714591192, "deviation-center-line": 0.07077390798309896, "driven_lanedir_consec": 0.0819383221144574, "sim_compute_sim_state": 0.0385485681994208, "sim_compute_performance-ego": 0.07141706039165628, "sim_compute_robot_state-ego": 0.0771245709780989, "sim_compute_robot_state-npc0": 0.07363201831949168, "sim_compute_robot_state-npc1": 0.07464429427837503, "sim_compute_robot_state-npc2": 0.068607733167451, "sim_compute_robot_state-npc3": 0.07009597482352421}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20041782579608844, "sim_physics": 0.19276969134807587, "survival_time": 1.6000000000000008, "driven_lanedir": 0.053388466723951034, "sim_render-ego": 0.054685547947883606, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.14671557396650314, "deviation-heading": 0.8324616964471786, "set_robot_commands": 0.07870610803365707, "deviation-center-line": 0.05641878674318129, "driven_lanedir_consec": 0.053388466723951034, "sim_compute_sim_state": 0.03493325412273407, "sim_compute_performance-ego": 0.05989177525043487, "sim_compute_robot_state-ego": 0.06696608662605286, "sim_compute_robot_state-npc0": 0.06143356114625931, "sim_compute_robot_state-npc1": 0.06332977861166, "sim_compute_robot_state-npc2": 0.06112276017665863, "sim_compute_robot_state-npc3": 0.06364889442920685}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14502263548424654, "sim_physics": 0.16786829284999685, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11509937785817526, "sim_render-ego": 0.05559926447661027, "in-drivable-lane": 0, "agent_compute-ego": 0.14872488768204398, "deviation-heading": 0.4521897011097954, "set_robot_commands": 0.09000758502794348, "deviation-center-line": 0.09800504654144594, "driven_lanedir_consec": 0.11509937785817526, "sim_compute_sim_state": 0.03772831999737283, "sim_compute_performance-ego": 0.05576241534689198, "sim_compute_robot_state-ego": 0.05968075213224992, "sim_compute_robot_state-npc0": 0.0684490618498429, "sim_compute_robot_state-npc1": 0.06388718148936397, "sim_compute_robot_state-npc2": 0.06374618281488834, "sim_compute_robot_state-npc3": 0.061319952425749405}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1423948807637008, "sim_physics": 0.17129621903101602, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1087705570175852, "sim_render-ego": 0.054846485455830894, "in-drivable-lane": 0, "agent_compute-ego": 0.16747220357259116, "deviation-heading": 0.5331672384709879, "set_robot_commands": 0.08396690090497334, "deviation-center-line": 0.09692031875325116, "driven_lanedir_consec": 0.1087705570175852, "sim_compute_sim_state": 0.035669416189193726, "sim_compute_performance-ego": 0.057942996422449745, "sim_compute_robot_state-ego": 0.062318642934163414, "sim_compute_robot_state-npc0": 0.06539532542228699, "sim_compute_robot_state-npc1": 0.0644575556119283, "sim_compute_robot_state-npc2": 0.06464587648709615, "sim_compute_robot_state-npc3": 0.06303100784619649}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1423779403214888, "sim_physics": 0.1671090951332679, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05282981528380293, "sim_render-ego": 0.06030139556297889, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15347544046548697, "deviation-heading": 0.6870076329772088, "set_robot_commands": 0.08243260016808143, "deviation-center-line": 0.030135435176982937, "driven_lanedir_consec": 0.05282981528380293, "sim_compute_sim_state": 0.03926129524524395, "sim_compute_performance-ego": 0.06409441507779635, "sim_compute_robot_state-ego": 0.06766114785121037, "sim_compute_robot_state-npc0": 0.06311380863189697, "sim_compute_robot_state-npc1": 0.05971040175511287, "sim_compute_robot_state-npc2": 0.05896378480471098, "sim_compute_robot_state-npc3": 0.06268228017366849}}
set_robot_commands_max	0.09356327714591192
set_robot_commands_mean	0.08573529425611344
set_robot_commands_median	0.08396690090497334
set_robot_commands_min	0.07870610803365707
sim_compute_performance-ego_max	0.07141706039165628
sim_compute_performance-ego_mean	0.06182173249784585
sim_compute_performance-ego_median	0.05989177525043487
sim_compute_performance-ego_min	0.05576241534689198
sim_compute_robot_state-ego_max	0.0771245709780989
sim_compute_robot_state-ego_mean	0.06675024010435508
sim_compute_robot_state-ego_median	0.06696608662605286
sim_compute_robot_state-ego_min	0.05968075213224992
sim_compute_robot_state-npc0_max	0.07363201831949168
sim_compute_robot_state-npc0_mean	0.06640475507395557
sim_compute_robot_state-npc0_median	0.06539532542228699
sim_compute_robot_state-npc0_min	0.06143356114625931
sim_compute_robot_state-npc1_max	0.07464429427837503
sim_compute_robot_state-npc1_mean	0.06520584234928803
sim_compute_robot_state-npc1_median	0.06388718148936397
sim_compute_robot_state-npc1_min	0.05971040175511287
sim_compute_robot_state-npc2_max	0.068607733167451
sim_compute_robot_state-npc2_mean	0.06341726749016102
sim_compute_robot_state-npc2_median	0.06374618281488834
sim_compute_robot_state-npc2_min	0.05896378480471098
sim_compute_robot_state-npc3_max	0.07009597482352421
sim_compute_robot_state-npc3_mean	0.06415562193966909
sim_compute_robot_state-npc3_median	0.06303100784619649
sim_compute_robot_state-npc3_min	0.061319952425749405
sim_compute_sim_state_max	0.03926129524524395
sim_compute_sim_state_mean	0.03722817075079308
sim_compute_sim_state_median	0.03772831999737283
sim_compute_sim_state_min	0.03493325412273407
sim_physics_max	0.20608437472376331
sim_physics_mean	0.181025534617224
sim_physics_median	0.17129621903101602
sim_physics_min	0.1671090951332679
sim_render-ego_max	0.06778819807644548
sim_render-ego_mean	0.05864417830394984
sim_render-ego_median	0.05559926447661027
sim_render-ego_min	0.054685547947883606
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.3400000000000003
survival_time_min	1.1500000000000004

No reset possible

24049

3842

Kenechukwu Nnodu 🇨🇦

kene-template-random

step1-simulation

error

yes

2019-06-27 20:58:12+00:00

2019-06-27 21:00:12+00:00

0:02:00

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24047

3843

Kenechukwu Nnodu 🇨🇦

kene-template-random

step1-simulation

success

yes

2019-06-27 20:49:43+00:00

2019-06-27 20:58:04+00:00

0:08:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.16231069564819336
agent_compute-ego_mean	0.15128819758289083
agent_compute-ego_median	0.15210639547418664
agent_compute-ego_min	0.13974570286901375
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1633225988458704, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059476772944132485, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15210639547418664, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09054977805526168, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03930593419958044, "sim_compute_performance-ego": 0.06233612696329752, "sim_compute_robot_state-ego": 0.06939459288561786, "sim_compute_robot_state-npc0": 0.06632724956229881, "sim_compute_robot_state-npc1": 0.06937612427605523, "sim_compute_robot_state-npc2": 0.06878949094701696, "sim_compute_robot_state-npc3": 0.06956363607335973}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.20505611419677736, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06617661476135255, "in-drivable-lane": 0, "agent_compute-ego": 0.16231069564819336, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10179373741149902, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.043011751174926754, "sim_compute_performance-ego": 0.0762082290649414, "sim_compute_robot_state-ego": 0.08063323974609375, "sim_compute_robot_state-npc0": 0.0743963623046875, "sim_compute_robot_state-npc1": 0.07485847473144532, "sim_compute_robot_state-npc2": 0.07597770690917968, "sim_compute_robot_state-npc3": 0.07454434394836426}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17613514473563746, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.060132625855897605, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13974570286901375, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08798848014128835, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.037200209341551126, "sim_compute_performance-ego": 0.07145665821276213, "sim_compute_robot_state-ego": 0.06995841390208195, "sim_compute_robot_state-npc0": 0.06377959251403809, "sim_compute_robot_state-npc1": 0.06602493085359272, "sim_compute_robot_state-npc2": 0.06932620939455535, "sim_compute_robot_state-npc3": 0.06616252974459999}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18737847291970555, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06109425387805021, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15262396727936178, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09570898285394984, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03940281083312216, "sim_compute_performance-ego": 0.06668576409545125, "sim_compute_robot_state-ego": 0.07513675508619863, "sim_compute_robot_state-npc0": 0.07176095322717595, "sim_compute_robot_state-npc1": 0.06829976130135451, "sim_compute_robot_state-npc2": 0.06925340543819379, "sim_compute_robot_state-npc3": 0.0657697055913225}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1711898786681039, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05929947750908988, "in-drivable-lane": 0, "agent_compute-ego": 0.14965422664369857, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0934708033289228, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03752040011542184, "sim_compute_performance-ego": 0.06353692497525897, "sim_compute_robot_state-ego": 0.08188389028821673, "sim_compute_robot_state-npc0": 0.07103140865053449, "sim_compute_robot_state-npc1": 0.07125016621180943, "sim_compute_robot_state-npc2": 0.07379370076315743, "sim_compute_robot_state-npc3": 0.06655193226678031}}
set_robot_commands_max	0.10179373741149902
set_robot_commands_mean	0.09390235635818436
set_robot_commands_median	0.0934708033289228
set_robot_commands_min	0.08798848014128835
sim_compute_performance-ego_max	0.0762082290649414
sim_compute_performance-ego_mean	0.06804474066234226
sim_compute_performance-ego_median	0.06668576409545125
sim_compute_performance-ego_min	0.06233612696329752
sim_compute_robot_state-ego_max	0.08188389028821673
sim_compute_robot_state-ego_mean	0.07540137838164178
sim_compute_robot_state-ego_median	0.07513675508619863
sim_compute_robot_state-ego_min	0.06939459288561786
sim_compute_robot_state-npc0_max	0.0743963623046875
sim_compute_robot_state-npc0_mean	0.06945911325174696
sim_compute_robot_state-npc0_median	0.07103140865053449
sim_compute_robot_state-npc0_min	0.06377959251403809
sim_compute_robot_state-npc1_max	0.07485847473144532
sim_compute_robot_state-npc1_mean	0.06996189147485143
sim_compute_robot_state-npc1_median	0.06937612427605523
sim_compute_robot_state-npc1_min	0.06602493085359272
sim_compute_robot_state-npc2_max	0.07597770690917968
sim_compute_robot_state-npc2_mean	0.07142810269042064
sim_compute_robot_state-npc2_median	0.06932620939455535
sim_compute_robot_state-npc2_min	0.06878949094701696
sim_compute_robot_state-npc3_max	0.07454434394836426
sim_compute_robot_state-npc3_mean	0.06851842952488535
sim_compute_robot_state-npc3_median	0.06655193226678031
sim_compute_robot_state-npc3_min	0.0657697055913225
sim_compute_sim_state_max	0.043011751174926754
sim_compute_sim_state_mean	0.03928822113292047
sim_compute_sim_state_median	0.03930593419958044
sim_compute_sim_state_min	0.037200209341551126
sim_physics_max	0.20505611419677736
sim_physics_mean	0.18061644187321896
sim_physics_median	0.17613514473563746
sim_physics_min	0.1633225988458704
sim_render-ego_max	0.06617661476135255
sim_render-ego_mean	0.061235948989704546
sim_render-ego_median	0.060132625855897605
sim_render-ego_min	0.05929947750908988
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24040

3830

Donghoon Lee

challenge-aido_LF-template-pytorch

step1-simulation

success

yes

2019-06-20 13:17:10+00:00

2019-06-20 13:54:56+00:00

0:37:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.05619252710304179
survival_time_median	1.5500000000000007
deviation-center-line_median	0.07150011916070365
in-drivable-lane_median	0.6000000000000004

other stats

agent_compute-ego_max	0.16363341410954793
agent_compute-ego_mean	0.11574671522941628
agent_compute-ego_median	0.11757416560732084
agent_compute-ego_min	0.09233924058767463
deviation-center-line_max	0.67455409294423
deviation-center-line_mean	0.2062292765429776
deviation-center-line_min	0.0252460442318012
deviation-heading_max	5.951946366406269
deviation-heading_mean	2.992326580684763
deviation-heading_median	0.660032058750875
deviation-heading_min	0.475064368099676
driven_any_max	1.549300856112976
driven_any_mean	0.756381258447249
driven_any_median	0.13902285579015622
driven_any_min	0.09785778688038418
driven_lanedir_consec_max	0.5128275283186512
driven_lanedir_consec_mean	0.2448402237322826
driven_lanedir_consec_min	0.03539412568615141
driven_lanedir_max	0.5128275283186512
driven_lanedir_mean	0.2448402237322826
driven_lanedir_median	0.05619252710304179
driven_lanedir_min	0.03539412568615141
in-drivable-lane_max	7.400000000000042
in-drivable-lane_mean	3.650000000000019
in-drivable-lane_min	0.40000000000000024
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.520449431210659, "sim_physics": 0.15357592344284057, "survival_time": 14.950000000000076, "driven_lanedir": 0.4761497610365853, "sim_render-ego": 0.05812755823135376, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.15606792052586874, "deviation-heading": 5.703725350250262, "set_robot_commands": 0.08969576597213745, "deviation-center-line": 0.67455409294423, "driven_lanedir_consec": 0.4761497610365853, "sim_compute_sim_state": 0.03624515453974406, "sim_compute_performance-ego": 0.06333513975143433, "sim_compute_robot_state-ego": 0.0677087124188741, "sim_compute_robot_state-npc0": 0.06804217179616293, "sim_compute_robot_state-npc1": 0.06287844101587932, "sim_compute_robot_state-npc2": 0.06436240275700887, "sim_compute_robot_state-npc3": 0.06611492077509562}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5007181505792806, "sim_physics": 0.15405097166697185, "survival_time": 14.950000000000076, "driven_lanedir": 0.5128275283186512, "sim_render-ego": 0.056550753911336266, "in-drivable-lane": 7.250000000000039, "agent_compute-ego": 0.16363341410954793, "deviation-heading": 5.951946366406269, "set_robot_commands": 0.08858625888824463, "deviation-center-line": 0.6486559452884139, "driven_lanedir_consec": 0.5128275283186512, "sim_compute_sim_state": 0.03634945392608643, "sim_compute_performance-ego": 0.06272190332412719, "sim_compute_robot_state-ego": 0.06941298802693685, "sim_compute_robot_state-npc0": 0.06595839897791544, "sim_compute_robot_state-npc1": 0.0645911447207133, "sim_compute_robot_state-npc2": 0.06565740585327148, "sim_compute_robot_state-npc3": 0.06607284625371297}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11253832201412475, "sim_physics": 0.1473619054864954, "survival_time": 1.3500000000000003, "driven_lanedir": 0.03932019861766678, "sim_render-ego": 0.06759012186968769, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.13401043856585468, "deviation-heading": 0.4791709020455639, "set_robot_commands": 0.0827018243295175, "deviation-center-line": 0.07150011916070365, "driven_lanedir_consec": 0.03932019861766678, "sim_compute_sim_state": 0.02831494366681134, "sim_compute_performance-ego": 0.05273879015887225, "sim_compute_robot_state-ego": 0.054263282705236365, "sim_compute_robot_state-npc0": 0.050477036723384154, "sim_compute_robot_state-npc1": 0.04830805460611979, "sim_compute_robot_state-npc2": 0.051373702508431894, "sim_compute_robot_state-npc3": 0.04924785649334943}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09785778688038418, "sim_physics": 0.12603880677904403, "survival_time": 1.4000000000000006, "driven_lanedir": 0.03658928646741266, "sim_render-ego": 0.03883779048919678, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.12104438883917672, "deviation-heading": 0.475064368099676, "set_robot_commands": 0.06639944655554635, "deviation-center-line": 0.06487951268102517, "driven_lanedir_consec": 0.03658928646741266, "sim_compute_sim_state": 0.02553622211728777, "sim_compute_performance-ego": 0.040439026696341376, "sim_compute_robot_state-ego": 0.04547431639262608, "sim_compute_robot_state-npc0": 0.046820376600537984, "sim_compute_robot_state-npc1": 0.04576652390616281, "sim_compute_robot_state-npc2": 0.04686811140605381, "sim_compute_robot_state-npc3": 0.045682319572993686}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13902285579015622, "sim_physics": 0.11336714990677373, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04511625552223309, "sim_render-ego": 0.04513412906277564, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.130077761988486, "deviation-heading": 0.660032058750875, "set_robot_commands": 0.07208092751041535, "deviation-center-line": 0.0252460442318012, "driven_lanedir_consec": 0.04511625552223309, "sim_compute_sim_state": 0.030574229455763293, "sim_compute_performance-ego": 0.047448519737489765, "sim_compute_robot_state-ego": 0.052729491264589375, "sim_compute_robot_state-npc0": 0.05188827360829999, "sim_compute_robot_state-npc1": 0.05176391140107186, "sim_compute_robot_state-npc2": 0.053771018981933594, "sim_compute_robot_state-npc3": 0.053046787938764016}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5231332255954098, "sim_physics": 0.11337181488672891, "survival_time": 14.950000000000076, "driven_lanedir": 0.46154987075899934, "sim_render-ego": 0.04284192403157552, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.1198224933942159, "deviation-heading": 5.846279732457238, "set_robot_commands": 0.06863049030303955, "deviation-center-line": 0.19487592557061875, "driven_lanedir_consec": 0.46154987075899934, "sim_compute_sim_state": 0.027536209424336752, "sim_compute_performance-ego": 0.04710146347681681, "sim_compute_robot_state-ego": 0.04930564324061076, "sim_compute_robot_state-npc0": 0.05037042856216431, "sim_compute_robot_state-npc1": 0.04956636110941569, "sim_compute_robot_state-npc2": 0.04895167509714762, "sim_compute_robot_state-npc3": 0.04918215433756511}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12250839159386852, "sim_physics": 0.12772474617793642, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05619252710304179, "sim_render-ego": 0.04367977175219306, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.13004909712692786, "deviation-heading": 0.5552112406757185, "set_robot_commands": 0.0724709938312399, "deviation-center-line": 0.06029425998802036, "driven_lanedir_consec": 0.05619252710304179, "sim_compute_sim_state": 0.029237969168301285, "sim_compute_performance-ego": 0.048412692957911, "sim_compute_robot_state-ego": 0.05017775502698175, "sim_compute_robot_state-npc0": 0.05222282738521181, "sim_compute_robot_state-npc1": 0.04961733160347774, "sim_compute_robot_state-npc2": 0.048100372840618265, "sim_compute_robot_state-npc3": 0.04701910347774111}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11630928031024144, "sim_physics": 0.11538097776215651, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0474967363266976, "sim_render-ego": 0.03910641834653657, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.11757416560732084, "deviation-heading": 0.5030055899666701, "set_robot_commands": 0.06500858273999445, "deviation-center-line": 0.06487076640014555, "driven_lanedir_consec": 0.0474967363266976, "sim_compute_sim_state": 0.025905395376271213, "sim_compute_performance-ego": 0.04349142107470282, "sim_compute_robot_state-ego": 0.04523434310123838, "sim_compute_robot_state-npc0": 0.04470735582812079, "sim_compute_robot_state-npc1": 0.04745567256006701, "sim_compute_robot_state-npc2": 0.04347459201155038, "sim_compute_robot_state-npc3": 0.04311674216697956}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4173505343595274, "sim_physics": 0.08691491921742757, "survival_time": 14.950000000000076, "driven_lanedir": 0.4648112553924002, "sim_render-ego": 0.03542586167653402, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09706971089045206, "deviation-heading": 5.70587525882846, "set_robot_commands": 0.05512343883514404, "deviation-center-line": 0.17941614396429134, "driven_lanedir_consec": 0.4648112553924002, "sim_compute_sim_state": 0.02249463478724162, "sim_compute_performance-ego": 0.0382056721051534, "sim_compute_robot_state-ego": 0.04035648028055827, "sim_compute_robot_state-npc0": 0.040192278226216634, "sim_compute_robot_state-npc1": 0.04291801611582438, "sim_compute_robot_state-npc2": 0.039559539953867594, "sim_compute_robot_state-npc3": 0.03960151354471842}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.549300856112976, "sim_physics": 0.08637301524480184, "survival_time": 14.950000000000076, "driven_lanedir": 0.5021161672433161, "sim_render-ego": 0.03440210501352946, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09415711164474488, "deviation-heading": 5.914564142579523, "set_robot_commands": 0.05417873064676921, "deviation-center-line": 0.2599067842059366, "driven_lanedir_consec": 0.5021161672433161, "sim_compute_sim_state": 0.021880664825439457, "sim_compute_performance-ego": 0.03747548818588257, "sim_compute_robot_state-ego": 0.0396323815981547, "sim_compute_robot_state-npc0": 0.03898825883865356, "sim_compute_robot_state-npc1": 0.03846743901570638, "sim_compute_robot_state-npc2": 0.03816656986872355, "sim_compute_robot_state-npc3": 0.03838402430216471}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.4753623571873176, "sim_physics": 0.08769421946721447, "survival_time": 14.850000000000076, "driven_lanedir": 0.43921059175913646, "sim_render-ego": 0.03594921494172478, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.09418090104254008, "deviation-heading": 5.785997466850599, "set_robot_commands": 0.05346408355918396, "deviation-center-line": 0.16129015706442756, "driven_lanedir_consec": 0.43921059175913646, "sim_compute_sim_state": 0.02190391222635905, "sim_compute_performance-ego": 0.037550302466960866, "sim_compute_robot_state-ego": 0.04084114675168638, "sim_compute_robot_state-npc0": 0.03899870496807677, "sim_compute_robot_state-npc1": 0.038403901186856354, "sim_compute_robot_state-npc2": 0.03838756670454135, "sim_compute_robot_state-npc3": 0.03856651068536521}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1062414247922028, "sim_physics": 0.08574439929081844, "survival_time": 1.3000000000000005, "driven_lanedir": 0.03539412568615141, "sim_render-ego": 0.03405158336345966, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.09233924058767463, "deviation-heading": 0.5469586710936079, "set_robot_commands": 0.05391481289496789, "deviation-center-line": 0.06768869117415303, "driven_lanedir_consec": 0.03539412568615141, "sim_compute_sim_state": 0.02190543138063871, "sim_compute_performance-ego": 0.03741241418398344, "sim_compute_robot_state-ego": 0.0394969811806312, "sim_compute_robot_state-npc0": 0.038795021864084095, "sim_compute_robot_state-npc1": 0.038312636888944186, "sim_compute_robot_state-npc2": 0.03814960443056547, "sim_compute_robot_state-npc3": 0.03826470558459942}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4144272744009805, "sim_physics": 0.0870790688196818, "survival_time": 14.950000000000076, "driven_lanedir": 0.4637785754440843, "sim_render-ego": 0.0348508087793986, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09484684546788534, "deviation-heading": 5.626897126940251, "set_robot_commands": 0.05315001885096232, "deviation-center-line": 0.4964700492703755, "driven_lanedir_consec": 0.4637785754440843, "sim_compute_sim_state": 0.021866169770558674, "sim_compute_performance-ego": 0.03748757123947143, "sim_compute_robot_state-ego": 0.03958635171254476, "sim_compute_robot_state-npc0": 0.0388403590520223, "sim_compute_robot_state-npc1": 0.038857120672861734, "sim_compute_robot_state-npc2": 0.03832295020421346, "sim_compute_robot_state-npc3": 0.03830404837926229}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.12083257660815765, "sim_physics": 0.08946015153612409, "survival_time": 1.4000000000000006, "driven_lanedir": 0.042197402673734175, "sim_render-ego": 0.03497825350080218, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.0966081704412188, "deviation-heading": 0.5229829866540693, "set_robot_commands": 0.053070204598563056, "deviation-center-line": 0.061918832249083615, "driven_lanedir_consec": 0.042197402673734175, "sim_compute_sim_state": 0.02204619986670358, "sim_compute_performance-ego": 0.03740223816462925, "sim_compute_robot_state-ego": 0.03991428443363735, "sim_compute_robot_state-npc0": 0.03886995996747698, "sim_compute_robot_state-npc1": 0.03862914868763515, "sim_compute_robot_state-npc2": 0.0382178681237357, "sim_compute_robot_state-npc3": 0.03828510216304234}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12966640927345294, "sim_physics": 0.0859628438949585, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04985307363412872, "sim_render-ego": 0.03415618737538655, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09471906820933024, "deviation-heading": 0.6071874486726682, "set_robot_commands": 0.052899408340454104, "deviation-center-line": 0.06187182395143777, "driven_lanedir_consec": 0.04985307363412872, "sim_compute_sim_state": 0.02197280724843343, "sim_compute_performance-ego": 0.03885881900787354, "sim_compute_robot_state-ego": 0.039401976267496745, "sim_compute_robot_state-npc0": 0.03872841993967692, "sim_compute_robot_state-npc1": 0.038318204879760745, "sim_compute_robot_state-npc2": 0.038157113393147785, "sim_compute_robot_state-npc3": 0.038229330380757647}}
set_robot_commands_max	0.08969576597213745
set_robot_commands_mean	0.06542499919041199
set_robot_commands_median	0.06500858273999445
set_robot_commands_min	0.052899408340454104
sim_compute_performance-ego_max	0.06333513975143433
sim_compute_performance-ego_mean	0.044672097502110014
sim_compute_performance-ego_median	0.040439026696341376
sim_compute_performance-ego_min	0.03740223816462925
sim_compute_robot_state-ego_max	0.06941298802693685
sim_compute_robot_state-ego_mean	0.047569075626786875
sim_compute_robot_state-ego_median	0.04523434310123838
sim_compute_robot_state-ego_min	0.039401976267496745
sim_compute_robot_state-npc0_max	0.06804217179616293
sim_compute_robot_state-npc0_mean	0.04692665815586698
sim_compute_robot_state-npc0_median	0.04470735582812079
sim_compute_robot_state-npc0_min	0.03872841993967692
sim_compute_robot_state-npc1_max	0.0645911447207133
sim_compute_robot_state-npc1_mean	0.046256927224699755
sim_compute_robot_state-npc1_median	0.04576652390616281
sim_compute_robot_state-npc1_min	0.038312636888944186
sim_compute_robot_state-npc2_max	0.06565740585327148
sim_compute_robot_state-npc2_mean	0.04610136627565406
sim_compute_robot_state-npc2_median	0.04347459201155038
sim_compute_robot_state-npc2_min	0.03814960443056547
sim_compute_robot_state-npc3_max	0.06611492077509562
sim_compute_robot_state-npc3_mean	0.04594119773707409
sim_compute_robot_state-npc3_median	0.04311674216697956
sim_compute_robot_state-npc3_min	0.038229330380757647
sim_compute_sim_state_max	0.03634945392608643
sim_compute_sim_state_mean	0.026251293185331776
sim_compute_sim_state_median	0.02553622211728777
sim_compute_sim_state_min	0.021866169770558674
sim_physics_max	0.15405097166697185
sim_physics_mean	0.11067339423866496
sim_physics_median	0.11336714990677373
sim_physics_min	0.08574439929081844
sim_render-ego_max	0.06759012186968769
sim_render-ego_mean	0.04237883215636603
sim_render-ego_median	0.03883779048919678
sim_render-ego_min	0.03405158336345966
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.730000000000036
survival_time_min	1.3000000000000005

No reset possible

24037

3834

Donghoon Lee

challenge-aido_LF-template-pytorch

step1-simulation

success

yes

2019-06-20 13:10:07+00:00

2019-06-20 13:15:59+00:00

0:05:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07383424331709154
survival_time_median	1.3500000000000003
deviation-center-line_median	0.05705265581440869
in-drivable-lane_median	0.30000000000000027

other stats

agent_compute-ego_max	0.17874737467084612
agent_compute-ego_mean	0.1606283118232848
agent_compute-ego_median	0.1673769746507917
agent_compute-ego_min	0.12412693765428331
deviation-center-line_max	0.09818380750852644
deviation-center-line_mean	0.0677207387718659
deviation-center-line_min	0.03656547923061833
deviation-heading_max	0.7771855002132214
deviation-heading_mean	0.6583715316956857
deviation-heading_median	0.6682300029207968
deviation-heading_min	0.5403861725297875
driven_any_max	0.20784381121866372
driven_any_mean	0.15914885559001862
driven_any_median	0.1417168846318984
driven_any_min	0.12319961026820576
driven_lanedir_consec_max	0.0953976952757818
driven_lanedir_consec_mean	0.07130341266563955
driven_lanedir_consec_min	0.0436590552126539
driven_lanedir_max	0.0953976952757818
driven_lanedir_mean	0.07130341266563955
driven_lanedir_median	0.07383424331709154
driven_lanedir_min	0.0436590552126539
in-drivable-lane_max	0.7500000000000007
in-drivable-lane_mean	0.3400000000000003
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.20784381121866372, "sim_physics": 0.16911689213344028, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07383424331709154, "sim_render-ego": 0.05449119976588658, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.17874737467084612, "deviation-heading": 0.6682300029207968, "set_robot_commands": 0.09517807279314314, "deviation-center-line": 0.05705265581440869, "driven_lanedir_consec": 0.07383424331709154, "sim_compute_sim_state": 0.03626397677830288, "sim_compute_performance-ego": 0.06300899641854422, "sim_compute_robot_state-ego": 0.06642934254237584, "sim_compute_robot_state-npc0": 0.06494290488106864, "sim_compute_robot_state-npc1": 0.06091593333653041, "sim_compute_robot_state-npc2": 0.06288292067391532, "sim_compute_robot_state-npc3": 0.07792319570268903}, "udem1-1-0": {"driven_any": 0.19357951605083903, "sim_physics": 0.199284873689924, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0436590552126539, "sim_render-ego": 0.05764995983668736, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.1673769746507917, "deviation-heading": 0.7771855002132214, "set_robot_commands": 0.0989567416054862, "deviation-center-line": 0.05316634304862935, "driven_lanedir_consec": 0.0436590552126539, "sim_compute_sim_state": 0.03772200856889997, "sim_compute_performance-ego": 0.06320146151951381, "sim_compute_robot_state-ego": 0.07055085727146694, "sim_compute_robot_state-npc0": 0.06637706075395856, "sim_compute_robot_state-npc1": 0.06363024711608886, "sim_compute_robot_state-npc2": 0.06438001905168805, "sim_compute_robot_state-npc3": 0.06601973942347936}, "udem1-2-0": {"driven_any": 0.12319961026820576, "sim_physics": 0.2378211228743843, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0909348778873702, "sim_render-ego": 0.05719819276229195, "in-drivable-lane": 0, "agent_compute-ego": 0.16761250081269638, "deviation-heading": 0.5500801984102511, "set_robot_commands": 0.0926177916319474, "deviation-center-line": 0.09818380750852644, "driven_lanedir_consec": 0.0909348778873702, "sim_compute_sim_state": 0.037220571352087936, "sim_compute_performance-ego": 0.06499089365420134, "sim_compute_robot_state-ego": 0.07251958225084387, "sim_compute_robot_state-npc0": 0.0686053296794062, "sim_compute_robot_state-npc1": 0.06713612183280614, "sim_compute_robot_state-npc2": 0.06670742449553116, "sim_compute_robot_state-npc3": 0.06639506505883258}, "udem1-3-0": {"driven_any": 0.1294044557804862, "sim_physics": 0.1794763129690419, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0953976952757818, "sim_render-ego": 0.05026697075885275, "in-drivable-lane": 0, "agent_compute-ego": 0.16527777132780655, "deviation-heading": 0.5403861725297875, "set_robot_commands": 0.08696698105853537, "deviation-center-line": 0.09363540825714668, "driven_lanedir_consec": 0.0953976952757818, "sim_compute_sim_state": 0.03274481192879055, "sim_compute_performance-ego": 0.05597413104513417, "sim_compute_robot_state-ego": 0.06083795298700747, "sim_compute_robot_state-npc0": 0.06421364908633025, "sim_compute_robot_state-npc1": 0.06535506248474121, "sim_compute_robot_state-npc2": 0.06313301169353983, "sim_compute_robot_state-npc3": 0.07008324498715608}, "udem1-4-0": {"driven_any": 0.1417168846318984, "sim_physics": 0.13775081987734197, "survival_time": 1.3500000000000003, "driven_lanedir": 0.05269119163530034, "sim_render-ego": 0.04435784728438766, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12412693765428331, "deviation-heading": 0.7559757844043717, "set_robot_commands": 0.0783363801461679, "deviation-center-line": 0.03656547923061833, "driven_lanedir_consec": 0.05269119163530034, "sim_compute_sim_state": 0.030198229683770075, "sim_compute_performance-ego": 0.04664537641737196, "sim_compute_robot_state-ego": 0.05089267094930013, "sim_compute_robot_state-npc0": 0.05352564211244936, "sim_compute_robot_state-npc1": 0.04939112839875398, "sim_compute_robot_state-npc2": 0.050411109571103695, "sim_compute_robot_state-npc3": 0.050608414190786856}}
set_robot_commands_max	0.0989567416054862
set_robot_commands_mean	0.090411193447056
set_robot_commands_median	0.0926177916319474
set_robot_commands_min	0.0783363801461679
sim_compute_performance-ego_max	0.06499089365420134
sim_compute_performance-ego_mean	0.0587641718109531
sim_compute_performance-ego_median	0.06300899641854422
sim_compute_performance-ego_min	0.04664537641737196
sim_compute_robot_state-ego_max	0.07251958225084387
sim_compute_robot_state-ego_mean	0.06424608120019884
sim_compute_robot_state-ego_median	0.06642934254237584
sim_compute_robot_state-ego_min	0.05089267094930013
sim_compute_robot_state-npc0_max	0.0686053296794062
sim_compute_robot_state-npc0_mean	0.06353291730264261
sim_compute_robot_state-npc0_median	0.06494290488106864
sim_compute_robot_state-npc0_min	0.05352564211244936
sim_compute_robot_state-npc1_max	0.06713612183280614
sim_compute_robot_state-npc1_mean	0.06128569863378412
sim_compute_robot_state-npc1_median	0.06363024711608886
sim_compute_robot_state-npc1_min	0.04939112839875398
sim_compute_robot_state-npc2_max	0.06670742449553116
sim_compute_robot_state-npc2_mean	0.0615028970971556
sim_compute_robot_state-npc2_median	0.06313301169353983
sim_compute_robot_state-npc2_min	0.050411109571103695
sim_compute_robot_state-npc3_max	0.07792319570268903
sim_compute_robot_state-npc3_mean	0.06620593187258879
sim_compute_robot_state-npc3_median	0.06639506505883258
sim_compute_robot_state-npc3_min	0.050608414190786856
sim_compute_sim_state_max	0.03772200856889997
sim_compute_sim_state_mean	0.03482991966237028
sim_compute_sim_state_median	0.03626397677830288
sim_compute_sim_state_min	0.030198229683770075
sim_physics_max	0.2378211228743843
sim_physics_mean	0.18469000430882648
sim_physics_median	0.1794763129690419
sim_physics_min	0.13775081987734197
sim_render-ego_max	0.05764995983668736
sim_render-ego_mean	0.052792834081621255
sim_render-ego_median	0.05449119976588658
sim_render-ego_min	0.04435784728438766
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.4300000000000006
survival_time_min	1.1500000000000004

No reset possible

24035

3825

Diego Charrez 🇵🇪

PredictorLast

step1-simulation

success

2019-06-19 17:37:42+00:00

2019-06-19 17:38:12+00:00

0:00:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1263750130726308
error_L2	0.023816452751950105

No reset possible

24030

3824

Donghoon Lee

PredictorLast

step1-simulation

success

2019-06-18 08:05:22+00:00

2019-06-18 08:05:50+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11856790268534818
error_L2	0.02192530636895919

No reset possible

24025

3819

Philippe Laferriere

PredictorLast

step1-simulation

success

2019-06-12 21:04:13+00:00

2019-06-12 21:04:43+00:00

0:00:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11536419350005156
error_L2	0.021206786063720628

No reset possible

24021

3811

Amaury Camus 🇨🇭

Let's do this one today

step1-simulation

success

yes

2019-06-11 17:09:24+00:00

2019-06-11 17:29:33+00:00

0:20:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.15490049362182615
agent_compute-ego_mean	0.1456960371013701
agent_compute-ego_median	0.14437071323394776
agent_compute-ego_min	0.13737282947618135
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14457240811100713, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.054441346062554255, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1380183387685705, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08253905949769197, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03582359684838189, "sim_compute_performance-ego": 0.06477907410374394, "sim_compute_robot_state-ego": 0.06567731610050907, "sim_compute_robot_state-npc0": 0.062410694581490976, "sim_compute_robot_state-npc1": 0.05984913419794153, "sim_compute_robot_state-npc2": 0.059104857621369536, "sim_compute_robot_state-npc3": 0.0693692719494855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1896437549591065, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0549664306640625, "in-drivable-lane": 0, "agent_compute-ego": 0.1511079978942871, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09153096199035644, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.035165834426879886, "sim_compute_performance-ego": 0.0656983184814453, "sim_compute_robot_state-ego": 0.07345609664916992, "sim_compute_robot_state-npc0": 0.06581464767456055, "sim_compute_robot_state-npc1": 0.0680873966217041, "sim_compute_robot_state-npc2": 0.0686650276184082, "sim_compute_robot_state-npc3": 0.06469029426574707}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18416582283220792, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06020417338923404, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1547418707295468, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09182849369551006, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03796993431292082, "sim_compute_performance-ego": 0.06892933343586169, "sim_compute_robot_state-ego": 0.07456099045904059, "sim_compute_robot_state-npc0": 0.06911055978975798, "sim_compute_robot_state-npc1": 0.06830665312315289, "sim_compute_robot_state-npc2": 0.06938967892998144, "sim_compute_robot_state-npc3": 0.06763688200398495}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1758499930176554, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05715300463422944, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14191963401021837, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0884618065025233, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03715092320985432, "sim_compute_performance-ego": 0.06487847581694398, "sim_compute_robot_state-ego": 0.0688384062127222, "sim_compute_robot_state-npc0": 0.06655381601068038, "sim_compute_robot_state-npc1": 0.0637691292581679, "sim_compute_robot_state-npc2": 0.06270368793342687, "sim_compute_robot_state-npc3": 0.06492069099522844}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18644426550183976, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06348412377493722, "in-drivable-lane": 0, "agent_compute-ego": 0.14642901931490218, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09115604843412128, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03799478496823992, "sim_compute_performance-ego": 0.07842214618410383, "sim_compute_robot_state-ego": 0.08461907080241612, "sim_compute_robot_state-npc0": 0.06538815157754081, "sim_compute_robot_state-npc1": 0.06816862310682024, "sim_compute_robot_state-npc2": 0.0801080550466265, "sim_compute_robot_state-npc3": 0.0691582305090768}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.17198358641730416, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05898628411469636, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1540774769253201, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.09305791060129802, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.037748230828179255, "sim_compute_performance-ego": 0.06823840847721806, "sim_compute_robot_state-ego": 0.07831386283591941, "sim_compute_robot_state-npc0": 0.06665530469682482, "sim_compute_robot_state-npc1": 0.06747843159569634, "sim_compute_robot_state-npc2": 0.06419946529247143, "sim_compute_robot_state-npc3": 0.0622190413651643}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.1580219754466304, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.05955469166790998, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.14819739041505037, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09131286320862948, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.038524349530537925, "sim_compute_performance-ego": 0.06429988366586191, "sim_compute_robot_state-ego": 0.07411954579529939, "sim_compute_robot_state-npc0": 0.07103748674745913, "sim_compute_robot_state-npc1": 0.06879680686526829, "sim_compute_robot_state-npc2": 0.06804309950934516, "sim_compute_robot_state-npc3": 0.0676783941410206}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.18525716463724773, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.055891826417711045, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.14014821582370335, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.08578039275275337, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03633508152431912, "sim_compute_performance-ego": 0.06373834080166287, "sim_compute_robot_state-ego": 0.06935877799987793, "sim_compute_robot_state-npc0": 0.06444903479682075, "sim_compute_robot_state-npc1": 0.06377460161844889, "sim_compute_robot_state-npc2": 0.06452424791124133, "sim_compute_robot_state-npc3": 0.06049550374348958}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.15554473711096722, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.0547945032949033, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.14252261493517004, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.08384197691212529, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03499943277110224, "sim_compute_performance-ego": 0.063835885213769, "sim_compute_robot_state-ego": 0.06966765548871912, "sim_compute_robot_state-npc0": 0.060037846150605576, "sim_compute_robot_state-npc1": 0.06194913905599843, "sim_compute_robot_state-npc2": 0.061233359834422234, "sim_compute_robot_state-npc3": 0.06351341890252155}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.17428080558776857, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.05718729972839356, "in-drivable-lane": 0, "agent_compute-ego": 0.14437071323394776, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.09319132328033448, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.03674973487854004, "sim_compute_performance-ego": 0.06508312702178955, "sim_compute_robot_state-ego": 0.0697386360168457, "sim_compute_robot_state-npc0": 0.06593659400939941, "sim_compute_robot_state-npc1": 0.06584096908569335, "sim_compute_robot_state-npc2": 0.06328247547149658, "sim_compute_robot_state-npc3": 0.06283201694488526}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.19032766819000244, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.054708456993103026, "in-drivable-lane": 0, "agent_compute-ego": 0.1379152297973633, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.08132275342941284, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.03937950134277344, "sim_compute_performance-ego": 0.056161558628082274, "sim_compute_robot_state-ego": 0.06101411581039429, "sim_compute_robot_state-npc0": 0.06086570024490357, "sim_compute_robot_state-npc1": 0.060111498832702635, "sim_compute_robot_state-npc2": 0.060692989826202394, "sim_compute_robot_state-npc3": 0.06275250911712646}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1837275404679148, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.057871529930516294, "in-drivable-lane": 0, "agent_compute-ego": 0.14319327003077456, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.09725716239527651, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.038558156866776314, "sim_compute_performance-ego": 0.06474228909141139, "sim_compute_robot_state-ego": 0.06653420548689992, "sim_compute_robot_state-npc0": 0.06477884242409154, "sim_compute_robot_state-npc1": 0.06340068265011436, "sim_compute_robot_state-npc2": 0.06229994171544125, "sim_compute_robot_state-npc3": 0.06110197619387978}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1596747589111328, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06129908084869385, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15490049362182615, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.09682887077331542, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.03829436302185059, "sim_compute_performance-ego": 0.06720079898834229, "sim_compute_robot_state-ego": 0.07471795082092285, "sim_compute_robot_state-npc0": 0.07501360416412353, "sim_compute_robot_state-npc1": 0.06613888263702393, "sim_compute_robot_state-npc2": 0.06960060119628907, "sim_compute_robot_state-npc3": 0.0668506669998169}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1979970173402266, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06210316311229359, "in-drivable-lane": 0, "agent_compute-ego": 0.15052546154369006, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.09406846219843085, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.03684248707511208, "sim_compute_performance-ego": 0.0688642913644964, "sim_compute_robot_state-ego": 0.06672258810563521, "sim_compute_robot_state-npc0": 0.06770364804701372, "sim_compute_robot_state-npc1": 0.06814177469773726, "sim_compute_robot_state-npc2": 0.0650750615380027, "sim_compute_robot_state-npc3": 0.0683983564376831}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.19275997122939753, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.054923115944375794, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.13737282947618135, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.08814426830836705, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.03414844006908183, "sim_compute_performance-ego": 0.06097612089040328, "sim_compute_robot_state-ego": 0.06554427438852739, "sim_compute_robot_state-npc0": 0.06166401687933474, "sim_compute_robot_state-npc1": 0.06144505131001375, "sim_compute_robot_state-npc2": 0.06232723411248655, "sim_compute_robot_state-npc3": 0.06330297917735819}}
set_robot_commands_max	0.09725716239527651
set_robot_commands_mean	0.0900214902653431
set_robot_commands_median	0.09131286320862948
set_robot_commands_min	0.08132275342941284
sim_compute_performance-ego_max	0.07842214618410383
sim_compute_performance-ego_mean	0.06572320347767571
sim_compute_performance-ego_median	0.06487847581694398
sim_compute_performance-ego_min	0.056161558628082274
sim_compute_robot_state-ego_max	0.08461907080241612
sim_compute_robot_state-ego_mean	0.07085889953152662
sim_compute_robot_state-ego_median	0.06966765548871912
sim_compute_robot_state-ego_min	0.06101411581039429
sim_compute_robot_state-npc0_max	0.07501360416412353
sim_compute_robot_state-npc0_mean	0.0658279965196405
sim_compute_robot_state-npc0_median	0.06581464767456055
sim_compute_robot_state-npc0_min	0.060037846150605576
sim_compute_robot_state-npc1_max	0.06879680686526829
sim_compute_robot_state-npc1_mean	0.0650172516437656
sim_compute_robot_state-npc1_median	0.06584096908569335
sim_compute_robot_state-npc1_min	0.05984913419794153
sim_compute_robot_state-npc2_max	0.0801080550466265
sim_compute_robot_state-npc2_mean	0.06541665223714742
sim_compute_robot_state-npc2_median	0.06419946529247143
sim_compute_robot_state-npc2_min	0.059104857621369536
sim_compute_robot_state-npc3_max	0.0693692719494855
sim_compute_robot_state-npc3_mean	0.0649946821830979
sim_compute_robot_state-npc3_median	0.06469029426574707
sim_compute_robot_state-npc3_min	0.06049550374348958
sim_compute_sim_state_max	0.03937950134277344
sim_compute_sim_state_mean	0.03704565677830331
sim_compute_sim_state_median	0.03715092320985432
sim_compute_sim_state_min	0.03414844006908183
sim_physics_max	0.1979970173402266
sim_physics_mean	0.17668343131736058
sim_physics_median	0.1837275404679148
sim_physics_min	0.14457240811100713
sim_render-ego_max	0.06348412377493722
sim_render-ego_mean	0.05783793537184094
sim_render-ego_median	0.05718729972839356
sim_render-ego_min	0.054441346062554255
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

24018

3812

Amaury Camus 🇨🇭

Let's do this one today

step1-simulation

success

yes

2019-06-11 17:00:40+00:00

2019-06-11 17:08:38+00:00

0:07:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.1589952196393694
agent_compute-ego_mean	0.1443899867802169
agent_compute-ego_median	0.14387595176696777
agent_compute-ego_min	0.1272968053817749
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1386045394120393, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05365012310169361, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1272968053817749, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08360874211346661, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.030434882199322735, "sim_compute_performance-ego": 0.05939118950455277, "sim_compute_robot_state-ego": 0.06362844396520544, "sim_compute_robot_state-npc0": 0.05890295240614149, "sim_compute_robot_state-npc1": 0.06061981342456959, "sim_compute_robot_state-npc2": 0.05585845752998635, "sim_compute_robot_state-npc3": 0.05371559107745135}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.17676926612854005, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.05732707977294922, "in-drivable-lane": 0, "agent_compute-ego": 0.14387595176696777, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08809575080871582, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.038383712768554686, "sim_compute_performance-ego": 0.0675126838684082, "sim_compute_robot_state-ego": 0.07254491806030273, "sim_compute_robot_state-npc0": 0.06259063720703124, "sim_compute_robot_state-npc1": 0.05928920745849609, "sim_compute_robot_state-npc2": 0.06364901542663574, "sim_compute_robot_state-npc3": 0.06614619255065918}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.16564353202518664, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06097643626363654, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15265919032849765, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09170702256654438, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03777066657417699, "sim_compute_performance-ego": 0.06716087931080868, "sim_compute_robot_state-ego": 0.07071869310579802, "sim_compute_robot_state-npc0": 0.06850385979602211, "sim_compute_robot_state-npc1": 0.06672239303588867, "sim_compute_robot_state-npc2": 0.06498376946700246, "sim_compute_robot_state-npc3": 0.06363452421991449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1672186911860599, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05605304090282585, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13912276678447483, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08500884756257263, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.036784003052530406, "sim_compute_performance-ego": 0.06535746176031572, "sim_compute_robot_state-ego": 0.06858903245080876, "sim_compute_robot_state-npc0": 0.06409105469908895, "sim_compute_robot_state-npc1": 0.06202624417558501, "sim_compute_robot_state-npc2": 0.06290957293932951, "sim_compute_robot_state-npc3": 0.06163346616527702}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.19311797618865967, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.0674223814691816, "in-drivable-lane": 0, "agent_compute-ego": 0.1589952196393694, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09666510139192852, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.038140339510781426, "sim_compute_performance-ego": 0.07641136646270752, "sim_compute_robot_state-ego": 0.08577047075544085, "sim_compute_robot_state-npc0": 0.07334305558885847, "sim_compute_robot_state-npc1": 0.06730685915265765, "sim_compute_robot_state-npc2": 0.06725857087544032, "sim_compute_robot_state-npc3": 0.06931218930653163}}
set_robot_commands_max	0.09666510139192852
set_robot_commands_mean	0.0890170928886456
set_robot_commands_median	0.08809575080871582
set_robot_commands_min	0.08360874211346661
sim_compute_performance-ego_max	0.07641136646270752
sim_compute_performance-ego_mean	0.06716671618135858
sim_compute_performance-ego_median	0.06716087931080868
sim_compute_performance-ego_min	0.05939118950455277
sim_compute_robot_state-ego_max	0.08577047075544085
sim_compute_robot_state-ego_mean	0.07225031166751117
sim_compute_robot_state-ego_median	0.07071869310579802
sim_compute_robot_state-ego_min	0.06362844396520544
sim_compute_robot_state-npc0_max	0.07334305558885847
sim_compute_robot_state-npc0_mean	0.06548631193942844
sim_compute_robot_state-npc0_median	0.06409105469908895
sim_compute_robot_state-npc0_min	0.05890295240614149
sim_compute_robot_state-npc1_max	0.06730685915265765
sim_compute_robot_state-npc1_mean	0.06319290344943941
sim_compute_robot_state-npc1_median	0.06202624417558501
sim_compute_robot_state-npc1_min	0.05928920745849609
sim_compute_robot_state-npc2_max	0.06725857087544032
sim_compute_robot_state-npc2_mean	0.06293187724767887
sim_compute_robot_state-npc2_median	0.06364901542663574
sim_compute_robot_state-npc2_min	0.05585845752998635
sim_compute_robot_state-npc3_max	0.06931218930653163
sim_compute_robot_state-npc3_mean	0.06288839266396673
sim_compute_robot_state-npc3_median	0.06363452421991449
sim_compute_robot_state-npc3_min	0.05371559107745135
sim_compute_sim_state_max	0.038383712768554686
sim_compute_sim_state_mean	0.036302720821073255
sim_compute_sim_state_median	0.03777066657417699
sim_compute_sim_state_min	0.030434882199322735
sim_physics_max	0.19311797618865967
sim_physics_mean	0.16827080098809713
sim_physics_median	0.1672186911860599
sim_physics_min	0.1386045394120393
sim_render-ego_max	0.0674223814691816
sim_render-ego_mean	0.05908581230205736
sim_render-ego_median	0.05732707977294922
sim_render-ego_min	0.05365012310169361
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24017

3808

Baseline solution using reinforcement learning

step1-simulation

failed

yes

2019-06-11 02:56:19+00:00

2019-06-11 02:58:36+00:00

0:02:17

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24016

3807

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-06-10 16:52:24+00:00

2019-06-10 16:57:50+00:00

0:05:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2970674355257206
survival_time_median	3.949999999999994
deviation-center-line_median	0.24025421116283985
in-drivable-lane_median	1.1

other stats

agent_compute-ego_max	0.10040280486963972
agent_compute-ego_mean	0.09702737088559864
agent_compute-ego_median	0.0965848930420414
agent_compute-ego_min	0.09535973167419434
deviation-center-line_max	0.4061793754210388
deviation-center-line_mean	0.25189118162533297
deviation-center-line_min	0.15515493126262506
deviation-heading_max	2.647670858343001
deviation-heading_mean	1.1252774021173737
deviation-heading_median	0.6747565568469233
deviation-heading_min	0.5052265076591098
driven_any_max	3.2880508883115636
driven_any_mean	1.8578266103841456
driven_any_median	1.6706165070497003
driven_any_min	1.1319608299029815
driven_lanedir_consec_max	2.3342334664816917
driven_lanedir_consec_mean	1.2690510285465983
driven_lanedir_consec_min	0.6051744314078786
driven_lanedir_max	2.3342334664816917
driven_lanedir_mean	1.2899546004169025
driven_lanedir_median	1.2970674355257206
driven_lanedir_min	0.7096922907593997
in-drivable-lane_max	2.3499999999999934
in-drivable-lane_mean	1.389999999999996
in-drivable-lane_min	0.6999999999999975
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1319608299029815, "sim_physics": 0.05300341033935547, "survival_time": 6.249999999999986, "driven_lanedir": 0.7096922907593997, "sim_render-ego": 0.03633154296875, "in-drivable-lane": 2.3499999999999934, "agent_compute-ego": 0.09535973167419434, "deviation-heading": 2.647670858343001, "set_robot_commands": 0.054799161911010745, "deviation-center-line": 0.29980146209532654, "driven_lanedir_consec": 0.6051744314078786, "sim_compute_sim_state": 0.02317292022705078, "sim_compute_performance-ego": 0.03870099067687988, "sim_compute_robot_state-ego": 0.04071904563903809}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4527301541173807, "sim_physics": 0.05605689556367936, "survival_time": 3.099999999999997, "driven_lanedir": 0.7944486342774126, "sim_render-ego": 0.03648869452937957, "in-drivable-lane": 1.1, "agent_compute-ego": 0.0965848930420414, "deviation-heading": 0.6747565568469233, "set_robot_commands": 0.054535369719228434, "deviation-center-line": 0.15806592818483473, "driven_lanedir_consec": 0.7944486342774126, "sim_compute_sim_state": 0.02423794807926301, "sim_compute_performance-ego": 0.0385343567017586, "sim_compute_robot_state-ego": 0.04058572553819226}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2880508883115636, "sim_physics": 0.05646739267323115, "survival_time": 7.299999999999982, "driven_lanedir": 2.3342334664816917, "sim_render-ego": 0.036066349238565526, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0971947189879744, "deviation-heading": 1.2629759937588492, "set_robot_commands": 0.055597088108324026, "deviation-center-line": 0.4061793754210388, "driven_lanedir_consec": 2.3342334664816917, "sim_compute_sim_state": 0.023705583729156075, "sim_compute_performance-ego": 0.03895185744925721, "sim_compute_robot_state-ego": 0.040644637525898135}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6706165070497003, "sim_physics": 0.05653592906420744, "survival_time": 3.949999999999994, "driven_lanedir": 1.2970674355257206, "sim_render-ego": 0.03599302678168574, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.10040280486963972, "deviation-heading": 0.535757093978986, "set_robot_commands": 0.05501183980627905, "deviation-center-line": 0.24025421116283985, "driven_lanedir_consec": 1.2970674355257206, "sim_compute_sim_state": 0.023166505596305752, "sim_compute_performance-ego": 0.039199469964715496, "sim_compute_robot_state-ego": 0.04064590417886082}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.745774672539102, "sim_physics": 0.05590164661407471, "survival_time": 3.4999999999999956, "driven_lanedir": 1.3143311750402882, "sim_render-ego": 0.03624299253736223, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0955947058541434, "deviation-heading": 0.5052265076591098, "set_robot_commands": 0.05462308951786586, "deviation-center-line": 0.15515493126262506, "driven_lanedir_consec": 1.3143311750402882, "sim_compute_sim_state": 0.023116132191249306, "sim_compute_performance-ego": 0.03843733583177839, "sim_compute_robot_state-ego": 0.040599523271833145}}
set_robot_commands_max	0.055597088108324026
set_robot_commands_mean	0.054913309812541625
set_robot_commands_median	0.054799161911010745
set_robot_commands_min	0.054535369719228434
sim_compute_performance-ego_max	0.039199469964715496
sim_compute_performance-ego_mean	0.038764802124877915
sim_compute_performance-ego_median	0.03870099067687988
sim_compute_performance-ego_min	0.03843733583177839
sim_compute_robot_state-ego_max	0.04071904563903809
sim_compute_robot_state-ego_mean	0.04063896723076449
sim_compute_robot_state-ego_median	0.040644637525898135
sim_compute_robot_state-ego_min	0.04058572553819226
sim_compute_sim_state_max	0.02423794807926301
sim_compute_sim_state_mean	0.023479817964604983
sim_compute_sim_state_median	0.02317292022705078
sim_compute_sim_state_min	0.023116132191249306
sim_physics_max	0.05653592906420744
sim_physics_mean	0.055593054850909616
sim_physics_median	0.05605689556367936
sim_physics_min	0.05300341033935547
sim_render-ego_max	0.03648869452937957
sim_render-ego_mean	0.03622452121114862
sim_render-ego_median	0.03624299253736223
sim_render-ego_min	0.03599302678168574
simulation-passed	1
survival_time_max	7.299999999999982
survival_time_mean	4.819999999999991
survival_time_min	3.099999999999997

No reset possible

24015

3806

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-06-10 16:36:02+00:00

2019-06-10 16:39:48+00:00

0:03:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6855098869645495
survival_time_median	2.5999999999999988
deviation-center-line_median	0.12793042492891543
in-drivable-lane_median	1.0000000000000009

other stats

agent_compute-ego_max	0.0984562219575394
agent_compute-ego_mean	0.096470371236175
agent_compute-ego_median	0.09590721130371094
agent_compute-ego_min	0.09588342242770724
deviation-center-line_max	0.16679643269696504
deviation-center-line_mean	0.13737866514037766
deviation-center-line_min	0.12414245792704968
deviation-heading_max	0.6791831831911687
deviation-heading_mean	0.33884697450451134
deviation-heading_median	0.21409351211459093
deviation-heading_min	0.18215304654123532
driven_any_max	1.604140759595854
driven_any_mean	1.2096054895409938
driven_any_median	1.2668379264292713
driven_any_min	0.5682626539104457
driven_lanedir_consec_max	1.1193879233836466
driven_lanedir_consec_mean	0.7576280848276593
driven_lanedir_consec_min	0.5641809645311522
driven_lanedir_max	1.1193879233836466
driven_lanedir_mean	0.7576280848276593
driven_lanedir_median	0.6855098869645495
driven_lanedir_min	0.5641809645311522
in-drivable-lane_max	1.5499999999999945
in-drivable-lane_mean	0.859999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0137664315009025, "sim_physics": 0.05875971705414528, "survival_time": 2.1500000000000004, "driven_lanedir": 0.6855098869645495, "sim_render-ego": 0.0364763293155404, "in-drivable-lane": 0.5499999999999996, "agent_compute-ego": 0.0984562219575394, "deviation-heading": 0.2039272936686647, "set_robot_commands": 0.05511888237886651, "deviation-center-line": 0.12591626222493102, "driven_lanedir_consec": 0.6855098869645495, "sim_compute_sim_state": 0.02294494384943053, "sim_compute_performance-ego": 0.03841918568278468, "sim_compute_robot_state-ego": 0.040881467420001365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2668379264292713, "sim_physics": 0.055738549966078535, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6094197005359626, "sim_render-ego": 0.0383343008848337, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.09590721130371094, "deviation-heading": 0.6791831831911687, "set_robot_commands": 0.05498377176431509, "deviation-center-line": 0.12414245792704968, "driven_lanedir_consec": 0.6094197005359626, "sim_compute_sim_state": 0.02285874806917631, "sim_compute_performance-ego": 0.03857610317376944, "sim_compute_robot_state-ego": 0.04049638142952552}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5682626539104457, "sim_physics": 0.06095984246995714, "survival_time": 1.3500000000000003, "driven_lanedir": 0.5641809645311522, "sim_render-ego": 0.03600402231569643, "in-drivable-lane": 0, "agent_compute-ego": 0.09588342242770724, "deviation-heading": 0.18215304654123532, "set_robot_commands": 0.05470576992741338, "deviation-center-line": 0.14210774792402706, "driven_lanedir_consec": 0.5641809645311522, "sim_compute_sim_state": 0.023037071581240052, "sim_compute_performance-ego": 0.038295993098506224, "sim_compute_robot_state-ego": 0.04055567140932436}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.604140759595854, "sim_physics": 0.05493602237185916, "survival_time": 3.699999999999995, "driven_lanedir": 0.809641948722986, "sim_render-ego": 0.03844661648209031, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.09588521235697978, "deviation-heading": 0.414877837006897, "set_robot_commands": 0.05556973573323842, "deviation-center-line": 0.12793042492891543, "driven_lanedir_consec": 0.809641948722986, "sim_compute_sim_state": 0.023032265740471916, "sim_compute_performance-ego": 0.0385152681453808, "sim_compute_robot_state-ego": 0.04064293165464659}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5950196762684965, "sim_physics": 0.05641588023011113, "survival_time": 3.5499999999999954, "driven_lanedir": 1.1193879233836466, "sim_render-ego": 0.0362303592789341, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.09621978813493756, "deviation-heading": 0.21409351211459093, "set_robot_commands": 0.05563468664464816, "deviation-center-line": 0.16679643269696504, "driven_lanedir_consec": 1.1193879233836466, "sim_compute_sim_state": 0.023199262753338883, "sim_compute_performance-ego": 0.038837902982470016, "sim_compute_robot_state-ego": 0.0443235350326753}}
set_robot_commands_max	0.05563468664464816
set_robot_commands_mean	0.05520256928969631
set_robot_commands_median	0.05511888237886651
set_robot_commands_min	0.05470576992741338
sim_compute_performance-ego_max	0.038837902982470016
sim_compute_performance-ego_mean	0.03852889061658223
sim_compute_performance-ego_median	0.0385152681453808
sim_compute_performance-ego_min	0.038295993098506224
sim_compute_robot_state-ego_max	0.0443235350326753
sim_compute_robot_state-ego_mean	0.04137999738923463
sim_compute_robot_state-ego_median	0.04064293165464659
sim_compute_robot_state-ego_min	0.04049638142952552
sim_compute_sim_state_max	0.023199262753338883
sim_compute_sim_state_mean	0.023014458398731535
sim_compute_sim_state_median	0.023032265740471916
sim_compute_sim_state_min	0.02285874806917631
sim_physics_max	0.06095984246995714
sim_physics_mean	0.05736200241843024
sim_physics_median	0.05641588023011113
sim_physics_min	0.05493602237185916
sim_render-ego_max	0.03844661648209031
sim_render-ego_mean	0.037098325655418984
sim_render-ego_median	0.0364763293155404
sim_render-ego_min	0.03600402231569643
simulation-passed	1
survival_time_max	3.699999999999995
survival_time_mean	2.6699999999999977
survival_time_min	1.3500000000000003

No reset possible

23989

3788

Andrés Calderón 🇨🇴

challenge-aido_LF-template-random

step1-simulation

success

yes

2019-06-04 14:51:15+00:00

2019-06-04 14:59:12+00:00

0:07:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.14947347981589182
agent_compute-ego_mean	0.1363077549816327
agent_compute-ego_median	0.14229384209345847
agent_compute-ego_min	0.11264621714750926
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19407301914842823, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.060520986967448946, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1482754115816913, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09916533095927178, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03712070440944237, "sim_compute_performance-ego": 0.06775676449642906, "sim_compute_robot_state-ego": 0.07034035272236112, "sim_compute_robot_state-npc0": 0.06628528124169458, "sim_compute_robot_state-npc1": 0.06680799737761292, "sim_compute_robot_state-npc2": 0.06554390207121644, "sim_compute_robot_state-npc3": 0.06759585006327569}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2124412911278861, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06811869995934623, "in-drivable-lane": 0, "agent_compute-ego": 0.14947347981589182, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09324975524629864, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03833797999790737, "sim_compute_performance-ego": 0.07171557630811419, "sim_compute_robot_state-ego": 0.07972225121089391, "sim_compute_robot_state-npc0": 0.06490887914385114, "sim_compute_robot_state-npc1": 0.06500063623700823, "sim_compute_robot_state-npc2": 0.06676739454269409, "sim_compute_robot_state-npc3": 0.06743172236851283}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1817907939836817, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06045508847653287, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14229384209345847, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08312763519657468, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.035817465735870656, "sim_compute_performance-ego": 0.06313097129747705, "sim_compute_robot_state-ego": 0.06926587947363992, "sim_compute_robot_state-npc0": 0.06430929146924065, "sim_compute_robot_state-npc1": 0.06562385281312813, "sim_compute_robot_state-npc2": 0.06527653018247734, "sim_compute_robot_state-npc3": 0.06307925529850339}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.14384466409683228, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.046836654345194496, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11264621714750926, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07099344333012898, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.028764143586158752, "sim_compute_performance-ego": 0.05199195941289266, "sim_compute_robot_state-ego": 0.05249966184298197, "sim_compute_robot_state-npc0": 0.05060990651448568, "sim_compute_robot_state-npc1": 0.052147080500920616, "sim_compute_robot_state-npc2": 0.05272684494654337, "sim_compute_robot_state-npc3": 0.05006362497806549}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1341072264171782, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04733263878595261, "in-drivable-lane": 0, "agent_compute-ego": 0.12884982426961264, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.0733969665708996, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02747821807861328, "sim_compute_performance-ego": 0.054478656677972706, "sim_compute_robot_state-ego": 0.0495168822152274, "sim_compute_robot_state-npc0": 0.05257193247477213, "sim_compute_robot_state-npc1": 0.05250067937941778, "sim_compute_robot_state-npc2": 0.05608508700416202, "sim_compute_robot_state-npc3": 0.04951449802943638}}
set_robot_commands_max	0.09916533095927178
set_robot_commands_mean	0.08398662626063473
set_robot_commands_median	0.08312763519657468
set_robot_commands_min	0.07099344333012898
sim_compute_performance-ego_max	0.07171557630811419
sim_compute_performance-ego_mean	0.06181478563857713
sim_compute_performance-ego_median	0.06313097129747705
sim_compute_performance-ego_min	0.05199195941289266
sim_compute_robot_state-ego_max	0.07972225121089391
sim_compute_robot_state-ego_mean	0.06426900549302086
sim_compute_robot_state-ego_median	0.06926587947363992
sim_compute_robot_state-ego_min	0.0495168822152274
sim_compute_robot_state-npc0_max	0.06628528124169458
sim_compute_robot_state-npc0_mean	0.05973705816880883
sim_compute_robot_state-npc0_median	0.06430929146924065
sim_compute_robot_state-npc0_min	0.05060990651448568
sim_compute_robot_state-npc1_max	0.06680799737761292
sim_compute_robot_state-npc1_mean	0.06041604926161753
sim_compute_robot_state-npc1_median	0.06500063623700823
sim_compute_robot_state-npc1_min	0.052147080500920616
sim_compute_robot_state-npc2_max	0.06676739454269409
sim_compute_robot_state-npc2_mean	0.06127995174941866
sim_compute_robot_state-npc2_median	0.06527653018247734
sim_compute_robot_state-npc2_min	0.05272684494654337
sim_compute_robot_state-npc3_max	0.06759585006327569
sim_compute_robot_state-npc3_mean	0.059536990147558755
sim_compute_robot_state-npc3_median	0.06307925529850339
sim_compute_robot_state-npc3_min	0.04951449802943638
sim_compute_sim_state_max	0.03833797999790737
sim_compute_sim_state_mean	0.033503702361598484
sim_compute_sim_state_median	0.035817465735870656
sim_compute_sim_state_min	0.02747821807861328
sim_physics_max	0.2124412911278861
sim_physics_mean	0.1732513989548013
sim_physics_median	0.1817907939836817
sim_physics_min	0.1341072264171782
sim_render-ego_max	0.06811869995934623
sim_render-ego_mean	0.056652813706895025
sim_render-ego_median	0.06045508847653287
sim_render-ego_min	0.046836654345194496
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

23749

3762

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

error

yes

2019-05-21 20:21:57+00:00

2019-05-21 21:01:33+00:00

0:39:36

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23736

3747

sebastian glatz

step1-simulation

success

yes

2019-05-21 20:01:48+00:00

2019-05-21 20:06:03+00:00

0:04:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.12199536491842831
agent_compute-ego_mean	0.11335889166846198
agent_compute-ego_median	0.11389463036148637
agent_compute-ego_min	0.10476522352181228
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05849235146133988, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04956727999228018, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11389463036148637, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05561636553870307, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.023923617822152597, "sim_compute_performance-ego": 0.0403083430396186, "sim_compute_robot_state-ego": 0.04170925970430727}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.07938395294488645, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04314203823313994, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10476522352181228, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.06453849755081476, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.028622996573354684, "sim_compute_performance-ego": 0.047435671675438974, "sim_compute_robot_state-ego": 0.05377449241338992}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0802910888896269, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.04947386068456313, "in-drivable-lane": 0, "agent_compute-ego": 0.12199536491842831, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0760809954474954, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.028622991898480585, "sim_compute_performance-ego": 0.05031184589161592, "sim_compute_robot_state-ego": 0.05045732329873478}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07461433410644532, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04038871765136719, "in-drivable-lane": 0, "agent_compute-ego": 0.10781005859375, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.06237324714660644, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.02543781280517578, "sim_compute_performance-ego": 0.04478235244750976, "sim_compute_robot_state-ego": 0.04548724174499512}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.07276426387738578, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.04550890681109851, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.11832918094683297, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0712078311775304, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02830149553999116, "sim_compute_performance-ego": 0.04868088492864295, "sim_compute_robot_state-ego": 0.05106089990350265}}
set_robot_commands_max	0.0760809954474954
set_robot_commands_mean	0.06596338737223002
set_robot_commands_median	0.06453849755081476
set_robot_commands_min	0.05561636553870307
sim_compute_performance-ego_max	0.05031184589161592
sim_compute_performance-ego_mean	0.04630381959656524
sim_compute_performance-ego_median	0.047435671675438974
sim_compute_performance-ego_min	0.0403083430396186
sim_compute_robot_state-ego_max	0.05377449241338992
sim_compute_robot_state-ego_mean	0.04849784341298595
sim_compute_robot_state-ego_median	0.05045732329873478
sim_compute_robot_state-ego_min	0.04170925970430727
sim_compute_sim_state_max	0.028622996573354684
sim_compute_sim_state_mean	0.02698178292783096
sim_compute_sim_state_median	0.02830149553999116
sim_compute_sim_state_min	0.023923617822152597
sim_physics_max	0.0802910888896269
sim_physics_mean	0.07310919825593686
sim_physics_median	0.07461433410644532
sim_physics_min	0.05849235146133988
sim_render-ego_max	0.04956727999228018
sim_render-ego_mean	0.045616160674489786
sim_render-ego_median	0.04550890681109851
sim_render-ego_min	0.04038871765136719
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

23720

3744

Anastasiya Nikolskaya 🇷🇺

colcnt fix

step1-simulation

success

yes

2019-05-21 17:31:15+00:00

2019-05-21 17:43:50+00:00

0:12:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9705669376900432
survival_time_median	14.950000000000076
deviation-center-line_median	0.7422340304530037
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.052840578556060794
agent_compute-ego_mean	0.05209226701167692
agent_compute-ego_median	0.05201107347515267
agent_compute-ego_min	0.05160330040286286
deviation-center-line_max	1.2082307329342523
deviation-center-line_mean	0.7139712903877511
deviation-center-line_min	0.2976033703881105
deviation-heading_max	2.9019980388351496
deviation-heading_mean	2.055183686097723
deviation-heading_median	2.5826051961665573
deviation-heading_min	0.4783500635159773
driven_any_max	2.081962678438535
driven_any_mean	1.4615878586790547
driven_any_median	2.046539141116722
driven_any_min	0.4601374492136299
driven_lanedir_consec_max	2.0148048229342077
driven_lanedir_consec_mean	1.4072865603571754
driven_lanedir_consec_min	0.4546187992944528
driven_lanedir_max	2.0148048229342077
driven_lanedir_mean	1.4072865603571754
driven_lanedir_median	1.9705669376900432
driven_lanedir_min	0.4546187992944528
in-drivable-lane_max	0.09999999999999964
in-drivable-lane_mean	0.019999999999999928
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.046539141116722, "sim_physics": 0.07620734691619874, "survival_time": 14.950000000000076, "driven_lanedir": 1.9705669376900432, "sim_render-ego": 0.03715049187342326, "in-drivable-lane": 0, "agent_compute-ego": 0.05169507503509521, "deviation-heading": 2.5826051961665573, "set_robot_commands": 0.06983069737752279, "deviation-center-line": 1.2082307329342523, "driven_lanedir_consec": 1.9705669376900432, "sim_compute_sim_state": 0.028919689655303955, "sim_compute_performance-ego": 0.04263082106908162, "sim_compute_robot_state-ego": 0.04909709771474202}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6517876053649976, "sim_physics": 0.06956413779595885, "survival_time": 4.94999999999999, "driven_lanedir": 0.5863186782911962, "sim_render-ego": 0.036590648419929275, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.05160330040286286, "deviation-heading": 1.5432802419840048, "set_robot_commands": 0.06694418974597045, "deviation-center-line": 0.2976033703881105, "driven_lanedir_consec": 0.5863186782911962, "sim_compute_sim_state": 0.02893591890431414, "sim_compute_performance-ego": 0.04280408945950595, "sim_compute_robot_state-ego": 0.04876386035572399}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4601374492136299, "sim_physics": 0.07476299917194205, "survival_time": 3.5499999999999954, "driven_lanedir": 0.4546187992944528, "sim_render-ego": 0.03668399595878494, "in-drivable-lane": 0, "agent_compute-ego": 0.05201107347515267, "deviation-heading": 0.4783500635159773, "set_robot_commands": 0.0682686684836804, "deviation-center-line": 0.3215696732608136, "driven_lanedir_consec": 0.4546187992944528, "sim_compute_sim_state": 0.027644476420442824, "sim_compute_performance-ego": 0.04014250594125667, "sim_compute_robot_state-ego": 0.04766347710515412}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0675124192613885, "sim_physics": 0.0773093072573344, "survival_time": 14.950000000000076, "driven_lanedir": 2.010123563575976, "sim_render-ego": 0.0363422171274821, "in-drivable-lane": 0, "agent_compute-ego": 0.052311307589213055, "deviation-heading": 2.769684889986926, "set_robot_commands": 0.0689547069867452, "deviation-center-line": 1.0002186449025752, "driven_lanedir_consec": 2.010123563575976, "sim_compute_sim_state": 0.0297066330909729, "sim_compute_performance-ego": 0.042552579243977866, "sim_compute_robot_state-ego": 0.05000249306360881}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.081962678438535, "sim_physics": 0.07434181213378906, "survival_time": 14.950000000000076, "driven_lanedir": 2.0148048229342077, "sim_render-ego": 0.036698753833770754, "in-drivable-lane": 0, "agent_compute-ego": 0.052840578556060794, "deviation-heading": 2.9019980388351496, "set_robot_commands": 0.06718560616175334, "deviation-center-line": 0.7422340304530037, "driven_lanedir_consec": 2.0148048229342077, "sim_compute_sim_state": 0.02859974861145019, "sim_compute_performance-ego": 0.0429000186920166, "sim_compute_robot_state-ego": 0.04926316102345785}}
set_robot_commands_max	0.06983069737752279
set_robot_commands_mean	0.06823677375113443
set_robot_commands_median	0.0682686684836804
set_robot_commands_min	0.06694418974597045
sim_compute_performance-ego_max	0.0429000186920166
sim_compute_performance-ego_mean	0.04220600288116774
sim_compute_performance-ego_median	0.04263082106908162
sim_compute_performance-ego_min	0.04014250594125667
sim_compute_robot_state-ego_max	0.05000249306360881
sim_compute_robot_state-ego_mean	0.04895801785253736
sim_compute_robot_state-ego_median	0.04909709771474202
sim_compute_robot_state-ego_min	0.04766347710515412
sim_compute_sim_state_max	0.0297066330909729
sim_compute_sim_state_mean	0.028761293336496803
sim_compute_sim_state_median	0.028919689655303955
sim_compute_sim_state_min	0.027644476420442824
sim_physics_max	0.0773093072573344
sim_physics_mean	0.07443712065504461
sim_physics_median	0.07476299917194205
sim_physics_min	0.06956413779595885
sim_render-ego_max	0.03715049187342326
sim_render-ego_mean	0.036693221442678066
sim_render-ego_median	0.03668399595878494
sim_render-ego_min	0.0363422171274821
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.670000000000044
survival_time_min	3.5499999999999954

No reset possible

23713

3738

LF sim test - wh

step1-simulation

error

yes

2019-05-21 16:43:59+00:00

2019-05-21 17:01:38+00:00

0:17:39

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23708

3733

Second test -RGB- TH-jp

step1-simulation

error

yes

2019-05-21 16:12:01+00:00

2019-05-21 16:14:12+00:00

0:02:11

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23685

3724

Second test -RGB- TH-jp

step1-simulation

success

yes

2019-05-21 15:12:49+00:00

2019-05-21 15:44:31+00:00

0:31:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.709012048590294
survival_time_median	14.950000000000076
deviation-center-line_median	0.38447320334523055
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.0996611918846186
agent_compute-ego_mean	0.09810469418239014
agent_compute-ego_median	0.0980234138170878
agent_compute-ego_min	0.09696349541346232
deviation-center-line_max	1.438868052751231
deviation-center-line_mean	0.48208775053432856
deviation-center-line_min	0.0617584420153499
deviation-heading_max	5.564545696826533
deviation-heading_mean	2.359945341123894
deviation-heading_median	1.5742087652078072
deviation-heading_min	0.2871123077880753
driven_any_max	2.136133509270581
driven_any_mean	0.7241300030505512
driven_any_median	0.754356812754684
driven_any_min	0.01207028324337977
driven_lanedir_consec_max	2.0900359741350343
driven_lanedir_consec_mean	0.6788604458460102
driven_lanedir_consec_min	0.011972988324831402
driven_lanedir_max	2.0900359741350343
driven_lanedir_mean	0.6788604458460102
driven_lanedir_median	0.709012048590294
driven_lanedir_min	0.011972988324831402
in-drivable-lane_max	3.7000000000000526
in-drivable-lane_mean	0.3833333333333363
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0126610440005843, "sim_physics": 0.05420453638970098, "survival_time": 3.949999999999994, "driven_lanedir": 0.6609181258806545, "sim_render-ego": 0.03471648240391212, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0976023100599458, "deviation-heading": 0.858940841687016, "set_robot_commands": 0.05373997929729993, "deviation-center-line": 0.13529134746320506, "driven_lanedir_consec": 0.6609181258806545, "sim_compute_sim_state": 0.022649535649939427, "sim_compute_performance-ego": 0.03844546064545837, "sim_compute_robot_state-ego": 0.040026024927066854}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7595522424314712, "sim_physics": 0.05649709065755208, "survival_time": 14.950000000000076, "driven_lanedir": 0.7352279124260795, "sim_render-ego": 0.035350757439931234, "in-drivable-lane": 0, "agent_compute-ego": 0.0980234138170878, "deviation-heading": 4.795891064811469, "set_robot_commands": 0.05499387820561727, "deviation-center-line": 0.360545942209073, "driven_lanedir_consec": 0.7352279124260795, "sim_compute_sim_state": 0.023203980922698975, "sim_compute_performance-ego": 0.038593909740448, "sim_compute_robot_state-ego": 0.03988143603006999}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9535561139978752, "sim_physics": 0.05531730810801188, "survival_time": 14.950000000000076, "driven_lanedir": 0.9462743954342976, "sim_render-ego": 0.03514857848485311, "in-drivable-lane": 0, "agent_compute-ego": 0.09724403381347656, "deviation-heading": 1.812369823698207, "set_robot_commands": 0.05373850822448731, "deviation-center-line": 0.27508255291473815, "driven_lanedir_consec": 0.9462743954342976, "sim_compute_sim_state": 0.022386131286621095, "sim_compute_performance-ego": 0.0378109057744344, "sim_compute_robot_state-ego": 0.040115397771199546}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9792418325527504, "sim_physics": 0.05794432878494263, "survival_time": 14.950000000000076, "driven_lanedir": 0.9743230583614304, "sim_render-ego": 0.03464421351750692, "in-drivable-lane": 0, "agent_compute-ego": 0.09696349541346232, "deviation-heading": 5.564545696826533, "set_robot_commands": 0.05381812175114949, "deviation-center-line": 0.5179984751883532, "driven_lanedir_consec": 0.9743230583614304, "sim_compute_sim_state": 0.022425337632497152, "sim_compute_performance-ego": 0.03873747825622559, "sim_compute_robot_state-ego": 0.03999961455663045}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.754356812754684, "sim_physics": 0.05876517375310262, "survival_time": 14.950000000000076, "driven_lanedir": 0.7468731885941198, "sim_render-ego": 0.03517238696416219, "in-drivable-lane": 0, "agent_compute-ego": 0.09744280894597372, "deviation-heading": 5.256343632028708, "set_robot_commands": 0.05396216948827108, "deviation-center-line": 0.38447320334523055, "driven_lanedir_consec": 0.7468731885941198, "sim_compute_sim_state": 0.022570263544718423, "sim_compute_performance-ego": 0.03904949982961019, "sim_compute_robot_state-ego": 0.03985714276631673}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0129391163110788, "sim_physics": 0.055006386131368656, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8692143577854579, "sim_render-ego": 0.03456300048417942, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09755104331560031, "deviation-heading": 1.002728981635512, "set_robot_commands": 0.053575708020117976, "deviation-center-line": 0.24064776928315793, "driven_lanedir_consec": 0.8692143577854579, "sim_compute_sim_state": 0.02249879990854571, "sim_compute_performance-ego": 0.0401685494248585, "sim_compute_robot_state-ego": 0.03994862751294208}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.06203930329353196, "sim_physics": 0.05754446268081665, "survival_time": 14.950000000000076, "driven_lanedir": 0.061569482784165075, "sim_render-ego": 0.03534478743871053, "in-drivable-lane": 0, "agent_compute-ego": 0.09858973026275634, "deviation-heading": 1.645525881043571, "set_robot_commands": 0.054133090972900394, "deviation-center-line": 0.7779901747567166, "driven_lanedir_consec": 0.061569482784165075, "sim_compute_sim_state": 0.02257569392522176, "sim_compute_performance-ego": 0.039389306704203285, "sim_compute_robot_state-ego": 0.040039972464243574}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.15136862047452393, "sim_physics": 0.05534584023231684, "survival_time": 2.1500000000000004, "driven_lanedir": 0.09773519546862808, "sim_render-ego": 0.0343180867128594, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.09841010736864668, "deviation-heading": 0.8050995867641144, "set_robot_commands": 0.05409701480421909, "deviation-center-line": 0.13271573895151803, "driven_lanedir_consec": 0.09773519546862808, "sim_compute_sim_state": 0.02252128512360329, "sim_compute_performance-ego": 0.03775852225547613, "sim_compute_robot_state-ego": 0.039420116779416106}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.39366644863819766, "sim_physics": 0.057451059420903526, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3769299980029403, "sim_render-ego": 0.034979045391082764, "in-drivable-lane": 0, "agent_compute-ego": 0.09956639011700948, "deviation-heading": 0.2871123077880753, "set_robot_commands": 0.05402557055155436, "deviation-center-line": 0.0617584420153499, "driven_lanedir_consec": 0.3769299980029403, "sim_compute_sim_state": 0.022832214832305908, "sim_compute_performance-ego": 0.03849690159161886, "sim_compute_robot_state-ego": 0.03986928860346476}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.01207028324337977, "sim_physics": 0.056538570721944174, "survival_time": 14.950000000000076, "driven_lanedir": 0.011972988324831402, "sim_render-ego": 0.035556633472442624, "in-drivable-lane": 0, "agent_compute-ego": 0.09887064536412556, "deviation-heading": 1.5742087652078072, "set_robot_commands": 0.054431983629862464, "deviation-center-line": 0.5186473247667536, "driven_lanedir_consec": 0.011972988324831402, "sim_compute_sim_state": 0.022678641478220626, "sim_compute_performance-ego": 0.03810760656992594, "sim_compute_robot_state-ego": 0.04011669635772705}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7184318050350545, "sim_physics": 0.054263792037963866, "survival_time": 14.950000000000076, "driven_lanedir": 0.709012048590294, "sim_render-ego": 0.035081058343251544, "in-drivable-lane": 0, "agent_compute-ego": 0.09806182702382406, "deviation-heading": 1.349317653307769, "set_robot_commands": 0.05443323055903117, "deviation-center-line": 1.438868052751231, "driven_lanedir_consec": 0.709012048590294, "sim_compute_sim_state": 0.02238067626953125, "sim_compute_performance-ego": 0.03780695676803589, "sim_compute_robot_state-ego": 0.03987501303354899}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.18588476350540203, "sim_physics": 0.05472529967625936, "survival_time": 14.950000000000076, "driven_lanedir": 0.17552793266900713, "sim_render-ego": 0.03484431743621826, "in-drivable-lane": 3.7000000000000526, "agent_compute-ego": 0.09733277161916096, "deviation-heading": 4.3552318393211715, "set_robot_commands": 0.053373096783955895, "deviation-center-line": 0.34688256652617033, "driven_lanedir_consec": 0.17552793266900713, "sim_compute_sim_state": 0.02230413834253947, "sim_compute_performance-ego": 0.03769482692082723, "sim_compute_robot_state-ego": 0.03941885550816854}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.0626005991626111, "sim_physics": 0.05314427693684896, "survival_time": 14.950000000000076, "driven_lanedir": 0.06235658463734717, "sim_render-ego": 0.035106648604075114, "in-drivable-lane": 0, "agent_compute-ego": 0.09825180530548096, "deviation-heading": 1.4015827358155828, "set_robot_commands": 0.05376312096913655, "deviation-center-line": 0.7257497630175758, "driven_lanedir_consec": 0.06235658463734717, "sim_compute_sim_state": 0.022611144383748373, "sim_compute_performance-ego": 0.038234810034434, "sim_compute_robot_state-ego": 0.03958297888437907}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.136133509270581, "sim_physics": 0.052472587919583286, "survival_time": 6.849999999999984, "driven_lanedir": 2.0900359741350343, "sim_render-ego": 0.034677773496530354, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.0996611918846186, "deviation-heading": 1.1788561841133236, "set_robot_commands": 0.053573258601836045, "deviation-center-line": 0.38841158383151136, "driven_lanedir_consec": 2.0900359741350343, "sim_compute_sim_state": 0.022490000202708, "sim_compute_performance-ego": 0.0378209657042566, "sim_compute_robot_state-ego": 0.039261551669044215}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.6674475510865443, "sim_physics": 0.054576791922251386, "survival_time": 14.950000000000076, "driven_lanedir": 1.6649354445958648, "sim_render-ego": 0.035544300079345705, "in-drivable-lane": 0, "agent_compute-ego": 0.0979988384246826, "deviation-heading": 3.5114251228095523, "set_robot_commands": 0.05351172129313151, "deviation-center-line": 0.9262533209943434, "driven_lanedir_consec": 1.6649354445958648, "sim_compute_sim_state": 0.022145510514577228, "sim_compute_performance-ego": 0.03733561833699544, "sim_compute_robot_state-ego": 0.039485049247741696}}
set_robot_commands_max	0.05499387820561727
set_robot_commands_mean	0.05394469687683804
set_robot_commands_median	0.05381812175114949
set_robot_commands_min	0.053373096783955895
sim_compute_performance-ego_max	0.0401685494248585
sim_compute_performance-ego_mean	0.03836342123712056
sim_compute_performance-ego_median	0.038234810034434
sim_compute_performance-ego_min	0.03733561833699544
sim_compute_robot_state-ego_max	0.04011669635772705
sim_compute_robot_state-ego_mean	0.039793184407463975
sim_compute_robot_state-ego_median	0.03987501303354899
sim_compute_robot_state-ego_min	0.039261551669044215
sim_compute_sim_state_max	0.023203980922698975
sim_compute_sim_state_mean	0.022551556934498448
sim_compute_sim_state_median	0.02252128512360329
sim_compute_sim_state_min	0.022145510514577228
sim_physics_max	0.05876517375310262
sim_physics_mean	0.05558650035823779
sim_physics_median	0.05531730810801188
sim_physics_min	0.052472587919583286
sim_render-ego_max	0.035556633472442624
sim_render-ego_mean	0.035003204684604085
sim_render-ego_median	0.035081058343251544
sim_render-ego_min	0.0343180867128594
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.22000000000005
survival_time_min	1.2000000000000004

No reset possible

23682

3720

final test2 - wh

step1-simulation

failed

yes

2019-05-21 15:08:19+00:00

2019-05-21 15:10:57+00:00

0:02:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 60, in on_received_get_commands
               ||     action = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     if action[0]<1e-2:
               || UnboundLocalError: local variable 'action' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23672

3717

Second test -RGB- TH-jp

step1-simulation

failed

yes

2019-05-21 14:44:10+00:00

2019-05-21 14:47:25+00:00

0:03:15

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23620

3710

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-05-21 04:18:34+00:00

2019-05-21 05:00:15+00:00

0:41:41

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23617

3705

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-05-21 02:09:51+00:00

2019-05-21 03:00:56+00:00

0:51:05

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23590

3692

Manfred Diaz

challenge-aido_LF-template-tensorflow

step1-simulation

success

yes

2019-05-20 20:44:11+00:00

2019-05-20 20:56:09+00:00

0:11:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6514023258687487
survival_time_median	4.449999999999992
deviation-center-line_median	0.23739122357818904
in-drivable-lane_median	0.849999999999997

other stats

agent_compute-ego_max	0.14946525361802843
agent_compute-ego_mean	0.14370166347578034
agent_compute-ego_median	0.14363891463125905
agent_compute-ego_min	0.13956740379333496
deviation-center-line_max	0.5170746666829398
deviation-center-line_mean	0.286490123346237
deviation-center-line_min	0.11858883250573632
deviation-heading_max	2.8602914150984016
deviation-heading_mean	1.7467146270959322
deviation-heading_median	1.883489448082707
deviation-heading_min	0.7774267019988155
driven_any_max	1.806170835824281
driven_any_mean	1.0870136375050108
driven_any_median	1.098380589429692
driven_any_min	0.5292009749888434
driven_lanedir_consec_max	1.342369046619216
driven_lanedir_consec_mean	0.7701808073457285
driven_lanedir_consec_min	0.42382714508842456
driven_lanedir_max	1.342369046619216
driven_lanedir_mean	0.7701808073457285
driven_lanedir_median	0.6514023258687487
driven_lanedir_min	0.42382714508842456
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.6399999999999977
in-drivable-lane_min	0.09999999999999964
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5292009749888434, "sim_physics": 0.1206768936581082, "survival_time": 2.25, "driven_lanedir": 0.42382714508842456, "sim_render-ego": 0.06719823413425022, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.14946525361802843, "deviation-heading": 0.7774267019988155, "set_robot_commands": 0.09415511025322808, "deviation-center-line": 0.14559773692031788, "driven_lanedir_consec": 0.42382714508842456, "sim_compute_sim_state": 0.038673920101589626, "sim_compute_performance-ego": 0.06957403288947211, "sim_compute_robot_state-ego": 0.0786970615386963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.098380589429692, "sim_physics": 0.10529749580983364, "survival_time": 4.449999999999992, "driven_lanedir": 0.6514023258687487, "sim_render-ego": 0.05653299374526806, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14373021715142753, "deviation-heading": 1.883489448082707, "set_robot_commands": 0.09079486868354712, "deviation-center-line": 0.23739122357818904, "driven_lanedir_consec": 0.6514023258687487, "sim_compute_sim_state": 0.03746234165148789, "sim_compute_performance-ego": 0.06657439671205671, "sim_compute_robot_state-ego": 0.0706902246796683}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.806170835824281, "sim_physics": 0.1079913126368101, "survival_time": 7.349999999999982, "driven_lanedir": 1.342369046619216, "sim_render-ego": 0.060333362241991526, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.1421065281848518, "deviation-heading": 2.8602914150984016, "set_robot_commands": 0.1044308701340033, "deviation-center-line": 0.5170746666829398, "driven_lanedir_consec": 1.342369046619216, "sim_compute_sim_state": 0.03852646042700528, "sim_compute_performance-ego": 0.06795510629407403, "sim_compute_robot_state-ego": 0.07096199437874515}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1615700603052233, "sim_physics": 0.1115765380859375, "survival_time": 4.99999999999999, "driven_lanedir": 0.9798601952252768, "sim_render-ego": 0.06322489500045776, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13956740379333496, "deviation-heading": 2.2145663289769866, "set_robot_commands": 0.08822371244430542, "deviation-center-line": 0.4137981570440021, "driven_lanedir_consec": 0.9798601952252768, "sim_compute_sim_state": 0.03742807388305664, "sim_compute_performance-ego": 0.06537937641143798, "sim_compute_robot_state-ego": 0.06835029125213624}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8397457269770152, "sim_physics": 0.1080409942134734, "survival_time": 3.099999999999997, "driven_lanedir": 0.45344532392697623, "sim_render-ego": 0.05873402472465269, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14363891463125905, "deviation-heading": 0.9977992413227512, "set_robot_commands": 0.09034750538487588, "deviation-center-line": 0.11858883250573632, "driven_lanedir_consec": 0.45344532392697623, "sim_compute_sim_state": 0.03952567038997527, "sim_compute_performance-ego": 0.06798774965347783, "sim_compute_robot_state-ego": 0.0664678196753225}}
set_robot_commands_max	0.1044308701340033
set_robot_commands_mean	0.09359041337999197
set_robot_commands_median	0.09079486868354712
set_robot_commands_min	0.08822371244430542
sim_compute_performance-ego_max	0.06957403288947211
sim_compute_performance-ego_mean	0.06749413239210374
sim_compute_performance-ego_median	0.06795510629407403
sim_compute_performance-ego_min	0.06537937641143798
sim_compute_robot_state-ego_max	0.0786970615386963
sim_compute_robot_state-ego_mean	0.0710334783049137
sim_compute_robot_state-ego_median	0.0706902246796683
sim_compute_robot_state-ego_min	0.0664678196753225
sim_compute_sim_state_max	0.03952567038997527
sim_compute_sim_state_mean	0.03832329329062294
sim_compute_sim_state_median	0.03852646042700528
sim_compute_sim_state_min	0.03742807388305664
sim_physics_max	0.1206768936581082
sim_physics_mean	0.11071664688083258
sim_physics_median	0.1080409942134734
sim_physics_min	0.10529749580983364
sim_render-ego_max	0.06719823413425022
sim_render-ego_mean	0.06120470196932405
sim_render-ego_median	0.060333362241991526
sim_render-ego_min	0.05653299374526806
simulation-passed	1
survival_time_max	7.349999999999982
survival_time_mean	4.429999999999993
survival_time_min	2.25

No reset possible

23462

3652

FANG MEIYI 🇸🇬

test

step1-simulation

error

yes

2019-05-20 03:20:20+00:00

2019-05-20 04:00:16+00:00

0:39:56

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23455

3649

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

step1-simulation

error

yes

2019-05-20 02:54:37+00:00

2019-05-20 03:00:25+00:00

0:05:48

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23408

3638

Angel Woo 🇭🇰

HKDUCK

step1-simulation

success

yes

2019-05-19 21:16:22+00:00

2019-05-19 21:28:36+00:00

0:12:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3985434806544852
survival_time_median	8.999999999999993
deviation-center-line_median	0.4195350258812748
in-drivable-lane_median	3.3999999999999906

other stats

agent_compute-ego_max	0.19601535229455855
agent_compute-ego_mean	0.18925902155089003
agent_compute-ego_median	0.18951765537261964
agent_compute-ego_min	0.18307086096869576
deviation-center-line_max	0.7391797512240016
deviation-center-line_mean	0.4218625236504649
deviation-center-line_min	0.2125450582078782
deviation-heading_max	4.112199519161604
deviation-heading_mean	1.5034026457446608
deviation-heading_median	0.8501527311300738
deviation-heading_min	0.548078208681167
driven_any_max	1.5491560058468408
driven_any_mean	0.8296669819222954
driven_any_median	1.00574171915957
driven_any_min	0.22605035291042525
driven_lanedir_consec_max	0.6196900440864868
driven_lanedir_consec_mean	0.3797273266028719
driven_lanedir_consec_min	0.217880906877971
driven_lanedir_max	0.6196900440864868
driven_lanedir_mean	0.3797273266028719
driven_lanedir_median	0.3985434806544852
driven_lanedir_min	0.217880906877971
in-drivable-lane_max	10.950000000000085
in-drivable-lane_mean	3.830000000000015
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.00574171915957, "sim_physics": 0.05352273252275255, "survival_time": 8.999999999999993, "driven_lanedir": 0.4085994677356664, "sim_render-ego": 0.036618582407633465, "in-drivable-lane": 4.8, "agent_compute-ego": 0.18307086096869576, "deviation-heading": 0.6410804492719147, "set_robot_commands": 0.054311830467647974, "deviation-center-line": 0.5196983327237378, "driven_lanedir_consec": 0.4085994677356664, "sim_compute_sim_state": 0.023450280560387504, "sim_compute_performance-ego": 0.03950999975204468, "sim_compute_robot_state-ego": 0.04130300283432007}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0751999436658484, "sim_physics": 0.05734101563942533, "survival_time": 11.900000000000034, "driven_lanedir": 0.6196900440864868, "sim_render-ego": 0.03815067114950228, "in-drivable-lane": 3.3999999999999906, "agent_compute-ego": 0.1844912256513323, "deviation-heading": 4.112199519161604, "set_robot_commands": 0.05450275966099331, "deviation-center-line": 0.7391797512240016, "driven_lanedir_consec": 0.6196900440864868, "sim_compute_sim_state": 0.023438489737630897, "sim_compute_performance-ego": 0.03898641241698706, "sim_compute_robot_state-ego": 0.04115447176604712}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22605035291042525, "sim_physics": 0.056062868663242886, "survival_time": 2.1000000000000005, "driven_lanedir": 0.217880906877971, "sim_render-ego": 0.03547638370877221, "in-drivable-lane": 0, "agent_compute-ego": 0.19601535229455855, "deviation-heading": 0.548078208681167, "set_robot_commands": 0.05333755697522845, "deviation-center-line": 0.21835445021543207, "driven_lanedir_consec": 0.217880906877971, "sim_compute_sim_state": 0.023101710137866792, "sim_compute_performance-ego": 0.03867136864435105, "sim_compute_robot_state-ego": 0.0407523995354062}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.29218688802879217, "sim_physics": 0.05828401020595005, "survival_time": 2.799999999999998, "driven_lanedir": 0.2539227336597505, "sim_render-ego": 0.036623703581946235, "in-drivable-lane": 0, "agent_compute-ego": 0.19320001346724375, "deviation-heading": 1.3655023204785444, "set_robot_commands": 0.054644682577678134, "deviation-center-line": 0.2125450582078782, "driven_lanedir_consec": 0.2539227336597505, "sim_compute_sim_state": 0.02348941990307399, "sim_compute_performance-ego": 0.03930684072630746, "sim_compute_robot_state-ego": 0.04065151725496565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5491560058468408, "sim_physics": 0.057543240388234454, "survival_time": 14.950000000000076, "driven_lanedir": 0.3985434806544852, "sim_render-ego": 0.03616609970728557, "in-drivable-lane": 10.950000000000085, "agent_compute-ego": 0.18951765537261964, "deviation-heading": 0.8501527311300738, "set_robot_commands": 0.05370533227920532, "deviation-center-line": 0.4195350258812748, "driven_lanedir_consec": 0.3985434806544852, "sim_compute_sim_state": 0.023257683118184408, "sim_compute_performance-ego": 0.03863510926564535, "sim_compute_robot_state-ego": 0.04151976744333903}}
set_robot_commands_max	0.054644682577678134
set_robot_commands_mean	0.054100432392150635
set_robot_commands_median	0.054311830467647974
set_robot_commands_min	0.05333755697522845
sim_compute_performance-ego_max	0.03950999975204468
sim_compute_performance-ego_mean	0.03902194616106712
sim_compute_performance-ego_median	0.03898641241698706
sim_compute_performance-ego_min	0.03863510926564535
sim_compute_robot_state-ego_max	0.04151976744333903
sim_compute_robot_state-ego_mean	0.04107623176681561
sim_compute_robot_state-ego_median	0.04115447176604712
sim_compute_robot_state-ego_min	0.04065151725496565
sim_compute_sim_state_max	0.02348941990307399
sim_compute_sim_state_mean	0.023347516691428715
sim_compute_sim_state_median	0.023438489737630897
sim_compute_sim_state_min	0.023101710137866792
sim_physics_max	0.05828401020595005
sim_physics_mean	0.056550773483921055
sim_physics_median	0.05734101563942533
sim_physics_min	0.05352273252275255
sim_render-ego_max	0.03815067114950228
sim_render-ego_mean	0.036607088111027954
sim_render-ego_median	0.036618582407633465
sim_render-ego_min	0.03547638370877221
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.15000000000002
survival_time_min	2.1000000000000005

No reset possible

23401

3634

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

yes

2019-05-19 19:18:56+00:00

2019-05-19 19:34:07+00:00

0:15:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2932968863301235
survival_time_median	12.000000000000036
deviation-center-line_median	0.5428480558509712
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14416495561599732
agent_compute-ego_mean	0.14213884926394943
agent_compute-ego_median	0.14128753070917605
agent_compute-ego_min	0.14045836687088012
deviation-center-line_max	1.2545102713230998
deviation-center-line_mean	0.622210109555386
deviation-center-line_min	0.28009223675992184
deviation-heading_max	1.8536757404464157
deviation-heading_mean	1.5817646483482783
deviation-heading_median	1.7334473101384278
deviation-heading_min	1.2491895377385989
driven_any_max	1.6803424467176225
driven_any_mean	1.3016697591247863
driven_any_median	1.356331216069872
driven_any_min	1.0019717789023883
driven_lanedir_consec_max	1.671543605018729
driven_lanedir_consec_mean	1.2020197376945547
driven_lanedir_consec_min	0.7166359896439909
driven_lanedir_max	1.671543605018729
driven_lanedir_mean	1.2020197376945547
driven_lanedir_median	1.2932968863301235
driven_lanedir_min	0.7166359896439909
in-drivable-lane_max	2.8500000000000405
in-drivable-lane_mean	0.6200000000000088
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.103080333151624, "sim_physics": 0.05468600260186519, "survival_time": 11.050000000000022, "driven_lanedir": 0.7166359896439909, "sim_render-ego": 0.03667079161734602, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.14128753070917605, "deviation-heading": 1.7600329620639388, "set_robot_commands": 0.05528489065386052, "deviation-center-line": 0.387653382470645, "driven_lanedir_consec": 0.7166359896439909, "sim_compute_sim_state": 0.022879539032327645, "sim_compute_performance-ego": 0.038152635367207935, "sim_compute_robot_state-ego": 0.04012442282422096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.356331216069872, "sim_physics": 0.054363184173901874, "survival_time": 12.000000000000036, "driven_lanedir": 1.343815051014507, "sim_render-ego": 0.034600035349528, "in-drivable-lane": 0, "agent_compute-ego": 0.14416495561599732, "deviation-heading": 1.3124776913540108, "set_robot_commands": 0.05461906393369039, "deviation-center-line": 0.5428480558509712, "driven_lanedir_consec": 1.343815051014507, "sim_compute_sim_state": 0.02261511584122976, "sim_compute_performance-ego": 0.03852868676185608, "sim_compute_robot_state-ego": 0.04001905620098114}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6803424467176225, "sim_physics": 0.05571472326914469, "survival_time": 14.950000000000076, "driven_lanedir": 1.671543605018729, "sim_render-ego": 0.03503158728281657, "in-drivable-lane": 0, "agent_compute-ego": 0.14045836687088012, "deviation-heading": 1.2491895377385989, "set_robot_commands": 0.05436585982640584, "deviation-center-line": 1.2545102713230998, "driven_lanedir_consec": 1.671543605018729, "sim_compute_sim_state": 0.02255563497543335, "sim_compute_performance-ego": 0.03810618082682292, "sim_compute_robot_state-ego": 0.03945291916529337}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0019717789023883, "sim_physics": 0.053666700396621435, "survival_time": 11.400000000000029, "driven_lanedir": 0.9848071564654224, "sim_render-ego": 0.0350069612787481, "in-drivable-lane": 0, "agent_compute-ego": 0.14411154546235738, "deviation-heading": 1.7334473101384278, "set_robot_commands": 0.05475003572932461, "deviation-center-line": 0.6459466013722925, "driven_lanedir_consec": 0.9848071564654224, "sim_compute_sim_state": 0.02248706629401759, "sim_compute_performance-ego": 0.0381512349111992, "sim_compute_robot_state-ego": 0.03922048890799807}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.366623020782425, "sim_physics": 0.053456055323282875, "survival_time": 14.950000000000076, "driven_lanedir": 1.2932968863301235, "sim_render-ego": 0.03487984418869019, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.14067184766133625, "deviation-heading": 1.8536757404464157, "set_robot_commands": 0.05490405162175496, "deviation-center-line": 0.28009223675992184, "driven_lanedir_consec": 1.2932968863301235, "sim_compute_sim_state": 0.0224370543162028, "sim_compute_performance-ego": 0.03797109603881836, "sim_compute_robot_state-ego": 0.03966047128041585}}
set_robot_commands_max	0.05528489065386052
set_robot_commands_mean	0.05478478035300727
set_robot_commands_median	0.05475003572932461
set_robot_commands_min	0.05436585982640584
sim_compute_performance-ego_max	0.03852868676185608
sim_compute_performance-ego_mean	0.038181966781180895
sim_compute_performance-ego_median	0.0381512349111992
sim_compute_performance-ego_min	0.03797109603881836
sim_compute_robot_state-ego_max	0.04012442282422096
sim_compute_robot_state-ego_mean	0.03969547167578188
sim_compute_robot_state-ego_median	0.03966047128041585
sim_compute_robot_state-ego_min	0.03922048890799807
sim_compute_sim_state_max	0.022879539032327645
sim_compute_sim_state_mean	0.02259488209184223
sim_compute_sim_state_median	0.02255563497543335
sim_compute_sim_state_min	0.0224370543162028
sim_physics_max	0.05571472326914469
sim_physics_mean	0.05437733315296321
sim_physics_median	0.054363184173901874
sim_physics_min	0.053456055323282875
sim_render-ego_max	0.03667079161734602
sim_render-ego_mean	0.03523784394342578
sim_render-ego_median	0.0350069612787481
sim_render-ego_min	0.034600035349528
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.870000000000047
survival_time_min	11.050000000000022

No reset possible

23390

3632

Nicky Eichmann

step1-simulation

success

yes

2019-05-19 18:33:03+00:00

2019-05-19 18:57:18+00:00

0:24:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4443672320455454
survival_time_median	2.499999999999999
deviation-center-line_median	0.15455097642444732
in-drivable-lane_median	0.7000000000000006

other stats

agent_compute-ego_max	0.12579487787710653
agent_compute-ego_mean	0.10108475088377546
agent_compute-ego_median	0.09728738239833289
agent_compute-ego_min	0.09507711483882024
deviation-center-line_max	1.068229629093837
deviation-center-line_mean	0.25274867543065366
deviation-center-line_min	0.054904029848945685
deviation-heading_max	3.507487670047857
deviation-heading_mean	0.9951171151839956
deviation-heading_median	0.4411806188695786
deviation-heading_min	0.13989224355569133
driven_any_max	3.207709657944666
driven_any_mean	1.2513357364761413
driven_any_median	1.008977359835069
driven_any_min	0.37149985167138017
driven_lanedir_consec_max	2.3108240053208213
driven_lanedir_consec_mean	0.8535592430911254
driven_lanedir_consec_min	0.17855427696068582
driven_lanedir_max	2.3527222534487895
driven_lanedir_mean	0.927270844605768
driven_lanedir_median	0.4443672320455454
driven_lanedir_min	0.17855427696068582
in-drivable-lane_max	7.450000000000026
in-drivable-lane_mean	1.6266666666666665
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.50162892780929, "sim_physics": 0.1303127762433645, "survival_time": 7.399999999999982, "driven_lanedir": 2.1208268912576216, "sim_render-ego": 0.04695734140035268, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.12579487787710653, "deviation-heading": 0.36159719377172606, "set_robot_commands": 0.06898449562691353, "deviation-center-line": 0.28905228033842156, "driven_lanedir_consec": 2.120743097074997, "sim_compute_sim_state": 0.028648276586790342, "sim_compute_performance-ego": 0.05047347900029775, "sim_compute_robot_state-ego": 0.05037268271317353, "sim_compute_robot_state-npc0": 0.05097346853565525, "sim_compute_robot_state-npc1": 0.0496539602408538, "sim_compute_robot_state-npc2": 0.050061113125569115, "sim_compute_robot_state-npc3": 0.04985267084998053}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.13298135454004462, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.04310985044999556, "in-drivable-lane": 0, "agent_compute-ego": 0.10952236435630104, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.06221373514695601, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.025588566606695003, "sim_compute_performance-ego": 0.04710344834761186, "sim_compute_robot_state-ego": 0.04837015542117032, "sim_compute_robot_state-npc0": 0.04974007606506348, "sim_compute_robot_state-npc1": 0.0468057935888117, "sim_compute_robot_state-npc2": 0.04548823833465576, "sim_compute_robot_state-npc3": 0.04403805732727051}, "udem1-2-0": {"driven_any": 2.4755270458423686, "sim_physics": 0.1217907802113947, "survival_time": 10.600000000000016, "driven_lanedir": 2.1506205729307473, "sim_render-ego": 0.043521931711232885, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.12083262542508684, "deviation-heading": 3.451647136461856, "set_robot_commands": 0.0674754594856838, "deviation-center-line": 1.068229629093837, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.02754419817114776, "sim_compute_performance-ego": 0.04666406928368334, "sim_compute_robot_state-ego": 0.04895027965869544, "sim_compute_robot_state-npc0": 0.04968261381365218, "sim_compute_robot_state-npc1": 0.04972328779832373, "sim_compute_robot_state-npc2": 0.05014199130939988, "sim_compute_robot_state-npc3": 0.04844863347287448}, "udem1-3-0": {"driven_any": 3.207709657944666, "sim_physics": 0.10023000280735855, "survival_time": 11.800000000000033, "driven_lanedir": 2.3527222534487895, "sim_render-ego": 0.0356690782611653, "in-drivable-lane": 7.450000000000026, "agent_compute-ego": 0.09610077385175024, "deviation-heading": 0.4411806188695786, "set_robot_commands": 0.05528494766203024, "deviation-center-line": 0.3742483665016732, "driven_lanedir_consec": 2.3108240053208213, "sim_compute_sim_state": 0.022265896958819892, "sim_compute_performance-ego": 0.038034861370668575, "sim_compute_robot_state-ego": 0.04034038721504858, "sim_compute_robot_state-npc0": 0.03982664467924732, "sim_compute_robot_state-npc1": 0.03922452259871919, "sim_compute_robot_state-npc2": 0.03899813708612474, "sim_compute_robot_state-npc3": 0.039018103631876286}, "udem1-4-0": {"driven_any": 0.400811386017319, "sim_physics": 0.10934990644454956, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38693847040587825, "sim_render-ego": 0.035493326187133786, "in-drivable-lane": 0, "agent_compute-ego": 0.0954519271850586, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.054077553749084475, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38693847040587825, "sim_compute_sim_state": 0.022308659553527833, "sim_compute_performance-ego": 0.038115501403808594, "sim_compute_robot_state-ego": 0.040381121635437014, "sim_compute_robot_state-npc0": 0.03984323740005493, "sim_compute_robot_state-npc1": 0.03899335861206055, "sim_compute_robot_state-npc2": 0.03885066509246826, "sim_compute_robot_state-npc3": 0.03912315368652344}, "udem1-5-0": {"driven_any": 1.1301285156014205, "sim_physics": 0.10505011081695556, "survival_time": 2.499999999999999, "driven_lanedir": 0.3805698593940634, "sim_render-ego": 0.03573078632354736, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.09628181457519532, "deviation-heading": 0.924976817672808, "set_robot_commands": 0.0547673749923706, "deviation-center-line": 0.1205488749427968, "driven_lanedir_consec": 0.3805698593940634, "sim_compute_sim_state": 0.02251267433166504, "sim_compute_performance-ego": 0.03866978645324707, "sim_compute_robot_state-ego": 0.04052900791168213, "sim_compute_robot_state-npc0": 0.04008974075317383, "sim_compute_robot_state-npc1": 0.039516873359680176, "sim_compute_robot_state-npc2": 0.03927776336669922, "sim_compute_robot_state-npc3": 0.03932257175445557}, "udem1-6-0": {"driven_any": 0.8796785144013353, "sim_physics": 0.12079187896516588, "survival_time": 1.800000000000001, "driven_lanedir": 0.8770246919234508, "sim_render-ego": 0.0354907578892178, "in-drivable-lane": 0, "agent_compute-ego": 0.0972089370091756, "deviation-heading": 0.13989224355569133, "set_robot_commands": 0.053935719860924616, "deviation-center-line": 0.15455097642444732, "driven_lanedir_consec": 0.8770246919234508, "sim_compute_sim_state": 0.022196325990888808, "sim_compute_performance-ego": 0.03794503211975098, "sim_compute_robot_state-ego": 0.04126464658313327, "sim_compute_robot_state-npc0": 0.03960323996014065, "sim_compute_robot_state-npc1": 0.03883483674791125, "sim_compute_robot_state-npc2": 0.03868100378248426, "sim_compute_robot_state-npc3": 0.03876482778125339}, "udem1-7-0": {"driven_any": 1.008977359835069, "sim_physics": 0.11556951896004054, "survival_time": 2.3, "driven_lanedir": 0.8934759392227924, "sim_render-ego": 0.03565124843431556, "in-drivable-lane": 0, "agent_compute-ego": 0.09798097610473631, "deviation-heading": 1.0583693635822085, "set_robot_commands": 0.05415734000827955, "deviation-center-line": 0.15983372236288246, "driven_lanedir_consec": 0.8770842728627053, "sim_compute_sim_state": 0.02212951494299847, "sim_compute_performance-ego": 0.03800359497899595, "sim_compute_robot_state-ego": 0.04024951354317043, "sim_compute_robot_state-npc0": 0.03961937842161759, "sim_compute_robot_state-npc1": 0.03878322373265806, "sim_compute_robot_state-npc2": 0.03870572214541228, "sim_compute_robot_state-npc3": 0.03885953322700832}, "udem1-8-0": {"driven_any": 1.7854758389187866, "sim_physics": 0.10307882485851164, "survival_time": 6.199999999999986, "driven_lanedir": 1.2770502106053638, "sim_render-ego": 0.03547324865095077, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.09789155375572944, "deviation-heading": 1.9536260214987975, "set_robot_commands": 0.054199653287087715, "deviation-center-line": 0.5971886468995992, "driven_lanedir_consec": 1.2770502106053638, "sim_compute_sim_state": 0.022464085009790236, "sim_compute_performance-ego": 0.03824980797306184, "sim_compute_robot_state-ego": 0.04056805372238159, "sim_compute_robot_state-npc0": 0.040431601385916435, "sim_compute_robot_state-npc1": 0.039307578917472594, "sim_compute_robot_state-npc2": 0.03910266199419575, "sim_compute_robot_state-npc3": 0.039195724071994904}, "udem1-9-0": {"driven_any": 0.4605114688305781, "sim_physics": 0.12386540933088824, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4443672320455454, "sim_render-ego": 0.03590524196624756, "in-drivable-lane": 0, "agent_compute-ego": 0.09735300324179907, "deviation-heading": 0.2921306476839709, "set_robot_commands": 0.05389658971266313, "deviation-center-line": 0.06393804025783281, "driven_lanedir_consec": 0.4443672320455454, "sim_compute_sim_state": 0.022110364653847435, "sim_compute_performance-ego": 0.038040778853676536, "sim_compute_robot_state-ego": 0.04074032740159468, "sim_compute_robot_state-npc0": 0.03951588543978604, "sim_compute_robot_state-npc1": 0.03916941989551891, "sim_compute_robot_state-npc2": 0.03889300606467507, "sim_compute_robot_state-npc3": 0.03867713971571489}, "udem1-10-0": {"driven_any": 0.37149985167138017, "sim_physics": 0.1119976796601948, "survival_time": 0.9500000000000004, "driven_lanedir": 0.3517991142132264, "sim_render-ego": 0.03666752263119346, "in-drivable-lane": 0, "agent_compute-ego": 0.098503966080515, "deviation-heading": 0.31076793256366336, "set_robot_commands": 0.05368198846515856, "deviation-center-line": 0.054904029848945685, "driven_lanedir_consec": 0.3517991142132264, "sim_compute_sim_state": 0.022528824053312604, "sim_compute_performance-ego": 0.03859118411415502, "sim_compute_robot_state-ego": 0.04058632097746197, "sim_compute_robot_state-npc0": 0.03987253339667069, "sim_compute_robot_state-npc1": 0.03933215141296387, "sim_compute_robot_state-npc2": 0.03958532684727719, "sim_compute_robot_state-npc3": 0.03924484001962762}, "udem1-11-0": {"driven_any": 0.4307612897755775, "sim_physics": 0.10577259744916644, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261291824030562, "sim_render-ego": 0.03615953808739072, "in-drivable-lane": 0, "agent_compute-ego": 0.09728738239833289, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.05390955152965728, "deviation-center-line": 0.09941469755038562, "driven_lanedir_consec": 0.4261291824030562, "sim_compute_sim_state": 0.02273197401137579, "sim_compute_performance-ego": 0.03836211704072498, "sim_compute_robot_state-ego": 0.040588185900733584, "sim_compute_robot_state-npc0": 0.05611964634486607, "sim_compute_robot_state-npc1": 0.03938428560892741, "sim_compute_robot_state-npc2": 0.039196196056547616, "sim_compute_robot_state-npc3": 0.03936022803896949}, "udem1-12-0": {"driven_any": 1.3824591937553763, "sim_physics": 0.10541878400310394, "survival_time": 6.199999999999986, "driven_lanedir": 0.3402246555815205, "sim_render-ego": 0.03534124166734757, "in-drivable-lane": 4.799999999999987, "agent_compute-ego": 0.09544034158029864, "deviation-heading": 0.9247813938323732, "set_robot_commands": 0.05343397202030305, "deviation-center-line": 0.16225221199578418, "driven_lanedir_consec": 0.3402246555815205, "sim_compute_sim_state": 0.022105830331002514, "sim_compute_performance-ego": 0.03774715623547954, "sim_compute_robot_state-ego": 0.04032877952821793, "sim_compute_robot_state-npc0": 0.039503928153745586, "sim_compute_robot_state-npc1": 0.038867089056199594, "sim_compute_robot_state-npc2": 0.038661237685911114, "sim_compute_robot_state-npc3": 0.038693595317102245}, "udem1-13-0": {"driven_any": 1.628837292636662, "sim_physics": 0.09903453557919233, "survival_time": 9.750000000000004, "driven_lanedir": 1.2938002384019889, "sim_render-ego": 0.03524814874697954, "in-drivable-lane": 4.050000000000004, "agent_compute-ego": 0.09507711483882024, "deviation-heading": 3.507487670047857, "set_robot_commands": 0.053537992330697864, "deviation-center-line": 0.43117857132256254, "driven_lanedir_consec": 0.6557366352747889, "sim_compute_sim_state": 0.02230414121578901, "sim_compute_performance-ego": 0.038157142736972904, "sim_compute_robot_state-ego": 0.04021897927308694, "sim_compute_robot_state-npc0": 0.03988419679495005, "sim_compute_robot_state-npc1": 0.039271280093070786, "sim_compute_robot_state-npc2": 0.03896530591524564, "sim_compute_robot_state-npc3": 0.0393251590239696}, "udem1-14-0": {"driven_any": 0.6455182352717241, "sim_physics": 0.11480471323121268, "survival_time": 2.6499999999999986, "driven_lanedir": 0.17855427696068582, "sim_render-ego": 0.035964025641387364, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.09554360497672602, "deviation-heading": 0.7741476850944534, "set_robot_commands": 0.05371708689995531, "deviation-center-line": 0.077891975310135, "driven_lanedir_consec": 0.17855427696068582, "sim_compute_sim_state": 0.02211646313937205, "sim_compute_performance-ego": 0.037973520890721736, "sim_compute_robot_state-ego": 0.040326248924687225, "sim_compute_robot_state-npc0": 0.03950341692510641, "sim_compute_robot_state-npc1": 0.038845548089945094, "sim_compute_robot_state-npc2": 0.03881252486750765, "sim_compute_robot_state-npc3": 0.03934516097014805}}
set_robot_commands_max	0.06898449562691353
set_robot_commands_mean	0.05648489738518439
set_robot_commands_median	0.054077553749084475
set_robot_commands_min	0.05343397202030305
sim_compute_performance-ego_max	0.05047347900029775
sim_compute_performance-ego_mean	0.04014209872019044
sim_compute_performance-ego_median	0.038157142736972904
sim_compute_performance-ego_min	0.03774715623547954
sim_compute_robot_state-ego_max	0.05037268271317353
sim_compute_robot_state-ego_mean	0.04225431269397831
sim_compute_robot_state-ego_median	0.04056805372238159
sim_compute_robot_state-ego_min	0.04021897927308694
sim_compute_robot_state-npc0_max	0.05611964634486607
sim_compute_robot_state-npc0_mean	0.0429473072046431
sim_compute_robot_state-npc0_median	0.03987253339667069
sim_compute_robot_state-npc0_min	0.03950341692510641
sim_compute_robot_state-npc1_max	0.04972328779832373
sim_compute_robot_state-npc1_mean	0.04104754731687445
sim_compute_robot_state-npc1_median	0.039271280093070786
sim_compute_robot_state-npc1_min	0.03878322373265806
sim_compute_robot_state-npc2_max	0.05014199130939988
sim_compute_robot_state-npc2_mean	0.040894726244944904
sim_compute_robot_state-npc2_median	0.03899813708612474
sim_compute_robot_state-npc2_min	0.038661237685911114
sim_compute_robot_state-npc3_max	0.04985267084998053
sim_compute_robot_state-npc3_mean	0.04075129325925129
sim_compute_robot_state-npc3_median	0.03924484001962762
sim_compute_robot_state-npc3_min	0.03867713971571489
sim_compute_sim_state_max	0.028648276586790342
sim_compute_sim_state_mean	0.02330371970380152
sim_compute_sim_state_median	0.022308659553527833
sim_compute_sim_state_min	0.022105830331002514
sim_physics_max	0.13298135454004462
sim_physics_mean	0.11333659154007628
sim_physics_median	0.1119976796601948
sim_physics_min	0.09903453557919233
sim_render-ego_max	0.04695734140035268
sim_render-ego_mean	0.03749221920323052
sim_render-ego_median	0.03573078632354736
sim_render-ego_min	0.03524814874697954
simulation-passed	1
survival_time_max	11.800000000000033
survival_time_mean	4.426666666666667
survival_time_min	0.9500000000000004

No reset possible

23379

3620

FANG MEIYI 🇸🇬

test

step1-simulation

error

yes

2019-05-19 16:36:55+00:00

2019-05-19 17:00:31+00:00

0:23:36

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23356

3609

Riza Velioglu 🇩🇪

step1-simulation

error

yes

2019-05-19 11:54:54+00:00

2019-05-19 12:00:16+00:00

0:05:22

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23355

3604

FANG MEIYI 🇸🇬

test

step1-simulation

error

yes

2019-05-19 10:30:51+00:00

2019-05-19 11:00:22+00:00

0:29:31

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23353

3602

FANG MEIYI 🇸🇬

test

step1-simulation

error

yes

2019-05-19 05:50:03+00:00

2019-05-19 06:00:27+00:00

0:10:24

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23332

3597

Victor Adolfo Romero Cano 🇨🇴

step1-simulation

success

yes

aido2-LFVI-sim-validation

2019-05-18 16:28:27+00:00

2019-05-18 16:41:54+00:00

0:13:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.12117403966409188
agent_compute-ego_mean	0.0943884288169612
agent_compute-ego_median	0.08579270044962566
agent_compute-ego_min	0.0847318172454834
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11150115066104466, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04608925625129982, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12117403966409188, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.06987743024472837, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02789100452705666, "sim_compute_performance-ego": 0.04859203762478299, "sim_compute_robot_state-ego": 0.05176416591361717, "sim_compute_robot_state-npc0": 0.05264091933215106, "sim_compute_robot_state-npc1": 0.051717678705851235, "sim_compute_robot_state-npc2": 0.05222060503783049, "sim_compute_robot_state-npc3": 0.05050568668930619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1309053611755371, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.04664741516113281, "in-drivable-lane": 0, "agent_compute-ego": 0.11681883811950684, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.07168488502502442, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.030660943984985353, "sim_compute_performance-ego": 0.052088136672973635, "sim_compute_robot_state-ego": 0.05363428115844727, "sim_compute_robot_state-npc0": 0.051275386810302734, "sim_compute_robot_state-npc1": 0.04797172546386719, "sim_compute_robot_state-npc2": 0.05204931259155274, "sim_compute_robot_state-npc3": 0.05395244598388672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12064300712786225, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.043275378252330576, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10630479298139874, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.06280541106274254, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.02797605175721018, "sim_compute_performance-ego": 0.04827641185961271, "sim_compute_robot_state-ego": 0.04914965127643786, "sim_compute_robot_state-npc0": 0.04643561965540836, "sim_compute_robot_state-npc1": 0.04619423652950086, "sim_compute_robot_state-npc2": 0.046722440343154106, "sim_compute_robot_state-npc3": 0.047222987601631565}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.12712318685990345, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.043375664119479025, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.11014933525761472, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.06800885441937024, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.027159917203685904, "sim_compute_performance-ego": 0.04722817638252355, "sim_compute_robot_state-ego": 0.05012507378300534, "sim_compute_robot_state-npc0": 0.05246663998953904, "sim_compute_robot_state-npc1": 0.051373901246469234, "sim_compute_robot_state-npc2": 0.04975870892971377, "sim_compute_robot_state-npc3": 0.049436035035531734}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.10010761874062676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04044470616749355, "in-drivable-lane": 0, "agent_compute-ego": 0.10578417778015135, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.060710276876177104, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.023120462894439697, "sim_compute_performance-ego": 0.04603620086397443, "sim_compute_robot_state-ego": 0.04451092651912144, "sim_compute_robot_state-npc0": 0.04329056399209159, "sim_compute_robot_state-npc1": 0.04232628004891532, "sim_compute_robot_state-npc2": 0.04309627839497158, "sim_compute_robot_state-npc3": 0.04184817416327341}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08194327354431152, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.03521350578025535, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08624926761344627, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.0536988134737368, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.022231746602941443, "sim_compute_performance-ego": 0.0406493654957524, "sim_compute_robot_state-ego": 0.04001951217651367, "sim_compute_robot_state-npc0": 0.039231057520265934, "sim_compute_robot_state-npc1": 0.03960601930265074, "sim_compute_robot_state-npc2": 0.03868971047578035, "sim_compute_robot_state-npc3": 0.03861169903366654}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0844954737910518, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.03490696571491383, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08579270044962566, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0532834044209233, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.022049034083331073, "sim_compute_performance-ego": 0.037778125868903265, "sim_compute_robot_state-ego": 0.03988954755995008, "sim_compute_robot_state-npc0": 0.039292494455973305, "sim_compute_robot_state-npc1": 0.03864149252573649, "sim_compute_robot_state-npc2": 0.03863577489499693, "sim_compute_robot_state-npc3": 0.0385353167851766}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.11228564580281576, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03631012704637315, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08685203658209907, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05411349402533637, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.022988091574774848, "sim_compute_performance-ego": 0.03919310569763183, "sim_compute_robot_state-ego": 0.04229167302449544, "sim_compute_robot_state-npc0": 0.04039191669887966, "sim_compute_robot_state-npc1": 0.040125799179077146, "sim_compute_robot_state-npc2": 0.03963661193847656, "sim_compute_robot_state-npc3": 0.04009330007765028}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.08624698804772418, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03493636587391729, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08536121119623599, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05324211327925972, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.02224360859912375, "sim_compute_performance-ego": 0.037977228993954865, "sim_compute_robot_state-ego": 0.04002940654754639, "sim_compute_robot_state-npc0": 0.039358786914659584, "sim_compute_robot_state-npc1": 0.03873440493708071, "sim_compute_robot_state-npc2": 0.038615936818330185, "sim_compute_robot_state-npc3": 0.03882363568181577}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.10017043590545656, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.034849538803100585, "in-drivable-lane": 0, "agent_compute-ego": 0.08571155071258545, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.053426289558410646, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02205103874206543, "sim_compute_performance-ego": 0.03853568077087402, "sim_compute_robot_state-ego": 0.0427286434173584, "sim_compute_robot_state-npc0": 0.03912705421447754, "sim_compute_robot_state-npc1": 0.03872065067291259, "sim_compute_robot_state-npc2": 0.0386264181137085, "sim_compute_robot_state-npc3": 0.0386556339263916}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.1122372031211853, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.0351258397102356, "in-drivable-lane": 0, "agent_compute-ego": 0.0855568528175354, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05282052755355835, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.0220969557762146, "sim_compute_performance-ego": 0.037859654426574706, "sim_compute_robot_state-ego": 0.03998314142227173, "sim_compute_robot_state-npc0": 0.039096271991729735, "sim_compute_robot_state-npc1": 0.038419461250305174, "sim_compute_robot_state-npc2": 0.03839997053146362, "sim_compute_robot_state-npc3": 0.0385094404220581}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08870715844003778, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03434359399895919, "in-drivable-lane": 0, "agent_compute-ego": 0.0847318172454834, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05273724857129549, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02198984748438785, "sim_compute_performance-ego": 0.037758864854511465, "sim_compute_robot_state-ego": 0.03959963196202328, "sim_compute_robot_state-npc0": 0.03901698714808414, "sim_compute_robot_state-npc1": 0.03854633632459139, "sim_compute_robot_state-npc2": 0.03842009996113024, "sim_compute_robot_state-npc3": 0.038662734784578025}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.082181396484375, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.03448686599731445, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.0849280023574829, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05235579967498779, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.02206511974334717, "sim_compute_performance-ego": 0.037347850799560545, "sim_compute_robot_state-ego": 0.03948755264282226, "sim_compute_robot_state-npc0": 0.03905360221862793, "sim_compute_robot_state-npc1": 0.03832610607147217, "sim_compute_robot_state-npc2": 0.03896951675415039, "sim_compute_robot_state-npc3": 0.03840787410736084}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1042057600888339, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.035158601674166595, "in-drivable-lane": 0, "agent_compute-ego": 0.0850601087916981, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.05273234844207764, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.022030754522843796, "sim_compute_performance-ego": 0.03761691396886653, "sim_compute_robot_state-ego": 0.03987704623829235, "sim_compute_robot_state-npc0": 0.03899142958901145, "sim_compute_robot_state-npc1": 0.03853940963745117, "sim_compute_robot_state-npc2": 0.03844360871748491, "sim_compute_robot_state-npc3": 0.03821939771825617}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10011285178515376, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.034939201510682395, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08535170068546218, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.052632229668753486, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02192103619478187, "sim_compute_performance-ego": 0.03753426610207071, "sim_compute_robot_state-ego": 0.03961390378523846, "sim_compute_robot_state-npc0": 0.046734848800970584, "sim_compute_robot_state-npc1": 0.03838518687656948, "sim_compute_robot_state-npc2": 0.03809822822103695, "sim_compute_robot_state-npc3": 0.03828405847354811}}
set_robot_commands_max	0.07168488502502442
set_robot_commands_mean	0.05760860841975882
set_robot_commands_median	0.053426289558410646
set_robot_commands_min	0.05235579967498779
sim_compute_performance-ego_max	0.052088136672973635
sim_compute_performance-ego_mean	0.041631468025504506
sim_compute_performance-ego_median	0.03853568077087402
sim_compute_performance-ego_min	0.037347850799560545
sim_compute_robot_state-ego_max	0.05363428115844727
sim_compute_robot_state-ego_mean	0.043513610495142734
sim_compute_robot_state-ego_median	0.04002940654754639
sim_compute_robot_state-ego_min	0.03948755264282226
sim_compute_robot_state-npc0_max	0.05264091933215106
sim_compute_robot_state-npc0_mean	0.04309357195547817
sim_compute_robot_state-npc0_median	0.039358786914659584
sim_compute_robot_state-npc0_min	0.03899142958901145
sim_compute_robot_state-npc1_max	0.051717678705851235
sim_compute_robot_state-npc1_mean	0.041841912584830054
sim_compute_robot_state-npc1_median	0.03873440493708071
sim_compute_robot_state-npc1_min	0.03832610607147217
sim_compute_robot_state-npc2_max	0.05222060503783049
sim_compute_robot_state-npc2_mean	0.04202554811491875
sim_compute_robot_state-npc2_median	0.03868971047578035
sim_compute_robot_state-npc2_min	0.03809822822103695
sim_compute_robot_state-npc3_max	0.05395244598388672
sim_compute_robot_state-npc3_mean	0.041984561365608776
sim_compute_robot_state-npc3_median	0.038662734784578025
sim_compute_robot_state-npc3_min	0.03821939771825617
sim_compute_sim_state_max	0.030660943984985353
sim_compute_sim_state_mean	0.02389837424607931
sim_compute_sim_state_median	0.022231746602941443
sim_compute_sim_state_min	0.02192103619478187
sim_physics_max	0.1309053611755371
sim_physics_mean	0.10285776743839464
sim_physics_median	0.10017043590545656
sim_physics_min	0.08194327354431152
sim_render-ego_max	0.04664741516113281
sim_render-ego_mean	0.038006868404110286
sim_render-ego_median	0.035158601674166595
sim_render-ego_min	0.03434359399895919
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

23292

3513

Bea Baselines 🐤

challenge-aido_LF-template-pytorch

step1-simulation

success

yes

2019-05-17 20:50:06+00:00

2019-05-17 20:58:18+00:00

0:08:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.126519619846877
survival_time_median	1.2500000000000004
deviation-center-line_median	0.09099610507857396
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17437504952953709
agent_compute-ego_mean	0.15807920630602
agent_compute-ego_median	0.15490864753723144
agent_compute-ego_min	0.1480963627497355
deviation-center-line_max	0.1133884355221843
deviation-center-line_mean	0.08992195278247239
deviation-center-line_min	0.06389265570941403
deviation-heading_max	0.9918498881185052
deviation-heading_mean	0.6989804307508887
deviation-heading_median	0.7489263178993967
deviation-heading_min	0.4286232289812193
driven_any_max	0.2071389909002107
driven_any_mean	0.18601213728065524
driven_any_median	0.1843375442846786
driven_any_min	0.16473283374657466
driven_lanedir_consec_max	0.15677666245360866
driven_lanedir_consec_mean	0.1267139230659188
driven_lanedir_consec_min	0.09642465400829003
driven_lanedir_max	0.15677666245360866
driven_lanedir_mean	0.1267139230659188
driven_lanedir_median	0.126519619846877
driven_lanedir_min	0.09642465400829003
in-drivable-lane_max	0.20000000000000015
in-drivable-lane_mean	0.04000000000000003
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2041346079356744, "sim_physics": 0.20655958114131803, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09642465400829003, "sim_render-ego": 0.06199335282848727, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17437504952953709, "deviation-heading": 0.8654299790414866, "set_robot_commands": 0.08897796753914125, "deviation-center-line": 0.07535448141486417, "driven_lanedir_consec": 0.09642465400829003, "sim_compute_sim_state": 0.03978893064683483, "sim_compute_performance-ego": 0.0695214117726972, "sim_compute_robot_state-ego": 0.07844278120225476, "sim_compute_robot_state-npc0": 0.06974702496682444, "sim_compute_robot_state-npc1": 0.06656402926291188, "sim_compute_robot_state-npc2": 0.06976249141077842, "sim_compute_robot_state-npc3": 0.06549476808117281}, "udem1-1-0": {"driven_any": 0.2071389909002107, "sim_physics": 0.19499941225405093, "survival_time": 1.3500000000000003, "driven_lanedir": 0.126519619846877, "sim_render-ego": 0.061435558177806715, "in-drivable-lane": 0, "agent_compute-ego": 0.1538143687778049, "deviation-heading": 0.9918498881185052, "set_robot_commands": 0.07576971583896214, "deviation-center-line": 0.09099610507857396, "driven_lanedir_consec": 0.126519619846877, "sim_compute_sim_state": 0.03699239978083858, "sim_compute_performance-ego": 0.06923903359307183, "sim_compute_robot_state-ego": 0.0686461572293882, "sim_compute_robot_state-npc0": 0.06295571503815828, "sim_compute_robot_state-npc1": 0.05931214933042173, "sim_compute_robot_state-npc2": 0.05754051385102449, "sim_compute_robot_state-npc3": 0.06738716584664804}, "udem1-2-0": {"driven_any": 0.1843375442846786, "sim_physics": 0.21084897994995117, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15677666245360866, "sim_render-ego": 0.057331695556640624, "in-drivable-lane": 0, "agent_compute-ego": 0.15490864753723144, "deviation-heading": 0.4286232289812193, "set_robot_commands": 0.08966363906860352, "deviation-center-line": 0.1133884355221843, "driven_lanedir_consec": 0.15677666245360866, "sim_compute_sim_state": 0.036446666717529295, "sim_compute_performance-ego": 0.059206151962280275, "sim_compute_robot_state-ego": 0.06776450157165527, "sim_compute_robot_state-npc0": 0.06362541198730469, "sim_compute_robot_state-npc1": 0.0653553295135498, "sim_compute_robot_state-npc2": 0.06928662300109863, "sim_compute_robot_state-npc3": 0.06553478240966797}, "udem1-3-0": {"driven_any": 0.1697167095361378, "sim_physics": 0.19585787773132324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1403138163611315, "sim_render-ego": 0.06261606216430664, "in-drivable-lane": 0, "agent_compute-ego": 0.15920160293579105, "deviation-heading": 0.4600727397138359, "set_robot_commands": 0.09010379791259764, "deviation-center-line": 0.10597808618732547, "driven_lanedir_consec": 0.1403138163611315, "sim_compute_sim_state": 0.032850522994995114, "sim_compute_performance-ego": 0.06647941589355469, "sim_compute_robot_state-ego": 0.07230002403259278, "sim_compute_robot_state-npc0": 0.06809094429016113, "sim_compute_robot_state-npc1": 0.06808688163757325, "sim_compute_robot_state-npc2": 0.06462312698364257, "sim_compute_robot_state-npc3": 0.06273202896118164}, "udem1-4-0": {"driven_any": 0.16473283374657466, "sim_physics": 0.1806030571460724, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11353486265968682, "sim_render-ego": 0.055715968211491905, "in-drivable-lane": 0, "agent_compute-ego": 0.1480963627497355, "deviation-heading": 0.7489263178993967, "set_robot_commands": 0.08113818367322286, "deviation-center-line": 0.06389265570941403, "driven_lanedir_consec": 0.11353486265968682, "sim_compute_sim_state": 0.03428687651952108, "sim_compute_performance-ego": 0.06407466530799866, "sim_compute_robot_state-ego": 0.06794539093971252, "sim_compute_robot_state-npc0": 0.05488091707229614, "sim_compute_robot_state-npc1": 0.0593599279721578, "sim_compute_robot_state-npc2": 0.05697957674662272, "sim_compute_robot_state-npc3": 0.0595604677995046}}
set_robot_commands_max	0.09010379791259764
set_robot_commands_mean	0.08513066080650547
set_robot_commands_median	0.08897796753914125
set_robot_commands_min	0.07576971583896214
sim_compute_performance-ego_max	0.0695214117726972
sim_compute_performance-ego_mean	0.06570413570592053
sim_compute_performance-ego_median	0.06647941589355469
sim_compute_performance-ego_min	0.059206151962280275
sim_compute_robot_state-ego_max	0.07844278120225476
sim_compute_robot_state-ego_mean	0.0710197709951207
sim_compute_robot_state-ego_median	0.0686461572293882
sim_compute_robot_state-ego_min	0.06776450157165527
sim_compute_robot_state-npc0_max	0.06974702496682444
sim_compute_robot_state-npc0_mean	0.06386000267094893
sim_compute_robot_state-npc0_median	0.06362541198730469
sim_compute_robot_state-npc0_min	0.05488091707229614
sim_compute_robot_state-npc1_max	0.06808688163757325
sim_compute_robot_state-npc1_mean	0.06373566354332288
sim_compute_robot_state-npc1_median	0.0653553295135498
sim_compute_robot_state-npc1_min	0.05931214933042173
sim_compute_robot_state-npc2_max	0.06976249141077842
sim_compute_robot_state-npc2_mean	0.06363846639863338
sim_compute_robot_state-npc2_median	0.06462312698364257
sim_compute_robot_state-npc2_min	0.05697957674662272
sim_compute_robot_state-npc3_max	0.06738716584664804
sim_compute_robot_state-npc3_mean	0.064141842619635
sim_compute_robot_state-npc3_median	0.06549476808117281
sim_compute_robot_state-npc3_min	0.0595604677995046
sim_compute_sim_state_max	0.03978893064683483
sim_compute_sim_state_mean	0.03607307933194378
sim_compute_sim_state_median	0.036446666717529295
sim_compute_sim_state_min	0.032850522994995114
sim_physics_max	0.21084897994995117
sim_physics_mean	0.19777378164454312
sim_physics_median	0.19585787773132324
sim_physics_min	0.1806030571460724
sim_render-ego_max	0.06261606216430664
sim_render-ego_mean	0.05981852738774664
sim_render-ego_median	0.061435558177806715
sim_render-ego_min	0.055715968211491905
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3200000000000005
survival_time_min	1.2000000000000004

No reset possible

23169

3575

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

error

yes