Evaluator 914

step1-simulation

success

2019-05-13 13:01:08+00:00

2019-05-13 13:15:43+00:00

0:14:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.799686118484899
survival_time_median	14.950000000000076
deviation-center-line_median	1.1656320574463124
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06105303446451823
agent_compute-ego_mean	0.05866334378928469
agent_compute-ego_median	0.05765983793470594
agent_compute-ego_min	0.057338883876800535
deviation-center-line_max	1.3387685050717464
deviation-center-line_mean	1.0473342418265197
deviation-center-line_min	0.6562941144627154
deviation-heading_max	4.000371797103772
deviation-heading_mean	2.8052879297224425
deviation-heading_median	2.521031972848331
deviation-heading_min	2.0155748497168293
driven_any_max	3.2837256814460183
driven_any_mean	2.740327711621146
driven_any_median	2.9532351515080633
driven_any_min	1.9229166910983069
driven_lanedir_consec_max	2.9390936740998534
driven_lanedir_consec_mean	2.548097446406828
driven_lanedir_consec_min	1.8477420112246343
driven_lanedir_max	2.9390936740998534
driven_lanedir_mean	2.548097446406828
driven_lanedir_median	2.799686118484899
driven_lanedir_min	1.8477420112246343
in-drivable-lane_max	1.7500000000000249
in-drivable-lane_mean	0.6800000000000038
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9229166910983069, "sim_physics": 0.06373694207933214, "survival_time": 8.549999999999986, "driven_lanedir": 1.8477420112246343, "sim_render-ego": 0.039393705234192965, "in-drivable-lane": 0, "agent_compute-ego": 0.05960944382070798, "deviation-heading": 2.0155748497168293, "set_robot_commands": 0.07620479767782647, "deviation-center-line": 0.6562941144627154, "driven_lanedir_consec": 1.8477420112246343, "sim_compute_sim_state": 0.028750461444520113, "sim_compute_performance-ego": 0.04285978852656849, "sim_compute_robot_state-ego": 0.04497747532805504}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.9532351515080633, "sim_physics": 0.06600495179494222, "survival_time": 14.950000000000076, "driven_lanedir": 2.799686118484899, "sim_render-ego": 0.03894125699996948, "in-drivable-lane": 0, "agent_compute-ego": 0.06105303446451823, "deviation-heading": 4.000371797103772, "set_robot_commands": 0.07601704438527425, "deviation-center-line": 1.3387685050717464, "driven_lanedir_consec": 2.799686118484899, "sim_compute_sim_state": 0.027509688536326092, "sim_compute_performance-ego": 0.04265744765599569, "sim_compute_robot_state-ego": 0.04529706875483195}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1942408488784393, "sim_physics": 0.06454865296681722, "survival_time": 14.950000000000076, "driven_lanedir": 2.904331408977733, "sim_render-ego": 0.03911122798919678, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.057338883876800535, "deviation-heading": 2.4507417115862276, "set_robot_commands": 0.07707489967346191, "deviation-center-line": 1.1656320574463124, "driven_lanedir_consec": 2.904331408977733, "sim_compute_sim_state": 0.02729616403579712, "sim_compute_performance-ego": 0.042408303419748945, "sim_compute_robot_state-ego": 0.047749102115631104}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.347520185174905, "sim_physics": 0.06402307086520725, "survival_time": 11.700000000000031, "driven_lanedir": 2.2496340192470203, "sim_render-ego": 0.04133349809891138, "in-drivable-lane": 0, "agent_compute-ego": 0.05765983793470594, "deviation-heading": 3.0387193173570535, "set_robot_commands": 0.07580041274046287, "deviation-center-line": 0.8295793645906848, "driven_lanedir_consec": 2.2496340192470203, "sim_compute_sim_state": 0.029568000736399595, "sim_compute_performance-ego": 0.043466422292921275, "sim_compute_robot_state-ego": 0.044343586660857894}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.2837256814460183, "sim_physics": 0.0644843864440918, "survival_time": 14.950000000000076, "driven_lanedir": 2.9390936740998534, "sim_render-ego": 0.03912280400594075, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.05765551884969076, "deviation-heading": 2.521031972848331, "set_robot_commands": 0.07486648877461752, "deviation-center-line": 1.246397167561139, "driven_lanedir_consec": 2.9390936740998534, "sim_compute_sim_state": 0.02783356507619222, "sim_compute_performance-ego": 0.04302750428517659, "sim_compute_robot_state-ego": 0.04468300024668376}}
set_robot_commands_max	0.07707489967346191
set_robot_commands_mean	0.0759927286503286
set_robot_commands_median	0.07601704438527425
set_robot_commands_min	0.07486648877461752
sim_compute_performance-ego_max	0.043466422292921275
sim_compute_performance-ego_mean	0.0428838932360822
sim_compute_performance-ego_median	0.04285978852656849
sim_compute_performance-ego_min	0.042408303419748945
sim_compute_robot_state-ego_max	0.047749102115631104
sim_compute_robot_state-ego_mean	0.045410046621211946
sim_compute_robot_state-ego_median	0.04497747532805504
sim_compute_robot_state-ego_min	0.044343586660857894
sim_compute_sim_state_max	0.029568000736399595
sim_compute_sim_state_mean	0.028191575965847027
sim_compute_sim_state_median	0.02783356507619222
sim_compute_sim_state_min	0.02729616403579712
sim_physics_max	0.06600495179494222
sim_physics_mean	0.06455960083007813
sim_physics_median	0.0644843864440918
sim_physics_min	0.06373694207933214
sim_render-ego_max	0.04133349809891138
sim_render-ego_mean	0.03958049846564227
sim_render-ego_median	0.03912280400594075
sim_render-ego_min	0.03894125699996948
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.02000000000005
survival_time_min	8.549999999999986

No reset possible

21925

3355

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LF-sim-testing

step1-simulation

success

2019-05-13 08:05:24+00:00

2019-05-13 08:45:13+00:00

0:39:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.6047163131028066
survival_time_median	14.950000000000076
deviation-center-line_median	1.1794850266629724
in-drivable-lane_median	0.5000000000000071

other stats

agent_compute-ego_max	0.1415994612375895
agent_compute-ego_mean	0.1059778536079886
agent_compute-ego_median	0.1373172566510629
agent_compute-ego_min	0.05531534613395224
deviation-center-line_max	1.4296285788335263
deviation-center-line_mean	1.069341183721055
deviation-center-line_min	0.3700897657559232
deviation-heading_max	3.392345110298936
deviation-heading_mean	2.0309384707777536
deviation-heading_median	1.9338840663399604
deviation-heading_min	0.5732850294967654
driven_any_max	2.921871767618988
driven_any_mean	2.453796912365142
driven_any_median	2.73632083650625
driven_any_min	0.5586545684535191
driven_lanedir_consec_max	2.768248967144613
driven_lanedir_consec_mean	2.295858577755724
driven_lanedir_consec_min	0.5416276124765957
driven_lanedir_max	2.768248967144613
driven_lanedir_mean	2.295858577755724
driven_lanedir_median	2.6047163131028066
driven_lanedir_min	0.5416276124765957
in-drivable-lane_max	1.9999999999999991
in-drivable-lane_mean	0.8166666666666735
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.562450442566345, "sim_physics": 0.0592143177986145, "survival_time": 14.950000000000076, "driven_lanedir": 2.2393175886563346, "sim_render-ego": 0.038157495657602944, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.06197711944580078, "deviation-heading": 2.676335134986774, "set_robot_commands": 0.07372255325317383, "deviation-center-line": 0.8667832876334194, "driven_lanedir_consec": 2.2393175886563346, "sim_compute_sim_state": 0.027768126328786218, "sim_compute_performance-ego": 0.04096299966176351, "sim_compute_robot_state-ego": 0.04334742863972982}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.805442972471226, "sim_physics": 0.06353675285975138, "survival_time": 14.950000000000076, "driven_lanedir": 2.647004166845406, "sim_render-ego": 0.03759766658147176, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.05550151745478312, "deviation-heading": 2.2550715197548747, "set_robot_commands": 0.0748917818069458, "deviation-center-line": 1.3296675752369342, "driven_lanedir_consec": 2.647004166845406, "sim_compute_sim_state": 0.027391003767649337, "sim_compute_performance-ego": 0.04098726590474447, "sim_compute_robot_state-ego": 0.043455158869425456}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9098682653056605, "sim_physics": 0.06362983147303264, "survival_time": 14.950000000000076, "driven_lanedir": 2.602146080532171, "sim_render-ego": 0.0379305362701416, "in-drivable-lane": 1.9999999999999991, "agent_compute-ego": 0.05709272464116415, "deviation-heading": 1.7102626492518371, "set_robot_commands": 0.07412001291910807, "deviation-center-line": 1.2017862193687967, "driven_lanedir_consec": 2.602146080532171, "sim_compute_sim_state": 0.02701632261276245, "sim_compute_performance-ego": 0.04115325609842936, "sim_compute_robot_state-ego": 0.043176170190175375}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.740301247027215, "sim_physics": 0.06321932474772135, "survival_time": 14.950000000000076, "driven_lanedir": 2.6842982380813147, "sim_render-ego": 0.03810842196146647, "in-drivable-lane": 0, "agent_compute-ego": 0.05542652765909831, "deviation-heading": 2.5945172805444243, "set_robot_commands": 0.07479211489359537, "deviation-center-line": 0.8719049558532, "driven_lanedir_consec": 2.6842982380813147, "sim_compute_sim_state": 0.026974872748057047, "sim_compute_performance-ego": 0.04114916721979777, "sim_compute_robot_state-ego": 0.04302115440368652}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.73632083650625, "sim_physics": 0.06549858093261719, "survival_time": 14.950000000000076, "driven_lanedir": 2.701061360145948, "sim_render-ego": 0.03735067447026571, "in-drivable-lane": 0, "agent_compute-ego": 0.055935248533884686, "deviation-heading": 1.9338840663399604, "set_robot_commands": 0.07434553305308024, "deviation-center-line": 1.106377737110598, "driven_lanedir_consec": 2.701061360145948, "sim_compute_sim_state": 0.027239826520284015, "sim_compute_performance-ego": 0.04070483922958374, "sim_compute_robot_state-ego": 0.044225791295369465}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.722821371868309, "sim_physics": 0.05966321059635707, "survival_time": 9.800000000000004, "driven_lanedir": 1.464946316944128, "sim_render-ego": 0.03647870311931688, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.05531534613395224, "deviation-heading": 1.7180940801608886, "set_robot_commands": 0.0734756978190675, "deviation-center-line": 0.8444853283751286, "driven_lanedir_consec": 1.464946316944128, "sim_compute_sim_state": 0.0268224125005761, "sim_compute_performance-ego": 0.041018695247416595, "sim_compute_robot_state-ego": 0.04290793623243059}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.5558162375729823, "sim_physics": 0.061609196662902835, "survival_time": 14.950000000000076, "driven_lanedir": 2.4058898313881993, "sim_render-ego": 0.037444916566212974, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.1415994612375895, "deviation-heading": 3.3429670057351952, "set_robot_commands": 0.05672325849533081, "deviation-center-line": 0.732531490273836, "driven_lanedir_consec": 2.4058898313881993, "sim_compute_sim_state": 0.0249156657854716, "sim_compute_performance-ego": 0.040515503883361816, "sim_compute_robot_state-ego": 0.043158340454101565}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.5586545684535191, "sim_physics": 0.0632712633713432, "survival_time": 3.4499999999999957, "driven_lanedir": 0.5416276124765957, "sim_render-ego": 0.036982121674910835, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1373172566510629, "deviation-heading": 0.5732850294967654, "set_robot_commands": 0.056176551874133125, "deviation-center-line": 0.3700897657559232, "driven_lanedir_consec": 0.5416276124765957, "sim_compute_sim_state": 0.025222622829934822, "sim_compute_performance-ego": 0.04066244415614916, "sim_compute_robot_state-ego": 0.0437819784966068}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.882959378212304, "sim_physics": 0.05987181504567464, "survival_time": 14.950000000000076, "driven_lanedir": 2.6047163131028066, "sim_render-ego": 0.0375012731552124, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.13793230613072713, "deviation-heading": 1.1621516432596015, "set_robot_commands": 0.05692705551783244, "deviation-center-line": 1.2960826969461317, "driven_lanedir_consec": 2.6047163131028066, "sim_compute_sim_state": 0.024888407389322915, "sim_compute_performance-ego": 0.04094746430714925, "sim_compute_robot_state-ego": 0.043120365937550864}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.6877011676493607, "sim_physics": 0.06586498896280925, "survival_time": 14.950000000000076, "driven_lanedir": 2.627191615271868, "sim_render-ego": 0.03763414939244588, "in-drivable-lane": 0, "agent_compute-ego": 0.1404525113105774, "deviation-heading": 2.757193452272143, "set_robot_commands": 0.05633762121200561, "deviation-center-line": 1.382824851578384, "driven_lanedir_consec": 2.627191615271868, "sim_compute_sim_state": 0.02503342787424723, "sim_compute_performance-ego": 0.040842154026031495, "sim_compute_robot_state-ego": 0.04351631323496501}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.7999929036704945, "sim_physics": 0.06187265396118164, "survival_time": 14.950000000000076, "driven_lanedir": 2.768248967144613, "sim_render-ego": 0.03741104364395142, "in-drivable-lane": 0, "agent_compute-ego": 0.138669060866038, "deviation-heading": 1.6879540400769222, "set_robot_commands": 0.05680177132288615, "deviation-center-line": 1.302698296942682, "driven_lanedir_consec": 2.768248967144613, "sim_compute_sim_state": 0.024936091105143228, "sim_compute_performance-ego": 0.04112167517344157, "sim_compute_robot_state-ego": 0.04341070016225179}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.5827667270233676, "sim_physics": 0.06090327739715576, "survival_time": 14.950000000000076, "driven_lanedir": 2.497161845777729, "sim_render-ego": 0.03773020267486572, "in-drivable-lane": 0, "agent_compute-ego": 0.14000369946161906, "deviation-heading": 3.392345110298936, "set_robot_commands": 0.056724082628885904, "deviation-center-line": 1.1794850266629724, "driven_lanedir_consec": 2.497161845777729, "sim_compute_sim_state": 0.024917126496632892, "sim_compute_performance-ego": 0.04076785008112589, "sim_compute_robot_state-ego": 0.043072479565938314}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4201420701732672, "sim_physics": 0.06316458272655108, "survival_time": 8.549999999999986, "driven_lanedir": 1.3521933806292856, "sim_render-ego": 0.037044791450277406, "in-drivable-lane": 0, "agent_compute-ego": 0.13728036239133243, "deviation-heading": 2.1011985718339643, "set_robot_commands": 0.05617614796287135, "deviation-center-line": 0.8363363606801798, "driven_lanedir_consec": 1.3521933806292856, "sim_compute_sim_state": 0.025048518041421095, "sim_compute_performance-ego": 0.04108384617587976, "sim_compute_robot_state-ego": 0.043047333321376155}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.921871767618988, "sim_physics": 0.05972119808197021, "survival_time": 14.950000000000076, "driven_lanedir": 2.6435083997350652, "sim_render-ego": 0.03734200954437256, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.1376333689689636, "deviation-heading": 1.421163928734532, "set_robot_commands": 0.059427226384480794, "deviation-center-line": 1.2894355845641106, "driven_lanedir_consec": 2.6435083997350652, "sim_compute_sim_state": 0.02530097484588623, "sim_compute_performance-ego": 0.04134946902592977, "sim_compute_robot_state-ego": 0.043265198866526286}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.9198437293578485, "sim_physics": 0.061646843751271566, "survival_time": 14.950000000000076, "driven_lanedir": 2.658566949604398, "sim_render-ego": 0.03749440749486287, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.13753129323323568, "deviation-heading": 1.1376535489194843, "set_robot_commands": 0.05667798757553101, "deviation-center-line": 1.4296285788335263, "driven_lanedir_consec": 2.658566949604398, "sim_compute_sim_state": 0.024788750012715657, "sim_compute_performance-ego": 0.0431837519009908, "sim_compute_robot_state-ego": 0.04316168228785197}}
set_robot_commands_max	0.0748917818069458
set_robot_commands_mean	0.0638212931145952
set_robot_commands_median	0.05692705551783244
set_robot_commands_min	0.05617614796287135
sim_compute_performance-ego_max	0.0431837519009908
sim_compute_performance-ego_mean	0.04109669213945299
sim_compute_performance-ego_median	0.04098726590474447
sim_compute_performance-ego_min	0.040515503883361816
sim_compute_robot_state-ego_max	0.044225791295369465
sim_compute_robot_state-ego_mean	0.0433112021305324
sim_compute_robot_state-ego_median	0.043176170190175375
sim_compute_robot_state-ego_min	0.04290793623243059
sim_compute_sim_state_max	0.027768126328786218
sim_compute_sim_state_mean	0.02588427659059272
sim_compute_sim_state_median	0.025222622829934822
sim_compute_sim_state_min	0.024788750012715657
sim_physics_max	0.06586498896280925
sim_physics_mean	0.06217918922459696
sim_physics_median	0.06187265396118164
sim_physics_min	0.0592143177986145
sim_render-ego_max	0.038157495657602944
sim_render-ego_mean	0.03748056091049183
sim_render-ego_median	0.03749440749486287
sim_render-ego_min	0.03647870311931688
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.413333333333393
survival_time_min	3.4499999999999957

No reset possible

21913

3347

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LFV-sim-testing

step1-simulation

host-error

2019-05-12 20:10:23+00:00

2019-05-12 21:00:35+00:00

0:50:12

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3347/step1-simulation-ip-172-31-38-104-5376-job21913/logs/challenges-runner/stdout.html'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21882

3331

RL-TH-shi

step1-simulation

success

2019-05-11 01:39:23+00:00

2019-05-11 01:51:34+00:00

0:12:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.127435436900436
survival_time_median	14.950000000000076
deviation-center-line_median	0.7214578388011399
in-drivable-lane_median	1.900000000000027

other stats

agent_compute-ego_max	0.1030179222424825
agent_compute-ego_mean	0.10187082829298796
agent_compute-ego_median	0.10166871468226114
agent_compute-ego_min	0.1010220558555038
deviation-center-line_max	1.2416735933499656
deviation-center-line_mean	0.8060325501396666
deviation-center-line_min	0.4110948048380859
deviation-heading_max	12.043785580032765
deviation-heading_mean	5.485007155262168
deviation-heading_median	3.0760043411725215
deviation-heading_min	0.422028089941221
driven_any_max	3.6790659130362102
driven_any_mean	1.66499503393779
driven_any_median	1.3350629067469348
driven_any_min	0.6660256344337798
driven_lanedir_consec_max	3.4974205048941274
driven_lanedir_consec_mean	1.4697877409680142
driven_lanedir_consec_min	0.6432076063790508
driven_lanedir_max	3.4974205048941274
driven_lanedir_mean	1.46978204967284
driven_lanedir_median	1.1274069804245652
driven_lanedir_min	0.6432076063790508
in-drivable-lane_max	5.4500000000000135
in-drivable-lane_mean	2.8200000000000136
in-drivable-lane_min	0.4499999999999984
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6660256344337798, "sim_physics": 0.05675021568934123, "survival_time": 14.950000000000076, "driven_lanedir": 0.6432076063790508, "sim_render-ego": 0.036932358741760256, "in-drivable-lane": 4.600000000000034, "agent_compute-ego": 0.1030179222424825, "deviation-heading": 12.043785580032765, "set_robot_commands": 0.05659141063690185, "deviation-center-line": 1.2416735933499656, "driven_lanedir_consec": 0.6432076063790508, "sim_compute_sim_state": 0.02363350788752238, "sim_compute_performance-ego": 0.04004211664199829, "sim_compute_robot_state-ego": 0.04228564341862996}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0567753633368664, "sim_physics": 0.058730986383226186, "survival_time": 5.399999999999989, "driven_lanedir": 0.8806952004104415, "sim_render-ego": 0.03603848042311491, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1010220558555038, "deviation-heading": 0.9648607035056956, "set_robot_commands": 0.055834167533450656, "deviation-center-line": 0.5422618092905656, "driven_lanedir_consec": 0.8806952004104415, "sim_compute_sim_state": 0.023613174756368, "sim_compute_performance-ego": 0.04019058633733679, "sim_compute_robot_state-ego": 0.04220258968847769}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.6790659130362102, "sim_physics": 0.05713768800099691, "survival_time": 14.950000000000076, "driven_lanedir": 3.4974205048941274, "sim_render-ego": 0.03756674528121949, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.10235560019810996, "deviation-heading": 3.0760043411725215, "set_robot_commands": 0.05687939484914144, "deviation-center-line": 1.1136747044185755, "driven_lanedir_consec": 3.4974205048941274, "sim_compute_sim_state": 0.023855931758880615, "sim_compute_performance-ego": 0.03980957905451456, "sim_compute_robot_state-ego": 0.04238661209742228}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5880453521351603, "sim_physics": 0.061802438011875856, "survival_time": 5.399999999999989, "driven_lanedir": 1.2001799562560151, "sim_render-ego": 0.03698278577239425, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.10128984848658244, "deviation-heading": 0.422028089941221, "set_robot_commands": 0.05611858323768333, "deviation-center-line": 0.4110948048380859, "driven_lanedir_consec": 1.2001799562560151, "sim_compute_sim_state": 0.02399807506137424, "sim_compute_performance-ego": 0.03979752902631407, "sim_compute_robot_state-ego": 0.042150387057551635}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3350629067469348, "sim_physics": 0.05649277051289876, "survival_time": 14.950000000000076, "driven_lanedir": 1.1274069804245652, "sim_render-ego": 0.03695840358734131, "in-drivable-lane": 5.4500000000000135, "agent_compute-ego": 0.10166871468226114, "deviation-heading": 10.918357061658636, "set_robot_commands": 0.05646975596745809, "deviation-center-line": 0.7214578388011399, "driven_lanedir_consec": 1.127435436900436, "sim_compute_sim_state": 0.023653927644093832, "sim_compute_performance-ego": 0.039771531422932944, "sim_compute_robot_state-ego": 0.04206174294153849}}
set_robot_commands_max	0.05687939484914144
set_robot_commands_mean	0.05637866244492706
set_robot_commands_median	0.05646975596745809
set_robot_commands_min	0.055834167533450656
sim_compute_performance-ego_max	0.04019058633733679
sim_compute_performance-ego_mean	0.039922268496619326
sim_compute_performance-ego_median	0.03980957905451456
sim_compute_performance-ego_min	0.039771531422932944
sim_compute_robot_state-ego_max	0.04238661209742228
sim_compute_robot_state-ego_mean	0.04221739504072401
sim_compute_robot_state-ego_median	0.04220258968847769
sim_compute_robot_state-ego_min	0.04206174294153849
sim_compute_sim_state_max	0.02399807506137424
sim_compute_sim_state_mean	0.023750923421647818
sim_compute_sim_state_median	0.023653927644093832
sim_compute_sim_state_min	0.023613174756368
sim_physics_max	0.061802438011875856
sim_physics_mean	0.05818281971966779
sim_physics_median	0.05713768800099691
sim_physics_min	0.05649277051289876
sim_render-ego_max	0.03756674528121949
sim_render-ego_mean	0.03689575476116604
sim_render-ego_median	0.03695840358734131
sim_render-ego_min	0.03603848042311491
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.130000000000042
survival_time_min	5.399999999999989

No reset possible

21855

3321

Third test - TH

step1-simulation

host-error

2019-05-10 04:51:36+00:00

2019-05-10 05:00:30+00:00

0:08:54

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3321/step1-simulation-ip-172-31-38-104-5376-job21855/logs/challenges-runner/stdout.html'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21852

3318

RL - TH - shi

step1-simulation

error

2019-05-10 03:28:26+00:00

2019-05-10 03:28:54+00:00

0:00:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21850

3317

RL - TH - shi

step1-simulation

error

2019-05-10 03:19:31+00:00

2019-05-10 03:21:28+00:00

0:01:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21799

3279

Tony Hsiao

PredictorRandom

aido2-PRED

step1-simulation

success

2019-05-08 07:12:42+00:00

2019-05-08 07:13:12+00:00

0:00:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.3157540991377083
error_L2	0.1433984208487294

No reset possible

21796

3276

Timothius Victorio Yasin 🇦🇫

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

error

2019-05-08 06:34:03+00:00

2019-05-08 06:34:30+00:00

0:00:27

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 24, in check_compatible_protocol
    raise IncompatibleProtocol(msg)
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type <class 'aido_schemas.schemas.Duckiebot1Observations'> as <class 'float'>: Type <class 'aido_schemas.schemas.Duckiebot1Observations'>
 is not a subclass of <class 'float'>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 75, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 84, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 42, in check_compatible_protocol
    raise IncompatibleProtocol(msg) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
p1: |InteractionProtocol(description='Particularization for Duckiebot1 observations and commands.', inputs={'observations': <class 'aido_schemas.schemas.Duckiebot1Observations'>, 'seed': <class 'int'>, 'get_commands': <class 'NoneType'>, 'episode_start': <class 'aido_schemas.protocol_agent.EpisodeStart'>}, outputs={'commands': <class 'aido_schemas.schemas.Duckiebot1Commands'>}, language='(in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)')
p2: |InteractionProtocol(description='An estimator receives a stream of values and must predict the next value.', inputs={'observations': <class 'float'>, 'seed': <class 'int'>, 'get_prediction': <class 'NoneType'>}, outputs={'prediction': <class 'float'>}, language='(in:seed)? ; ((in:observations | (in:get_prediction ; out:prediction))*)')

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21792

3273

RL - TH -hhk

step1-simulation

host-error

2019-05-08 02:56:41+00:00

2019-05-08 03:01:49+00:00

0:05:08

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3273/step1-simulation-ip-172-31-38-104-5376-job21792/logs/challenges-runner/stdout.html'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21758

2981

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-05-07 21:01:47+00:00

2019-05-07 22:02:08+00:00

1:00:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-38-104-5376-job21758/logs/challenges-runner/stdout.html'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21736

2964

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-05-07 20:29:40+00:00

2019-05-07 21:01:10+00:00

0:31:30

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2964/step1-simulation-ip-172-31-38-104-5376-job21736/logs/challenges-runner/stdout.html'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21724

2555

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-05-07 20:01:21+00:00

2019-05-07 20:29:24+00:00

0:28:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2875407694053156
survival_time_median	2.849999999999998
deviation-center-line_median	0.11031194850197353
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.08360248141818577
agent_compute-ego_mean	0.07570646987116621
agent_compute-ego_median	0.07517876074864314
agent_compute-ego_min	0.07194498006035299
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.13746050030700233
deviation-center-line_min	0.07113819587235681
deviation-heading_max	1.4854398920276677
deviation-heading_mean	0.7236995121312619
deviation-heading_median	0.6953408166028192
deviation-heading_min	0.3118646573709166
driven_any_max	1.934434121703833
driven_any_mean	0.806757806634148
driven_any_median	0.8072381933001392
driven_any_min	0.20912585880423715
driven_lanedir_consec_max	0.7222251056746308
driven_lanedir_consec_mean	0.3962831867516217
driven_lanedir_consec_min	0.1917983424483971
driven_lanedir_max	0.7287863177121016
driven_lanedir_mean	0.3975640776898326
driven_lanedir_median	0.2875407694053156
driven_lanedir_min	0.1917983424483971
in-drivable-lane_max	4.04999999999999
in-drivable-lane_mean	1.2133333333333305
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.21971305019884224, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06529137599899108, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07480933292802558, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.10291667156908886, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04183615546628653, "sim_compute_performance-ego": 0.07292167537183647, "sim_compute_robot_state-ego": 0.08229595781808877, "sim_compute_robot_state-npc0": 0.07474334843187447, "sim_compute_robot_state-npc1": 0.07495336072990694, "sim_compute_robot_state-npc2": 0.07475591567625482, "sim_compute_robot_state-npc3": 0.07479555348315871}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.2415015079357006, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.0698604495437057, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08360248141818577, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10377788543701172, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04255442266111021, "sim_compute_performance-ego": 0.07618117332458496, "sim_compute_robot_state-ego": 0.08576837292423954, "sim_compute_robot_state-npc0": 0.07452605388782642, "sim_compute_robot_state-npc1": 0.07422569946006492, "sim_compute_robot_state-npc2": 0.0758062380331534, "sim_compute_robot_state-npc3": 0.07585843404134114}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21889122938498473, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06719901317205185, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07921151014474723, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10273241385435448, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04077196426880665, "sim_compute_performance-ego": 0.07073049056224334, "sim_compute_robot_state-ego": 0.07786347315861629, "sim_compute_robot_state-npc0": 0.07410646707583697, "sim_compute_robot_state-npc1": 0.07008930047353108, "sim_compute_robot_state-npc2": 0.07160702729836488, "sim_compute_robot_state-npc3": 0.07345421191973564}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.2303532048275596, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06951144703647547, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.0767586022092585, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.1049290707236842, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.04272693500184176, "sim_compute_performance-ego": 0.07193082675599215, "sim_compute_robot_state-ego": 0.08276017506917317, "sim_compute_robot_state-npc0": 0.07243623231586657, "sim_compute_robot_state-npc1": 0.07181118663988616, "sim_compute_robot_state-npc2": 0.07272381113286604, "sim_compute_robot_state-npc3": 0.07261112698337488}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.21333026885986328, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06336672409721043, "in-drivable-lane": 0, "agent_compute-ego": 0.07365736754044243, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.1018656233082647, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.03860729673634405, "sim_compute_performance-ego": 0.07272805338320525, "sim_compute_robot_state-ego": 0.07879545377648395, "sim_compute_robot_state-npc0": 0.07340624021447223, "sim_compute_robot_state-npc1": 0.07388538899629013, "sim_compute_robot_state-npc2": 0.07338331056677777, "sim_compute_robot_state-npc3": 0.070611456166143}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.2132624060499902, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06295125858456481, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07194498006035299, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.09975638109094956, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04021930227092668, "sim_compute_performance-ego": 0.07074877327563715, "sim_compute_robot_state-ego": 0.07606104308483648, "sim_compute_robot_state-npc0": 0.0731357920403574, "sim_compute_robot_state-npc1": 0.07195228221369725, "sim_compute_robot_state-npc2": 0.0696944185331756, "sim_compute_robot_state-npc3": 0.07183462498234768}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.21377171959195815, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.0674081904547555, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07423218658992223, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.10369638545172556, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04439753804888044, "sim_compute_performance-ego": 0.07101448774337768, "sim_compute_robot_state-ego": 0.07611033746174403, "sim_compute_robot_state-npc0": 0.069724554674966, "sim_compute_robot_state-npc1": 0.07099975177219936, "sim_compute_robot_state-npc2": 0.07012201036725725, "sim_compute_robot_state-npc3": 0.07098725863865443}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.23155147082185093, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06993991708102291, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07837003551117361, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10348085507954637, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.04019686947130177, "sim_compute_performance-ego": 0.08236809299416738, "sim_compute_robot_state-ego": 0.08445480751664672, "sim_compute_robot_state-npc0": 0.07411551148924109, "sim_compute_robot_state-npc1": 0.07434668606274748, "sim_compute_robot_state-npc2": 0.07235724958654953, "sim_compute_robot_state-npc3": 0.07182183657606987}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.20133208674053812, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06334603941717813, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07203931309456049, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.09972476404766704, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.038926742797674135, "sim_compute_performance-ego": 0.07277721027995265, "sim_compute_robot_state-ego": 0.07858352328455726, "sim_compute_robot_state-npc0": 0.07051047890685326, "sim_compute_robot_state-npc1": 0.0691438358883525, "sim_compute_robot_state-npc2": 0.07539196901543196, "sim_compute_robot_state-npc3": 0.06887476111567298}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.2454432615867028, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06952397639934833, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07517876074864314, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10062213127429669, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.04450632975651668, "sim_compute_performance-ego": 0.07516727997706486, "sim_compute_robot_state-ego": 0.08419566888075608, "sim_compute_robot_state-npc0": 0.07356224610255314, "sim_compute_robot_state-npc1": 0.07081696620354286, "sim_compute_robot_state-npc2": 0.07408851843613845, "sim_compute_robot_state-npc3": 0.07290754868434025}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.2064703909556071, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06352205594380697, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07287702560424805, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.1034156894683838, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.039400914510091145, "sim_compute_performance-ego": 0.07031529426574706, "sim_compute_robot_state-ego": 0.07625905990600586, "sim_compute_robot_state-npc0": 0.07250308672587077, "sim_compute_robot_state-npc1": 0.0727016830444336, "sim_compute_robot_state-npc2": 0.0735417652130127, "sim_compute_robot_state-npc3": 0.07343718528747559}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.2141775403703962, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06857011431739443, "in-drivable-lane": 0, "agent_compute-ego": 0.077229034333002, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.1084737777709961, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.04372784069606236, "sim_compute_performance-ego": 0.07427911531357538, "sim_compute_robot_state-ego": 0.07965972310020811, "sim_compute_robot_state-npc0": 0.075713316599528, "sim_compute_robot_state-npc1": 0.07340348334539504, "sim_compute_robot_state-npc2": 0.07640706925165086, "sim_compute_robot_state-npc3": 0.07544004349481492}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.22818589210510257, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06350913713144701, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07250849036283272, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.10292772359626236, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.03960398186084836, "sim_compute_performance-ego": 0.07286576892054358, "sim_compute_robot_state-ego": 0.08289500169975814, "sim_compute_robot_state-npc0": 0.07484193735344466, "sim_compute_robot_state-npc1": 0.07208609580993652, "sim_compute_robot_state-npc2": 0.0696822488030722, "sim_compute_robot_state-npc3": 0.06894375002661417}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.217792238507952, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.07001251833779472, "in-drivable-lane": 0, "agent_compute-ego": 0.07687270641326904, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.1013044033731733, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04043649775641305, "sim_compute_performance-ego": 0.06995661769594465, "sim_compute_robot_state-ego": 0.07576074770518712, "sim_compute_robot_state-npc0": 0.07426473072596959, "sim_compute_robot_state-npc1": 0.07354917696544103, "sim_compute_robot_state-npc2": 0.07235233272824969, "sim_compute_robot_state-npc3": 0.07370316130774361}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.24918372490826776, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06395269375221402, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07630522110882927, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.10264085788352816, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04337125666001264, "sim_compute_performance-ego": 0.07376802201364555, "sim_compute_robot_state-ego": 0.0816789094139548, "sim_compute_robot_state-npc0": 0.07468568109998516, "sim_compute_robot_state-npc1": 0.0761255376479205, "sim_compute_robot_state-npc2": 0.07373621884514303, "sim_compute_robot_state-npc3": 0.07822431302538105}}
set_robot_commands_max	0.1084737777709961
set_robot_commands_mean	0.10281764226192888
set_robot_commands_median	0.10291667156908886
set_robot_commands_min	0.09972476404766704
sim_compute_performance-ego_max	0.08236809299416738
sim_compute_performance-ego_mean	0.07318352545850122
sim_compute_performance-ego_median	0.07277721027995265
sim_compute_performance-ego_min	0.06995661769594465
sim_compute_robot_state-ego_max	0.08576837292423954
sim_compute_robot_state-ego_mean	0.08020948365335043
sim_compute_robot_state-ego_median	0.07965972310020811
sim_compute_robot_state-ego_min	0.07576074770518712
sim_compute_robot_state-npc0_max	0.075713316599528
sim_compute_robot_state-npc0_mean	0.07348504517630973
sim_compute_robot_state-npc0_median	0.07410646707583697
sim_compute_robot_state-npc0_min	0.069724554674966
sim_compute_robot_state-npc1_max	0.0761255376479205
sim_compute_robot_state-npc1_mean	0.07267269568355635
sim_compute_robot_state-npc1_median	0.0727016830444336
sim_compute_robot_state-npc1_min	0.0691438358883525
sim_compute_robot_state-npc2_max	0.07640706925165086
sim_compute_robot_state-npc2_mean	0.0730433402324732
sim_compute_robot_state-npc2_median	0.07338331056677777
sim_compute_robot_state-npc2_min	0.0696822488030722
sim_compute_robot_state-npc3_max	0.07822431302538105
sim_compute_robot_state-npc3_mean	0.07290035104885785
sim_compute_robot_state-npc3_median	0.07290754868434025
sim_compute_robot_state-npc3_min	0.06887476111567298
sim_compute_sim_state_max	0.04450632975651668
sim_compute_sim_state_mean	0.04141893653087443
sim_compute_sim_state_median	0.04077196426880665
sim_compute_sim_state_min	0.03860729673634405
sim_physics_max	0.24918372490826776
sim_physics_mean	0.22299733285635437
sim_physics_median	0.21889122938498473
sim_physics_min	0.20133208674053812
sim_render-ego_max	0.07001251833779472
sim_render-ego_mean	0.06653099408453075
sim_render-ego_median	0.06719901317205185
sim_render-ego_min	0.06295125858456481
simulation-passed	1
survival_time_max	6.999999999999983
survival_time_mean	3.043333333333329
survival_time_min	1.0500000000000005

No reset possible

21709

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error