Evaluator 777

step1-simulation

success

2019-04-25 14:59:36+00:00

2019-04-25 15:17:14+00:00

0:17:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7406162049123841
survival_time_median	9.950000000000006
deviation-center-line_median	0.3302177143601141
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15946732337818395
agent_compute-ego_mean	0.14566702057522787
agent_compute-ego_median	0.14382830634713173
agent_compute-ego_min	0.13522730906804403
deviation-center-line_max	0.6904628736300545
deviation-center-line_mean	0.3874259749000404
deviation-center-line_min	0.2530034862371619
deviation-heading_max	1.0778162767766089
deviation-heading_mean	0.8215479365254513
deviation-heading_median	0.9150868055674838
deviation-heading_min	0.3781055846447399
driven_any_max	2.20273818289615
driven_any_mean	1.2469484705963905
driven_any_median	1.4279632190835694
driven_any_min	0.4328289963250949
driven_lanedir_consec_max	2.201596053570166
driven_lanedir_consec_mean	1.1015078923939634
driven_lanedir_consec_min	0.4219705604336601
driven_lanedir_max	2.201596053570166
driven_lanedir_mean	1.1015543630441058
driven_lanedir_median	0.7406162049123841
driven_lanedir_min	0.4219705604336601
in-drivable-lane_max	4.550000000000018
in-drivable-lane_mean	0.9100000000000036
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.6645051945479123, "sim_physics": 0.1177824688790667, "survival_time": 11.450000000000028, "driven_lanedir": 1.6584103880801533, "sim_render-ego": 0.05914980667647316, "in-drivable-lane": 0, "agent_compute-ego": 0.15946732337818395, "deviation-heading": 0.9150868055674838, "set_robot_commands": 0.07720691043737153, "deviation-center-line": 0.6904628736300545, "driven_lanedir_consec": 1.6581780348294406, "sim_compute_sim_state": 0.03562007408475251, "sim_compute_performance-ego": 0.062332126250954176, "sim_compute_robot_state-ego": 0.060436394537380166, "sim_compute_robot_state-npc0": 0.06865329513383224, "sim_compute_robot_state-npc1": 0.06445230042570023, "sim_compute_robot_state-npc2": 0.06386728682372247, "sim_compute_robot_state-npc3": 0.06539600593033837}, "udem1-1-0": {"driven_any": 0.5067067601292259, "sim_physics": 0.09850074167120948, "survival_time": 3.649999999999995, "driven_lanedir": 0.4851786082241656, "sim_render-ego": 0.06400263146178363, "in-drivable-lane": 0, "agent_compute-ego": 0.1475848139148869, "deviation-heading": 1.0778162767766089, "set_robot_commands": 0.07837974861876605, "deviation-center-line": 0.25585703994298503, "driven_lanedir_consec": 0.4851786082241656, "sim_compute_sim_state": 0.039275590687581935, "sim_compute_performance-ego": 0.06309600725565871, "sim_compute_robot_state-ego": 0.06396588234052267, "sim_compute_robot_state-npc0": 0.07553100912538294, "sim_compute_robot_state-npc1": 0.0699357463888926, "sim_compute_robot_state-npc2": 0.06823340180802019, "sim_compute_robot_state-npc3": 0.0689894630484385}, "udem1-2-0": {"driven_any": 1.4279632190835694, "sim_physics": 0.11154718614702848, "survival_time": 9.950000000000006, "driven_lanedir": 0.7406162049123841, "sim_render-ego": 0.05740314632204909, "in-drivable-lane": 4.550000000000018, "agent_compute-ego": 0.14222735016789267, "deviation-heading": 1.0112025852481552, "set_robot_commands": 0.07784633660436276, "deviation-center-line": 0.3302177143601141, "driven_lanedir_consec": 0.7406162049123841, "sim_compute_sim_state": 0.03484979826002265, "sim_compute_performance-ego": 0.0627690188249751, "sim_compute_robot_state-ego": 0.060187953201370624, "sim_compute_robot_state-npc0": 0.06911681285455598, "sim_compute_robot_state-npc1": 0.06466027240657327, "sim_compute_robot_state-npc2": 0.06308059356919485, "sim_compute_robot_state-npc3": 0.06260661144352439}, "udem1-3-0": {"driven_any": 2.20273818289615, "sim_physics": 0.12238462289174398, "survival_time": 14.950000000000076, "driven_lanedir": 2.201596053570166, "sim_render-ego": 0.054865829149882, "in-drivable-lane": 0, "agent_compute-ego": 0.13522730906804403, "deviation-heading": 0.3781055846447399, "set_robot_commands": 0.07462424437204997, "deviation-center-line": 0.4075887603298862, "driven_lanedir_consec": 2.201596053570166, "sim_compute_sim_state": 0.03415902694066365, "sim_compute_performance-ego": 0.05902993679046631, "sim_compute_robot_state-ego": 0.06109031756718954, "sim_compute_robot_state-npc0": 0.06532902797063192, "sim_compute_robot_state-npc1": 0.061717787583669026, "sim_compute_robot_state-npc2": 0.06014169057210286, "sim_compute_robot_state-npc3": 0.05987952470779419}, "udem1-4-0": {"driven_any": 0.4328289963250949, "sim_physics": 0.09831463918089868, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4219705604336601, "sim_render-ego": 0.05880428105592728, "in-drivable-lane": 0, "agent_compute-ego": 0.14382830634713173, "deviation-heading": 0.7255284303902685, "set_robot_commands": 0.07818508893251419, "deviation-center-line": 0.2530034862371619, "driven_lanedir_consec": 0.4219705604336601, "sim_compute_sim_state": 0.034754280000925064, "sim_compute_performance-ego": 0.06069193035364151, "sim_compute_robot_state-ego": 0.06162373349070549, "sim_compute_robot_state-npc0": 0.0646270215511322, "sim_compute_robot_state-npc1": 0.06339213624596596, "sim_compute_robot_state-npc2": 0.061686281114816666, "sim_compute_robot_state-npc3": 0.0601111575961113}}
set_robot_commands_max	0.07837974861876605
set_robot_commands_mean	0.0772484657930129
set_robot_commands_median	0.07784633660436276
set_robot_commands_min	0.07462424437204997
sim_compute_performance-ego_max	0.06309600725565871
sim_compute_performance-ego_mean	0.06158380389513916
sim_compute_performance-ego_median	0.062332126250954176
sim_compute_performance-ego_min	0.05902993679046631
sim_compute_robot_state-ego_max	0.06396588234052267
sim_compute_robot_state-ego_mean	0.061460856227433705
sim_compute_robot_state-ego_median	0.06109031756718954
sim_compute_robot_state-ego_min	0.060187953201370624
sim_compute_robot_state-npc0_max	0.07553100912538294
sim_compute_robot_state-npc0_mean	0.06865143332710706
sim_compute_robot_state-npc0_median	0.06865329513383224
sim_compute_robot_state-npc0_min	0.0646270215511322
sim_compute_robot_state-npc1_max	0.0699357463888926
sim_compute_robot_state-npc1_mean	0.06483164861016022
sim_compute_robot_state-npc1_median	0.06445230042570023
sim_compute_robot_state-npc1_min	0.061717787583669026
sim_compute_robot_state-npc2_max	0.06823340180802019
sim_compute_robot_state-npc2_mean	0.0634018507775714
sim_compute_robot_state-npc2_median	0.06308059356919485
sim_compute_robot_state-npc2_min	0.06014169057210286
sim_compute_robot_state-npc3_max	0.0689894630484385
sim_compute_robot_state-npc3_mean	0.06339655254524135
sim_compute_robot_state-npc3_median	0.06260661144352439
sim_compute_robot_state-npc3_min	0.05987952470779419
sim_compute_sim_state_max	0.039275590687581935
sim_compute_sim_state_mean	0.03573175399478916
sim_compute_sim_state_median	0.03484979826002265
sim_compute_sim_state_min	0.03415902694066365
sim_physics_max	0.12238462289174398
sim_physics_mean	0.10970593175398946
sim_physics_median	0.11154718614702848
sim_physics_min	0.09831463918089868
sim_render-ego_max	0.06400263146178363
sim_render-ego_mean	0.05884513893322303
sim_render-ego_median	0.05880428105592728
sim_render-ego_min	0.054865829149882
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.64000000000002
survival_time_min	3.1999999999999966

No reset possible

20606

2385

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:54:51+00:00

2019-04-25 14:59:29+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.13478852998191737
survival_time_median	1.2500000000000004
deviation-center-line_median	0.0935601292819921
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.22792916462339205
agent_compute-ego_mean	0.20282102713091624
agent_compute-ego_median	0.20237389206886292
agent_compute-ego_min	0.16478919982910156
deviation-center-line_max	0.1074969413555919
deviation-center-line_mean	0.09356619193735614
deviation-center-line_min	0.06944600958170305
deviation-heading_max	0.9764057486991816
deviation-heading_mean	0.6843173066280346
deviation-heading_median	0.639777522221276
deviation-heading_min	0.46786035240737733
driven_any_max	0.2250821670241124
driven_any_mean	0.1912640707617395
driven_any_median	0.194057940563626
driven_any_min	0.1562673264380681
driven_lanedir_consec_max	0.15252424057158964
driven_lanedir_consec_mean	0.1394564697998742
driven_lanedir_consec_min	0.12483910079913364
driven_lanedir_max	0.15252424057158964
driven_lanedir_mean	0.1394564697998742
driven_lanedir_median	0.13478852998191737
driven_lanedir_min	0.12483910079913364
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2250821670241124, "sim_physics": 0.0878229963368383, "survival_time": 1.4500000000000006, "driven_lanedir": 0.15045262911568802, "sim_render-ego": 0.0523156790897764, "in-drivable-lane": 0, "agent_compute-ego": 0.22792916462339205, "deviation-heading": 0.8550203930030855, "set_robot_commands": 0.07255534468025997, "deviation-center-line": 0.0935601292819921, "driven_lanedir_consec": 0.15045262911568802, "sim_compute_sim_state": 0.03172533265475569, "sim_compute_performance-ego": 0.05644333773645861, "sim_compute_robot_state-ego": 0.05853035532194992, "sim_compute_robot_state-npc0": 0.06360597446047027, "sim_compute_robot_state-npc1": 0.06068185280109274, "sim_compute_robot_state-npc2": 0.05791883633054536, "sim_compute_robot_state-npc3": 0.05862837824328192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21617751947221311, "sim_physics": 0.08022610346476237, "survival_time": 1.3500000000000003, "driven_lanedir": 0.13467784853104223, "sim_render-ego": 0.05272236576786748, "in-drivable-lane": 0, "agent_compute-ego": 0.16478919982910156, "deviation-heading": 0.9764057486991816, "set_robot_commands": 0.0729489767992938, "deviation-center-line": 0.09230868860955968, "driven_lanedir_consec": 0.13467784853104223, "sim_compute_sim_state": 0.03241792431584111, "sim_compute_performance-ego": 0.056758765821103695, "sim_compute_robot_state-ego": 0.059917573575620296, "sim_compute_robot_state-npc0": 0.0627909677999991, "sim_compute_robot_state-npc1": 0.05633101639924226, "sim_compute_robot_state-npc2": 0.056005124692563656, "sim_compute_robot_state-npc3": 0.05598565384193703}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1562673264380681, "sim_physics": 0.0806686778863271, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12483910079913364, "sim_render-ego": 0.05473506450653076, "in-drivable-lane": 0, "agent_compute-ego": 0.1931743323802948, "deviation-heading": 0.46786035240737733, "set_robot_commands": 0.07713985443115234, "deviation-center-line": 0.10501919085793404, "driven_lanedir_consec": 0.12483910079913364, "sim_compute_sim_state": 0.03434582551320394, "sim_compute_performance-ego": 0.05588976542154948, "sim_compute_robot_state-ego": 0.06030258536338806, "sim_compute_robot_state-npc0": 0.0718295971552531, "sim_compute_robot_state-npc1": 0.06309181451797485, "sim_compute_robot_state-npc2": 0.059623648722966514, "sim_compute_robot_state-npc3": 0.06037574013074239}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16473540031067804, "sim_physics": 0.08972331047058106, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13478852998191737, "sim_render-ego": 0.05611663818359375, "in-drivable-lane": 0, "agent_compute-ego": 0.2258385467529297, "deviation-heading": 0.48252251680925207, "set_robot_commands": 0.07254212379455566, "deviation-center-line": 0.1074969413555919, "driven_lanedir_consec": 0.13478852998191737, "sim_compute_sim_state": 0.03251335144042969, "sim_compute_performance-ego": 0.05850143432617187, "sim_compute_robot_state-ego": 0.0604715633392334, "sim_compute_robot_state-npc0": 0.06239264488220215, "sim_compute_robot_state-npc1": 0.05949882507324219, "sim_compute_robot_state-npc2": 0.05579360008239746, "sim_compute_robot_state-npc3": 0.05764728546142578}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.194057940563626, "sim_physics": 0.0737630029519399, "survival_time": 1.2000000000000004, "driven_lanedir": 0.15252424057158964, "sim_render-ego": 0.0540939470132192, "in-drivable-lane": 0, "agent_compute-ego": 0.20237389206886292, "deviation-heading": 0.639777522221276, "set_robot_commands": 0.07303805152575175, "deviation-center-line": 0.06944600958170305, "driven_lanedir_consec": 0.15252424057158964, "sim_compute_sim_state": 0.032888044913609825, "sim_compute_performance-ego": 0.058079818884531655, "sim_compute_robot_state-ego": 0.05978761116663615, "sim_compute_robot_state-npc0": 0.06491450468699138, "sim_compute_robot_state-npc1": 0.059256662925084434, "sim_compute_robot_state-npc2": 0.06037243207295736, "sim_compute_robot_state-npc3": 0.05961968501408895}}
set_robot_commands_max	0.07713985443115234
set_robot_commands_mean	0.07364487024620271
set_robot_commands_median	0.0729489767992938
set_robot_commands_min	0.07254212379455566
sim_compute_performance-ego_max	0.05850143432617187
sim_compute_performance-ego_mean	0.057134624437963064
sim_compute_performance-ego_median	0.056758765821103695
sim_compute_performance-ego_min	0.05588976542154948
sim_compute_robot_state-ego_max	0.0604715633392334
sim_compute_robot_state-ego_mean	0.05980193775336557
sim_compute_robot_state-ego_median	0.059917573575620296
sim_compute_robot_state-ego_min	0.05853035532194992
sim_compute_robot_state-npc0_max	0.0718295971552531
sim_compute_robot_state-npc0_mean	0.0651067377969832
sim_compute_robot_state-npc0_median	0.06360597446047027
sim_compute_robot_state-npc0_min	0.06239264488220215
sim_compute_robot_state-npc1_max	0.06309181451797485
sim_compute_robot_state-npc1_mean	0.0597720343433273
sim_compute_robot_state-npc1_median	0.05949882507324219
sim_compute_robot_state-npc1_min	0.05633101639924226
sim_compute_robot_state-npc2_max	0.06037243207295736
sim_compute_robot_state-npc2_mean	0.057942728380286065
sim_compute_robot_state-npc2_median	0.05791883633054536
sim_compute_robot_state-npc2_min	0.05579360008239746
sim_compute_robot_state-npc3_max	0.06037574013074239
sim_compute_robot_state-npc3_mean	0.058451348538295214
sim_compute_robot_state-npc3_median	0.05862837824328192
sim_compute_robot_state-npc3_min	0.05598565384193703
sim_compute_sim_state_max	0.03434582551320394
sim_compute_sim_state_mean	0.03277809576756806
sim_compute_sim_state_median	0.03251335144042969
sim_compute_sim_state_min	0.03172533265475569
sim_physics_max	0.08972331047058106
sim_physics_mean	0.08244081822208973
sim_physics_median	0.0806686778863271
sim_physics_min	0.0737630029519399
sim_render-ego_max	0.05611663818359375
sim_render-ego_mean	0.053996738912197514
sim_render-ego_median	0.0540939470132192
sim_render-ego_min	0.0523156790897764
simulation-passed	1
survival_time_max	1.4500000000000006
survival_time_mean	1.2900000000000005
survival_time_min	1.2000000000000004

No reset possible

20596

2392

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-25 14:50:00+00:00

2019-04-25 14:54:38+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.13352839152018228
agent_compute-ego_mean	0.12803440432024854
agent_compute-ego_median	0.1258968925476074
agent_compute-ego_min	0.12314573773797952
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.058247377287666754, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05962764991904205, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.12314573773797952, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.0761797068254003, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.035808819644856, "sim_compute_performance-ego": 0.06136401194446492, "sim_compute_robot_state-ego": 0.06248173623714807}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.05606833329567543, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.05694006956540621, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1321503336612995, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.08010996763522808, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03815548695050753, "sim_compute_performance-ego": 0.06315737045728244, "sim_compute_robot_state-ego": 0.06420128620587863}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.04525882667965359, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.05485208829243978, "in-drivable-lane": 0, "agent_compute-ego": 0.13352839152018228, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.08012257681952582, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.035432391696506076, "sim_compute_performance-ego": 0.059431645605299205, "sim_compute_robot_state-ego": 0.05662975046369764}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.05326038360595703, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.056447868347167966, "in-drivable-lane": 0, "agent_compute-ego": 0.1258968925476074, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.07919147491455078, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.03919110298156738, "sim_compute_performance-ego": 0.06156599044799805, "sim_compute_robot_state-ego": 0.06904356956481933}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.05244808319287422, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.057705454337291226, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.12545066613417405, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.07942526157085712, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03772439100803473, "sim_compute_performance-ego": 0.061758930866534896, "sim_compute_robot_state-ego": 0.061934000406509794}}
set_robot_commands_max	0.08012257681952582
set_robot_commands_mean	0.07900579755311242
set_robot_commands_median	0.07942526157085712
set_robot_commands_min	0.0761797068254003
sim_compute_performance-ego_max	0.06315737045728244
sim_compute_performance-ego_mean	0.061455589864315895
sim_compute_performance-ego_median	0.06156599044799805
sim_compute_performance-ego_min	0.059431645605299205
sim_compute_robot_state-ego_max	0.06904356956481933
sim_compute_robot_state-ego_mean	0.0628580685756107
sim_compute_robot_state-ego_median	0.06248173623714807
sim_compute_robot_state-ego_min	0.05662975046369764
sim_compute_sim_state_max	0.03919110298156738
sim_compute_sim_state_mean	0.037262438456294344
sim_compute_sim_state_median	0.03772439100803473
sim_compute_sim_state_min	0.035432391696506076
sim_physics_max	0.058247377287666754
sim_physics_mean	0.053056600812365406
sim_physics_median	0.05326038360595703
sim_physics_min	0.04525882667965359
sim_render-ego_max	0.05962764991904205
sim_render-ego_mean	0.05711462609226945
sim_render-ego_median	0.05694006956540621
sim_render-ego_min	0.05485208829243978
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20591

2405

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:45:15+00:00

2019-04-25 14:49:53+00:00

0:04:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07751589237048018
survival_time_median	1.1500000000000004
deviation-center-line_median	0.08519343779038901
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.2203097550765328
agent_compute-ego_mean	0.19410055544200017
agent_compute-ego_median	0.194295292808896
agent_compute-ego_min	0.16808548840609464
deviation-center-line_max	0.09725984015332131
deviation-center-line_mean	0.0747508203972187
deviation-center-line_min	0.03627322930012288
deviation-heading_max	0.90822476906147
deviation-heading_mean	0.6743205738942029
deviation-heading_median	0.7056707048109792
deviation-heading_min	0.4466628828187254
driven_any_max	0.2423136217272155
driven_any_mean	0.1661304260655037
driven_any_median	0.1697312919756228
driven_any_min	0.11233018437300382
driven_lanedir_consec_max	0.1595854635262679
driven_lanedir_consec_mean	0.09834078085612824
driven_lanedir_consec_min	0.057621209008242746
driven_lanedir_max	0.1595854635262679
driven_lanedir_mean	0.09834078085612824
driven_lanedir_median	0.07751589237048018
driven_lanedir_min	0.057621209008242746
in-drivable-lane_max	0.20000000000000015
in-drivable-lane_mean	0.08000000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2423136217272155, "sim_physics": 0.09515643914540609, "survival_time": 1.5000000000000009, "driven_lanedir": 0.1595854635262679, "sim_render-ego": 0.053874699274698894, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1957144578297933, "deviation-heading": 0.8071978988955479, "set_robot_commands": 0.07714331150054932, "deviation-center-line": 0.08519343779038901, "driven_lanedir_consec": 0.1595854635262679, "sim_compute_sim_state": 0.03245668411254883, "sim_compute_performance-ego": 0.057625222206115725, "sim_compute_robot_state-ego": 0.05865818659464518, "sim_compute_robot_state-npc0": 0.06574389934539795, "sim_compute_robot_state-npc1": 0.0606427272160848, "sim_compute_robot_state-npc2": 0.05812779267628987, "sim_compute_robot_state-npc3": 0.05514551003774007}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17795561517256403, "sim_physics": 0.08238643866318923, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05976328409653853, "sim_render-ego": 0.06084220225994404, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.19209778308868408, "deviation-heading": 0.90822476906147, "set_robot_commands": 0.0765010852080125, "deviation-center-line": 0.06553208782555336, "driven_lanedir_consec": 0.05976328409653853, "sim_compute_sim_state": 0.033130297294029824, "sim_compute_performance-ego": 0.06239938735961914, "sim_compute_robot_state-ego": 0.0608219183408297, "sim_compute_robot_state-npc0": 0.0710829496383667, "sim_compute_robot_state-npc1": 0.06475676940037654, "sim_compute_robot_state-npc2": 0.06115844616523155, "sim_compute_robot_state-npc3": 0.06461018782395583}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11233018437300382, "sim_physics": 0.08267671721322196, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07751589237048018, "sim_render-ego": 0.05408385821751186, "in-drivable-lane": 0, "agent_compute-ego": 0.194295292808896, "deviation-heading": 0.5038466138842919, "set_robot_commands": 0.07811889194306873, "deviation-center-line": 0.0894955069167069, "driven_lanedir_consec": 0.07751589237048018, "sim_compute_sim_state": 0.0345235892704555, "sim_compute_performance-ego": 0.06354196866353352, "sim_compute_robot_state-ego": 0.0601114204951695, "sim_compute_robot_state-npc0": 0.06519046283903576, "sim_compute_robot_state-npc1": 0.06100803329831078, "sim_compute_robot_state-npc2": 0.06200858524867466, "sim_compute_robot_state-npc3": 0.06298057238260905}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1697312919756228, "sim_physics": 0.09180868190267812, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1372180552791118, "sim_render-ego": 0.055777155834695565, "in-drivable-lane": 0, "agent_compute-ego": 0.2203097550765328, "deviation-heading": 0.4466628828187254, "set_robot_commands": 0.07014982596687648, "deviation-center-line": 0.09725984015332131, "driven_lanedir_consec": 0.1372180552791118, "sim_compute_sim_state": 0.03409402266792629, "sim_compute_performance-ego": 0.06413615268209706, "sim_compute_robot_state-ego": 0.06425509245499321, "sim_compute_robot_state-npc0": 0.06289742303931195, "sim_compute_robot_state-npc1": 0.059667618378348976, "sim_compute_robot_state-npc2": 0.06008367953093156, "sim_compute_robot_state-npc3": 0.06061714628468389}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.12832141707911235, "sim_physics": 0.07254175706343217, "survival_time": 1.1000000000000003, "driven_lanedir": 0.057621209008242746, "sim_render-ego": 0.05228275602514094, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16808548840609464, "deviation-heading": 0.7056707048109792, "set_robot_commands": 0.07250275395133278, "deviation-center-line": 0.03627322930012288, "driven_lanedir_consec": 0.057621209008242746, "sim_compute_sim_state": 0.033549167893149635, "sim_compute_performance-ego": 0.054442828351801094, "sim_compute_robot_state-ego": 0.05700057203119451, "sim_compute_robot_state-npc0": 0.06472303650595924, "sim_compute_robot_state-npc1": 0.06144857406616211, "sim_compute_robot_state-npc2": 0.06009062853726474, "sim_compute_robot_state-npc3": 0.06197249889373779}}
set_robot_commands_max	0.07811889194306873
set_robot_commands_mean	0.07488317371396797
set_robot_commands_median	0.0765010852080125
set_robot_commands_min	0.07014982596687648
sim_compute_performance-ego_max	0.06413615268209706
sim_compute_performance-ego_mean	0.06042911185263331
sim_compute_performance-ego_median	0.06239938735961914
sim_compute_performance-ego_min	0.054442828351801094
sim_compute_robot_state-ego_max	0.06425509245499321
sim_compute_robot_state-ego_mean	0.06016943798336642
sim_compute_robot_state-ego_median	0.0601114204951695
sim_compute_robot_state-ego_min	0.05700057203119451
sim_compute_robot_state-npc0_max	0.0710829496383667
sim_compute_robot_state-npc0_mean	0.06592755427361432
sim_compute_robot_state-npc0_median	0.06519046283903576
sim_compute_robot_state-npc0_min	0.06289742303931195
sim_compute_robot_state-npc1_max	0.06475676940037654
sim_compute_robot_state-npc1_mean	0.06150474447185663
sim_compute_robot_state-npc1_median	0.06100803329831078
sim_compute_robot_state-npc1_min	0.059667618378348976
sim_compute_robot_state-npc2_max	0.06200858524867466
sim_compute_robot_state-npc2_mean	0.06029382643167848
sim_compute_robot_state-npc2_median	0.06009062853726474
sim_compute_robot_state-npc2_min	0.05812779267628987
sim_compute_robot_state-npc3_max	0.06461018782395583
sim_compute_robot_state-npc3_mean	0.06106518308454533
sim_compute_robot_state-npc3_median	0.06197249889373779
sim_compute_robot_state-npc3_min	0.05514551003774007
sim_compute_sim_state_max	0.0345235892704555
sim_compute_sim_state_mean	0.03355075224762201
sim_compute_sim_state_median	0.033549167893149635
sim_compute_sim_state_min	0.03245668411254883
sim_physics_max	0.09515643914540609
sim_physics_mean	0.08491400679758551
sim_physics_median	0.08267671721322196
sim_physics_min	0.07254175706343217
sim_render-ego_max	0.06084220225994404
sim_render-ego_mean	0.05537213432239826
sim_render-ego_median	0.05408385821751186
sim_render-ego_min	0.05228275602514094
simulation-passed	1
survival_time_max	1.5000000000000009
survival_time_mean	1.2200000000000004
survival_time_min	1.0500000000000005

No reset possible

20219

2982

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:15:44+00:00

2019-04-25 10:39:48+00:00

0:24:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7957508380698788
survival_time_median	12.650000000000045
deviation-center-line_median	0.8294011792639612
in-drivable-lane_median	0.6500000000000092

other stats

agent_compute-ego_max	0.18907193422317503
agent_compute-ego_mean	0.1875761167630697
agent_compute-ego_median	0.18745577971140545
agent_compute-ego_min	0.18605148179728995
deviation-center-line_max	1.48763528402887
deviation-center-line_mean	0.7887218403093292
deviation-center-line_min	0.30876318427113575
deviation-heading_max	2.8895648067772344
deviation-heading_mean	1.80248943043622
deviation-heading_median	1.7266540720807406
deviation-heading_min	1.0672675930091362
driven_any_max	1.516133362482185
driven_any_mean	1.0944026310494546
driven_any_median	1.034895059531196
driven_any_min	0.5192585461317222
driven_lanedir_consec_max	1.5079895885789136
driven_lanedir_consec_mean	0.8762452349578431
driven_lanedir_consec_min	0.4662403619960642
driven_lanedir_max	1.5079897675952842
driven_lanedir_mean	0.935629236906142
driven_lanedir_median	0.7957508380698788
driven_lanedir_min	0.4662403619960642
in-drivable-lane_max	3.300000000000047
in-drivable-lane_mean	1.4300000000000197
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.516133362482185, "sim_physics": 0.11402761061986288, "survival_time": 14.950000000000076, "driven_lanedir": 1.5079897675952842, "sim_render-ego": 0.05962657292683919, "in-drivable-lane": 0, "agent_compute-ego": 0.18745577971140545, "deviation-heading": 1.1643680885686312, "set_robot_commands": 0.07601450920104981, "deviation-center-line": 0.8512062333965807, "driven_lanedir_consec": 1.5079895885789136, "sim_compute_sim_state": 0.03734231233596802, "sim_compute_performance-ego": 0.06308534304300945, "sim_compute_robot_state-ego": 0.06073898951212565, "sim_compute_robot_state-npc0": 0.06824959913889567, "sim_compute_robot_state-npc1": 0.06369003613789877, "sim_compute_robot_state-npc2": 0.06356787840525309, "sim_compute_robot_state-npc3": 0.06420452117919923}, "udem1-1-0": {"driven_any": 0.5192585461317222, "sim_physics": 0.09896089874695396, "survival_time": 5.349999999999989, "driven_lanedir": 0.4662403619960642, "sim_render-ego": 0.0578691781124222, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.1864407998379146, "deviation-heading": 1.7266540720807406, "set_robot_commands": 0.07526609830767195, "deviation-center-line": 0.30876318427113575, "driven_lanedir_consec": 0.4662403619960642, "sim_compute_sim_state": 0.03453573556703942, "sim_compute_performance-ego": 0.06179438127535526, "sim_compute_robot_state-ego": 0.06087557400498435, "sim_compute_robot_state-npc0": 0.06696439457830981, "sim_compute_robot_state-npc1": 0.06381702423095703, "sim_compute_robot_state-npc2": 0.06343391899750611, "sim_compute_robot_state-npc3": 0.06113928055094781}, "udem1-2-0": {"driven_any": 1.0248057406297146, "sim_physics": 0.11650507252206917, "survival_time": 12.650000000000045, "driven_lanedir": 0.6955406978906019, "sim_render-ego": 0.05814183653578928, "in-drivable-lane": 3.300000000000047, "agent_compute-ego": 0.18605148179728995, "deviation-heading": 2.1645925917453583, "set_robot_commands": 0.07617636914309776, "deviation-center-line": 0.8294011792639612, "driven_lanedir_consec": 0.665912556283924, "sim_compute_sim_state": 0.03562738867145282, "sim_compute_performance-ego": 0.06199585590437938, "sim_compute_robot_state-ego": 0.061161681126228905, "sim_compute_robot_state-npc0": 0.06755678078873827, "sim_compute_robot_state-npc1": 0.06303736720631717, "sim_compute_robot_state-npc2": 0.06244912260605884, "sim_compute_robot_state-npc3": 0.06294994957362239}, "udem1-3-0": {"driven_any": 1.3769204464724558, "sim_physics": 0.11589242855707804, "survival_time": 14.950000000000076, "driven_lanedir": 1.2126245189788816, "sim_render-ego": 0.05801762898763021, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.18907193422317503, "deviation-heading": 2.8895648067772344, "set_robot_commands": 0.07520814577738444, "deviation-center-line": 1.48763528402887, "driven_lanedir_consec": 0.9453328298604348, "sim_compute_sim_state": 0.0353658390045166, "sim_compute_performance-ego": 0.06137809673945109, "sim_compute_robot_state-ego": 0.060068675676981605, "sim_compute_robot_state-npc0": 0.06793959776560465, "sim_compute_robot_state-npc1": 0.06360953410466512, "sim_compute_robot_state-npc2": 0.06311722040176392, "sim_compute_robot_state-npc3": 0.06356743971506755}, "udem1-4-0": {"driven_any": 1.034895059531196, "sim_physics": 0.10763439294454212, "survival_time": 11.100000000000025, "driven_lanedir": 0.7957508380698788, "sim_render-ego": 0.05973982918369877, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.18886058824556368, "deviation-heading": 1.0672675930091362, "set_robot_commands": 0.07451056037937198, "deviation-center-line": 0.4666033205860988, "driven_lanedir_consec": 0.7957508380698788, "sim_compute_sim_state": 0.03588279947504267, "sim_compute_performance-ego": 0.06150756870304142, "sim_compute_robot_state-ego": 0.06050314344801344, "sim_compute_robot_state-npc0": 0.0684547520972587, "sim_compute_robot_state-npc1": 0.06468929149009087, "sim_compute_robot_state-npc2": 0.06355185551686329, "sim_compute_robot_state-npc3": 0.06247240143853265}}
set_robot_commands_max	0.07617636914309776
set_robot_commands_mean	0.07543513656171519
set_robot_commands_median	0.07526609830767195
set_robot_commands_min	0.07451056037937198
sim_compute_performance-ego_max	0.06308534304300945
sim_compute_performance-ego_mean	0.06195224913304733
sim_compute_performance-ego_median	0.06179438127535526
sim_compute_performance-ego_min	0.06137809673945109
sim_compute_robot_state-ego_max	0.061161681126228905
sim_compute_robot_state-ego_mean	0.06066961275366679
sim_compute_robot_state-ego_median	0.06073898951212565
sim_compute_robot_state-ego_min	0.060068675676981605
sim_compute_robot_state-npc0_max	0.0684547520972587
sim_compute_robot_state-npc0_mean	0.06783302487376143
sim_compute_robot_state-npc0_median	0.06793959776560465
sim_compute_robot_state-npc0_min	0.06696439457830981
sim_compute_robot_state-npc1_max	0.06468929149009087
sim_compute_robot_state-npc1_mean	0.06376865063398578
sim_compute_robot_state-npc1_median	0.06369003613789877
sim_compute_robot_state-npc1_min	0.06303736720631717
sim_compute_robot_state-npc2_max	0.06356787840525309
sim_compute_robot_state-npc2_mean	0.06322399918548904
sim_compute_robot_state-npc2_median	0.06343391899750611
sim_compute_robot_state-npc2_min	0.06244912260605884
sim_compute_robot_state-npc3_max	0.06420452117919923
sim_compute_robot_state-npc3_mean	0.06286671849147393
sim_compute_robot_state-npc3_median	0.06294994957362239
sim_compute_robot_state-npc3_min	0.06113928055094781
sim_compute_sim_state_max	0.03734231233596802
sim_compute_sim_state_mean	0.035750815010803905
sim_compute_sim_state_median	0.03562738867145282
sim_compute_sim_state_min	0.03453573556703942
sim_physics_max	0.11650507252206917
sim_physics_mean	0.11060408067810124
sim_physics_median	0.11402761061986288
sim_physics_min	0.09896089874695396
sim_render-ego_max	0.05973982918369877
sim_render-ego_mean	0.05867900914927593
sim_render-ego_median	0.05814183653578928
sim_render-ego_min	0.0578691781124222
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.800000000000043
survival_time_min	5.349999999999989

No reset possible

20218

2986

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:14:04+00:00

2019-04-25 10:15:05+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20215

2988

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:13:03+00:00

2019-04-25 10:13:43+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20209

2995

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:12:12+00:00

2019-04-25 10:12:51+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20204

3003

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:10:49+00:00

2019-04-25 10:11:32+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20202

3019

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:09:37+00:00

2019-04-25 10:10:15+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20196

3023

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:08:51+00:00

2019-04-25 10:09:30+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20194

3031

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:07:52+00:00

2019-04-25 10:08:31+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20147

2978

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 09:44:44+00:00

2019-04-25 10:07:06+00:00

0:22:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0575075098578126
survival_time_median	11.65000000000003
deviation-center-line_median	0.6204176676352585
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18731188933054607
agent_compute-ego_mean	0.1830478393195944
agent_compute-ego_median	0.18411262761881425
agent_compute-ego_min	0.17848630994558334
deviation-center-line_max	0.7940475630796648
deviation-center-line_mean	0.6235492091043171
deviation-center-line_min	0.49036643752709
deviation-heading_max	5.889092957205723
deviation-heading_mean	2.1528069671963093
deviation-heading_median	1.2171036937074298
deviation-heading_min	0.9359099422727736
driven_any_max	1.334052693361759
driven_any_mean	1.121916433525115
driven_any_median	1.085306981764941
driven_any_min	1.023522935511936
driven_lanedir_consec_max	1.326302462124338
driven_lanedir_consec_mean	1.0363469292593224
driven_lanedir_consec_min	0.6613433179112942
driven_lanedir_max	1.326302462124338
driven_lanedir_mean	1.0424553672657209
driven_lanedir_median	1.0575075098578126
driven_lanedir_min	0.6918855079432855
in-drivable-lane_max	1.2500000000000178
in-drivable-lane_mean	0.28000000000000397
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.023522935511936, "sim_physics": 0.04024666573356661, "survival_time": 11.65000000000003, "driven_lanedir": 0.6918855079432855, "sim_render-ego": 0.05850022135886, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.18411262761881425, "deviation-heading": 5.889092957205723, "set_robot_commands": 0.07615867602467025, "deviation-center-line": 0.6550926558563891, "driven_lanedir_consec": 0.6613433179112942, "sim_compute_sim_state": 0.03483090994184109, "sim_compute_performance-ego": 0.0625815800842809, "sim_compute_robot_state-ego": 0.06294626023124728, "sim_compute_robot_state-npc0": 0.06782413347596263, "sim_compute_robot_state-npc1": 0.06359019299945094, "sim_compute_robot_state-npc2": 0.062358123550087595, "sim_compute_robot_state-npc3": 0.06333641432897216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.334052693361759, "sim_physics": 0.04392579555511475, "survival_time": 14.950000000000076, "driven_lanedir": 1.326302462124338, "sim_render-ego": 0.05901990969975789, "in-drivable-lane": 0, "agent_compute-ego": 0.18731188933054607, "deviation-heading": 0.9359099422727736, "set_robot_commands": 0.07557650009791056, "deviation-center-line": 0.5578217214231834, "driven_lanedir_consec": 1.326302462124338, "sim_compute_sim_state": 0.036478432019551595, "sim_compute_performance-ego": 0.06254972219467163, "sim_compute_robot_state-ego": 0.06263577779134115, "sim_compute_robot_state-npc0": 0.06977752606074016, "sim_compute_robot_state-npc1": 0.0652652621269226, "sim_compute_robot_state-npc2": 0.063693261941274, "sim_compute_robot_state-npc3": 0.0635332441329956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0713788628963874, "sim_physics": 0.03979793416351831, "survival_time": 11.900000000000034, "driven_lanedir": 1.0575075098578126, "sim_render-ego": 0.056804928459039256, "in-drivable-lane": 0, "agent_compute-ego": 0.1856920168179424, "deviation-heading": 1.165943504922806, "set_robot_commands": 0.07557052223622299, "deviation-center-line": 0.7940475630796648, "driven_lanedir_consec": 1.0575075098578126, "sim_compute_sim_state": 0.03571039588511491, "sim_compute_performance-ego": 0.06061132415002134, "sim_compute_robot_state-ego": 0.06210342876049651, "sim_compute_robot_state-npc0": 0.06780496064354391, "sim_compute_robot_state-npc1": 0.0642040206604645, "sim_compute_robot_state-npc2": 0.06253569566902994, "sim_compute_robot_state-npc3": 0.06295136143179501}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0953206940905518, "sim_physics": 0.03938091961683425, "survival_time": 11.300000000000026, "driven_lanedir": 1.082138327594414, "sim_render-ego": 0.055573654385794584, "in-drivable-lane": 0, "agent_compute-ego": 0.17963635288508592, "deviation-heading": 1.2171036937074298, "set_robot_commands": 0.0738782661151042, "deviation-center-line": 0.6204176676352585, "driven_lanedir_consec": 1.082138327594414, "sim_compute_sim_state": 0.034379059234551625, "sim_compute_performance-ego": 0.05930751825855896, "sim_compute_robot_state-ego": 0.05915093210946142, "sim_compute_robot_state-npc0": 0.06490048792509906, "sim_compute_robot_state-npc1": 0.060737904194182, "sim_compute_robot_state-npc2": 0.05974337906964057, "sim_compute_robot_state-npc3": 0.0612284071677554}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.085306981764941, "sim_physics": 0.037750844444547384, "survival_time": 11.200000000000024, "driven_lanedir": 1.0544430288087536, "sim_render-ego": 0.05552959016391209, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.17848630994558334, "deviation-heading": 1.5559847378728144, "set_robot_commands": 0.07382021631513323, "deviation-center-line": 0.49036643752709, "driven_lanedir_consec": 1.0544430288087536, "sim_compute_sim_state": 0.034753113985061646, "sim_compute_performance-ego": 0.05919591443879264, "sim_compute_robot_state-ego": 0.05950410344770977, "sim_compute_robot_state-npc0": 0.06566719391516276, "sim_compute_robot_state-npc1": 0.06120737322739193, "sim_compute_robot_state-npc2": 0.0600055530667305, "sim_compute_robot_state-npc3": 0.06040121295622417}}
set_robot_commands_max	0.07615867602467025
set_robot_commands_mean	0.07500083615780825
set_robot_commands_median	0.07557052223622299
set_robot_commands_min	0.07382021631513323
sim_compute_performance-ego_max	0.0625815800842809
sim_compute_performance-ego_mean	0.06084921182526509
sim_compute_performance-ego_median	0.06061132415002134
sim_compute_performance-ego_min	0.05919591443879264
sim_compute_robot_state-ego_max	0.06294626023124728
sim_compute_robot_state-ego_mean	0.06126810046805123
sim_compute_robot_state-ego_median	0.06210342876049651
sim_compute_robot_state-ego_min	0.05915093210946142
sim_compute_robot_state-npc0_max	0.06977752606074016
sim_compute_robot_state-npc0_mean	0.06719486040410169
sim_compute_robot_state-npc0_median	0.06780496064354391
sim_compute_robot_state-npc0_min	0.06490048792509906
sim_compute_robot_state-npc1_max	0.0652652621269226
sim_compute_robot_state-npc1_mean	0.0630009506416824
sim_compute_robot_state-npc1_median	0.06359019299945094
sim_compute_robot_state-npc1_min	0.060737904194182
sim_compute_robot_state-npc2_max	0.063693261941274
sim_compute_robot_state-npc2_mean	0.06166720265935253
sim_compute_robot_state-npc2_median	0.062358123550087595
sim_compute_robot_state-npc2_min	0.05974337906964057
sim_compute_robot_state-npc3_max	0.0635332441329956
sim_compute_robot_state-npc3_mean	0.062290128003548474
sim_compute_robot_state-npc3_median	0.06295136143179501
sim_compute_robot_state-npc3_min	0.06040121295622417
sim_compute_sim_state_max	0.036478432019551595
sim_compute_sim_state_mean	0.03523038221322417
sim_compute_sim_state_median	0.03483090994184109
sim_compute_sim_state_min	0.034379059234551625
sim_physics_max	0.04392579555511475
sim_physics_mean	0.040220431902716264
sim_physics_median	0.03979793416351831
sim_physics_min	0.037750844444547384
sim_render-ego_max	0.05901990969975789
sim_render-ego_mean	0.05708566081347276
sim_render-ego_median	0.056804928459039256
sim_render-ego_min	0.05552959016391209
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.200000000000038
survival_time_min	11.200000000000024

No reset possible

20142

2989

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:42:23+00:00

2019-04-25 09:44:30+00:00

0:02:07

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20137

2999

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:41:09+00:00

2019-04-25 09:41:47+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20130

3007

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:40:04+00:00

2019-04-25 09:40:42+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20124

3014

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:39:13+00:00

2019-04-25 09:39:51+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20119

3022

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:38:21+00:00

2019-04-25 09:38:59+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20117

3031

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:37:23+00:00

2019-04-25 09:38:01+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20114

3034

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:36:19+00:00

2019-04-25 09:36:58+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20112

3039

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:35:08+00:00

2019-04-25 09:35:46+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20109

3042

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:33:48+00:00

2019-04-25 09:34:31+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20108

3047

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:32:51+00:00

2019-04-25 09:33:29+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20106

3050

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:31:39+00:00

2019-04-25 09:32:18+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20087

2904

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 09:19:11+00:00

2019-04-25 09:31:31+00:00

0:12:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6676858764507174
survival_time_median	5.999999999999987
deviation-center-line_median	0.22348634922802843
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.1950817819227252
agent_compute-ego_mean	0.1845065374434906
agent_compute-ego_median	0.18287601955434216
agent_compute-ego_min	0.17591609760206572
deviation-center-line_max	0.3310966890298091
deviation-center-line_mean	0.25119729979187927
deviation-center-line_min	0.18011331274863565
deviation-heading_max	0.9706887627920516
deviation-heading_mean	0.859839637795704
deviation-heading_median	0.8821738571140612
deviation-heading_min	0.6562250420185252
driven_any_max	1.5799469400206925
driven_any_mean	0.9946918992667152
driven_any_median	0.994691873794677
driven_any_min	0.3744963213087336
driven_lanedir_consec_max	1.209733597869298
driven_lanedir_consec_mean	0.7733203967182727
driven_lanedir_consec_min	0.3610813952710298
driven_lanedir_max	1.209733597869298
driven_lanedir_mean	0.7733203967182727
driven_lanedir_median	0.6676858764507174
driven_lanedir_min	0.3610813952710298
in-drivable-lane_max	2.000000000000016
in-drivable-lane_mean	1.1300000000000052
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.994691873794677, "sim_physics": 0.04395365516344706, "survival_time": 5.999999999999987, "driven_lanedir": 0.6676858764507174, "sim_render-ego": 0.06101164619127909, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.19041109283765156, "deviation-heading": 0.9351513507591204, "set_robot_commands": 0.07517213821411133, "deviation-center-line": 0.22348634922802843, "driven_lanedir_consec": 0.6676858764507174, "sim_compute_sim_state": 0.03662242889404297, "sim_compute_performance-ego": 0.06450479825337728, "sim_compute_robot_state-ego": 0.06776616374651591, "sim_compute_robot_state-npc0": 0.06987487276395161, "sim_compute_robot_state-npc1": 0.06572471062342326, "sim_compute_robot_state-npc2": 0.06381447116533916, "sim_compute_robot_state-npc3": 0.0635099470615387}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.44437742153563287, "sim_physics": 0.05045811335245768, "survival_time": 2.849999999999998, "driven_lanedir": 0.4187336912516324, "sim_render-ego": 0.06349987732736688, "in-drivable-lane": 0, "agent_compute-ego": 0.1950817819227252, "deviation-heading": 0.9706887627920516, "set_robot_commands": 0.0810112618563468, "deviation-center-line": 0.203399741065412, "driven_lanedir_consec": 0.4187336912516324, "sim_compute_sim_state": 0.038045159557409454, "sim_compute_performance-ego": 0.06971849893268786, "sim_compute_robot_state-ego": 0.07001023961786638, "sim_compute_robot_state-npc0": 0.07235333375763475, "sim_compute_robot_state-npc1": 0.06803135704575923, "sim_compute_robot_state-npc2": 0.06678292207550585, "sim_compute_robot_state-npc3": 0.06609018643697102}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5799469400206925, "sim_physics": 0.03968811927632215, "survival_time": 9.349999999999998, "driven_lanedir": 1.209367422748686, "sim_render-ego": 0.05593665653371556, "in-drivable-lane": 2.000000000000016, "agent_compute-ego": 0.1782476953006683, "deviation-heading": 0.8821738571140612, "set_robot_commands": 0.07288868797016654, "deviation-center-line": 0.3310966890298091, "driven_lanedir_consec": 1.209367422748686, "sim_compute_sim_state": 0.03401649062008781, "sim_compute_performance-ego": 0.06036581457617449, "sim_compute_robot_state-ego": 0.06252646318731461, "sim_compute_robot_state-npc0": 0.06618098014178761, "sim_compute_robot_state-npc1": 0.06142688307532653, "sim_compute_robot_state-npc2": 0.06081357104255554, "sim_compute_robot_state-npc3": 0.05951612518432944}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.579946939673839, "sim_physics": 0.04045220237364743, "survival_time": 9.349999999999998, "driven_lanedir": 1.209733597869298, "sim_render-ego": 0.05667000658371869, "in-drivable-lane": 2.000000000000016, "agent_compute-ego": 0.18287601955434216, "deviation-heading": 0.8549591762947624, "set_robot_commands": 0.07404544009244378, "deviation-center-line": 0.3178904068875111, "driven_lanedir_consec": 1.209733597869298, "sim_compute_sim_state": 0.03658752262911057, "sim_compute_performance-ego": 0.06113004556951676, "sim_compute_robot_state-ego": 0.06276381589512137, "sim_compute_robot_state-npc0": 0.06622358694433529, "sim_compute_robot_state-npc1": 0.06311530480410325, "sim_compute_robot_state-npc2": 0.06177442214068245, "sim_compute_robot_state-npc3": 0.06162603526191915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3744963213087336, "sim_physics": 0.039693049022129605, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3610813952710298, "sim_render-ego": 0.05765980603743573, "in-drivable-lane": 0, "agent_compute-ego": 0.17591609760206572, "deviation-heading": 0.6562250420185252, "set_robot_commands": 0.07601075756306551, "deviation-center-line": 0.18011331274863565, "driven_lanedir_consec": 0.3610813952710298, "sim_compute_sim_state": 0.03463126688587422, "sim_compute_performance-ego": 0.05891606759051887, "sim_compute_robot_state-ego": 0.05945711719746492, "sim_compute_robot_state-npc0": 0.06378020072469906, "sim_compute_robot_state-npc1": 0.0612008912222726, "sim_compute_robot_state-npc2": 0.06155549263467594, "sim_compute_robot_state-npc3": 0.059570969367513854}}
set_robot_commands_max	0.0810112618563468
set_robot_commands_mean	0.07582565713922679
set_robot_commands_median	0.07517213821411133
set_robot_commands_min	0.07288868797016654
sim_compute_performance-ego_max	0.06971849893268786
sim_compute_performance-ego_mean	0.06292704498445505
sim_compute_performance-ego_median	0.06113004556951676
sim_compute_performance-ego_min	0.05891606759051887
sim_compute_robot_state-ego_max	0.07001023961786638
sim_compute_robot_state-ego_mean	0.06450475992885665
sim_compute_robot_state-ego_median	0.06276381589512137
sim_compute_robot_state-ego_min	0.05945711719746492
sim_compute_robot_state-npc0_max	0.07235333375763475
sim_compute_robot_state-npc0_mean	0.06768259486648168
sim_compute_robot_state-npc0_median	0.06622358694433529
sim_compute_robot_state-npc0_min	0.06378020072469906
sim_compute_robot_state-npc1_max	0.06803135704575923
sim_compute_robot_state-npc1_mean	0.06389982935417698
sim_compute_robot_state-npc1_median	0.06311530480410325
sim_compute_robot_state-npc1_min	0.0612008912222726
sim_compute_robot_state-npc2_max	0.06678292207550585
sim_compute_robot_state-npc2_mean	0.06294817581175179
sim_compute_robot_state-npc2_median	0.06177442214068245
sim_compute_robot_state-npc2_min	0.06081357104255554
sim_compute_robot_state-npc3_max	0.06609018643697102
sim_compute_robot_state-npc3_mean	0.062062652662454434
sim_compute_robot_state-npc3_median	0.06162603526191915
sim_compute_robot_state-npc3_min	0.05951612518432944
sim_compute_sim_state_max	0.038045159557409454
sim_compute_sim_state_mean	0.03598057371730501
sim_compute_sim_state_median	0.03658752262911057
sim_compute_sim_state_min	0.03401649062008781
sim_physics_max	0.05045811335245768
sim_physics_mean	0.04284902783760079
sim_physics_median	0.04045220237364743
sim_physics_min	0.03968811927632215
sim_render-ego_max	0.06349987732736688
sim_render-ego_mean	0.05895559853470318
sim_render-ego_median	0.05765980603743573
sim_render-ego_min	0.05593665653371556
simulation-passed	1
survival_time_max	9.349999999999998
survival_time_mean	5.999999999999996
survival_time_min	2.4499999999999993

No reset possible

20084

3059

Andrea Censi 🇨🇭

rotation

step1-simulation

error

2019-04-25 09:17:34+00:00

2019-04-25 09:18:33+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20071

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:04:55+00:00

2019-04-25 09:17:21+00:00

0:12:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4311021888305311
survival_time_median	4.94999999999999
deviation-center-line_median	0.22749418531812665
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.06807118143354143
agent_compute-ego_mean	0.06389073068220583
agent_compute-ego_median	0.06401036739349365
agent_compute-ego_min	0.06039865330012158
deviation-center-line_max	0.9896584909171426
deviation-center-line_mean	0.3942411125864686
deviation-center-line_min	0.12285395430479464
deviation-heading_max	6.205199444841395
deviation-heading_mean	2.4819094790675313
deviation-heading_median	1.756949478108086
deviation-heading_min	0.5408181371642428
driven_any_max	2.348501520593358
driven_any_mean	0.9539497625512104
driven_any_median	0.7416718551049392
driven_any_min	0.22750191497787384
driven_lanedir_consec_max	0.704524862070769
driven_lanedir_consec_mean	0.4135348443357172
driven_lanedir_consec_min	0.18951907720118968
driven_lanedir_max	1.1503385537317583
driven_lanedir_mean	0.5345436980445456
driven_lanedir_median	0.5346483306205481
driven_lanedir_min	0.18951907720118968
in-drivable-lane_max	4.850000000000026
in-drivable-lane_mean	1.6500000000000028
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.192447347558196, "sim_physics": 0.1099444453124028, "survival_time": 7.84999999999998, "driven_lanedir": 0.5903327657136839, "sim_render-ego": 0.058015408789276315, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.06520397192353655, "deviation-heading": 2.7275045695982887, "set_robot_commands": 0.07734913886732357, "deviation-center-line": 0.4683575788630887, "driven_lanedir_consec": 0.4311021888305311, "sim_compute_sim_state": 0.033412998648965436, "sim_compute_performance-ego": 0.059602245403702854, "sim_compute_robot_state-ego": 0.06006882297005623, "sim_compute_robot_state-npc0": 0.0658912795364477, "sim_compute_robot_state-npc1": 0.061500898592031686, "sim_compute_robot_state-npc2": 0.060716501466787545, "sim_compute_robot_state-npc3": 0.060042864198138}, "udem1-1-0": {"driven_any": 0.25962617452168435, "sim_physics": 0.1121654693896954, "survival_time": 1.950000000000001, "driven_lanedir": 0.18951907720118968, "sim_render-ego": 0.052336796736105896, "in-drivable-lane": 0, "agent_compute-ego": 0.06176947936033591, "deviation-heading": 1.1790757656256468, "set_robot_commands": 0.07813338744334686, "deviation-center-line": 0.12285395430479464, "driven_lanedir_consec": 0.18951907720118968, "sim_compute_sim_state": 0.03294719793857672, "sim_compute_performance-ego": 0.057065572494115584, "sim_compute_robot_state-ego": 0.05921363219236716, "sim_compute_robot_state-npc0": 0.06107919032757099, "sim_compute_robot_state-npc1": 0.05692306543007875, "sim_compute_robot_state-npc2": 0.05772019043946878, "sim_compute_robot_state-npc3": 0.05962520990616236}, "udem1-2-0": {"driven_any": 2.348501520593358, "sim_physics": 0.12310019890467326, "survival_time": 14.950000000000076, "driven_lanedir": 1.1503385537317583, "sim_render-ego": 0.05383099635442098, "in-drivable-lane": 4.850000000000026, "agent_compute-ego": 0.06401036739349365, "deviation-heading": 6.205199444841395, "set_robot_commands": 0.07400984684626262, "deviation-center-line": 0.9896584909171426, "driven_lanedir_consec": 0.704524862070769, "sim_compute_sim_state": 0.03204212427139282, "sim_compute_performance-ego": 0.05693756659825643, "sim_compute_robot_state-ego": 0.058853518962860105, "sim_compute_robot_state-npc0": 0.06338854392369588, "sim_compute_robot_state-npc1": 0.05921902100245158, "sim_compute_robot_state-npc2": 0.0579626472791036, "sim_compute_robot_state-npc3": 0.0573425038655599}, "udem1-3-0": {"driven_any": 0.22750191497787384, "sim_physics": 0.11022662435259138, "survival_time": 1.7500000000000009, "driven_lanedir": 0.207879762955548, "sim_render-ego": 0.05610410826546805, "in-drivable-lane": 0, "agent_compute-ego": 0.06807118143354143, "deviation-heading": 0.5408181371642428, "set_robot_commands": 0.07382357461111887, "deviation-center-line": 0.1628413535291903, "driven_lanedir_consec": 0.207879762955548, "sim_compute_sim_state": 0.0322995730808803, "sim_compute_performance-ego": 0.0574460574558803, "sim_compute_robot_state-ego": 0.0581693240574428, "sim_compute_robot_state-npc0": 0.06304148946489607, "sim_compute_robot_state-npc1": 0.059144994190761024, "sim_compute_robot_state-npc2": 0.057103122983660014, "sim_compute_robot_state-npc3": 0.057555314472743445}, "udem1-4-0": {"driven_any": 0.7416718551049392, "sim_physics": 0.10226336392489346, "survival_time": 4.94999999999999, "driven_lanedir": 0.5346483306205481, "sim_render-ego": 0.05325702705768624, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06039865330012158, "deviation-heading": 1.756949478108086, "set_robot_commands": 0.07269447018401791, "deviation-center-line": 0.22749418531812665, "driven_lanedir_consec": 0.5346483306205481, "sim_compute_sim_state": 0.032452397876315646, "sim_compute_performance-ego": 0.057536223922112974, "sim_compute_robot_state-ego": 0.0602907363814537, "sim_compute_robot_state-npc0": 0.062200423442956176, "sim_compute_robot_state-npc1": 0.05772994022176723, "sim_compute_robot_state-npc2": 0.05678783041058165, "sim_compute_robot_state-npc3": 0.058528112642692795}}
set_robot_commands_max	0.07813338744334686
set_robot_commands_mean	0.07520208359041397
set_robot_commands_median	0.07400984684626262
set_robot_commands_min	0.07269447018401791
sim_compute_performance-ego_max	0.059602245403702854
sim_compute_performance-ego_mean	0.05771753317481363
sim_compute_performance-ego_median	0.0574460574558803
sim_compute_performance-ego_min	0.05693756659825643
sim_compute_robot_state-ego_max	0.0602907363814537
sim_compute_robot_state-ego_mean	0.059319206912836
sim_compute_robot_state-ego_median	0.05921363219236716
sim_compute_robot_state-ego_min	0.0581693240574428
sim_compute_robot_state-npc0_max	0.0658912795364477
sim_compute_robot_state-npc0_mean	0.06312018533911337
sim_compute_robot_state-npc0_median	0.06304148946489607
sim_compute_robot_state-npc0_min	0.06107919032757099
sim_compute_robot_state-npc1_max	0.061500898592031686
sim_compute_robot_state-npc1_mean	0.05890358388741805
sim_compute_robot_state-npc1_median	0.059144994190761024
sim_compute_robot_state-npc1_min	0.05692306543007875
sim_compute_robot_state-npc2_max	0.060716501466787545
sim_compute_robot_state-npc2_mean	0.05805805851592032
sim_compute_robot_state-npc2_median	0.05772019043946878
sim_compute_robot_state-npc2_min	0.05678783041058165
sim_compute_robot_state-npc3_max	0.060042864198138
sim_compute_robot_state-npc3_mean	0.0586188010170593
sim_compute_robot_state-npc3_median	0.058528112642692795
sim_compute_robot_state-npc3_min	0.0573425038655599
sim_compute_sim_state_max	0.033412998648965436
sim_compute_sim_state_mean	0.03263085836322619
sim_compute_sim_state_median	0.032452397876315646
sim_compute_sim_state_min	0.03204212427139282
sim_physics_max	0.12310019890467326
sim_physics_mean	0.11154002037685126
sim_physics_median	0.11022662435259138
sim_physics_min	0.10226336392489346
sim_render-ego_max	0.058015408789276315
sim_render-ego_mean	0.0547088674405915
sim_render-ego_median	0.05383099635442098
sim_render-ego_min	0.052336796736105896
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.290000000000009
survival_time_min	1.7500000000000009

No reset possible

20038

2952

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 08:59:25+00:00

2019-04-25 09:04:25+00:00

0:05:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09137232113108772
survival_time_median	1.2000000000000004
deviation-center-line_median	0.06484136441745139
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.21742997747479065
agent_compute-ego_mean	0.1821437740416238
agent_compute-ego_median	0.17932358655062589
agent_compute-ego_min	0.15560062726338705
deviation-center-line_max	0.09821398342221552
deviation-center-line_mean	0.07458520431477648
deviation-center-line_min	0.057356978258205585
deviation-heading_max	0.8032457713732432
deviation-heading_mean	0.6432568544290491
deviation-heading_median	0.7179333820052395
deviation-heading_min	0.4445272530493165
driven_any_max	0.21820429239455105
driven_any_mean	0.1772547864934623
driven_any_median	0.1727748384295832
driven_any_min	0.12283885639829376
driven_lanedir_consec_max	0.14469542445037353
driven_lanedir_consec_mean	0.0977361036713036
driven_lanedir_consec_min	0.06066406987277984
driven_lanedir_max	0.14469542445037353
driven_lanedir_mean	0.0977361036713036
driven_lanedir_median	0.09137232113108772
driven_lanedir_min	0.06066406987277984
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.2100000000000002
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.21820429239455105, "sim_physics": 0.09599974661162404, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06066406987277984, "sim_render-ego": 0.06114662054813269, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.21742997747479065, "deviation-heading": 0.7179333820052395, "set_robot_commands": 0.0778055985768636, "deviation-center-line": 0.058337026160877575, "driven_lanedir_consec": 0.06066406987277984, "sim_compute_sim_state": 0.03718485254229921, "sim_compute_performance-ego": 0.06358906717011423, "sim_compute_robot_state-ego": 0.060711521090883194, "sim_compute_robot_state-npc0": 0.06978353587063876, "sim_compute_robot_state-npc1": 0.0686866081122196, "sim_compute_robot_state-npc2": 0.06627146402994792, "sim_compute_robot_state-npc3": 0.06536870291738799}, "udem1-1-0": {"driven_any": 0.2074138387565126, "sim_physics": 0.1057884469628334, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07839912841836671, "sim_render-ego": 0.061965517699718475, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.19077569991350177, "deviation-heading": 0.8032457713732432, "set_robot_commands": 0.07436306774616241, "deviation-center-line": 0.057356978258205585, "driven_lanedir_consec": 0.07839912841836671, "sim_compute_sim_state": 0.03854406625032425, "sim_compute_performance-ego": 0.06160566210746765, "sim_compute_robot_state-ego": 0.057284317910671234, "sim_compute_robot_state-npc0": 0.06953723728656769, "sim_compute_robot_state-npc1": 0.06670074164867401, "sim_compute_robot_state-npc2": 0.06736088544130325, "sim_compute_robot_state-npc3": 0.06589160114526749}, "udem1-2-0": {"driven_any": 0.12283885639829376, "sim_physics": 0.10659994862296364, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09137232113108772, "sim_render-ego": 0.06258562478152188, "in-drivable-lane": 0, "agent_compute-ego": 0.17932358655062589, "deviation-heading": 0.4968742855520053, "set_robot_commands": 0.07662443681196733, "deviation-center-line": 0.09417666931513238, "driven_lanedir_consec": 0.09137232113108772, "sim_compute_sim_state": 0.03568338264118542, "sim_compute_performance-ego": 0.06249902465126731, "sim_compute_robot_state-ego": 0.06205672567540949, "sim_compute_robot_state-npc0": 0.06997364217584784, "sim_compute_robot_state-npc1": 0.06537707285447554, "sim_compute_robot_state-npc2": 0.0624366890300404, "sim_compute_robot_state-npc3": 0.061031710017811165}, "udem1-3-0": {"driven_any": 0.1727748384295832, "sim_physics": 0.09776581327120464, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14469542445037353, "sim_render-ego": 0.06028240919113159, "in-drivable-lane": 0, "agent_compute-ego": 0.15560062726338705, "deviation-heading": 0.4445272530493165, "set_robot_commands": 0.07862934470176697, "deviation-center-line": 0.09821398342221552, "driven_lanedir_consec": 0.14469542445037353, "sim_compute_sim_state": 0.03728510936101278, "sim_compute_performance-ego": 0.05800173679987589, "sim_compute_robot_state-ego": 0.0594963530699412, "sim_compute_robot_state-npc0": 0.06778294841448466, "sim_compute_robot_state-npc1": 0.06236018737157186, "sim_compute_robot_state-npc2": 0.06303263703982036, "sim_compute_robot_state-npc3": 0.0635124941666921}, "udem1-4-0": {"driven_any": 0.16504210648837095, "sim_physics": 0.09041638175646464, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11354957448391012, "sim_render-ego": 0.06013649702072144, "in-drivable-lane": 0, "agent_compute-ego": 0.1675889790058136, "deviation-heading": 0.753703580165441, "set_robot_commands": 0.0747537910938263, "deviation-center-line": 0.06484136441745139, "driven_lanedir_consec": 0.11354957448391012, "sim_compute_sim_state": 0.03522482514381409, "sim_compute_performance-ego": 0.06379088759422302, "sim_compute_robot_state-ego": 0.061884780724843345, "sim_compute_robot_state-npc0": 0.06805131832758586, "sim_compute_robot_state-npc1": 0.06752012173334758, "sim_compute_robot_state-npc2": 0.06427130103111267, "sim_compute_robot_state-npc3": 0.06361547112464905}}
set_robot_commands_max	0.07862934470176697
set_robot_commands_mean	0.07643524778611732
set_robot_commands_median	0.07662443681196733
set_robot_commands_min	0.07436306774616241
sim_compute_performance-ego_max	0.06379088759422302
sim_compute_performance-ego_mean	0.06189727566458962
sim_compute_performance-ego_median	0.06249902465126731
sim_compute_performance-ego_min	0.05800173679987589
sim_compute_robot_state-ego_max	0.06205672567540949
sim_compute_robot_state-ego_mean	0.06028673969434969
sim_compute_robot_state-ego_median	0.060711521090883194
sim_compute_robot_state-ego_min	0.057284317910671234
sim_compute_robot_state-npc0_max	0.06997364217584784
sim_compute_robot_state-npc0_mean	0.06902573641502496
sim_compute_robot_state-npc0_median	0.06953723728656769
sim_compute_robot_state-npc0_min	0.06778294841448466
sim_compute_robot_state-npc1_max	0.0686866081122196
sim_compute_robot_state-npc1_mean	0.06612894634405772
sim_compute_robot_state-npc1_median	0.06670074164867401
sim_compute_robot_state-npc1_min	0.06236018737157186
sim_compute_robot_state-npc2_max	0.06736088544130325
sim_compute_robot_state-npc2_mean	0.06467459531444493
sim_compute_robot_state-npc2_median	0.06427130103111267
sim_compute_robot_state-npc2_min	0.0624366890300404
sim_compute_robot_state-npc3_max	0.06589160114526749
sim_compute_robot_state-npc3_mean	0.06388399587436155
sim_compute_robot_state-npc3_median	0.06361547112464905
sim_compute_robot_state-npc3_min	0.061031710017811165
sim_compute_sim_state_max	0.03854406625032425
sim_compute_sim_state_mean	0.03678444718772715
sim_compute_sim_state_median	0.03718485254229921
sim_compute_sim_state_min	0.03522482514381409
sim_physics_max	0.10659994862296364
sim_physics_mean	0.09931406744501808
sim_physics_median	0.09776581327120464
sim_physics_min	0.09041638175646464
sim_render-ego_max	0.06258562478152188
sim_render-ego_mean	0.06122333384824521
sim_render-ego_median	0.06114662054813269
sim_render-ego_min	0.06013649702072144
simulation-passed	1
survival_time_max	1.6500000000000008
survival_time_mean	1.3500000000000003
survival_time_min	1.1000000000000003

No reset possible

19991

2475

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 08:43:32+00:00

2019-04-25 08:50:34+00:00

0:07:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.630782078032722
survival_time_median	2.6499999999999986
deviation-center-line_median	0.10342694179960472
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.1613829224197953
agent_compute-ego_mean	0.1555451407444367
agent_compute-ego_median	0.15909085921870852
agent_compute-ego_min	0.14348498143647848
deviation-center-line_max	0.24274593434117447
deviation-center-line_mean	0.1423794188959262
deviation-center-line_min	0.05838775199208855
deviation-heading_max	0.9510803390140998
deviation-heading_mean	0.5404741772455786
deviation-heading_median	0.4662935751765816
deviation-heading_min	0.3138996563005005
driven_any_max	2.1937495917222662
driven_any_mean	1.101203967779493
driven_any_median	1.072953759306336
driven_any_min	0.3121624499492532
driven_lanedir_consec_max	1.8128454170816104
driven_lanedir_consec_mean	0.8194262040404128
driven_lanedir_consec_min	0.29255031695938905
driven_lanedir_max	1.8128454170816104
driven_lanedir_mean	0.8194262040404128
driven_lanedir_median	0.630782078032722
driven_lanedir_min	0.29255031695938905
in-drivable-lane_max	1.0499999999999965
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.03218231929673089, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.06612994273503621, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15381055739190844, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.07730470763312446, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.03795051574707031, "sim_compute_performance-ego": 0.06659684909714593, "sim_compute_robot_state-ego": 0.06416969497998555, "sim_compute_robot_state-npc0": 0.0730518036418491, "sim_compute_robot_state-npc1": 0.07176310155126783, "sim_compute_robot_state-npc2": 0.06873888439602321, "sim_compute_robot_state-npc3": 0.06762158208423191}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.02971080497459129, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.06783565768489132, "in-drivable-lane": 0, "agent_compute-ego": 0.1613829224197953, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.08079862594604492, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.03895369282475224, "sim_compute_performance-ego": 0.06643705014829282, "sim_compute_robot_state-ego": 0.0649702372374358, "sim_compute_robot_state-npc0": 0.0784483309145327, "sim_compute_robot_state-npc1": 0.07250233932777687, "sim_compute_robot_state-npc2": 0.06992284456888835, "sim_compute_robot_state-npc3": 0.069659188941673}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.032354699755177914, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.0679482904452722, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15909085921870852, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.07971535377132083, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.04079915018914973, "sim_compute_performance-ego": 0.06885420002983612, "sim_compute_robot_state-ego": 0.06492874228838579, "sim_compute_robot_state-npc0": 0.07754358967531075, "sim_compute_robot_state-npc1": 0.07574390439153875, "sim_compute_robot_state-npc2": 0.07321671143318843, "sim_compute_robot_state-npc3": 0.07292769024673018}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.030671690994838494, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.0697294181247927, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.1599563832552928, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.07839690064484219, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.03749474939310326, "sim_compute_performance-ego": 0.07107669002604934, "sim_compute_robot_state-ego": 0.06535747366131477, "sim_compute_robot_state-npc0": 0.07614095705860066, "sim_compute_robot_state-npc1": 0.07196694500041458, "sim_compute_robot_state-npc2": 0.06963383476689176, "sim_compute_robot_state-npc3": 0.07084465026855469}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.026006585673282023, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.06360742920323421, "in-drivable-lane": 0, "agent_compute-ego": 0.14348498143647848, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.07402874294080232, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.03426546799509149, "sim_compute_performance-ego": 0.062476584785862974, "sim_compute_robot_state-ego": 0.06276956357453999, "sim_compute_robot_state-npc0": 0.07151283715900622, "sim_compute_robot_state-npc1": 0.06650858176381964, "sim_compute_robot_state-npc2": 0.06416529103329308, "sim_compute_robot_state-npc3": 0.06182513738933362}}
set_robot_commands_max	0.08079862594604492
set_robot_commands_mean	0.07804886618722694
set_robot_commands_median	0.07839690064484219
set_robot_commands_min	0.07402874294080232
sim_compute_performance-ego_max	0.07107669002604934
sim_compute_performance-ego_mean	0.06708827481743743
sim_compute_performance-ego_median	0.06659684909714593
sim_compute_performance-ego_min	0.062476584785862974
sim_compute_robot_state-ego_max	0.06535747366131477
sim_compute_robot_state-ego_mean	0.06443914234833238
sim_compute_robot_state-ego_median	0.06492874228838579
sim_compute_robot_state-ego_min	0.06276956357453999
sim_compute_robot_state-npc0_max	0.0784483309145327
sim_compute_robot_state-npc0_mean	0.0753395036898599
sim_compute_robot_state-npc0_median	0.07614095705860066
sim_compute_robot_state-npc0_min	0.07151283715900622
sim_compute_robot_state-npc1_max	0.07574390439153875
sim_compute_robot_state-npc1_mean	0.07169697440696353
sim_compute_robot_state-npc1_median	0.07196694500041458
sim_compute_robot_state-npc1_min	0.06650858176381964
sim_compute_robot_state-npc2_max	0.07321671143318843
sim_compute_robot_state-npc2_mean	0.06913551323965697
sim_compute_robot_state-npc2_median	0.06963383476689176
sim_compute_robot_state-npc2_min	0.06416529103329308
sim_compute_robot_state-npc3_max	0.07292769024673018
sim_compute_robot_state-npc3_mean	0.06857564978610468
sim_compute_robot_state-npc3_median	0.069659188941673
sim_compute_robot_state-npc3_min	0.06182513738933362
sim_compute_sim_state_max	0.04079915018914973
sim_compute_sim_state_mean	0.03789271522983341
sim_compute_sim_state_median	0.03795051574707031
sim_compute_sim_state_min	0.03426546799509149
sim_physics_max	0.032354699755177914
sim_physics_mean	0.030185220138924117
sim_physics_median	0.030671690994838494
sim_physics_min	0.026006585673282023
sim_render-ego_max	0.0697294181247927
sim_render-ego_mean	0.06705014763864534
sim_render-ego_median	0.06783565768489132
sim_render-ego_min	0.06360742920323421
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.739999999999997
survival_time_min	0.9500000000000004

No reset possible

19987

2503

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:42:46+00:00

2019-04-25 08:43:26+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19970

2578

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:41:38+00:00

2019-04-25 08:42:16+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19952

2691

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:40:21+00:00

2019-04-25 08:41:19+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19941

2844

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:39:27+00:00

2019-04-25 08:40:07+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19930

2933

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:38:31+00:00

2019-04-25 08:39:08+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19915

2653

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:37:28+00:00

2019-04-25 08:38:23+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19898

2716

jiang peng

test for ppo

step1-simulation

error

2019-04-25 08:36:31+00:00

2019-04-25 08:37:10+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19884

2792

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:35:13+00:00

2019-04-25 08:36:12+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19875

2872

Peter Almasi 🇭🇺

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:34:01+00:00

2019-04-25 08:35:00+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19864

2949

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:32:36+00:00

2019-04-25 08:33:36+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19858

2995

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 08:31:46+00:00

2019-04-25 08:32:24+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19850

3019

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:30:55+00:00

2019-04-25 08:31:34+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19845

3043

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 08:30:04+00:00

2019-04-25 08:30:48+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19839

2904

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-25 08:28:58+00:00

2019-04-25 08:29:57+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19827

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 08:19:40+00:00

2019-04-25 08:28:33+00:00

0:08:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.192850800093046
survival_time_median	3.699999999999995
deviation-center-line_median	0.22317625291004176
in-drivable-lane_median	0.40000000000000013

other stats

agent_compute-ego_max	0.07635776648360691
agent_compute-ego_mean	0.07191497060138113
agent_compute-ego_median	0.07243999567898837
agent_compute-ego_min	0.0671130354340012
deviation-center-line_max	0.8409586872561159
deviation-center-line_mean	0.3240149452804257
deviation-center-line_min	0.08260198369865339
deviation-heading_max	2.7068470395648907
deviation-heading_mean	1.177368593165525
deviation-heading_median	0.9272201856358104
deviation-heading_min	0.4976783063937394
driven_any_max	1.568135579701663
driven_any_mean	0.6530805626135524
driven_any_median	0.5476136723054288
driven_any_min	0.21811749319179355
driven_lanedir_consec_max	1.211528748300235
driven_lanedir_consec_mean	0.4487473439337165
driven_lanedir_consec_min	0.15500504957372785
driven_lanedir_max	1.2118495709382602
driven_lanedir_mean	0.4549875223824772
driven_lanedir_median	0.22097589362730807
driven_lanedir_min	0.15500504957372785
in-drivable-lane_max	2.0999999999999934
in-drivable-lane_mean	0.8500000000000029
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6572101586623545, "sim_physics": 0.03257669491714306, "survival_time": 4.449999999999992, "driven_lanedir": 0.22097589362730807, "sim_render-ego": 0.062035295400726664, "in-drivable-lane": 2.0999999999999934, "agent_compute-ego": 0.07635776648360691, "deviation-heading": 1.250273538571795, "set_robot_commands": 0.08109013418133339, "deviation-center-line": 0.22317625291004176, "driven_lanedir_consec": 0.1900958240215298, "sim_compute_sim_state": 0.03587973519657435, "sim_compute_performance-ego": 0.06319716807161824, "sim_compute_robot_state-ego": 0.06171187122216385, "sim_compute_robot_state-npc0": 0.06803725542647115, "sim_compute_robot_state-npc1": 0.06215927038299904, "sim_compute_robot_state-npc2": 0.06153479854712326, "sim_compute_robot_state-npc3": 0.06230275282699071}, "udem1-1-0": {"driven_any": 0.2743259092065222, "sim_physics": 0.02694711685180664, "survival_time": 2.000000000000001, "driven_lanedir": 0.15500504957372785, "sim_render-ego": 0.06113508939743042, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.07283477187156677, "deviation-heading": 0.9272201856358104, "set_robot_commands": 0.07971562743186951, "deviation-center-line": 0.08260198369865339, "driven_lanedir_consec": 0.15500504957372785, "sim_compute_sim_state": 0.034761077165603636, "sim_compute_performance-ego": 0.061344039440155027, "sim_compute_robot_state-ego": 0.061483001708984374, "sim_compute_robot_state-npc0": 0.0701676845550537, "sim_compute_robot_state-npc1": 0.0626634418964386, "sim_compute_robot_state-npc2": 0.061890602111816406, "sim_compute_robot_state-npc3": 0.06163807511329651}, "udem1-2-0": {"driven_any": 0.5476136723054288, "sim_physics": 0.03294757572380272, "survival_time": 3.699999999999995, "driven_lanedir": 0.4942562976800442, "sim_render-ego": 0.06112237556560619, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.0671130354340012, "deviation-heading": 0.4976783063937394, "set_robot_commands": 0.0763940327876323, "deviation-center-line": 0.3378723663769211, "driven_lanedir_consec": 0.4942562976800442, "sim_compute_sim_state": 0.034593350178486595, "sim_compute_performance-ego": 0.06117341969464276, "sim_compute_robot_state-ego": 0.06212156205563932, "sim_compute_robot_state-npc0": 0.06405351290831694, "sim_compute_robot_state-npc1": 0.06120919214712607, "sim_compute_robot_state-npc2": 0.06190055769843024, "sim_compute_robot_state-npc3": 0.061277708491763554}, "udem1-3-0": {"driven_any": 0.21811749319179355, "sim_physics": 0.027944333625562263, "survival_time": 1.6500000000000008, "driven_lanedir": 0.192850800093046, "sim_render-ego": 0.05672495292894768, "in-drivable-lane": 0, "agent_compute-ego": 0.07243999567898837, "deviation-heading": 0.5048238956613887, "set_robot_commands": 0.07946340243021648, "deviation-center-line": 0.13546543616039652, "driven_lanedir_consec": 0.192850800093046, "sim_compute_sim_state": 0.03351527994329279, "sim_compute_performance-ego": 0.05808724056590687, "sim_compute_robot_state-ego": 0.0605676607652144, "sim_compute_robot_state-npc0": 0.0660162911270604, "sim_compute_robot_state-npc1": 0.059943285855379974, "sim_compute_robot_state-npc2": 0.06280510353319572, "sim_compute_robot_state-npc3": 0.061652393052072235}, "udem1-4-0": {"driven_any": 1.568135579701663, "sim_physics": 0.027907659758382768, "survival_time": 10.050000000000008, "driven_lanedir": 1.2118495709382602, "sim_render-ego": 0.05586528778076172, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.07082928353874245, "deviation-heading": 2.7068470395648907, "set_robot_commands": 0.07607681952898775, "deviation-center-line": 0.8409586872561159, "driven_lanedir_consec": 1.211528748300235, "sim_compute_sim_state": 0.032633701960245766, "sim_compute_performance-ego": 0.05893183466213853, "sim_compute_robot_state-ego": 0.05947712642043384, "sim_compute_robot_state-npc0": 0.06485873668348018, "sim_compute_robot_state-npc1": 0.06077701416774769, "sim_compute_robot_state-npc2": 0.05970847428734623, "sim_compute_robot_state-npc3": 0.06008315798061997}}
set_robot_commands_max	0.08109013418133339
set_robot_commands_mean	0.07854800327200788
set_robot_commands_median	0.07946340243021648
set_robot_commands_min	0.07607681952898775
sim_compute_performance-ego_max	0.06319716807161824
sim_compute_performance-ego_mean	0.06054674048689228
sim_compute_performance-ego_median	0.06117341969464276
sim_compute_performance-ego_min	0.05808724056590687
sim_compute_robot_state-ego_max	0.06212156205563932
sim_compute_robot_state-ego_mean	0.06107224443448715
sim_compute_robot_state-ego_median	0.061483001708984374
sim_compute_robot_state-ego_min	0.05947712642043384
sim_compute_robot_state-npc0_max	0.0701676845550537
sim_compute_robot_state-npc0_mean	0.06662669614007648
sim_compute_robot_state-npc0_median	0.0660162911270604
sim_compute_robot_state-npc0_min	0.06405351290831694
sim_compute_robot_state-npc1_max	0.0626634418964386
sim_compute_robot_state-npc1_mean	0.061350440889938275
sim_compute_robot_state-npc1_median	0.06120919214712607
sim_compute_robot_state-npc1_min	0.059943285855379974
sim_compute_robot_state-npc2_max	0.06280510353319572
sim_compute_robot_state-npc2_mean	0.06156790723558238
sim_compute_robot_state-npc2_median	0.061890602111816406
sim_compute_robot_state-npc2_min	0.05970847428734623
sim_compute_robot_state-npc3_max	0.06230275282699071
sim_compute_robot_state-npc3_mean	0.06139081749294859
sim_compute_robot_state-npc3_median	0.06163807511329651
sim_compute_robot_state-npc3_min	0.06008315798061997
sim_compute_sim_state_max	0.03587973519657435
sim_compute_sim_state_mean	0.03427662888884063
sim_compute_sim_state_median	0.034593350178486595
sim_compute_sim_state_min	0.032633701960245766
sim_physics_max	0.03294757572380272
sim_physics_mean	0.029664676175339487
sim_physics_median	0.027944333625562263
sim_physics_min	0.02694711685180664
sim_render-ego_max	0.062035295400726664
sim_render-ego_mean	0.05937660021469454
sim_render-ego_median	0.06112237556560619
sim_render-ego_min	0.05586528778076172
simulation-passed	1
survival_time_max	10.050000000000008
survival_time_mean	4.369999999999999
survival_time_min	1.6500000000000008

No reset possible

19826

2723

jiang peng

test for ppo

step1-simulation

error

2019-04-25 08:18:40+00:00

2019-04-25 08:19:19+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19813

2928

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 08:12:09+00:00

2019-04-25 08:18:28+00:00

0:06:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1168359609116223
survival_time_median	1.2500000000000004
deviation-center-line_median	0.06906112133859554
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.19121044681918237
agent_compute-ego_mean	0.17390821784696628
agent_compute-ego_median	0.177916685740153
agent_compute-ego_min	0.15771255493164063
deviation-center-line_max	0.11077967186771896
deviation-center-line_mean	0.07965446886337739
deviation-center-line_min	0.05408807776073249
deviation-heading_max	0.8506143626344457
deviation-heading_mean	0.6701259246433062
deviation-heading_median	0.7817189294217113
deviation-heading_min	0.4519268094165167
driven_any_max	0.24077014204362404
driven_any_mean	0.18210031109295768
driven_any_median	0.17770388981489454
driven_any_min	0.136107082977737
driven_lanedir_consec_max	0.15210670116922276
driven_lanedir_consec_mean	0.10935765422857156
driven_lanedir_consec_min	0.06722545092951382
driven_lanedir_max	0.15210670116922276
driven_lanedir_mean	0.10935765422857156
driven_lanedir_median	0.1168359609116223
driven_lanedir_min	0.06722545092951382
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.2100000000000002
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.24077014204362404, "sim_physics": 0.026973987237001076, "survival_time": 1.950000000000001, "driven_lanedir": 0.1168359609116223, "sim_render-ego": 0.06125093117738382, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16127700072068435, "deviation-heading": 0.8129932598517031, "set_robot_commands": 0.0760498474805783, "deviation-center-line": 0.06906112133859554, "driven_lanedir_consec": 0.1168359609116223, "sim_compute_sim_state": 0.03432180942633213, "sim_compute_performance-ego": 0.06519457010122445, "sim_compute_robot_state-ego": 0.06398597741738343, "sim_compute_robot_state-npc0": 0.0701759411738469, "sim_compute_robot_state-npc1": 0.06346247135064541, "sim_compute_robot_state-npc2": 0.06290369767409104, "sim_compute_robot_state-npc3": 0.06092979969122471}, "udem1-1-0": {"driven_any": 0.19605612359308713, "sim_physics": 0.02886611415493873, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06722545092951382, "sim_render-ego": 0.05992937088012695, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.19121044681918237, "deviation-heading": 0.8506143626344457, "set_robot_commands": 0.07613585072178994, "deviation-center-line": 0.0554645033141533, "driven_lanedir_consec": 0.06722545092951382, "sim_compute_sim_state": 0.03474932332192698, "sim_compute_performance-ego": 0.05741453939868558, "sim_compute_robot_state-ego": 0.06318638401646767, "sim_compute_robot_state-npc0": 0.06637878571787188, "sim_compute_robot_state-npc1": 0.062249006763581305, "sim_compute_robot_state-npc2": 0.06175713385305097, "sim_compute_robot_state-npc3": 0.06274544808172411}, "udem1-2-0": {"driven_any": 0.15986431703544565, "sim_physics": 0.03194612264633179, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13233485271255185, "sim_render-ego": 0.05775617559750875, "in-drivable-lane": 0, "agent_compute-ego": 0.177916685740153, "deviation-heading": 0.4519268094165167, "set_robot_commands": 0.07272387544314067, "deviation-center-line": 0.10887897003568664, "driven_lanedir_consec": 0.13233485271255185, "sim_compute_sim_state": 0.03246658047040304, "sim_compute_performance-ego": 0.059648364782333374, "sim_compute_robot_state-ego": 0.061903039614359535, "sim_compute_robot_state-npc0": 0.06513327360153198, "sim_compute_robot_state-npc1": 0.06181437770525614, "sim_compute_robot_state-npc2": 0.05872374773025513, "sim_compute_robot_state-npc3": 0.05964776873588562}, "udem1-3-0": {"driven_any": 0.17770388981489454, "sim_physics": 0.028091917037963866, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15210670116922276, "sim_render-ego": 0.05987590789794922, "in-drivable-lane": 0, "agent_compute-ego": 0.15771255493164063, "deviation-heading": 0.4533762618921547, "set_robot_commands": 0.08183385848999024, "deviation-center-line": 0.11077967186771896, "driven_lanedir_consec": 0.15210670116922276, "sim_compute_sim_state": 0.035508890151977536, "sim_compute_performance-ego": 0.0612215805053711, "sim_compute_robot_state-ego": 0.05911540031433105, "sim_compute_robot_state-npc0": 0.06934809684753418, "sim_compute_robot_state-npc1": 0.065515775680542, "sim_compute_robot_state-npc2": 0.06409639358520508, "sim_compute_robot_state-npc3": 0.06516027450561523}, "udem1-4-0": {"driven_any": 0.136107082977737, "sim_physics": 0.026919993487271397, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07828530541994705, "sim_render-ego": 0.05676130814985795, "in-drivable-lane": 0, "agent_compute-ego": 0.18142440102317117, "deviation-heading": 0.7817189294217113, "set_robot_commands": 0.07566377249631015, "deviation-center-line": 0.05408807776073249, "driven_lanedir_consec": 0.07828530541994705, "sim_compute_sim_state": 0.03444225137883967, "sim_compute_performance-ego": 0.06129080599004572, "sim_compute_robot_state-ego": 0.05915689468383789, "sim_compute_robot_state-npc0": 0.06487541848962958, "sim_compute_robot_state-npc1": 0.06141533634879373, "sim_compute_robot_state-npc2": 0.05889428745616566, "sim_compute_robot_state-npc3": 0.05974591862071644}}
set_robot_commands_max	0.08183385848999024
set_robot_commands_mean	0.07648144092636186
set_robot_commands_median	0.0760498474805783
set_robot_commands_min	0.07272387544314067
sim_compute_performance-ego_max	0.06519457010122445
sim_compute_performance-ego_mean	0.06095397215553204
sim_compute_performance-ego_median	0.0612215805053711
sim_compute_performance-ego_min	0.05741453939868558
sim_compute_robot_state-ego_max	0.06398597741738343
sim_compute_robot_state-ego_mean	0.06146953920927591
sim_compute_robot_state-ego_median	0.061903039614359535
sim_compute_robot_state-ego_min	0.05911540031433105
sim_compute_robot_state-npc0_max	0.0701759411738469
sim_compute_robot_state-npc0_mean	0.0671823031660829
sim_compute_robot_state-npc0_median	0.06637878571787188
sim_compute_robot_state-npc0_min	0.06487541848962958
sim_compute_robot_state-npc1_max	0.065515775680542
sim_compute_robot_state-npc1_mean	0.06289139356976371
sim_compute_robot_state-npc1_median	0.062249006763581305
sim_compute_robot_state-npc1_min	0.06141533634879373
sim_compute_robot_state-npc2_max	0.06409639358520508
sim_compute_robot_state-npc2_mean	0.061275052059753574
sim_compute_robot_state-npc2_median	0.06175713385305097
sim_compute_robot_state-npc2_min	0.05872374773025513
sim_compute_robot_state-npc3_max	0.06516027450561523
sim_compute_robot_state-npc3_mean	0.06164584192703322
sim_compute_robot_state-npc3_median	0.06092979969122471
sim_compute_robot_state-npc3_min	0.05964776873588562
sim_compute_sim_state_max	0.035508890151977536
sim_compute_sim_state_mean	0.03429777094989587
sim_compute_sim_state_median	0.03444225137883967
sim_compute_sim_state_min	0.03246658047040304
sim_physics_max	0.03194612264633179
sim_physics_mean	0.02855962691270137
sim_physics_median	0.028091917037963866
sim_physics_min	0.026919993487271397
sim_render-ego_max	0.06125093117738382
sim_render-ego_mean	0.059114738740565345
sim_render-ego_median	0.05987590789794922
sim_render-ego_min	0.05676130814985795
simulation-passed	1
survival_time_max	1.950000000000001
survival_time_mean	1.4100000000000006
survival_time_min	1.1000000000000003

No reset possible

19808

3002

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 08:11:25+00:00

2019-04-25 08:12:03+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19803

3050

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 08:10:36+00:00

2019-04-25 08:11:18+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19788

2612

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 08:01:37+00:00

2019-04-25 08:10:18+00:00

0:08:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4677520238097679
survival_time_median	2.849999999999998
deviation-center-line_median	0.13993923038273243
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.07279123957194979
agent_compute-ego_mean	0.0682818510022939
agent_compute-ego_median	0.0691046361570005
agent_compute-ego_min	0.0638083533236855
deviation-center-line_max	0.441991081977021
deviation-center-line_mean	0.24301419493149473
deviation-center-line_min	0.11233303566656118
deviation-heading_max	1.965590298952019
deviation-heading_mean	0.904977224642509
deviation-heading_median	0.6817498444220604
deviation-heading_min	0.23880859753921196
driven_any_max	2.234618045439434
driven_any_mean	1.1136680430892796
driven_any_median	0.7854280860806753
driven_any_min	0.3734823939695258
driven_lanedir_consec_max	1.4162453958283412
driven_lanedir_consec_mean	0.7217431069832176
driven_lanedir_consec_min	0.3618460409658957
driven_lanedir_max	1.4162453958283412
driven_lanedir_mean	0.7217431069832176
driven_lanedir_median	0.4677520238097679
driven_lanedir_min	0.3618460409658957
in-drivable-lane_max	3.2999999999999883
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.029271077198587406, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.06295345695155441, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06657182790671184, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.07520330787464312, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.03585747700587959, "sim_compute_performance-ego": 0.06355184354599874, "sim_compute_robot_state-ego": 0.0633788837748728, "sim_compute_robot_state-npc0": 0.07172391824661546, "sim_compute_robot_state-npc1": 0.06561123793292198, "sim_compute_robot_state-npc2": 0.0649665950969526, "sim_compute_robot_state-npc3": 0.06471918039261156}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.025989306600470292, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.060230480997185955, "in-drivable-lane": 0, "agent_compute-ego": 0.0638083533236855, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.0737687161094264, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.033049972433792915, "sim_compute_performance-ego": 0.06153336951607152, "sim_compute_robot_state-ego": 0.05999826130114103, "sim_compute_robot_state-npc0": 0.07314555268538625, "sim_compute_robot_state-npc1": 0.06729861937071148, "sim_compute_robot_state-npc2": 0.06371447914525082, "sim_compute_robot_state-npc3": 0.05989976305710642}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.0294589452576219, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.05988772291886179, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06913319805212188, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.07648580952694542, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.03531474397893537, "sim_compute_performance-ego": 0.06311804369876259, "sim_compute_robot_state-ego": 0.062068541844685875, "sim_compute_robot_state-npc0": 0.06915591892443206, "sim_compute_robot_state-npc1": 0.06515074612801536, "sim_compute_robot_state-npc2": 0.06392077395790502, "sim_compute_robot_state-npc3": 0.06411468355279219}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.028702647597701463, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.06266886216622812, "in-drivable-lane": 0, "agent_compute-ego": 0.0691046361570005, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.07670381334092882, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.034775733947753906, "sim_compute_performance-ego": 0.06238377535784686, "sim_compute_robot_state-ego": 0.06395936012268066, "sim_compute_robot_state-npc0": 0.07050826814439562, "sim_compute_robot_state-npc1": 0.06340575218200684, "sim_compute_robot_state-npc2": 0.05972086058722602, "sim_compute_robot_state-npc3": 0.06367856484872324}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.032829280883546856, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.06687326279897539, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07279123957194979, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.08179408217233325, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.0395941866768731, "sim_compute_performance-ego": 0.06903925963810512, "sim_compute_robot_state-ego": 0.06649086021241687, "sim_compute_robot_state-npc0": 0.07503959867689344, "sim_compute_robot_state-npc1": 0.0695869071143014, "sim_compute_robot_state-npc2": 0.06911920555054195, "sim_compute_robot_state-npc3": 0.06870039304097493}}
set_robot_commands_max	0.08179408217233325
set_robot_commands_mean	0.0767911458048554
set_robot_commands_median	0.07648580952694542
set_robot_commands_min	0.0737687161094264
sim_compute_performance-ego_max	0.06903925963810512
sim_compute_performance-ego_mean	0.06392525835135696
sim_compute_performance-ego_median	0.06311804369876259
sim_compute_performance-ego_min	0.06153336951607152
sim_compute_robot_state-ego_max	0.06649086021241687
sim_compute_robot_state-ego_mean	0.06317918145115944
sim_compute_robot_state-ego_median	0.0633788837748728
sim_compute_robot_state-ego_min	0.05999826130114103
sim_compute_robot_state-npc0_max	0.07503959867689344
sim_compute_robot_state-npc0_mean	0.07191465133554457
sim_compute_robot_state-npc0_median	0.07172391824661546
sim_compute_robot_state-npc0_min	0.06915591892443206
sim_compute_robot_state-npc1_max	0.0695869071143014
sim_compute_robot_state-npc1_mean	0.06621065254559141
sim_compute_robot_state-npc1_median	0.06561123793292198
sim_compute_robot_state-npc1_min	0.06340575218200684
sim_compute_robot_state-npc2_max	0.06911920555054195
sim_compute_robot_state-npc2_mean	0.0642883828675753
sim_compute_robot_state-npc2_median	0.06392077395790502
sim_compute_robot_state-npc2_min	0.05972086058722602
sim_compute_robot_state-npc3_max	0.06870039304097493
sim_compute_robot_state-npc3_mean	0.06422251697844167
sim_compute_robot_state-npc3_median	0.06411468355279219
sim_compute_robot_state-npc3_min	0.05989976305710642
sim_compute_sim_state_max	0.0395941866768731
sim_compute_sim_state_mean	0.035718422808646975
sim_compute_sim_state_median	0.03531474397893537
sim_compute_sim_state_min	0.033049972433792915
sim_physics_max	0.032829280883546856
sim_physics_mean	0.029250251507585583
sim_physics_median	0.029271077198587406
sim_physics_min	0.025989306600470292
sim_render-ego_max	0.06687326279897539
sim_render-ego_mean	0.06252275716656112
sim_render-ego_median	0.06266886216622812
sim_render-ego_min	0.05988772291886179
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	4.049999999999993
survival_time_min	1.3500000000000003

No reset possible

19742

2907

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 07:45:28+00:00

2019-04-25 08:01:15+00:00

0:15:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3745342426838212
survival_time_median	8.199999999999982
deviation-center-line_median	0.5215655214406835
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.197071911995871
agent_compute-ego_mean	0.1872450268896159
agent_compute-ego_median	0.1889086116955975
agent_compute-ego_min	0.17915741284688314
deviation-center-line_max	1.0243712505239329
deviation-center-line_mean	0.5104937828661258
deviation-center-line_min	0.181552173414958
deviation-heading_max	0.9674238141748316
deviation-heading_mean	0.8240707405707675
deviation-heading_median	0.8364369420819541
deviation-heading_min	0.6524393281816242
driven_any_max	2.560662071787198
driven_any_mean	1.3866578975264614
driven_any_median	1.3814167929586016
driven_any_min	0.3768745879914847
driven_lanedir_consec_max	2.334870794711395
driven_lanedir_consec_mean	1.2560670952644155
driven_lanedir_consec_min	0.3635537664685682
driven_lanedir_max	2.3348916013987537
driven_lanedir_mean	1.2561498736032586
driven_lanedir_median	1.37490769676153
driven_lanedir_min	0.3635537664685682
in-drivable-lane_max	2.10000000000003
in-drivable-lane_mean	0.6700000000000095
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3814167929586016, "sim_physics": 0.02642942783309192, "survival_time": 8.199999999999982, "driven_lanedir": 1.37490769676153, "sim_render-ego": 0.053558153350178786, "in-drivable-lane": 0, "agent_compute-ego": 0.1892877715389903, "deviation-heading": 0.7821830618564979, "set_robot_commands": 0.07516294572411514, "deviation-center-line": 0.5215655214406835, "driven_lanedir_consec": 1.3745342426838212, "sim_compute_sim_state": 0.03203106798776766, "sim_compute_performance-ego": 0.05746353690217181, "sim_compute_robot_state-ego": 0.059042647117521704, "sim_compute_robot_state-npc0": 0.06531312407516851, "sim_compute_robot_state-npc1": 0.060880716254071494, "sim_compute_robot_state-npc2": 0.05851406440502259, "sim_compute_robot_state-npc3": 0.05830408160279437}, "udem1-1-0": {"driven_any": 0.44675572554277954, "sim_physics": 0.026271493811356395, "survival_time": 2.849999999999998, "driven_lanedir": 0.4211752412866385, "sim_render-ego": 0.057119147819385194, "in-drivable-lane": 0, "agent_compute-ego": 0.197071911995871, "deviation-heading": 0.9674238141748316, "set_robot_commands": 0.0761692816751045, "deviation-center-line": 0.20389742719410403, "driven_lanedir_consec": 0.4211752412866385, "sim_compute_sim_state": 0.03321528853031627, "sim_compute_performance-ego": 0.05944132386592396, "sim_compute_robot_state-ego": 0.06032143559372216, "sim_compute_robot_state-npc0": 0.07056250906827156, "sim_compute_robot_state-npc1": 0.06293211066932008, "sim_compute_robot_state-npc2": 0.061218805480421634, "sim_compute_robot_state-npc3": 0.06190406230458042}, "udem1-2-0": {"driven_any": 2.167580309352243, "sim_physics": 0.024971914103650673, "survival_time": 12.700000000000044, "driven_lanedir": 1.7862210621008026, "sim_render-ego": 0.05589656660875936, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.1889086116955975, "deviation-heading": 0.8818705565589293, "set_robot_commands": 0.07643724989703321, "deviation-center-line": 0.6210825417569507, "driven_lanedir_consec": 1.7862014311716543, "sim_compute_sim_state": 0.03232281696139358, "sim_compute_performance-ego": 0.058375532232870266, "sim_compute_robot_state-ego": 0.05905527862038199, "sim_compute_robot_state-npc0": 0.06447514023367815, "sim_compute_robot_state-npc1": 0.059401974903316945, "sim_compute_robot_state-npc2": 0.0580345157563217, "sim_compute_robot_state-npc3": 0.05901036112327275}, "udem1-3-0": {"driven_any": 2.560662071787198, "sim_physics": 0.024300905068715413, "survival_time": 14.950000000000076, "driven_lanedir": 2.3348916013987537, "sim_render-ego": 0.05249558687210083, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.17915741284688314, "deviation-heading": 0.8364369420819541, "set_robot_commands": 0.07424239873886108, "deviation-center-line": 1.0243712505239329, "driven_lanedir_consec": 2.334870794711395, "sim_compute_sim_state": 0.031618553002675374, "sim_compute_performance-ego": 0.056251644293467205, "sim_compute_robot_state-ego": 0.05720424890518189, "sim_compute_robot_state-npc0": 0.06132374445597331, "sim_compute_robot_state-npc1": 0.057348792552948, "sim_compute_robot_state-npc2": 0.05646773497263591, "sim_compute_robot_state-npc3": 0.05656026204427083}, "udem1-4-0": {"driven_any": 0.3768745879914847, "sim_physics": 0.024826113058596243, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3635537664685682, "sim_render-ego": 0.051329603000563016, "in-drivable-lane": 0, "agent_compute-ego": 0.1817994263707375, "deviation-heading": 0.6524393281816242, "set_robot_commands": 0.07486146810103436, "deviation-center-line": 0.181552173414958, "driven_lanedir_consec": 0.3635537664685682, "sim_compute_sim_state": 0.03078548275694555, "sim_compute_performance-ego": 0.05765050771285077, "sim_compute_robot_state-ego": 0.05741124250450913, "sim_compute_robot_state-npc0": 0.061607355974158465, "sim_compute_robot_state-npc1": 0.057997066147473395, "sim_compute_robot_state-npc2": 0.05595621770741988, "sim_compute_robot_state-npc3": 0.05528037888663156}}
set_robot_commands_max	0.07643724989703321
set_robot_commands_mean	0.07537466882722965
set_robot_commands_median	0.07516294572411514
set_robot_commands_min	0.07424239873886108
sim_compute_performance-ego_max	0.05944132386592396
sim_compute_performance-ego_mean	0.0578365090014568
sim_compute_performance-ego_median	0.05765050771285077
sim_compute_performance-ego_min	0.056251644293467205
sim_compute_robot_state-ego_max	0.06032143559372216
sim_compute_robot_state-ego_mean	0.05860697054826338
sim_compute_robot_state-ego_median	0.059042647117521704
sim_compute_robot_state-ego_min	0.05720424890518189
sim_compute_robot_state-npc0_max	0.07056250906827156
sim_compute_robot_state-npc0_mean	0.06465637476145
sim_compute_robot_state-npc0_median	0.06447514023367815
sim_compute_robot_state-npc0_min	0.06132374445597331
sim_compute_robot_state-npc1_max	0.06293211066932008
sim_compute_robot_state-npc1_mean	0.05971213210542599
sim_compute_robot_state-npc1_median	0.059401974903316945
sim_compute_robot_state-npc1_min	0.057348792552948
sim_compute_robot_state-npc2_max	0.061218805480421634
sim_compute_robot_state-npc2_mean	0.05803826766436435
sim_compute_robot_state-npc2_median	0.0580345157563217
sim_compute_robot_state-npc2_min	0.05595621770741988
sim_compute_robot_state-npc3_max	0.06190406230458042
sim_compute_robot_state-npc3_mean	0.05821182919230998
sim_compute_robot_state-npc3_median	0.05830408160279437
sim_compute_robot_state-npc3_min	0.05528037888663156
sim_compute_sim_state_max	0.03321528853031627
sim_compute_sim_state_mean	0.031994641847819694
sim_compute_sim_state_median	0.03203106798776766
sim_compute_sim_state_min	0.03078548275694555
sim_physics_max	0.02642942783309192
sim_physics_mean	0.02535997077508213
sim_physics_median	0.024971914103650673
sim_physics_min	0.024300905068715413
sim_render-ego_max	0.057119147819385194
sim_render-ego_mean	0.05407981153019743
sim_render-ego_median	0.053558153350178786
sim_render-ego_min	0.051329603000563016
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.230000000000022
survival_time_min	2.4499999999999993

No reset possible

19726

3042

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-24 21:08:36+00:00

2019-04-24 21:09:16+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19715

3035

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-24 21:05:08+00:00

2019-04-24 21:05:47+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19710

3026

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-24 20:43:58+00:00

2019-04-24 20:44:40+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19707

3011

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-24 20:25:57+00:00

2019-04-24 20:28:08+00:00

0:02:11

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19696

3003

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-24 20:18:20+00:00

2019-04-24 20:20:31+00:00

0:02:11

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19674

2367

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-24 16:36:40+00:00

2019-04-24 16:44:53+00:00

0:08:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.12597404642308013
agent_compute-ego_mean	0.12430574385914311
agent_compute-ego_median	0.12354796273367744
agent_compute-ego_min	0.12294780823492236
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.031146848012530613, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05850414624289861, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12354796273367744, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07692013089618986, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03456833249046689, "sim_compute_performance-ego": 0.06075354606386215, "sim_compute_robot_state-ego": 0.06033084884522453, "sim_compute_robot_state-npc0": 0.06829716288854205, "sim_compute_robot_state-npc1": 0.0639478365580241, "sim_compute_robot_state-npc2": 0.06250336813548255, "sim_compute_robot_state-npc3": 0.06353093707372272}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.028267126457363952, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05945567991219315, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.12322018660751044, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07491618044236127, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03314803628360524, "sim_compute_performance-ego": 0.06306191519194958, "sim_compute_robot_state-ego": 0.06190296247893689, "sim_compute_robot_state-npc0": 0.06726474855460372, "sim_compute_robot_state-npc1": 0.06447416660832424, "sim_compute_robot_state-npc2": 0.06139529920091816, "sim_compute_robot_state-npc3": 0.05994194161658194}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.031988047784374606, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05668817412468695, "in-drivable-lane": 0, "agent_compute-ego": 0.12294780823492236, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07551183623652305, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03373897460199172, "sim_compute_performance-ego": 0.060748469445013234, "sim_compute_robot_state-ego": 0.06548796546074652, "sim_compute_robot_state-npc0": 0.06480599987891413, "sim_compute_robot_state-npc1": 0.05986865105167512, "sim_compute_robot_state-npc2": 0.059872338848729285, "sim_compute_robot_state-npc3": 0.060694459945924824}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.030809029619744483, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.0597869614337353, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12597404642308013, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07961462913675511, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.034063136323969415, "sim_compute_performance-ego": 0.06046575941938035, "sim_compute_robot_state-ego": 0.06142529274554963, "sim_compute_robot_state-npc0": 0.06791782632787177, "sim_compute_robot_state-npc1": 0.060775888727066366, "sim_compute_robot_state-npc2": 0.06179331718607152, "sim_compute_robot_state-npc3": 0.06079661338887316}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.028283018332261305, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05497353352033175, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1258387152965252, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07602772345909706, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.034742616690122165, "sim_compute_performance-ego": 0.062415012946495645, "sim_compute_robot_state-ego": 0.06024793478158804, "sim_compute_robot_state-npc0": 0.06653161232288067, "sim_compute_robot_state-npc1": 0.0624197033735422, "sim_compute_robot_state-npc2": 0.061249301983759954, "sim_compute_robot_state-npc3": 0.05994314413804274}}
set_robot_commands_max	0.07961462913675511
set_robot_commands_mean	0.07659810003418528
set_robot_commands_median	0.07602772345909706
set_robot_commands_min	0.07491618044236127
sim_compute_performance-ego_max	0.06306191519194958
sim_compute_performance-ego_mean	0.06148894061334018
sim_compute_performance-ego_median	0.06075354606386215
sim_compute_performance-ego_min	0.06046575941938035
sim_compute_robot_state-ego_max	0.06548796546074652
sim_compute_robot_state-ego_mean	0.06187900086240912
sim_compute_robot_state-ego_median	0.06142529274554963
sim_compute_robot_state-ego_min	0.06024793478158804
sim_compute_robot_state-npc0_max	0.06829716288854205
sim_compute_robot_state-npc0_mean	0.06696346999456247
sim_compute_robot_state-npc0_median	0.06726474855460372
sim_compute_robot_state-npc0_min	0.06480599987891413
sim_compute_robot_state-npc1_max	0.06447416660832424
sim_compute_robot_state-npc1_mean	0.062297249263726394
sim_compute_robot_state-npc1_median	0.0624197033735422
sim_compute_robot_state-npc1_min	0.05986865105167512
sim_compute_robot_state-npc2_max	0.06250336813548255
sim_compute_robot_state-npc2_mean	0.06136272507099229
sim_compute_robot_state-npc2_median	0.06139529920091816
sim_compute_robot_state-npc2_min	0.059872338848729285
sim_compute_robot_state-npc3_max	0.06353093707372272
sim_compute_robot_state-npc3_mean	0.06098141923262908
sim_compute_robot_state-npc3_median	0.060694459945924824
sim_compute_robot_state-npc3_min	0.05994194161658194
sim_compute_sim_state_max	0.034742616690122165
sim_compute_sim_state_mean	0.034052219278031086
sim_compute_sim_state_median	0.034063136323969415
sim_compute_sim_state_min	0.03314803628360524
sim_physics_max	0.031988047784374606
sim_physics_mean	0.03009881404125499
sim_physics_median	0.030809029619744483
sim_physics_min	0.028267126457363952
sim_render-ego_max	0.0597869614337353
sim_render-ego_mean	0.05788169904676915
sim_render-ego_median	0.05850414624289861
sim_render-ego_min	0.05497353352033175
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

19627

2412

jiang peng

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:01:10+00:00

2019-04-24 16:36:34+00:00

0:35:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3614573264245535
survival_time_median	14.950000000000076
deviation-center-line_median	1.0119696714086834
in-drivable-lane_median	4.050000000000022

other stats

agent_compute-ego_max	0.5761282658576965
agent_compute-ego_mean	0.3691687281926472
agent_compute-ego_median	0.32798253377278647
agent_compute-ego_min	0.28531571467717487
deviation-center-line_max	1.0119699909612991
deviation-center-line_mean	1.0119697191394268
deviation-center-line_min	1.0119693200897382
deviation-heading_max	6.81542792438532
deviation-heading_mean	6.815427924385318
deviation-heading_median	6.815427924385318
deviation-heading_min	6.815427924385317
driven_any_max	4.390824152784938
driven_any_mean	4.3908241527849325
driven_any_median	4.3908241527849325
driven_any_min	4.390824152784927
driven_lanedir_consec_max	-1.361452200425545
driven_lanedir_consec_mean	-1.3614579701548792
driven_lanedir_consec_min	-1.3614641213545289
driven_lanedir_max	-2.315814608416598
driven_lanedir_mean	-2.3158170164441083
driven_lanedir_median	-2.3158169926021728
driven_lanedir_min	-2.315819376788188
in-drivable-lane_max	4.050000000000022
in-drivable-lane_mean	4.050000000000022
in-drivable-lane_min	4.050000000000022
per-episodes	details {"udem1-0-0": {"driven_any": 4.390824152784927, "sim_physics": 0.04142817974090576, "survival_time": 14.950000000000076, "driven_lanedir": -2.315816992602138, "sim_render-ego": 0.06103767077128092, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.5761282658576965, "deviation-heading": 6.815427924385318, "set_robot_commands": 0.08038323084513346, "deviation-center-line": 1.0119693200897382, "driven_lanedir_consec": -1.361457326424502, "sim_compute_sim_state": 0.03824665784835815, "sim_compute_performance-ego": 0.06651507059733074, "sim_compute_robot_state-ego": 0.07035071134567261, "sim_compute_robot_state-npc0": 0.06776563962300619, "sim_compute_robot_state-npc1": 0.0651838207244873, "sim_compute_robot_state-npc2": 0.06566424687703451, "sim_compute_robot_state-npc3": 0.06633431831995647}, "udem1-1-0": {"driven_any": 4.390824152784938, "sim_physics": 0.031816855271657306, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.058270734945933024, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.32798253377278647, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.07513944546381633, "deviation-center-line": 1.0119699909612991, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.035234074592590335, "sim_compute_performance-ego": 0.06084009647369384, "sim_compute_robot_state-ego": 0.06184642791748047, "sim_compute_robot_state-npc0": 0.06483476400375367, "sim_compute_robot_state-npc1": 0.061371955871582035, "sim_compute_robot_state-npc2": 0.06198980728785197, "sim_compute_robot_state-npc3": 0.062329331239064534}, "udem1-2-0": {"driven_any": 4.390824152784927, "sim_physics": 0.030383511384328207, "survival_time": 14.950000000000076, "driven_lanedir": -2.315819376788188, "sim_render-ego": 0.056453967889149984, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.3333202528953552, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.07470910867055257, "deviation-center-line": 1.0119699909612945, "driven_lanedir_consec": -1.3614641213545289, "sim_compute_sim_state": 0.034790712197621664, "sim_compute_performance-ego": 0.06086362997690837, "sim_compute_robot_state-ego": 0.0614087462425232, "sim_compute_robot_state-npc0": 0.06408914963404337, "sim_compute_robot_state-npc1": 0.061384681860605875, "sim_compute_robot_state-npc2": 0.05999785582224528, "sim_compute_robot_state-npc3": 0.06089724699656169}, "udem1-3-0": {"driven_any": 4.3908241527849325, "sim_physics": 0.02994277238845825, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158169926021728, "sim_render-ego": 0.05644707441329956, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.3230968737602234, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.07544492244720459, "deviation-center-line": 1.0119696714086834, "driven_lanedir_consec": -1.3614573264245535, "sim_compute_sim_state": 0.034603251616160076, "sim_compute_performance-ego": 0.06020973523457845, "sim_compute_robot_state-ego": 0.06317115227381388, "sim_compute_robot_state-npc0": 0.06459905862808228, "sim_compute_robot_state-npc1": 0.06138597091039022, "sim_compute_robot_state-npc2": 0.061404539744059246, "sim_compute_robot_state-npc3": 0.06042534907658895}, "udem1-4-0": {"driven_any": 4.390824152784936, "sim_physics": 0.030245021184285483, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158171118114455, "sim_render-ego": 0.05767667293548584, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.28531571467717487, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.0749137306213379, "deviation-center-line": 1.0119696222761183, "driven_lanedir_consec": -1.3614588761452664, "sim_compute_sim_state": 0.03465712785720825, "sim_compute_performance-ego": 0.06041971286137899, "sim_compute_robot_state-ego": 0.06138614892959595, "sim_compute_robot_state-npc0": 0.06654308160146077, "sim_compute_robot_state-npc1": 0.06095014492670695, "sim_compute_robot_state-npc2": 0.06005094766616821, "sim_compute_robot_state-npc3": 0.059386310577392576}}
set_robot_commands_max	0.08038323084513346
set_robot_commands_mean	0.07611808760960896
set_robot_commands_median	0.07513944546381633
set_robot_commands_min	0.07470910867055257
sim_compute_performance-ego_max	0.06651507059733074
sim_compute_performance-ego_mean	0.06176964902877807
sim_compute_performance-ego_median	0.06084009647369384
sim_compute_performance-ego_min	0.06020973523457845
sim_compute_robot_state-ego_max	0.07035071134567261
sim_compute_robot_state-ego_mean	0.0636326373418172
sim_compute_robot_state-ego_median	0.06184642791748047
sim_compute_robot_state-ego_min	0.06138614892959595
sim_compute_robot_state-npc0_max	0.06776563962300619
sim_compute_robot_state-npc0_mean	0.06556633869806926
sim_compute_robot_state-npc0_median	0.06483476400375367
sim_compute_robot_state-npc0_min	0.06408914963404337
sim_compute_robot_state-npc1_max	0.0651838207244873
sim_compute_robot_state-npc1_mean	0.06205531485875448
sim_compute_robot_state-npc1_median	0.061384681860605875
sim_compute_robot_state-npc1_min	0.06095014492670695
sim_compute_robot_state-npc2_max	0.06566424687703451
sim_compute_robot_state-npc2_mean	0.06182147947947184
sim_compute_robot_state-npc2_median	0.061404539744059246
sim_compute_robot_state-npc2_min	0.05999785582224528
sim_compute_robot_state-npc3_max	0.06633431831995647
sim_compute_robot_state-npc3_mean	0.06187451124191283
sim_compute_robot_state-npc3_median	0.06089724699656169
sim_compute_robot_state-npc3_min	0.059386310577392576
sim_compute_sim_state_max	0.03824665784835815
sim_compute_sim_state_mean	0.0355063648223877
sim_compute_sim_state_median	0.034790712197621664
sim_compute_sim_state_min	0.034603251616160076
sim_physics_max	0.04142817974090576
sim_physics_mean	0.032763267993927
sim_physics_median	0.030383511384328207
sim_physics_min	0.02994277238845825
sim_render-ego_max	0.06103767077128092
sim_render-ego_mean	0.057977224191029866
sim_render-ego_median	0.05767667293548584
sim_render-ego_min	0.05644707441329956
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

19597

2444

Jacopo Tani

random_agent

step1-simulation

success

2019-04-24 15:52:52+00:00

2019-04-24 16:00:57+00:00

0:08:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.1412738315642826
agent_compute-ego_mean	0.13634475755481992
agent_compute-ego_median	0.13631963262370989
agent_compute-ego_min	0.13270382342800016
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.040903931572323755, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.062009046948145304, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1412738315642826, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07893974440438407, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03581736201331729, "sim_compute_performance-ego": 0.06605054083324614, "sim_compute_robot_state-ego": 0.06764708246503558, "sim_compute_robot_state-npc0": 0.06726942365131681, "sim_compute_robot_state-npc1": 0.06606704091268872, "sim_compute_robot_state-npc2": 0.06397891044616699, "sim_compute_robot_state-npc3": 0.06300730175442165}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03371784266303567, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05486652430366067, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13631963262370989, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07933393179201613, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.0368348196441052, "sim_compute_performance-ego": 0.06110676597146427, "sim_compute_robot_state-ego": 0.06493887246823778, "sim_compute_robot_state-npc0": 0.0639956792195638, "sim_compute_robot_state-npc1": 0.061459952709721585, "sim_compute_robot_state-npc2": 0.06271801275365493, "sim_compute_robot_state-npc3": 0.06235980052574008}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.034018716504496914, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05547322380927301, "in-drivable-lane": 0, "agent_compute-ego": 0.13270382342800016, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07667937586384435, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03544626312871133, "sim_compute_performance-ego": 0.0602267365301809, "sim_compute_robot_state-ego": 0.06035377133277155, "sim_compute_robot_state-npc0": 0.06600206513558665, "sim_compute_robot_state-npc1": 0.060047868759401386, "sim_compute_robot_state-npc2": 0.0586549658929148, "sim_compute_robot_state-npc3": 0.06094986008059594}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.031839008026934686, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05644166976847547, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1347293270395157, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.0743896022756049, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.033202171325683594, "sim_compute_performance-ego": 0.06084479676916244, "sim_compute_robot_state-ego": 0.060001091754182855, "sim_compute_robot_state-npc0": 0.06434852011660312, "sim_compute_robot_state-npc1": 0.06294139902642433, "sim_compute_robot_state-npc2": 0.060897505029718926, "sim_compute_robot_state-npc3": 0.06027330489868813}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.029909211855668288, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05558101947490986, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1366971731185913, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08152648577323326, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03615625546528743, "sim_compute_performance-ego": 0.06235325336456299, "sim_compute_robot_state-ego": 0.06157358334614681, "sim_compute_robot_state-npc0": 0.06696458046252911, "sim_compute_robot_state-npc1": 0.06321376103621262, "sim_compute_robot_state-npc2": 0.06027604983403133, "sim_compute_robot_state-npc3": 0.06108604027674748}}
set_robot_commands_max	0.08152648577323326
set_robot_commands_mean	0.07817382802181654
set_robot_commands_median	0.07893974440438407
set_robot_commands_min	0.0743896022756049
sim_compute_performance-ego_max	0.06605054083324614
sim_compute_performance-ego_mean	0.06211641869372335
sim_compute_performance-ego_median	0.06110676597146427
sim_compute_performance-ego_min	0.0602267365301809
sim_compute_robot_state-ego_max	0.06764708246503558
sim_compute_robot_state-ego_mean	0.06290288027327491
sim_compute_robot_state-ego_median	0.06157358334614681
sim_compute_robot_state-ego_min	0.060001091754182855
sim_compute_robot_state-npc0_max	0.06726942365131681
sim_compute_robot_state-npc0_mean	0.0657160537171199
sim_compute_robot_state-npc0_median	0.06600206513558665
sim_compute_robot_state-npc0_min	0.0639956792195638
sim_compute_robot_state-npc1_max	0.06606704091268872
sim_compute_robot_state-npc1_mean	0.06274600448888973
sim_compute_robot_state-npc1_median	0.06294139902642433
sim_compute_robot_state-npc1_min	0.060047868759401386
sim_compute_robot_state-npc2_max	0.06397891044616699
sim_compute_robot_state-npc2_mean	0.0613050887912974
sim_compute_robot_state-npc2_median	0.060897505029718926
sim_compute_robot_state-npc2_min	0.0586549658929148
sim_compute_robot_state-npc3_max	0.06300730175442165
sim_compute_robot_state-npc3_mean	0.06153526150723866
sim_compute_robot_state-npc3_median	0.06108604027674748
sim_compute_robot_state-npc3_min	0.06027330489868813
sim_compute_sim_state_max	0.0368348196441052
sim_compute_sim_state_mean	0.035491374315420966
sim_compute_sim_state_median	0.03581736201331729
sim_compute_sim_state_min	0.033202171325683594
sim_physics_max	0.040903931572323755
sim_physics_mean	0.03407774212449186
sim_physics_median	0.03371784266303567
sim_physics_min	0.029909211855668288
sim_render-ego_max	0.062009046948145304
sim_render-ego_mean	0.05687429686089286
sim_render-ego_median	0.05558101947490986
sim_render-ego_min	0.05486652430366067
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

19594

2459

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-24 15:51:56+00:00

2019-04-24 15:52:38+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19570

2479

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:46:37+00:00

2019-04-24 15:47:30+00:00

0:00:53

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19558

2505

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-24 15:45:36+00:00

2019-04-24 15:46:31+00:00

0:00:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19546

2521

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:44:04+00:00

2019-04-24 15:45:22+00:00

0:01:18

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19521

2555

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-24 15:37:19+00:00

2019-04-24 15:43:50+00:00

0:06:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.06602128555900172
agent_compute-ego_mean	0.06255874676220838
agent_compute-ego_median	0.06172664348895733
agent_compute-ego_min	0.06050832705064253
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.031364932813142475, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.054142962004009046, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06287130807575426, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07476435962476229, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.033393957740382146, "sim_compute_performance-ego": 0.058395709489521226, "sim_compute_robot_state-ego": 0.05953321456909179, "sim_compute_robot_state-npc0": 0.061846238688418737, "sim_compute_robot_state-npc1": 0.0604000166842812, "sim_compute_robot_state-npc2": 0.059942398573222914, "sim_compute_robot_state-npc3": 0.05993505779065584}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.025977448413246555, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.054735704472190456, "in-drivable-lane": 0, "agent_compute-ego": 0.06602128555900172, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07411749739395945, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.033532995926706416, "sim_compute_performance-ego": 0.05732435301730507, "sim_compute_robot_state-ego": 0.058103172402632866, "sim_compute_robot_state-npc0": 0.06260405088725843, "sim_compute_robot_state-npc1": 0.058614599077325115, "sim_compute_robot_state-npc2": 0.05658086350089625, "sim_compute_robot_state-npc3": 0.05669120738380834}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.03159455152658316, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.055751947256234974, "in-drivable-lane": 0, "agent_compute-ego": 0.06172664348895733, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07697162261376014, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.0361631650191087, "sim_compute_performance-ego": 0.060124476750691734, "sim_compute_robot_state-ego": 0.06309339327689929, "sim_compute_robot_state-npc0": 0.06463520954816769, "sim_compute_robot_state-npc1": 0.06280005283844776, "sim_compute_robot_state-npc2": 0.06021971580309746, "sim_compute_robot_state-npc3": 0.06532726532373673}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03213675257185815, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.05837701743757221, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.061666169636686086, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07370817829185808, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03358299631468007, "sim_compute_performance-ego": 0.06327070988399881, "sim_compute_robot_state-ego": 0.05982030613321654, "sim_compute_robot_state-npc0": 0.06412169631098358, "sim_compute_robot_state-npc1": 0.05975560403205979, "sim_compute_robot_state-npc2": 0.0589832151439828, "sim_compute_robot_state-npc3": 0.059521681825879594}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02627768299796365, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.05822820555080067, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06050832705064253, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.0714842677116394, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03269316391511397, "sim_compute_performance-ego": 0.06041601571169766, "sim_compute_robot_state-ego": 0.05826183340766213, "sim_compute_robot_state-npc0": 0.06407876990058205, "sim_compute_robot_state-npc1": 0.06038514592430808, "sim_compute_robot_state-npc2": 0.06040036136453802, "sim_compute_robot_state-npc3": 0.05924383076754483}}
set_robot_commands_max	0.07697162261376014
set_robot_commands_mean	0.07420918512719588
set_robot_commands_median	0.07411749739395945
set_robot_commands_min	0.0714842677116394
sim_compute_performance-ego_max	0.06327070988399881
sim_compute_performance-ego_mean	0.05990625297064289
sim_compute_performance-ego_median	0.060124476750691734
sim_compute_performance-ego_min	0.05732435301730507
sim_compute_robot_state-ego_max	0.06309339327689929
sim_compute_robot_state-ego_mean	0.059762383957900525
sim_compute_robot_state-ego_median	0.05953321456909179
sim_compute_robot_state-ego_min	0.058103172402632866
sim_compute_robot_state-npc0_max	0.06463520954816769
sim_compute_robot_state-npc0_mean	0.0634571930670821
sim_compute_robot_state-npc0_median	0.06407876990058205
sim_compute_robot_state-npc0_min	0.061846238688418737
sim_compute_robot_state-npc1_max	0.06280005283844776
sim_compute_robot_state-npc1_mean	0.06039108371128439
sim_compute_robot_state-npc1_median	0.06038514592430808
sim_compute_robot_state-npc1_min	0.058614599077325115
sim_compute_robot_state-npc2_max	0.06040036136453802
sim_compute_robot_state-npc2_mean	0.05922531087714748
sim_compute_robot_state-npc2_median	0.059942398573222914
sim_compute_robot_state-npc2_min	0.05658086350089625
sim_compute_robot_state-npc3_max	0.06532726532373673
sim_compute_robot_state-npc3_mean	0.060143808618325065
sim_compute_robot_state-npc3_median	0.059521681825879594
sim_compute_robot_state-npc3_min	0.05669120738380834
sim_compute_sim_state_max	0.0361631650191087
sim_compute_sim_state_mean	0.03387325578319826
sim_compute_sim_state_median	0.033532995926706416
sim_compute_sim_state_min	0.03269316391511397
sim_physics_max	0.03213675257185815
sim_physics_mean	0.029470273664558795
sim_physics_median	0.031364932813142475
sim_physics_min	0.025977448413246555
sim_render-ego_max	0.05837701743757221
sim_render-ego_mean	0.05624716734416148
sim_render-ego_median	0.055751947256234974
sim_render-ego_min	0.054142962004009046
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

19501

2594

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 15:25:49+00:00

2019-04-24 15:36:59+00:00

0:11:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24065169028132297
survival_time_median	5.1999999999999895
deviation-center-line_median	0.2759467893798752
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.19105662337136925
agent_compute-ego_mean	0.1822976343708482
agent_compute-ego_median	0.1823833126288194
agent_compute-ego_min	0.17482208270652622
deviation-center-line_max	0.2849728936126146
deviation-center-line_mean	0.2634499965505913
deviation-center-line_min	0.2389737158963205
deviation-heading_max	2.112935659639651
deviation-heading_mean	2.017306687581979
deviation-heading_median	2.008255340648452
deviation-heading_min	1.9531988078653169
driven_any_max	0.30586048621067286
driven_any_mean	0.2824653945032282
driven_any_median	0.2788063803591431
driven_any_min	0.2711781178886129
driven_lanedir_consec_max	0.2719162035321243
driven_lanedir_consec_mean	0.24546881704208992
driven_lanedir_consec_min	0.23184888292133363
driven_lanedir_max	0.2719162035321243
driven_lanedir_mean	0.24546881704208992
driven_lanedir_median	0.24065169028132297
driven_lanedir_min	0.23184888292133363
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.30586048621067286, "sim_physics": 0.03264571767334545, "survival_time": 5.449999999999989, "driven_lanedir": 0.2719162035321243, "sim_render-ego": 0.05560676110993831, "in-drivable-lane": 0, "agent_compute-ego": 0.19105662337136925, "deviation-heading": 1.9531988078653169, "set_robot_commands": 0.07599768069905972, "deviation-center-line": 0.2849728936126146, "driven_lanedir_consec": 0.2719162035321243, "sim_compute_sim_state": 0.033843141083323626, "sim_compute_performance-ego": 0.059768600201388015, "sim_compute_robot_state-ego": 0.06269315185896847, "sim_compute_robot_state-npc0": 0.06221416674622702, "sim_compute_robot_state-npc1": 0.06109804844637529, "sim_compute_robot_state-npc2": 0.06049297927716456, "sim_compute_robot_state-npc3": 0.05978691468545056}, "udem1-1-0": {"driven_any": 0.2788063803591431, "sim_physics": 0.030726253986358643, "survival_time": 5.1999999999999895, "driven_lanedir": 0.24065169028132297, "sim_render-ego": 0.05671962178670443, "in-drivable-lane": 0, "agent_compute-ego": 0.1797896004640139, "deviation-heading": 1.9626749499236416, "set_robot_commands": 0.07218525272149307, "deviation-center-line": 0.2389737158963205, "driven_lanedir_consec": 0.24065169028132297, "sim_compute_sim_state": 0.033363860387068525, "sim_compute_performance-ego": 0.05730811219948989, "sim_compute_robot_state-ego": 0.06068540765688969, "sim_compute_robot_state-npc0": 0.05985714609806354, "sim_compute_robot_state-npc1": 0.05860492128592271, "sim_compute_robot_state-npc2": 0.05632026837422298, "sim_compute_robot_state-npc3": 0.0568630718267881}, "udem1-2-0": {"driven_any": 0.2740930016230381, "sim_physics": 0.032947696891485474, "survival_time": 5.09999999999999, "driven_lanedir": 0.23645558645839104, "sim_render-ego": 0.05371368398853377, "in-drivable-lane": 0, "agent_compute-ego": 0.17482208270652622, "deviation-heading": 2.112935659639651, "set_robot_commands": 0.07401839658325794, "deviation-center-line": 0.2772841154300696, "driven_lanedir_consec": 0.23645558645839104, "sim_compute_sim_state": 0.03300825521057727, "sim_compute_performance-ego": 0.057020926008037494, "sim_compute_robot_state-ego": 0.058673832930770574, "sim_compute_robot_state-npc0": 0.060120612967248056, "sim_compute_robot_state-npc1": 0.05857516971288943, "sim_compute_robot_state-npc2": 0.05672779270246917, "sim_compute_robot_state-npc3": 0.05727005706113927}, "udem1-3-0": {"driven_any": 0.2711781178886129, "sim_physics": 0.030991398371182956, "survival_time": 5.1999999999999895, "driven_lanedir": 0.23184888292133363, "sim_render-ego": 0.054018307190675005, "in-drivable-lane": 0, "agent_compute-ego": 0.1823833126288194, "deviation-heading": 2.0494686798328337, "set_robot_commands": 0.0725297538133768, "deviation-center-line": 0.2400724684340764, "driven_lanedir_consec": 0.23184888292133363, "sim_compute_sim_state": 0.03232895869475145, "sim_compute_performance-ego": 0.058052863066013045, "sim_compute_robot_state-ego": 0.059365228964732245, "sim_compute_robot_state-npc0": 0.06097477674484253, "sim_compute_robot_state-npc1": 0.057357538204926714, "sim_compute_robot_state-npc2": 0.057408034801483154, "sim_compute_robot_state-npc3": 0.056108676470243014}, "udem1-4-0": {"driven_any": 0.2823889864346741, "sim_physics": 0.02756315119126264, "survival_time": 5.09999999999999, "driven_lanedir": 0.24647172201727763, "sim_render-ego": 0.05580299274594176, "in-drivable-lane": 0, "agent_compute-ego": 0.18343655268351236, "deviation-heading": 2.008255340648452, "set_robot_commands": 0.0751496015810499, "deviation-center-line": 0.2759467893798752, "driven_lanedir_consec": 0.24647172201727763, "sim_compute_sim_state": 0.03313844344195198, "sim_compute_performance-ego": 0.05924687899795233, "sim_compute_robot_state-ego": 0.05890363805434283, "sim_compute_robot_state-npc0": 0.06387040194343119, "sim_compute_robot_state-npc1": 0.06132614145091936, "sim_compute_robot_state-npc2": 0.06015577970766554, "sim_compute_robot_state-npc3": 0.05947106024798225}}
set_robot_commands_max	0.07599768069905972
set_robot_commands_mean	0.07397613707964748
set_robot_commands_median	0.07401839658325794
set_robot_commands_min	0.07218525272149307
sim_compute_performance-ego_max	0.059768600201388015
sim_compute_performance-ego_mean	0.05827947609457616
sim_compute_performance-ego_median	0.058052863066013045
sim_compute_performance-ego_min	0.057020926008037494
sim_compute_robot_state-ego_max	0.06269315185896847
sim_compute_robot_state-ego_mean	0.06006425189314076
sim_compute_robot_state-ego_median	0.059365228964732245
sim_compute_robot_state-ego_min	0.058673832930770574
sim_compute_robot_state-npc0_max	0.06387040194343119
sim_compute_robot_state-npc0_mean	0.06140742089996247
sim_compute_robot_state-npc0_median	0.06097477674484253
sim_compute_robot_state-npc0_min	0.05985714609806354
sim_compute_robot_state-npc1_max	0.06132614145091936
sim_compute_robot_state-npc1_mean	0.059392363820206705
sim_compute_robot_state-npc1_median	0.05860492128592271
sim_compute_robot_state-npc1_min	0.057357538204926714
sim_compute_robot_state-npc2_max	0.06049297927716456
sim_compute_robot_state-npc2_mean	0.05822097097260108
sim_compute_robot_state-npc2_median	0.057408034801483154
sim_compute_robot_state-npc2_min	0.05632026837422298
sim_compute_robot_state-npc3_max	0.05978691468545056
sim_compute_robot_state-npc3_mean	0.057899956058320635
sim_compute_robot_state-npc3_median	0.05727005706113927
sim_compute_robot_state-npc3_min	0.056108676470243014
sim_compute_sim_state_max	0.033843141083323626
sim_compute_sim_state_mean	0.03313653176353457
sim_compute_sim_state_median	0.03313844344195198
sim_compute_sim_state_min	0.03232895869475145
sim_physics_max	0.032947696891485474
sim_physics_mean	0.03097484362272703
sim_physics_median	0.030991398371182956
sim_physics_min	0.02756315119126264
sim_render-ego_max	0.05671962178670443
sim_render-ego_mean	0.05517227336435865
sim_render-ego_median	0.05560676110993831
sim_render-ego_min	0.05371368398853377
simulation-passed	1
survival_time_max	5.449999999999989
survival_time_mean	5.209999999999989
survival_time_min	5.09999999999999

No reset possible

19467

2695

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 15:07:54+00:00

2019-04-24 15:24:36+00:00

0:16:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1802141406797024
survival_time_median	8.649999999999988
deviation-center-line_median	0.7965437983127776
in-drivable-lane_median	0.20000000000000284

other stats

agent_compute-ego_max	0.08893430577537229
agent_compute-ego_mean	0.06856204137096969
agent_compute-ego_median	0.06484275691363277
agent_compute-ego_min	0.05865654889603107
deviation-center-line_max	1.207239286033628
deviation-center-line_mean	0.7118996265720561
deviation-center-line_min	0.21780930389065103
deviation-heading_max	6.8992715004082275
deviation-heading_mean	2.8413549928865955
deviation-heading_median	1.8594951036697824
deviation-heading_min	1.3471748575077371
driven_any_max	2.3550395011431084
driven_any_mean	1.4292581002763558
driven_any_median	1.34315132029921
driven_any_min	0.7296519354957519
driven_lanedir_consec_max	1.362795467669451
driven_lanedir_consec_mean	1.0572859553801646
driven_lanedir_consec_min	0.5898827115023142
driven_lanedir_max	1.567971238993355
driven_lanedir_mean	1.2037433193101337
driven_lanedir_median	1.3178530377058442
driven_lanedir_min	0.5898827115023142
in-drivable-lane_max	2.2000000000000144
in-drivable-lane_mean	0.5300000000000032
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7296519354957519, "sim_physics": 0.031072716323696837, "survival_time": 4.899999999999991, "driven_lanedir": 0.5898827115023142, "sim_render-ego": 0.055600587202578176, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.06484275691363277, "deviation-heading": 1.8594951036697824, "set_robot_commands": 0.07621553236124468, "deviation-center-line": 0.21780930389065103, "driven_lanedir_consec": 0.5898827115023142, "sim_compute_sim_state": 0.03461705908483388, "sim_compute_performance-ego": 0.06194562084820806, "sim_compute_robot_state-ego": 0.06204235797025719, "sim_compute_robot_state-npc0": 0.06275558471679688, "sim_compute_robot_state-npc1": 0.06124884741646903, "sim_compute_robot_state-npc2": 0.060772484662581464, "sim_compute_robot_state-npc3": 0.06037734722604557}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.391394069959697, "sim_physics": 0.02875580734380797, "survival_time": 8.949999999999992, "driven_lanedir": 1.362795467669451, "sim_render-ego": 0.05322753650516105, "in-drivable-lane": 0, "agent_compute-ego": 0.06187546452996451, "deviation-heading": 1.5236063960619506, "set_robot_commands": 0.07373024498284196, "deviation-center-line": 0.8827161490522074, "driven_lanedir_consec": 1.362795467669451, "sim_compute_sim_state": 0.033885842595020484, "sim_compute_performance-ego": 0.06095795125268691, "sim_compute_robot_state-ego": 0.061595221471520106, "sim_compute_robot_state-npc0": 0.06082214856280961, "sim_compute_robot_state-npc1": 0.059957942483145434, "sim_compute_robot_state-npc2": 0.05987672033256659, "sim_compute_robot_state-npc3": 0.05855345726013184}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3270536744840118, "sim_physics": 0.025201330408018235, "survival_time": 8.549999999999986, "driven_lanedir": 1.1802141406797024, "sim_render-ego": 0.05189427297714858, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.05865654889603107, "deviation-heading": 2.5772271067852803, "set_robot_commands": 0.07356392430980303, "deviation-center-line": 0.4551895955710162, "driven_lanedir_consec": 1.1802141406797024, "sim_compute_sim_state": 0.032303295637431895, "sim_compute_performance-ego": 0.05605539801525094, "sim_compute_robot_state-ego": 0.05837043265850223, "sim_compute_robot_state-npc0": 0.05968611700492993, "sim_compute_robot_state-npc1": 0.05782098798026816, "sim_compute_robot_state-npc2": 0.05637749733283506, "sim_compute_robot_state-npc3": 0.05679665950306675}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3550395011431084, "sim_physics": 0.0298958420753479, "survival_time": 14.950000000000076, "driven_lanedir": 1.567971238993355, "sim_render-ego": 0.05653761943181356, "in-drivable-lane": 2.2000000000000144, "agent_compute-ego": 0.06850113073984782, "deviation-heading": 6.8992715004082275, "set_robot_commands": 0.08209709962209066, "deviation-center-line": 1.207239286033628, "driven_lanedir_consec": 0.8356844193435107, "sim_compute_sim_state": 0.03495833396911621, "sim_compute_performance-ego": 0.0631276257832845, "sim_compute_robot_state-ego": 0.0644575572013855, "sim_compute_robot_state-npc0": 0.06629026254018147, "sim_compute_robot_state-npc1": 0.06382560809453329, "sim_compute_robot_state-npc2": 0.0633202068010966, "sim_compute_robot_state-npc3": 0.06262346188227336}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.34315132029921, "sim_physics": 0.04651475228326169, "survival_time": 8.649999999999988, "driven_lanedir": 1.3178530377058442, "sim_render-ego": 0.07072139888829579, "in-drivable-lane": 0, "agent_compute-ego": 0.08893430577537229, "deviation-heading": 1.3471748575077371, "set_robot_commands": 0.09809202128063048, "deviation-center-line": 0.7965437983127776, "driven_lanedir_consec": 1.3178530377058442, "sim_compute_sim_state": 0.04325731916923743, "sim_compute_performance-ego": 0.07571929038604559, "sim_compute_robot_state-ego": 0.07680927122259415, "sim_compute_robot_state-npc0": 0.07564034765166354, "sim_compute_robot_state-npc1": 0.07464334041397007, "sim_compute_robot_state-npc2": 0.07512305237654317, "sim_compute_robot_state-npc3": 0.07535436525510225}}
set_robot_commands_max	0.09809202128063048
set_robot_commands_mean	0.08073976451132217
set_robot_commands_median	0.07621553236124468
set_robot_commands_min	0.07356392430980303
sim_compute_performance-ego_max	0.07571929038604559
sim_compute_performance-ego_mean	0.0635611772570952
sim_compute_performance-ego_median	0.06194562084820806
sim_compute_performance-ego_min	0.05605539801525094
sim_compute_robot_state-ego_max	0.07680927122259415
sim_compute_robot_state-ego_mean	0.06465496810485183
sim_compute_robot_state-ego_median	0.06204235797025719
sim_compute_robot_state-ego_min	0.05837043265850223
sim_compute_robot_state-npc0_max	0.07564034765166354
sim_compute_robot_state-npc0_mean	0.06503889209527627
sim_compute_robot_state-npc0_median	0.06275558471679688
sim_compute_robot_state-npc0_min	0.05968611700492993
sim_compute_robot_state-npc1_max	0.07464334041397007
sim_compute_robot_state-npc1_mean	0.0634993452776772
sim_compute_robot_state-npc1_median	0.06124884741646903
sim_compute_robot_state-npc1_min	0.05782098798026816
sim_compute_robot_state-npc2_max	0.07512305237654317
sim_compute_robot_state-npc2_mean	0.06309399230112459
sim_compute_robot_state-npc2_median	0.060772484662581464
sim_compute_robot_state-npc2_min	0.05637749733283506
sim_compute_robot_state-npc3_max	0.07535436525510225
sim_compute_robot_state-npc3_mean	0.06274105822532396
sim_compute_robot_state-npc3_median	0.06037734722604557
sim_compute_robot_state-npc3_min	0.05679665950306675
sim_compute_sim_state_max	0.04325731916923743
sim_compute_sim_state_mean	0.03580437009112798
sim_compute_sim_state_median	0.03461705908483388
sim_compute_sim_state_min	0.032303295637431895
sim_physics_max	0.04651475228326169
sim_physics_mean	0.032288089686826525
sim_physics_median	0.0298958420753479
sim_physics_min	0.025201330408018235
sim_render-ego_max	0.07072139888829579
sim_render-ego_mean	0.057596283000999435
sim_render-ego_median	0.055600587202578176
sim_render-ego_min	0.05189427297714858
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.200000000000008
survival_time_min	4.899999999999991

No reset possible

19429

2684

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:49:35+00:00

2019-04-24 15:02:50+00:00

0:13:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7377906672947074
survival_time_median	7.149999999999983
deviation-center-line_median	0.5083283083043251
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.05845232089360555
agent_compute-ego_mean	0.057627922284815815
agent_compute-ego_median	0.0581339856127759
agent_compute-ego_min	0.05543408522734771
deviation-center-line_max	0.9671908984070314
deviation-center-line_mean	0.4897683038646278
deviation-center-line_min	0.07617372737899289
deviation-heading_max	4.073216126496454
deviation-heading_mean	2.1483542581396686
deviation-heading_median	1.6247066279598623
deviation-heading_min	0.7053206864403494
driven_any_max	2.355652735895849
driven_any_mean	1.177010323636824
driven_any_median	1.0913542158937612
driven_any_min	0.2502506132699314
driven_lanedir_consec_max	1.8884274062032675
driven_lanedir_consec_mean	0.9061946579222112
driven_lanedir_consec_min	0.20634143012000392
driven_lanedir_max	2.2675864052720973
driven_lanedir_mean	1.0347437395629764
driven_lanedir_median	0.9996508302699167
driven_lanedir_min	0.20634143012000392
in-drivable-lane_max	1.450000000000002
in-drivable-lane_mean	0.31000000000000033
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.0913542158937612, "sim_physics": 0.026562992509428437, "survival_time": 7.149999999999983, "driven_lanedir": 1.0757604654934885, "sim_render-ego": 0.05091328720946412, "in-drivable-lane": 0, "agent_compute-ego": 0.0581339856127759, "deviation-heading": 0.945543217951354, "set_robot_commands": 0.0715332598119349, "deviation-center-line": 0.6494373078595951, "driven_lanedir_consec": 1.0740342193337018, "sim_compute_sim_state": 0.030589765602058464, "sim_compute_performance-ego": 0.05391379836555961, "sim_compute_robot_state-ego": 0.05479266426780007, "sim_compute_robot_state-npc0": 0.05839162606459398, "sim_compute_robot_state-npc1": 0.05506928483922999, "sim_compute_robot_state-npc2": 0.05446211441413506, "sim_compute_robot_state-npc3": 0.0551116799974775}, "udem1-1-0": {"driven_any": 0.7243390159135649, "sim_physics": 0.029386681814988453, "survival_time": 4.799999999999991, "driven_lanedir": 0.6243795666593757, "sim_render-ego": 0.04986958702405294, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.058209011952082314, "deviation-heading": 1.6247066279598623, "set_robot_commands": 0.07099098712205887, "deviation-center-line": 0.2477112773731944, "driven_lanedir_consec": 0.6243795666593757, "sim_compute_sim_state": 0.03043055534362793, "sim_compute_performance-ego": 0.05280476063489914, "sim_compute_robot_state-ego": 0.05441641559203466, "sim_compute_robot_state-npc0": 0.05761141826709112, "sim_compute_robot_state-npc1": 0.05509102592865626, "sim_compute_robot_state-npc2": 0.054501891136169434, "sim_compute_robot_state-npc3": 0.0542231077949206}, "udem1-2-0": {"driven_any": 1.463455037211013, "sim_physics": 0.026280174864099386, "survival_time": 9.4, "driven_lanedir": 0.9996508302699167, "sim_render-ego": 0.049086300616568705, "in-drivable-lane": 1.450000000000002, "agent_compute-ego": 0.05791020773826761, "deviation-heading": 4.073216126496454, "set_robot_commands": 0.07167300264886085, "deviation-center-line": 0.5083283083043251, "driven_lanedir_consec": 0.7377906672947074, "sim_compute_sim_state": 0.02988594389976339, "sim_compute_performance-ego": 0.052997452147463535, "sim_compute_robot_state-ego": 0.05425586091711166, "sim_compute_robot_state-npc0": 0.05566195604648995, "sim_compute_robot_state-npc1": 0.053967343999984416, "sim_compute_robot_state-npc2": 0.053312729013727064, "sim_compute_robot_state-npc3": 0.053412631471106344}, "udem1-3-0": {"driven_any": 0.2502506132699314, "sim_physics": 0.026324633005503063, "survival_time": 1.850000000000001, "driven_lanedir": 0.20634143012000392, "sim_render-ego": 0.049030303955078125, "in-drivable-lane": 0, "agent_compute-ego": 0.05543408522734771, "deviation-heading": 0.7053206864403494, "set_robot_commands": 0.07173256616334657, "deviation-center-line": 0.07617372737899289, "driven_lanedir_consec": 0.20634143012000392, "sim_compute_sim_state": 0.029440061466113943, "sim_compute_performance-ego": 0.05370282482456516, "sim_compute_robot_state-ego": 0.05554879033887709, "sim_compute_robot_state-npc0": 0.05521303254204827, "sim_compute_robot_state-npc1": 0.05288304509343328, "sim_compute_robot_state-npc2": 0.05142838246113545, "sim_compute_robot_state-npc3": 0.051337532095006994}, "udem1-4-0": {"driven_any": 2.355652735895849, "sim_physics": 0.025670392513275145, "survival_time": 14.950000000000076, "driven_lanedir": 2.2675864052720973, "sim_render-ego": 0.05002299706141154, "in-drivable-lane": 0, "agent_compute-ego": 0.05845232089360555, "deviation-heading": 3.392984631850324, "set_robot_commands": 0.07285736719767252, "deviation-center-line": 0.9671908984070314, "driven_lanedir_consec": 1.8884274062032675, "sim_compute_sim_state": 0.03068251212437948, "sim_compute_performance-ego": 0.05380072275797526, "sim_compute_robot_state-ego": 0.05584723154703776, "sim_compute_robot_state-npc0": 0.05701773961385091, "sim_compute_robot_state-npc1": 0.05478996992111206, "sim_compute_robot_state-npc2": 0.05415530522664388, "sim_compute_robot_state-npc3": 0.05449104944864909}}
set_robot_commands_max	0.07285736719767252
set_robot_commands_mean	0.07175743658877473
set_robot_commands_median	0.07167300264886085
set_robot_commands_min	0.07099098712205887
sim_compute_performance-ego_max	0.05391379836555961
sim_compute_performance-ego_mean	0.053443911746092546
sim_compute_performance-ego_median	0.05370282482456516
sim_compute_performance-ego_min	0.05280476063489914
sim_compute_robot_state-ego_max	0.05584723154703776
sim_compute_robot_state-ego_mean	0.05497219253257225
sim_compute_robot_state-ego_median	0.05479266426780007
sim_compute_robot_state-ego_min	0.05425586091711166
sim_compute_robot_state-npc0_max	0.05839162606459398
sim_compute_robot_state-npc0_mean	0.05677915450681485
sim_compute_robot_state-npc0_median	0.05701773961385091
sim_compute_robot_state-npc0_min	0.05521303254204827
sim_compute_robot_state-npc1_max	0.05509102592865626
sim_compute_robot_state-npc1_mean	0.0543601339564832
sim_compute_robot_state-npc1_median	0.05478996992111206
sim_compute_robot_state-npc1_min	0.05288304509343328
sim_compute_robot_state-npc2_max	0.054501891136169434
sim_compute_robot_state-npc2_mean	0.05357208445036218
sim_compute_robot_state-npc2_median	0.05415530522664388
sim_compute_robot_state-npc2_min	0.05142838246113545
sim_compute_robot_state-npc3_max	0.0551116799974775
sim_compute_robot_state-npc3_mean	0.05371520016143211
sim_compute_robot_state-npc3_median	0.0542231077949206
sim_compute_robot_state-npc3_min	0.051337532095006994
sim_compute_sim_state_max	0.03068251212437948
sim_compute_sim_state_mean	0.03020576768718864
sim_compute_sim_state_median	0.03043055534362793
sim_compute_sim_state_min	0.029440061466113943
sim_physics_max	0.029386681814988453
sim_physics_mean	0.026844974941458898
sim_physics_median	0.026324633005503063
sim_physics_min	0.025670392513275145
sim_render-ego_max	0.05091328720946412
sim_render-ego_mean	0.04978449517331509
sim_render-ego_median	0.04986958702405294
sim_render-ego_min	0.049030303955078125
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.63000000000001
survival_time_min	1.850000000000001

No reset possible

19420

2690

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:34:28+00:00

2019-04-24 14:43:49+00:00

0:09:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8487083914266242
survival_time_median	7.049999999999983
deviation-center-line_median	0.6468372360881994
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.062432928422910976
agent_compute-ego_mean	0.058266971209431626
agent_compute-ego_median	0.05777798727446912
agent_compute-ego_min	0.05652576865571918
deviation-center-line_max	1.3759809001795045
deviation-center-line_mean	0.7457584689632444
deviation-center-line_min	0.2412814347527685
deviation-heading_max	7.853890817959224
deviation-heading_mean	2.9284591619779485
deviation-heading_median	1.2707417734809467
deviation-heading_min	0.6833064953949669
driven_any_max	2.3549792340685265
driven_any_mean	1.3553169247604882
driven_any_median	1.0860284180506825
driven_any_min	0.4725765147268585
driven_lanedir_consec_max	1.2210270159478829
driven_lanedir_consec_mean	0.8843177127329124
driven_lanedir_consec_min	0.4550367077797048
driven_lanedir_max	1.6280778757749612
driven_lanedir_mean	1.1026273565978542
driven_lanedir_median	1.0580130706105737
driven_lanedir_min	0.4550367077797048
in-drivable-lane_max	2.0000000000000124
in-drivable-lane_mean	0.6400000000000038
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4725765147268585, "sim_physics": 0.015184070124770657, "survival_time": 3.2999999999999963, "driven_lanedir": 0.4550367077797048, "sim_render-ego": 0.048907139084555885, "in-drivable-lane": 0, "agent_compute-ego": 0.05652576865571918, "deviation-heading": 0.6833064953949669, "set_robot_commands": 0.0704994924140699, "deviation-center-line": 0.2412814347527685, "driven_lanedir_consec": 0.4550367077797048, "sim_compute_sim_state": 0.03066355893106171, "sim_compute_performance-ego": 0.05139379067854448, "sim_compute_robot_state-ego": 0.05331442211613511}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0019678787077506, "sim_physics": 0.015367505129645851, "survival_time": 12.750000000000046, "driven_lanedir": 1.6280778757749612, "sim_render-ego": 0.05090760249717563, "in-drivable-lane": 1.2000000000000064, "agent_compute-ego": 0.05777798727446912, "deviation-heading": 4.073162500043238, "set_robot_commands": 0.07212243080139161, "deviation-center-line": 0.9794765538365298, "driven_lanedir_consec": 1.2210270159478829, "sim_compute_sim_state": 0.03293631030064003, "sim_compute_performance-ego": 0.05573846779617609, "sim_compute_robot_state-ego": 0.05848862704108743}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3549792340685265, "sim_physics": 0.015146590868632, "survival_time": 14.950000000000076, "driven_lanedir": 1.5233007373974077, "sim_render-ego": 0.04947725137074789, "in-drivable-lane": 2.0000000000000124, "agent_compute-ego": 0.05782913208007812, "deviation-heading": 7.853890817959224, "set_robot_commands": 0.07090997934341431, "deviation-center-line": 1.3759809001795045, "driven_lanedir_consec": 0.8388033778997759, "sim_compute_sim_state": 0.03342485745747884, "sim_compute_performance-ego": 0.05616007169087728, "sim_compute_robot_state-ego": 0.05833767016728719}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0860284180506825, "sim_physics": 0.01528084193561094, "survival_time": 7.049999999999983, "driven_lanedir": 1.0580130706105737, "sim_render-ego": 0.05014451513899133, "in-drivable-lane": 0, "agent_compute-ego": 0.056769039613980776, "deviation-heading": 1.2707417734809467, "set_robot_commands": 0.07065042198127043, "deviation-center-line": 0.6468372360881994, "driven_lanedir_consec": 1.0580130706105737, "sim_compute_sim_state": 0.03369570454807146, "sim_compute_performance-ego": 0.05560449167346278, "sim_compute_robot_state-ego": 0.05754395410524193}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8610325782486226, "sim_physics": 0.021038831862728154, "survival_time": 5.649999999999988, "driven_lanedir": 0.8487083914266242, "sim_render-ego": 0.05431388331725534, "in-drivable-lane": 0, "agent_compute-ego": 0.062432928422910976, "deviation-heading": 0.7611942230113683, "set_robot_commands": 0.07720539844141597, "deviation-center-line": 0.4852162199592199, "driven_lanedir_consec": 0.8487083914266242, "sim_compute_sim_state": 0.035377614266049545, "sim_compute_performance-ego": 0.0585981238204821, "sim_compute_robot_state-ego": 0.061924202252278286}}
set_robot_commands_max	0.07720539844141597
set_robot_commands_mean	0.07227754459631244
set_robot_commands_median	0.07090997934341431
set_robot_commands_min	0.0704994924140699
sim_compute_performance-ego_max	0.0585981238204821
sim_compute_performance-ego_mean	0.05549898913190854
sim_compute_performance-ego_median	0.05573846779617609
sim_compute_performance-ego_min	0.05139379067854448
sim_compute_robot_state-ego_max	0.061924202252278286
sim_compute_robot_state-ego_mean	0.05792177513640599
sim_compute_robot_state-ego_median	0.05833767016728719
sim_compute_robot_state-ego_min	0.05331442211613511
sim_compute_sim_state_max	0.035377614266049545
sim_compute_sim_state_mean	0.03321960910066032
sim_compute_sim_state_median	0.03342485745747884
sim_compute_sim_state_min	0.03066355893106171
sim_physics_max	0.021038831862728154
sim_physics_mean	0.01640356798427752
sim_physics_median	0.01528084193561094
sim_physics_min	0.015146590868632
sim_render-ego_max	0.05431388331725534
sim_render-ego_mean	0.050750078281745215
sim_render-ego_median	0.05014451513899133
sim_render-ego_min	0.048907139084555885
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.740000000000018
survival_time_min	3.2999999999999963

No reset possible

19417

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-24 14:32:20+00:00

2019-04-24 14:34:03+00:00

0:01:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19386

2746

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-24 14:24:07+00:00

2019-04-24 14:25:58+00:00

0:01:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19373

2766

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:14:01+00:00

2019-04-24 14:24:01+00:00

0:10:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6730551409975218
survival_time_median	4.549999999999992
deviation-center-line_median	0.42131021260548374
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14105674519258388
agent_compute-ego_mean	0.10094272691968516
agent_compute-ego_median	0.08492166548967361
agent_compute-ego_min	0.07554461143829011
deviation-center-line_max	1.3399803587919406
deviation-center-line_mean	0.690092009501396
deviation-center-line_min	0.23061904171407344
deviation-heading_max	6.319574444351236
deviation-heading_mean	2.0022243397971375
deviation-heading_median	0.6665609404145512
deviation-heading_min	0.5954275906692456
driven_any_max	2.3550297140221943
driven_any_mean	1.1834743312664209
driven_any_median	0.6842416511385191
driven_any_min	0.4649323527941049
driven_lanedir_consec_max	1.7438051523860183
driven_lanedir_consec_mean	0.8820094365154505
driven_lanedir_consec_min	0.4532802799121858
driven_lanedir_max	1.7438051523860183
driven_lanedir_mean	1.031907813116154
driven_lanedir_median	0.6730551409975218
driven_lanedir_min	0.4532802799121858
in-drivable-lane_max	1.850000000000012
in-drivable-lane_mean	0.3700000000000024
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4649323527941049, "sim_physics": 0.01914317160844803, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4532802799121858, "sim_render-ego": 0.05278792232275009, "in-drivable-lane": 0, "agent_compute-ego": 0.08492166548967361, "deviation-heading": 0.5954275906692456, "set_robot_commands": 0.07398510724306107, "deviation-center-line": 0.23061904171407344, "driven_lanedir_consec": 0.4532802799121858, "sim_compute_sim_state": 0.03493493050336838, "sim_compute_performance-ego": 0.05930567905306816, "sim_compute_robot_state-ego": 0.06232479214668274}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.77714403782252, "sim_physics": 0.014932504309431572, "survival_time": 11.350000000000026, "driven_lanedir": 1.7438051523860183, "sim_render-ego": 0.04986758799279839, "in-drivable-lane": 0, "agent_compute-ego": 0.07783815829239228, "deviation-heading": 1.791210184705957, "set_robot_commands": 0.07052472509476582, "deviation-center-line": 1.099934961406281, "driven_lanedir_consec": 1.7438051523860183, "sim_compute_sim_state": 0.03433853204029772, "sim_compute_performance-ego": 0.055381037590262125, "sim_compute_robot_state-ego": 0.05643502626124983}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.636023900554766, "sim_physics": 0.04129399692311007, "survival_time": 4.249999999999993, "driven_lanedir": 0.6248688516912431, "sim_render-ego": 0.06977141885196461, "in-drivable-lane": 0, "agent_compute-ego": 0.14105674519258388, "deviation-heading": 0.6383485388446989, "set_robot_commands": 0.10217813323525822, "deviation-center-line": 0.3586154729892014, "driven_lanedir_consec": 0.6248688516912431, "sim_compute_sim_state": 0.04439900061663459, "sim_compute_performance-ego": 0.07563346694497501, "sim_compute_robot_state-ego": 0.08424744886510513}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.01608988478943542, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.05060204306801597, "in-drivable-lane": 0, "agent_compute-ego": 0.07554461143829011, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.06955585374936953, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.03238477025713239, "sim_compute_performance-ego": 0.052188632252452134, "sim_compute_robot_state-ego": 0.05473435842073881}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3550297140221943, "sim_physics": 0.03256765445073446, "survival_time": 14.950000000000076, "driven_lanedir": 1.6645296405938002, "sim_render-ego": 0.06983060439427693, "in-drivable-lane": 1.850000000000012, "agent_compute-ego": 0.12535245418548585, "deviation-heading": 6.319574444351236, "set_robot_commands": 0.09883411566416422, "deviation-center-line": 1.3399803587919406, "driven_lanedir_consec": 0.9150377575902832, "sim_compute_sim_state": 0.04567797104517619, "sim_compute_performance-ego": 0.07676473379135132, "sim_compute_robot_state-ego": 0.08197048902511597}}
set_robot_commands_max	0.10217813323525822
set_robot_commands_mean	0.08301558699732377
set_robot_commands_median	0.07398510724306107
set_robot_commands_min	0.06955585374936953
sim_compute_performance-ego_max	0.07676473379135132
sim_compute_performance-ego_mean	0.06385470992642175
sim_compute_performance-ego_median	0.05930567905306816
sim_compute_performance-ego_min	0.052188632252452134
sim_compute_robot_state-ego_max	0.08424744886510513
sim_compute_robot_state-ego_mean	0.0679424229437785
sim_compute_robot_state-ego_median	0.06232479214668274
sim_compute_robot_state-ego_min	0.05473435842073881
sim_compute_sim_state_max	0.04567797104517619
sim_compute_sim_state_mean	0.038347040892521854
sim_compute_sim_state_median	0.03493493050336838
sim_compute_sim_state_min	0.03238477025713239
sim_physics_max	0.04129399692311007
sim_physics_mean	0.02480544241623191
sim_physics_median	0.01914317160844803
sim_physics_min	0.014932504309431572
sim_render-ego_max	0.06983060439427693
sim_render-ego_mean	0.0585719153259612
sim_render-ego_median	0.05278792232275009
sim_render-ego_min	0.04986758799279839
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.660000000000016
survival_time_min	3.1999999999999966

No reset possible

19348

2812

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-24 14:06:08+00:00

2019-04-24 14:13:55+00:00

0:07:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.13852888153445336
agent_compute-ego_mean	0.1328881112870656
agent_compute-ego_median	0.13206446629304153
agent_compute-ego_min	0.13035469206552658
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03224108711121574, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.0559505129617358, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13035469206552658, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07363629719567677, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03481766534230066, "sim_compute_performance-ego": 0.05896379834129697, "sim_compute_robot_state-ego": 0.06145796321687244, "sim_compute_robot_state-npc0": 0.0646491807604593, "sim_compute_robot_state-npc1": 0.05869612996540372, "sim_compute_robot_state-npc2": 0.06120157998705667, "sim_compute_robot_state-npc3": 0.06142385800679525}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.029990364523494944, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05513745195725385, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.1326610948525223, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07202794972588034, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.033941100625430834, "sim_compute_performance-ego": 0.05990285499423158, "sim_compute_robot_state-ego": 0.062476798599841545, "sim_compute_robot_state-npc0": 0.06596900902542413, "sim_compute_robot_state-npc1": 0.06427690094592524, "sim_compute_robot_state-npc2": 0.05931623309266334, "sim_compute_robot_state-npc3": 0.05964777048896341}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03471151090437366, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.057686140460352746, "in-drivable-lane": 0, "agent_compute-ego": 0.13852888153445336, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07183361053466797, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03450632095336914, "sim_compute_performance-ego": 0.06208801654077346, "sim_compute_robot_state-ego": 0.061059986391375144, "sim_compute_robot_state-npc0": 0.0635064878771382, "sim_compute_robot_state-npc1": 0.05977264527351626, "sim_compute_robot_state-npc2": 0.05976073972640499, "sim_compute_robot_state-npc3": 0.06130788787718742}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0333505336274492, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05643152429702434, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13083142168978426, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07250869527776191, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03586374698801244, "sim_compute_performance-ego": 0.05886943796847729, "sim_compute_robot_state-ego": 0.06301737846212184, "sim_compute_robot_state-npc0": 0.06583652344155819, "sim_compute_robot_state-npc1": 0.061069376925204664, "sim_compute_robot_state-npc2": 0.06037298922843121, "sim_compute_robot_state-npc3": 0.06197801549383934}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.028809208136338457, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.0546795679972722, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13206446629304153, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07361689897683951, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.033033205912663385, "sim_compute_performance-ego": 0.06085755733343271, "sim_compute_robot_state-ego": 0.05978483878649198, "sim_compute_robot_state-npc0": 0.06226990773127629, "sim_compute_robot_state-npc1": 0.06017759671578041, "sim_compute_robot_state-npc2": 0.058185769961430475, "sim_compute_robot_state-npc3": 0.05850814856015719}}
set_robot_commands_max	0.07363629719567677
set_robot_commands_mean	0.0727246903421653
set_robot_commands_median	0.07250869527776191
set_robot_commands_min	0.07183361053466797
sim_compute_performance-ego_max	0.06208801654077346
sim_compute_performance-ego_mean	0.0601363330356424
sim_compute_performance-ego_median	0.05990285499423158
sim_compute_performance-ego_min	0.05886943796847729
sim_compute_robot_state-ego_max	0.06301737846212184
sim_compute_robot_state-ego_mean	0.061559393091340585
sim_compute_robot_state-ego_median	0.06145796321687244
sim_compute_robot_state-ego_min	0.05978483878649198
sim_compute_robot_state-npc0_max	0.06596900902542413
sim_compute_robot_state-npc0_mean	0.06444622176717121
sim_compute_robot_state-npc0_median	0.0646491807604593
sim_compute_robot_state-npc0_min	0.06226990773127629
sim_compute_robot_state-npc1_max	0.06427690094592524
sim_compute_robot_state-npc1_mean	0.06079852996516606
sim_compute_robot_state-npc1_median	0.06017759671578041
sim_compute_robot_state-npc1_min	0.05869612996540372
sim_compute_robot_state-npc2_max	0.06120157998705667
sim_compute_robot_state-npc2_mean	0.059767462399197335
sim_compute_robot_state-npc2_median	0.05976073972640499
sim_compute_robot_state-npc2_min	0.058185769961430475
sim_compute_robot_state-npc3_max	0.06197801549383934
sim_compute_robot_state-npc3_mean	0.06057313608538852
sim_compute_robot_state-npc3_median	0.06130788787718742
sim_compute_robot_state-npc3_min	0.05850814856015719
sim_compute_sim_state_max	0.03586374698801244
sim_compute_sim_state_mean	0.034432407964355295
sim_compute_sim_state_median	0.03450632095336914
sim_compute_sim_state_min	0.033033205912663385
sim_physics_max	0.03471151090437366
sim_physics_mean	0.0318205408605744
sim_physics_median	0.03224108711121574
sim_physics_min	0.028809208136338457
sim_render-ego_max	0.057686140460352746
sim_render-ego_mean	0.05597703953472779
sim_render-ego_median	0.0559505129617358
sim_render-ego_min	0.0546795679972722
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

19326

2823

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-24 13:59:21+00:00

2019-04-24 14:05:37+00:00

0:06:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.13378454314337837
agent_compute-ego_mean	0.13142903503867776
agent_compute-ego_median	0.13204993219936595
agent_compute-ego_min	0.12634120746092362
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.024313535330430517, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.051531481293012514, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.131840854320886, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07374171490939159, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03219875299705649, "sim_compute_performance-ego": 0.05844805375585016, "sim_compute_robot_state-ego": 0.0602926623146489, "sim_compute_robot_state-npc0": 0.05975076387513359, "sim_compute_robot_state-npc1": 0.056043467431698205, "sim_compute_robot_state-npc2": 0.05751605753628713, "sim_compute_robot_state-npc3": 0.05658949995940586}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.02545900236476551, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05070627277547663, "in-drivable-lane": 0, "agent_compute-ego": 0.12634120746092362, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07222783023660834, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.031735355203801933, "sim_compute_performance-ego": 0.05684024095535278, "sim_compute_robot_state-ego": 0.05627563324841586, "sim_compute_robot_state-npc0": 0.06021953712810169, "sim_compute_robot_state-npc1": 0.05722805044867776, "sim_compute_robot_state-npc2": 0.053828087720004, "sim_compute_robot_state-npc3": 0.05660922418941151}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02548024389478895, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05312847561306423, "in-drivable-lane": 0, "agent_compute-ego": 0.13378454314337837, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07090626292758517, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.031093131171332465, "sim_compute_performance-ego": 0.05607142448425293, "sim_compute_robot_state-ego": 0.05776087443033854, "sim_compute_robot_state-npc0": 0.05985696050855849, "sim_compute_robot_state-npc1": 0.05563585493299696, "sim_compute_robot_state-npc2": 0.05664866235521104, "sim_compute_robot_state-npc3": 0.05648416413201226}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.028581475218137104, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05122800668080648, "in-drivable-lane": 0, "agent_compute-ego": 0.13312863806883493, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07396235068639119, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03430842856566111, "sim_compute_performance-ego": 0.057017008463541664, "sim_compute_robot_state-ego": 0.05990115304787954, "sim_compute_robot_state-npc0": 0.06282056371370952, "sim_compute_robot_state-npc1": 0.057291130224863686, "sim_compute_robot_state-npc2": 0.0550799568494161, "sim_compute_robot_state-npc3": 0.056110446651776634}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02770410565768971, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05645060188630048, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13204993219936595, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07105931464363546, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.033264054971582746, "sim_compute_performance-ego": 0.05923231559641221, "sim_compute_robot_state-ego": 0.06097844768972958, "sim_compute_robot_state-npc0": 0.06294519059798297, "sim_compute_robot_state-npc1": 0.059078125392689425, "sim_compute_robot_state-npc2": 0.05684396449257346, "sim_compute_robot_state-npc3": 0.056656837463378906}}
set_robot_commands_max	0.07396235068639119
set_robot_commands_mean	0.07237949468072234
set_robot_commands_median	0.07222783023660834
set_robot_commands_min	0.07090626292758517
sim_compute_performance-ego_max	0.05923231559641221
sim_compute_performance-ego_mean	0.05752180865108195
sim_compute_performance-ego_median	0.057017008463541664
sim_compute_performance-ego_min	0.05607142448425293
sim_compute_robot_state-ego_max	0.06097844768972958
sim_compute_robot_state-ego_mean	0.05904175414620248
sim_compute_robot_state-ego_median	0.05990115304787954
sim_compute_robot_state-ego_min	0.05627563324841586
sim_compute_robot_state-npc0_max	0.06294519059798297
sim_compute_robot_state-npc0_mean	0.06111860316469725
sim_compute_robot_state-npc0_median	0.06021953712810169
sim_compute_robot_state-npc0_min	0.05975076387513359
sim_compute_robot_state-npc1_max	0.059078125392689425
sim_compute_robot_state-npc1_mean	0.05705532568618521
sim_compute_robot_state-npc1_median	0.05722805044867776
sim_compute_robot_state-npc1_min	0.05563585493299696
sim_compute_robot_state-npc2_max	0.05751605753628713
sim_compute_robot_state-npc2_mean	0.055983345790698344
sim_compute_robot_state-npc2_median	0.05664866235521104
sim_compute_robot_state-npc2_min	0.053828087720004
sim_compute_robot_state-npc3_max	0.056656837463378906
sim_compute_robot_state-npc3_mean	0.05649003447919704
sim_compute_robot_state-npc3_median	0.05658949995940586
sim_compute_robot_state-npc3_min	0.056110446651776634
sim_compute_sim_state_max	0.03430842856566111
sim_compute_sim_state_mean	0.03251994458188695
sim_compute_sim_state_median	0.03219875299705649
sim_compute_sim_state_min	0.031093131171332465
sim_physics_max	0.028581475218137104
sim_physics_mean	0.02630767249316236
sim_physics_median	0.02548024389478895
sim_physics_min	0.024313535330430517
sim_render-ego_max	0.05645060188630048
sim_render-ego_mean	0.05260896764973207
sim_render-ego_median	0.051531481293012514
sim_render-ego_min	0.05070627277547663
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19298

2871

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 13:51:14+00:00

2019-04-24 13:59:10+00:00

0:07:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3843116776952349
survival_time_median	4.599999999999992
deviation-center-line_median	0.2024589718399926
in-drivable-lane_median	0.8999999999999968

other stats

agent_compute-ego_max	0.39482156608415686
agent_compute-ego_mean	0.33560388293965226
agent_compute-ego_median	0.323718722807158
agent_compute-ego_min	0.2590561859747943
deviation-center-line_max	0.27686650596225404
deviation-center-line_mean	0.1686069365366214
deviation-center-line_min	0.03907190001763231
deviation-heading_max	1.996135483627975
deviation-heading_mean	0.9641859345486636
deviation-heading_median	0.6224523615372093
deviation-heading_min	0.2043667871413054
driven_any_max	2.588883912834826
driven_any_mean	2.102255064937585
driven_any_median	2.057141740916324
driven_any_min	1.590587107042657
driven_lanedir_consec_max	2.1343402774078393
driven_lanedir_consec_mean	1.4299005759118175
driven_lanedir_consec_min	1.0238198600812267
driven_lanedir_max	2.1343402774078393
driven_lanedir_mean	1.5232259017754637
driven_lanedir_median	1.3843116776952349
driven_lanedir_min	1.2221935811192264
in-drivable-lane_max	1.1499999999999977
in-drivable-lane_mean	0.8199999999999974
in-drivable-lane_min	0.29999999999999893
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.057141740916324, "sim_physics": 0.01914172068886135, "survival_time": 4.599999999999992, "driven_lanedir": 1.2280134892599517, "sim_render-ego": 0.05296433749406234, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.39482156608415686, "deviation-heading": 1.5858059928410326, "set_robot_commands": 0.07290153140607088, "deviation-center-line": 0.2121993844649399, "driven_lanedir_consec": 1.0238198600812267, "sim_compute_sim_state": 0.03522325080374013, "sim_compute_performance-ego": 0.05949238590572192, "sim_compute_robot_state-ego": 0.06158191483953725}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.588883912834826, "sim_physics": 0.01902593747533933, "survival_time": 4.94999999999999, "driven_lanedir": 2.1343402774078393, "sim_render-ego": 0.054405000474717885, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.3836157586839464, "deviation-heading": 0.6224523615372093, "set_robot_commands": 0.07148533638077553, "deviation-center-line": 0.2024589718399926, "driven_lanedir_consec": 2.1343402774078393, "sim_compute_sim_state": 0.03542195907746903, "sim_compute_performance-ego": 0.058143931205826574, "sim_compute_robot_state-ego": 0.06335765665227716}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.590587107042657, "sim_physics": 0.017508361299159163, "survival_time": 2.9499999999999975, "driven_lanedir": 1.3843116776952349, "sim_render-ego": 0.05194236464419608, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.3168071811482058, "deviation-heading": 0.2043667871413054, "set_robot_commands": 0.07161581314216225, "deviation-center-line": 0.03907190001763231, "driven_lanedir_consec": 1.3843116776952349, "sim_compute_sim_state": 0.03362851223703158, "sim_compute_performance-ego": 0.055516853170879815, "sim_compute_robot_state-ego": 0.058014283745975816}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7302979203738438, "sim_physics": 0.016224128358504352, "survival_time": 3.399999999999996, "driven_lanedir": 1.2221935811192264, "sim_render-ego": 0.04947913744870354, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.2590561859747943, "deviation-heading": 0.412169047595796, "set_robot_commands": 0.06979662530562457, "deviation-center-line": 0.11243792039828812, "driven_lanedir_consec": 1.212060105054313, "sim_compute_sim_state": 0.03382826903287102, "sim_compute_performance-ego": 0.056218459325678205, "sim_compute_robot_state-ego": 0.05661991413901834}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.5443646435202756, "sim_physics": 0.016146106457491535, "survival_time": 5.449999999999989, "driven_lanedir": 1.6472704833950664, "sim_render-ego": 0.04902688078924056, "in-drivable-lane": 1.0499999999999967, "agent_compute-ego": 0.323718722807158, "deviation-heading": 1.996135483627975, "set_robot_commands": 0.0710224558454041, "deviation-center-line": 0.27686650596225404, "driven_lanedir_consec": 1.394970959320474, "sim_compute_sim_state": 0.034186496647126086, "sim_compute_performance-ego": 0.05411929165551422, "sim_compute_robot_state-ego": 0.056147754739183896}}
set_robot_commands_max	0.07290153140607088
set_robot_commands_mean	0.07136435241600747
set_robot_commands_median	0.07148533638077553
set_robot_commands_min	0.06979662530562457
sim_compute_performance-ego_max	0.05949238590572192
sim_compute_performance-ego_mean	0.056698184252724146
sim_compute_performance-ego_median	0.056218459325678205
sim_compute_performance-ego_min	0.05411929165551422
sim_compute_robot_state-ego_max	0.06335765665227716
sim_compute_robot_state-ego_mean	0.05914430482319849
sim_compute_robot_state-ego_median	0.058014283745975816
sim_compute_robot_state-ego_min	0.056147754739183896
sim_compute_sim_state_max	0.03542195907746903
sim_compute_sim_state_mean	0.034457697559647574
sim_compute_sim_state_median	0.034186496647126086
sim_compute_sim_state_min	0.03362851223703158
sim_physics_max	0.01914172068886135
sim_physics_mean	0.017609250855871148
sim_physics_median	0.017508361299159163
sim_physics_min	0.016146106457491535
sim_render-ego_max	0.054405000474717885
sim_render-ego_mean	0.051563544170184085
sim_render-ego_median	0.05194236464419608
sim_render-ego_min	0.04902688078924056
simulation-passed	1
survival_time_max	5.449999999999989
survival_time_mean	4.269999999999993
survival_time_min	2.9499999999999975

No reset possible

19269

2903

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 13:32:37+00:00

2019-04-24 13:51:03+00:00

0:18:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.241898971574764
survival_time_median	9.299999999999995
deviation-center-line_median	0.10701214595705932
in-drivable-lane_median	1.6500000000000163

other stats

agent_compute-ego_max	0.18723414421081544
agent_compute-ego_mean	0.18563267330965225
agent_compute-ego_median	0.1863068637027535
agent_compute-ego_min	0.18277337730571788
deviation-center-line_max	0.3304716377805105
deviation-center-line_mean	0.14803071698752474
deviation-center-line_min	0.09236902367164691
deviation-heading_max	0.7830887340867339
deviation-heading_mean	0.7356202389472949
deviation-heading_median	0.7644891571925739
deviation-heading_min	0.6157822856032742
driven_any_max	2.5606620748559195
driven_any_mean	1.653953480387771
driven_any_median	1.5735900983958824
driven_any_min	0.9883350319474454
driven_lanedir_consec_max	2.467262495659171
driven_lanedir_consec_mean	1.370289986282949
driven_lanedir_consec_min	0.6581239520776823
driven_lanedir_max	2.467262495659171
driven_lanedir_mean	1.370289986282949
driven_lanedir_median	1.241898971574764
driven_lanedir_min	0.6581239520776823
in-drivable-lane_max	1.6500000000000163
in-drivable-lane_mean	1.41000000000001
in-drivable-lane_min	0.4500000000000064
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9883350319474454, "sim_physics": 0.029837926896680304, "survival_time": 5.949999999999987, "driven_lanedir": 0.6581239520776823, "sim_render-ego": 0.05483379283872973, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.186343736007434, "deviation-heading": 0.734499194536954, "set_robot_commands": 0.07441375636253036, "deviation-center-line": 0.09236902367164691, "driven_lanedir_consec": 0.6581239520776823, "sim_compute_sim_state": 0.03450747698295016, "sim_compute_performance-ego": 0.06008954408789883, "sim_compute_robot_state-ego": 0.0629141831598362, "sim_compute_robot_state-npc0": 0.06469311433679917, "sim_compute_robot_state-npc1": 0.061348221883052535, "sim_compute_robot_state-npc2": 0.061333780529118385, "sim_compute_robot_state-npc3": 0.06081788880484445}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.5606620748559195, "sim_physics": 0.02787604331970215, "survival_time": 14.950000000000076, "driven_lanedir": 2.467262495659171, "sim_render-ego": 0.05453212261199951, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.18723414421081544, "deviation-heading": 0.6157822856032742, "set_robot_commands": 0.07533328453699747, "deviation-center-line": 0.3304716377805105, "driven_lanedir_consec": 2.467262495659171, "sim_compute_sim_state": 0.03374589681625366, "sim_compute_performance-ego": 0.05944642543792725, "sim_compute_robot_state-ego": 0.061338992913564046, "sim_compute_robot_state-npc0": 0.06274896621704101, "sim_compute_robot_state-npc1": 0.05939282576243083, "sim_compute_robot_state-npc2": 0.05937958796819051, "sim_compute_robot_state-npc3": 0.05934253215789795}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5735900991919587, "sim_physics": 0.027256177317711613, "survival_time": 9.299999999999995, "driven_lanedir": 1.2423343662811517, "sim_render-ego": 0.05509729411012383, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.1863068637027535, "deviation-heading": 0.7644891571925739, "set_robot_commands": 0.07477006604594569, "deviation-center-line": 0.10221958828532016, "driven_lanedir_consec": 1.2423343662811517, "sim_compute_sim_state": 0.03557810603931386, "sim_compute_performance-ego": 0.05990051325931344, "sim_compute_robot_state-ego": 0.0617342443876369, "sim_compute_robot_state-npc0": 0.06445195469804989, "sim_compute_robot_state-npc1": 0.05951766942137031, "sim_compute_robot_state-npc2": 0.05941863085633965, "sim_compute_robot_state-npc3": 0.0589077434232158}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5735900983958824, "sim_physics": 0.02684713179065335, "survival_time": 9.299999999999995, "driven_lanedir": 1.241898971574764, "sim_render-ego": 0.05443385724098452, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.18277337730571788, "deviation-heading": 0.7802418233169384, "set_robot_commands": 0.07640492403379051, "deviation-center-line": 0.10701214595705932, "driven_lanedir_consec": 1.241898971574764, "sim_compute_sim_state": 0.034255717390327046, "sim_compute_performance-ego": 0.058974039170049855, "sim_compute_robot_state-ego": 0.06036139047274026, "sim_compute_robot_state-npc0": 0.06167867106776083, "sim_compute_robot_state-npc1": 0.05980274497821767, "sim_compute_robot_state-npc2": 0.06012409989551831, "sim_compute_robot_state-npc3": 0.059902368053313226}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.573590097547647, "sim_physics": 0.026077226925921695, "survival_time": 9.299999999999995, "driven_lanedir": 1.2418301458219756, "sim_render-ego": 0.05471317486096454, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.1855052453215404, "deviation-heading": 0.7830887340867339, "set_robot_commands": 0.0745350609543503, "deviation-center-line": 0.10808118924308686, "driven_lanedir_consec": 1.2418301458219756, "sim_compute_sim_state": 0.0353724366875105, "sim_compute_performance-ego": 0.060390095556935953, "sim_compute_robot_state-ego": 0.06132625123505951, "sim_compute_robot_state-npc0": 0.063216902876413, "sim_compute_robot_state-npc1": 0.06014871725472071, "sim_compute_robot_state-npc2": 0.05991838568000384, "sim_compute_robot_state-npc3": 0.05982908894938807}}
set_robot_commands_max	0.07640492403379051
set_robot_commands_mean	0.07509141838672287
set_robot_commands_median	0.07477006604594569
set_robot_commands_min	0.07441375636253036
sim_compute_performance-ego_max	0.060390095556935953
sim_compute_performance-ego_mean	0.059760123502425065
sim_compute_performance-ego_median	0.05990051325931344
sim_compute_performance-ego_min	0.058974039170049855
sim_compute_robot_state-ego_max	0.0629141831598362
sim_compute_robot_state-ego_mean	0.06153501243376739
sim_compute_robot_state-ego_median	0.061338992913564046
sim_compute_robot_state-ego_min	0.06036139047274026
sim_compute_robot_state-npc0_max	0.06469311433679917
sim_compute_robot_state-npc0_mean	0.06335792183921278
sim_compute_robot_state-npc0_median	0.063216902876413
sim_compute_robot_state-npc0_min	0.06167867106776083
sim_compute_robot_state-npc1_max	0.061348221883052535
sim_compute_robot_state-npc1_mean	0.06004203585995841
sim_compute_robot_state-npc1_median	0.05980274497821767
sim_compute_robot_state-npc1_min	0.05939282576243083
sim_compute_robot_state-npc2_max	0.061333780529118385
sim_compute_robot_state-npc2_mean	0.06003489698583414
sim_compute_robot_state-npc2_median	0.05991838568000384
sim_compute_robot_state-npc2_min	0.05937958796819051
sim_compute_robot_state-npc3_max	0.06081788880484445
sim_compute_robot_state-npc3_mean	0.0597599242777319
sim_compute_robot_state-npc3_median	0.05982908894938807
sim_compute_robot_state-npc3_min	0.0589077434232158
sim_compute_sim_state_max	0.03557810603931386
sim_compute_sim_state_mean	0.03469192678327104
sim_compute_sim_state_median	0.03450747698295016
sim_compute_sim_state_min	0.03374589681625366
sim_physics_max	0.029837926896680304
sim_physics_mean	0.027578901250133823
sim_physics_median	0.027256177317711613
sim_physics_min	0.026077226925921695
sim_render-ego_max	0.05509729411012383
sim_render-ego_mean	0.054722048332560426
sim_render-ego_median	0.05471317486096454
sim_render-ego_min	0.05443385724098452
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.76000000000001
survival_time_min	5.949999999999987

No reset possible

19259

2949

Baseline solution using reinforcement learning

step1-simulation

success