Evaluator 768

step1-simulation

error

yes

2019-04-24 09:33:00+00:00

2019-04-24 09:33:33+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19168

2916

Python template

step2-scoring

success

yes

2019-04-24 09:24:45+00:00

2019-04-24 09:26:16+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-72.41689328433715

other stats

fleet_size	-1000000000
service_quality	-34.590523321084206

No reset possible

19156

2310

Andrea Censi 🇨🇭

Python template

step2-scoring

success

yes

2019-04-24 09:13:56+00:00

2019-04-24 09:14:12+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-64.07769033093837

other stats

fleet_size	-1000000000
service_quality	-32.85323258273458

No reset possible

19140

2310

Andrea Censi 🇨🇭

Python template

step1-simulation

success

yes

2019-04-24 09:04:24+00:00

2019-04-24 09:08:07+00:00

0:03:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

19128

2956

Baseline-IL-logs-tensorflow

aido2-LF-sim-testing

step1-simulation

success

2019-04-24 06:02:48+00:00

2019-04-24 06:23:38+00:00

0:20:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2043649136725725
survival_time_median	13.950000000000063
deviation-center-line_median	0.3921719151799371
in-drivable-lane_median	1.6500000000000234

other stats

agent_compute-ego_max	0.22085946877797444
agent_compute-ego_mean	0.2172017269509404
agent_compute-ego_median	0.21821808985911817
agent_compute-ego_min	0.2122515639522045
deviation-center-line_max	1.1459848826161827
deviation-center-line_mean	0.6457766203410158
deviation-center-line_min	0.2366328034403155
deviation-heading_max	2.577355234943985
deviation-heading_mean	1.8138263205884653
deviation-heading_median	1.713744561628805
deviation-heading_min	1.0935258693324237
driven_any_max	1.927302983176227
driven_any_mean	1.6599038072040628
driven_any_median	1.7298074018959366
driven_any_min	1.1276919604645876
driven_lanedir_consec_max	1.919347796690667
driven_lanedir_consec_mean	1.3653635375737945
driven_lanedir_consec_min	0.6117548839637439
driven_lanedir_max	1.919347796690667
driven_lanedir_mean	1.380512856519689
driven_lanedir_median	1.228692205573657
driven_lanedir_min	0.6383967597746434
in-drivable-lane_max	3.250000000000046
in-drivable-lane_mean	1.460000000000016
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1276919604645876, "sim_physics": 0.01713573932647705, "survival_time": 9.099999999999994, "driven_lanedir": 0.6383967597746434, "sim_render-ego": 0.05939967684693389, "in-drivable-lane": 2.40000000000001, "agent_compute-ego": 0.2186887041553036, "deviation-heading": 2.577355234943985, "set_robot_commands": 0.07925270808922065, "deviation-center-line": 0.2366328034403155, "driven_lanedir_consec": 0.6117548839637439, "sim_compute_sim_state": 0.042310435693342606, "sim_compute_performance-ego": 0.06254626106429886, "sim_compute_robot_state-ego": 0.06779717089055659}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.927302983176227, "sim_physics": 0.017125733693440757, "survival_time": 14.950000000000076, "driven_lanedir": 1.919347796690667, "sim_render-ego": 0.06497696240743002, "in-drivable-lane": 0, "agent_compute-ego": 0.21599080801010132, "deviation-heading": 1.0935258693324237, "set_robot_commands": 0.07919827222824097, "deviation-center-line": 1.1459848826161827, "driven_lanedir_consec": 1.919347796690667, "sim_compute_sim_state": 0.04286831458409627, "sim_compute_performance-ego": 0.06630886157353719, "sim_compute_robot_state-ego": 0.06910369634628295}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9260931793235536, "sim_physics": 0.016855363845825196, "survival_time": 14.950000000000076, "driven_lanedir": 1.914135527478455, "sim_render-ego": 0.06772062063217163, "in-drivable-lane": 0, "agent_compute-ego": 0.22085946877797444, "deviation-heading": 1.22930731217168, "set_robot_commands": 0.07871169408162434, "deviation-center-line": 1.1001383725447742, "driven_lanedir_consec": 1.914135527478455, "sim_compute_sim_state": 0.04209406852722168, "sim_compute_performance-ego": 0.06694462776184082, "sim_compute_robot_state-ego": 0.06808446009953817}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7298074018959366, "sim_physics": 0.01680085992300382, "survival_time": 13.950000000000063, "driven_lanedir": 1.228692205573657, "sim_render-ego": 0.06729638021052098, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.21821808985911817, "deviation-heading": 2.4551986248654325, "set_robot_commands": 0.07789318365008173, "deviation-center-line": 0.3921719151799371, "driven_lanedir_consec": 1.2043649136725725, "sim_compute_sim_state": 0.04207728327816105, "sim_compute_performance-ego": 0.06955525439272645, "sim_compute_robot_state-ego": 0.06935139710757894}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.588623511160009, "sim_physics": 0.017507067054126395, "survival_time": 11.65000000000003, "driven_lanedir": 1.2019919930810232, "sim_render-ego": 0.0666309426270841, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.2122515639522045, "deviation-heading": 1.713744561628805, "set_robot_commands": 0.07844539466334004, "deviation-center-line": 0.3539551279238697, "driven_lanedir_consec": 1.1772145660635327, "sim_compute_sim_state": 0.04236232773940451, "sim_compute_performance-ego": 0.06655776142562408, "sim_compute_robot_state-ego": 0.06757681768851219}}
set_robot_commands_max	0.07925270808922065
set_robot_commands_mean	0.07870025054250154
set_robot_commands_median	0.07871169408162434
set_robot_commands_min	0.07789318365008173
sim_compute_performance-ego_max	0.06955525439272645
sim_compute_performance-ego_mean	0.06638255324360548
sim_compute_performance-ego_median	0.06655776142562408
sim_compute_performance-ego_min	0.06254626106429886
sim_compute_robot_state-ego_max	0.06935139710757894
sim_compute_robot_state-ego_mean	0.06838270842649377
sim_compute_robot_state-ego_median	0.06808446009953817
sim_compute_robot_state-ego_min	0.06757681768851219
sim_compute_sim_state_max	0.04286831458409627
sim_compute_sim_state_mean	0.042342485964445224
sim_compute_sim_state_median	0.042310435693342606
sim_compute_sim_state_min	0.04207728327816105
sim_physics_max	0.017507067054126395
sim_physics_mean	0.017084952768574642
sim_physics_median	0.017125733693440757
sim_physics_min	0.01680085992300382
sim_render-ego_max	0.06772062063217163
sim_render-ego_mean	0.06520491654482811
sim_render-ego_median	0.0666309426270841
sim_render-ego_min	0.05939967684693389
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.92000000000005
survival_time_min	9.099999999999994

No reset possible

19122

2964

Baseline-IL-logs-tensorflow

aido2-LFVI-sim-testing

step1-simulation

error

2019-04-24 05:41:11+00:00

2019-04-24 06:02:15+00:00

0:21:04

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19115

2952

Bhairav Mehta

Baseline solution using reinforcement learning

aido2-LFVI-sim-testing

step1-simulation

success

2019-04-24 00:07:49+00:00

2019-04-24 00:25:36+00:00

0:17:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.12751805586721243
survival_time_median	4.199999999999993
deviation-center-line_median	0.06954702166286456
in-drivable-lane_median	1.7999999999999978

other stats

agent_compute-ego_max	0.2578928029095685
agent_compute-ego_mean	0.2041548036297372
agent_compute-ego_median	0.2031346843356178
agent_compute-ego_min	0.1702240966770747
deviation-center-line_max	0.2179078648423563
deviation-center-line_mean	0.08853519460022036
deviation-center-line_min	0.02605466095381765
deviation-heading_max	5.569352729433085
deviation-heading_mean	2.3023962217722684
deviation-heading_median	1.6771714769837136
deviation-heading_min	0.6090451555084121
driven_any_max	1.388250669484598
driven_any_mean	0.553485041441142
driven_any_median	0.37324979838812605
driven_any_min	0.14223546922520408
driven_lanedir_consec_max	0.4050695346148758
driven_lanedir_consec_mean	0.18195072334303805
driven_lanedir_consec_min	0.059294066788142086
driven_lanedir_max	0.4050695346148758
driven_lanedir_mean	0.18195072334303805
driven_lanedir_median	0.12751805586721243
driven_lanedir_min	0.059294066788142086
in-drivable-lane_max	6.300000000000021
in-drivable-lane_mean	2.4300000000000024
in-drivable-lane_min	0.20000000000000015
per-episodes	details {"udem1-0-0": {"driven_any": 0.14223546922520408, "sim_physics": 0.027670507077817565, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06344288374892115, "sim_render-ego": 0.05717601599516692, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.2578928029095685, "deviation-heading": 0.7047958588619627, "set_robot_commands": 0.0761524306403266, "deviation-center-line": 0.036545627040780085, "driven_lanedir_consec": 0.06344288374892115, "sim_compute_sim_state": 0.033160660001966685, "sim_compute_performance-ego": 0.06012027351944535, "sim_compute_robot_state-ego": 0.05862674889741121, "sim_compute_robot_state-npc0": 0.07029562526279026, "sim_compute_robot_state-npc1": 0.06178534472430194, "sim_compute_robot_state-npc2": 0.058681373242978695, "sim_compute_robot_state-npc3": 0.059739130514639395}, "udem1-1-0": {"driven_any": 0.153124914595314, "sim_physics": 0.02973797040827134, "survival_time": 1.7000000000000008, "driven_lanedir": 0.059294066788142086, "sim_render-ego": 0.05992758274078369, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.21143033223993635, "deviation-heading": 0.6090451555084121, "set_robot_commands": 0.08002285396351534, "deviation-center-line": 0.02605466095381765, "driven_lanedir_consec": 0.059294066788142086, "sim_compute_sim_state": 0.03408995796652401, "sim_compute_performance-ego": 0.05953013896942139, "sim_compute_robot_state-ego": 0.06198568203869988, "sim_compute_robot_state-npc0": 0.06694806323331945, "sim_compute_robot_state-npc1": 0.06295445386101217, "sim_compute_robot_state-npc2": 0.06174745279199937, "sim_compute_robot_state-npc3": 0.06208198210772346}, "udem1-2-0": {"driven_any": 0.37324979838812605, "sim_physics": 0.03130607945578439, "survival_time": 4.199999999999993, "driven_lanedir": 0.12751805586721243, "sim_render-ego": 0.06295765013921828, "in-drivable-lane": 1.7999999999999978, "agent_compute-ego": 0.2031346843356178, "deviation-heading": 1.6771714769837136, "set_robot_commands": 0.07788198902493432, "deviation-center-line": 0.06954702166286456, "driven_lanedir_consec": 0.12751805586721243, "sim_compute_sim_state": 0.03439296427227202, "sim_compute_performance-ego": 0.06086653470993042, "sim_compute_robot_state-ego": 0.06174351487840925, "sim_compute_robot_state-npc0": 0.0679731425784883, "sim_compute_robot_state-npc1": 0.06444527421678815, "sim_compute_robot_state-npc2": 0.06106774296079363, "sim_compute_robot_state-npc3": 0.061140693369365874}, "udem1-3-0": {"driven_any": 1.388250669484598, "sim_physics": 0.0285906470223759, "survival_time": 13.350000000000056, "driven_lanedir": 0.4050695346148758, "sim_render-ego": 0.0679638698306423, "in-drivable-lane": 6.300000000000021, "agent_compute-ego": 0.1780921019864886, "deviation-heading": 5.569352729433085, "set_robot_commands": 0.07885449209463284, "deviation-center-line": 0.2179078648423563, "driven_lanedir_consec": 0.4050695346148758, "sim_compute_sim_state": 0.03683299161075206, "sim_compute_performance-ego": 0.06589377328251185, "sim_compute_robot_state-ego": 0.06434099951040433, "sim_compute_robot_state-npc0": 0.07694625408015447, "sim_compute_robot_state-npc1": 0.06726272365127163, "sim_compute_robot_state-npc2": 0.06602905037697782, "sim_compute_robot_state-npc3": 0.06595709797148401}, "udem1-4-0": {"driven_any": 0.7105643555124678, "sim_physics": 0.028865908923214428, "survival_time": 7.299999999999982, "driven_lanedir": 0.2544290756960388, "sim_render-ego": 0.06505033741258595, "in-drivable-lane": 3.249999999999992, "agent_compute-ego": 0.1702240966770747, "deviation-heading": 2.951615888074169, "set_robot_commands": 0.07877537159070577, "deviation-center-line": 0.09262079850128316, "driven_lanedir_consec": 0.2544290756960388, "sim_compute_sim_state": 0.03642158802241495, "sim_compute_performance-ego": 0.0651790197581461, "sim_compute_robot_state-ego": 0.06807768018278357, "sim_compute_robot_state-npc0": 0.07569647488528736, "sim_compute_robot_state-npc1": 0.06823799381517384, "sim_compute_robot_state-npc2": 0.06681159751055991, "sim_compute_robot_state-npc3": 0.06627159412593057}}
set_robot_commands_max	0.08002285396351534
set_robot_commands_mean	0.07833742746282298
set_robot_commands_median	0.07877537159070577
set_robot_commands_min	0.0761524306403266
sim_compute_performance-ego_max	0.06589377328251185
sim_compute_performance-ego_mean	0.06231794804789102
sim_compute_performance-ego_median	0.06086653470993042
sim_compute_performance-ego_min	0.05953013896942139
sim_compute_robot_state-ego_max	0.06807768018278357
sim_compute_robot_state-ego_mean	0.06295492510154163
sim_compute_robot_state-ego_median	0.06198568203869988
sim_compute_robot_state-ego_min	0.05862674889741121
sim_compute_robot_state-npc0_max	0.07694625408015447
sim_compute_robot_state-npc0_mean	0.07157191200800797
sim_compute_robot_state-npc0_median	0.07029562526279026
sim_compute_robot_state-npc0_min	0.06694806323331945
sim_compute_robot_state-npc1_max	0.06823799381517384
sim_compute_robot_state-npc1_mean	0.06493715805370955
sim_compute_robot_state-npc1_median	0.06444527421678815
sim_compute_robot_state-npc1_min	0.06178534472430194
sim_compute_robot_state-npc2_max	0.06681159751055991
sim_compute_robot_state-npc2_mean	0.06286744337666189
sim_compute_robot_state-npc2_median	0.06174745279199937
sim_compute_robot_state-npc2_min	0.058681373242978695
sim_compute_robot_state-npc3_max	0.06627159412593057
sim_compute_robot_state-npc3_mean	0.06303809961782866
sim_compute_robot_state-npc3_median	0.06208198210772346
sim_compute_robot_state-npc3_min	0.059739130514639395
sim_compute_sim_state_max	0.03683299161075206
sim_compute_sim_state_mean	0.03497963237478594
sim_compute_sim_state_median	0.03439296427227202
sim_compute_sim_state_min	0.033160660001966685
sim_physics_max	0.03130607945578439
sim_physics_mean	0.029234222577492724
sim_physics_median	0.028865908923214428
sim_physics_min	0.027670507077817565
sim_render-ego_max	0.0679638698306423
sim_render-ego_mean	0.06261509122367943
sim_render-ego_median	0.06295765013921828
sim_render-ego_min	0.05717601599516692
simulation-passed	1
survival_time_max	13.350000000000056
survival_time_mean	5.580000000000007
survival_time_min	1.3500000000000003

No reset possible

19108

2940

Bhairav Mehta

Baseline solution using reinforcement learning

aido2-LFVI-sim-testing

step1-simulation

error

aido2-LFVI-sim-validation

2019-04-23 23:35:42+00:00

2019-04-23 23:36:23+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19099

2929

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-23 22:30:37+00:00

2019-04-23 22:38:25+00:00

0:07:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.18094764215094017
survival_time_median	1.3000000000000005
deviation-center-line_median	0.05751834795356252
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.46563448905944826
agent_compute-ego_mean	0.3264957544946263
agent_compute-ego_median	0.3218423036428598
agent_compute-ego_min	0.24284254587613616
deviation-center-line_max	0.06807759964692006
deviation-center-line_mean	0.060149271190166366
deviation-center-line_min	0.05493110096981592
deviation-heading_max	0.5753853801959548
deviation-heading_mean	0.5435408149568093
deviation-heading_median	0.5452363350332105
deviation-heading_min	0.510903547718295
driven_any_max	0.24567817938749303
driven_any_mean	0.22256317008097123
driven_any_median	0.22612866549683217
driven_any_min	0.20164420920789447
driven_lanedir_consec_max	0.20978898122694023
driven_lanedir_consec_mean	0.180049499523248
driven_lanedir_consec_min	0.15809434477627415
driven_lanedir_max	0.20978898122694023
driven_lanedir_mean	0.180049499523248
driven_lanedir_median	0.18094764215094017
driven_lanedir_min	0.15809434477627415
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.20164420920789447, "sim_physics": 0.028915605545043944, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15809434477627415, "sim_render-ego": 0.05614034652709961, "in-drivable-lane": 0, "agent_compute-ego": 0.46563448905944826, "deviation-heading": 0.5452363350332105, "set_robot_commands": 0.0763446044921875, "deviation-center-line": 0.05493110096981592, "driven_lanedir_consec": 0.15809434477627415, "sim_compute_sim_state": 0.032305307388305664, "sim_compute_performance-ego": 0.06009640693664551, "sim_compute_robot_state-ego": 0.0595726203918457, "sim_compute_robot_state-npc0": 0.06164698600769043, "sim_compute_robot_state-npc1": 0.05918342590332031, "sim_compute_robot_state-npc2": 0.05975324630737305, "sim_compute_robot_state-npc3": 0.06024307250976563}, "udem1-1-0": {"driven_any": 0.2096065481804179, "sim_physics": 0.03140139579772949, "survival_time": 1.3000000000000005, "driven_lanedir": 0.16403922359109568, "sim_render-ego": 0.0589904051560622, "in-drivable-lane": 0, "agent_compute-ego": 0.3218423036428598, "deviation-heading": 0.5753853801959548, "set_robot_commands": 0.07326855109288143, "deviation-center-line": 0.05619368399575937, "driven_lanedir_consec": 0.16403922359109568, "sim_compute_sim_state": 0.03472181466909555, "sim_compute_performance-ego": 0.0567469596862793, "sim_compute_robot_state-ego": 0.05846784665034367, "sim_compute_robot_state-npc0": 0.06601175895104042, "sim_compute_robot_state-npc1": 0.05978840131026048, "sim_compute_robot_state-npc2": 0.05882662076216478, "sim_compute_robot_state-npc3": 0.06009251337784987}, "udem1-2-0": {"driven_any": 0.22612866549683217, "sim_physics": 0.032336913622342624, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18094764215094017, "sim_render-ego": 0.060647001633277305, "in-drivable-lane": 0, "agent_compute-ego": 0.3354893922805786, "deviation-heading": 0.5592229197867459, "set_robot_commands": 0.07628167592562161, "deviation-center-line": 0.06402562338477394, "driven_lanedir_consec": 0.18094764215094017, "sim_compute_sim_state": 0.03212094306945801, "sim_compute_performance-ego": 0.05765121716719408, "sim_compute_robot_state-ego": 0.05833526758047251, "sim_compute_robot_state-npc0": 0.0644228275005634, "sim_compute_robot_state-npc1": 0.06167952830974872, "sim_compute_robot_state-npc2": 0.06140023928422194, "sim_compute_robot_state-npc3": 0.05983912027799166}, "udem1-3-0": {"driven_any": 0.24567817938749303, "sim_physics": 0.027362099400273076, "survival_time": 1.3500000000000003, "driven_lanedir": 0.20978898122694023, "sim_render-ego": 0.06221188439263238, "in-drivable-lane": 0, "agent_compute-ego": 0.2666700416141086, "deviation-heading": 0.510903547718295, "set_robot_commands": 0.07603767183091906, "deviation-center-line": 0.06807759964692006, "driven_lanedir_consec": 0.20978898122694023, "sim_compute_sim_state": 0.03355281441300004, "sim_compute_performance-ego": 0.06285254160563152, "sim_compute_robot_state-ego": 0.060418773580480506, "sim_compute_robot_state-npc0": 0.06175202793545193, "sim_compute_robot_state-npc1": 0.06282495569299769, "sim_compute_robot_state-npc2": 0.06126160974855776, "sim_compute_robot_state-npc3": 0.06178920357315629}, "udem1-4-0": {"driven_any": 0.22975824813221865, "sim_physics": 0.02877513261941763, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18737730587098975, "sim_render-ego": 0.06175251190478985, "in-drivable-lane": 0, "agent_compute-ego": 0.24284254587613616, "deviation-heading": 0.5269558920498402, "set_robot_commands": 0.07675713759202224, "deviation-center-line": 0.05751834795356252, "driven_lanedir_consec": 0.18737730587098975, "sim_compute_sim_state": 0.03536871763376089, "sim_compute_performance-ego": 0.06481222005990836, "sim_compute_robot_state-ego": 0.06844208790705754, "sim_compute_robot_state-npc0": 0.06788172171666072, "sim_compute_robot_state-npc1": 0.06756431322831374, "sim_compute_robot_state-npc2": 0.06623802735255314, "sim_compute_robot_state-npc3": 0.06490698227515587}}
set_robot_commands_max	0.07675713759202224
set_robot_commands_mean	0.07573792818672637
set_robot_commands_median	0.07628167592562161
set_robot_commands_min	0.07326855109288143
sim_compute_performance-ego_max	0.06481222005990836
sim_compute_performance-ego_mean	0.06043186909113174
sim_compute_performance-ego_median	0.06009640693664551
sim_compute_performance-ego_min	0.0567469596862793
sim_compute_robot_state-ego_max	0.06844208790705754
sim_compute_robot_state-ego_mean	0.061047319222039986
sim_compute_robot_state-ego_median	0.0595726203918457
sim_compute_robot_state-ego_min	0.05833526758047251
sim_compute_robot_state-npc0_max	0.06788172171666072
sim_compute_robot_state-npc0_mean	0.06434306442228138
sim_compute_robot_state-npc0_median	0.0644228275005634
sim_compute_robot_state-npc0_min	0.06164698600769043
sim_compute_robot_state-npc1_max	0.06756431322831374
sim_compute_robot_state-npc1_mean	0.062208124888928185
sim_compute_robot_state-npc1_median	0.06167952830974872
sim_compute_robot_state-npc1_min	0.05918342590332031
sim_compute_robot_state-npc2_max	0.06623802735255314
sim_compute_robot_state-npc2_mean	0.061495948690974134
sim_compute_robot_state-npc2_median	0.06126160974855776
sim_compute_robot_state-npc2_min	0.05882662076216478
sim_compute_robot_state-npc3_max	0.06490698227515587
sim_compute_robot_state-npc3_mean	0.06137417840278386
sim_compute_robot_state-npc3_median	0.06024307250976563
sim_compute_robot_state-npc3_min	0.05983912027799166
sim_compute_sim_state_max	0.03536871763376089
sim_compute_sim_state_mean	0.033613919434724034
sim_compute_sim_state_median	0.03355281441300004
sim_compute_sim_state_min	0.03212094306945801
sim_physics_max	0.032336913622342624
sim_physics_mean	0.029758229396961357
sim_physics_median	0.028915605545043944
sim_physics_min	0.027362099400273076
sim_render-ego_max	0.06221188439263238
sim_render-ego_mean	0.05994842992277227
sim_render-ego_median	0.060647001633277305
sim_render-ego_min	0.05614034652709961
simulation-passed	1
survival_time_max	1.3500000000000003
survival_time_mean	1.3000000000000005
survival_time_min	1.2500000000000004

No reset possible

19078

2916

Python template

step1-simulation

aborted

2019-04-23 14:19:25+00:00

2019-04-23 14:19:26+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19073

2917

Python template

step1-simulation

aborted

2019-04-23 14:18:29+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19058

2915

Python template

step1-simulation

host-error

2019-04-23 14:01:04+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19056

2914

Python template

step1-simulation

host-error

2019-04-23 14:00:43+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19047

2913

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-23 13:31:17+00:00

2019-04-23 13:31:47+00:00

0:00:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11508128316301248
error_L2	0.02222243898759634

No reset possible

19046

2912

Thies Lennart Alff 🇩🇪

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

success

2019-04-23 12:30:52+00:00

2019-04-23 12:44:57+00:00

0:14:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6292176526204964
survival_time_median	5.799999999999987
deviation-center-line_median	0.5518437136615361
in-drivable-lane_median	0.6999999999999993

other stats

agent_compute-ego_max	0.0998089053843281
agent_compute-ego_mean	0.09908362475342848
agent_compute-ego_median	0.09947714106789952
agent_compute-ego_min	0.09803519169489544
deviation-center-line_max	0.8388172885871314
deviation-center-line_mean	0.5965830511954149
deviation-center-line_min	0.3831185369193356
deviation-heading_max	5.497395294158972
deviation-heading_mean	2.246802761969068
deviation-heading_median	2.0613008998553433
deviation-heading_min	0.6665609404145512
driven_any_max	2.355077809805911
driven_any_mean	1.408452714629505
driven_any_median	0.8851375997510035
driven_any_min	0.6842416511385191
driven_lanedir_consec_max	0.8724476680242801
driven_lanedir_consec_mean	0.6077640143386722
driven_lanedir_consec_min	0.24922319000680743
driven_lanedir_max	1.3048848500993993
driven_lanedir_mean	0.8972795381878637
driven_lanedir_median	0.8724476680242801
driven_lanedir_min	0.496215710017791
in-drivable-lane_max	7.050000000000079
in-drivable-lane_mean	2.4100000000000237
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3533165292138927, "sim_physics": 0.017735690275828043, "survival_time": 14.950000000000076, "driven_lanedir": 1.139794321800326, "sim_render-ego": 0.07384518225987752, "in-drivable-lane": 7.050000000000079, "agent_compute-ego": 0.09803519169489544, "deviation-heading": 2.0613008998553433, "set_robot_commands": 0.08052979707717896, "deviation-center-line": 0.8388172885871314, "driven_lanedir_consec": 0.6148764200442556, "sim_compute_sim_state": 0.04537782271703084, "sim_compute_performance-ego": 0.07305649280548096, "sim_compute_robot_state-ego": 0.0713323990503947}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7644899832381978, "sim_physics": 0.01873140523929407, "survival_time": 5.04999999999999, "driven_lanedir": 0.496215710017791, "sim_render-ego": 0.07242607834315536, "in-drivable-lane": 0.6999999999999993, "agent_compute-ego": 0.0998089053843281, "deviation-heading": 2.2854462218994542, "set_robot_commands": 0.07872154453013203, "deviation-center-line": 0.3831185369193356, "driven_lanedir_consec": 0.24922319000680743, "sim_compute_sim_state": 0.04350214429421, "sim_compute_performance-ego": 0.07086054877479478, "sim_compute_robot_state-ego": 0.06844164593384998}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8851375997510035, "sim_physics": 0.01829440018226361, "survival_time": 5.799999999999987, "driven_lanedir": 0.8724476680242801, "sim_render-ego": 0.07252617128964128, "in-drivable-lane": 0, "agent_compute-ego": 0.09947714106789952, "deviation-heading": 0.7233104535170212, "set_robot_commands": 0.08173657696822594, "deviation-center-line": 0.5518437136615361, "driven_lanedir_consec": 0.8724476680242801, "sim_compute_sim_state": 0.04509220863210744, "sim_compute_performance-ego": 0.07366496119005926, "sim_compute_robot_state-ego": 0.0729696668427566}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.01909243929517138, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.06934626547844855, "in-drivable-lane": 0, "agent_compute-ego": 0.09976599766657902, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.08528305410028814, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.04512005323892111, "sim_compute_performance-ego": 0.06960902895246233, "sim_compute_robot_state-ego": 0.07199372826041756}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.355077809805911, "sim_physics": 0.017960631052652994, "survival_time": 14.950000000000076, "driven_lanedir": 1.3048848500993993, "sim_render-ego": 0.06984901587168375, "in-drivable-lane": 4.300000000000041, "agent_compute-ego": 0.09833088795344036, "deviation-heading": 5.497395294158972, "set_robot_commands": 0.08074383179346721, "deviation-center-line": 0.787825504203588, "driven_lanedir_consec": 0.6292176526204964, "sim_compute_sim_state": 0.0452701989809672, "sim_compute_performance-ego": 0.06993306477864583, "sim_compute_robot_state-ego": 0.07280942440032959}}
set_robot_commands_max	0.08528305410028814
set_robot_commands_mean	0.08140296089385846
set_robot_commands_median	0.08074383179346721
set_robot_commands_min	0.07872154453013203
sim_compute_performance-ego_max	0.07366496119005926
sim_compute_performance-ego_mean	0.07142481930028863
sim_compute_performance-ego_median	0.07086054877479478
sim_compute_performance-ego_min	0.06960902895246233
sim_compute_robot_state-ego_max	0.0729696668427566
sim_compute_robot_state-ego_mean	0.07150937289754969
sim_compute_robot_state-ego_median	0.07199372826041756
sim_compute_robot_state-ego_min	0.06844164593384998
sim_compute_sim_state_max	0.04537782271703084
sim_compute_sim_state_mean	0.04487248557264732
sim_compute_sim_state_median	0.04512005323892111
sim_compute_sim_state_min	0.04350214429421
sim_physics_max	0.01909243929517138
sim_physics_mean	0.01836291320904202
sim_physics_median	0.01829440018226361
sim_physics_min	0.017735690275828043
sim_render-ego_max	0.07384518225987752
sim_render-ego_mean	0.07159854264856128
sim_render-ego_median	0.07242607834315536
sim_render-ego_min	0.06934626547844855
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.060000000000024
survival_time_min	4.549999999999992

No reset possible

19038

2904

aido2-LFV-sim-validation

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-23 08:39:58+00:00

2019-04-23 09:01:05+00:00

0:21:07

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19032

2900

aido2-LF-sim-validation

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-23 08:19:28+00:00

2019-04-23 08:33:21+00:00

0:13:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2418823921974895
survival_time_median	9.299999999999995
deviation-center-line_median	0.10712794528394044
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.19369198045422953
agent_compute-ego_mean	0.1884626952399942
agent_compute-ego_median	0.18990051045137293
agent_compute-ego_min	0.1827265234554515
deviation-center-line_max	0.14132167177335703
deviation-center-line_mean	0.1125971941855486
deviation-center-line_min	0.09226302678581894
deviation-heading_max	0.7807836676607757
deviation-heading_mean	0.6992462771907368
deviation-heading_median	0.7348702630500736
deviation-heading_min	0.6079451781838128
driven_any_max	1.573590099124582
driven_any_mean	1.3394880718570463
driven_any_median	1.5735900962447813
driven_any_min	0.98833503231444
driven_lanedir_consec_max	1.3337546876995514
driven_lanedir_consec_mean	1.0464032542037318
driven_lanedir_consec_min	0.6581545631412622
driven_lanedir_max	1.3337546876995514
driven_lanedir_mean	1.0464032542037318
driven_lanedir_median	1.2418823921974895
driven_lanedir_min	0.6581545631412622
in-drivable-lane_max	1.6500000000000163
in-drivable-lane_mean	1.480000000000008
in-drivable-lane_min	1.1999999999999955
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.98833503231444, "sim_physics": 0.016482808008915235, "survival_time": 5.949999999999987, "driven_lanedir": 0.6581545631412622, "sim_render-ego": 0.06055741149838231, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1827265234554515, "deviation-heading": 0.7348702630500736, "set_robot_commands": 0.07781170396243825, "deviation-center-line": 0.09226302678581894, "driven_lanedir_consec": 0.6581545631412622, "sim_compute_sim_state": 0.03731178235606987, "sim_compute_performance-ego": 0.06275946152310412, "sim_compute_robot_state-ego": 0.06361516583867434}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.988335033104143, "sim_physics": 0.017111044971882795, "survival_time": 5.949999999999987, "driven_lanedir": 0.7558931947054509, "sim_render-ego": 0.06265534072363076, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.18990051045137293, "deviation-heading": 0.6081808139644682, "set_robot_commands": 0.07506596340852625, "deviation-center-line": 0.12005367105911297, "driven_lanedir_consec": 0.7558931947054509, "sim_compute_sim_state": 0.038974148886544366, "sim_compute_performance-ego": 0.06302675679952156, "sim_compute_robot_state-ego": 0.06425050727459562}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.573590098497286, "sim_physics": 0.016525123708991594, "survival_time": 9.299999999999995, "driven_lanedir": 1.3337546876995514, "sim_render-ego": 0.06015489178319131, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.18599479172819405, "deviation-heading": 0.6079451781838128, "set_robot_commands": 0.07470882451662453, "deviation-center-line": 0.14132167177335703, "driven_lanedir_consec": 1.3337546876995514, "sim_compute_sim_state": 0.03820740279331002, "sim_compute_performance-ego": 0.06188098205033169, "sim_compute_robot_state-ego": 0.06508477528889973}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.573590099124582, "sim_physics": 0.016738330164263324, "survival_time": 9.299999999999995, "driven_lanedir": 1.242331433274905, "sim_render-ego": 0.061438498958464594, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.18999967011072305, "deviation-heading": 0.764451463094554, "set_robot_commands": 0.07594234969026299, "deviation-center-line": 0.10221965602551354, "driven_lanedir_consec": 1.242331433274905, "sim_compute_sim_state": 0.03909521589996994, "sim_compute_performance-ego": 0.06349986855701734, "sim_compute_robot_state-ego": 0.06480751627235003}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5735900962447813, "sim_physics": 0.01696420741337602, "survival_time": 9.299999999999995, "driven_lanedir": 1.2418823921974895, "sim_render-ego": 0.06401449506000806, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.19369198045422953, "deviation-heading": 0.7807836676607757, "set_robot_commands": 0.07713258779177101, "deviation-center-line": 0.10712794528394044, "driven_lanedir_consec": 1.2418823921974895, "sim_compute_sim_state": 0.040613997367120555, "sim_compute_performance-ego": 0.06472097801905806, "sim_compute_robot_state-ego": 0.06621639061999578}}
set_robot_commands_max	0.07781170396243825
set_robot_commands_mean	0.07613228587392461
set_robot_commands_median	0.07594234969026299
set_robot_commands_min	0.07470882451662453
sim_compute_performance-ego_max	0.06472097801905806
sim_compute_performance-ego_mean	0.06317760938980656
sim_compute_performance-ego_median	0.06302675679952156
sim_compute_performance-ego_min	0.06188098205033169
sim_compute_robot_state-ego_max	0.06621639061999578
sim_compute_robot_state-ego_mean	0.06479487105890311
sim_compute_robot_state-ego_median	0.06480751627235003
sim_compute_robot_state-ego_min	0.06361516583867434
sim_compute_sim_state_max	0.040613997367120555
sim_compute_sim_state_mean	0.038840509460602954
sim_compute_sim_state_median	0.038974148886544366
sim_compute_sim_state_min	0.03731178235606987
sim_physics_max	0.017111044971882795
sim_physics_mean	0.016764302853485794
sim_physics_median	0.016738330164263324
sim_physics_min	0.016482808008915235
sim_render-ego_max	0.06401449506000806
sim_render-ego_mean	0.06176412760473541
sim_render-ego_median	0.061438498958464594
sim_render-ego_min	0.06015489178319131
simulation-passed	1
survival_time_max	9.299999999999995
survival_time_mean	7.959999999999994
survival_time_min	5.949999999999987

No reset possible

19016

2891

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:30:21+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19008

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:29:36+00:00

2019-04-22 17:29:37+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19001

2892

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:29:04+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18998

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

host-error

2019-04-22 17:28:51+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18955

2890

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

2019-04-22 16:49:56+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18953

2889

Diego Charrez 🇵🇪

Python template

step1-simulation

aborted

2019-04-22 16:49:41+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18950

2887

Diego Charrez 🇵🇪

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-22 15:29:11+00:00

2019-04-22 15:32:17+00:00

0:03:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11252654469078924
error_L2	0.0205911450551402

No reset possible

18949

2888

Diego Charrez 🇵🇪

PredictorLast

aido2-PRED

step1-simulation

success