Evaluator 798

step1-simulation

success

2019-04-26 17:00:24+00:00

2019-04-26 17:11:51+00:00

0:11:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.572675103533163
survival_time_median	14.950000000000076
deviation-center-line_median	1.1015575066481949
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07749705155690512
agent_compute-ego_mean	0.07386100764492796
agent_compute-ego_median	0.07598565896352132
agent_compute-ego_min	0.0693860949984022
deviation-center-line_max	1.390342796254889
deviation-center-line_mean	1.0200050247082173
deviation-center-line_min	0.3937533424522075
deviation-heading_max	4.0075793009300344
deviation-heading_mean	2.2411234749056845
deviation-heading_median	2.1682681011786045
deviation-heading_min	1.0189129269098496
driven_any_max	0.7830316455401461
driven_any_mean	0.6529486911039528
driven_any_median	0.780889843321914
driven_any_min	0.4026391155727696
driven_lanedir_consec_max	0.7797054944047659
driven_lanedir_consec_mean	0.5918095231994605
driven_lanedir_consec_min	0.35723264256933396
driven_lanedir_max	0.7797054944047659
driven_lanedir_mean	0.5918095231994605
driven_lanedir_median	0.572675103533163
driven_lanedir_min	0.35723264256933396
in-drivable-lane_max	3.650000000000052
in-drivable-lane_mean	0.7300000000000104
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.780889843321914, "sim_physics": 0.06801615317662557, "survival_time": 14.950000000000076, "driven_lanedir": 0.7376307963426246, "sim_render-ego": 0.03721176385879517, "in-drivable-lane": 0, "agent_compute-ego": 0.07749705155690512, "deviation-heading": 4.0075793009300344, "set_robot_commands": 0.05586944341659546, "deviation-center-line": 1.044229456529575, "driven_lanedir_consec": 0.7376307963426246, "sim_compute_sim_state": 0.024316441218058267, "sim_compute_performance-ego": 0.04028576930363973, "sim_compute_robot_state-ego": 0.04241690158843994}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7830282832345715, "sim_physics": 0.06816545963287353, "survival_time": 14.950000000000076, "driven_lanedir": 0.572675103533163, "sim_render-ego": 0.03648534377415975, "in-drivable-lane": 3.650000000000052, "agent_compute-ego": 0.07598565896352132, "deviation-heading": 2.1682681011786045, "set_robot_commands": 0.05586437463760376, "deviation-center-line": 1.1701420216562202, "driven_lanedir_consec": 0.572675103533163, "sim_compute_sim_state": 0.024013511339823403, "sim_compute_performance-ego": 0.04013766447703044, "sim_compute_robot_state-ego": 0.0421567440032959}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5151545678503628, "sim_physics": 0.06260834267391033, "survival_time": 9.950000000000006, "driven_lanedir": 0.5118035791474149, "sim_render-ego": 0.03664648113538273, "in-drivable-lane": 0, "agent_compute-ego": 0.06974132456372131, "deviation-heading": 1.1286074966739017, "set_robot_commands": 0.0557553971832122, "deviation-center-line": 1.1015575066481949, "driven_lanedir_consec": 0.5118035791474149, "sim_compute_sim_state": 0.02371760229369504, "sim_compute_performance-ego": 0.0400393704074112, "sim_compute_robot_state-ego": 0.042107615638617896}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4026391155727696, "sim_physics": 0.060158940637187595, "survival_time": 7.84999999999998, "driven_lanedir": 0.35723264256933396, "sim_render-ego": 0.03654250673427703, "in-drivable-lane": 0, "agent_compute-ego": 0.0693860949984022, "deviation-heading": 2.8822495488360316, "set_robot_commands": 0.05679511416489911, "deviation-center-line": 0.3937533424522075, "driven_lanedir_consec": 0.35723264256933396, "sim_compute_sim_state": 0.02365928850356181, "sim_compute_performance-ego": 0.03973652754619623, "sim_compute_robot_state-ego": 0.042036355680720824}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7830316455401461, "sim_physics": 0.06374242305755615, "survival_time": 14.950000000000076, "driven_lanedir": 0.7797054944047659, "sim_render-ego": 0.036333391666412355, "in-drivable-lane": 0, "agent_compute-ego": 0.07669490814208985, "deviation-heading": 1.0189129269098496, "set_robot_commands": 0.05660507281621297, "deviation-center-line": 1.390342796254889, "driven_lanedir_consec": 0.7797054944047659, "sim_compute_sim_state": 0.02411789814631144, "sim_compute_performance-ego": 0.03986524422963461, "sim_compute_robot_state-ego": 0.04177234093348185}}
set_robot_commands_max	0.05679511416489911
set_robot_commands_mean	0.0561778804437047
set_robot_commands_median	0.05586944341659546
set_robot_commands_min	0.0557553971832122
sim_compute_performance-ego_max	0.04028576930363973
sim_compute_performance-ego_mean	0.04001291519278244
sim_compute_performance-ego_median	0.0400393704074112
sim_compute_performance-ego_min	0.03973652754619623
sim_compute_robot_state-ego_max	0.04241690158843994
sim_compute_robot_state-ego_mean	0.04209799156891129
sim_compute_robot_state-ego_median	0.042107615638617896
sim_compute_robot_state-ego_min	0.04177234093348185
sim_compute_sim_state_max	0.024316441218058267
sim_compute_sim_state_mean	0.02396494830028999
sim_compute_sim_state_median	0.024013511339823403
sim_compute_sim_state_min	0.02365928850356181
sim_physics_max	0.06816545963287353
sim_physics_mean	0.06453826383563063
sim_physics_median	0.06374242305755615
sim_physics_min	0.060158940637187595
sim_render-ego_max	0.03721176385879517
sim_render-ego_mean	0.0366438974338054
sim_render-ego_median	0.03654250673427703
sim_render-ego_min	0.036333391666412355
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.530000000000044
survival_time_min	7.84999999999998

No reset possible

20697

3094

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 15:00:23+00:00

2019-04-26 15:12:00+00:00

0:11:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6623258525741951
survival_time_median	12.750000000000046
deviation-center-line_median	0.570013205605356
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1263930294662714
agent_compute-ego_mean	0.12215432164319256
agent_compute-ego_median	0.121129669061228
agent_compute-ego_min	0.12053230323043523
deviation-center-line_max	0.91610365578435
deviation-center-line_mean	0.61675723592108
deviation-center-line_min	0.4112521295316036
deviation-heading_max	3.698830880493315
deviation-heading_mean	2.2819670812794475
deviation-heading_median	1.8184946880931996
deviation-heading_min	0.8317415439989438
driven_any_max	1.201342183410811
driven_any_mean	0.7905989102615821
driven_any_median	0.9963128238208814
driven_any_min	0.2749027968856813
driven_lanedir_consec_max	1.1767726289173273
driven_lanedir_consec_mean	0.6761964806753962
driven_lanedir_consec_min	0.2680589470773551
driven_lanedir_max	1.1767726289173273
driven_lanedir_mean	0.6761964806753962
driven_lanedir_median	0.6623258525741951
driven_lanedir_min	0.2680589470773551
in-drivable-lane_max	3.250000000000046
in-drivable-lane_mean	0.8900000000000127
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0213085429747646, "sim_physics": 0.05918267369270325, "survival_time": 12.800000000000049, "driven_lanedir": 0.6623258525741951, "sim_render-ego": 0.03482775669544935, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.1263930294662714, "deviation-heading": 3.698830880493315, "set_robot_commands": 0.0545216565951705, "deviation-center-line": 0.570013205605356, "driven_lanedir_consec": 0.6623258525741951, "sim_compute_sim_state": 0.022783621214330196, "sim_compute_performance-ego": 0.0389002226293087, "sim_compute_robot_state-ego": 0.040369133464992046}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9963128238208814, "sim_physics": 0.059159339642992206, "survival_time": 12.750000000000046, "driven_lanedir": 0.836119104911883, "sim_render-ego": 0.035024344687368356, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.12053230323043523, "deviation-heading": 3.243681256514505, "set_robot_commands": 0.054845639771106194, "deviation-center-line": 0.91610365578435, "driven_lanedir_consec": 0.836119104911883, "sim_compute_sim_state": 0.022789815827911977, "sim_compute_performance-ego": 0.038376874549716125, "sim_compute_robot_state-ego": 0.04013007575390386}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2749027968856813, "sim_physics": 0.04594159444173177, "survival_time": 3.7499999999999942, "driven_lanedir": 0.2680589470773551, "sim_render-ego": 0.03483156204223633, "in-drivable-lane": 0, "agent_compute-ego": 0.12100945472717284, "deviation-heading": 0.8317415439989438, "set_robot_commands": 0.053811508814493814, "deviation-center-line": 0.4112521295316036, "driven_lanedir_consec": 0.2680589470773551, "sim_compute_sim_state": 0.022666826248168945, "sim_compute_performance-ego": 0.03890888532002767, "sim_compute_robot_state-ego": 0.040386349360148115}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.05637833451022621, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.035831607690378395, "in-drivable-lane": 0, "agent_compute-ego": 0.121129669061228, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.05435441522037282, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.02270036785542464, "sim_compute_performance-ego": 0.03860706842246176, "sim_compute_robot_state-ego": 0.04060171632205739}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.201342183410811, "sim_physics": 0.06184904972712199, "survival_time": 14.950000000000076, "driven_lanedir": 1.1767726289173273, "sim_render-ego": 0.035224892298380536, "in-drivable-lane": 0, "agent_compute-ego": 0.1217071517308553, "deviation-heading": 1.8184946880931996, "set_robot_commands": 0.05447614908218384, "deviation-center-line": 0.7449179319340268, "driven_lanedir_consec": 1.1767726289173273, "sim_compute_sim_state": 0.02280704418818156, "sim_compute_performance-ego": 0.038997705777486166, "sim_compute_robot_state-ego": 0.040524617830912275}}
set_robot_commands_max	0.054845639771106194
set_robot_commands_mean	0.05440187389666543
set_robot_commands_median	0.05447614908218384
set_robot_commands_min	0.053811508814493814
sim_compute_performance-ego_max	0.038997705777486166
sim_compute_performance-ego_mean	0.03875815133980008
sim_compute_performance-ego_median	0.0389002226293087
sim_compute_performance-ego_min	0.038376874549716125
sim_compute_robot_state-ego_max	0.04060171632205739
sim_compute_robot_state-ego_mean	0.04040237854640273
sim_compute_robot_state-ego_median	0.040386349360148115
sim_compute_robot_state-ego_min	0.04013007575390386
sim_compute_sim_state_max	0.02280704418818156
sim_compute_sim_state_mean	0.02274953506680346
sim_compute_sim_state_median	0.022783621214330196
sim_compute_sim_state_min	0.022666826248168945
sim_physics_max	0.06184904972712199
sim_physics_mean	0.056502198402955096
sim_physics_median	0.059159339642992206
sim_physics_min	0.04594159444173177
sim_render-ego_max	0.035831607690378395
sim_render-ego_mean	0.0351480326827626
sim_render-ego_median	0.035024344687368356
sim_render-ego_min	0.03482775669544935
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.040000000000031
survival_time_min	3.7499999999999942

No reset possible

20692

3093

aido2-AMOD-service_quality

Python template

step2-scoring

success

yes

2019-04-26 13:51:58+00:00

2019-04-26 13:52:17+00:00

0:00:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.48664809260989

other stats

efficiency	-63.339432370436896
fleet_size	-1000000000

No reset possible

20686

3091

Java template from Webinar

aido2-AMOD-fleet_size

step1-simulation

success

yes

2019-04-26 13:38:12+00:00

2019-04-26 13:40:35+00:00

0:02:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20681

3088

Python template

aido2-AMOD-fleet_size

step1-simulation

failed

yes

2019-04-26 13:01:16+00:00

2019-04-26 13:21:15+00:00

0:19:59

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 288, in wait_for_solution
    return wait_for_file(fn, timeout=TIMEOUT_SOLUTION, wait=1)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 245, in wait_for_file
    raise Timeout(msg)
duckietown_challenges.cie_concrete.Timeout: Timeout of 600 while waiting for /challenges/challenge-solution-output/output-solution.yaml.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 505, in wrap_evaluator
    cie.wait_for_solution()
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 291, in wait_for_solution
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Time out: Timeout of 600 while waiting for /challenges/challenge-solution-output/output-solution.yaml.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20673

3084

Java template

aido2-AMOD-efficiency

step1-simulation

success

yes

2019-04-26 12:35:17+00:00

2019-04-26 12:38:49+00:00

0:03:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20652

3079

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:20+00:00

2019-04-26 10:24:53+00:00

0:22:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8599232881673053
survival_time_median	14.950000000000076
deviation-center-line_median	0.6335287352392424
in-drivable-lane_median	2.2000000000000313

other stats

agent_compute-ego_max	0.15599129915237428
agent_compute-ego_mean	0.148502830664725
agent_compute-ego_median	0.1537677844365438
agent_compute-ego_min	0.12825569480356544
deviation-center-line_max	1.1230390781277448
deviation-center-line_mean	0.6443533260535778
deviation-center-line_min	0.39602713017350016
deviation-heading_max	1.6260102964112138
deviation-heading_mean	1.380888615327228
deviation-heading_median	1.551039618121833
deviation-heading_min	1.0376565982432402
driven_any_max	1.376358436959676
driven_any_mean	1.016465835226609
driven_any_median	1.3740059265631186
driven_any_min	0.4335428665924545
driven_lanedir_consec_max	0.9279007246941569
driven_lanedir_consec_mean	0.7175881642779899
driven_lanedir_consec_min	0.4231274396910571
driven_lanedir_max	1.161793927676608
driven_lanedir_mean	0.7643668048744802
driven_lanedir_median	0.8599232881673053
driven_lanedir_min	0.4231274396910571
in-drivable-lane_max	5.350000000000076
in-drivable-lane_mean	2.550000000000036
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3740059265631186, "sim_physics": 0.14228260040283203, "survival_time": 14.950000000000076, "driven_lanedir": 1.161793927676608, "sim_render-ego": 0.045039248466491696, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.1537677844365438, "deviation-heading": 1.0376565982432402, "set_robot_commands": 0.06839471101760865, "deviation-center-line": 1.1230390781277448, "driven_lanedir_consec": 0.9279007246941569, "sim_compute_sim_state": 0.028499855995178226, "sim_compute_performance-ego": 0.04879077990849813, "sim_compute_robot_state-ego": 0.051687479813893634, "sim_compute_robot_state-npc0": 0.05248184760411581, "sim_compute_robot_state-npc1": 0.05024511734644572, "sim_compute_robot_state-npc2": 0.05150019407272339, "sim_compute_robot_state-npc3": 0.04987252394358317}, "udem1-1-0": {"driven_any": 0.5228434886770005, "sim_physics": 0.11995525683386853, "survival_time": 5.899999999999987, "driven_lanedir": 0.5029361601139741, "sim_render-ego": 0.04635112164384228, "in-drivable-lane": 0, "agent_compute-ego": 0.14944710165767347, "deviation-heading": 1.6260102964112138, "set_robot_commands": 0.06797463004871951, "deviation-center-line": 0.4312118162175535, "driven_lanedir_consec": 0.5029361601139741, "sim_compute_sim_state": 0.027009450783163816, "sim_compute_performance-ego": 0.050127560809507206, "sim_compute_robot_state-ego": 0.05132097308918581, "sim_compute_robot_state-npc0": 0.05130850662619381, "sim_compute_robot_state-npc1": 0.047961653289148365, "sim_compute_robot_state-npc2": 0.0490922362117444, "sim_compute_robot_state-npc3": 0.048327290405661374}, "udem1-2-0": {"driven_any": 1.376358436959676, "sim_physics": 0.1378671439488729, "survival_time": 14.950000000000076, "driven_lanedir": 0.8599232881673053, "sim_render-ego": 0.045111826260884606, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.15599129915237428, "deviation-heading": 1.592921528755377, "set_robot_commands": 0.06772221724192301, "deviation-center-line": 0.6379598705098476, "driven_lanedir_consec": 0.8599232881673053, "sim_compute_sim_state": 0.027954933643341066, "sim_compute_performance-ego": 0.04963948011398315, "sim_compute_robot_state-ego": 0.051694986820220945, "sim_compute_robot_state-npc0": 0.05138241052627564, "sim_compute_robot_state-npc1": 0.05006398359934489, "sim_compute_robot_state-npc2": 0.04983279307683309, "sim_compute_robot_state-npc3": 0.049656081994374594}, "udem1-3-0": {"driven_any": 1.3755784573407943, "sim_physics": 0.1453389080365499, "survival_time": 14.950000000000076, "driven_lanedir": 0.874053208723456, "sim_render-ego": 0.04495434443155925, "in-drivable-lane": 5.200000000000074, "agent_compute-ego": 0.15505227327346802, "deviation-heading": 1.551039618121833, "set_robot_commands": 0.0664381996790568, "deviation-center-line": 0.6335287352392424, "driven_lanedir_consec": 0.874053208723456, "sim_compute_sim_state": 0.029912792841593424, "sim_compute_performance-ego": 0.04901161114374797, "sim_compute_robot_state-ego": 0.05230225165685018, "sim_compute_robot_state-npc0": 0.05069818019866943, "sim_compute_robot_state-npc1": 0.04954506476720174, "sim_compute_robot_state-npc2": 0.04977511723836263, "sim_compute_robot_state-npc3": 0.050996100107828776}, "udem1-4-0": {"driven_any": 0.4335428665924545, "sim_physics": 0.0932302860298542, "survival_time": 4.94999999999999, "driven_lanedir": 0.4231274396910571, "sim_render-ego": 0.03879530020434447, "in-drivable-lane": 0, "agent_compute-ego": 0.12825569480356544, "deviation-heading": 1.0968150351044763, "set_robot_commands": 0.057888401879204646, "deviation-center-line": 0.39602713017350016, "driven_lanedir_consec": 0.4231274396910571, "sim_compute_sim_state": 0.023936560659697563, "sim_compute_performance-ego": 0.04216337926460035, "sim_compute_robot_state-ego": 0.04415388299961283, "sim_compute_robot_state-npc0": 0.043511833807434695, "sim_compute_robot_state-npc1": 0.042870641958833944, "sim_compute_robot_state-npc2": 0.0425768332047896, "sim_compute_robot_state-npc3": 0.04150613871487704}}
set_robot_commands_max	0.06839471101760865
set_robot_commands_mean	0.06568363197330251
set_robot_commands_median	0.06772221724192301
set_robot_commands_min	0.057888401879204646
sim_compute_performance-ego_max	0.050127560809507206
sim_compute_performance-ego_mean	0.04794656224806736
sim_compute_performance-ego_median	0.04901161114374797
sim_compute_performance-ego_min	0.04216337926460035
sim_compute_robot_state-ego_max	0.05230225165685018
sim_compute_robot_state-ego_mean	0.050231914875952674
sim_compute_robot_state-ego_median	0.051687479813893634
sim_compute_robot_state-ego_min	0.04415388299961283
sim_compute_robot_state-npc0_max	0.05248184760411581
sim_compute_robot_state-npc0_mean	0.049876555752537875
sim_compute_robot_state-npc0_median	0.05130850662619381
sim_compute_robot_state-npc0_min	0.043511833807434695
sim_compute_robot_state-npc1_max	0.05024511734644572
sim_compute_robot_state-npc1_mean	0.04813729219219493
sim_compute_robot_state-npc1_median	0.04954506476720174
sim_compute_robot_state-npc1_min	0.042870641958833944
sim_compute_robot_state-npc2_max	0.05150019407272339
sim_compute_robot_state-npc2_mean	0.04855543476089062
sim_compute_robot_state-npc2_median	0.04977511723836263
sim_compute_robot_state-npc2_min	0.0425768332047896
sim_compute_robot_state-npc3_max	0.050996100107828776
sim_compute_robot_state-npc3_mean	0.048071627033264994
sim_compute_robot_state-npc3_median	0.049656081994374594
sim_compute_robot_state-npc3_min	0.04150613871487704
sim_compute_sim_state_max	0.029912792841593424
sim_compute_sim_state_mean	0.02746271878459482
sim_compute_sim_state_median	0.027954933643341066
sim_compute_sim_state_min	0.023936560659697563
sim_physics_max	0.1453389080365499
sim_physics_mean	0.1277348390503955
sim_physics_median	0.1378671439488729
sim_physics_min	0.0932302860298542
sim_render-ego_max	0.04635112164384228
sim_render-ego_mean	0.04405036820142445
sim_render-ego_median	0.045039248466491696
sim_render-ego_min	0.03879530020434447
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.14000000000004
survival_time_min	4.94999999999999

No reset possible

20649

3066

Lei Chen

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-26 05:15:44+00:00

2019-04-26 05:16:10+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1164657887558502
error_L2	0.02157145235169452

No reset possible

20636

2388

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 15:10:43+00:00

2019-04-25 15:16:47+00:00

0:06:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.11984953767046956
survival_time_median	1.2000000000000004
deviation-center-line_median	0.08485600628811331
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.20508996645609537
agent_compute-ego_mean	0.17077886578045604
agent_compute-ego_median	0.1588827669620514
agent_compute-ego_min	0.1557176411151886
deviation-center-line_max	0.1054368882430943
deviation-center-line_mean	0.08562986826479413
deviation-center-line_min	0.06218220206135272
deviation-heading_max	1.033586561459023
deviation-heading_mean	0.7185933092655455
deviation-heading_median	0.7822781543120871
deviation-heading_min	0.45620931985405366
driven_any_max	0.25259404696853033
driven_any_mean	0.18564410123466277
driven_any_median	0.1637929009385311
driven_any_min	0.1475331351691219
driven_lanedir_consec_max	0.1313625951038111
driven_lanedir_consec_mean	0.1167408816103506
driven_lanedir_consec_min	0.09161129916126608
driven_lanedir_max	0.1313625951038111
driven_lanedir_mean	0.1167408816103506
driven_lanedir_median	0.11984953767046956
driven_lanedir_min	0.09161129916126608
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.1100000000000001
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.25259404696853033, "sim_physics": 0.1712558785000363, "survival_time": 1.850000000000001, "driven_lanedir": 0.11984953767046956, "sim_render-ego": 0.05844468039435309, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15843321181632378, "deviation-heading": 0.7822781543120871, "set_robot_commands": 0.09022708841272302, "deviation-center-line": 0.07216380742610627, "driven_lanedir_consec": 0.11984953767046956, "sim_compute_sim_state": 0.03988304653683224, "sim_compute_performance-ego": 0.06657712524001663, "sim_compute_robot_state-ego": 0.06813087334503999, "sim_compute_robot_state-npc0": 0.06789600526964343, "sim_compute_robot_state-npc1": 0.06772214013176996, "sim_compute_robot_state-npc2": 0.06805147995819917, "sim_compute_robot_state-npc3": 0.06834202199368863}, "udem1-1-0": {"driven_any": 0.2061915627749479, "sim_physics": 0.1934412462370736, "survival_time": 1.4000000000000006, "driven_lanedir": 0.11195254048586768, "sim_render-ego": 0.060741262776511054, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.175770742552621, "deviation-heading": 1.033586561459023, "set_robot_commands": 0.0938001104763576, "deviation-center-line": 0.08485600628811331, "driven_lanedir_consec": 0.11195254048586768, "sim_compute_sim_state": 0.04028280292238508, "sim_compute_performance-ego": 0.06524601152965001, "sim_compute_robot_state-ego": 0.0786998016493661, "sim_compute_robot_state-npc0": 0.06600218159811837, "sim_compute_robot_state-npc1": 0.06834345204489571, "sim_compute_robot_state-npc2": 0.06673469713756017, "sim_compute_robot_state-npc3": 0.06997556345803398}, "udem1-2-0": {"driven_any": 0.1581088603221827, "sim_physics": 0.1648207108179728, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12892843563033862, "sim_render-ego": 0.054447958866755165, "in-drivable-lane": 0, "agent_compute-ego": 0.1557176411151886, "deviation-heading": 0.45620931985405366, "set_robot_commands": 0.08522525429725647, "deviation-center-line": 0.1054368882430943, "driven_lanedir_consec": 0.12892843563033862, "sim_compute_sim_state": 0.0346524715423584, "sim_compute_performance-ego": 0.05953710277875265, "sim_compute_robot_state-ego": 0.05903462568918864, "sim_compute_robot_state-npc0": 0.060367037852605186, "sim_compute_robot_state-npc1": 0.059584230184555054, "sim_compute_robot_state-npc2": 0.05826891462008158, "sim_compute_robot_state-npc3": 0.05948718388875326}, "udem1-3-0": {"driven_any": 0.1637929009385311, "sim_physics": 0.2059967815876007, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1313625951038111, "sim_render-ego": 0.0681387186050415, "in-drivable-lane": 0, "agent_compute-ego": 0.20508996645609537, "deviation-heading": 0.4808227037642678, "set_robot_commands": 0.09933393200238544, "deviation-center-line": 0.10351043730530406, "driven_lanedir_consec": 0.1313625951038111, "sim_compute_sim_state": 0.04015237092971802, "sim_compute_performance-ego": 0.0779193143049876, "sim_compute_robot_state-ego": 0.08534764250119527, "sim_compute_robot_state-npc0": 0.07578166325887044, "sim_compute_robot_state-npc1": 0.07288513580958049, "sim_compute_robot_state-npc2": 0.0731704831123352, "sim_compute_robot_state-npc3": 0.07474441329638164}, "udem1-4-0": {"driven_any": 0.1475331351691219, "sim_physics": 0.15198177099227905, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09161129916126608, "sim_render-ego": 0.05982688069343567, "in-drivable-lane": 0, "agent_compute-ego": 0.1588827669620514, "deviation-heading": 0.8400698069382964, "set_robot_commands": 0.09354170163472492, "deviation-center-line": 0.06218220206135272, "driven_lanedir_consec": 0.09161129916126608, "sim_compute_sim_state": 0.039093196392059326, "sim_compute_performance-ego": 0.06525786717732747, "sim_compute_robot_state-ego": 0.07240204016367595, "sim_compute_robot_state-npc0": 0.06902881463368733, "sim_compute_robot_state-npc1": 0.07140383124351501, "sim_compute_robot_state-npc2": 0.07082385818163554, "sim_compute_robot_state-npc3": 0.07108692328135173}}
set_robot_commands_max	0.09933393200238544
set_robot_commands_mean	0.09242561736468947
set_robot_commands_median	0.09354170163472492
set_robot_commands_min	0.08522525429725647
sim_compute_performance-ego_max	0.0779193143049876
sim_compute_performance-ego_mean	0.06690748420614687
sim_compute_performance-ego_median	0.06525786717732747
sim_compute_performance-ego_min	0.05953710277875265
sim_compute_robot_state-ego_max	0.08534764250119527
sim_compute_robot_state-ego_mean	0.0727229966696932
sim_compute_robot_state-ego_median	0.07240204016367595
sim_compute_robot_state-ego_min	0.05903462568918864
sim_compute_robot_state-npc0_max	0.07578166325887044
sim_compute_robot_state-npc0_mean	0.06781514052258494
sim_compute_robot_state-npc0_median	0.06789600526964343
sim_compute_robot_state-npc0_min	0.060367037852605186
sim_compute_robot_state-npc1_max	0.07288513580958049
sim_compute_robot_state-npc1_mean	0.06798775788286324
sim_compute_robot_state-npc1_median	0.06834345204489571
sim_compute_robot_state-npc1_min	0.059584230184555054
sim_compute_robot_state-npc2_max	0.0731704831123352
sim_compute_robot_state-npc2_mean	0.06740988660196233
sim_compute_robot_state-npc2_median	0.06805147995819917
sim_compute_robot_state-npc2_min	0.05826891462008158
sim_compute_robot_state-npc3_max	0.07474441329638164
sim_compute_robot_state-npc3_mean	0.06872722118364186
sim_compute_robot_state-npc3_median	0.06997556345803398
sim_compute_robot_state-npc3_min	0.05948718388875326
sim_compute_sim_state_max	0.04028280292238508
sim_compute_sim_state_mean	0.03881277766467061
sim_compute_sim_state_median	0.03988304653683224
sim_compute_sim_state_min	0.0346524715423584
sim_physics_max	0.2059967815876007
sim_physics_mean	0.1774992776269925
sim_physics_median	0.1712558785000363
sim_physics_min	0.15198177099227905
sim_render-ego_max	0.0681387186050415
sim_render-ego_mean	0.0603199002672193
sim_render-ego_median	0.05982688069343567
sim_render-ego_min	0.054447958866755165
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.3700000000000006
survival_time_min	1.2000000000000004

No reset possible

20625

2363

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 15:00:32+00:00

2019-04-25 15:05:57+00:00

0:05:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1443762911690606
agent_compute-ego_mean	0.13629564520959372
agent_compute-ego_median	0.13641324104406896
agent_compute-ego_min	0.12820199300658028
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.09202586479906766, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06286164949525078, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.12820199300658028, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.08309936973283875, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03701424598693848, "sim_compute_performance-ego": 0.06687346944269144, "sim_compute_robot_state-ego": 0.06901961902402481}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.10404477211145256, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06257893488957332, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.13347793083924514, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.0955219864845276, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03907298124753512, "sim_compute_performance-ego": 0.0717822267458989, "sim_compute_robot_state-ego": 0.08092897213422336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.0906149943669637, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06823392709096272, "in-drivable-lane": 0, "agent_compute-ego": 0.1443762911690606, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10352390342288548, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.04355763064490424, "sim_compute_performance-ego": 0.07459783554077148, "sim_compute_robot_state-ego": 0.08711083730061848}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.10264922142028808, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.062354421615600585, "in-drivable-lane": 0, "agent_compute-ego": 0.13900876998901368, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.09947738647460938, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.03978148460388184, "sim_compute_performance-ego": 0.07254953384399414, "sim_compute_robot_state-ego": 0.07535505294799805}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09969123204549152, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06480198028760079, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13641324104406896, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.10038982599209516, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03964318984594101, "sim_compute_performance-ego": 0.07197780486864921, "sim_compute_robot_state-ego": 0.0795884254651192}}
set_robot_commands_max	0.10352390342288548
set_robot_commands_mean	0.09640249442139127
set_robot_commands_median	0.09947738647460938
set_robot_commands_min	0.08309936973283875
sim_compute_performance-ego_max	0.07459783554077148
sim_compute_performance-ego_mean	0.07155617408840105
sim_compute_performance-ego_median	0.07197780486864921
sim_compute_performance-ego_min	0.06687346944269144
sim_compute_robot_state-ego_max	0.08711083730061848
sim_compute_robot_state-ego_mean	0.07840058137439677
sim_compute_robot_state-ego_median	0.0795884254651192
sim_compute_robot_state-ego_min	0.06901961902402481
sim_compute_sim_state_max	0.04355763064490424
sim_compute_sim_state_mean	0.03981390646584013
sim_compute_sim_state_median	0.03964318984594101
sim_compute_sim_state_min	0.03701424598693848
sim_physics_max	0.10404477211145256
sim_physics_mean	0.09780521694865273
sim_physics_median	0.09969123204549152
sim_physics_min	0.0906149943669637
sim_render-ego_max	0.06823392709096272
sim_render-ego_mean	0.06416618267579763
sim_render-ego_median	0.06286164949525078
sim_render-ego_min	0.062354421615600585
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20594

2403

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:47:28+00:00

2019-04-25 15:00:03+00:00

0:12:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20594-774297', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20594-774297', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20594-774297', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20557

2448

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:12:03+00:00

2019-04-25 14:47:08+00:00

0:35:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401047463162574
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020903216633783
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.16553809404373168
agent_compute-ego_mean	0.16160608752568564
agent_compute-ego_median	0.16162372668584188
agent_compute-ego_min	0.15815285364786782
deviation-center-line_max	1.5200593248921646
deviation-center-line_mean	0.9234182563504314
deviation-center-line_min	0.2826572656098777
deviation-heading_max	8.488415384770876
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.0891261288876
deviation-heading_min	5.694184625828924
driven_any_max	4.378320939674847
driven_any_mean	4.378320939674838
driven_any_median	4.378320939674838
driven_any_min	4.378320939674826
driven_lanedir_consec_max	-1.273127772600478
driven_lanedir_consec_mean	-1.3316670653980158
driven_lanedir_consec_min	-1.367352616124776
driven_lanedir_max	-1.3666338643676914
driven_lanedir_mean	-2.0778269948498607
driven_lanedir_median	-2.2611414102685594
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.17612857818603517, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.060925007661183674, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16553809404373168, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.0945378271738688, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.03902211348215739, "sim_compute_performance-ego": 0.06598224957784017, "sim_compute_robot_state-ego": 0.0708611798286438, "sim_compute_robot_state-npc0": 0.06768607139587403, "sim_compute_robot_state-npc1": 0.0676597793896993, "sim_compute_robot_state-npc2": 0.0682045594851176, "sim_compute_robot_state-npc3": 0.0679340664545695}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674847, "sim_physics": 0.173218670686086, "survival_time": 14.950000000000076, "driven_lanedir": -2.682734814564024, "sim_render-ego": 0.06227023204167684, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.16230411052703858, "deviation-heading": 8.488415384770876, "set_robot_commands": 0.09080047607421876, "deviation-center-line": 1.5200593248921646, "driven_lanedir_consec": -1.273127772600478, "sim_compute_sim_state": 0.03722941398620606, "sim_compute_performance-ego": 0.0676656985282898, "sim_compute_robot_state-ego": 0.07071905692418416, "sim_compute_robot_state-npc0": 0.06632178703943889, "sim_compute_robot_state-npc1": 0.06802146673202515, "sim_compute_robot_state-npc2": 0.06705626487731933, "sim_compute_robot_state-npc3": 0.06792085806528728}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378320939674833, "sim_physics": 0.16611572265625, "survival_time": 14.950000000000076, "driven_lanedir": -1.3666338643676914, "sim_render-ego": 0.05910628000895182, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.15815285364786782, "deviation-heading": 5.77182628235273, "set_robot_commands": 0.0912089228630066, "deviation-center-line": 0.2928511106075376, "driven_lanedir_consec": -1.3666338643676914, "sim_compute_sim_state": 0.037804898420969645, "sim_compute_performance-ego": 0.06509397745132446, "sim_compute_robot_state-ego": 0.0687062382698059, "sim_compute_robot_state-npc0": 0.06812045892079671, "sim_compute_robot_state-npc1": 0.06795207579930623, "sim_compute_robot_state-npc2": 0.06618663787841797, "sim_compute_robot_state-npc3": 0.06732538143793741}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674826, "sim_physics": 0.1680119283994039, "survival_time": 14.950000000000076, "driven_lanedir": -1.367352616124776, "sim_render-ego": 0.05825367609659831, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.16041165272394817, "deviation-heading": 5.694184625828924, "set_robot_commands": 0.09240368048350016, "deviation-center-line": 0.2826572656098777, "driven_lanedir_consec": -1.367352616124776, "sim_compute_sim_state": 0.037534232139587405, "sim_compute_performance-ego": 0.06459887027740478, "sim_compute_robot_state-ego": 0.06798359711964926, "sim_compute_robot_state-npc0": 0.06602983713150025, "sim_compute_robot_state-npc1": 0.06720935106277466, "sim_compute_robot_state-npc2": 0.06586565017700195, "sim_compute_robot_state-npc3": 0.06567838191986083}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674838, "sim_physics": 0.17360886494318645, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611414102685594, "sim_render-ego": 0.0600317374865214, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.16162372668584188, "deviation-heading": 7.0891261288876, "set_robot_commands": 0.09223092873891196, "deviation-center-line": 1.0020903216633783, "driven_lanedir_consec": -1.3401047463162574, "sim_compute_sim_state": 0.037171358267466224, "sim_compute_performance-ego": 0.06607660373051961, "sim_compute_robot_state-ego": 0.07179342110951742, "sim_compute_robot_state-npc0": 0.06895602226257325, "sim_compute_robot_state-npc1": 0.06753009955088297, "sim_compute_robot_state-npc2": 0.06666634400685628, "sim_compute_robot_state-npc3": 0.06692985614140828}}
set_robot_commands_max	0.0945378271738688
set_robot_commands_mean	0.09223636706670128
set_robot_commands_median	0.09223092873891196
set_robot_commands_min	0.09080047607421876
sim_compute_performance-ego_max	0.0676656985282898
sim_compute_performance-ego_mean	0.06588347991307576
sim_compute_performance-ego_median	0.06598224957784017
sim_compute_performance-ego_min	0.06459887027740478
sim_compute_robot_state-ego_max	0.07179342110951742
sim_compute_robot_state-ego_mean	0.07001269865036011
sim_compute_robot_state-ego_median	0.07071905692418416
sim_compute_robot_state-ego_min	0.06798359711964926
sim_compute_robot_state-npc0_max	0.06895602226257325
sim_compute_robot_state-npc0_mean	0.06742283535003663
sim_compute_robot_state-npc0_median	0.06768607139587403
sim_compute_robot_state-npc0_min	0.06602983713150025
sim_compute_robot_state-npc1_max	0.06802146673202515
sim_compute_robot_state-npc1_mean	0.06767455450693766
sim_compute_robot_state-npc1_median	0.0676597793896993
sim_compute_robot_state-npc1_min	0.06720935106277466
sim_compute_robot_state-npc2_max	0.0682045594851176
sim_compute_robot_state-npc2_mean	0.06679589128494262
sim_compute_robot_state-npc2_median	0.06666634400685628
sim_compute_robot_state-npc2_min	0.06586565017700195
sim_compute_robot_state-npc3_max	0.0679340664545695
sim_compute_robot_state-npc3_mean	0.06715770880381265
sim_compute_robot_state-npc3_median	0.06732538143793741
sim_compute_robot_state-npc3_min	0.06567838191986083
sim_compute_sim_state_max	0.03902211348215739
sim_compute_sim_state_mean	0.037752403259277346
sim_compute_sim_state_median	0.037534232139587405
sim_compute_sim_state_min	0.037171358267466224
sim_physics_max	0.17612857818603517
sim_physics_mean	0.1714167529741923
sim_physics_median	0.173218670686086
sim_physics_min	0.16611572265625
sim_render-ego_max	0.06227023204167684
sim_render-ego_mean	0.0601173866589864
sim_render-ego_median	0.0600317374865214
sim_render-ego_min	0.05825367609659831
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20544

2468

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 14:07:09+00:00

2019-04-25 14:11:50+00:00

0:04:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.24064523643917507
agent_compute-ego_mean	0.14466787065526895
agent_compute-ego_median	0.1273172757564447
agent_compute-ego_min	0.08861047744750977
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.0699507695324016, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.04456232178885982, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.10961872226787064, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.06836825046899184, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.02815801242612443, "sim_compute_performance-ego": 0.049077524329131504, "sim_compute_robot_state-ego": 0.053590545114481226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.11044839253792396, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.060392994147080645, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1571476413653447, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.10598836036828849, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.04066595205893883, "sim_compute_performance-ego": 0.07347761667691745, "sim_compute_robot_state-ego": 0.08637649279374343}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.13915158642662895, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.07999303605821398, "in-drivable-lane": 0, "agent_compute-ego": 0.24064523643917507, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.14523806836869982, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.05642803510030111, "sim_compute_performance-ego": 0.09038474824693468, "sim_compute_robot_state-ego": 0.10408702161577012}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.052309331893920896, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.03664813995361328, "in-drivable-lane": 0, "agent_compute-ego": 0.08861047744750977, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.05973073959350586, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.02334589958190918, "sim_compute_performance-ego": 0.03993804931640625, "sim_compute_robot_state-ego": 0.042172203063964846}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.06844632136516082, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.049735915966523, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.1273172757564447, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.07799010704725216, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03182510840587127, "sim_compute_performance-ego": 0.05439468836173033, "sim_compute_robot_state-ego": 0.057318938084137745}}
set_robot_commands_max	0.14523806836869982
set_robot_commands_mean	0.09146310516934764
set_robot_commands_median	0.07799010704725216
set_robot_commands_min	0.05973073959350586
sim_compute_performance-ego_max	0.09038474824693468
sim_compute_performance-ego_mean	0.06145452538622405
sim_compute_performance-ego_median	0.05439468836173033
sim_compute_performance-ego_min	0.03993804931640625
sim_compute_robot_state-ego_max	0.10408702161577012
sim_compute_robot_state-ego_mean	0.06870904013441947
sim_compute_robot_state-ego_median	0.057318938084137745
sim_compute_robot_state-ego_min	0.042172203063964846
sim_compute_sim_state_max	0.05642803510030111
sim_compute_sim_state_mean	0.036084601514628965
sim_compute_sim_state_median	0.03182510840587127
sim_compute_sim_state_min	0.02334589958190918
sim_physics_max	0.13915158642662895
sim_physics_mean	0.08806128035120725
sim_physics_median	0.0699507695324016
sim_physics_min	0.052309331893920896
sim_render-ego_max	0.07999303605821398
sim_render-ego_mean	0.05426648158285814
sim_render-ego_median	0.049735915966523
sim_render-ego_min	0.03664813995361328
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20534

2491

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 14:02:04+00:00

2019-04-25 14:06:46+00:00

0:04:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1567176441574092
survival_time_median	1.3500000000000003
deviation-center-line_median	0.07157032040884065
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18772667029808307
agent_compute-ego_mean	0.17446513339412234
agent_compute-ego_median	0.172821839650472
agent_compute-ego_min	0.15575789269946871
deviation-center-line_max	0.10157359360467576
deviation-center-line_mean	0.07703798212251294
deviation-center-line_min	0.05945221649172833
deviation-heading_max	0.8263938109409096
deviation-heading_mean	0.6484735668680617
deviation-heading_median	0.6463188076226539
deviation-heading_min	0.4354674567570896
driven_any_max	0.2568789545893042
driven_any_mean	0.22157066675598905
driven_any_median	0.2245315371312381
driven_any_min	0.1745128954709013
driven_lanedir_consec_max	0.2042207308674182
driven_lanedir_consec_mean	0.16561548233861276
driven_lanedir_consec_min	0.14913357214265677
driven_lanedir_max	0.2042207308674182
driven_lanedir_mean	0.16561548233861276
driven_lanedir_median	0.1567176441574092
driven_lanedir_min	0.14913357214265677
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.010000000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2361142816050058, "sim_physics": 0.09961698795187064, "survival_time": 1.4500000000000006, "driven_lanedir": 0.14913357214265677, "sim_render-ego": 0.06786993454242575, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18772667029808307, "deviation-heading": 0.8263938109409096, "set_robot_commands": 0.09674334526062012, "deviation-center-line": 0.08771945839981929, "driven_lanedir_consec": 0.14913357214265677, "sim_compute_sim_state": 0.04034660602438039, "sim_compute_performance-ego": 0.07356163551067484, "sim_compute_robot_state-ego": 0.0741270821670006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2568789545893042, "sim_physics": 0.09763095296662427, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2042207308674182, "sim_render-ego": 0.060779637303845634, "in-drivable-lane": 0, "agent_compute-ego": 0.1690908629318763, "deviation-heading": 0.6224183584565727, "set_robot_commands": 0.0950373205645331, "deviation-center-line": 0.05945221649172833, "driven_lanedir_consec": 0.2042207308674182, "sim_compute_sim_state": 0.03873941816132644, "sim_compute_performance-ego": 0.07082299528450801, "sim_compute_robot_state-ego": 0.07949405703051336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1745128954709013, "sim_physics": 0.08503769692920503, "survival_time": 1.0500000000000005, "driven_lanedir": 0.15091584473737907, "sim_render-ego": 0.05594771248953683, "in-drivable-lane": 0, "agent_compute-ego": 0.15575789269946871, "deviation-heading": 0.4354674567570896, "set_robot_commands": 0.08946963718959264, "deviation-center-line": 0.10157359360467576, "driven_lanedir_consec": 0.15091584473737907, "sim_compute_sim_state": 0.03497406414576939, "sim_compute_performance-ego": 0.06705480530148461, "sim_compute_robot_state-ego": 0.07624226524716332}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2245315371312381, "sim_physics": 0.09557044506072998, "survival_time": 1.2000000000000004, "driven_lanedir": 0.16708961978820058, "sim_render-ego": 0.06097768743832906, "in-drivable-lane": 0, "agent_compute-ego": 0.18692840139071143, "deviation-heading": 0.7117694005630824, "set_robot_commands": 0.09825827678044637, "deviation-center-line": 0.07157032040884065, "driven_lanedir_consec": 0.16708961978820058, "sim_compute_sim_state": 0.03902005155881246, "sim_compute_performance-ego": 0.07051906983057658, "sim_compute_robot_state-ego": 0.0729954441388448}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21581566498349572, "sim_physics": 0.10470927203143084, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1567176441574092, "sim_render-ego": 0.060640308592054576, "in-drivable-lane": 0, "agent_compute-ego": 0.172821839650472, "deviation-heading": 0.6463188076226539, "set_robot_commands": 0.0953820723074454, "deviation-center-line": 0.06487432170750064, "driven_lanedir_consec": 0.1567176441574092, "sim_compute_sim_state": 0.03851696296974465, "sim_compute_performance-ego": 0.06265486611260308, "sim_compute_robot_state-ego": 0.06983927444175438}}
set_robot_commands_max	0.09825827678044637
set_robot_commands_mean	0.09497813042052752
set_robot_commands_median	0.0953820723074454
set_robot_commands_min	0.08946963718959264
sim_compute_performance-ego_max	0.07356163551067484
sim_compute_performance-ego_mean	0.06892267440796943
sim_compute_performance-ego_median	0.07051906983057658
sim_compute_performance-ego_min	0.06265486611260308
sim_compute_robot_state-ego_max	0.07949405703051336
sim_compute_robot_state-ego_mean	0.07453962460505528
sim_compute_robot_state-ego_median	0.0741270821670006
sim_compute_robot_state-ego_min	0.06983927444175438
sim_compute_sim_state_max	0.04034660602438039
sim_compute_sim_state_mean	0.03831942057200667
sim_compute_sim_state_median	0.03873941816132644
sim_compute_sim_state_min	0.03497406414576939
sim_physics_max	0.10470927203143084
sim_physics_mean	0.09651307098797215
sim_physics_median	0.09763095296662427
sim_physics_min	0.08503769692920503
sim_render-ego_max	0.06786993454242575
sim_render-ego_mean	0.06124305607323837
sim_render-ego_median	0.060779637303845634
sim_render-ego_min	0.05594771248953683
simulation-passed	1
survival_time_max	1.4500000000000006
survival_time_mean	1.3000000000000005
survival_time_min	1.0500000000000005

No reset possible

20522

2507

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:01:09+00:00

2019-04-25 14:01:56+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20500

2517

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 13:58:34+00:00

2019-04-25 14:00:49+00:00

0:02:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20500-489976', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20500-489976', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20500-489976', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20487

2544

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

success

2019-04-25 13:51:08+00:00

2019-04-25 13:58:06+00:00

0:06:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.07128211380778879
agent_compute-ego_mean	0.06691854250972959
agent_compute-ego_median	0.06595446513249324
agent_compute-ego_min	0.06381133669301083
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.08929718795575593, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.05749716570502833, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.06381133669301083, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.08707430174476222, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03573750822167648, "sim_compute_performance-ego": 0.064873805171565, "sim_compute_robot_state-ego": 0.07087036183005885}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.10026245186294334, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.06362905709639839, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07128211380778879, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.097584112830784, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.0400828278583029, "sim_compute_performance-ego": 0.07224653423696324, "sim_compute_robot_state-ego": 0.08027690735416136}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.09088847853920676, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06120159409262917, "in-drivable-lane": 0, "agent_compute-ego": 0.06865605441006747, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.09669711373069068, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.03880227695811878, "sim_compute_performance-ego": 0.06315257332541725, "sim_compute_robot_state-ego": 0.06858757409182462}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.0999547282418052, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.05973454622121958, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06595446513249324, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.09256034106998652, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.03912505212720934, "sim_compute_performance-ego": 0.06602141097351745, "sim_compute_robot_state-ego": 0.0691011056795225}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.0950120955097432, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.05718186436867227, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06488874250528764, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.09150798223456558, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.03700440513844393, "sim_compute_performance-ego": 0.06456077585414964, "sim_compute_robot_state-ego": 0.06720629516912967}}
set_robot_commands_max	0.097584112830784
set_robot_commands_mean	0.0930847703221578
set_robot_commands_median	0.09256034106998652
set_robot_commands_min	0.08707430174476222
sim_compute_performance-ego_max	0.07224653423696324
sim_compute_performance-ego_mean	0.06617101991232252
sim_compute_performance-ego_median	0.064873805171565
sim_compute_performance-ego_min	0.06315257332541725
sim_compute_robot_state-ego_max	0.08027690735416136
sim_compute_robot_state-ego_mean	0.0712084488249394
sim_compute_robot_state-ego_median	0.0691011056795225
sim_compute_robot_state-ego_min	0.06720629516912967
sim_compute_sim_state_max	0.0400828278583029
sim_compute_sim_state_mean	0.03815041406075028
sim_compute_sim_state_median	0.03880227695811878
sim_compute_sim_state_min	0.03573750822167648
sim_physics_max	0.10026245186294334
sim_physics_mean	0.09508298842189088
sim_physics_median	0.0950120955097432
sim_physics_min	0.08929718795575593
sim_render-ego_max	0.06362905709639839
sim_render-ego_mean	0.05984884549678955
sim_render-ego_median	0.05973454622121958
sim_render-ego_min	0.05718186436867227
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20481

2560

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:43:25+00:00

2019-04-25 13:50:17+00:00

0:06:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.071328512136487
agent_compute-ego_mean	0.06478044227577325
agent_compute-ego_median	0.06546238335696133
agent_compute-ego_min	0.05678233033732364
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.07106037202634309, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.04616732660092806, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.05678233033732364, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.0719515179332934, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.029797692047922236, "sim_compute_performance-ego": 0.052735322400143274, "sim_compute_robot_state-ego": 0.05501517182902286}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.1029781535051871, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.06199698517287987, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.071328512136487, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.09893448802008144, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.039789438247680664, "sim_compute_performance-ego": 0.0695466891579006, "sim_compute_robot_state-ego": 0.07768604720848193}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.09728237715634432, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06058302792635831, "in-drivable-lane": 0, "agent_compute-ego": 0.06546238335696133, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.09950791705738414, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.037270101633938874, "sim_compute_performance-ego": 0.06680462577126244, "sim_compute_robot_state-ego": 0.07240586931055243}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.10482302864829264, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.06145643925928807, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06816733800447904, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.09717801639011928, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.039175371547321695, "sim_compute_performance-ego": 0.06733034469269134, "sim_compute_robot_state-ego": 0.07513497163961222}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.08768581370918119, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.05488692011151995, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06216164754361522, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.08171259870334548, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.03526236816328399, "sim_compute_performance-ego": 0.061006429244060904, "sim_compute_robot_state-ego": 0.06535941240738849}}
set_robot_commands_max	0.09950791705738414
set_robot_commands_mean	0.08985690762084475
set_robot_commands_median	0.09717801639011928
set_robot_commands_min	0.0719515179332934
sim_compute_performance-ego_max	0.0695466891579006
sim_compute_performance-ego_mean	0.06348468225321172
sim_compute_performance-ego_median	0.06680462577126244
sim_compute_performance-ego_min	0.052735322400143274
sim_compute_robot_state-ego_max	0.07768604720848193
sim_compute_robot_state-ego_mean	0.06912029447901158
sim_compute_robot_state-ego_median	0.07240586931055243
sim_compute_robot_state-ego_min	0.05501517182902286
sim_compute_sim_state_max	0.039789438247680664
sim_compute_sim_state_mean	0.036258994328029495
sim_compute_sim_state_median	0.037270101633938874
sim_compute_sim_state_min	0.029797692047922236
sim_physics_max	0.10482302864829264
sim_physics_mean	0.09276594900906968
sim_physics_median	0.09728237715634432
sim_physics_min	0.07106037202634309
sim_render-ego_max	0.06199698517287987
sim_render-ego_mean	0.057018139814194846
sim_render-ego_median	0.06058302792635831
sim_render-ego_min	0.04616732660092806
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20462

2590

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:28:35+00:00

2019-04-25 13:43:02+00:00

0:14:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.26265176060443496
survival_time_median	5.249999999999989
deviation-center-line_median	0.36721712006425705
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.24686350020687137
agent_compute-ego_mean	0.22666584847978344
agent_compute-ego_median	0.2299029496636721
agent_compute-ego_min	0.20195727839189417
deviation-center-line_max	0.4905420581536473
deviation-center-line_mean	0.37297207334348703
deviation-center-line_min	0.23600586352594896
deviation-heading_max	3.024656432717629
deviation-heading_mean	2.133112262108539
deviation-heading_median	2.021888747764478
deviation-heading_min	1.3608994850691836
driven_any_max	0.3217029043377684
driven_any_mean	0.2823769057834865
driven_any_median	0.29642814478930535
driven_any_min	0.18868019330860653
driven_lanedir_consec_max	0.2917648955242602
driven_lanedir_consec_mean	0.2404618212599242
driven_lanedir_consec_min	0.14824941619721543
driven_lanedir_max	0.2917648955242602
driven_lanedir_mean	0.2404618212599242
driven_lanedir_median	0.26265176060443496
driven_lanedir_min	0.14824941619721543
in-drivable-lane_max	0.14999999999999947
in-drivable-lane_mean	0.04999999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3217029043377684, "sim_physics": 0.15498623227685449, "survival_time": 6.149999999999986, "driven_lanedir": 0.26265176060443496, "sim_render-ego": 0.0602823486173056, "in-drivable-lane": 0, "agent_compute-ego": 0.21955975865930075, "deviation-heading": 3.024656432717629, "set_robot_commands": 0.08984646370740441, "deviation-center-line": 0.36721712006425705, "driven_lanedir_consec": 0.26265176060443496, "sim_compute_sim_state": 0.03531317594574719, "sim_compute_performance-ego": 0.0652253957298713, "sim_compute_robot_state-ego": 0.06953337328220771, "sim_compute_robot_state-npc0": 0.06669242013760698, "sim_compute_robot_state-npc1": 0.06689811528213625, "sim_compute_robot_state-npc2": 0.0656226747404269, "sim_compute_robot_state-npc3": 0.06512798720259007}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2850978968550731, "sim_physics": 0.14811890432150057, "survival_time": 5.04999999999999, "driven_lanedir": 0.2299492449782159, "sim_render-ego": 0.060592047058709776, "in-drivable-lane": 0, "agent_compute-ego": 0.2299029496636721, "deviation-heading": 2.86058729137075, "set_robot_commands": 0.09516412668889113, "deviation-center-line": 0.3268610441731542, "driven_lanedir_consec": 0.2299492449782159, "sim_compute_sim_state": 0.03931819802463645, "sim_compute_performance-ego": 0.06581969544439033, "sim_compute_robot_state-ego": 0.0707371707009797, "sim_compute_robot_state-npc0": 0.0683473525661053, "sim_compute_robot_state-npc1": 0.06722551997345273, "sim_compute_robot_state-npc2": 0.06668495187664976, "sim_compute_robot_state-npc3": 0.07090102563990225}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3199753896266793, "sim_physics": 0.17214866655062783, "survival_time": 5.649999999999988, "driven_lanedir": 0.2917648955242602, "sim_render-ego": 0.06447813152211958, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.24686350020687137, "deviation-heading": 1.3608994850691836, "set_robot_commands": 0.10057006684024776, "deviation-center-line": 0.4905420581536473, "driven_lanedir_consec": 0.2917648955242602, "sim_compute_sim_state": 0.041163556343686264, "sim_compute_performance-ego": 0.07583735685432906, "sim_compute_robot_state-ego": 0.08056755614491691, "sim_compute_robot_state-npc0": 0.07296320400406829, "sim_compute_robot_state-npc1": 0.07122198881301205, "sim_compute_robot_state-npc2": 0.07056714581177298, "sim_compute_robot_state-npc3": 0.0719126747772757}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.29642814478930535, "sim_physics": 0.16013688359941755, "survival_time": 5.249999999999989, "driven_lanedir": 0.26969378899549445, "sim_render-ego": 0.06604109945751371, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.23504575547717865, "deviation-heading": 1.397529353620656, "set_robot_commands": 0.09445509683518184, "deviation-center-line": 0.44423428080042776, "driven_lanedir_consec": 0.26969378899549445, "sim_compute_sim_state": 0.03933395885285877, "sim_compute_performance-ego": 0.06914712815057664, "sim_compute_robot_state-ego": 0.07652475720360166, "sim_compute_robot_state-npc0": 0.0678551469530378, "sim_compute_robot_state-npc1": 0.06842950866335915, "sim_compute_robot_state-npc2": 0.06804301398141044, "sim_compute_robot_state-npc3": 0.06935305595397949}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18868019330860653, "sim_physics": 0.12085237923790426, "survival_time": 3.399999999999996, "driven_lanedir": 0.14824941619721543, "sim_render-ego": 0.05670322039548088, "in-drivable-lane": 0, "agent_compute-ego": 0.20195727839189417, "deviation-heading": 2.021888747764478, "set_robot_commands": 0.0859628109370961, "deviation-center-line": 0.23600586352594896, "driven_lanedir_consec": 0.14824941619721543, "sim_compute_sim_state": 0.03608198726878447, "sim_compute_performance-ego": 0.06013914767433615, "sim_compute_robot_state-ego": 0.06305489469976987, "sim_compute_robot_state-npc0": 0.06663020218119901, "sim_compute_robot_state-npc1": 0.062494344571057486, "sim_compute_robot_state-npc2": 0.06427215828615077, "sim_compute_robot_state-npc3": 0.06296835927402272}}
set_robot_commands_max	0.10057006684024776
set_robot_commands_mean	0.09319971300176425
set_robot_commands_median	0.09445509683518184
set_robot_commands_min	0.0859628109370961
sim_compute_performance-ego_max	0.07583735685432906
sim_compute_performance-ego_mean	0.0672337447707007
sim_compute_performance-ego_median	0.06581969544439033
sim_compute_performance-ego_min	0.06013914767433615
sim_compute_robot_state-ego_max	0.08056755614491691
sim_compute_robot_state-ego_mean	0.07208355040629517
sim_compute_robot_state-ego_median	0.0707371707009797
sim_compute_robot_state-ego_min	0.06305489469976987
sim_compute_robot_state-npc0_max	0.07296320400406829
sim_compute_robot_state-npc0_mean	0.06849766516840347
sim_compute_robot_state-npc0_median	0.0678551469530378
sim_compute_robot_state-npc0_min	0.06663020218119901
sim_compute_robot_state-npc1_max	0.07122198881301205
sim_compute_robot_state-npc1_mean	0.06725389546060354
sim_compute_robot_state-npc1_median	0.06722551997345273
sim_compute_robot_state-npc1_min	0.062494344571057486
sim_compute_robot_state-npc2_max	0.07056714581177298
sim_compute_robot_state-npc2_mean	0.06703798893928217
sim_compute_robot_state-npc2_median	0.06668495187664976
sim_compute_robot_state-npc2_min	0.06427215828615077
sim_compute_robot_state-npc3_max	0.0719126747772757
sim_compute_robot_state-npc3_mean	0.06805262056955405
sim_compute_robot_state-npc3_median	0.06935305595397949
sim_compute_robot_state-npc3_min	0.06296835927402272
sim_compute_sim_state_max	0.041163556343686264
sim_compute_sim_state_mean	0.03824217528714263
sim_compute_sim_state_median	0.03931819802463645
sim_compute_sim_state_min	0.03531317594574719
sim_physics_max	0.17214866655062783
sim_physics_mean	0.15124861319726096
sim_physics_median	0.15498623227685449
sim_physics_min	0.12085237923790426
sim_render-ego_max	0.06604109945751371
sim_render-ego_mean	0.06161936941022591
sim_render-ego_median	0.060592047058709776
sim_render-ego_min	0.05670322039548088
simulation-passed	1
survival_time_max	6.149999999999986
survival_time_mean	5.09999999999999
survival_time_min	3.399999999999996

No reset possible

20450

2605

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:20:31+00:00

2019-04-25 13:27:53+00:00

0:07:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.08401482755487616
agent_compute-ego_mean	0.07861833630453284
agent_compute-ego_median	0.08064475612363954
agent_compute-ego_min	0.0728472222338666
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.124563593613474, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06972348376324303, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.08255583675284135, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.11158383833734611, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.04636755428816143, "sim_compute_performance-ego": 0.08006106866033454, "sim_compute_robot_state-ego": 0.0892199434732136}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.11125502379044244, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.06796846527984177, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08064475612363954, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.11014999859574912, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.04358240832453189, "sim_compute_performance-ego": 0.07799049736796945, "sim_compute_robot_state-ego": 0.08268117559128914}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.14101274447007614, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.07224583625793457, "in-drivable-lane": 0, "agent_compute-ego": 0.08401482755487616, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.13534827665849167, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.049596613103693184, "sim_compute_performance-ego": 0.08339001915671608, "sim_compute_robot_state-ego": 0.09764991023323752}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.1091376529945122, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.06354368125999367, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.0728472222338666, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.09992675466851872, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.03882104223901099, "sim_compute_performance-ego": 0.07265227967566186, "sim_compute_robot_state-ego": 0.07556410936208871}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.11287756598725612, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.06474791254316058, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.07302903885744055, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.10002321126509686, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.03981500499102534, "sim_compute_performance-ego": 0.0724416192697019, "sim_compute_robot_state-ego": 0.0768898141627409}}
set_robot_commands_max	0.13534827665849167
set_robot_commands_mean	0.1114064159050405
set_robot_commands_median	0.11014999859574912
set_robot_commands_min	0.09992675466851872
sim_compute_performance-ego_max	0.08339001915671608
sim_compute_performance-ego_mean	0.07730709682607675
sim_compute_performance-ego_median	0.07799049736796945
sim_compute_performance-ego_min	0.0724416192697019
sim_compute_robot_state-ego_max	0.09764991023323752
sim_compute_robot_state-ego_mean	0.08440099056451397
sim_compute_robot_state-ego_median	0.08268117559128914
sim_compute_robot_state-ego_min	0.07556410936208871
sim_compute_sim_state_max	0.049596613103693184
sim_compute_sim_state_mean	0.04363652458928456
sim_compute_sim_state_median	0.04358240832453189
sim_compute_sim_state_min	0.03882104223901099
sim_physics_max	0.14101274447007614
sim_physics_mean	0.11976931617115216
sim_physics_median	0.11287756598725612
sim_physics_min	0.1091376529945122
sim_render-ego_max	0.07224583625793457
sim_render-ego_mean	0.06764587582083473
sim_render-ego_median	0.06796846527984177
sim_render-ego_min	0.06354368125999367
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20441

2621

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:10:48+00:00

2019-04-25 13:19:54+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.16449003849389418
agent_compute-ego_mean	0.1586148038409824
agent_compute-ego_median	0.15968807844015268
agent_compute-ego_min	0.1497369973283065
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1628662865116911, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06804872458835817, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.16449003849389418, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10647482692070728, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04376567984527012, "sim_compute_performance-ego": 0.07714800114901561, "sim_compute_robot_state-ego": 0.08277996531072652, "sim_compute_robot_state-npc0": 0.07520825458022784, "sim_compute_robot_state-npc1": 0.07576435466982284, "sim_compute_robot_state-npc2": 0.07557547767207308, "sim_compute_robot_state-npc3": 0.07585502570530153}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.16897142850435698, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.06200602421393761, "in-drivable-lane": 0, "agent_compute-ego": 0.15968807844015268, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.10348660212296706, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.04498598208794227, "sim_compute_performance-ego": 0.07536804676055908, "sim_compute_robot_state-ego": 0.08765559013073261, "sim_compute_robot_state-npc0": 0.0746233738385714, "sim_compute_robot_state-npc1": 0.0768587039067195, "sim_compute_robot_state-npc2": 0.07707607746124268, "sim_compute_robot_state-npc3": 0.07485162294827975}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.14539971477106997, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.0599513336231834, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.1497369973283065, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.09429863252137836, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.038974382375416006, "sim_compute_performance-ego": 0.06832757121638248, "sim_compute_robot_state-ego": 0.0711954675222698, "sim_compute_robot_state-npc0": 0.06749771770678069, "sim_compute_robot_state-npc1": 0.06675474267256887, "sim_compute_robot_state-npc2": 0.0681863552645633, "sim_compute_robot_state-npc3": 0.06673802200116609}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.177387976948219, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.06688538382324992, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.16182854205747194, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.10673814785631396, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.0416635863388641, "sim_compute_performance-ego": 0.0748896628995485, "sim_compute_robot_state-ego": 0.08268797246715691, "sim_compute_robot_state-npc0": 0.07565578931494604, "sim_compute_robot_state-npc1": 0.07420876961720141, "sim_compute_robot_state-npc2": 0.07944655116600326, "sim_compute_robot_state-npc3": 0.07338446001463299}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.15758660987571435, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06100097409001103, "in-drivable-lane": 0, "agent_compute-ego": 0.15733036288508662, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.0995361186839916, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.0426896059954608, "sim_compute_performance-ego": 0.0745866475281892, "sim_compute_robot_state-ego": 0.0781979207639341, "sim_compute_robot_state-npc0": 0.07155123463383427, "sim_compute_robot_state-npc1": 0.06821510526869032, "sim_compute_robot_state-npc2": 0.07011127471923828, "sim_compute_robot_state-npc3": 0.07558053511160391}}
set_robot_commands_max	0.10673814785631396
set_robot_commands_mean	0.10210686562107166
set_robot_commands_median	0.10348660212296706
set_robot_commands_min	0.09429863252137836
sim_compute_performance-ego_max	0.07714800114901561
sim_compute_performance-ego_mean	0.07406398591073898
sim_compute_performance-ego_median	0.0748896628995485
sim_compute_performance-ego_min	0.06832757121638248
sim_compute_robot_state-ego_max	0.08765559013073261
sim_compute_robot_state-ego_mean	0.08050338323896399
sim_compute_robot_state-ego_median	0.08268797246715691
sim_compute_robot_state-ego_min	0.0711954675222698
sim_compute_robot_state-npc0_max	0.07565578931494604
sim_compute_robot_state-npc0_mean	0.07290727401487204
sim_compute_robot_state-npc0_median	0.0746233738385714
sim_compute_robot_state-npc0_min	0.06749771770678069
sim_compute_robot_state-npc1_max	0.0768587039067195
sim_compute_robot_state-npc1_mean	0.07236033522700058
sim_compute_robot_state-npc1_median	0.07420876961720141
sim_compute_robot_state-npc1_min	0.06675474267256887
sim_compute_robot_state-npc2_max	0.07944655116600326
sim_compute_robot_state-npc2_mean	0.07407914725662411
sim_compute_robot_state-npc2_median	0.07557547767207308
sim_compute_robot_state-npc2_min	0.0681863552645633
sim_compute_robot_state-npc3_max	0.07585502570530153
sim_compute_robot_state-npc3_mean	0.07328193315619685
sim_compute_robot_state-npc3_median	0.07485162294827975
sim_compute_robot_state-npc3_min	0.06673802200116609
sim_compute_sim_state_max	0.04498598208794227
sim_compute_sim_state_mean	0.042415847328590654
sim_compute_sim_state_median	0.0426896059954608
sim_compute_sim_state_min	0.038974382375416006
sim_physics_max	0.177387976948219
sim_physics_mean	0.16244240332221027
sim_physics_median	0.1628662865116911
sim_physics_min	0.14539971477106997
sim_render-ego_max	0.06804872458835817
sim_render-ego_mean	0.06357848806774803
sim_render-ego_median	0.06200602421393761
sim_render-ego_min	0.0599513336231834
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20427

2633

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:00:19+00:00

2019-04-25 13:10:06+00:00

0:09:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.17425736000663355
agent_compute-ego_mean	0.16745294450238496
agent_compute-ego_median	0.16706158541425875
agent_compute-ego_min	0.16094623671637642
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.15942503371328678, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06618073751341622, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.16533269072478674, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10851263999938963, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04278131251065236, "sim_compute_performance-ego": 0.07705336246850356, "sim_compute_robot_state-ego": 0.07961217412408793, "sim_compute_robot_state-npc0": 0.07308480424701043, "sim_compute_robot_state-npc1": 0.0761765848915532, "sim_compute_robot_state-npc2": 0.07764211690650796, "sim_compute_robot_state-npc3": 0.07823272471158009}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.17055204281440148, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.0691145475094135, "in-drivable-lane": 0, "agent_compute-ego": 0.16966684964986947, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.10981475389920747, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.0419006164257343, "sim_compute_performance-ego": 0.07912017748906063, "sim_compute_robot_state-ego": 0.08476587442251352, "sim_compute_robot_state-npc0": 0.07652767804952768, "sim_compute_robot_state-npc1": 0.07706279021043044, "sim_compute_robot_state-npc2": 0.07431989449721116, "sim_compute_robot_state-npc3": 0.07809722423553467}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.18571360801395617, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.07084334524054277, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.17425736000663355, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.10775613157372724, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.04388757128464548, "sim_compute_performance-ego": 0.0783261405794244, "sim_compute_robot_state-ego": 0.08565241412112587, "sim_compute_robot_state-npc0": 0.07905452816109908, "sim_compute_robot_state-npc1": 0.07572902503766511, "sim_compute_robot_state-npc2": 0.07664643149626882, "sim_compute_robot_state-npc3": 0.07599982462431255}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1725334004510807, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.06943563268154482, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.16706158541425875, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.10765208775484109, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.04255493079559713, "sim_compute_performance-ego": 0.07668480692030508, "sim_compute_robot_state-ego": 0.07957849623281744, "sim_compute_robot_state-npc0": 0.0756384179561953, "sim_compute_robot_state-npc1": 0.0748080845120587, "sim_compute_robot_state-npc2": 0.07552223265925541, "sim_compute_robot_state-npc3": 0.07539425016958502}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.16671811209784615, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06565724478827582, "in-drivable-lane": 0, "agent_compute-ego": 0.16094623671637642, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.10549181478994864, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.042775516156797054, "sim_compute_performance-ego": 0.07515891393025716, "sim_compute_robot_state-ego": 0.08145280237551089, "sim_compute_robot_state-npc0": 0.07533452245924208, "sim_compute_robot_state-npc1": 0.07202944932160554, "sim_compute_robot_state-npc2": 0.07648537777088306, "sim_compute_robot_state-npc3": 0.07270573686670374}}
set_robot_commands_max	0.10981475389920747
set_robot_commands_mean	0.10784548560342282
set_robot_commands_median	0.10775613157372724
set_robot_commands_min	0.10549181478994864
sim_compute_performance-ego_max	0.07912017748906063
sim_compute_performance-ego_mean	0.07726868027751016
sim_compute_performance-ego_median	0.07705336246850356
sim_compute_performance-ego_min	0.07515891393025716
sim_compute_robot_state-ego_max	0.08565241412112587
sim_compute_robot_state-ego_mean	0.08221235225521113
sim_compute_robot_state-ego_median	0.08145280237551089
sim_compute_robot_state-ego_min	0.07957849623281744
sim_compute_robot_state-npc0_max	0.07905452816109908
sim_compute_robot_state-npc0_mean	0.0759279901746149
sim_compute_robot_state-npc0_median	0.0756384179561953
sim_compute_robot_state-npc0_min	0.07308480424701043
sim_compute_robot_state-npc1_max	0.07706279021043044
sim_compute_robot_state-npc1_mean	0.0751611867946626
sim_compute_robot_state-npc1_median	0.07572902503766511
sim_compute_robot_state-npc1_min	0.07202944932160554
sim_compute_robot_state-npc2_max	0.07764211690650796
sim_compute_robot_state-npc2_mean	0.07612321066602527
sim_compute_robot_state-npc2_median	0.07648537777088306
sim_compute_robot_state-npc2_min	0.07431989449721116
sim_compute_robot_state-npc3_max	0.07823272471158009
sim_compute_robot_state-npc3_mean	0.0760859521215432
sim_compute_robot_state-npc3_median	0.07599982462431255
sim_compute_robot_state-npc3_min	0.07270573686670374
sim_compute_sim_state_max	0.04388757128464548
sim_compute_sim_state_mean	0.042779989434685264
sim_compute_sim_state_median	0.042775516156797054
sim_compute_sim_state_min	0.0419006164257343
sim_physics_max	0.18571360801395617
sim_physics_mean	0.17098843941811426
sim_physics_median	0.17055204281440148
sim_physics_min	0.15942503371328678
sim_render-ego_max	0.07084334524054277
sim_render-ego_mean	0.06824630154663862
sim_render-ego_median	0.0691145475094135
sim_render-ego_min	0.06565724478827582
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20424

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 12:59:06+00:00

2019-04-25 13:00:10+00:00

0:01:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20424-537887', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20424-537887', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20424-537887', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20414

2640

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 12:50:58+00:00

2019-04-25 12:57:25+00:00

0:06:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.07407252867143232
agent_compute-ego_mean	0.06532167769412096
agent_compute-ego_median	0.07019622759385542
agent_compute-ego_min	0.03903197928478843
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.04791142752296046, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.035377292256606255, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.03903197928478843, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.05435713968778912, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.02274663197366815, "sim_compute_performance-ego": 0.03916753279535394, "sim_compute_robot_state-ego": 0.04025113582611084}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.08776797419009001, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.05750904221465622, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.06978230199952057, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.09048517199530118, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.0385651277459186, "sim_compute_performance-ego": 0.06415618329808331, "sim_compute_robot_state-ego": 0.06995476501575415}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.09159947525371204, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.060840422456914726, "in-drivable-lane": 0, "agent_compute-ego": 0.07019622759385542, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.09665299545634876, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.04020475257526745, "sim_compute_performance-ego": 0.07117269255898216, "sim_compute_robot_state-ego": 0.08035872199318626}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.1059158084156749, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.06351339162051023, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07407252867143232, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.1015031180538974, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.04021880914876749, "sim_compute_performance-ego": 0.0743195014995533, "sim_compute_robot_state-ego": 0.07823885404146634}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.11287355422973631, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.0646131792846991, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.07352535092100805, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.10248732566833496, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.040162358965192525, "sim_compute_performance-ego": 0.07195576599666051, "sim_compute_robot_state-ego": 0.08158845804175552}}
set_robot_commands_max	0.10248732566833496
set_robot_commands_mean	0.08909715017233429
set_robot_commands_median	0.09665299545634876
set_robot_commands_min	0.05435713968778912
sim_compute_performance-ego_max	0.0743195014995533
sim_compute_performance-ego_mean	0.06415433522972665
sim_compute_performance-ego_median	0.07117269255898216
sim_compute_performance-ego_min	0.03916753279535394
sim_compute_robot_state-ego_max	0.08158845804175552
sim_compute_robot_state-ego_mean	0.07007838698365462
sim_compute_robot_state-ego_median	0.07823885404146634
sim_compute_robot_state-ego_min	0.04025113582611084
sim_compute_sim_state_max	0.04021880914876749
sim_compute_sim_state_mean	0.03637953608176285
sim_compute_sim_state_median	0.040162358965192525
sim_compute_sim_state_min	0.02274663197366815
sim_physics_max	0.11287355422973631
sim_physics_mean	0.08921364792243475
sim_physics_median	0.09159947525371204
sim_physics_min	0.04791142752296046
sim_render-ego_max	0.0646131792846991
sim_render-ego_mean	0.0563706655666773
sim_render-ego_median	0.060840422456914726
sim_render-ego_min	0.035377292256606255
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20410

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

timeout

2019-04-25 12:35:00+00:00

2019-04-25 12:50:49+00:00

0:15:49

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20396

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:14:32+00:00

2019-04-25 12:34:54+00:00

0:20:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5760711073173179
survival_time_median	13.75000000000006
deviation-center-line_median	0.47852088438429746
in-drivable-lane_median	2.500000000000023

other stats

agent_compute-ego_max	0.09709294464277184
agent_compute-ego_mean	0.0886627692406935
agent_compute-ego_median	0.0884346604347229
agent_compute-ego_min	0.0771326795916691
deviation-center-line_max	0.835114693182425
deviation-center-line_mean	0.4926331638003797
deviation-center-line_min	0.2181078993296792
deviation-heading_max	5.809829988073076
deviation-heading_mean	3.687659604955871
deviation-heading_median	4.273636616278855
deviation-heading_min	0.4990329360347692
driven_any_max	2.348280728373023
driven_any_mean	1.5918293585858414
driven_any_median	2.14076821311882
driven_any_min	0.3159003413953557
driven_lanedir_consec_max	0.9700351886287936
driven_lanedir_consec_mean	0.632280543913368
driven_lanedir_consec_min	0.3061199591569581
driven_lanedir_max	1.4005406953502515
driven_lanedir_mean	0.7908482723857589
driven_lanedir_median	0.6660332179163091
driven_lanedir_min	0.3061199591569581
in-drivable-lane_max	8.650000000000055
in-drivable-lane_mean	3.5500000000000256
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.14076821311882, "sim_physics": 0.14630012598904696, "survival_time": 13.75000000000006, "driven_lanedir": 1.4005406953502515, "sim_render-ego": 0.06885484435341575, "in-drivable-lane": 2.500000000000023, "agent_compute-ego": 0.08824125983498313, "deviation-heading": 5.809829988073076, "set_robot_commands": 0.1133558160608465, "deviation-center-line": 0.835114693182425, "driven_lanedir_consec": 0.8796057007663499, "sim_compute_sim_state": 0.04255875847556374, "sim_compute_performance-ego": 0.07695049632679332, "sim_compute_robot_state-ego": 0.0866907700625333}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8059982335469681, "sim_physics": 0.10862637903088722, "survival_time": 5.349999999999989, "driven_lanedir": 0.6115123008764822, "sim_render-ego": 0.0600114893690448, "in-drivable-lane": 0.45, "agent_compute-ego": 0.0771326795916691, "deviation-heading": 2.232259165825437, "set_robot_commands": 0.09603732991441388, "deviation-center-line": 0.47852088438429746, "driven_lanedir_consec": 0.42957076369742, "sim_compute_sim_state": 0.037682515438472, "sim_compute_performance-ego": 0.06538760773489409, "sim_compute_robot_state-ego": 0.07241991747205502}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3159003413953557, "sim_physics": 0.13348243547522504, "survival_time": 2.3, "driven_lanedir": 0.3061199591569581, "sim_render-ego": 0.06922494328540305, "in-drivable-lane": 0, "agent_compute-ego": 0.09709294464277184, "deviation-heading": 0.4990329360347692, "set_robot_commands": 0.1185701619023862, "deviation-center-line": 0.2181078993296792, "driven_lanedir_consec": 0.3061199591569581, "sim_compute_sim_state": 0.043593100879503334, "sim_compute_performance-ego": 0.0849801198295925, "sim_compute_robot_state-ego": 0.08733706888945206}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348280728373023, "sim_physics": 0.16678716977437338, "survival_time": 14.950000000000076, "driven_lanedir": 0.6660332179163091, "sim_render-ego": 0.07317475477854411, "in-drivable-lane": 8.650000000000055, "agent_compute-ego": 0.09241230169932048, "deviation-heading": 4.273636616278855, "set_robot_commands": 0.11827450354894002, "deviation-center-line": 0.3651634407421032, "driven_lanedir_consec": 0.5760711073173179, "sim_compute_sim_state": 0.04543078740437825, "sim_compute_performance-ego": 0.08114465951919556, "sim_compute_robot_state-ego": 0.09047252575556436}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3481992764950403, "sim_physics": 0.14586012840270995, "survival_time": 14.950000000000076, "driven_lanedir": 0.9700351886287936, "sim_render-ego": 0.06863526662190755, "in-drivable-lane": 6.1500000000000465, "agent_compute-ego": 0.0884346604347229, "deviation-heading": 5.623539318567221, "set_robot_commands": 0.11015954415003458, "deviation-center-line": 0.5662589013633935, "driven_lanedir_consec": 0.9700351886287936, "sim_compute_sim_state": 0.04195753812789917, "sim_compute_performance-ego": 0.07809500455856323, "sim_compute_robot_state-ego": 0.09022595405578614}}
set_robot_commands_max	0.1185701619023862
set_robot_commands_mean	0.11127947111532424
set_robot_commands_median	0.1133558160608465
set_robot_commands_min	0.09603732991441388
sim_compute_performance-ego_max	0.0849801198295925
sim_compute_performance-ego_mean	0.07731157759380773
sim_compute_performance-ego_median	0.07809500455856323
sim_compute_performance-ego_min	0.06538760773489409
sim_compute_robot_state-ego_max	0.09047252575556436
sim_compute_robot_state-ego_mean	0.08542924724707818
sim_compute_robot_state-ego_median	0.08733706888945206
sim_compute_robot_state-ego_min	0.07241991747205502
sim_compute_sim_state_max	0.04543078740437825
sim_compute_sim_state_mean	0.0422445400651633
sim_compute_sim_state_median	0.04255875847556374
sim_compute_sim_state_min	0.037682515438472
sim_physics_max	0.16678716977437338
sim_physics_mean	0.1402112477344485
sim_physics_median	0.14586012840270995
sim_physics_min	0.10862637903088722
sim_render-ego_max	0.07317475477854411
sim_render-ego_mean	0.06798025968166305
sim_render-ego_median	0.06885484435341575
sim_render-ego_min	0.0600114893690448
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.260000000000042
survival_time_min	2.3

No reset possible

20385

2677

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:00:37+00:00

2019-04-25 12:14:09+00:00

0:13:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3318997461309423
survival_time_median	5.349999999999989
deviation-center-line_median	0.24398901912403165
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.09032846008028304
agent_compute-ego_mean	0.08549675659692771
agent_compute-ego_median	0.08608131019436584
agent_compute-ego_min	0.07717811058614855
deviation-center-line_max	0.8835928746903856
deviation-center-line_mean	0.36596939513351234
deviation-center-line_min	0.1320461866841441
deviation-heading_max	6.704521131720769
deviation-heading_mean	2.5263380572523806
deviation-heading_median	1.97556525266711
deviation-heading_min	0.5038025667894459
driven_any_max	2.3479019712110554
driven_any_mean	0.9843547621877086
driven_any_median	0.7909416983721438
driven_any_min	0.34001256063147334
driven_lanedir_consec_max	0.6729291242093863
driven_lanedir_consec_mean	0.4211399301413616
driven_lanedir_consec_min	0.2226919589878392
driven_lanedir_max	1.2436173608009384
driven_lanedir_mean	0.5513500261384467
driven_lanedir_median	0.3318997461309423
driven_lanedir_min	0.2517120928289933
in-drivable-lane_max	4.150000000000044
in-drivable-lane_mean	1.7100000000000062
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7909416983721438, "sim_physics": 0.11617131545164874, "survival_time": 5.349999999999989, "driven_lanedir": 0.6729291242093863, "sim_render-ego": 0.059920244127790505, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07717811058614855, "deviation-heading": 1.97556525266711, "set_robot_commands": 0.09830115220257056, "deviation-center-line": 0.34869083228643755, "driven_lanedir_consec": 0.6729291242093863, "sim_compute_sim_state": 0.03874577762924622, "sim_compute_performance-ego": 0.06726012274483655, "sim_compute_robot_state-ego": 0.07657639556956068}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.070816237827238, "sim_physics": 0.14427772419793264, "survival_time": 6.999999999999983, "driven_lanedir": 0.2565918067219731, "sim_render-ego": 0.07274892330169677, "in-drivable-lane": 3.9499999999999895, "agent_compute-ego": 0.09032846008028304, "deviation-heading": 2.347486713727196, "set_robot_commands": 0.1140404292515346, "deviation-center-line": 0.22152806288256283, "driven_lanedir_consec": 0.2226919589878392, "sim_compute_sim_state": 0.04533330712999616, "sim_compute_performance-ego": 0.08158229078565325, "sim_compute_robot_state-ego": 0.09086052009037562}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.34001256063147334, "sim_physics": 0.13098691434276347, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3318997461309423, "sim_render-ego": 0.07038749967302595, "in-drivable-lane": 0, "agent_compute-ego": 0.08608131019436584, "deviation-heading": 0.5038025667894459, "set_robot_commands": 0.1185853286665313, "deviation-center-line": 0.24398901912403165, "driven_lanedir_consec": 0.3318997461309423, "sim_compute_sim_state": 0.046173762302009425, "sim_compute_performance-ego": 0.08046289852687291, "sim_compute_robot_state-ego": 0.0938050211692343}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3479019712110554, "sim_physics": 0.1623836350440979, "survival_time": 14.950000000000076, "driven_lanedir": 1.2436173608009384, "sim_render-ego": 0.07130579471588135, "in-drivable-lane": 4.150000000000044, "agent_compute-ego": 0.08552512009938558, "deviation-heading": 6.704521131720769, "set_robot_commands": 0.1133509357770284, "deviation-center-line": 0.8835928746903856, "driven_lanedir_consec": 0.626466728549647, "sim_compute_sim_state": 0.0454749059677124, "sim_compute_performance-ego": 0.07990721066792807, "sim_compute_robot_state-ego": 0.0908202044169108}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.37210134289663255, "sim_physics": 0.13736533218959593, "survival_time": 2.6499999999999986, "driven_lanedir": 0.2517120928289933, "sim_render-ego": 0.07308277543985618, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08837078202445552, "deviation-heading": 1.100314621357381, "set_robot_commands": 0.11672584515697552, "deviation-center-line": 0.1320461866841441, "driven_lanedir_consec": 0.2517120928289933, "sim_compute_sim_state": 0.044867848450282834, "sim_compute_performance-ego": 0.0835657389658802, "sim_compute_robot_state-ego": 0.09110869551604649}}
set_robot_commands_max	0.1185853286665313
set_robot_commands_mean	0.11220073821092806
set_robot_commands_median	0.1140404292515346
set_robot_commands_min	0.09830115220257056
sim_compute_performance-ego_max	0.0835657389658802
sim_compute_performance-ego_mean	0.0785556523382342
sim_compute_performance-ego_median	0.08046289852687291
sim_compute_performance-ego_min	0.06726012274483655
sim_compute_robot_state-ego_max	0.0938050211692343
sim_compute_robot_state-ego_mean	0.08863416735242557
sim_compute_robot_state-ego_median	0.09086052009037562
sim_compute_robot_state-ego_min	0.07657639556956068
sim_compute_sim_state_max	0.046173762302009425
sim_compute_sim_state_mean	0.044119120295849405
sim_compute_sim_state_median	0.04533330712999616
sim_compute_sim_state_min	0.03874577762924622
sim_physics_max	0.1623836350440979
sim_physics_mean	0.13823698424520775
sim_physics_median	0.13736533218959593
sim_physics_min	0.11617131545164874
sim_render-ego_max	0.07308277543985618
sim_render-ego_mean	0.06948904745165016
sim_render-ego_median	0.07130579471588135
sim_render-ego_min	0.059920244127790505
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.480000000000009
survival_time_min	2.4499999999999993

No reset possible

20376

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:56:09+00:00

2019-04-25 12:00:07+00:00

0:03:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20376-963679', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20376-963679', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20376-963679', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20334

2771

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:37:01+00:00

2019-04-25 11:56:03+00:00

0:19:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.648261399250331
survival_time_median	7.199999999999982
deviation-center-line_median	0.373746979722848
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.10206625302632648
agent_compute-ego_mean	0.09478703020832488
agent_compute-ego_median	0.09479255312018924
agent_compute-ego_min	0.08759911724778473
deviation-center-line_max	1.1380411970125934
deviation-center-line_mean	0.54991540383833
deviation-center-line_min	0.27132198146061004
deviation-heading_max	6.685945421732379
deviation-heading_mean	2.8827980895018372
deviation-heading_median	2.4249151057845273
deviation-heading_min	0.8290035765255835
driven_any_max	2.348281104172844
driven_any_mean	1.1726009264967232
driven_any_median	1.1033434452217794
driven_any_min	0.429947662106132
driven_lanedir_consec_max	1.0069324187321746
driven_lanedir_consec_mean	0.6732406197518157
driven_lanedir_consec_min	0.31237091232119996
driven_lanedir_max	1.526641835680072
driven_lanedir_mean	0.8147552797060221
driven_lanedir_median	0.648261399250331
driven_lanedir_min	0.31237091232119996
in-drivable-lane_max	3.4499999999999877
in-drivable-lane_mean	1.1999999999999995
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.429947662106132, "sim_physics": 0.12733729940945984, "survival_time": 3.049999999999997, "driven_lanedir": 0.31237091232119996, "sim_render-ego": 0.052816973357904154, "in-drivable-lane": 0, "agent_compute-ego": 0.08759911724778473, "deviation-heading": 1.6140234310281365, "set_robot_commands": 0.08394066232149719, "deviation-center-line": 0.27132198146061004, "driven_lanedir_consec": 0.31237091232119996, "sim_compute_sim_state": 0.03491215627701556, "sim_compute_performance-ego": 0.05917197368184074, "sim_compute_robot_state-ego": 0.06329206169628707, "sim_compute_robot_state-npc0": 0.0588542281604204, "sim_compute_robot_state-npc1": 0.058068666301789834, "sim_compute_robot_state-npc2": 0.06097081059315165, "sim_compute_robot_state-npc3": 0.06170605440608791}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348281104172844, "sim_physics": 0.2034830300013224, "survival_time": 14.950000000000076, "driven_lanedir": 1.526641835680072, "sim_render-ego": 0.06786892731984456, "in-drivable-lane": 2.5500000000000096, "agent_compute-ego": 0.10206625302632648, "deviation-heading": 6.685945421732379, "set_robot_commands": 0.1060835870107015, "deviation-center-line": 1.1380411970125934, "driven_lanedir_consec": 0.8190685359090404, "sim_compute_sim_state": 0.041819934050242105, "sim_compute_performance-ego": 0.07555645624796549, "sim_compute_robot_state-ego": 0.08329292217890422, "sim_compute_robot_state-npc0": 0.07444246451059977, "sim_compute_robot_state-npc1": 0.07412432273228964, "sim_compute_robot_state-npc2": 0.07446301857630412, "sim_compute_robot_state-npc3": 0.0757196307182312}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.319979572040355, "sim_physics": 0.18203661037467375, "survival_time": 8.549999999999986, "driven_lanedir": 0.579569832546333, "sim_render-ego": 0.06368549804241337, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.0995081391250878, "deviation-heading": 2.8601029124385584, "set_robot_commands": 0.10204219957541304, "deviation-center-line": 0.36276354164481395, "driven_lanedir_consec": 0.579569832546333, "sim_compute_sim_state": 0.03967268285695572, "sim_compute_performance-ego": 0.07112111961632445, "sim_compute_robot_state-ego": 0.0793722735510932, "sim_compute_robot_state-npc0": 0.07649778343780696, "sim_compute_robot_state-npc1": 0.07137061977944179, "sim_compute_robot_state-npc2": 0.0702333352719134, "sim_compute_robot_state-npc3": 0.07179439276979681}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1033434452217794, "sim_physics": 0.16551752388477323, "survival_time": 7.199999999999982, "driven_lanedir": 1.0069324187321746, "sim_render-ego": 0.059360184603267245, "in-drivable-lane": 0, "agent_compute-ego": 0.09479255312018924, "deviation-heading": 2.4249151057845273, "set_robot_commands": 0.09313048422336578, "deviation-center-line": 0.6037033193507848, "driven_lanedir_consec": 1.0069324187321746, "sim_compute_sim_state": 0.03693126473161909, "sim_compute_performance-ego": 0.06566374335024092, "sim_compute_robot_state-ego": 0.07434081037839253, "sim_compute_robot_state-npc0": 0.065367610918151, "sim_compute_robot_state-npc1": 0.06692243284649319, "sim_compute_robot_state-npc2": 0.06476926969157325, "sim_compute_robot_state-npc3": 0.06623816986878713}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6614528489425054, "sim_physics": 0.1258364018429531, "survival_time": 4.449999999999992, "driven_lanedir": 0.648261399250331, "sim_render-ego": 0.05408812640758043, "in-drivable-lane": 0, "agent_compute-ego": 0.089969088522236, "deviation-heading": 0.8290035765255835, "set_robot_commands": 0.08245329910449767, "deviation-center-line": 0.373746979722848, "driven_lanedir_consec": 0.648261399250331, "sim_compute_sim_state": 0.032964374242203956, "sim_compute_performance-ego": 0.059992222303754825, "sim_compute_robot_state-ego": 0.0650918831985988, "sim_compute_robot_state-npc0": 0.062329021732458904, "sim_compute_robot_state-npc1": 0.05985637996973616, "sim_compute_robot_state-npc2": 0.060525066397163305, "sim_compute_robot_state-npc3": 0.06233106838183457}}
set_robot_commands_max	0.1060835870107015
set_robot_commands_mean	0.09353004644709503
set_robot_commands_median	0.09313048422336578
set_robot_commands_min	0.08245329910449767
sim_compute_performance-ego_max	0.07555645624796549
sim_compute_performance-ego_mean	0.06630110304002529
sim_compute_performance-ego_median	0.06566374335024092
sim_compute_performance-ego_min	0.05917197368184074
sim_compute_robot_state-ego_max	0.08329292217890422
sim_compute_robot_state-ego_mean	0.07307799020065515
sim_compute_robot_state-ego_median	0.07434081037839253
sim_compute_robot_state-ego_min	0.06329206169628707
sim_compute_robot_state-npc0_max	0.07649778343780696
sim_compute_robot_state-npc0_mean	0.06749822175188741
sim_compute_robot_state-npc0_median	0.065367610918151
sim_compute_robot_state-npc0_min	0.0588542281604204
sim_compute_robot_state-npc1_max	0.07412432273228964
sim_compute_robot_state-npc1_mean	0.06606848432595011
sim_compute_robot_state-npc1_median	0.06692243284649319
sim_compute_robot_state-npc1_min	0.058068666301789834
sim_compute_robot_state-npc2_max	0.07446301857630412
sim_compute_robot_state-npc2_mean	0.06619230010602115
sim_compute_robot_state-npc2_median	0.06476926969157325
sim_compute_robot_state-npc2_min	0.060525066397163305
sim_compute_robot_state-npc3_max	0.0757196307182312
sim_compute_robot_state-npc3_mean	0.06755786322894752
sim_compute_robot_state-npc3_median	0.06623816986878713
sim_compute_robot_state-npc3_min	0.06170605440608791
sim_compute_sim_state_max	0.041819934050242105
sim_compute_sim_state_mean	0.03726008243160729
sim_compute_sim_state_median	0.03693126473161909
sim_compute_sim_state_min	0.032964374242203956
sim_physics_max	0.2034830300013224
sim_physics_mean	0.16084217310263646
sim_physics_median	0.16551752388477323
sim_physics_min	0.1258364018429531
sim_render-ego_max	0.06786892731984456
sim_render-ego_mean	0.05956394194620196
sim_render-ego_median	0.059360184603267245
sim_render-ego_min	0.052816973357904154
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.640000000000006
survival_time_min	3.049999999999997

No reset possible

20327

2791

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:35:15+00:00

2019-04-25 11:36:48+00:00

0:01:33

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20312

2827

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:26:15+00:00

2019-04-25 11:34:47+00:00

0:08:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15185711781183878
agent_compute-ego_mean	0.14359307413123562
agent_compute-ego_median	0.1453282267360364
agent_compute-ego_min	0.13250977710141973
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.16999787204670455, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.061947282755149984, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14867326223625327, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09599744823743712, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.038855152310065505, "sim_compute_performance-ego": 0.06624765890949177, "sim_compute_robot_state-ego": 0.06809526794361619, "sim_compute_robot_state-npc0": 0.06668241968694723, "sim_compute_robot_state-npc1": 0.06595122814178467, "sim_compute_robot_state-npc2": 0.06728590884298649, "sim_compute_robot_state-npc3": 0.06859459067290684}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.14970314502716064, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.062349518140157066, "in-drivable-lane": 0, "agent_compute-ego": 0.15185711781183878, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.0955055058002472, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.040132363637288414, "sim_compute_performance-ego": 0.06640417377154033, "sim_compute_robot_state-ego": 0.0668703019618988, "sim_compute_robot_state-npc0": 0.0698651373386383, "sim_compute_robot_state-npc1": 0.06673797965049744, "sim_compute_robot_state-npc2": 0.06765487790107727, "sim_compute_robot_state-npc3": 0.06881757577260335}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.13705851668018407, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.05253329923597433, "in-drivable-lane": 0, "agent_compute-ego": 0.13250977710141973, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.08166046465857554, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03059088577658443, "sim_compute_performance-ego": 0.0542197267887956, "sim_compute_robot_state-ego": 0.057823387242979925, "sim_compute_robot_state-npc0": 0.05645376544887737, "sim_compute_robot_state-npc1": 0.05770709555027848, "sim_compute_robot_state-npc2": 0.05467718334521277, "sim_compute_robot_state-npc3": 0.054854203078706386}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.16580456394260212, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05576912427352647, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1453282267360364, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.08886201502913135, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.0353806342108775, "sim_compute_performance-ego": 0.06509219993979244, "sim_compute_robot_state-ego": 0.06602812621553066, "sim_compute_robot_state-npc0": 0.06661431668168408, "sim_compute_robot_state-npc1": 0.06482920000108622, "sim_compute_robot_state-npc2": 0.06370474120317879, "sim_compute_robot_state-npc3": 0.06136098554578878}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.11803888082504271, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.0507108211517334, "in-drivable-lane": 0, "agent_compute-ego": 0.13959698677062987, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08388389348983764, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03249897956848145, "sim_compute_performance-ego": 0.0558245062828064, "sim_compute_robot_state-ego": 0.06139062643051148, "sim_compute_robot_state-npc0": 0.06062605381011963, "sim_compute_robot_state-npc1": 0.05749642848968506, "sim_compute_robot_state-npc2": 0.058776354789733885, "sim_compute_robot_state-npc3": 0.057214903831481936}}
set_robot_commands_max	0.09599744823743712
set_robot_commands_mean	0.08918186544304577
set_robot_commands_median	0.08886201502913135
set_robot_commands_min	0.08166046465857554
sim_compute_performance-ego_max	0.06640417377154033
sim_compute_performance-ego_mean	0.0615576531384853
sim_compute_performance-ego_median	0.06509219993979244
sim_compute_performance-ego_min	0.0542197267887956
sim_compute_robot_state-ego_max	0.06809526794361619
sim_compute_robot_state-ego_mean	0.0640415419589074
sim_compute_robot_state-ego_median	0.06602812621553066
sim_compute_robot_state-ego_min	0.057823387242979925
sim_compute_robot_state-npc0_max	0.0698651373386383
sim_compute_robot_state-npc0_mean	0.06404833859325332
sim_compute_robot_state-npc0_median	0.06661431668168408
sim_compute_robot_state-npc0_min	0.05645376544887737
sim_compute_robot_state-npc1_max	0.06673797965049744
sim_compute_robot_state-npc1_mean	0.06254438636666637
sim_compute_robot_state-npc1_median	0.06482920000108622
sim_compute_robot_state-npc1_min	0.05749642848968506
sim_compute_robot_state-npc2_max	0.06765487790107727
sim_compute_robot_state-npc2_mean	0.06241981321643784
sim_compute_robot_state-npc2_median	0.06370474120317879
sim_compute_robot_state-npc2_min	0.05467718334521277
sim_compute_robot_state-npc3_max	0.06881757577260335
sim_compute_robot_state-npc3_mean	0.06216845178029745
sim_compute_robot_state-npc3_median	0.06136098554578878
sim_compute_robot_state-npc3_min	0.054854203078706386
sim_compute_sim_state_max	0.040132363637288414
sim_compute_sim_state_mean	0.035491603100659457
sim_compute_sim_state_median	0.0353806342108775
sim_compute_sim_state_min	0.03059088577658443
sim_physics_max	0.16999787204670455
sim_physics_mean	0.14812059570433883
sim_physics_median	0.14970314502716064
sim_physics_min	0.11803888082504271
sim_render-ego_max	0.062349518140157066
sim_render-ego_mean	0.056662009111308254
sim_render-ego_median	0.05576912427352647
sim_render-ego_min	0.0507108211517334
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20304

2831

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:24:07+00:00

2019-04-25 11:24:39+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20298

2839

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:18+00:00

2019-04-25 11:23:53+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20275

2910

FANG MEIYI 🇸🇬

test

step1-simulation

success

2019-04-25 11:00:22+00:00

2019-04-25 11:23:11+00:00

0:22:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.7189765092763416
survival_time_median	14.950000000000076
deviation-center-line_median	0.5628881254066869
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17807059446970622
agent_compute-ego_mean	0.16379034228463774
agent_compute-ego_median	0.15894649346669515
agent_compute-ego_min	0.1564031211535136
deviation-center-line_max	0.7751969433433742
deviation-center-line_mean	0.5609129694875856
deviation-center-line_min	0.3224889333931096
deviation-heading_max	3.6741437948390274
deviation-heading_mean	2.312271137861082
deviation-heading_median	2.3558882559907723
deviation-heading_min	0.903770471242202
driven_any_max	3.449747152262015
driven_any_mean	2.9158882685755407
driven_any_median	3.3495345475760994
driven_any_min	1.101117758883274
driven_lanedir_consec_max	3.4111024908395264
driven_lanedir_consec_mean	2.615914403619256
driven_lanedir_consec_min	1.081892256855391
driven_lanedir_max	3.4111024908395264
driven_lanedir_mean	2.615914403619256
driven_lanedir_median	2.7189765092763416
driven_lanedir_min	1.081892256855391
in-drivable-lane_max	2.499999999999991
in-drivable-lane_mean	0.9499999999999988
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.3249317512807615, "sim_physics": 0.1385614252090454, "survival_time": 14.950000000000076, "driven_lanedir": 2.5772760590398542, "sim_render-ego": 0.07063819726308186, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.17807059446970622, "deviation-heading": 3.6741437948390274, "set_robot_commands": 0.1084702467918396, "deviation-center-line": 0.7751969433433742, "driven_lanedir_consec": 2.5772760590398542, "sim_compute_sim_state": 0.04178686539332072, "sim_compute_performance-ego": 0.07424573342005412, "sim_compute_robot_state-ego": 0.08080130179723104}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.449747152262015, "sim_physics": 0.12292796691258748, "survival_time": 14.950000000000076, "driven_lanedir": 3.4111024908395264, "sim_render-ego": 0.06028936942418416, "in-drivable-lane": 0, "agent_compute-ego": 0.15853437980016072, "deviation-heading": 1.848357623393169, "set_robot_commands": 0.09398922046025594, "deviation-center-line": 0.42570901661484234, "driven_lanedir_consec": 3.4111024908395264, "sim_compute_sim_state": 0.03801510651906331, "sim_compute_performance-ego": 0.06704029560089111, "sim_compute_robot_state-ego": 0.0719490671157837}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.3541101328755523, "sim_physics": 0.11951880534489948, "survival_time": 14.950000000000076, "driven_lanedir": 3.2903247020851656, "sim_render-ego": 0.05937216440836589, "in-drivable-lane": 0, "agent_compute-ego": 0.15894649346669515, "deviation-heading": 2.3558882559907723, "set_robot_commands": 0.09532343943913778, "deviation-center-line": 0.7182818286799152, "driven_lanedir_consec": 3.2903247020851656, "sim_compute_sim_state": 0.037594811121622725, "sim_compute_performance-ego": 0.06681871732076008, "sim_compute_robot_state-ego": 0.07077114661534627}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.101117758883274, "sim_physics": 0.1108474800887617, "survival_time": 5.14999999999999, "driven_lanedir": 1.081892256855391, "sim_render-ego": 0.06279398168174966, "in-drivable-lane": 0, "agent_compute-ego": 0.16699712253311305, "deviation-heading": 0.903770471242202, "set_robot_commands": 0.09721366873065244, "deviation-center-line": 0.3224889333931096, "driven_lanedir_consec": 1.081892256855391, "sim_compute_sim_state": 0.040434589663755544, "sim_compute_performance-ego": 0.06813705777659, "sim_compute_robot_state-ego": 0.07585959758573366}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3495345475760994, "sim_physics": 0.13508249362309774, "survival_time": 14.950000000000076, "driven_lanedir": 2.7189765092763416, "sim_render-ego": 0.062252043088277184, "in-drivable-lane": 2.2500000000000027, "agent_compute-ego": 0.1564031211535136, "deviation-heading": 2.7791955438402405, "set_robot_commands": 0.0937346887588501, "deviation-center-line": 0.5628881254066869, "driven_lanedir_consec": 2.7189765092763416, "sim_compute_sim_state": 0.038310434023539224, "sim_compute_performance-ego": 0.06940329949061076, "sim_compute_robot_state-ego": 0.07589187701543172}}
set_robot_commands_max	0.1084702467918396
set_robot_commands_mean	0.09774625283614716
set_robot_commands_median	0.09532343943913778
set_robot_commands_min	0.0937346887588501
sim_compute_performance-ego_max	0.07424573342005412
sim_compute_performance-ego_mean	0.0691290207217812
sim_compute_performance-ego_median	0.06813705777659
sim_compute_performance-ego_min	0.06681871732076008
sim_compute_robot_state-ego_max	0.08080130179723104
sim_compute_robot_state-ego_mean	0.07505459802590528
sim_compute_robot_state-ego_median	0.07585959758573366
sim_compute_robot_state-ego_min	0.07077114661534627
sim_compute_sim_state_max	0.04178686539332072
sim_compute_sim_state_mean	0.039228361344260304
sim_compute_sim_state_median	0.038310434023539224
sim_compute_sim_state_min	0.037594811121622725
sim_physics_max	0.1385614252090454
sim_physics_mean	0.1253876342356784
sim_physics_median	0.12292796691258748
sim_physics_min	0.1108474800887617
sim_render-ego_max	0.07063819726308186
sim_render-ego_mean	0.06306915117313175
sim_render-ego_median	0.062252043088277184
sim_render-ego_min	0.05937216440836589
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.99000000000006
survival_time_min	5.14999999999999

No reset possible

20267

2876

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 10:57:40+00:00

2019-04-25 11:00:06+00:00

0:02:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20267-487756', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20267-487756', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20267-487756', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20259

2893

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 10:45:34+00:00

2019-04-25 10:57:12+00:00

0:11:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.587544159189521
survival_time_median	6.549999999999985
deviation-center-line_median	0.34471102440726425
in-drivable-lane_median	1.999999999999993

other stats

agent_compute-ego_max	0.18085599419296972
agent_compute-ego_mean	0.17151471410651611
agent_compute-ego_median	0.17143448982529969
agent_compute-ego_min	0.15791539234273574
deviation-center-line_max	0.4399969902573069
deviation-center-line_mean	0.33388041286154757
deviation-center-line_min	0.1725528796585174
deviation-heading_max	2.6931530713809653
deviation-heading_mean	1.6138741063067847
deviation-heading_median	1.6237943970573814
deviation-heading_min	0.5174502357244133
driven_any_max	1.1035086460423256
driven_any_mean	0.950592735745414
driven_any_median	0.9653571861477752
driven_any_min	0.674944465775228
driven_lanedir_consec_max	0.6022015781505305
driven_lanedir_consec_mean	0.4707515490684752
driven_lanedir_consec_min	0.281016449647315
driven_lanedir_max	0.6140134246283755
driven_lanedir_mean	0.4823587953609879
driven_lanedir_median	0.587544159189521
driven_lanedir_min	0.281016449647315
in-drivable-lane_max	5.299999999999981
in-drivable-lane_mean	2.5599999999999907
in-drivable-lane_min	1.1999999999999955
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0818578722606176, "sim_physics": 0.09047644278582403, "survival_time": 6.799999999999984, "driven_lanedir": 0.587544159189521, "sim_render-ego": 0.055071348653120154, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.15791539234273574, "deviation-heading": 0.5174502357244133, "set_robot_commands": 0.08118448713246514, "deviation-center-line": 0.34471102440726425, "driven_lanedir_consec": 0.587544159189521, "sim_compute_sim_state": 0.03493000128689934, "sim_compute_performance-ego": 0.060070448061999154, "sim_compute_robot_state-ego": 0.0635165554635665}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1035086460423256, "sim_physics": 0.11687793794846692, "survival_time": 7.549999999999981, "driven_lanedir": 0.281016449647315, "sim_render-ego": 0.06206770290602122, "in-drivable-lane": 5.299999999999981, "agent_compute-ego": 0.18085599419296972, "deviation-heading": 0.726058096454902, "set_robot_commands": 0.09775824578392583, "deviation-center-line": 0.1725528796585174, "driven_lanedir_consec": 0.281016449647315, "sim_compute_sim_state": 0.03903757183757049, "sim_compute_performance-ego": 0.0717994724677888, "sim_compute_robot_state-ego": 0.07745762534488905}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9272955085011236, "sim_physics": 0.10569344833493231, "survival_time": 6.399999999999985, "driven_lanedir": 0.6140134246283755, "sim_render-ego": 0.058563608676195145, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.16907422989606857, "deviation-heading": 2.508914730916262, "set_robot_commands": 0.09321244992315768, "deviation-center-line": 0.4399969902573069, "driven_lanedir_consec": 0.6022015781505305, "sim_compute_sim_state": 0.03765128739178181, "sim_compute_performance-ego": 0.06701731868088245, "sim_compute_robot_state-ego": 0.07237672619521618}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9653571861477752, "sim_physics": 0.10400288705607406, "survival_time": 6.549999999999985, "driven_lanedir": 0.5893175724154798, "sim_render-ego": 0.060858042185543144, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.17143448982529969, "deviation-heading": 2.6931530713809653, "set_robot_commands": 0.09509324481469074, "deviation-center-line": 0.4051553519281236, "driven_lanedir_consec": 0.5883802140011349, "sim_compute_sim_state": 0.03904443478766288, "sim_compute_performance-ego": 0.06813121569975641, "sim_compute_robot_state-ego": 0.0713182351061406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.674944465775228, "sim_physics": 0.09712021167461687, "survival_time": 5.1999999999999895, "driven_lanedir": 0.33990237092424813, "sim_render-ego": 0.06077563533416161, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.17829346427550682, "deviation-heading": 1.6237943970573814, "set_robot_commands": 0.09727139656360333, "deviation-center-line": 0.3069858180565259, "driven_lanedir_consec": 0.2946153443538746, "sim_compute_sim_state": 0.0398593178162208, "sim_compute_performance-ego": 0.07041085224885207, "sim_compute_robot_state-ego": 0.07564557974155132}}
set_robot_commands_max	0.09775824578392583
set_robot_commands_mean	0.09290396484356854
set_robot_commands_median	0.09509324481469074
set_robot_commands_min	0.08118448713246514
sim_compute_performance-ego_max	0.0717994724677888
sim_compute_performance-ego_mean	0.06748586143185578
sim_compute_performance-ego_median	0.06813121569975641
sim_compute_performance-ego_min	0.060070448061999154
sim_compute_robot_state-ego_max	0.07745762534488905
sim_compute_robot_state-ego_mean	0.07206294437027273
sim_compute_robot_state-ego_median	0.07237672619521618
sim_compute_robot_state-ego_min	0.0635165554635665
sim_compute_sim_state_max	0.0398593178162208
sim_compute_sim_state_mean	0.03810452262402707
sim_compute_sim_state_median	0.03903757183757049
sim_compute_sim_state_min	0.03493000128689934
sim_physics_max	0.11687793794846692
sim_physics_mean	0.10283418555998285
sim_physics_median	0.10400288705607406
sim_physics_min	0.09047644278582403
sim_render-ego_max	0.06206770290602122
sim_render-ego_mean	0.05946726755100825
sim_render-ego_median	0.06077563533416161
sim_render-ego_min	0.055071348653120154
simulation-passed	1
survival_time_max	7.549999999999981
survival_time_mean	6.499999999999984
survival_time_min	5.1999999999999895

No reset possible

20251

2924

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 10:39:30+00:00

2019-04-25 10:45:10+00:00

0:05:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09248145046317946
survival_time_median	1.2000000000000004
deviation-center-line_median	0.06638680485173552
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1894371168954032
agent_compute-ego_mean	0.169127609609437
agent_compute-ego_median	0.16226476080277386
agent_compute-ego_min	0.15172937512397766
deviation-center-line_max	0.0975525231320441
deviation-center-line_mean	0.0757686494934561
deviation-center-line_min	0.059834001666195735
deviation-heading_max	0.8754745035901188
deviation-heading_mean	0.6965776273577511
deviation-heading_median	0.7681699713260494
deviation-heading_min	0.472613198210889
driven_any_max	0.2356894582793031
driven_any_mean	0.16970749476856217
driven_any_median	0.14079107735564378
driven_any_min	0.12105543851699307
driven_lanedir_consec_max	0.09789820051011856
driven_lanedir_consec_mean	0.09017606950434828
driven_lanedir_consec_min	0.07858495883472383
driven_lanedir_max	0.09789820051011856
driven_lanedir_mean	0.09017606950434828
driven_lanedir_median	0.09248145046317946
driven_lanedir_min	0.07858495883472383
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.2100000000000002
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2356894582793031, "sim_physics": 0.16301452091761998, "survival_time": 1.7500000000000009, "driven_lanedir": 0.09789820051011856, "sim_render-ego": 0.06656455993652344, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1894371168954032, "deviation-heading": 0.7681699713260494, "set_robot_commands": 0.0933152539389474, "deviation-center-line": 0.06638680485173552, "driven_lanedir_consec": 0.09789820051011856, "sim_compute_sim_state": 0.04108518191746303, "sim_compute_performance-ego": 0.07381078856331962, "sim_compute_robot_state-ego": 0.07315614564078195, "sim_compute_robot_state-npc0": 0.07153878893171038, "sim_compute_robot_state-npc1": 0.07006421089172363, "sim_compute_robot_state-npc2": 0.07065798214503698, "sim_compute_robot_state-npc3": 0.07212804385593959}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2203113267960101, "sim_physics": 0.13583482714260325, "survival_time": 1.7000000000000008, "driven_lanedir": 0.08768256999743462, "sim_render-ego": 0.05873659077812644, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16226476080277386, "deviation-heading": 0.8243960642601673, "set_robot_commands": 0.1053620927474078, "deviation-center-line": 0.059834001666195735, "driven_lanedir_consec": 0.08768256999743462, "sim_compute_sim_state": 0.03741130408118753, "sim_compute_performance-ego": 0.0634619207943187, "sim_compute_robot_state-ego": 0.06634982894448672, "sim_compute_robot_state-npc0": 0.070123272783616, "sim_compute_robot_state-npc1": 0.06421089873594396, "sim_compute_robot_state-npc2": 0.0671155242358937, "sim_compute_robot_state-npc3": 0.06494318737703211}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12105543851699307, "sim_physics": 0.14199184287678113, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09248145046317946, "sim_render-ego": 0.06392126733606512, "in-drivable-lane": 0, "agent_compute-ego": 0.159919641234658, "deviation-heading": 0.472613198210889, "set_robot_commands": 0.08757903359153053, "deviation-center-line": 0.0952072761418476, "driven_lanedir_consec": 0.09248145046317946, "sim_compute_sim_state": 0.03725046461278742, "sim_compute_performance-ego": 0.06627644192088734, "sim_compute_robot_state-ego": 0.06866681575775146, "sim_compute_robot_state-npc0": 0.05962903933091597, "sim_compute_robot_state-npc1": 0.06103332476182417, "sim_compute_robot_state-npc2": 0.06352576342496005, "sim_compute_robot_state-npc3": 0.06690353696996515}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13069017289486085, "sim_physics": 0.1538765223129936, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09423316771628489, "sim_render-ego": 0.06452536582946777, "in-drivable-lane": 0, "agent_compute-ego": 0.18228715399037235, "deviation-heading": 0.5422343994015308, "set_robot_commands": 0.09944051244984502, "deviation-center-line": 0.0975525231320441, "driven_lanedir_consec": 0.09423316771628489, "sim_compute_sim_state": 0.03703852321790612, "sim_compute_performance-ego": 0.07203474252120308, "sim_compute_robot_state-ego": 0.0803029848181683, "sim_compute_robot_state-npc0": 0.07203500167183254, "sim_compute_robot_state-npc1": 0.07199451197748599, "sim_compute_robot_state-npc2": 0.06723505517710811, "sim_compute_robot_state-npc3": 0.06698883098104726}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14079107735564378, "sim_physics": 0.12006691098213196, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07858495883472383, "sim_render-ego": 0.05787944793701172, "in-drivable-lane": 0, "agent_compute-ego": 0.15172937512397766, "deviation-heading": 0.8754745035901188, "set_robot_commands": 0.08315655589103699, "deviation-center-line": 0.05986264167545756, "driven_lanedir_consec": 0.07858495883472383, "sim_compute_sim_state": 0.03535794218381246, "sim_compute_performance-ego": 0.06300604343414307, "sim_compute_robot_state-ego": 0.06525044639905293, "sim_compute_robot_state-npc0": 0.060640970865885414, "sim_compute_robot_state-npc1": 0.06110760569572449, "sim_compute_robot_state-npc2": 0.05979328354199728, "sim_compute_robot_state-npc3": 0.06433477997779846}}
set_robot_commands_max	0.1053620927474078
set_robot_commands_mean	0.09377068972375356
set_robot_commands_median	0.0933152539389474
set_robot_commands_min	0.08315655589103699
sim_compute_performance-ego_max	0.07381078856331962
sim_compute_performance-ego_mean	0.06771798744677435
sim_compute_performance-ego_median	0.06627644192088734
sim_compute_performance-ego_min	0.06300604343414307
sim_compute_robot_state-ego_max	0.0803029848181683
sim_compute_robot_state-ego_mean	0.07074524431204827
sim_compute_robot_state-ego_median	0.06866681575775146
sim_compute_robot_state-ego_min	0.06525044639905293
sim_compute_robot_state-npc0_max	0.07203500167183254
sim_compute_robot_state-npc0_mean	0.06679341471679207
sim_compute_robot_state-npc0_median	0.070123272783616
sim_compute_robot_state-npc0_min	0.05962903933091597
sim_compute_robot_state-npc1_max	0.07199451197748599
sim_compute_robot_state-npc1_mean	0.06568211041254043
sim_compute_robot_state-npc1_median	0.06421089873594396
sim_compute_robot_state-npc1_min	0.06103332476182417
sim_compute_robot_state-npc2_max	0.07065798214503698
sim_compute_robot_state-npc2_mean	0.06566552170499922
sim_compute_robot_state-npc2_median	0.0671155242358937
sim_compute_robot_state-npc2_min	0.05979328354199728
sim_compute_robot_state-npc3_max	0.07212804385593959
sim_compute_robot_state-npc3_mean	0.06705967583235652
sim_compute_robot_state-npc3_median	0.06690353696996515
sim_compute_robot_state-npc3_min	0.06433477997779846
sim_compute_sim_state_max	0.04108518191746303
sim_compute_sim_state_mean	0.03762868320263131
sim_compute_sim_state_median	0.03725046461278742
sim_compute_sim_state_min	0.03535794218381246
sim_physics_max	0.16301452091761998
sim_physics_mean	0.14295692484642597
sim_physics_median	0.14199184287678113
sim_physics_min	0.12006691098213196
sim_render-ego_max	0.06656455993652344
sim_render-ego_mean	0.0623254463634389
sim_render-ego_median	0.06392126733606512
sim_render-ego_min	0.05787944793701172
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.3800000000000006
survival_time_min	1.1000000000000003

No reset possible

20243

2936

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 10:37:59+00:00

2019-04-25 10:38:36+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20232

2957

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:24:21+00:00

2019-04-25 10:37:51+00:00

0:13:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5241505659463743
survival_time_median	6.299999999999986
deviation-center-line_median	0.34878945781452847
in-drivable-lane_median	1.5999999999999943

other stats

agent_compute-ego_max	0.2113140764690581
agent_compute-ego_mean	0.1996317853455337
agent_compute-ego_median	0.19934202194213868
agent_compute-ego_min	0.18664197876768293
deviation-center-line_max	0.9819314040723984
deviation-center-line_mean	0.44421241034195547
deviation-center-line_min	0.23514240093594896
deviation-heading_max	2.1059918594409988
deviation-heading_mean	1.4251974305132855
deviation-heading_median	1.0752067106899137
deviation-heading_min	0.9175846448581412
driven_any_max	1.6633451550345215
driven_any_mean	0.9575333158284072
driven_any_median	0.865925608634622
driven_any_min	0.5795169090261159
driven_lanedir_consec_max	1.529554521378386
driven_lanedir_consec_mean	0.6443509718201981
driven_lanedir_consec_min	0.20949909998529392
driven_lanedir_max	1.529554521378386
driven_lanedir_mean	0.6462954739844001
driven_lanedir_median	0.525073011809337
driven_lanedir_min	0.20949909998529392
in-drivable-lane_max	2.499999999999991
in-drivable-lane_mean	1.649999999999998
in-drivable-lane_min	0.7500000000000107
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.865925608634622, "sim_physics": 0.1066178972758944, "survival_time": 6.299999999999986, "driven_lanedir": 0.525073011809337, "sim_render-ego": 0.06069819510929168, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.2113140764690581, "deviation-heading": 1.0752067106899137, "set_robot_commands": 0.09327036804623072, "deviation-center-line": 0.34878945781452847, "driven_lanedir_consec": 0.5241505659463743, "sim_compute_sim_state": 0.03862328945644318, "sim_compute_performance-ego": 0.06769822325025286, "sim_compute_robot_state-ego": 0.07412670339856829}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6633451550345215, "sim_physics": 0.1142363166809082, "survival_time": 14.950000000000076, "driven_lanedir": 1.529554521378386, "sim_render-ego": 0.058291030724843346, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.19934202194213868, "deviation-heading": 2.098567453530309, "set_robot_commands": 0.08888037125269573, "deviation-center-line": 0.9819314040723984, "driven_lanedir_consec": 1.529554521378386, "sim_compute_sim_state": 0.0364484182993571, "sim_compute_performance-ego": 0.06465751806894939, "sim_compute_robot_state-ego": 0.06984795173009237}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6326360809537855, "sim_physics": 0.08558860589873116, "survival_time": 5.299999999999989, "driven_lanedir": 0.3150639662932848, "sim_render-ego": 0.056805057345696214, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.18664197876768293, "deviation-heading": 2.1059918594409988, "set_robot_commands": 0.0848534107208252, "deviation-center-line": 0.30635039877367254, "driven_lanedir_consec": 0.3062639013352375, "sim_compute_sim_state": 0.034736390383738394, "sim_compute_performance-ego": 0.06158289369547142, "sim_compute_robot_state-ego": 0.06850263982448938}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5795169090261159, "sim_physics": 0.08985588129828959, "survival_time": 5.09999999999999, "driven_lanedir": 0.20949909998529392, "sim_render-ego": 0.05864259542203417, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.20904674483280555, "deviation-heading": 0.9175846448581412, "set_robot_commands": 0.09297529856363931, "deviation-center-line": 0.23514240093594896, "driven_lanedir_consec": 0.20949909998529392, "sim_compute_sim_state": 0.03612996316423603, "sim_compute_performance-ego": 0.06834086016112682, "sim_compute_robot_state-ego": 0.07287862955355177}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.04624282549299, "sim_physics": 0.09954764729454404, "survival_time": 8.399999999999984, "driven_lanedir": 0.6522867704556989, "sim_render-ego": 0.055477071376073925, "in-drivable-lane": 2.3999999999999977, "agent_compute-ego": 0.19181410471598304, "deviation-heading": 0.928636484047066, "set_robot_commands": 0.08371990635281518, "deviation-center-line": 0.3488483901132287, "driven_lanedir_consec": 0.6522867704556989, "sim_compute_sim_state": 0.036050062803995045, "sim_compute_performance-ego": 0.062101389680589945, "sim_compute_robot_state-ego": 0.06781911282312303}}
set_robot_commands_max	0.09327036804623072
set_robot_commands_mean	0.08873987098724123
set_robot_commands_median	0.08888037125269573
set_robot_commands_min	0.08371990635281518
sim_compute_performance-ego_max	0.06834086016112682
sim_compute_performance-ego_mean	0.0648761769712781
sim_compute_performance-ego_median	0.06465751806894939
sim_compute_performance-ego_min	0.06158289369547142
sim_compute_robot_state-ego_max	0.07412670339856829
sim_compute_robot_state-ego_mean	0.07063500746596497
sim_compute_robot_state-ego_median	0.06984795173009237
sim_compute_robot_state-ego_min	0.06781911282312303
sim_compute_sim_state_max	0.03862328945644318
sim_compute_sim_state_mean	0.03639762482155394
sim_compute_sim_state_median	0.03612996316423603
sim_compute_sim_state_min	0.034736390383738394
sim_physics_max	0.1142363166809082
sim_physics_mean	0.09916926968967348
sim_physics_median	0.09954764729454404
sim_physics_min	0.08558860589873116
sim_render-ego_max	0.06069819510929168
sim_render-ego_mean	0.05798278999558787
sim_render-ego_median	0.058291030724843346
sim_render-ego_min	0.055477071376073925
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.010000000000005
survival_time_min	5.09999999999999

No reset possible

20177

3055

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 10:01:20+00:00

2019-04-25 10:24:03+00:00

0:22:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0002899177104858097
survival_time_median	14.950000000000076
deviation-center-line_median	0.4556840711244427
in-drivable-lane_median	7.650000000000041

other stats

agent_compute-ego_max	0.14973920663197834
agent_compute-ego_mean	0.14838043006261187
agent_compute-ego_median	0.14838398138682046
agent_compute-ego_min	0.14697835763295491
deviation-center-line_max	0.56158233038212
deviation-center-line_mean	0.3843787837350768
deviation-center-line_min	0.1377857232578268
deviation-heading_max	5.954688203243268
deviation-heading_mean	5.64539335130318
deviation-heading_median	5.656741799274124
deviation-heading_min	5.366591917889959
driven_any_max	0.026994866629984765
driven_any_mean	0.025026630137878057
driven_any_median	0.025845567204834465
driven_any_min	0.0221106304422465
driven_lanedir_consec_max	0.0024792245869211804
driven_lanedir_consec_mean	-0.000226709968211658
driven_lanedir_consec_min	-0.0033655945211097382
driven_lanedir_max	0.0024792245869211804
driven_lanedir_mean	-0.000226709968211658
driven_lanedir_median	-0.0002899177104858097
driven_lanedir_min	-0.0033655945211097382
in-drivable-lane_max	7.650000000000045
in-drivable-lane_mean	7.610000000000042
in-drivable-lane_min	7.500000000000041
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026994866629984765, "sim_physics": 0.11568843603134156, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024792245869211804, "sim_render-ego": 0.05896277189254761, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.14697835763295491, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.08996734142303467, "deviation-center-line": 0.56158233038212, "driven_lanedir_consec": 0.0024792245869211804, "sim_compute_sim_state": 0.03697316646575928, "sim_compute_performance-ego": 0.06614305496215821, "sim_compute_robot_state-ego": 0.07018784761428833}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025845567204834465, "sim_physics": 0.11648271401723226, "survival_time": 14.950000000000076, "driven_lanedir": -0.0033655945211097382, "sim_render-ego": 0.06066606601079305, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.14876147190729777, "deviation-heading": 5.366591917889959, "set_robot_commands": 0.09264860153198244, "deviation-center-line": 0.1377857232578268, "driven_lanedir_consec": -0.0033655945211097382, "sim_compute_sim_state": 0.03832041740417481, "sim_compute_performance-ego": 0.06659710963567098, "sim_compute_robot_state-ego": 0.07069803555806478}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.024318396942425016, "sim_physics": 0.11790754000345866, "survival_time": 14.950000000000076, "driven_lanedir": 0.002366558833728938, "sim_render-ego": 0.061982617378234864, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.14838398138682046, "deviation-heading": 5.954688203243268, "set_robot_commands": 0.09210404713948568, "deviation-center-line": 0.483344128978024, "driven_lanedir_consec": 0.002366558833728938, "sim_compute_sim_state": 0.03797614256540934, "sim_compute_performance-ego": 0.06792338212331137, "sim_compute_robot_state-ego": 0.07466476202011109}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.0221106304422465, "sim_physics": 0.11562433004379272, "survival_time": 14.950000000000076, "driven_lanedir": -0.0023238210301128603, "sim_render-ego": 0.06251411596934, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.14973920663197834, "deviation-heading": 5.796593889452949, "set_robot_commands": 0.09312931934992472, "deviation-center-line": 0.4556840711244427, "driven_lanedir_consec": -0.0023238210301128603, "sim_compute_sim_state": 0.03773257811864217, "sim_compute_performance-ego": 0.06670258204142253, "sim_compute_robot_state-ego": 0.07140824317932129}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025863689469899528, "sim_physics": 0.12288081566492716, "survival_time": 14.950000000000076, "driven_lanedir": -0.0002899177104858097, "sim_render-ego": 0.058738762537638343, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.14803913275400798, "deviation-heading": 5.452350946655598, "set_robot_commands": 0.0911286163330078, "deviation-center-line": 0.2834976649329702, "driven_lanedir_consec": -0.0002899177104858097, "sim_compute_sim_state": 0.03721591631571452, "sim_compute_performance-ego": 0.06440160751342773, "sim_compute_robot_state-ego": 0.06898818413416545}}
set_robot_commands_max	0.09312931934992472
set_robot_commands_mean	0.09179558515548708
set_robot_commands_median	0.09210404713948568
set_robot_commands_min	0.08996734142303467
sim_compute_performance-ego_max	0.06792338212331137
sim_compute_performance-ego_mean	0.06635354725519815
sim_compute_performance-ego_median	0.06659710963567098
sim_compute_performance-ego_min	0.06440160751342773
sim_compute_robot_state-ego_max	0.07466476202011109
sim_compute_robot_state-ego_mean	0.07118941450119019
sim_compute_robot_state-ego_median	0.07069803555806478
sim_compute_robot_state-ego_min	0.06898818413416545
sim_compute_sim_state_max	0.03832041740417481
sim_compute_sim_state_mean	0.037643644173940026
sim_compute_sim_state_median	0.03773257811864217
sim_compute_sim_state_min	0.03697316646575928
sim_physics_max	0.12288081566492716
sim_physics_mean	0.11771676715215049
sim_physics_median	0.11648271401723226
sim_physics_min	0.11562433004379272
sim_render-ego_max	0.06251411596934
sim_render-ego_mean	0.06057286675771077
sim_render-ego_median	0.06066606601079305
sim_render-ego_min	0.058738762537638343
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20148

2977

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 09:45:46+00:00

2019-04-25 10:00:06+00:00

0:14:20

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20148-347940', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20148-347940', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20148-347940', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20143

2986

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:42:28+00:00

2019-04-25 09:45:33+00:00

0:03:05

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20138

2998

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:41:09+00:00

2019-04-25 09:41:41+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20132

3003

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:40:21+00:00

2019-04-25 09:40:53+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20091

2903

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 09:22:57+00:00

2019-04-25 09:39:59+00:00

0:17:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6676563372594861
survival_time_median	5.999999999999987
deviation-center-line_median	0.224079608361823
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.23482386433348365
agent_compute-ego_mean	0.21690548085273456
agent_compute-ego_median	0.22080217835737423
agent_compute-ego_min	0.19268471002578735
deviation-center-line_max	0.33108680466471013
deviation-center-line_mean	0.25270384915962313
deviation-center-line_min	0.1801132241448525
deviation-heading_max	0.9800544331976736
deviation-heading_mean	0.861670467639412
deviation-heading_median	0.8821846907947586
deviation-heading_min	0.6562404463373469
driven_any_max	1.5799469400254906
driven_any_mean	0.9964389289181452
driven_any_median	0.9946918741225416
driven_any_min	0.3744963213018415
driven_lanedir_consec_max	1.209735066342987
driven_lanedir_consec_mean	0.7750514189748949
driven_lanedir_consec_min	0.3610808445548539
driven_lanedir_max	1.209735066342987
driven_lanedir_mean	0.7750514189748949
driven_lanedir_median	0.6676563372594861
driven_lanedir_min	0.3610808445548539
in-drivable-lane_max	2.000000000000016
in-drivable-lane_mean	1.1300000000000052
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9946918741225416, "sim_physics": 0.05761929949124654, "survival_time": 5.999999999999987, "driven_lanedir": 0.6676563372594861, "sim_render-ego": 0.05252267916997274, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.19268471002578735, "deviation-heading": 0.934901527225482, "set_robot_commands": 0.07726116180419922, "deviation-center-line": 0.224079608361823, "driven_lanedir_consec": 0.6676563372594861, "sim_compute_sim_state": 0.032630346218744916, "sim_compute_performance-ego": 0.05823742548624675, "sim_compute_robot_state-ego": 0.061914728085199995, "sim_compute_robot_state-npc0": 0.057462881008783974, "sim_compute_robot_state-npc1": 0.05853104591369629, "sim_compute_robot_state-npc2": 0.05864438017209371, "sim_compute_robot_state-npc3": 0.059537603457768755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4531125694215929, "sim_physics": 0.06724741541106126, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4274191165934127, "sim_render-ego": 0.06417448356233794, "in-drivable-lane": 0, "agent_compute-ego": 0.2099792422919438, "deviation-heading": 0.9800544331976736, "set_robot_commands": 0.09071859409069193, "deviation-center-line": 0.2103291160082249, "driven_lanedir_consec": 0.4274191165934127, "sim_compute_sim_state": 0.03693738065916916, "sim_compute_performance-ego": 0.06458448541575465, "sim_compute_robot_state-ego": 0.06814208112913987, "sim_compute_robot_state-npc0": 0.06378012278984332, "sim_compute_robot_state-npc1": 0.06547477327544114, "sim_compute_robot_state-npc2": 0.06351095232470282, "sim_compute_robot_state-npc3": 0.06571911943369899}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5799469400254906, "sim_physics": 0.06828535941832843, "survival_time": 9.349999999999998, "driven_lanedir": 1.2093657301237344, "sim_render-ego": 0.06189867646936427, "in-drivable-lane": 2.000000000000016, "agent_compute-ego": 0.22623740925508387, "deviation-heading": 0.8821846907947586, "set_robot_commands": 0.09567567753919304, "deviation-center-line": 0.33108680466471013, "driven_lanedir_consec": 1.2093657301237344, "sim_compute_sim_state": 0.03868772384317164, "sim_compute_performance-ego": 0.06882480759034182, "sim_compute_robot_state-ego": 0.07441198634591333, "sim_compute_robot_state-npc0": 0.06792134907156389, "sim_compute_robot_state-npc1": 0.06961431732789718, "sim_compute_robot_state-npc2": 0.06946533121527197, "sim_compute_robot_state-npc3": 0.06915207470164579}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5799469397192594, "sim_physics": 0.06211719283445634, "survival_time": 9.349999999999998, "driven_lanedir": 1.209735066342987, "sim_render-ego": 0.060296000006364626, "in-drivable-lane": 2.000000000000016, "agent_compute-ego": 0.22080217835737423, "deviation-heading": 0.8549712406417991, "set_robot_commands": 0.0888437192070293, "deviation-center-line": 0.31791049261850524, "driven_lanedir_consec": 1.209735066342987, "sim_compute_sim_state": 0.038112905573717416, "sim_compute_performance-ego": 0.06378256828389703, "sim_compute_robot_state-ego": 0.06882390491465196, "sim_compute_robot_state-npc0": 0.0643370304515655, "sim_compute_robot_state-npc1": 0.06586158976835363, "sim_compute_robot_state-npc2": 0.06439649612508355, "sim_compute_robot_state-npc3": 0.06540728762825543}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3744963213018415, "sim_physics": 0.06852456988120566, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3610808445548539, "sim_render-ego": 0.06461830528414979, "in-drivable-lane": 0, "agent_compute-ego": 0.23482386433348365, "deviation-heading": 0.6562404463373469, "set_robot_commands": 0.0996114867074149, "deviation-center-line": 0.1801132241448525, "driven_lanedir_consec": 0.3610808445548539, "sim_compute_sim_state": 0.038589993301703006, "sim_compute_performance-ego": 0.07040960448128837, "sim_compute_robot_state-ego": 0.07009676038002481, "sim_compute_robot_state-npc0": 0.0693335046573561, "sim_compute_robot_state-npc1": 0.0708599431174142, "sim_compute_robot_state-npc2": 0.06859174066660356, "sim_compute_robot_state-npc3": 0.06710020863280004}}
set_robot_commands_max	0.0996114867074149
set_robot_commands_mean	0.09042212786970567
set_robot_commands_median	0.09071859409069193
set_robot_commands_min	0.07726116180419922
sim_compute_performance-ego_max	0.07040960448128837
sim_compute_performance-ego_mean	0.06516777825150571
sim_compute_performance-ego_median	0.06458448541575465
sim_compute_performance-ego_min	0.05823742548624675
sim_compute_robot_state-ego_max	0.07441198634591333
sim_compute_robot_state-ego_mean	0.068677892170986
sim_compute_robot_state-ego_median	0.06882390491465196
sim_compute_robot_state-ego_min	0.061914728085199995
sim_compute_robot_state-npc0_max	0.0693335046573561
sim_compute_robot_state-npc0_mean	0.06456697759582256
sim_compute_robot_state-npc0_median	0.0643370304515655
sim_compute_robot_state-npc0_min	0.057462881008783974
sim_compute_robot_state-npc1_max	0.0708599431174142
sim_compute_robot_state-npc1_mean	0.06606833388056048
sim_compute_robot_state-npc1_median	0.06586158976835363
sim_compute_robot_state-npc1_min	0.05853104591369629
sim_compute_robot_state-npc2_max	0.06946533121527197
sim_compute_robot_state-npc2_mean	0.06492178010075111
sim_compute_robot_state-npc2_median	0.06439649612508355
sim_compute_robot_state-npc2_min	0.05864438017209371
sim_compute_robot_state-npc3_max	0.06915207470164579
sim_compute_robot_state-npc3_mean	0.0653832587708338
sim_compute_robot_state-npc3_median	0.06571911943369899
sim_compute_robot_state-npc3_min	0.059537603457768755
sim_compute_sim_state_max	0.03868772384317164
sim_compute_sim_state_mean	0.03699166991930123
sim_compute_sim_state_median	0.038112905573717416
sim_compute_sim_state_min	0.032630346218744916
sim_physics_max	0.06852456988120566
sim_physics_mean	0.06475876740725964
sim_physics_median	0.06724741541106126
sim_physics_min	0.05761929949124654
sim_render-ego_max	0.06461830528414979
sim_render-ego_mean	0.060702028898437864
sim_render-ego_median	0.06189867646936427
sim_render-ego_min	0.05252267916997274
simulation-passed	1
survival_time_max	9.349999999999998
survival_time_mean	6.009999999999996
survival_time_min	2.4499999999999993

No reset possible

20075

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 09:07:11+00:00

2019-04-25 09:22:31+00:00

0:15:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.08048971155856519
agent_compute-ego_mean	0.07470518671888647
agent_compute-ego_median	0.07532408875478826
agent_compute-ego_min	0.06395067666706286
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.18610940196297385, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.06656168536706404, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.07511278174140236, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.1006098145788366, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.04159172014756636, "sim_compute_performance-ego": 0.07248461788350885, "sim_compute_robot_state-ego": 0.07566721601919695, "sim_compute_robot_state-npc0": 0.07433154637163336, "sim_compute_robot_state-npc1": 0.072793724862012, "sim_compute_robot_state-npc2": 0.07388713684949008, "sim_compute_robot_state-npc3": 0.07250761714848605}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.16874584844035487, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.06428613201264412, "in-drivable-lane": 0, "agent_compute-ego": 0.07864867487261372, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.10253194070631458, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.039342295738958546, "sim_compute_performance-ego": 0.07014191535211378, "sim_compute_robot_state-ego": 0.07461342503947596, "sim_compute_robot_state-npc0": 0.07275752867421796, "sim_compute_robot_state-npc1": 0.07380183281437043, "sim_compute_robot_state-npc2": 0.07402776902721774, "sim_compute_robot_state-npc3": 0.0728945501389042}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.23617838798685276, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.0700890967186461, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.08048971155856519, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.1087329607483343, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.0422740286969124, "sim_compute_performance-ego": 0.07722763305014753, "sim_compute_robot_state-ego": 0.08831849504024425, "sim_compute_robot_state-npc0": 0.07604219558391165, "sim_compute_robot_state-npc1": 0.07756289184516203, "sim_compute_robot_state-npc2": 0.07710631857527063, "sim_compute_robot_state-npc3": 0.07737785197318868}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.16113351269772178, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.053899082384611434, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.06395067666706286, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.08770981336894788, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.03592994338587711, "sim_compute_performance-ego": 0.06140491836949399, "sim_compute_robot_state-ego": 0.0650564193725586, "sim_compute_robot_state-npc0": 0.061247027547735915, "sim_compute_robot_state-npc1": 0.06293206214904785, "sim_compute_robot_state-npc2": 0.062402943560951635, "sim_compute_robot_state-npc3": 0.06322509113110994}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.2007659321099939, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.06728149467790631, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.07532408875478826, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.10402935827282112, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.04147049574784829, "sim_compute_performance-ego": 0.07323941378526284, "sim_compute_robot_state-ego": 0.07739454423877555, "sim_compute_robot_state-npc0": 0.0730456080235226, "sim_compute_robot_state-npc1": 0.07248098581609591, "sim_compute_robot_state-npc2": 0.07172994714387705, "sim_compute_robot_state-npc3": 0.07258617710059798}}
set_robot_commands_max	0.1087329607483343
set_robot_commands_mean	0.1007227775350509
set_robot_commands_median	0.10253194070631458
set_robot_commands_min	0.08770981336894788
sim_compute_performance-ego_max	0.07722763305014753
sim_compute_performance-ego_mean	0.07089969968810539
sim_compute_performance-ego_median	0.07248461788350885
sim_compute_performance-ego_min	0.06140491836949399
sim_compute_robot_state-ego_max	0.08831849504024425
sim_compute_robot_state-ego_mean	0.07621001994205026
sim_compute_robot_state-ego_median	0.07566721601919695
sim_compute_robot_state-ego_min	0.0650564193725586
sim_compute_robot_state-npc0_max	0.07604219558391165
sim_compute_robot_state-npc0_mean	0.0714847812402043
sim_compute_robot_state-npc0_median	0.0730456080235226
sim_compute_robot_state-npc0_min	0.061247027547735915
sim_compute_robot_state-npc1_max	0.07756289184516203
sim_compute_robot_state-npc1_mean	0.07191429949733764
sim_compute_robot_state-npc1_median	0.072793724862012
sim_compute_robot_state-npc1_min	0.06293206214904785
sim_compute_robot_state-npc2_max	0.07710631857527063
sim_compute_robot_state-npc2_mean	0.07183082303136142
sim_compute_robot_state-npc2_median	0.07388713684949008
sim_compute_robot_state-npc2_min	0.062402943560951635
sim_compute_robot_state-npc3_max	0.07737785197318868
sim_compute_robot_state-npc3_mean	0.07171825749845737
sim_compute_robot_state-npc3_median	0.07258617710059798
sim_compute_robot_state-npc3_min	0.06322509113110994
sim_compute_sim_state_max	0.0422740286969124
sim_compute_sim_state_mean	0.04012169674343254
sim_compute_sim_state_median	0.04147049574784829
sim_compute_sim_state_min	0.03592994338587711
sim_physics_max	0.23617838798685276
sim_physics_mean	0.19058661663957943
sim_physics_median	0.18610940196297385
sim_physics_min	0.16113351269772178
sim_render-ego_max	0.0700890967186461
sim_render-ego_mean	0.06442349823217439
sim_render-ego_median	0.06656168536706404
sim_render-ego_min	0.053899082384611434
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20074

2672

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 09:06:22+00:00

2019-04-25 09:06:59+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20070

2750

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 09:04:00+00:00

2019-04-25 09:05:52+00:00

0:01:52

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20067

3002

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:02:58+00:00

2019-04-25 09:03:39+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20066

2786

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 09:01:58+00:00

2019-04-25 09:02:45+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20053

2851

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 09:00:24+00:00

2019-04-25 09:01:37+00:00

0:01:13

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20041

3026

challenge-aido_LF-template-pytorch

step1-simulation

host-error

2019-04-25 08:59:25+00:00

2019-04-25 09:00:06+00:00

0:00:41

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20041-367290', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20041-367290', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20041-367290', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20016

2387

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 08:46:40+00:00

2019-04-25 08:51:59+00:00

0:05:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.15100142599759758
survival_time_median	1.3500000000000003
deviation-center-line_median	0.10233451785091469
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16946885415485927
agent_compute-ego_mean	0.14390841669184273
agent_compute-ego_median	0.13306751458541208
agent_compute-ego_min	0.12881756711889197
deviation-center-line_max	0.11848985796399043
deviation-center-line_mean	0.09750881963230432
deviation-center-line_min	0.06258955655597936
deviation-heading_max	1.0464964562529877
deviation-heading_mean	0.7329957767773433
deviation-heading_median	0.7364682898323343
deviation-heading_min	0.38667189199302143
driven_any_max	0.2352415613230655
driven_any_mean	0.2085536598544826
driven_any_median	0.21259364861824495
driven_any_min	0.15779403704083167
driven_lanedir_consec_max	0.19522302653986667
driven_lanedir_consec_mean	0.15364973804121998
driven_lanedir_consec_min	0.10811045094622918
driven_lanedir_max	0.19522302653986667
driven_lanedir_mean	0.15364973804121998
driven_lanedir_median	0.15100142599759758
driven_lanedir_min	0.10811045094622918
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.010000000000000007
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2352415613230655, "sim_physics": 0.02784810960292816, "survival_time": 1.6000000000000008, "driven_lanedir": 0.15100142599759758, "sim_render-ego": 0.05115039646625519, "in-drivable-lane": 0, "agent_compute-ego": 0.13282757252454758, "deviation-heading": 1.031272617537681, "set_robot_commands": 0.07122118771076202, "deviation-center-line": 0.10233451785091469, "driven_lanedir_consec": 0.15100142599759758, "sim_compute_sim_state": 0.03009355068206787, "sim_compute_performance-ego": 0.055277734994888306, "sim_compute_robot_state-ego": 0.05325455218553543, "sim_compute_robot_state-npc0": 0.05369732528924942, "sim_compute_robot_state-npc1": 0.053076982498168945, "sim_compute_robot_state-npc2": 0.05378077179193497, "sim_compute_robot_state-npc3": 0.056347914040088654}, "udem1-1-0": {"driven_any": 0.20910438802650771, "sim_physics": 0.039128976208823066, "survival_time": 1.4000000000000006, "driven_lanedir": 0.13159963274137043, "sim_render-ego": 0.059486721243177144, "in-drivable-lane": 0, "agent_compute-ego": 0.16946885415485927, "deviation-heading": 1.0464964562529877, "set_robot_commands": 0.0806119612285069, "deviation-center-line": 0.09139300266149024, "driven_lanedir_consec": 0.13159963274137043, "sim_compute_sim_state": 0.03554379088538034, "sim_compute_performance-ego": 0.0623428395816258, "sim_compute_robot_state-ego": 0.06648606913430351, "sim_compute_robot_state-npc0": 0.0633414558001927, "sim_compute_robot_state-npc1": 0.06495401688984462, "sim_compute_robot_state-npc2": 0.06431655372892107, "sim_compute_robot_state-npc3": 0.06050294637680054}, "udem1-2-0": {"driven_any": 0.22803466426376315, "sim_physics": 0.03673961427476671, "survival_time": 1.3500000000000003, "driven_lanedir": 0.19522302653986667, "sim_render-ego": 0.04969958022788719, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.12881756711889197, "deviation-heading": 0.38667189199302143, "set_robot_commands": 0.07525342482107657, "deviation-center-line": 0.11848985796399043, "driven_lanedir_consec": 0.19522302653986667, "sim_compute_sim_state": 0.0346816998940927, "sim_compute_performance-ego": 0.05427473562735098, "sim_compute_robot_state-ego": 0.05425197106820566, "sim_compute_robot_state-npc0": 0.05168324046664768, "sim_compute_robot_state-npc1": 0.052656209027325665, "sim_compute_robot_state-npc2": 0.05422974515844275, "sim_compute_robot_state-npc3": 0.05411156018575033}, "udem1-3-0": {"driven_any": 0.21259364861824495, "sim_physics": 0.040757726739954064, "survival_time": 1.3500000000000003, "driven_lanedir": 0.182314153981036, "sim_render-ego": 0.0615893734825982, "in-drivable-lane": 0, "agent_compute-ego": 0.15536057507550274, "deviation-heading": 0.4640696282706922, "set_robot_commands": 0.0868833065032959, "deviation-center-line": 0.11273716312914683, "driven_lanedir_consec": 0.182314153981036, "sim_compute_sim_state": 0.035982078976101346, "sim_compute_performance-ego": 0.0637035811388934, "sim_compute_robot_state-ego": 0.06835305249249493, "sim_compute_robot_state-npc0": 0.06716575445952239, "sim_compute_robot_state-npc1": 0.0663659484298141, "sim_compute_robot_state-npc2": 0.06893440529152199, "sim_compute_robot_state-npc3": 0.06618517416494864}, "udem1-4-0": {"driven_any": 0.15779403704083167, "sim_physics": 0.030281605927840523, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10811045094622918, "sim_render-ego": 0.04944975479789402, "in-drivable-lane": 0, "agent_compute-ego": 0.13306751458541208, "deviation-heading": 0.7364682898323343, "set_robot_commands": 0.07416648450105087, "deviation-center-line": 0.06258955655597936, "driven_lanedir_consec": 0.10811045094622918, "sim_compute_sim_state": 0.031281968821649964, "sim_compute_performance-ego": 0.05377820263738218, "sim_compute_robot_state-ego": 0.05680623261824898, "sim_compute_robot_state-npc0": 0.05597394445668096, "sim_compute_robot_state-npc1": 0.05234768079674762, "sim_compute_robot_state-npc2": 0.052610096724137016, "sim_compute_robot_state-npc3": 0.05362722148065981}}
set_robot_commands_max	0.0868833065032959
set_robot_commands_mean	0.07762727295293845
set_robot_commands_median	0.07525342482107657
set_robot_commands_min	0.07122118771076202
sim_compute_performance-ego_max	0.0637035811388934
sim_compute_performance-ego_mean	0.05787541879602813
sim_compute_performance-ego_median	0.055277734994888306
sim_compute_performance-ego_min	0.05377820263738218
sim_compute_robot_state-ego_max	0.06835305249249493
sim_compute_robot_state-ego_mean	0.059830375499757706
sim_compute_robot_state-ego_median	0.05680623261824898
sim_compute_robot_state-ego_min	0.05325455218553543
sim_compute_robot_state-npc0_max	0.06716575445952239
sim_compute_robot_state-npc0_mean	0.05837234409445863
sim_compute_robot_state-npc0_median	0.05597394445668096
sim_compute_robot_state-npc0_min	0.05168324046664768
sim_compute_robot_state-npc1_max	0.0663659484298141
sim_compute_robot_state-npc1_mean	0.05788016752838019
sim_compute_robot_state-npc1_median	0.053076982498168945
sim_compute_robot_state-npc1_min	0.05234768079674762
sim_compute_robot_state-npc2_max	0.06893440529152199
sim_compute_robot_state-npc2_mean	0.058774314538991554
sim_compute_robot_state-npc2_median	0.05422974515844275
sim_compute_robot_state-npc2_min	0.052610096724137016
sim_compute_robot_state-npc3_max	0.06618517416494864
sim_compute_robot_state-npc3_mean	0.0581549632496496
sim_compute_robot_state-npc3_median	0.056347914040088654
sim_compute_robot_state-npc3_min	0.05362722148065981
sim_compute_sim_state_max	0.035982078976101346
sim_compute_sim_state_mean	0.03351661785185844
sim_compute_sim_state_median	0.0346816998940927
sim_compute_sim_state_min	0.03009355068206787
sim_physics_max	0.040757726739954064
sim_physics_mean	0.0349512065508625
sim_physics_median	0.03673961427476671
sim_physics_min	0.02784810960292816
sim_render-ego_max	0.0615893734825982
sim_render-ego_mean	0.05427516524356235
sim_render-ego_median	0.05115039646625519
sim_render-ego_min	0.04944975479789402
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.3700000000000006
survival_time_min	1.1500000000000004

No reset possible

19983

2524

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:42:46+00:00

2019-04-25 08:46:01+00:00

0:03:15

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19965

2609

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:41:23+00:00

2019-04-25 08:42:13+00:00

0:00:50

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19950

2629

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:40:19+00:00

2019-04-25 08:41:06+00:00

0:00:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19934

2910

FANG MEIYI 🇸🇬

test

step1-simulation

error

2019-04-25 08:38:46+00:00

2019-04-25 08:40:02+00:00

0:01:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19916

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:37:41+00:00

2019-04-25 08:38:32+00:00

0:00:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19900

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:36:32+00:00

2019-04-25 08:37:25+00:00

0:00:53

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19886

2805

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

error

2019-04-25 08:35:19+00:00

2019-04-25 08:36:08+00:00

0:00:49

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19836

2594

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 08:23:22+00:00

2019-04-25 08:35:12+00:00

0:11:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.21977364573073865
survival_time_median	4.99999999999999
deviation-center-line_median	0.3710428986682928
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.25255269606908165
agent_compute-ego_mean	0.2165779770137597
agent_compute-ego_median	0.2301261401176453
agent_compute-ego_min	0.17893925751789963
deviation-center-line_max	0.4568249730102634
deviation-center-line_mean	0.3562828260243858
deviation-center-line_min	0.2498265468985448
deviation-heading_max	2.834929744013305
deviation-heading_mean	2.1807812287833057
deviation-heading_median	2.0290828023814647
deviation-heading_min	1.6380722438398143
driven_any_max	0.3312858289117714
driven_any_mean	0.25687783633573913
driven_any_median	0.25043537459115883
driven_any_min	0.19847685047195843
driven_lanedir_consec_max	0.27794193269183154
driven_lanedir_consec_mean	0.21543954272594515
driven_lanedir_consec_min	0.1586105693224975
driven_lanedir_max	0.27794193269183154
driven_lanedir_mean	0.21543954272594515
driven_lanedir_median	0.21977364573073865
driven_lanedir_min	0.1586105693224975
in-drivable-lane_max	0.04999999999999982
in-drivable-lane_mean	0.009999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.3312858289117714, "sim_physics": 0.04588709473609924, "survival_time": 5.999999999999987, "driven_lanedir": 0.27794193269183154, "sim_render-ego": 0.06263176202774048, "in-drivable-lane": 0, "agent_compute-ego": 0.25255269606908165, "deviation-heading": 2.834929744013305, "set_robot_commands": 0.09448443253835044, "deviation-center-line": 0.3710428986682928, "driven_lanedir_consec": 0.27794193269183154, "sim_compute_sim_state": 0.039634678761164346, "sim_compute_performance-ego": 0.06933929721514384, "sim_compute_robot_state-ego": 0.07448307077089945, "sim_compute_robot_state-npc0": 0.06785250902175903, "sim_compute_robot_state-npc1": 0.06882140040397644, "sim_compute_robot_state-npc2": 0.07051085233688355, "sim_compute_robot_state-npc3": 0.07092565894126893}, "udem1-1-0": {"driven_any": 0.2571374023393813, "sim_physics": 0.04763854783156823, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1959142176537312, "sim_render-ego": 0.06435612700451379, "in-drivable-lane": 0, "agent_compute-ego": 0.2303750350557525, "deviation-heading": 2.6929183622082538, "set_robot_commands": 0.0946333052098066, "deviation-center-line": 0.28136841176608984, "driven_lanedir_consec": 0.1959142176537312, "sim_compute_sim_state": 0.03893594358159208, "sim_compute_performance-ego": 0.06725709191684065, "sim_compute_robot_state-ego": 0.06893075745681236, "sim_compute_robot_state-npc0": 0.08136239271054323, "sim_compute_robot_state-npc1": 0.06825506824186478, "sim_compute_robot_state-npc2": 0.06690487094309139, "sim_compute_robot_state-npc3": 0.06953097211903539}, "udem1-2-0": {"driven_any": 0.24705372536442555, "sim_physics": 0.05154679298400879, "survival_time": 4.99999999999999, "driven_lanedir": 0.21977364573073865, "sim_render-ego": 0.061462206840515135, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2301261401176453, "deviation-heading": 1.70890299147369, "set_robot_commands": 0.09389485836029052, "deviation-center-line": 0.4568249730102634, "driven_lanedir_consec": 0.21977364573073865, "sim_compute_sim_state": 0.03808120012283325, "sim_compute_performance-ego": 0.06452587604522705, "sim_compute_robot_state-ego": 0.06928646802902222, "sim_compute_robot_state-npc0": 0.06658974885940552, "sim_compute_robot_state-npc1": 0.06578014135360717, "sim_compute_robot_state-npc2": 0.06542762279510499, "sim_compute_robot_state-npc3": 0.06788124322891236}, "udem1-3-0": {"driven_any": 0.25043537459115883, "sim_physics": 0.034654614948990324, "survival_time": 5.04999999999999, "driven_lanedir": 0.22495734823092683, "sim_render-ego": 0.04630292996321574, "in-drivable-lane": 0, "agent_compute-ego": 0.17893925751789963, "deviation-heading": 1.6380722438398143, "set_robot_commands": 0.0679910914732678, "deviation-center-line": 0.42235129977873825, "driven_lanedir_consec": 0.22495734823092683, "sim_compute_sim_state": 0.0282887066944991, "sim_compute_performance-ego": 0.049550422347418153, "sim_compute_robot_state-ego": 0.05249246040193161, "sim_compute_robot_state-npc0": 0.04976411621169288, "sim_compute_robot_state-npc1": 0.04975401528991095, "sim_compute_robot_state-npc2": 0.04836456374366685, "sim_compute_robot_state-npc3": 0.04916831526425806}, "udem1-4-0": {"driven_any": 0.19847685047195843, "sim_physics": 0.03687694072723389, "survival_time": 3.4999999999999956, "driven_lanedir": 0.1586105693224975, "sim_render-ego": 0.05083836487361363, "in-drivable-lane": 0, "agent_compute-ego": 0.19089675630841935, "deviation-heading": 2.0290828023814647, "set_robot_commands": 0.08283140318734306, "deviation-center-line": 0.2498265468985448, "driven_lanedir_consec": 0.1586105693224975, "sim_compute_sim_state": 0.031980797222682406, "sim_compute_performance-ego": 0.05554394040788923, "sim_compute_robot_state-ego": 0.05912928581237793, "sim_compute_robot_state-npc0": 0.05874079976763044, "sim_compute_robot_state-npc1": 0.05545289175851005, "sim_compute_robot_state-npc2": 0.05582594871520996, "sim_compute_robot_state-npc3": 0.05627452986580985}}
set_robot_commands_max	0.0946333052098066
set_robot_commands_mean	0.08676701815381169
set_robot_commands_median	0.09389485836029052
set_robot_commands_min	0.0679910914732678
sim_compute_performance-ego_max	0.06933929721514384
sim_compute_performance-ego_mean	0.061243325586503784
sim_compute_performance-ego_median	0.06452587604522705
sim_compute_performance-ego_min	0.049550422347418153
sim_compute_robot_state-ego_max	0.07448307077089945
sim_compute_robot_state-ego_mean	0.06486440849420871
sim_compute_robot_state-ego_median	0.06893075745681236
sim_compute_robot_state-ego_min	0.05249246040193161
sim_compute_robot_state-npc0_max	0.08136239271054323
sim_compute_robot_state-npc0_mean	0.06486191331420624
sim_compute_robot_state-npc0_median	0.06658974885940552
sim_compute_robot_state-npc0_min	0.04976411621169288
sim_compute_robot_state-npc1_max	0.06882140040397644
sim_compute_robot_state-npc1_mean	0.06161270340957388
sim_compute_robot_state-npc1_median	0.06578014135360717
sim_compute_robot_state-npc1_min	0.04975401528991095
sim_compute_robot_state-npc2_max	0.07051085233688355
sim_compute_robot_state-npc2_mean	0.06140677170679134
sim_compute_robot_state-npc2_median	0.06542762279510499
sim_compute_robot_state-npc2_min	0.04836456374366685
sim_compute_robot_state-npc3_max	0.07092565894126893
sim_compute_robot_state-npc3_mean	0.06275614388385692
sim_compute_robot_state-npc3_median	0.06788124322891236
sim_compute_robot_state-npc3_min	0.04916831526425806
sim_compute_sim_state_max	0.039634678761164346
sim_compute_sim_state_mean	0.035384265276554236
sim_compute_sim_state_median	0.03808120012283325
sim_compute_sim_state_min	0.0282887066944991
sim_physics_max	0.05154679298400879
sim_physics_mean	0.04332079824558009
sim_physics_median	0.04588709473609924
sim_physics_min	0.034654614948990324
sim_render-ego_max	0.06435612700451379
sim_render-ego_mean	0.057118278141919755
sim_render-ego_median	0.061462206840515135
sim_render-ego_min	0.04630292996321574
simulation-passed	1
survival_time_max	5.999999999999987
survival_time_mean	4.779999999999991
survival_time_min	3.4999999999999956

No reset possible

19819

2812

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 08:15:29+00:00

2019-04-25 08:22:54+00:00

0:07:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.630782078032722
survival_time_median	2.6499999999999986
deviation-center-line_median	0.10342694179960472
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.15639902416028476
agent_compute-ego_mean	0.13244782064804198
agent_compute-ego_median	0.13196688228183323
agent_compute-ego_min	0.11558384365505642
deviation-center-line_max	0.24274593434117447
deviation-center-line_mean	0.1423794188959262
deviation-center-line_min	0.05838775199208855
deviation-heading_max	0.9510803390140998
deviation-heading_mean	0.5404741772455786
deviation-heading_median	0.4662935751765816
deviation-heading_min	0.3138996563005005
driven_any_max	2.1937495917222662
driven_any_mean	1.101203967779493
driven_any_median	1.072953759306336
driven_any_min	0.3121624499492532
driven_lanedir_consec_max	1.8128454170816104
driven_lanedir_consec_mean	0.8194262040404128
driven_lanedir_consec_min	0.29255031695938905
driven_lanedir_max	1.8128454170816104
driven_lanedir_mean	0.8194262040404128
driven_lanedir_median	0.630782078032722
driven_lanedir_min	0.29255031695938905
in-drivable-lane_max	1.0499999999999965
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.040383067395952016, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.05263821283976237, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13196688228183323, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.08257428805033366, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.03319394588470459, "sim_compute_performance-ego": 0.05496549606323242, "sim_compute_robot_state-ego": 0.058830446667141385, "sim_compute_robot_state-npc0": 0.05774029427104526, "sim_compute_robot_state-npc1": 0.05931493971082899, "sim_compute_robot_state-npc2": 0.06016579270362854, "sim_compute_robot_state-npc3": 0.057552221748563975}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.030415270063612197, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.04825452521995262, "in-drivable-lane": 0, "agent_compute-ego": 0.11558384365505642, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.06779331631130642, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.029181754147564923, "sim_compute_performance-ego": 0.050809771926314744, "sim_compute_robot_state-ego": 0.051988831272831666, "sim_compute_robot_state-npc0": 0.05311143839800799, "sim_compute_robot_state-npc1": 0.05113688221684209, "sim_compute_robot_state-npc2": 0.05143673331649215, "sim_compute_robot_state-npc3": 0.05151023688139739}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.034621690083475945, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.04830586331561931, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11640080664921731, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.07227703437064457, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.029094084952641455, "sim_compute_performance-ego": 0.05212122954211189, "sim_compute_robot_state-ego": 0.053291603199486594, "sim_compute_robot_state-npc0": 0.0527906024340287, "sim_compute_robot_state-npc1": 0.051820965646540075, "sim_compute_robot_state-npc2": 0.0513753705811732, "sim_compute_robot_state-npc3": 0.05046040803483389}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.0417060672112231, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.05530799559827121, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.1418885464938182, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.08706870169009802, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.035794761945616524, "sim_compute_performance-ego": 0.06387245430136626, "sim_compute_robot_state-ego": 0.06397855956599398, "sim_compute_robot_state-npc0": 0.06251594255555351, "sim_compute_robot_state-npc1": 0.0661196213848186, "sim_compute_robot_state-npc2": 0.06615802926837273, "sim_compute_robot_state-npc3": 0.06365049560115023}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.04220838295786005, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.06290086946989361, "in-drivable-lane": 0, "agent_compute-ego": 0.15639902416028476, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.09716109225624486, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.03872491184033846, "sim_compute_performance-ego": 0.07005881008348967, "sim_compute_robot_state-ego": 0.07221981098777369, "sim_compute_robot_state-npc0": 0.0722806830155222, "sim_compute_robot_state-npc1": 0.07139183345593904, "sim_compute_robot_state-npc2": 0.07292167763960988, "sim_compute_robot_state-npc3": 0.07300468495017604}}
set_robot_commands_max	0.09716109225624486
set_robot_commands_mean	0.08137488653572551
set_robot_commands_median	0.08257428805033366
set_robot_commands_min	0.06779331631130642
sim_compute_performance-ego_max	0.07005881008348967
sim_compute_performance-ego_mean	0.058365552383303
sim_compute_performance-ego_median	0.05496549606323242
sim_compute_performance-ego_min	0.050809771926314744
sim_compute_robot_state-ego_max	0.07221981098777369
sim_compute_robot_state-ego_mean	0.06006185033864546
sim_compute_robot_state-ego_median	0.058830446667141385
sim_compute_robot_state-ego_min	0.051988831272831666
sim_compute_robot_state-npc0_max	0.0722806830155222
sim_compute_robot_state-npc0_mean	0.05968779213483153
sim_compute_robot_state-npc0_median	0.05774029427104526
sim_compute_robot_state-npc0_min	0.0527906024340287
sim_compute_robot_state-npc1_max	0.07139183345593904
sim_compute_robot_state-npc1_mean	0.05995684848299375
sim_compute_robot_state-npc1_median	0.05931493971082899
sim_compute_robot_state-npc1_min	0.05113688221684209
sim_compute_robot_state-npc2_max	0.07292167763960988
sim_compute_robot_state-npc2_mean	0.060411520701855306
sim_compute_robot_state-npc2_median	0.06016579270362854
sim_compute_robot_state-npc2_min	0.0513753705811732
sim_compute_robot_state-npc3_max	0.07300468495017604
sim_compute_robot_state-npc3_mean	0.0592356094432243
sim_compute_robot_state-npc3_median	0.057552221748563975
sim_compute_robot_state-npc3_min	0.05046040803483389
sim_compute_sim_state_max	0.03872491184033846
sim_compute_sim_state_mean	0.03319789175417319
sim_compute_sim_state_median	0.03319394588470459
sim_compute_sim_state_min	0.029094084952641455
sim_physics_max	0.04220838295786005
sim_physics_mean	0.03786689554242466
sim_physics_median	0.040383067395952016
sim_physics_min	0.030415270063612197
sim_render-ego_max	0.06290086946989361
sim_render-ego_mean	0.05348149328869982
sim_render-ego_median	0.05263821283976237
sim_render-ego_min	0.04825452521995262
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.739999999999997
survival_time_min	0.9500000000000004

No reset possible

19816

2851

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:14:40+00:00

2019-04-25 08:15:14+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19781

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 08:00:20+00:00

2019-04-25 08:14:32+00:00

0:14:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.16456432257935205
survival_time_median	3.4999999999999956
deviation-center-line_median	0.19254695728088783
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.09091710249582928
agent_compute-ego_mean	0.08648597803569975
agent_compute-ego_median	0.08603269713265556
agent_compute-ego_min	0.08396871089935302
deviation-center-line_max	1.1590037613748574
deviation-center-line_mean	0.3760895638335095
deviation-center-line_min	0.06669514875348738
deviation-heading_max	4.64946189462297
deviation-heading_mean	1.5992128829154102
deviation-heading_median	0.8213320499346134
deviation-heading_min	0.5194501218928118
driven_any_max	2.355551226904378
driven_any_mean	0.7832493660673346
driven_any_median	0.5154588620729132
driven_any_min	0.1940131181720098
driven_lanedir_consec_max	1.465781528336555
driven_lanedir_consec_mean	0.46974377415901447
driven_lanedir_consec_min	0.11080263714089256
driven_lanedir_max	2.010452469899344
driven_lanedir_mean	0.5802655962072618
driven_lanedir_median	0.1701274714956329
driven_lanedir_min	0.11080263714089256
in-drivable-lane_max	2.149999999999994
in-drivable-lane_mean	0.7500000000000011
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6170866015810761, "sim_physics": 0.051237333388555614, "survival_time": 4.199999999999993, "driven_lanedir": 0.1701274714956329, "sim_render-ego": 0.06490030742826916, "in-drivable-lane": 2.149999999999994, "agent_compute-ego": 0.08753225065412976, "deviation-heading": 1.278768684158225, "set_robot_commands": 0.10792171955108644, "deviation-center-line": 0.19254695728088783, "driven_lanedir_consec": 0.1621893028171848, "sim_compute_sim_state": 0.03867253235408238, "sim_compute_performance-ego": 0.06951070967174712, "sim_compute_robot_state-ego": 0.07319899400075276, "sim_compute_robot_state-npc0": 0.07161037694840204, "sim_compute_robot_state-npc1": 0.0709579104468936, "sim_compute_robot_state-npc2": 0.06910644258771624, "sim_compute_robot_state-npc3": 0.0686018637248448}, "udem1-1-0": {"driven_any": 0.2341370216062963, "sim_physics": 0.04404399054391043, "survival_time": 1.7500000000000009, "driven_lanedir": 0.11080263714089256, "sim_render-ego": 0.06395189421517508, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.08603269713265556, "deviation-heading": 0.8213320499346134, "set_robot_commands": 0.11214685440063477, "deviation-center-line": 0.06669514875348738, "driven_lanedir_consec": 0.11080263714089256, "sim_compute_sim_state": 0.03720347540719168, "sim_compute_performance-ego": 0.06320887974330357, "sim_compute_robot_state-ego": 0.07104904311043876, "sim_compute_robot_state-npc0": 0.07428437641688755, "sim_compute_robot_state-npc1": 0.07038201604570661, "sim_compute_robot_state-npc2": 0.06917862210954939, "sim_compute_robot_state-npc3": 0.0691234929221017}, "udem1-2-0": {"driven_any": 0.5154588620729132, "sim_physics": 0.055943659373692105, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4453810799210878, "sim_render-ego": 0.06423875263759068, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08396871089935302, "deviation-heading": 0.7270516639684298, "set_robot_commands": 0.10051032815660749, "deviation-center-line": 0.33874939218893935, "driven_lanedir_consec": 0.4453810799210878, "sim_compute_sim_state": 0.03954570634024484, "sim_compute_performance-ego": 0.06810754367283413, "sim_compute_robot_state-ego": 0.07424933910369873, "sim_compute_robot_state-npc0": 0.07019033091408866, "sim_compute_robot_state-npc1": 0.07204538413456509, "sim_compute_robot_state-npc2": 0.07140262467520578, "sim_compute_robot_state-npc3": 0.0725243023463658}, "udem1-3-0": {"driven_any": 0.1940131181720098, "sim_physics": 0.052828288078308104, "survival_time": 1.5000000000000009, "driven_lanedir": 0.16456432257935205, "sim_render-ego": 0.06713438828786214, "in-drivable-lane": 0, "agent_compute-ego": 0.09091710249582928, "deviation-heading": 0.5194501218928118, "set_robot_commands": 0.1131089448928833, "deviation-center-line": 0.12345255956937576, "driven_lanedir_consec": 0.16456432257935205, "sim_compute_sim_state": 0.04154788653055827, "sim_compute_performance-ego": 0.07610975901285807, "sim_compute_robot_state-ego": 0.08570928573608398, "sim_compute_robot_state-npc0": 0.07882089614868164, "sim_compute_robot_state-npc1": 0.0757248560587565, "sim_compute_robot_state-npc2": 0.07876023451487223, "sim_compute_robot_state-npc3": 0.07504359086354574}, "udem1-4-0": {"driven_any": 2.355551226904378, "sim_physics": 0.04305157820383708, "survival_time": 14.950000000000076, "driven_lanedir": 2.010452469899344, "sim_render-ego": 0.06290421644846599, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.08397912899653116, "deviation-heading": 4.64946189462297, "set_robot_commands": 0.10089179197947185, "deviation-center-line": 1.1590037613748574, "driven_lanedir_consec": 1.465781528336555, "sim_compute_sim_state": 0.039910662174224856, "sim_compute_performance-ego": 0.06893133958180746, "sim_compute_robot_state-ego": 0.07290510416030883, "sim_compute_robot_state-npc0": 0.07110686063766479, "sim_compute_robot_state-npc1": 0.07001871744791667, "sim_compute_robot_state-npc2": 0.06964652220408121, "sim_compute_robot_state-npc3": 0.06834799925486247}}
set_robot_commands_max	0.1131089448928833
set_robot_commands_mean	0.10691592779613676
set_robot_commands_median	0.10792171955108644
set_robot_commands_min	0.10051032815660749
sim_compute_performance-ego_max	0.07610975901285807
sim_compute_performance-ego_mean	0.06917364633651008
sim_compute_performance-ego_median	0.06893133958180746
sim_compute_performance-ego_min	0.06320887974330357
sim_compute_robot_state-ego_max	0.08570928573608398
sim_compute_robot_state-ego_mean	0.07542235322225661
sim_compute_robot_state-ego_median	0.07319899400075276
sim_compute_robot_state-ego_min	0.07104904311043876
sim_compute_robot_state-npc0_max	0.07882089614868164
sim_compute_robot_state-npc0_mean	0.07320256821314494
sim_compute_robot_state-npc0_median	0.07161037694840204
sim_compute_robot_state-npc0_min	0.07019033091408866
sim_compute_robot_state-npc1_max	0.0757248560587565
sim_compute_robot_state-npc1_mean	0.07182577682676769
sim_compute_robot_state-npc1_median	0.0709579104468936
sim_compute_robot_state-npc1_min	0.07001871744791667
sim_compute_robot_state-npc2_max	0.07876023451487223
sim_compute_robot_state-npc2_mean	0.07161888921828496
sim_compute_robot_state-npc2_median	0.06964652220408121
sim_compute_robot_state-npc2_min	0.06910644258771624
sim_compute_robot_state-npc3_max	0.07504359086354574
sim_compute_robot_state-npc3_mean	0.07072824982234409
sim_compute_robot_state-npc3_median	0.0691234929221017
sim_compute_robot_state-npc3_min	0.06834799925486247
sim_compute_sim_state_max	0.04154788653055827
sim_compute_sim_state_mean	0.03937605256126041
sim_compute_sim_state_median	0.03954570634024484
sim_compute_sim_state_min	0.03720347540719168
sim_physics_max	0.055943659373692105
sim_physics_mean	0.04942096991766067
sim_physics_median	0.051237333388555614
sim_physics_min	0.04305157820383708
sim_render-ego_max	0.06713438828786214
sim_render-ego_mean	0.06462591180347262
sim_render-ego_median	0.06423875263759068
sim_render-ego_min	0.06290421644846599
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.180000000000013
survival_time_min	1.5000000000000009

No reset possible

19757

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 07:46:40+00:00

2019-04-25 08:00:04+00:00

0:13:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19757-275266', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19757-275266', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19757-275266', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19736

3047

challenge-aido_LF-template-tensorflow

step1-simulation

error