Submission 15499

Submission

15499

Competing

yes

Challenge

aido-LFV_multi_full-sim-validation

User

Alessandro Zanardi 🇨🇭

Date submitted

2021-05-19 12:49:20+00:00

Last status update

2021-12-04 20:48:04+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 91534 sim-1of4: 91533 sim-2of4: 91535 sim-3of4: 91538

User label

minimal-agent-full

Admin priority

Blessing

n/a

User priority

91538

Click the images to see detailed statistics about the episode.

LFV_multi-full-small_loop-000

91535

Click the images to see detailed statistics about the episode.

LFV_multi-full-zigzag-000

91534

Click the images to see detailed statistics about the episode.

LFV_multi-full-loop-000

91533

Click the images to see detailed statistics about the episode.

LFV_multi-full-techtrack-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

91538

sim-3of4

success

yes

2021-10-22 16:57:00+00:00

2021-10-22 17:03:28+00:00

0:06:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	29.05000000000028
in-drivable-lane_median	25.27500000000026
driven_lanedir_consec_median	0.2611157652053312
deviation-center-line_median	0.28769253392854743

other stats

agent_compute-ego0_max	0.014154267884611674
agent_compute-ego0_mean	0.014154267884611674
agent_compute-ego0_median	0.014154267884611674
agent_compute-ego0_min	0.014154267884611674
agent_compute-ego1_max	0.014628231320594183
agent_compute-ego1_mean	0.014628231320594183
agent_compute-ego1_median	0.014628231320594183
agent_compute-ego1_min	0.014628231320594183
complete-iteration_max	0.2236748597875903
complete-iteration_mean	0.2236748597875903
complete-iteration_median	0.2236748597875903
complete-iteration_min	0.2236748597875903
deviation-center-line_max	0.3769100738070137
deviation-center-line_mean	0.28769253392854743
deviation-center-line_min	0.1984749940500812
deviation-heading_max	4.075080540261315
deviation-heading_mean	2.688100819745608
deviation-heading_median	2.688100819745608
deviation-heading_min	1.3011210992299012
distance-from-start_max	1.4448941295785172
distance-from-start_mean	1.0530381721612738
distance-from-start_median	1.0530381721612738
distance-from-start_min	0.6611822147440306
driven_any_max	3.490611603741896
driven_any_mean	2.089675934502924
driven_any_median	2.089675934502924
driven_any_min	0.6887402652639523
driven_lanedir_consec_max	0.3343198169726864
driven_lanedir_consec_mean	0.2611157652053312
driven_lanedir_consec_min	0.18791171343797597
driven_lanedir_max	0.3343198169726864
driven_lanedir_mean	0.2817629957635712
driven_lanedir_median	0.2817629957635712
driven_lanedir_min	0.229206174554456
get_duckie_state_max	1.1281868846146102e-06
get_duckie_state_mean	1.1281868846146102e-06
get_duckie_state_median	1.1281868846146102e-06
get_duckie_state_min	1.1281868846146102e-06
get_robot_state_max	0.006685336840521429
get_robot_state_mean	0.006685336840521429
get_robot_state_median	0.006685336840521429
get_robot_state_min	0.006685336840521429
get_state_dump_max	0.005731914870927424
get_state_dump_mean	0.005731914870927424
get_state_dump_median	0.005731914870927424
get_state_dump_min	0.005731914870927424
get_ui_image_max	0.04248106274817817
get_ui_image_mean	0.04248106274817817
get_ui_image_median	0.04248106274817817
get_ui_image_min	0.04248106274817817
in-drivable-lane_max	25.75000000000028
in-drivable-lane_mean	25.27500000000026
in-drivable-lane_min	24.80000000000024
per-episodes	details {"LFV_multi-full-small_loop-000-ego0": {"driven_any": 0.6887402652639523, "get_ui_image": 0.04248106274817817, "step_physics": 0.118926148644018, "survival_time": 29.05000000000028, "driven_lanedir": 0.3343198169726864, "get_state_dump": 0.005731914870927424, "get_robot_state": 0.006685336840521429, "sim_render-ego0": 0.003454270231764751, "sim_render-ego1": 0.0035626408980064784, "get_duckie_state": 1.1281868846146102e-06, "in-drivable-lane": 25.75000000000028, "deviation-heading": 1.3011210992299012, "agent_compute-ego0": 0.014154267884611674, "agent_compute-ego1": 0.014628231320594183, "complete-iteration": 0.2236748597875903, "set_robot_commands": 0.002016078565538544, "distance-from-start": 0.6611822147440306, "deviation-center-line": 0.1984749940500812, "driven_lanedir_consec": 0.3343198169726864, "sim_compute_sim_state": 0.006324582083528394, "sim_compute_performance-ego0": 0.0017610046871748986, "sim_compute_performance-ego1": 0.0016989773491403902}, "LFV_multi-full-small_loop-000-ego1": {"driven_any": 3.490611603741896, "get_ui_image": 0.04248106274817817, "step_physics": 0.118926148644018, "survival_time": 29.05000000000028, "driven_lanedir": 0.229206174554456, "get_state_dump": 0.005731914870927424, "get_robot_state": 0.006685336840521429, "sim_render-ego0": 0.003454270231764751, "sim_render-ego1": 0.0035626408980064784, "get_duckie_state": 1.1281868846146102e-06, "in-drivable-lane": 24.80000000000024, "deviation-heading": 4.075080540261315, "agent_compute-ego0": 0.014154267884611674, "agent_compute-ego1": 0.014628231320594183, "complete-iteration": 0.2236748597875903, "set_robot_commands": 0.002016078565538544, "distance-from-start": 1.4448941295785172, "deviation-center-line": 0.3769100738070137, "driven_lanedir_consec": 0.18791171343797597, "sim_compute_sim_state": 0.006324582083528394, "sim_compute_performance-ego0": 0.0017610046871748986, "sim_compute_performance-ego1": 0.0016989773491403902}}
set_robot_commands_max	0.002016078565538544
set_robot_commands_mean	0.002016078565538544
set_robot_commands_median	0.002016078565538544
set_robot_commands_min	0.002016078565538544
sim_compute_performance-ego0_max	0.0017610046871748986
sim_compute_performance-ego0_mean	0.0017610046871748986
sim_compute_performance-ego0_median	0.0017610046871748986
sim_compute_performance-ego0_min	0.0017610046871748986
sim_compute_performance-ego1_max	0.0016989773491403902
sim_compute_performance-ego1_mean	0.0016989773491403902
sim_compute_performance-ego1_median	0.0016989773491403902
sim_compute_performance-ego1_min	0.0016989773491403902
sim_compute_sim_state_max	0.006324582083528394
sim_compute_sim_state_mean	0.006324582083528394
sim_compute_sim_state_median	0.006324582083528394
sim_compute_sim_state_min	0.006324582083528394
sim_render-ego0_max	0.003454270231764751
sim_render-ego0_mean	0.003454270231764751
sim_render-ego0_median	0.003454270231764751
sim_render-ego0_min	0.003454270231764751
sim_render-ego1_max	0.0035626408980064784
sim_render-ego1_mean	0.0035626408980064784
sim_render-ego1_median	0.0035626408980064784
sim_render-ego1_min	0.0035626408980064784
simulation-passed	1
step_physics_max	0.118926148644018
step_physics_mean	0.118926148644018
step_physics_median	0.118926148644018
step_physics_min	0.118926148644018
survival_time_max	29.05000000000028
survival_time_mean	29.05000000000028
survival_time_min	29.05000000000028

No reset possible

91535

sim-2of4

success

yes

2021-10-22 16:51:14+00:00

2021-10-22 17:17:17+00:00

0:26:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	57.374999999998735
driven_lanedir_consec_median	0.2168275036419739
deviation-center-line_median	0.16756432583595293

other stats

agent_compute-ego0_max	0.02735688267500573
agent_compute-ego0_mean	0.02735688267500573
agent_compute-ego0_median	0.02735688267500573
agent_compute-ego0_min	0.02735688267500573
agent_compute-ego1_max	0.026993811874961377
agent_compute-ego1_mean	0.026993811874961377
agent_compute-ego1_median	0.026993811874961377
agent_compute-ego1_min	0.026993811874961377
agent_compute-ego2_max	0.02694833745170295
agent_compute-ego2_mean	0.02694833745170295
agent_compute-ego2_median	0.02694833745170295
agent_compute-ego2_min	0.02694833745170295
agent_compute-ego3_max	0.02987411139311143
agent_compute-ego3_mean	0.02987411139311143
agent_compute-ego3_median	0.02987411139311143
agent_compute-ego3_min	0.02987411139311143
complete-iteration_max	0.4729847040501959
complete-iteration_mean	0.4729847040501959
complete-iteration_median	0.4729847040501959
complete-iteration_min	0.4729847040501959
deviation-center-line_max	0.931970140776458
deviation-center-line_mean	0.35098953070911487
deviation-center-line_min	0.1368593303880955
deviation-heading_max	11.060775760364317
deviation-heading_mean	3.6809043570064017
deviation-heading_median	1.4847740661255802
deviation-heading_min	0.6932935354101288
distance-from-start_max	1.398778266079122
distance-from-start_mean	0.8718895281993915
distance-from-start_median	0.8369265204839986
distance-from-start_min	0.4149268057504466
driven_any_max	7.431909174519991
driven_any_mean	2.422786479100203
driven_any_median	0.9128894473669764
driven_any_min	0.4334578471468685
driven_lanedir_consec_max	0.5601796688733538
driven_lanedir_consec_mean	0.2818702877418576
driven_lanedir_consec_min	0.1336464748101287
driven_lanedir_max	0.5801835149677443
driven_lanedir_mean	0.2868712492654552
driven_lanedir_median	0.2168275036419739
driven_lanedir_min	0.1336464748101287
get_duckie_state_max	2.206314811103052e-06
get_duckie_state_mean	2.206314811103052e-06
get_duckie_state_median	2.206314811103052e-06
get_duckie_state_min	2.206314811103052e-06
get_robot_state_max	0.01350445850604182
get_robot_state_mean	0.01350445850604182
get_robot_state_median	0.01350445850604182
get_robot_state_min	0.01350445850604182
get_state_dump_max	0.008761511158685105
get_state_dump_mean	0.008761511158685105
get_state_dump_median	0.008761511158685105
get_state_dump_min	0.008761511158685105
get_ui_image_max	0.05939414757276753
get_ui_image_mean	0.05939414757276753
get_ui_image_median	0.05939414757276753
get_ui_image_min	0.05939414757276753
in-drivable-lane_max	58.44999999999872
in-drivable-lane_mean	55.6749999999988
in-drivable-lane_min	49.49999999999901
per-episodes	details {"LFV_multi-full-zigzag-000-ego0": {"driven_any": 1.205529222266862, "get_ui_image": 0.05939414757276753, "step_physics": 0.2324681301895129, "survival_time": 59.99999999999873, "driven_lanedir": 0.16925123326613734, "get_state_dump": 0.008761511158685105, "get_robot_state": 0.01350445850604182, "sim_render-ego0": 0.003434905005335113, "sim_render-ego1": 0.003820898729398983, "sim_render-ego2": 0.004265711170549099, "sim_render-ego3": 0.003802382082466678, "get_duckie_state": 2.206314811103052e-06, "in-drivable-lane": 57.49999999999873, "deviation-heading": 1.732166353379932, "agent_compute-ego0": 0.02735688267500573, "agent_compute-ego1": 0.026993811874961377, "agent_compute-ego2": 0.02694833745170295, "agent_compute-ego3": 0.02987411139311143, "complete-iteration": 0.4729847040501959, "set_robot_commands": 0.0022834717085915344, "distance-from-start": 1.0642962695763312, "deviation-center-line": 0.1368593303880955, "driven_lanedir_consec": 0.16925123326613734, "sim_compute_sim_state": 0.015049988582271225, "sim_compute_performance-ego0": 0.0019884264340110864, "sim_compute_performance-ego1": 0.0018925420648350903, "sim_compute_performance-ego2": 0.0019929343516582455, "sim_compute_performance-ego3": 0.0019788720228590636}, "LFV_multi-full-zigzag-000-ego1": {"driven_any": 0.6202496724670908, "get_ui_image": 0.05939414757276753, "step_physics": 0.2324681301895129, "survival_time": 59.99999999999873, "driven_lanedir": 0.1336464748101287, "get_state_dump": 0.008761511158685105, "get_robot_state": 0.01350445850604182, "sim_render-ego0": 0.003434905005335113, "sim_render-ego1": 0.003820898729398983, "sim_render-ego2": 0.004265711170549099, "sim_render-ego3": 0.003802382082466678, "get_duckie_state": 2.206314811103052e-06, "in-drivable-lane": 58.44999999999872, "deviation-heading": 0.6932935354101288, "agent_compute-ego0": 0.02735688267500573, "agent_compute-ego1": 0.026993811874961377, "agent_compute-ego2": 0.02694833745170295, "agent_compute-ego3": 0.02987411139311143, "complete-iteration": 0.4729847040501959, "set_robot_commands": 0.0022834717085915344, "distance-from-start": 0.6095567713916662, "deviation-center-line": 0.167617989779648, "driven_lanedir_consec": 0.1336464748101287, "sim_compute_sim_state": 0.015049988582271225, "sim_compute_performance-ego0": 0.0019884264340110864, "sim_compute_performance-ego1": 0.0018925420648350903, "sim_compute_performance-ego2": 0.0019929343516582455, "sim_compute_performance-ego3": 0.0019788720228590636}, "LFV_multi-full-zigzag-000-ego2": {"driven_any": 0.4334578471468685, "get_ui_image": 0.05939414757276753, "step_physics": 0.2324681301895129, "survival_time": 59.99999999999873, "driven_lanedir": 0.26440377401781046, "get_state_dump": 0.008761511158685105, "get_robot_state": 0.01350445850604182, "sim_render-ego0": 0.003434905005335113, "sim_render-ego1": 0.003820898729398983, "sim_render-ego2": 0.004265711170549099, "sim_render-ego3": 0.003802382082466678, "get_duckie_state": 2.206314811103052e-06, "in-drivable-lane": 57.249999999998735, "deviation-heading": 1.2373817788712285, "agent_compute-ego0": 0.02735688267500573, "agent_compute-ego1": 0.026993811874961377, "agent_compute-ego2": 0.02694833745170295, "agent_compute-ego3": 0.02987411139311143, "complete-iteration": 0.4729847040501959, "set_robot_commands": 0.0022834717085915344, "distance-from-start": 0.4149268057504466, "deviation-center-line": 0.16751066189225786, "driven_lanedir_consec": 0.26440377401781046, "sim_compute_sim_state": 0.015049988582271225, "sim_compute_performance-ego0": 0.0019884264340110864, "sim_compute_performance-ego1": 0.0018925420648350903, "sim_compute_performance-ego2": 0.0019929343516582455, "sim_compute_performance-ego3": 0.0019788720228590636}, "LFV_multi-full-zigzag-000-ego3": {"driven_any": 7.431909174519991, "get_ui_image": 0.05939414757276753, "step_physics": 0.2324681301895129, "survival_time": 59.99999999999873, "driven_lanedir": 0.5801835149677443, "get_state_dump": 0.008761511158685105, "get_robot_state": 0.01350445850604182, "sim_render-ego0": 0.003434905005335113, "sim_render-ego1": 0.003820898729398983, "sim_render-ego2": 0.004265711170549099, "sim_render-ego3": 0.003802382082466678, "get_duckie_state": 2.206314811103052e-06, "in-drivable-lane": 49.49999999999901, "deviation-heading": 11.060775760364317, "agent_compute-ego0": 0.02735688267500573, "agent_compute-ego1": 0.026993811874961377, "agent_compute-ego2": 0.02694833745170295, "agent_compute-ego3": 0.02987411139311143, "complete-iteration": 0.4729847040501959, "set_robot_commands": 0.0022834717085915344, "distance-from-start": 1.398778266079122, "deviation-center-line": 0.931970140776458, "driven_lanedir_consec": 0.5601796688733538, "sim_compute_sim_state": 0.015049988582271225, "sim_compute_performance-ego0": 0.0019884264340110864, "sim_compute_performance-ego1": 0.0018925420648350903, "sim_compute_performance-ego2": 0.0019929343516582455, "sim_compute_performance-ego3": 0.0019788720228590636}}
set_robot_commands_max	0.0022834717085915344
set_robot_commands_mean	0.0022834717085915344
set_robot_commands_median	0.0022834717085915344
set_robot_commands_min	0.0022834717085915344
sim_compute_performance-ego0_max	0.0019884264340110864
sim_compute_performance-ego0_mean	0.0019884264340110864
sim_compute_performance-ego0_median	0.0019884264340110864
sim_compute_performance-ego0_min	0.0019884264340110864
sim_compute_performance-ego1_max	0.0018925420648350903
sim_compute_performance-ego1_mean	0.0018925420648350903
sim_compute_performance-ego1_median	0.0018925420648350903
sim_compute_performance-ego1_min	0.0018925420648350903
sim_compute_performance-ego2_max	0.0019929343516582455
sim_compute_performance-ego2_mean	0.0019929343516582455
sim_compute_performance-ego2_median	0.0019929343516582455
sim_compute_performance-ego2_min	0.0019929343516582455
sim_compute_performance-ego3_max	0.0019788720228590636
sim_compute_performance-ego3_mean	0.0019788720228590636
sim_compute_performance-ego3_median	0.0019788720228590636
sim_compute_performance-ego3_min	0.0019788720228590636
sim_compute_sim_state_max	0.015049988582271225
sim_compute_sim_state_mean	0.015049988582271225
sim_compute_sim_state_median	0.015049988582271225
sim_compute_sim_state_min	0.015049988582271225
sim_render-ego0_max	0.003434905005335113
sim_render-ego0_mean	0.003434905005335113
sim_render-ego0_median	0.003434905005335113
sim_render-ego0_min	0.003434905005335113
sim_render-ego1_max	0.003820898729398983
sim_render-ego1_mean	0.003820898729398983
sim_render-ego1_median	0.003820898729398983
sim_render-ego1_min	0.003820898729398983
sim_render-ego2_max	0.004265711170549099
sim_render-ego2_mean	0.004265711170549099
sim_render-ego2_median	0.004265711170549099
sim_render-ego2_min	0.004265711170549099
sim_render-ego3_max	0.003802382082466678
sim_render-ego3_mean	0.003802382082466678
sim_render-ego3_median	0.003802382082466678
sim_render-ego3_min	0.003802382082466678
simulation-passed	1
step_physics_max	0.2324681301895129
step_physics_mean	0.2324681301895129
step_physics_median	0.2324681301895129
step_physics_min	0.2324681301895129
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

91534

sim-0of4

success

yes

2021-10-22 16:44:22+00:00

2021-10-22 17:00:59+00:00

0:16:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	39.14999999999991
in-drivable-lane_median	33.899999999999906
driven_lanedir_consec_median	0.30038041105321955
deviation-center-line_median	0.4151559959956004

other stats

agent_compute-ego0_max	0.02025394962758434
agent_compute-ego0_mean	0.02025394962758434
agent_compute-ego0_median	0.02025394962758434
agent_compute-ego0_min	0.02025394962758434
agent_compute-ego1_max	0.01973038212377198
agent_compute-ego1_mean	0.01973038212377198
agent_compute-ego1_median	0.01973038212377198
agent_compute-ego1_min	0.01973038212377198
agent_compute-ego2_max	0.020132439781208423
agent_compute-ego2_mean	0.020132439781208423
agent_compute-ego2_median	0.020132439781208423
agent_compute-ego2_min	0.020132439781208423
agent_compute-ego3_max	0.023549852626664296
agent_compute-ego3_mean	0.023549852626664296
agent_compute-ego3_median	0.023549852626664296
agent_compute-ego3_min	0.023549852626664296
complete-iteration_max	0.4352036751046473
complete-iteration_mean	0.4352036751046473
complete-iteration_median	0.4352036751046473
complete-iteration_min	0.4352036751046473
deviation-center-line_max	0.5367267291533385
deviation-center-line_mean	0.3883714948965968
deviation-center-line_min	0.18644725844184792
deviation-heading_max	4.78717572057519
deviation-heading_mean	3.5909176742393147
deviation-heading_median	4.427529486802994
deviation-heading_min	0.7214360027760817
distance-from-start_max	1.5080245351176953
distance-from-start_mean	1.1217243594836066
distance-from-start_median	1.231424036548146
distance-from-start_min	0.5160248297204396
driven_any_max	4.748342036879556
driven_any_mean	2.070994965913309
driven_any_median	1.5043920616461282
driven_any_min	0.5268537034814247
driven_lanedir_consec_max	0.46849065975578186
driven_lanedir_consec_mean	0.31003808656302706
driven_lanedir_consec_min	0.17090086438988727
driven_lanedir_max	0.6198342005114854
driven_lanedir_mean	0.3656827900292638
driven_lanedir_median	0.33599804760784124
driven_lanedir_min	0.17090086438988727
get_duckie_state_max	1.3179925023293008e-06
get_duckie_state_mean	1.3179925023293008e-06
get_duckie_state_median	1.3179925023293008e-06
get_duckie_state_min	1.3179925023293008e-06
get_robot_state_max	0.012957965841098708
get_robot_state_mean	0.012957965841098708
get_robot_state_median	0.012957965841098708
get_robot_state_min	0.012957965841098708
get_state_dump_max	0.008750724245090874
get_state_dump_mean	0.008750724245090874
get_state_dump_median	0.008750724245090874
get_state_dump_min	0.008750724245090874
get_ui_image_max	0.05133280583790371
get_ui_image_mean	0.05133280583790371
get_ui_image_median	0.05133280583790371
get_ui_image_min	0.05133280583790371
in-drivable-lane_max	37.29999999999991
in-drivable-lane_mean	34.212499999999906
in-drivable-lane_min	31.74999999999991
per-episodes	details {"LFV_multi-full-loop-000-ego0": {"driven_any": 1.38609043077803, "get_ui_image": 0.05133280583790371, "step_physics": 0.2383414123739515, "survival_time": 39.14999999999991, "driven_lanedir": 0.2816144882173568, "get_state_dump": 0.008750724245090874, "get_robot_state": 0.012957965841098708, "sim_render-ego0": 0.0034845249385249857, "sim_render-ego1": 0.0036548938678235424, "sim_render-ego2": 0.003473241110237278, "sim_render-ego3": 0.003683593504282893, "get_duckie_state": 1.3179925023293008e-06, "in-drivable-lane": 34.2499999999999, "deviation-heading": 4.669047660760954, "agent_compute-ego0": 0.02025394962758434, "agent_compute-ego1": 0.01973038212377198, "agent_compute-ego2": 0.020132439781208423, "agent_compute-ego3": 0.023549852626664296, "complete-iteration": 0.4352036751046473, "set_robot_commands": 0.002075171592284222, "distance-from-start": 1.2641280676527091, "deviation-center-line": 0.35241216497731154, "driven_lanedir_consec": 0.244178541666882, "sim_compute_sim_state": 0.010395414367014048, "sim_compute_performance-ego0": 0.0017605639842091774, "sim_compute_performance-ego1": 0.00169315690896949, "sim_compute_performance-ego2": 0.0017380656636491114, "sim_compute_performance-ego3": 0.0017592843089784896}, "LFV_multi-full-loop-000-ego1": {"driven_any": 0.5268537034814247, "get_ui_image": 0.05133280583790371, "step_physics": 0.2383414123739515, "survival_time": 39.14999999999991, "driven_lanedir": 0.17090086438988727, "get_state_dump": 0.008750724245090874, "get_robot_state": 0.012957965841098708, "sim_render-ego0": 0.0034845249385249857, "sim_render-ego1": 0.0036548938678235424, "sim_render-ego2": 0.003473241110237278, "sim_render-ego3": 0.003683593504282893, "get_duckie_state": 1.3179925023293008e-06, "in-drivable-lane": 37.29999999999991, "deviation-heading": 0.7214360027760817, "agent_compute-ego0": 0.02025394962758434, "agent_compute-ego1": 0.01973038212377198, "agent_compute-ego2": 0.020132439781208423, "agent_compute-ego3": 0.023549852626664296, "complete-iteration": 0.4352036751046473, "set_robot_commands": 0.002075171592284222, "distance-from-start": 0.5160248297204396, "deviation-center-line": 0.18644725844184792, "driven_lanedir_consec": 0.17090086438988727, "sim_compute_sim_state": 0.010395414367014048, "sim_compute_performance-ego0": 0.0017605639842091774, "sim_compute_performance-ego1": 0.00169315690896949, "sim_compute_performance-ego2": 0.0017380656636491114, "sim_compute_performance-ego3": 0.0017592843089784896}, "LFV_multi-full-loop-000-ego2": {"driven_any": 1.6226936925142263, "get_ui_image": 0.05133280583790371, "step_physics": 0.2383414123739515, "survival_time": 39.14999999999991, "driven_lanedir": 0.3903816069983257, "get_state_dump": 0.008750724245090874, "get_robot_state": 0.012957965841098708, "sim_render-ego0": 0.0034845249385249857, "sim_render-ego1": 0.0036548938678235424, "sim_render-ego2": 0.003473241110237278, "sim_render-ego3": 0.003683593504282893, "get_duckie_state": 1.3179925023293008e-06, "in-drivable-lane": 33.54999999999991, "deviation-heading": 4.186011312845033, "agent_compute-ego0": 0.02025394962758434, "agent_compute-ego1": 0.01973038212377198, "agent_compute-ego2": 0.020132439781208423, "agent_compute-ego3": 0.023549852626664296, "complete-iteration": 0.4352036751046473, "set_robot_commands": 0.002075171592284222, "distance-from-start": 1.5080245351176953, "deviation-center-line": 0.4778998270138893, "driven_lanedir_consec": 0.3565822804395571, "sim_compute_sim_state": 0.010395414367014048, "sim_compute_performance-ego0": 0.0017605639842091774, "sim_compute_performance-ego1": 0.00169315690896949, "sim_compute_performance-ego2": 0.0017380656636491114, "sim_compute_performance-ego3": 0.0017592843089784896}, "LFV_multi-full-loop-000-ego3": {"driven_any": 4.748342036879556, "get_ui_image": 0.05133280583790371, "step_physics": 0.2383414123739515, "survival_time": 39.14999999999991, "driven_lanedir": 0.6198342005114854, "get_state_dump": 0.008750724245090874, "get_robot_state": 0.012957965841098708, "sim_render-ego0": 0.0034845249385249857, "sim_render-ego1": 0.0036548938678235424, "sim_render-ego2": 0.003473241110237278, "sim_render-ego3": 0.003683593504282893, "get_duckie_state": 1.3179925023293008e-06, "in-drivable-lane": 31.74999999999991, "deviation-heading": 4.78717572057519, "agent_compute-ego0": 0.02025394962758434, "agent_compute-ego1": 0.01973038212377198, "agent_compute-ego2": 0.020132439781208423, "agent_compute-ego3": 0.023549852626664296, "complete-iteration": 0.4352036751046473, "set_robot_commands": 0.002075171592284222, "distance-from-start": 1.1987200054435825, "deviation-center-line": 0.5367267291533385, "driven_lanedir_consec": 0.46849065975578186, "sim_compute_sim_state": 0.010395414367014048, "sim_compute_performance-ego0": 0.0017605639842091774, "sim_compute_performance-ego1": 0.00169315690896949, "sim_compute_performance-ego2": 0.0017380656636491114, "sim_compute_performance-ego3": 0.0017592843089784896}}
set_robot_commands_max	0.002075171592284222
set_robot_commands_mean	0.002075171592284222
set_robot_commands_median	0.002075171592284222
set_robot_commands_min	0.002075171592284222
sim_compute_performance-ego0_max	0.0017605639842091774
sim_compute_performance-ego0_mean	0.0017605639842091774
sim_compute_performance-ego0_median	0.0017605639842091774
sim_compute_performance-ego0_min	0.0017605639842091774
sim_compute_performance-ego1_max	0.00169315690896949
sim_compute_performance-ego1_mean	0.00169315690896949
sim_compute_performance-ego1_median	0.00169315690896949
sim_compute_performance-ego1_min	0.00169315690896949
sim_compute_performance-ego2_max	0.0017380656636491114
sim_compute_performance-ego2_mean	0.0017380656636491114
sim_compute_performance-ego2_median	0.0017380656636491114
sim_compute_performance-ego2_min	0.0017380656636491114
sim_compute_performance-ego3_max	0.0017592843089784896
sim_compute_performance-ego3_mean	0.0017592843089784896
sim_compute_performance-ego3_median	0.0017592843089784896
sim_compute_performance-ego3_min	0.0017592843089784896
sim_compute_sim_state_max	0.010395414367014048
sim_compute_sim_state_mean	0.010395414367014048
sim_compute_sim_state_median	0.010395414367014048
sim_compute_sim_state_min	0.010395414367014048
sim_render-ego0_max	0.0034845249385249857
sim_render-ego0_mean	0.0034845249385249857
sim_render-ego0_median	0.0034845249385249857
sim_render-ego0_min	0.0034845249385249857
sim_render-ego1_max	0.0036548938678235424
sim_render-ego1_mean	0.0036548938678235424
sim_render-ego1_median	0.0036548938678235424
sim_render-ego1_min	0.0036548938678235424
sim_render-ego2_max	0.003473241110237278
sim_render-ego2_mean	0.003473241110237278
sim_render-ego2_median	0.003473241110237278
sim_render-ego2_min	0.003473241110237278
sim_render-ego3_max	0.003683593504282893
sim_render-ego3_mean	0.003683593504282893
sim_render-ego3_median	0.003683593504282893
sim_render-ego3_min	0.003683593504282893
simulation-passed	1
step_physics_max	0.2383414123739515
step_physics_mean	0.2383414123739515
step_physics_median	0.2383414123739515
step_physics_min	0.2383414123739515
survival_time_max	39.14999999999991
survival_time_mean	39.14999999999991
survival_time_min	39.14999999999991

No reset possible

91533

sim-1of4

success

yes

2021-10-22 16:42:46+00:00

2021-10-22 17:00:14+00:00

0:17:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	39.449999999999896
in-drivable-lane_median	36.72499999999989
driven_lanedir_consec_median	0.12798884330781912
deviation-center-line_median	0.24412664963672423

other stats

agent_compute-ego0_max	0.031571101538742645
agent_compute-ego0_mean	0.031571101538742645
agent_compute-ego0_median	0.031571101538742645
agent_compute-ego0_min	0.031571101538742645
agent_compute-ego1_max	0.0252049117148677
agent_compute-ego1_mean	0.0252049117148677
agent_compute-ego1_median	0.0252049117148677
agent_compute-ego1_min	0.0252049117148677
agent_compute-ego2_max	0.0273863309546362
agent_compute-ego2_mean	0.0273863309546362
agent_compute-ego2_median	0.0273863309546362
agent_compute-ego2_min	0.0273863309546362
agent_compute-ego3_max	0.02545913291882865
agent_compute-ego3_mean	0.02545913291882865
agent_compute-ego3_median	0.02545913291882865
agent_compute-ego3_min	0.02545913291882865
complete-iteration_max	0.4805201110960562
complete-iteration_mean	0.4805201110960562
complete-iteration_median	0.4805201110960562
complete-iteration_min	0.4805201110960562
deviation-center-line_max	0.8545082553286015
deviation-center-line_mean	0.3714595347938417
deviation-center-line_min	0.14307658457331676
deviation-heading_max	9.05334369820372
deviation-heading_mean	3.729063095689737
deviation-heading_median	2.53177334699142
deviation-heading_min	0.7993619905723874
distance-from-start_max	2.2834693044361978
distance-from-start_mean	1.2196098982471753
distance-from-start_median	1.1055683553933702
distance-from-start_min	0.38383357776576216
driven_any_max	4.785698995490623
driven_any_mean	1.9262319788163984
driven_any_median	1.2584518794707802
driven_any_min	0.4023251608334093
driven_lanedir_consec_max	0.8823227118217747
driven_lanedir_consec_mean	0.31005294539501027
driven_lanedir_consec_min	0.10191138314262815
driven_lanedir_max	0.9043947011101606
driven_lanedir_mean	0.3270613172748139
driven_lanedir_median	0.1509695924232335
driven_lanedir_min	0.10191138314262815
get_duckie_state_max	2.3150745826431466e-06
get_duckie_state_mean	2.3150745826431466e-06
get_duckie_state_median	2.3150745826431466e-06
get_duckie_state_min	2.3150745826431466e-06
get_robot_state_max	0.013269243964666052
get_robot_state_mean	0.013269243964666052
get_robot_state_median	0.013269243964666052
get_robot_state_min	0.013269243964666052
get_state_dump_max	0.00894070124324364
get_state_dump_mean	0.00894070124324364
get_state_dump_median	0.00894070124324364
get_state_dump_min	0.00894070124324364
get_ui_image_max	0.05913835779021058
get_ui_image_mean	0.05913835779021058
get_ui_image_median	0.05913835779021058
get_ui_image_min	0.05913835779021058
in-drivable-lane_max	38.099999999999895
in-drivable-lane_mean	34.68749999999993
in-drivable-lane_min	27.200000000000053
per-episodes	details {"LFV_multi-full-techtrack-000-ego0": {"driven_any": 4.785698995490623, "get_ui_image": 0.05913835779021058, "step_physics": 0.24238670596593545, "survival_time": 39.449999999999896, "driven_lanedir": 0.9043947011101606, "get_state_dump": 0.00894070124324364, "get_robot_state": 0.013269243964666052, "sim_render-ego0": 0.0036149550087844263, "sim_render-ego1": 0.0034637104106854787, "sim_render-ego2": 0.0036446426488176177, "sim_render-ego3": 0.003669302071197123, "get_duckie_state": 2.3150745826431466e-06, "in-drivable-lane": 27.200000000000053, "deviation-heading": 9.05334369820372, "agent_compute-ego0": 0.031571101538742645, "agent_compute-ego1": 0.0252049117148677, "agent_compute-ego2": 0.0273863309546362, "agent_compute-ego3": 0.02545913291882865, "complete-iteration": 0.4805201110960562, "set_robot_commands": 0.0022489258005649227, "distance-from-start": 2.2834693044361978, "deviation-center-line": 0.8545082553286015, "driven_lanedir_consec": 0.8823227118217747, "sim_compute_sim_state": 0.016449353966531875, "sim_compute_performance-ego0": 0.0018656422820272328, "sim_compute_performance-ego1": 0.0017588383034814765, "sim_compute_performance-ego2": 0.0018069508709485016, "sim_compute_performance-ego3": 0.0018733308285097533}, "LFV_multi-full-techtrack-000-ego1": {"driven_any": 1.927786905609128, "get_ui_image": 0.05913835779021058, "step_physics": 0.24238670596593545, "survival_time": 39.449999999999896, "driven_lanedir": 0.195530319586819, "get_state_dump": 0.00894070124324364, "get_robot_state": 0.013269243964666052, "sim_render-ego0": 0.0036149550087844263, "sim_render-ego1": 0.0034637104106854787, "sim_render-ego2": 0.0036446426488176177, "sim_render-ego3": 0.003669302071197123, "get_duckie_state": 2.3150745826431466e-06, "in-drivable-lane": 35.39999999999988, "deviation-heading": 4.227965780196103, "agent_compute-ego0": 0.031571101538742645, "agent_compute-ego1": 0.0252049117148677, "agent_compute-ego2": 0.0273863309546362, "agent_compute-ego3": 0.02545913291882865, "complete-iteration": 0.4805201110960562, "set_robot_commands": 0.0022489258005649227, "distance-from-start": 1.6609667315416454, "deviation-center-line": 0.3447118624927671, "driven_lanedir_consec": 0.14956882135599026, "sim_compute_sim_state": 0.016449353966531875, "sim_compute_performance-ego0": 0.0018656422820272328, "sim_compute_performance-ego1": 0.0017588383034814765, "sim_compute_performance-ego2": 0.0018069508709485016, "sim_compute_performance-ego3": 0.0018733308285097533}, "LFV_multi-full-techtrack-000-ego2": {"driven_any": 0.4023251608334093, "get_ui_image": 0.05913835779021058, "step_physics": 0.24238670596593545, "survival_time": 39.449999999999896, "driven_lanedir": 0.10191138314262815, "get_state_dump": 0.00894070124324364, "get_robot_state": 0.013269243964666052, "sim_render-ego0": 0.0036149550087844263, "sim_render-ego1": 0.0034637104106854787, "sim_render-ego2": 0.0036446426488176177, "sim_render-ego3": 0.003669302071197123, "get_duckie_state": 2.3150745826431466e-06, "in-drivable-lane": 38.099999999999895, "deviation-heading": 0.7993619905723874, "agent_compute-ego0": 0.031571101538742645, "agent_compute-ego1": 0.0252049117148677, "agent_compute-ego2": 0.0273863309546362, "agent_compute-ego3": 0.02545913291882865, "complete-iteration": 0.4805201110960562, "set_robot_commands": 0.0022489258005649227, "distance-from-start": 0.38383357776576216, "deviation-center-line": 0.14307658457331676, "driven_lanedir_consec": 0.10191138314262815, "sim_compute_sim_state": 0.016449353966531875, "sim_compute_performance-ego0": 0.0018656422820272328, "sim_compute_performance-ego1": 0.0017588383034814765, "sim_compute_performance-ego2": 0.0018069508709485016, "sim_compute_performance-ego3": 0.0018733308285097533}, "LFV_multi-full-techtrack-000-ego3": {"driven_any": 0.5891168533324322, "get_ui_image": 0.05913835779021058, "step_physics": 0.24238670596593545, "survival_time": 39.449999999999896, "driven_lanedir": 0.106408865259648, "get_state_dump": 0.00894070124324364, "get_robot_state": 0.013269243964666052, "sim_render-ego0": 0.0036149550087844263, "sim_render-ego1": 0.0034637104106854787, "sim_render-ego2": 0.0036446426488176177, "sim_render-ego3": 0.003669302071197123, "get_duckie_state": 2.3150745826431466e-06, "in-drivable-lane": 38.0499999999999, "deviation-heading": 0.8355809137867375, "agent_compute-ego0": 0.031571101538742645, "agent_compute-ego1": 0.0252049117148677, "agent_compute-ego2": 0.0273863309546362, "agent_compute-ego3": 0.02545913291882865, "complete-iteration": 0.4805201110960562, "set_robot_commands": 0.0022489258005649227, "distance-from-start": 0.550169979245095, "deviation-center-line": 0.14354143678068138, "driven_lanedir_consec": 0.106408865259648, "sim_compute_sim_state": 0.016449353966531875, "sim_compute_performance-ego0": 0.0018656422820272328, "sim_compute_performance-ego1": 0.0017588383034814765, "sim_compute_performance-ego2": 0.0018069508709485016, "sim_compute_performance-ego3": 0.0018733308285097533}}
set_robot_commands_max	0.0022489258005649227
set_robot_commands_mean	0.0022489258005649227
set_robot_commands_median	0.0022489258005649227
set_robot_commands_min	0.0022489258005649227
sim_compute_performance-ego0_max	0.0018656422820272328
sim_compute_performance-ego0_mean	0.0018656422820272328
sim_compute_performance-ego0_median	0.0018656422820272328
sim_compute_performance-ego0_min	0.0018656422820272328
sim_compute_performance-ego1_max	0.0017588383034814765
sim_compute_performance-ego1_mean	0.0017588383034814765
sim_compute_performance-ego1_median	0.0017588383034814765
sim_compute_performance-ego1_min	0.0017588383034814765
sim_compute_performance-ego2_max	0.0018069508709485016
sim_compute_performance-ego2_mean	0.0018069508709485016
sim_compute_performance-ego2_median	0.0018069508709485016
sim_compute_performance-ego2_min	0.0018069508709485016
sim_compute_performance-ego3_max	0.0018733308285097533
sim_compute_performance-ego3_mean	0.0018733308285097533
sim_compute_performance-ego3_median	0.0018733308285097533
sim_compute_performance-ego3_min	0.0018733308285097533
sim_compute_sim_state_max	0.016449353966531875
sim_compute_sim_state_mean	0.016449353966531875
sim_compute_sim_state_median	0.016449353966531875
sim_compute_sim_state_min	0.016449353966531875
sim_render-ego0_max	0.0036149550087844263
sim_render-ego0_mean	0.0036149550087844263
sim_render-ego0_median	0.0036149550087844263
sim_render-ego0_min	0.0036149550087844263
sim_render-ego1_max	0.0034637104106854787
sim_render-ego1_mean	0.0034637104106854787
sim_render-ego1_median	0.0034637104106854787
sim_render-ego1_min	0.0034637104106854787
sim_render-ego2_max	0.0036446426488176177
sim_render-ego2_mean	0.0036446426488176177
sim_render-ego2_median	0.0036446426488176177
sim_render-ego2_min	0.0036446426488176177
sim_render-ego3_max	0.003669302071197123
sim_render-ego3_mean	0.003669302071197123
sim_render-ego3_median	0.003669302071197123
sim_render-ego3_min	0.003669302071197123
simulation-passed	1
step_physics_max	0.24238670596593545
step_physics_mean	0.24238670596593545
step_physics_median	0.24238670596593545
step_physics_min	0.24238670596593545
survival_time_max	39.449999999999896
survival_time_mean	39.449999999999896
survival_time_min	39.449999999999896

No reset possible

77055

sim-3of4

success

yes

2021-05-19 13:01:18+00:00

2021-05-19 13:07:20+00:00

0:06:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77054

sim-2of4

success

yes

2021-05-19 12:53:48+00:00

2021-05-19 13:20:08+00:00

0:26:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77053

sim-0of4

success

yes

2021-05-19 12:53:41+00:00

2021-05-19 13:10:29+00:00

0:16:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77052

sim-3of4

host-error

yes

2021-05-19 12:53:39+00:00

2021-05-19 13:00:13+00:00

0:06:34

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [7ce5255c597b6249e674781ca1b2c5bf9b76463d7d251ca08380be9cf4ce65c8,
│                 5017773414b3813c34b55f22244ebbf38157af9cb78297e9ad96037a676ec5c5,
│                 917dfda66eac5dd150268b966eb0f04999cf11bd9c0470afc46a4559bd231d5d]
│      services: dict[6]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:10389f870ad85646c7a177c9cf931fdc914decfddfbb2efb30bea0d49c3c90cf
│                │ │ environment:
│                │ │ dict[11]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 3
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |port: 10123
│                │ │ │ |
│                │ │ │ challenge_name: aido-LFV_multi_full-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 15499
│                │ │ │ submitter_name: Alessandro Zanardi
│                │ │ │ SUBMISSION_CONTAINER: docker.io/alezana/aido-submissions:2021_05_19_12_47_38@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-02_fa98839c1ea0
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_05_19_12_53_39-52260/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:74989d3337d7fc221b8550c34dab1359eb18109113950b27deaa647a983417e0
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |topdown_resolution: 600
│                │ │ │ |debug_no_video: false
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido-LFV_multi_full-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 15499
│                │ │ │ submitter_name: Alessandro Zanardi
│                │ │ │ SUBMISSION_CONTAINER: docker.io/alezana/aido-submissions:2021_05_19_12_47_38@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-02_fa98839c1ea0
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_05_19_12_53_39-52260/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/alezana/aido-submissions@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido-LFV_multi_full-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 15499
│                │ │ │ submitter_name: Alessandro Zanardi
│                │ │ │ SUBMISSION_CONTAINER: docker.io/alezana/aido-submissions:2021_05_19_12_47_38@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-02_fa98839c1ea0
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_05_19_12_53_39-52260/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego1:
│                │ dict[6]
│                │ │ image: docker.io/alezana/aido-submissions@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ AIDONODE_NAME: ego1
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego1-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego1-out
│                │ │ │ challenge_name: aido-LFV_multi_full-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 15499
│                │ │ │ submitter_name: Alessandro Zanardi
│                │ │ │ SUBMISSION_CONTAINER: docker.io/alezana/aido-submissions:2021_05_19_12_47_38@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-02_fa98839c1ea0
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_05_19_12_53_39-52260/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego2:
│                │ dict[6]
│                │ │ image: docker.io/alezana/aido-submissions@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ AIDONODE_NAME: ego2
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego2-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego2-out
│                │ │ │ challenge_name: aido-LFV_multi_full-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 15499
│                │ │ │ submitter_name: Alessandro Zanardi
│                │ │ │ SUBMISSION_CONTAINER: docker.io/alezana/aido-submissions:2021_05_19_12_47_38@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-02_fa98839c1ea0
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_05_19_12_53_39-52260/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego3:
│                │ dict[6]
│                │ │ image: docker.io/alezana/aido-submissions@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 3, "total": 4}
│                │ │ │ AIDONODE_NAME: ego3
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego3-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego3-out
│                │ │ │ challenge_name: aido-LFV_multi_full-sim-validation
│                │ │ │ challenge_step_name: sim-3of4
│                │ │ │ submission_id: 15499
│                │ │ │ submitter_name: Alessandro Zanardi
│                │ │ │ SUBMISSION_CONTAINER: docker.io/alezana/aido-submissions:2021_05_19_12_47_38@sha256:fd0c00d5fe0ba932bb1de58683589c32c217585f28d141b4669321c507f50aa3
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-0-02_fa98839c1ea0
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15499/sim-3of4-nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_05_19_12_53_39-52260/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: 7ce5255c597b6249e674781ca1b2c5bf9b76463d7d251ca08380be9cf4ce65c8
│                │ solution-ego2: 5017773414b3813c34b55f22244ebbf38157af9cb78297e9ad96037a676ec5c5
│                │ solution-ego3: 917dfda66eac5dd150268b966eb0f04999cf11bd9c0470afc46a4559bd231d5d
│         names: dict[3]
│                │ 7ce5255c597b6249e674781ca1b2c5bf9b76463d7d251ca08380be9cf4ce65c8: nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-981296_evaluator_1
│                │ 5017773414b3813c34b55f22244ebbf38157af9cb78297e9ad96037a676ec5c5: nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-981296_solution-ego2_1
│                │ 917dfda66eac5dd150268b966eb0f04999cf11bd9c0470afc46a4559bd231d5d: nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-981296_solution-ego3_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |7ce5255c597b6249e674781ca1b2c5bf9b76463d7d251ca08380be9cf4ce65c8
│         |5017773414b3813c34b55f22244ebbf38157af9cb78297e9ad96037a676ec5c5
│         |917dfda66eac5dd150268b966eb0f04999cf11bd9c0470afc46a4559bd231d5d
│         |
│  names: dict[3]
│         │ 7ce5255c597b6249e674781ca1b2c5bf9b76463d7d251ca08380be9cf4ce65c8: nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-981296_evaluator_1
│         │ 5017773414b3813c34b55f22244ebbf38157af9cb78297e9ad96037a676ec5c5: nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-981296_solution-ego2_1
│         │ 917dfda66eac5dd150268b966eb0f04999cf11bd9c0470afc46a4559bd231d5d: nogpu-production-b-spot-0-02_fa98839c1ea0-job77052-981296_solution-ego3_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

77051

sim-1of4

success

yes

2021-05-19 12:53:27+00:00

2021-05-19 13:10:51+00:00

0:17:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible