Duckietown Challenges Home Challenges Submissions

Submission 15373

Submission15373
Competingyes
Challengeaido-LFV_multi_full-sim-validation
UserAlessandro Zanardi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 91943 sim-1of4: 91941 sim-2of4: 91942 sim-3of4: 91940
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

91943

Click the images to see detailed statistics about the episode.

LFV_multi-full-loop-000

91942

Click the images to see detailed statistics about the episode.

LFV_multi-full-zigzag-000

91941

Click the images to see detailed statistics about the episode.

LFV_multi-full-techtrack-000

91940

Click the images to see detailed statistics about the episode.

LFV_multi-full-small_loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
91943sim-0of4successyes0:33:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median51.54999999999869
driven_lanedir_consec_median0.040858891461345026
deviation-center-line_median0.4944199599217245


other stats
agent_compute-ego0_max0.020480326073652105
agent_compute-ego0_mean0.020480326073652105
agent_compute-ego0_median0.020480326073652105
agent_compute-ego0_min0.020480326073652105
agent_compute-ego1_max0.020556968614322556
agent_compute-ego1_mean0.020556968614322556
agent_compute-ego1_median0.020556968614322556
agent_compute-ego1_min0.020556968614322556
agent_compute-ego2_max0.021169659696351876
agent_compute-ego2_mean0.021169659696351876
agent_compute-ego2_median0.021169659696351876
agent_compute-ego2_min0.021169659696351876
agent_compute-ego3_max0.021649449592228236
agent_compute-ego3_mean0.021649449592228236
agent_compute-ego3_median0.021649449592228236
agent_compute-ego3_min0.021649449592228236
complete-iteration_max0.815084908228929
complete-iteration_mean0.815084908228929
complete-iteration_median0.815084908228929
complete-iteration_min0.815084908228929
deviation-center-line_max0.8665051699404589
deviation-center-line_mean0.5684597906881912
deviation-center-line_min0.41849407296885693
deviation-heading_max9.953830191113996
deviation-heading_mean6.88964258783941
deviation-heading_median6.282638608498834
deviation-heading_min5.0394629432459785
distance-from-start_max0.1499850775767767
distance-from-start_mean0.1345782069775921
distance-from-start_median0.1406261278402332
distance-from-start_min0.10707549465312524
driven_any_max0.6755992585690507
driven_any_mean0.675597244661522
driven_any_median0.6755971603919212
driven_any_min0.6755953992931951
driven_lanedir_consec_max0.09585613343957312
driven_lanedir_consec_mean0.05015135986158176
driven_lanedir_consec_min0.023031523084063865
driven_lanedir_max0.09585613343957312
driven_lanedir_mean0.05015135986158176
driven_lanedir_median0.040858891461345026
driven_lanedir_min0.023031523084063865
get_duckie_state_max1.9996589069858776e-06
get_duckie_state_mean1.9996589069858776e-06
get_duckie_state_median1.9996589069858776e-06
get_duckie_state_min1.9996589069858776e-06
get_robot_state_max0.013303683858231444
get_robot_state_mean0.013303683858231444
get_robot_state_median0.013303683858231444
get_robot_state_min0.013303683858231444
get_state_dump_max0.008934070029723257
get_state_dump_mean0.008934070029723257
get_state_dump_median0.008934070029723257
get_state_dump_min0.008934070029723257
get_ui_image_max0.05344062979076427
get_ui_image_mean0.05344062979076427
get_ui_image_median0.05344062979076427
get_ui_image_min0.05344062979076427
in-drivable-lane_max54.44999999999874
in-drivable-lane_mean51.57499999999871
in-drivable-lane_min48.74999999999871
per-episodes
details{"LFV_multi-full-loop-000-ego0": {"driven_any": 0.675596197909323, "get_ui_image": 0.05344062979076427, "step_physics": 0.6042717878864171, "survival_time": 59.99999999999873, "driven_lanedir": 0.023031523084063865, "get_state_dump": 0.008934070029723257, "get_robot_state": 0.013303683858231444, "sim_render-ego0": 0.0034196712293791632, "sim_render-ego1": 0.0034412472174626205, "sim_render-ego2": 0.003467828209056743, "sim_render-ego3": 0.0034748576860642254, "get_duckie_state": 1.9996589069858776e-06, "in-drivable-lane": 53.499999999998714, "deviation-heading": 7.468081005822268, "agent_compute-ego0": 0.020480326073652105, "agent_compute-ego1": 0.020556968614322556, "agent_compute-ego2": 0.021169659696351876, "agent_compute-ego3": 0.021649449592228236, "complete-iteration": 0.815084908228929, "set_robot_commands": 0.002122390478675709, "distance-from-start": 0.14808605178392975, "deviation-center-line": 0.41849407296885693, "driven_lanedir_consec": 0.023031523084063865, "sim_compute_sim_state": 0.02170169264152584, "sim_compute_performance-ego0": 0.0018267474702553983, "sim_compute_performance-ego1": 0.0017436648487151414, "sim_compute_performance-ego2": 0.0017845747770615958, "sim_compute_performance-ego3": 0.0017920604454885415}, "LFV_multi-full-loop-000-ego1": {"driven_any": 0.6755953992931951, "get_ui_image": 0.05344062979076427, "step_physics": 0.6042717878864171, "survival_time": 59.99999999999873, "driven_lanedir": 0.02996051223966978, "get_state_dump": 0.008934070029723257, "get_robot_state": 0.013303683858231444, "sim_render-ego0": 0.0034196712293791632, "sim_render-ego1": 0.0034412472174626205, "sim_render-ego2": 0.003467828209056743, "sim_render-ego3": 0.0034748576860642254, "get_duckie_state": 1.9996589069858776e-06, "in-drivable-lane": 54.44999999999874, "deviation-heading": 5.0394629432459785, "agent_compute-ego0": 0.020480326073652105, "agent_compute-ego1": 0.020556968614322556, "agent_compute-ego2": 0.021169659696351876, "agent_compute-ego3": 0.021649449592228236, "complete-iteration": 0.815084908228929, "set_robot_commands": 0.002122390478675709, "distance-from-start": 0.10707549465312524, "deviation-center-line": 0.5266060480105194, "driven_lanedir_consec": 0.02996051223966978, "sim_compute_sim_state": 0.02170169264152584, "sim_compute_performance-ego0": 0.0018267474702553983, "sim_compute_performance-ego1": 0.0017436648487151414, "sim_compute_performance-ego2": 0.0017845747770615958, "sim_compute_performance-ego3": 0.0017920604454885415}, "LFV_multi-full-loop-000-ego2": {"driven_any": 0.6755992585690507, "get_ui_image": 0.05344062979076427, "step_physics": 0.6042717878864171, "survival_time": 59.99999999999873, "driven_lanedir": 0.09585613343957312, "get_state_dump": 0.008934070029723257, "get_robot_state": 0.013303683858231444, "sim_render-ego0": 0.0034196712293791632, "sim_render-ego1": 0.0034412472174626205, "sim_render-ego2": 0.003467828209056743, "sim_render-ego3": 0.0034748576860642254, "get_duckie_state": 1.9996589069858776e-06, "in-drivable-lane": 48.74999999999871, "deviation-heading": 5.097196211175399, "agent_compute-ego0": 0.020480326073652105, "agent_compute-ego1": 0.020556968614322556, "agent_compute-ego2": 0.021169659696351876, "agent_compute-ego3": 0.021649449592228236, "complete-iteration": 0.815084908228929, "set_robot_commands": 0.002122390478675709, "distance-from-start": 0.1499850775767767, "deviation-center-line": 0.8665051699404589, "driven_lanedir_consec": 0.09585613343957312, "sim_compute_sim_state": 0.02170169264152584, "sim_compute_performance-ego0": 0.0018267474702553983, "sim_compute_performance-ego1": 0.0017436648487151414, "sim_compute_performance-ego2": 0.0017845747770615958, "sim_compute_performance-ego3": 0.0017920604454885415}, "LFV_multi-full-loop-000-ego3": {"driven_any": 0.6755981228745194, "get_ui_image": 0.05344062979076427, "step_physics": 0.6042717878864171, "survival_time": 59.99999999999873, "driven_lanedir": 0.05175727068302027, "get_state_dump": 0.008934070029723257, "get_robot_state": 0.013303683858231444, "sim_render-ego0": 0.0034196712293791632, "sim_render-ego1": 0.0034412472174626205, "sim_render-ego2": 0.003467828209056743, "sim_render-ego3": 0.0034748576860642254, "get_duckie_state": 1.9996589069858776e-06, "in-drivable-lane": 49.59999999999867, "deviation-heading": 9.953830191113996, "agent_compute-ego0": 0.020480326073652105, "agent_compute-ego1": 0.020556968614322556, "agent_compute-ego2": 0.021169659696351876, "agent_compute-ego3": 0.021649449592228236, "complete-iteration": 0.815084908228929, "set_robot_commands": 0.002122390478675709, "distance-from-start": 0.13316620389653666, "deviation-center-line": 0.4622338718329297, "driven_lanedir_consec": 0.05175727068302027, "sim_compute_sim_state": 0.02170169264152584, "sim_compute_performance-ego0": 0.0018267474702553983, "sim_compute_performance-ego1": 0.0017436648487151414, "sim_compute_performance-ego2": 0.0017845747770615958, "sim_compute_performance-ego3": 0.0017920604454885415}}
set_robot_commands_max0.002122390478675709
set_robot_commands_mean0.002122390478675709
set_robot_commands_median0.002122390478675709
set_robot_commands_min0.002122390478675709
sim_compute_performance-ego0_max0.0018267474702553983
sim_compute_performance-ego0_mean0.0018267474702553983
sim_compute_performance-ego0_median0.0018267474702553983
sim_compute_performance-ego0_min0.0018267474702553983
sim_compute_performance-ego1_max0.0017436648487151414
sim_compute_performance-ego1_mean0.0017436648487151414
sim_compute_performance-ego1_median0.0017436648487151414
sim_compute_performance-ego1_min0.0017436648487151414
sim_compute_performance-ego2_max0.0017845747770615958
sim_compute_performance-ego2_mean0.0017845747770615958
sim_compute_performance-ego2_median0.0017845747770615958
sim_compute_performance-ego2_min0.0017845747770615958
sim_compute_performance-ego3_max0.0017920604454885415
sim_compute_performance-ego3_mean0.0017920604454885415
sim_compute_performance-ego3_median0.0017920604454885415
sim_compute_performance-ego3_min0.0017920604454885415
sim_compute_sim_state_max0.02170169264152584
sim_compute_sim_state_mean0.02170169264152584
sim_compute_sim_state_median0.02170169264152584
sim_compute_sim_state_min0.02170169264152584
sim_render-ego0_max0.0034196712293791632
sim_render-ego0_mean0.0034196712293791632
sim_render-ego0_median0.0034196712293791632
sim_render-ego0_min0.0034196712293791632
sim_render-ego1_max0.0034412472174626205
sim_render-ego1_mean0.0034412472174626205
sim_render-ego1_median0.0034412472174626205
sim_render-ego1_min0.0034412472174626205
sim_render-ego2_max0.003467828209056743
sim_render-ego2_mean0.003467828209056743
sim_render-ego2_median0.003467828209056743
sim_render-ego2_min0.003467828209056743
sim_render-ego3_max0.0034748576860642254
sim_render-ego3_mean0.0034748576860642254
sim_render-ego3_median0.0034748576860642254
sim_render-ego3_min0.0034748576860642254
simulation-passed1
step_physics_max0.6042717878864171
step_physics_mean0.6042717878864171
step_physics_median0.6042717878864171
step_physics_min0.6042717878864171
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91942sim-2of4successyes0:36:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.0999999999987
driven_lanedir_consec_median0.02537914017888654
deviation-center-line_median0.47482363371169134


other stats
agent_compute-ego0_max0.03820331984018902
agent_compute-ego0_mean0.03820331984018902
agent_compute-ego0_median0.03820331984018902
agent_compute-ego0_min0.03820331984018902
agent_compute-ego1_max0.029427677467403365
agent_compute-ego1_mean0.029427677467403365
agent_compute-ego1_median0.029427677467403365
agent_compute-ego1_min0.029427677467403365
agent_compute-ego2_max0.02928732138291485
agent_compute-ego2_mean0.02928732138291485
agent_compute-ego2_median0.02928732138291485
agent_compute-ego2_min0.02928732138291485
agent_compute-ego3_max0.02938963412047425
agent_compute-ego3_mean0.02938963412047425
agent_compute-ego3_median0.02938963412047425
agent_compute-ego3_min0.02938963412047425
complete-iteration_max0.9780112319345976
complete-iteration_mean0.9780112319345976
complete-iteration_median0.9780112319345976
complete-iteration_min0.9780112319345976
deviation-center-line_max0.5417311823893198
deviation-center-line_mean0.4819783255408906
deviation-center-line_min0.4365348523508599
deviation-heading_max10.151303216580253
deviation-heading_mean7.91092802708735
deviation-heading_median8.440502467918815
deviation-heading_min4.611403955931515
distance-from-start_max0.1537546701263195
distance-from-start_mean0.13357599079458296
distance-from-start_median0.14111638939079862
distance-from-start_min0.09831651427041506
driven_any_max0.6755978715438312
driven_any_mean0.6755963593922797
driven_any_median0.6755962501459893
driven_any_min0.675595065733309
driven_lanedir_consec_max0.041434923438779414
driven_lanedir_consec_mean0.026460509375953456
driven_lanedir_consec_min0.013648833707261332
driven_lanedir_max0.041434923438779414
driven_lanedir_mean0.026460509375953456
driven_lanedir_median0.02537914017888654
driven_lanedir_min0.013648833707261332
get_duckie_state_max2.4965462537728978e-06
get_duckie_state_mean2.4965462537728978e-06
get_duckie_state_median2.4965462537728978e-06
get_duckie_state_min2.4965462537728978e-06
get_robot_state_max0.013757020607280492
get_robot_state_mean0.013757020607280492
get_robot_state_median0.013757020607280492
get_robot_state_min0.013757020607280492
get_state_dump_max0.008998569302713743
get_state_dump_mean0.008998569302713743
get_state_dump_median0.008998569302713743
get_state_dump_min0.008998569302713743
get_ui_image_max0.05928286307062535
get_ui_image_mean0.05928286307062535
get_ui_image_median0.05928286307062535
get_ui_image_min0.05928286307062535
in-drivable-lane_max55.19999999999874
in-drivable-lane_mean52.8999999999987
in-drivable-lane_min50.19999999999865
per-episodes
details{"LFV_multi-full-zigzag-000-ego0": {"driven_any": 0.6755978715438312, "get_ui_image": 0.05928286307062535, "step_physics": 0.7019781967086856, "survival_time": 59.99999999999873, "driven_lanedir": 0.041434923438779414, "get_state_dump": 0.008998569302713743, "get_robot_state": 0.013757020607280492, "sim_render-ego0": 0.0035526146995931937, "sim_render-ego1": 0.003578408175364422, "sim_render-ego2": 0.0035417270501587016, "sim_render-ego3": 0.0035916911275261747, "get_duckie_state": 2.4965462537728978e-06, "in-drivable-lane": 50.19999999999865, "deviation-heading": 10.151303216580253, "agent_compute-ego0": 0.03820331984018902, "agent_compute-ego1": 0.029427677467403365, "agent_compute-ego2": 0.02928732138291485, "agent_compute-ego3": 0.02938963412047425, "complete-iteration": 0.9780112319345976, "set_robot_commands": 0.0021510193687394497, "distance-from-start": 0.14186556448187643, "deviation-center-line": 0.5417311823893198, "driven_lanedir_consec": 0.041434923438779414, "sim_compute_sim_state": 0.0369724556369448, "sim_compute_performance-ego0": 0.0019931030908691, "sim_compute_performance-ego1": 0.0018587916419468356, "sim_compute_performance-ego2": 0.0018461766985433483, "sim_compute_performance-ego3": 0.001869304491816512}, "LFV_multi-full-zigzag-000-ego1": {"driven_any": 0.675595065733309, "get_ui_image": 0.05928286307062535, "step_physics": 0.7019781967086856, "survival_time": 59.99999999999873, "driven_lanedir": 0.02395957903739321, "get_state_dump": 0.008998569302713743, "get_robot_state": 0.013757020607280492, "sim_render-ego0": 0.0035526146995931937, "sim_render-ego1": 0.003578408175364422, "sim_render-ego2": 0.0035417270501587016, "sim_render-ego3": 0.0035916911275261747, "get_duckie_state": 2.4965462537728978e-06, "in-drivable-lane": 55.19999999999874, "deviation-heading": 4.611403955931515, "agent_compute-ego0": 0.03820331984018902, "agent_compute-ego1": 0.029427677467403365, "agent_compute-ego2": 0.02928732138291485, "agent_compute-ego3": 0.02938963412047425, "complete-iteration": 0.9780112319345976, "set_robot_commands": 0.0021510193687394497, "distance-from-start": 0.09831651427041506, "deviation-center-line": 0.497306018190106, "driven_lanedir_consec": 0.02395957903739321, "sim_compute_sim_state": 0.0369724556369448, "sim_compute_performance-ego0": 0.0019931030908691, "sim_compute_performance-ego1": 0.0018587916419468356, "sim_compute_performance-ego2": 0.0018461766985433483, "sim_compute_performance-ego3": 0.001869304491816512}, "LFV_multi-full-zigzag-000-ego2": {"driven_any": 0.6755965249449702, "get_ui_image": 0.05928286307062535, "step_physics": 0.7019781967086856, "survival_time": 59.99999999999873, "driven_lanedir": 0.02679870132037987, "get_state_dump": 0.008998569302713743, "get_robot_state": 0.013757020607280492, "sim_render-ego0": 0.0035526146995931937, "sim_render-ego1": 0.003578408175364422, "sim_render-ego2": 0.0035417270501587016, "sim_render-ego3": 0.0035916911275261747, "get_duckie_state": 2.4965462537728978e-06, "in-drivable-lane": 52.999999999998714, "deviation-heading": 7.784251439967816, "agent_compute-ego0": 0.03820331984018902, "agent_compute-ego1": 0.029427677467403365, "agent_compute-ego2": 0.02928732138291485, "agent_compute-ego3": 0.02938963412047425, "complete-iteration": 0.9780112319345976, "set_robot_commands": 0.0021510193687394497, "distance-from-start": 0.1537546701263195, "deviation-center-line": 0.4365348523508599, "driven_lanedir_consec": 0.02679870132037987, "sim_compute_sim_state": 0.0369724556369448, "sim_compute_performance-ego0": 0.0019931030908691, "sim_compute_performance-ego1": 0.0018587916419468356, "sim_compute_performance-ego2": 0.0018461766985433483, "sim_compute_performance-ego3": 0.001869304491816512}, "LFV_multi-full-zigzag-000-ego3": {"driven_any": 0.6755959753470083, "get_ui_image": 0.05928286307062535, "step_physics": 0.7019781967086856, "survival_time": 59.99999999999873, "driven_lanedir": 0.013648833707261332, "get_state_dump": 0.008998569302713743, "get_robot_state": 0.013757020607280492, "sim_render-ego0": 0.0035526146995931937, "sim_render-ego1": 0.003578408175364422, "sim_render-ego2": 0.0035417270501587016, "sim_render-ego3": 0.0035916911275261747, "get_duckie_state": 2.4965462537728978e-06, "in-drivable-lane": 53.19999999999868, "deviation-heading": 9.096753495869816, "agent_compute-ego0": 0.03820331984018902, "agent_compute-ego1": 0.029427677467403365, "agent_compute-ego2": 0.02928732138291485, "agent_compute-ego3": 0.02938963412047425, "complete-iteration": 0.9780112319345976, "set_robot_commands": 0.0021510193687394497, "distance-from-start": 0.14036721429972085, "deviation-center-line": 0.4523412492332766, "driven_lanedir_consec": 0.013648833707261332, "sim_compute_sim_state": 0.0369724556369448, "sim_compute_performance-ego0": 0.0019931030908691, "sim_compute_performance-ego1": 0.0018587916419468356, "sim_compute_performance-ego2": 0.0018461766985433483, "sim_compute_performance-ego3": 0.001869304491816512}}
set_robot_commands_max0.0021510193687394497
set_robot_commands_mean0.0021510193687394497
set_robot_commands_median0.0021510193687394497
set_robot_commands_min0.0021510193687394497
sim_compute_performance-ego0_max0.0019931030908691
sim_compute_performance-ego0_mean0.0019931030908691
sim_compute_performance-ego0_median0.0019931030908691
sim_compute_performance-ego0_min0.0019931030908691
sim_compute_performance-ego1_max0.0018587916419468356
sim_compute_performance-ego1_mean0.0018587916419468356
sim_compute_performance-ego1_median0.0018587916419468356
sim_compute_performance-ego1_min0.0018587916419468356
sim_compute_performance-ego2_max0.0018461766985433483
sim_compute_performance-ego2_mean0.0018461766985433483
sim_compute_performance-ego2_median0.0018461766985433483
sim_compute_performance-ego2_min0.0018461766985433483
sim_compute_performance-ego3_max0.001869304491816512
sim_compute_performance-ego3_mean0.001869304491816512
sim_compute_performance-ego3_median0.001869304491816512
sim_compute_performance-ego3_min0.001869304491816512
sim_compute_sim_state_max0.0369724556369448
sim_compute_sim_state_mean0.0369724556369448
sim_compute_sim_state_median0.0369724556369448
sim_compute_sim_state_min0.0369724556369448
sim_render-ego0_max0.0035526146995931937
sim_render-ego0_mean0.0035526146995931937
sim_render-ego0_median0.0035526146995931937
sim_render-ego0_min0.0035526146995931937
sim_render-ego1_max0.003578408175364422
sim_render-ego1_mean0.003578408175364422
sim_render-ego1_median0.003578408175364422
sim_render-ego1_min0.003578408175364422
sim_render-ego2_max0.0035417270501587016
sim_render-ego2_mean0.0035417270501587016
sim_render-ego2_median0.0035417270501587016
sim_render-ego2_min0.0035417270501587016
sim_render-ego3_max0.0035916911275261747
sim_render-ego3_mean0.0035916911275261747
sim_render-ego3_median0.0035916911275261747
sim_render-ego3_min0.0035916911275261747
simulation-passed1
step_physics_max0.7019781967086856
step_physics_mean0.7019781967086856
step_physics_median0.7019781967086856
step_physics_min0.7019781967086856
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91941sim-1of4successyes0:34:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median51.49999999999865
driven_lanedir_consec_median0.020917590239281303
deviation-center-line_median0.556493087388587


other stats
agent_compute-ego0_max0.02607624636006097
agent_compute-ego0_mean0.02607624636006097
agent_compute-ego0_median0.02607624636006097
agent_compute-ego0_min0.02607624636006097
agent_compute-ego1_max0.026041978602603908
agent_compute-ego1_mean0.026041978602603908
agent_compute-ego1_median0.026041978602603908
agent_compute-ego1_min0.026041978602603908
agent_compute-ego2_max0.026361214926002623
agent_compute-ego2_mean0.026361214926002623
agent_compute-ego2_median0.026361214926002623
agent_compute-ego2_min0.026361214926002623
agent_compute-ego3_max0.026863764366639047
agent_compute-ego3_mean0.026863764366639047
agent_compute-ego3_median0.026863764366639047
agent_compute-ego3_min0.026863764366639047
complete-iteration_max0.9100557290743432
complete-iteration_mean0.9100557290743432
complete-iteration_median0.9100557290743432
complete-iteration_min0.9100557290743432
deviation-center-line_max0.6505601746889484
deviation-center-line_mean0.5510523277325894
deviation-center-line_min0.4406629614642348
deviation-heading_max10.948852543761456
deviation-heading_mean9.19025678340627
deviation-heading_median10.107983013164372
deviation-heading_min5.596208563534886
distance-from-start_max0.16662864554497347
distance-from-start_mean0.1430193364469008
distance-from-start_median0.14598681487670945
distance-from-start_min0.11347507048921088
driven_any_max0.6755992268080365
driven_any_mean0.6755971856400429
driven_any_median0.6755972149368006
driven_any_min0.6755950858785338
driven_lanedir_consec_max0.07286938408054211
driven_lanedir_consec_mean0.03300318698149307
driven_lanedir_consec_min0.01730818336686757
driven_lanedir_max0.07286938408054211
driven_lanedir_mean0.03300318698149307
driven_lanedir_median0.020917590239281303
driven_lanedir_min0.01730818336686757
get_duckie_state_max1.4062924349337791e-06
get_duckie_state_mean1.4062924349337791e-06
get_duckie_state_median1.4062924349337791e-06
get_duckie_state_min1.4062924349337791e-06
get_robot_state_max0.01319922535346013
get_robot_state_mean0.01319922535346013
get_robot_state_median0.01319922535346013
get_robot_state_min0.01319922535346013
get_state_dump_max0.00890879646923818
get_state_dump_mean0.00890879646923818
get_state_dump_median0.00890879646923818
get_state_dump_min0.00890879646923818
get_ui_image_max0.05813504436629499
get_ui_image_mean0.05813504436629499
get_ui_image_median0.05813504436629499
get_ui_image_min0.05813504436629499
in-drivable-lane_max55.09999999999873
in-drivable-lane_mean51.57499999999868
in-drivable-lane_min48.19999999999868
per-episodes
details{"LFV_multi-full-techtrack-000-ego0": {"driven_any": 0.6755992268080365, "get_ui_image": 0.05813504436629499, "step_physics": 0.6617218963708806, "survival_time": 59.99999999999873, "driven_lanedir": 0.07286938408054211, "get_state_dump": 0.00890879646923818, "get_robot_state": 0.01319922535346013, "sim_render-ego0": 0.003461555080747326, "sim_render-ego1": 0.0034174728552368062, "sim_render-ego2": 0.003458620408095487, "sim_render-ego3": 0.0034459705257495177, "get_duckie_state": 1.4062924349337791e-06, "in-drivable-lane": 48.19999999999868, "deviation-heading": 9.27292013819991, "agent_compute-ego0": 0.02607624636006097, "agent_compute-ego1": 0.026041978602603908, "agent_compute-ego2": 0.026361214926002623, "agent_compute-ego3": 0.026863764366639047, "complete-iteration": 0.9100557290743432, "set_robot_commands": 0.002116939209581513, "distance-from-start": 0.1265259939651348, "deviation-center-line": 0.46480386478027014, "driven_lanedir_consec": 0.07286938408054211, "sim_compute_sim_state": 0.03330810997110918, "sim_compute_performance-ego0": 0.0019184520699201677, "sim_compute_performance-ego1": 0.0017376380796535725, "sim_compute_performance-ego2": 0.0017695252246205555, "sim_compute_performance-ego3": 0.001768267224174455}, "LFV_multi-full-techtrack-000-ego1": {"driven_any": 0.6755950858785338, "get_ui_image": 0.05813504436629499, "step_physics": 0.6617218963708806, "survival_time": 59.99999999999873, "driven_lanedir": 0.01730818336686757, "get_state_dump": 0.00890879646923818, "get_robot_state": 0.01319922535346013, "sim_render-ego0": 0.003461555080747326, "sim_render-ego1": 0.0034174728552368062, "sim_render-ego2": 0.003458620408095487, "sim_render-ego3": 0.0034459705257495177, "get_duckie_state": 1.4062924349337791e-06, "in-drivable-lane": 55.09999999999873, "deviation-heading": 5.596208563534886, "agent_compute-ego0": 0.02607624636006097, "agent_compute-ego1": 0.026041978602603908, "agent_compute-ego2": 0.026361214926002623, "agent_compute-ego3": 0.026863764366639047, "complete-iteration": 0.9100557290743432, "set_robot_commands": 0.002116939209581513, "distance-from-start": 0.11347507048921088, "deviation-center-line": 0.4406629614642348, "driven_lanedir_consec": 0.01730818336686757, "sim_compute_sim_state": 0.03330810997110918, "sim_compute_performance-ego0": 0.0019184520699201677, "sim_compute_performance-ego1": 0.0017376380796535725, "sim_compute_performance-ego2": 0.0017695252246205555, "sim_compute_performance-ego3": 0.001768267224174455}, "LFV_multi-full-techtrack-000-ego2": {"driven_any": 0.6755972254180339, "get_ui_image": 0.05813504436629499, "step_physics": 0.6617218963708806, "survival_time": 59.99999999999873, "driven_lanedir": 0.020894237201504406, "get_state_dump": 0.00890879646923818, "get_robot_state": 0.01319922535346013, "sim_render-ego0": 0.003461555080747326, "sim_render-ego1": 0.0034174728552368062, "sim_render-ego2": 0.003458620408095487, "sim_render-ego3": 0.0034459705257495177, "get_duckie_state": 1.4062924349337791e-06, "in-drivable-lane": 51.49999999999865, "deviation-heading": 10.948852543761456, "agent_compute-ego0": 0.02607624636006097, "agent_compute-ego1": 0.026041978602603908, "agent_compute-ego2": 0.026361214926002623, "agent_compute-ego3": 0.026863764366639047, "complete-iteration": 0.9100557290743432, "set_robot_commands": 0.002116939209581513, "distance-from-start": 0.16662864554497347, "deviation-center-line": 0.6505601746889484, "driven_lanedir_consec": 0.020894237201504406, "sim_compute_sim_state": 0.03330810997110918, "sim_compute_performance-ego0": 0.0019184520699201677, "sim_compute_performance-ego1": 0.0017376380796535725, "sim_compute_performance-ego2": 0.0017695252246205555, "sim_compute_performance-ego3": 0.001768267224174455}, "LFV_multi-full-techtrack-000-ego3": {"driven_any": 0.6755972044555673, "get_ui_image": 0.05813504436629499, "step_physics": 0.6617218963708806, "survival_time": 59.99999999999873, "driven_lanedir": 0.0209409432770582, "get_state_dump": 0.00890879646923818, "get_robot_state": 0.01319922535346013, "sim_render-ego0": 0.003461555080747326, "sim_render-ego1": 0.0034174728552368062, "sim_render-ego2": 0.003458620408095487, "sim_render-ego3": 0.0034459705257495177, "get_duckie_state": 1.4062924349337791e-06, "in-drivable-lane": 51.49999999999866, "deviation-heading": 10.943045888128832, "agent_compute-ego0": 0.02607624636006097, "agent_compute-ego1": 0.026041978602603908, "agent_compute-ego2": 0.026361214926002623, "agent_compute-ego3": 0.026863764366639047, "complete-iteration": 0.9100557290743432, "set_robot_commands": 0.002116939209581513, "distance-from-start": 0.16544763578828406, "deviation-center-line": 0.648182309996904, "driven_lanedir_consec": 0.0209409432770582, "sim_compute_sim_state": 0.03330810997110918, "sim_compute_performance-ego0": 0.0019184520699201677, "sim_compute_performance-ego1": 0.0017376380796535725, "sim_compute_performance-ego2": 0.0017695252246205555, "sim_compute_performance-ego3": 0.001768267224174455}}
set_robot_commands_max0.002116939209581513
set_robot_commands_mean0.002116939209581513
set_robot_commands_median0.002116939209581513
set_robot_commands_min0.002116939209581513
sim_compute_performance-ego0_max0.0019184520699201677
sim_compute_performance-ego0_mean0.0019184520699201677
sim_compute_performance-ego0_median0.0019184520699201677
sim_compute_performance-ego0_min0.0019184520699201677
sim_compute_performance-ego1_max0.0017376380796535725
sim_compute_performance-ego1_mean0.0017376380796535725
sim_compute_performance-ego1_median0.0017376380796535725
sim_compute_performance-ego1_min0.0017376380796535725
sim_compute_performance-ego2_max0.0017695252246205555
sim_compute_performance-ego2_mean0.0017695252246205555
sim_compute_performance-ego2_median0.0017695252246205555
sim_compute_performance-ego2_min0.0017695252246205555
sim_compute_performance-ego3_max0.001768267224174455
sim_compute_performance-ego3_mean0.001768267224174455
sim_compute_performance-ego3_median0.001768267224174455
sim_compute_performance-ego3_min0.001768267224174455
sim_compute_sim_state_max0.03330810997110918
sim_compute_sim_state_mean0.03330810997110918
sim_compute_sim_state_median0.03330810997110918
sim_compute_sim_state_min0.03330810997110918
sim_render-ego0_max0.003461555080747326
sim_render-ego0_mean0.003461555080747326
sim_render-ego0_median0.003461555080747326
sim_render-ego0_min0.003461555080747326
sim_render-ego1_max0.0034174728552368062
sim_render-ego1_mean0.0034174728552368062
sim_render-ego1_median0.0034174728552368062
sim_render-ego1_min0.0034174728552368062
sim_render-ego2_max0.003458620408095487
sim_render-ego2_mean0.003458620408095487
sim_render-ego2_median0.003458620408095487
sim_render-ego2_min0.003458620408095487
sim_render-ego3_max0.0034459705257495177
sim_render-ego3_mean0.0034459705257495177
sim_render-ego3_median0.0034459705257495177
sim_render-ego3_min0.0034459705257495177
simulation-passed1
step_physics_max0.6617218963708806
step_physics_mean0.6617218963708806
step_physics_median0.6617218963708806
step_physics_min0.6617218963708806
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91940sim-3of4successyes0:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.44999999999872
driven_lanedir_consec_median0.028134900149824116
deviation-center-line_median0.5330758152292719


other stats
agent_compute-ego0_max0.014285097114251714
agent_compute-ego0_mean0.014285097114251714
agent_compute-ego0_median0.014285097114251714
agent_compute-ego0_min0.014285097114251714
agent_compute-ego1_max0.014396936669139245
agent_compute-ego1_mean0.014396936669139245
agent_compute-ego1_median0.014396936669139245
agent_compute-ego1_min0.014396936669139245
complete-iteration_max0.3162075611673525
complete-iteration_mean0.3162075611673525
complete-iteration_median0.3162075611673525
complete-iteration_min0.3162075611673525
deviation-center-line_max0.5404798398603777
deviation-center-line_mean0.5330758152292719
deviation-center-line_min0.5256717905981662
deviation-heading_max8.632710329793825
deviation-heading_mean6.893902062199389
deviation-heading_median6.893902062199389
deviation-heading_min5.155093794604954
distance-from-start_max0.1696988224639465
distance-from-start_mean0.13873032301918897
distance-from-start_median0.13873032301918897
distance-from-start_min0.10776182357443148
driven_any_max0.6755969429203665
driven_any_mean0.6755960521442712
driven_any_median0.6755960521442712
driven_any_min0.6755951613681758
driven_lanedir_consec_max0.029643440408403388
driven_lanedir_consec_mean0.028134900149824116
driven_lanedir_consec_min0.026626359891244844
driven_lanedir_max0.029643440408403388
driven_lanedir_mean0.028134900149824116
driven_lanedir_median0.028134900149824116
driven_lanedir_min0.026626359891244844
get_duckie_state_max1.1116936244535805e-06
get_duckie_state_mean1.1116936244535805e-06
get_duckie_state_median1.1116936244535805e-06
get_duckie_state_min1.1116936244535805e-06
get_robot_state_max0.0067655563751525625
get_robot_state_mean0.0067655563751525625
get_robot_state_median0.0067655563751525625
get_robot_state_min0.0067655563751525625
get_state_dump_max0.005743197457776478
get_state_dump_mean0.005743197457776478
get_state_dump_median0.005743197457776478
get_state_dump_min0.005743197457776478
get_ui_image_max0.03691134087549062
get_ui_image_mean0.03691134087549062
get_ui_image_median0.03691134087549062
get_ui_image_min0.03691134087549062
in-drivable-lane_max54.64999999999874
in-drivable-lane_mean53.44999999999872
in-drivable-lane_min52.24999999999871
per-episodes
details{"LFV_multi-full-small_loop-000-ego0": {"driven_any": 0.6755969429203665, "get_ui_image": 0.03691134087549062, "step_physics": 0.21511514220606973, "survival_time": 59.99999999999873, "driven_lanedir": 0.029643440408403388, "get_state_dump": 0.005743197457776478, "get_robot_state": 0.0067655563751525625, "sim_render-ego0": 0.003430688311714217, "sim_render-ego1": 0.0034000740559472333, "get_duckie_state": 1.1116936244535805e-06, "in-drivable-lane": 52.24999999999871, "deviation-heading": 8.632710329793825, "agent_compute-ego0": 0.014285097114251714, "agent_compute-ego1": 0.014396936669139245, "complete-iteration": 0.3162075611673525, "set_robot_commands": 0.0020336314700823044, "distance-from-start": 0.1696988224639465, "deviation-center-line": 0.5404798398603777, "driven_lanedir_consec": 0.029643440408403388, "sim_compute_sim_state": 0.008386884501931272, "sim_compute_performance-ego0": 0.001819788268166319, "sim_compute_performance-ego1": 0.001767083866014568}, "LFV_multi-full-small_loop-000-ego1": {"driven_any": 0.6755951613681758, "get_ui_image": 0.03691134087549062, "step_physics": 0.21511514220606973, "survival_time": 59.99999999999873, "driven_lanedir": 0.026626359891244844, "get_state_dump": 0.005743197457776478, "get_robot_state": 0.0067655563751525625, "sim_render-ego0": 0.003430688311714217, "sim_render-ego1": 0.0034000740559472333, "get_duckie_state": 1.1116936244535805e-06, "in-drivable-lane": 54.64999999999874, "deviation-heading": 5.155093794604954, "agent_compute-ego0": 0.014285097114251714, "agent_compute-ego1": 0.014396936669139245, "complete-iteration": 0.3162075611673525, "set_robot_commands": 0.0020336314700823044, "distance-from-start": 0.10776182357443148, "deviation-center-line": 0.5256717905981662, "driven_lanedir_consec": 0.026626359891244844, "sim_compute_sim_state": 0.008386884501931272, "sim_compute_performance-ego0": 0.001819788268166319, "sim_compute_performance-ego1": 0.001767083866014568}}
set_robot_commands_max0.0020336314700823044
set_robot_commands_mean0.0020336314700823044
set_robot_commands_median0.0020336314700823044
set_robot_commands_min0.0020336314700823044
sim_compute_performance-ego0_max0.001819788268166319
sim_compute_performance-ego0_mean0.001819788268166319
sim_compute_performance-ego0_median0.001819788268166319
sim_compute_performance-ego0_min0.001819788268166319
sim_compute_performance-ego1_max0.001767083866014568
sim_compute_performance-ego1_mean0.001767083866014568
sim_compute_performance-ego1_median0.001767083866014568
sim_compute_performance-ego1_min0.001767083866014568
sim_compute_sim_state_max0.008386884501931272
sim_compute_sim_state_mean0.008386884501931272
sim_compute_sim_state_median0.008386884501931272
sim_compute_sim_state_min0.008386884501931272
sim_render-ego0_max0.003430688311714217
sim_render-ego0_mean0.003430688311714217
sim_render-ego0_median0.003430688311714217
sim_render-ego0_min0.003430688311714217
sim_render-ego1_max0.0034000740559472333
sim_render-ego1_mean0.0034000740559472333
sim_render-ego1_median0.0034000740559472333
sim_render-ego1_min0.0034000740559472333
simulation-passed1
step_physics_max0.21511514220606973
step_physics_mean0.21511514220606973
step_physics_median0.21511514220606973
step_physics_min0.21511514220606973
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91937sim-0of4successyes0:33:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91936sim-2of4successyes0:37:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91933sim-1of4successyes0:36:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91830sim-2of4timeoutyes----No reset possible
91829sim-1of4timeoutyes----No reset possible
91822sim-2of4host-erroryes0:18:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/aido-LFV_multi_full-sim-validation/submission15373/sim-2of4-nogpu-production-b-spot-0-03-job91822-a-wd/challenge-evaluation-output/episodes/LFV_multi-full-zigzag-000/log.gs2.cbor' -> '/tmp/tmpuqlpy6ntlog.gs2.cbor'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76724sim-0of4successyes0:33:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76723sim-1of4successyes0:35:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76722sim-3of4successyes0:15:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76721sim-2of4successyes0:37:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible