Duckietown Challenges Home Challenges Submissions

Submission 15277

Submission15277
Competingyes
Challengeaido-LF_full-sim-validation
UserAlessandro Zanardi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 92200 sim-1of4: 92202 sim-2of4: 92199 sim-3of4: 92201
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

92202

Click the images to see detailed statistics about the episode.

LF-full-small_loop-000

92201

Click the images to see detailed statistics about the episode.

LF-full-zigzag-000

92200

Click the images to see detailed statistics about the episode.

LF-full-techtrack-000

92199

Click the images to see detailed statistics about the episode.

LF-full-loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
92202sim-1of4successyes0:08:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.3999999999998565
driven_lanedir_consec_median3.308747784339996
deviation-center-line_median6.377703499652585


other stats
agent_compute-ego0_max0.022585893253005612
agent_compute-ego0_mean0.022585893253005612
agent_compute-ego0_median0.022585893253005612
agent_compute-ego0_min0.022585893253005612
complete-iteration_max0.14169378026538249
complete-iteration_mean0.14169378026538249
complete-iteration_median0.14169378026538249
complete-iteration_min0.14169378026538249
deviation-center-line_max6.377703499652585
deviation-center-line_mean6.377703499652585
deviation-center-line_min6.377703499652585
deviation-heading_max5.894758056900745
deviation-heading_mean5.894758056900745
deviation-heading_median5.894758056900745
deviation-heading_min5.894758056900745
distance-from-start_max1.616008101033832
distance-from-start_mean1.616008101033832
distance-from-start_median1.616008101033832
distance-from-start_min1.616008101033832
driven_any_max3.48571993032436
driven_any_mean3.48571993032436
driven_any_median3.48571993032436
driven_any_min3.48571993032436
driven_lanedir_consec_max3.308747784339996
driven_lanedir_consec_mean3.308747784339996
driven_lanedir_consec_min3.308747784339996
driven_lanedir_max3.308747784339996
driven_lanedir_mean3.308747784339996
driven_lanedir_median3.308747784339996
driven_lanedir_min3.308747784339996
get_duckie_state_max1.1011722383650018e-06
get_duckie_state_mean1.1011722383650018e-06
get_duckie_state_median1.1011722383650018e-06
get_duckie_state_min1.1011722383650018e-06
get_robot_state_max0.003282136067462702
get_robot_state_mean0.003282136067462702
get_robot_state_median0.003282136067462702
get_robot_state_min0.003282136067462702
get_state_dump_max0.004219013884303771
get_state_dump_mean0.004219013884303771
get_state_dump_median0.004219013884303771
get_state_dump_min0.004219013884303771
get_ui_image_max0.03490693305156114
get_ui_image_mean0.03490693305156114
get_ui_image_median0.03490693305156114
get_ui_image_min0.03490693305156114
in-drivable-lane_max3.3999999999998565
in-drivable-lane_mean3.3999999999998565
in-drivable-lane_min3.3999999999998565
per-episodes
details{"LF-full-small_loop-000-ego0": {"driven_any": 3.48571993032436, "get_ui_image": 0.03490693305156114, "step_physics": 0.06484689502096692, "survival_time": 59.99999999999873, "driven_lanedir": 3.308747784339996, "get_state_dump": 0.004219013884303771, "get_robot_state": 0.003282136067462702, "sim_render-ego0": 0.003265060453391095, "get_duckie_state": 1.1011722383650018e-06, "in-drivable-lane": 3.3999999999998565, "deviation-heading": 5.894758056900745, "agent_compute-ego0": 0.022585893253005612, "complete-iteration": 0.14169378026538249, "set_robot_commands": 0.001904877695215433, "distance-from-start": 1.616008101033832, "deviation-center-line": 6.377703499652585, "driven_lanedir_consec": 3.308747784339996, "sim_compute_sim_state": 0.0050227374061755994, "sim_compute_performance-ego0": 0.0015889161036076098}}
set_robot_commands_max0.001904877695215433
set_robot_commands_mean0.001904877695215433
set_robot_commands_median0.001904877695215433
set_robot_commands_min0.001904877695215433
sim_compute_performance-ego0_max0.0015889161036076098
sim_compute_performance-ego0_mean0.0015889161036076098
sim_compute_performance-ego0_median0.0015889161036076098
sim_compute_performance-ego0_min0.0015889161036076098
sim_compute_sim_state_max0.0050227374061755994
sim_compute_sim_state_mean0.0050227374061755994
sim_compute_sim_state_median0.0050227374061755994
sim_compute_sim_state_min0.0050227374061755994
sim_render-ego0_max0.003265060453391095
sim_render-ego0_mean0.003265060453391095
sim_render-ego0_median0.003265060453391095
sim_render-ego0_min0.003265060453391095
simulation-passed1
step_physics_max0.06484689502096692
step_physics_mean0.06484689502096692
step_physics_median0.06484689502096692
step_physics_min0.06484689502096692
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
92201sim-3of4successyes0:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median1.946053871612075
deviation-center-line_median5.552673446020271


other stats
agent_compute-ego0_max0.03512011658242104
agent_compute-ego0_mean0.03512011658242104
agent_compute-ego0_median0.03512011658242104
agent_compute-ego0_min0.03512011658242104
complete-iteration_max0.18246338548112373
complete-iteration_mean0.18246338548112373
complete-iteration_median0.18246338548112373
complete-iteration_min0.18246338548112373
deviation-center-line_max5.552673446020271
deviation-center-line_mean5.552673446020271
deviation-center-line_min5.552673446020271
deviation-heading_max9.840316861580805
deviation-heading_mean9.840316861580805
deviation-heading_median9.840316861580805
deviation-heading_min9.840316861580805
distance-from-start_max1.058945306660356
distance-from-start_mean1.058945306660356
distance-from-start_median1.058945306660356
distance-from-start_min1.058945306660356
driven_any_max3.449079624640792
driven_any_mean3.449079624640792
driven_any_median3.449079624640792
driven_any_min3.449079624640792
driven_lanedir_consec_max1.946053871612075
driven_lanedir_consec_mean1.946053871612075
driven_lanedir_consec_min1.946053871612075
driven_lanedir_max3.182829444739326
driven_lanedir_mean3.182829444739326
driven_lanedir_median3.182829444739326
driven_lanedir_min3.182829444739326
get_duckie_state_max1.0892612352458564e-06
get_duckie_state_mean1.0892612352458564e-06
get_duckie_state_median1.0892612352458564e-06
get_duckie_state_min1.0892612352458564e-06
get_robot_state_max0.003325912775743216
get_robot_state_mean0.003325912775743216
get_robot_state_median0.003325912775743216
get_robot_state_min0.003325912775743216
get_state_dump_max0.004331626860327169
get_state_dump_mean0.004331626860327169
get_state_dump_median0.004331626860327169
get_state_dump_min0.004331626860327169
get_ui_image_max0.042467961402658023
get_ui_image_mean0.042467961402658023
get_ui_image_median0.042467961402658023
get_ui_image_min0.042467961402658023
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"LF-full-zigzag-000-ego0": {"driven_any": 3.449079624640792, "get_ui_image": 0.042467961402658023, "step_physics": 0.08101824439633995, "survival_time": 59.99999999999873, "driven_lanedir": 3.182829444739326, "get_state_dump": 0.004331626860327169, "get_robot_state": 0.003325912775743216, "sim_render-ego0": 0.0034483830994313006, "get_duckie_state": 1.0892612352458564e-06, "in-drivable-lane": 4.349999999999895, "deviation-heading": 9.840316861580805, "agent_compute-ego0": 0.03512011658242104, "complete-iteration": 0.18246338548112373, "set_robot_commands": 0.0020508063425132375, "distance-from-start": 1.058945306660356, "deviation-center-line": 5.552673446020271, "driven_lanedir_consec": 1.946053871612075, "sim_compute_sim_state": 0.008834754696098792, "sim_compute_performance-ego0": 0.0017818854710740114}}
set_robot_commands_max0.0020508063425132375
set_robot_commands_mean0.0020508063425132375
set_robot_commands_median0.0020508063425132375
set_robot_commands_min0.0020508063425132375
sim_compute_performance-ego0_max0.0017818854710740114
sim_compute_performance-ego0_mean0.0017818854710740114
sim_compute_performance-ego0_median0.0017818854710740114
sim_compute_performance-ego0_min0.0017818854710740114
sim_compute_sim_state_max0.008834754696098792
sim_compute_sim_state_mean0.008834754696098792
sim_compute_sim_state_median0.008834754696098792
sim_compute_sim_state_min0.008834754696098792
sim_render-ego0_max0.0034483830994313006
sim_render-ego0_mean0.0034483830994313006
sim_render-ego0_median0.0034483830994313006
sim_render-ego0_min0.0034483830994313006
simulation-passed1
step_physics_max0.08101824439633995
step_physics_mean0.08101824439633995
step_physics_median0.08101824439633995
step_physics_min0.08101824439633995
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
92200sim-0of4successyes0:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5513079720601755
deviation-center-line_median6.02900364172413


other stats
agent_compute-ego0_max0.029252093797123103
agent_compute-ego0_mean0.029252093797123103
agent_compute-ego0_median0.029252093797123103
agent_compute-ego0_min0.029252093797123103
complete-iteration_max0.1589756218420278
complete-iteration_mean0.1589756218420278
complete-iteration_median0.1589756218420278
complete-iteration_min0.1589756218420278
deviation-center-line_max6.02900364172413
deviation-center-line_mean6.02900364172413
deviation-center-line_min6.02900364172413
deviation-heading_max2.734316919838232
deviation-heading_mean2.734316919838232
deviation-heading_median2.734316919838232
deviation-heading_min2.734316919838232
distance-from-start_max2.723729721919248
distance-from-start_mean2.723729721919248
distance-from-start_median2.723729721919248
distance-from-start_min2.723729721919248
driven_any_max3.579596444910935
driven_any_mean3.579596444910935
driven_any_median3.579596444910935
driven_any_min3.579596444910935
driven_lanedir_consec_max3.5513079720601755
driven_lanedir_consec_mean3.5513079720601755
driven_lanedir_consec_min3.5513079720601755
driven_lanedir_max3.5513079720601755
driven_lanedir_mean3.5513079720601755
driven_lanedir_median3.5513079720601755
driven_lanedir_min3.5513079720601755
get_duckie_state_max1.116656542419891e-06
get_duckie_state_mean1.116656542419891e-06
get_duckie_state_median1.116656542419891e-06
get_duckie_state_min1.116656542419891e-06
get_robot_state_max0.003206764033791624
get_robot_state_mean0.003206764033791624
get_robot_state_median0.003206764033791624
get_robot_state_min0.003206764033791624
get_state_dump_max0.004125030312708871
get_state_dump_mean0.004125030312708871
get_state_dump_median0.004125030312708871
get_state_dump_min0.004125030312708871
get_ui_image_max0.03944889254415164
get_ui_image_mean0.03944889254415164
get_ui_image_median0.03944889254415164
get_ui_image_min0.03944889254415164
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-full-techtrack-000-ego0": {"driven_any": 3.579596444910935, "get_ui_image": 0.03944889254415164, "step_physics": 0.06650427418088635, "survival_time": 59.99999999999873, "driven_lanedir": 3.5513079720601755, "get_state_dump": 0.004125030312708871, "get_robot_state": 0.003206764033791624, "sim_render-ego0": 0.0032270192901458867, "get_duckie_state": 1.116656542419891e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.734316919838232, "agent_compute-ego0": 0.029252093797123103, "complete-iteration": 0.1589756218420278, "set_robot_commands": 0.0019436390771159124, "distance-from-start": 2.723729721919248, "deviation-center-line": 6.02900364172413, "driven_lanedir_consec": 3.5513079720601755, "sim_compute_sim_state": 0.00953790131059912, "sim_compute_performance-ego0": 0.0016538862582547382}}
set_robot_commands_max0.0019436390771159124
set_robot_commands_mean0.0019436390771159124
set_robot_commands_median0.0019436390771159124
set_robot_commands_min0.0019436390771159124
sim_compute_performance-ego0_max0.0016538862582547382
sim_compute_performance-ego0_mean0.0016538862582547382
sim_compute_performance-ego0_median0.0016538862582547382
sim_compute_performance-ego0_min0.0016538862582547382
sim_compute_sim_state_max0.00953790131059912
sim_compute_sim_state_mean0.00953790131059912
sim_compute_sim_state_median0.00953790131059912
sim_compute_sim_state_min0.00953790131059912
sim_render-ego0_max0.0032270192901458867
sim_render-ego0_mean0.0032270192901458867
sim_render-ego0_median0.0032270192901458867
sim_render-ego0_min0.0032270192901458867
simulation-passed1
step_physics_max0.06650427418088635
step_physics_mean0.06650427418088635
step_physics_median0.06650427418088635
step_physics_min0.06650427418088635
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
92199sim-2of4successyes0:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.4999999999999005
driven_lanedir_consec_median1.921903570955522
deviation-center-line_median6.258162721498459


other stats
agent_compute-ego0_max0.02620877016593177
agent_compute-ego0_mean0.02620877016593177
agent_compute-ego0_median0.02620877016593177
agent_compute-ego0_min0.02620877016593177
complete-iteration_max0.15630948215996
complete-iteration_mean0.15630948215996
complete-iteration_median0.15630948215996
complete-iteration_min0.15630948215996
deviation-center-line_max6.258162721498459
deviation-center-line_mean6.258162721498459
deviation-center-line_min6.258162721498459
deviation-heading_max7.339415897695058
deviation-heading_mean7.339415897695058
deviation-heading_median7.339415897695058
deviation-heading_min7.339415897695058
distance-from-start_max1.1754848688337045
distance-from-start_mean1.1754848688337045
distance-from-start_median1.1754848688337045
distance-from-start_min1.1754848688337045
driven_any_max3.445827271849358
driven_any_mean3.445827271849358
driven_any_median3.445827271849358
driven_any_min3.445827271849358
driven_lanedir_consec_max1.921903570955522
driven_lanedir_consec_mean1.921903570955522
driven_lanedir_consec_min1.921903570955522
driven_lanedir_max3.2076308181151987
driven_lanedir_mean3.2076308181151987
driven_lanedir_median3.2076308181151987
driven_lanedir_min3.2076308181151987
get_duckie_state_max1.1055396061753552e-06
get_duckie_state_mean1.1055396061753552e-06
get_duckie_state_median1.1055396061753552e-06
get_duckie_state_min1.1055396061753552e-06
get_robot_state_max0.003298171056895133
get_robot_state_mean0.003298171056895133
get_robot_state_median0.003298171056895133
get_robot_state_min0.003298171056895133
get_state_dump_max0.004142496607682786
get_state_dump_mean0.004142496607682786
get_state_dump_median0.004142496607682786
get_state_dump_min0.004142496607682786
get_ui_image_max0.03510356644210371
get_ui_image_mean0.03510356644210371
get_ui_image_median0.03510356644210371
get_ui_image_min0.03510356644210371
in-drivable-lane_max4.4999999999999005
in-drivable-lane_mean4.4999999999999005
in-drivable-lane_min4.4999999999999005
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.445827271849358, "get_ui_image": 0.03510356644210371, "step_physics": 0.07259763508017712, "survival_time": 59.99999999999873, "driven_lanedir": 3.2076308181151987, "get_state_dump": 0.004142496607682786, "get_robot_state": 0.003298171056895133, "sim_render-ego0": 0.0033152645374714186, "get_duckie_state": 1.1055396061753552e-06, "in-drivable-lane": 4.4999999999999005, "deviation-heading": 7.339415897695058, "agent_compute-ego0": 0.02620877016593177, "complete-iteration": 0.15630948215996, "set_robot_commands": 0.0019895006079757144, "distance-from-start": 1.1754848688337045, "deviation-center-line": 6.258162721498459, "driven_lanedir_consec": 1.921903570955522, "sim_compute_sim_state": 0.007917161785891212, "sim_compute_performance-ego0": 0.0016620482731421326}}
set_robot_commands_max0.0019895006079757144
set_robot_commands_mean0.0019895006079757144
set_robot_commands_median0.0019895006079757144
set_robot_commands_min0.0019895006079757144
sim_compute_performance-ego0_max0.0016620482731421326
sim_compute_performance-ego0_mean0.0016620482731421326
sim_compute_performance-ego0_median0.0016620482731421326
sim_compute_performance-ego0_min0.0016620482731421326
sim_compute_sim_state_max0.007917161785891212
sim_compute_sim_state_mean0.007917161785891212
sim_compute_sim_state_median0.007917161785891212
sim_compute_sim_state_min0.007917161785891212
sim_render-ego0_max0.0033152645374714186
sim_render-ego0_mean0.0033152645374714186
sim_render-ego0_median0.0033152645374714186
sim_render-ego0_min0.0033152645374714186
simulation-passed1
step_physics_max0.07259763508017712
step_physics_mean0.07259763508017712
step_physics_median0.07259763508017712
step_physics_min0.07259763508017712
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
76498sim-0of4successyes0:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76497sim-3of4successyes0:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76496sim-2of4successyes0:08:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76495sim-1of4successyes0:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible