Duckietown Challenges Home Challenges Submissions

Evaluator 5255

ID5255
evaluatornogpu-production-b-spot-0-04
ownerI don't have one 😀
machinenogpu-production-b-spot-0_3ee39c74cc11
processnogpu-production-b-spot-0-04_3ee39c74cc11
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success21 77146
# timeout
# failed1 77340
# error
# aborted3 77259
# host-error1 77369
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)184.7 GB
RAM free (MB)150.8 GB
Disk (MB)969.3 GB
Disk available (MB)292.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7791314795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval0-visualizesuccessnonogpu-production-b-spot-0-040:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.8815817974125577
survival_time20.399778366088867
deviation-center-line0.6184571124714398
in-drivable-lane7.399988651275635


other stats
deviation-heading1.1485227849077762
distance-from-start2.4266143223248395
driven_any2.8763012909981693
driven_lanedir1.8815817974125577
visualized-eval0-passed1
No reset possible
7761415673Dimitrios Dimopoulosexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-040:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.8680122098032585


other stats
agent_compute-ego0_max0.010434657641619488
agent_compute-ego0_mean0.010434657641619488
agent_compute-ego0_median0.010434657641619488
agent_compute-ego0_min0.010434657641619488
complete-iteration_max0.287149314838359
complete-iteration_mean0.287149314838359
complete-iteration_median0.287149314838359
complete-iteration_min0.287149314838359
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.8680122098032585
distance-from-start_median4.8680122098032585
distance-from-start_min4.8680122098032585
driven_any_max4.999620190248149
driven_any_mean4.999620190248149
driven_any_median4.999620190248149
driven_any_min4.999620190248149
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11608279994230788
get_duckie_state_mean0.11608279994230788
get_duckie_state_median0.11608279994230788
get_duckie_state_min0.11608279994230788
get_robot_state_max0.003682127783126943
get_robot_state_mean0.003682127783126943
get_robot_state_median0.003682127783126943
get_robot_state_min0.003682127783126943
get_state_dump_max0.021311358733324227
get_state_dump_mean0.021311358733324227
get_state_dump_median0.021311358733324227
get_state_dump_min0.021311358733324227
get_ui_image_max0.04315209528773192
get_ui_image_mean0.04315209528773192
get_ui_image_median0.04315209528773192
get_ui_image_min0.04315209528773192
in-drivable-lane_max34.000000000000206
in-drivable-lane_mean34.000000000000206
in-drivable-lane_median34.000000000000206
in-drivable-lane_min34.000000000000206
per-episodes
details{"d60-ego0": {"driven_any": 4.999620190248149, "get_ui_image": 0.04315209528773192, "step_physics": 0.07735615714881214, "survival_time": 34.000000000000206, "driven_lanedir": 0.0, "get_state_dump": 0.021311358733324227, "get_robot_state": 0.003682127783126943, "sim_render-ego0": 0.003426944631837013, "get_duckie_state": 0.11608279994230788, "in-drivable-lane": 34.000000000000206, "deviation-heading": 0.0, "agent_compute-ego0": 0.010434657641619488, "complete-iteration": 0.287149314838359, "set_robot_commands": 0.002023708452737279, "distance-from-start": 4.8680122098032585, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007749492376386331, "sim_compute_performance-ego0": 0.0018382177478941527}}
set_robot_commands_max0.002023708452737279
set_robot_commands_mean0.002023708452737279
set_robot_commands_median0.002023708452737279
set_robot_commands_min0.002023708452737279
sim_compute_performance-ego0_max0.0018382177478941527
sim_compute_performance-ego0_mean0.0018382177478941527
sim_compute_performance-ego0_median0.0018382177478941527
sim_compute_performance-ego0_min0.0018382177478941527
sim_compute_sim_state_max0.007749492376386331
sim_compute_sim_state_mean0.007749492376386331
sim_compute_sim_state_median0.007749492376386331
sim_compute_sim_state_min0.007749492376386331
sim_render-ego0_max0.003426944631837013
sim_render-ego0_mean0.003426944631837013
sim_render-ego0_median0.003426944631837013
sim_render-ego0_min0.003426944631837013
simulation-passed1
step_physics_max0.07735615714881214
step_physics_mean0.07735615714881214
step_physics_median0.07735615714881214
step_physics_min0.07735615714881214
survival_time_max34.000000000000206
survival_time_mean34.000000000000206
survival_time_median34.000000000000206
survival_time_min34.000000000000206
No reset possible
7750915644Awni Altabaaexercises_braitenbergaido-LFI-sim-testingsim-2of4successnonogpu-production-b-spot-0-040:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7749515643Awni Altabaaexercises_braitenbergaido-LFI-full-sim-validationsim-2of4successnonogpu-production-b-spot-0-040:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7748215644Awni Altabaaexercises_braitenbergaido-LFI-sim-testingsim-2of4successnonogpu-production-b-spot-0-040:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7747315645Awni Altabaaexercises_braitenbergaido-LFV-sim-validationsim-2of4successnonogpu-production-b-spot-0-040:18:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.49999999999904
in-drivable-lane_median51.49999999999905
driven_lanedir_consec_median0.168333709357952
deviation-center-line_median0.19967139327410763


other stats
agent_compute-ego0_max0.01077637029939786
agent_compute-ego0_mean0.01077637029939786
agent_compute-ego0_median0.01077637029939786
agent_compute-ego0_min0.01077637029939786
agent_compute-npc0_max0.03298722550368549
agent_compute-npc0_mean0.03298722550368549
agent_compute-npc0_median0.03298722550368549
agent_compute-npc0_min0.03298722550368549
agent_compute-npc1_max0.03702814703573337
agent_compute-npc1_mean0.03702814703573337
agent_compute-npc1_median0.03702814703573337
agent_compute-npc1_min0.03702814703573337
agent_compute-npc2_max0.034828042022467316
agent_compute-npc2_mean0.034828042022467316
agent_compute-npc2_median0.034828042022467316
agent_compute-npc2_min0.034828042022467316
agent_compute-npc3_max0.03833919965707305
agent_compute-npc3_mean0.03833919965707305
agent_compute-npc3_median0.03833919965707305
agent_compute-npc3_min0.03833919965707305
complete-iteration_max0.6236005998553757
complete-iteration_mean0.6236005998553757
complete-iteration_median0.6236005998553757
complete-iteration_min0.6236005998553757
deviation-center-line_max0.19967139327410763
deviation-center-line_mean0.19967139327410763
deviation-center-line_min0.19967139327410763
deviation-heading_max1.661619904735263
deviation-heading_mean1.661619904735263
deviation-heading_median1.661619904735263
deviation-heading_min1.661619904735263
distance-from-start_max3.420596571462104
distance-from-start_mean3.420596571462104
distance-from-start_median3.420596571462104
distance-from-start_min3.420596571462104
driven_any_max3.478495075467357
driven_any_mean3.478495075467357
driven_any_median3.478495075467357
driven_any_min3.478495075467357
driven_lanedir_consec_max0.168333709357952
driven_lanedir_consec_mean0.168333709357952
driven_lanedir_consec_min0.168333709357952
driven_lanedir_max0.168333709357952
driven_lanedir_mean0.168333709357952
driven_lanedir_median0.168333709357952
driven_lanedir_min0.168333709357952
get_duckie_state_max1.3081334688377203e-06
get_duckie_state_mean1.3081334688377203e-06
get_duckie_state_median1.3081334688377203e-06
get_duckie_state_min1.3081334688377203e-06
get_robot_state_max0.015601432181409912
get_robot_state_mean0.015601432181409912
get_robot_state_median0.015601432181409912
get_robot_state_min0.015601432181409912
get_state_dump_max0.009643358882690764
get_state_dump_mean0.009643358882690764
get_state_dump_median0.009643358882690764
get_state_dump_min0.009643358882690764
get_ui_image_max0.058039988649754654
get_ui_image_mean0.058039988649754654
get_ui_image_median0.058039988649754654
get_ui_image_min0.058039988649754654
in-drivable-lane_max51.49999999999905
in-drivable-lane_mean51.49999999999905
in-drivable-lane_min51.49999999999905
per-episodes
details{"LFV-norm-techtrack-000-ego0": {"driven_any": 3.478495075467357, "get_ui_image": 0.058039988649754654, "step_physics": 0.30840127911729404, "survival_time": 54.49999999999904, "driven_lanedir": 0.168333709357952, "get_state_dump": 0.009643358882690764, "get_robot_state": 0.015601432181409912, "sim_render-ego0": 0.0034197572171414913, "sim_render-npc0": 0.00325654057818307, "sim_render-npc1": 0.003362320848389791, "sim_render-npc2": 0.003379285280907734, "sim_render-npc3": 0.0033399473080167412, "get_duckie_state": 1.3081334688377203e-06, "in-drivable-lane": 51.49999999999905, "deviation-heading": 1.661619904735263, "agent_compute-ego0": 0.01077637029939786, "agent_compute-npc0": 0.03298722550368549, "agent_compute-npc1": 0.03702814703573337, "agent_compute-npc2": 0.034828042022467316, "agent_compute-npc3": 0.03833919965707305, "complete-iteration": 0.6236005998553757, "set_robot_commands": 0.0019326155388934363, "distance-from-start": 3.420596571462104, "deviation-center-line": 0.19967139327410763, "driven_lanedir_consec": 0.168333709357952, "sim_compute_sim_state": 0.04265850077628215, "sim_compute_performance-ego0": 0.001789905957187894, "sim_compute_performance-npc0": 0.0016379904899981783, "sim_compute_performance-npc1": 0.0017024607531637582, "sim_compute_performance-npc2": 0.0017045733034883911, "sim_compute_performance-npc3": 0.0016802397482336168}}
set_robot_commands_max0.0019326155388934363
set_robot_commands_mean0.0019326155388934363
set_robot_commands_median0.0019326155388934363
set_robot_commands_min0.0019326155388934363
sim_compute_performance-ego0_max0.001789905957187894
sim_compute_performance-ego0_mean0.001789905957187894
sim_compute_performance-ego0_median0.001789905957187894
sim_compute_performance-ego0_min0.001789905957187894
sim_compute_performance-npc0_max0.0016379904899981783
sim_compute_performance-npc0_mean0.0016379904899981783
sim_compute_performance-npc0_median0.0016379904899981783
sim_compute_performance-npc0_min0.0016379904899981783
sim_compute_performance-npc1_max0.0017024607531637582
sim_compute_performance-npc1_mean0.0017024607531637582
sim_compute_performance-npc1_median0.0017024607531637582
sim_compute_performance-npc1_min0.0017024607531637582
sim_compute_performance-npc2_max0.0017045733034883911
sim_compute_performance-npc2_mean0.0017045733034883911
sim_compute_performance-npc2_median0.0017045733034883911
sim_compute_performance-npc2_min0.0017045733034883911
sim_compute_performance-npc3_max0.0016802397482336168
sim_compute_performance-npc3_mean0.0016802397482336168
sim_compute_performance-npc3_median0.0016802397482336168
sim_compute_performance-npc3_min0.0016802397482336168
sim_compute_sim_state_max0.04265850077628215
sim_compute_sim_state_mean0.04265850077628215
sim_compute_sim_state_median0.04265850077628215
sim_compute_sim_state_min0.04265850077628215
sim_render-ego0_max0.0034197572171414913
sim_render-ego0_mean0.0034197572171414913
sim_render-ego0_median0.0034197572171414913
sim_render-ego0_min0.0034197572171414913
sim_render-npc0_max0.00325654057818307
sim_render-npc0_mean0.00325654057818307
sim_render-npc0_median0.00325654057818307
sim_render-npc0_min0.00325654057818307
sim_render-npc1_max0.003362320848389791
sim_render-npc1_mean0.003362320848389791
sim_render-npc1_median0.003362320848389791
sim_render-npc1_min0.003362320848389791
sim_render-npc2_max0.003379285280907734
sim_render-npc2_mean0.003379285280907734
sim_render-npc2_median0.003379285280907734
sim_render-npc2_min0.003379285280907734
sim_render-npc3_max0.0033399473080167412
sim_render-npc3_mean0.0033399473080167412
sim_render-npc3_median0.0033399473080167412
sim_render-npc3_min0.0033399473080167412
simulation-passed1
step_physics_max0.30840127911729404
step_physics_mean0.30840127911729404
step_physics_median0.30840127911729404
step_physics_min0.30840127911729404
survival_time_max54.49999999999904
survival_time_mean54.49999999999904
survival_time_min54.49999999999904
No reset possible
7744815634Shengjie Hu 🇨🇭baseline-duckietown-mlaido-LF-sim-validationsim-1of4successnonogpu-production-b-spot-0-040:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.266584900557811
survival_time_median59.99999999999873
deviation-center-line_median1.8463853919308544
in-drivable-lane_median23.6999999999989


other stats
agent_compute-ego0_max0.016751371355080584
agent_compute-ego0_mean0.016751371355080584
agent_compute-ego0_median0.016751371355080584
agent_compute-ego0_min0.016751371355080584
complete-iteration_max0.1790020997875636
complete-iteration_mean0.1790020997875636
complete-iteration_median0.1790020997875636
complete-iteration_min0.1790020997875636
deviation-center-line_max1.8463853919308544
deviation-center-line_mean1.8463853919308544
deviation-center-line_min1.8463853919308544
deviation-heading_max7.617216981519475
deviation-heading_mean7.617216981519475
deviation-heading_median7.617216981519475
deviation-heading_min7.617216981519475
distance-from-start_max3.029182321992786
distance-from-start_mean3.029182321992786
distance-from-start_median3.029182321992786
distance-from-start_min3.029182321992786
driven_any_max7.914176305184779
driven_any_mean7.914176305184779
driven_any_median7.914176305184779
driven_any_min7.914176305184779
driven_lanedir_consec_max4.266584900557811
driven_lanedir_consec_mean4.266584900557811
driven_lanedir_consec_min4.266584900557811
driven_lanedir_max4.451615626552016
driven_lanedir_mean4.451615626552016
driven_lanedir_median4.451615626552016
driven_lanedir_min4.451615626552016
get_duckie_state_max2.210086628757448e-06
get_duckie_state_mean2.210086628757448e-06
get_duckie_state_median2.210086628757448e-06
get_duckie_state_min2.210086628757448e-06
get_robot_state_max0.00351381559951617
get_robot_state_mean0.00351381559951617
get_robot_state_median0.00351381559951617
get_robot_state_min0.00351381559951617
get_state_dump_max0.004543325684648271
get_state_dump_mean0.004543325684648271
get_state_dump_median0.004543325684648271
get_state_dump_min0.004543325684648271
get_ui_image_max0.03869225599684386
get_ui_image_mean0.03869225599684386
get_ui_image_median0.03869225599684386
get_ui_image_min0.03869225599684386
in-drivable-lane_max23.6999999999989
in-drivable-lane_mean23.6999999999989
in-drivable-lane_min23.6999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914176305184779, "get_ui_image": 0.03869225599684386, "step_physics": 0.100708625199495, "survival_time": 59.99999999999873, "driven_lanedir": 4.451615626552016, "get_state_dump": 0.004543325684648271, "get_robot_state": 0.00351381559951617, "sim_render-ego0": 0.003530136055990024, "get_duckie_state": 2.210086628757448e-06, "in-drivable-lane": 23.6999999999989, "deviation-heading": 7.617216981519475, "agent_compute-ego0": 0.016751371355080584, "complete-iteration": 0.1790020997875636, "set_robot_commands": 0.0021262069625918017, "distance-from-start": 3.029182321992786, "deviation-center-line": 1.8463853919308544, "driven_lanedir_consec": 4.266584900557811, "sim_compute_sim_state": 0.007200544025379851, "sim_compute_performance-ego0": 0.001849673967575848}}
set_robot_commands_max0.0021262069625918017
set_robot_commands_mean0.0021262069625918017
set_robot_commands_median0.0021262069625918017
set_robot_commands_min0.0021262069625918017
sim_compute_performance-ego0_max0.001849673967575848
sim_compute_performance-ego0_mean0.001849673967575848
sim_compute_performance-ego0_median0.001849673967575848
sim_compute_performance-ego0_min0.001849673967575848
sim_compute_sim_state_max0.007200544025379851
sim_compute_sim_state_mean0.007200544025379851
sim_compute_sim_state_median0.007200544025379851
sim_compute_sim_state_min0.007200544025379851
sim_render-ego0_max0.003530136055990024
sim_render-ego0_mean0.003530136055990024
sim_render-ego0_median0.003530136055990024
sim_render-ego0_min0.003530136055990024
simulation-passed1
step_physics_max0.100708625199495
step_physics_mean0.100708625199495
step_physics_median0.100708625199495
step_physics_min0.100708625199495
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7741115603Liam Paull 🇨🇦objdet exercisemooc-objdetsimsuccessnonogpu-production-b-spot-0-040:18:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median0.0001430511474609375


other stats
agent_compute-ego0_max0.01685139837114142
agent_compute-ego0_mean0.016588582682867628
agent_compute-ego0_median0.016588582682867628
agent_compute-ego0_min0.01632576699459384
complete-iteration_max0.2140088045626854
complete-iteration_mean0.21028380886303397
complete-iteration_median0.21028380886303397
complete-iteration_min0.20655881316338257
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
get_duckie_state_max0.01877164145889727
get_duckie_state_mean0.01813804676491057
get_duckie_state_median0.01813804676491057
get_duckie_state_min0.017504452070923868
get_robot_state_max0.003335579944391433
get_robot_state_mean0.0032380133445415763
get_robot_state_median0.0032380133445415763
get_robot_state_min0.00314044674469172
get_state_dump_max0.00716411203865604
get_state_dump_mean0.006943089181834911
get_state_dump_median0.006943089181834911
get_state_dump_min0.006722066325013783
get_ui_image_max0.05789621029170129
get_ui_image_mean0.05585481820753671
get_ui_image_median0.05585481820753671
get_ui_image_min0.05381342612337212
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.05789621029170129, "step_physics": 0.07802982890139412, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "get_state_dump": 0.00716411203865604, "get_robot_state": 0.003335579944391433, "sim_render-ego0": 0.003329823555100669, "get_duckie_state": 0.01877164145889727, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.01685139837114142, "complete-iteration": 0.2140088045626854, "set_robot_commands": 0.001912601980738199, "distance-from-start": 0.0, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 0.0001430511474609375, "sim_compute_sim_state": 0.02479528467621434, "sim_compute_performance-ego0": 0.0018357577470815944}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 0.0, "get_ui_image": 0.05381342612337212, "step_physics": 0.07329517260479193, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "get_state_dump": 0.006722066325013783, "get_robot_state": 0.00314044674469172, "sim_render-ego0": 0.0031815772251125975, "get_duckie_state": 0.017504452070923868, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.01632576699459384, "complete-iteration": 0.20655881316338257, "set_robot_commands": 0.0018064213434325763, "distance-from-start": 0.0, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 0.0001430511474609375, "sim_compute_sim_state": 0.029016508845663588, "sim_compute_performance-ego0": 0.0016736962416090636}}
set_robot_commands_max0.001912601980738199
set_robot_commands_mean0.0018595116620853877
set_robot_commands_median0.0018595116620853877
set_robot_commands_min0.0018064213434325763
sim_compute_performance-ego0_max0.0018357577470815944
sim_compute_performance-ego0_mean0.001754726994345329
sim_compute_performance-ego0_median0.001754726994345329
sim_compute_performance-ego0_min0.0016736962416090636
sim_compute_sim_state_max0.029016508845663588
sim_compute_sim_state_mean0.026905896760938963
sim_compute_sim_state_median0.026905896760938963
sim_compute_sim_state_min0.02479528467621434
sim_render-ego0_max0.003329823555100669
sim_render-ego0_mean0.003255700390106633
sim_render-ego0_median0.003255700390106633
sim_render-ego0_min0.0031815772251125975
simulation-passed1
step_physics_max0.07802982890139412
step_physics_mean0.07566250075309303
step_physics_median0.07566250075309303
step_physics_min0.07329517260479193
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7741015602Nisith Singhexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-040:10:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.368259136955771


other stats
agent_compute-ego0_max0.01050977603680486
agent_compute-ego0_mean0.01050977603680486
agent_compute-ego0_median0.01050977603680486
agent_compute-ego0_min0.01050977603680486
complete-iteration_max0.26075788878282835
complete-iteration_mean0.26075788878282835
complete-iteration_median0.26075788878282835
complete-iteration_min0.26075788878282835
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.368259136955771
distance-from-start_median4.368259136955771
distance-from-start_min4.368259136955771
driven_any_max4.587803668087238
driven_any_mean4.587803668087238
driven_any_median4.587803668087238
driven_any_min4.587803668087238
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10088027704764564
get_duckie_state_mean0.10088027704764564
get_duckie_state_median0.10088027704764564
get_duckie_state_min0.10088027704764564
get_robot_state_max0.003578525498745146
get_robot_state_mean0.003578525498745146
get_robot_state_median0.003578525498745146
get_robot_state_min0.003578525498745146
get_state_dump_max0.018241076743374458
get_state_dump_mean0.018241076743374458
get_state_dump_median0.018241076743374458
get_state_dump_min0.018241076743374458
get_ui_image_max0.04005156091408964
get_ui_image_mean0.04005156091408964
get_ui_image_median0.04005156091408964
get_ui_image_min0.04005156091408964
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 4.587803668087238, "get_ui_image": 0.04005156091408964, "step_physics": 0.0723397138216017, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.018241076743374458, "get_robot_state": 0.003578525498745146, "sim_render-ego0": 0.0034238603291761667, "get_duckie_state": 0.10088027704764564, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.01050977603680486, "complete-iteration": 0.26075788878282835, "set_robot_commands": 0.002060772477339745, "distance-from-start": 4.368259136955771, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007720983792701232, "sim_compute_performance-ego0": 0.0018619047811287428}}
set_robot_commands_max0.002060772477339745
set_robot_commands_mean0.002060772477339745
set_robot_commands_median0.002060772477339745
set_robot_commands_min0.002060772477339745
sim_compute_performance-ego0_max0.0018619047811287428
sim_compute_performance-ego0_mean0.0018619047811287428
sim_compute_performance-ego0_median0.0018619047811287428
sim_compute_performance-ego0_min0.0018619047811287428
sim_compute_sim_state_max0.007720983792701232
sim_compute_sim_state_mean0.007720983792701232
sim_compute_sim_state_median0.007720983792701232
sim_compute_sim_state_min0.007720983792701232
sim_render-ego0_max0.0034238603291761667
sim_render-ego0_mean0.0034238603291761667
sim_render-ego0_median0.0034238603291761667
sim_render-ego0_min0.0034238603291761667
simulation-passed1
step_physics_max0.0723397138216017
step_physics_mean0.0723397138216017
step_physics_median0.0723397138216017
step_physics_min0.0723397138216017
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7740115599riccardo maggionitemplate-randomaido-hello-sim-validation370successnonogpu-production-b-spot-0-040:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.01011073047464544
agent_compute-ego0_mean0.01011073047464544
agent_compute-ego0_median0.01011073047464544
agent_compute-ego0_min0.01011073047464544
complete-iteration_max0.11359792405908758
complete-iteration_mean0.11359792405908758
complete-iteration_median0.11359792405908758
complete-iteration_min0.11359792405908758
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.003883925351229581
get_duckie_state_mean0.003883925351229581
get_duckie_state_median0.003883925351229581
get_duckie_state_min0.003883925351229581
get_robot_state_max0.003134646198966286
get_robot_state_mean0.003134646198966286
get_robot_state_median0.003134646198966286
get_robot_state_min0.003134646198966286
get_state_dump_max0.004463683475147594
get_state_dump_mean0.004463683475147594
get_state_dump_median0.004463683475147594
get_state_dump_min0.004463683475147594
get_ui_image_max0.02205182205546986
get_ui_image_mean0.02205182205546986
get_ui_image_median0.02205182205546986
get_ui_image_min0.02205182205546986
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02205182205546986, "step_physics": 0.05875836177305742, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.004463683475147594, "get_robot_state": 0.003134646198966286, "sim_render-ego0": 0.0033012574369257145, "get_duckie_state": 0.003883925351229581, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01011073047464544, "complete-iteration": 0.11359792405908758, "set_robot_commands": 0.0018001036210493608, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004304750399156051, "sim_compute_performance-ego0": 0.0017186186530373311}}
set_robot_commands_max0.0018001036210493608
set_robot_commands_mean0.0018001036210493608
set_robot_commands_median0.0018001036210493608
set_robot_commands_min0.0018001036210493608
sim_compute_performance-ego0_max0.0017186186530373311
sim_compute_performance-ego0_mean0.0017186186530373311
sim_compute_performance-ego0_median0.0017186186530373311
sim_compute_performance-ego0_min0.0017186186530373311
sim_compute_sim_state_max0.004304750399156051
sim_compute_sim_state_mean0.004304750399156051
sim_compute_sim_state_median0.004304750399156051
sim_compute_sim_state_min0.004304750399156051
sim_render-ego0_max0.0033012574369257145
sim_render-ego0_mean0.0033012574369257145
sim_render-ego0_median0.0033012574369257145
sim_render-ego0_min0.0033012574369257145
simulation-passed1
step_physics_max0.05875836177305742
step_physics_mean0.05875836177305742
step_physics_median0.05875836177305742
step_physics_min0.05875836177305742
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7739715598Liam Paull 🇨🇦baseline-duckietown-mlaido-LF-sim-validationsim-0of4successnonogpu-production-b-spot-0-040:09:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.102031363559787
survival_time_median59.99999999999873
deviation-center-line_median2.403502042507232
in-drivable-lane_median30.999999999999545


other stats
agent_compute-ego0_max0.016737301284129376
agent_compute-ego0_mean0.016737301284129376
agent_compute-ego0_median0.016737301284129376
agent_compute-ego0_min0.016737301284129376
complete-iteration_max0.2084055165267805
complete-iteration_mean0.2084055165267805
complete-iteration_median0.2084055165267805
complete-iteration_min0.2084055165267805
deviation-center-line_max2.403502042507232
deviation-center-line_mean2.403502042507232
deviation-center-line_min2.403502042507232
deviation-heading_max11.52697126894319
deviation-heading_mean11.52697126894319
deviation-heading_median11.52697126894319
deviation-heading_min11.52697126894319
distance-from-start_max2.3197065294388737
distance-from-start_mean2.3197065294388737
distance-from-start_median2.3197065294388737
distance-from-start_min2.3197065294388737
driven_any_max7.91420100533319
driven_any_mean7.91420100533319
driven_any_median7.91420100533319
driven_any_min7.91420100533319
driven_lanedir_consec_max2.102031363559787
driven_lanedir_consec_mean2.102031363559787
driven_lanedir_consec_min2.102031363559787
driven_lanedir_max3.2243188159983083
driven_lanedir_mean3.2243188159983083
driven_lanedir_median3.2243188159983083
driven_lanedir_min3.2243188159983083
get_duckie_state_max1.3534869877722342e-06
get_duckie_state_mean1.3534869877722342e-06
get_duckie_state_median1.3534869877722342e-06
get_duckie_state_min1.3534869877722342e-06
get_robot_state_max0.0034869779258048304
get_robot_state_mean0.0034869779258048304
get_robot_state_median0.0034869779258048304
get_robot_state_min0.0034869779258048304
get_state_dump_max0.004410322262385207
get_state_dump_mean0.004410322262385207
get_state_dump_median0.004410322262385207
get_state_dump_min0.004410322262385207
get_ui_image_max0.04263645901866599
get_ui_image_mean0.04263645901866599
get_ui_image_median0.04263645901866599
get_ui_image_min0.04263645901866599
in-drivable-lane_max30.999999999999545
in-drivable-lane_mean30.999999999999545
in-drivable-lane_min30.999999999999545
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 7.91420100533319, "get_ui_image": 0.04263645901866599, "step_physics": 0.12416474666325476, "survival_time": 59.99999999999873, "driven_lanedir": 3.2243188159983083, "get_state_dump": 0.004410322262385207, "get_robot_state": 0.0034869779258048304, "sim_render-ego0": 0.003493176411828034, "get_duckie_state": 1.3534869877722342e-06, "in-drivable-lane": 30.999999999999545, "deviation-heading": 11.52697126894319, "agent_compute-ego0": 0.016737301284129376, "complete-iteration": 0.2084055165267805, "set_robot_commands": 0.002075375764197255, "distance-from-start": 2.3197065294388737, "deviation-center-line": 2.403502042507232, "driven_lanedir_consec": 2.102031363559787, "sim_compute_sim_state": 0.009461170231472143, "sim_compute_performance-ego0": 0.001844994730000492}}
set_robot_commands_max0.002075375764197255
set_robot_commands_mean0.002075375764197255
set_robot_commands_median0.002075375764197255
set_robot_commands_min0.002075375764197255
sim_compute_performance-ego0_max0.001844994730000492
sim_compute_performance-ego0_mean0.001844994730000492
sim_compute_performance-ego0_median0.001844994730000492
sim_compute_performance-ego0_min0.001844994730000492
sim_compute_sim_state_max0.009461170231472143
sim_compute_sim_state_mean0.009461170231472143
sim_compute_sim_state_median0.009461170231472143
sim_compute_sim_state_min0.009461170231472143
sim_render-ego0_max0.003493176411828034
sim_render-ego0_mean0.003493176411828034
sim_render-ego0_median0.003493176411828034
sim_render-ego0_min0.003493176411828034
simulation-passed1
step_physics_max0.12416474666325476
step_physics_mean0.12416474666325476
step_physics_median0.12416474666325476
step_physics_min0.12416474666325476
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7736915585Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-2of4host-errornonogpu-production-b-spot-0-040:01:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7734015584Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-1of4failednonogpu-production-b-spot-0-040:04:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7727015580Ryan Arya Pratamaexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-040:08:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.070155448372009


other stats
agent_compute-ego0_max0.010576529070102206
agent_compute-ego0_mean0.010576529070102206
agent_compute-ego0_median0.010576529070102206
agent_compute-ego0_min0.010576529070102206
complete-iteration_max0.20541417013100044
complete-iteration_mean0.20541417013100044
complete-iteration_median0.20541417013100044
complete-iteration_min0.20541417013100044
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.070155448372009
distance-from-start_median5.070155448372009
distance-from-start_min5.070155448372009
driven_any_max5.092463306579143
driven_any_mean5.092463306579143
driven_any_median5.092463306579143
driven_any_min5.092463306579143
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05556301232877123
get_duckie_state_mean0.05556301232877123
get_duckie_state_median0.05556301232877123
get_duckie_state_min0.05556301232877123
get_robot_state_max0.003448229447491064
get_robot_state_mean0.003448229447491064
get_robot_state_median0.003448229447491064
get_robot_state_min0.003448229447491064
get_state_dump_max0.012844871224015083
get_state_dump_mean0.012844871224015083
get_state_dump_median0.012844871224015083
get_state_dump_min0.012844871224015083
get_ui_image_max0.035838047928059724
get_ui_image_mean0.035838047928059724
get_ui_image_median0.035838047928059724
get_ui_image_min0.035838047928059724
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 5.092463306579143, "get_ui_image": 0.035838047928059724, "step_physics": 0.07248648020945223, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.012844871224015083, "get_robot_state": 0.003448229447491064, "sim_render-ego0": 0.003346515436355121, "get_duckie_state": 0.05556301232877123, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010576529070102206, "complete-iteration": 0.20541417013100044, "set_robot_commands": 0.001988749023678896, "distance-from-start": 5.070155448372009, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0074696759200910045, "sim_compute_performance-ego0": 0.0017608746600885571}}
set_robot_commands_max0.001988749023678896
set_robot_commands_mean0.001988749023678896
set_robot_commands_median0.001988749023678896
set_robot_commands_min0.001988749023678896
sim_compute_performance-ego0_max0.0017608746600885571
sim_compute_performance-ego0_mean0.0017608746600885571
sim_compute_performance-ego0_median0.0017608746600885571
sim_compute_performance-ego0_min0.0017608746600885571
sim_compute_sim_state_max0.0074696759200910045
sim_compute_sim_state_mean0.0074696759200910045
sim_compute_sim_state_median0.0074696759200910045
sim_compute_sim_state_min0.0074696759200910045
sim_render-ego0_max0.003346515436355121
sim_render-ego0_mean0.003346515436355121
sim_render-ego0_median0.003346515436355121
sim_render-ego0_min0.003346515436355121
simulation-passed1
step_physics_max0.07248648020945223
step_physics_mean0.07248648020945223
step_physics_median0.07248648020945223
step_physics_min0.07248648020945223
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7726313798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7726113798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7725913798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7724215534Nicola Carrinoexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-040:04:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.382074748805595


other stats
agent_compute-ego0_max0.011063372186207584
agent_compute-ego0_mean0.011063372186207584
agent_compute-ego0_median0.011063372186207584
agent_compute-ego0_min0.011063372186207584
complete-iteration_max0.3048465637874354
complete-iteration_mean0.3048465637874354
complete-iteration_median0.3048465637874354
complete-iteration_min0.3048465637874354
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.382074748805595
distance-from-start_median5.382074748805595
distance-from-start_min5.382074748805595
driven_any_max5.746768242902202
driven_any_mean5.746768242902202
driven_any_median5.746768242902202
driven_any_min5.746768242902202
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1179550746091041
get_duckie_state_mean0.1179550746091041
get_duckie_state_median0.1179550746091041
get_duckie_state_min0.1179550746091041
get_robot_state_max0.003993201193548058
get_robot_state_mean0.003993201193548058
get_robot_state_median0.003993201193548058
get_robot_state_min0.003993201193548058
get_state_dump_max0.023007823032747673
get_state_dump_mean0.023007823032747673
get_state_dump_median0.023007823032747673
get_state_dump_min0.023007823032747673
get_ui_image_max0.04643964269453801
get_ui_image_mean0.04643964269453801
get_ui_image_median0.04643964269453801
get_ui_image_min0.04643964269453801
in-drivable-lane_max19.100000000000136
in-drivable-lane_mean19.100000000000136
in-drivable-lane_median19.100000000000136
in-drivable-lane_min19.100000000000136
per-episodes
details{"d60-ego0": {"driven_any": 5.746768242902202, "get_ui_image": 0.04643964269453801, "step_physics": 0.08594045813338874, "survival_time": 19.100000000000136, "driven_lanedir": 0.0, "get_state_dump": 0.023007823032747673, "get_robot_state": 0.003993201193548058, "sim_render-ego0": 0.003541011411900931, "get_duckie_state": 0.1179550746091041, "in-drivable-lane": 19.100000000000136, "deviation-heading": 0.0, "agent_compute-ego0": 0.011063372186207584, "complete-iteration": 0.3048465637874354, "set_robot_commands": 0.0021795828099661647, "distance-from-start": 5.382074748805595, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008726412571441411, "sim_compute_performance-ego0": 0.0018930640606593836}}
set_robot_commands_max0.0021795828099661647
set_robot_commands_mean0.0021795828099661647
set_robot_commands_median0.0021795828099661647
set_robot_commands_min0.0021795828099661647
sim_compute_performance-ego0_max0.0018930640606593836
sim_compute_performance-ego0_mean0.0018930640606593836
sim_compute_performance-ego0_median0.0018930640606593836
sim_compute_performance-ego0_min0.0018930640606593836
sim_compute_sim_state_max0.008726412571441411
sim_compute_sim_state_mean0.008726412571441411
sim_compute_sim_state_median0.008726412571441411
sim_compute_sim_state_min0.008726412571441411
sim_render-ego0_max0.003541011411900931
sim_render-ego0_mean0.003541011411900931
sim_render-ego0_median0.003541011411900931
sim_render-ego0_min0.003541011411900931
simulation-passed1
step_physics_max0.08594045813338874
step_physics_mean0.08594045813338874
step_physics_median0.08594045813338874
step_physics_min0.08594045813338874
survival_time_max19.100000000000136
survival_time_mean19.100000000000136
survival_time_median19.100000000000136
survival_time_min19.100000000000136
No reset possible
7723115534Nicola Carrinoexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-040:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.567933909332722


other stats
agent_compute-ego0_max0.011535780268081167
agent_compute-ego0_mean0.011535780268081167
agent_compute-ego0_median0.011535780268081167
agent_compute-ego0_min0.011535780268081167
complete-iteration_max0.2646538346214632
complete-iteration_mean0.2646538346214632
complete-iteration_median0.2646538346214632
complete-iteration_min0.2646538346214632
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.567933909332722
distance-from-start_median4.567933909332722
distance-from-start_min4.567933909332722
driven_any_max5.31358916825105
driven_any_mean5.31358916825105
driven_any_median5.31358916825105
driven_any_min5.31358916825105
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08860768821738814
get_duckie_state_mean0.08860768821738814
get_duckie_state_median0.08860768821738814
get_duckie_state_min0.08860768821738814
get_robot_state_max0.003850154820445013
get_robot_state_mean0.003850154820445013
get_robot_state_median0.003850154820445013
get_robot_state_min0.003850154820445013
get_state_dump_max0.01837667954706513
get_state_dump_mean0.01837667954706513
get_state_dump_median0.01837667954706513
get_state_dump_min0.01837667954706513
get_ui_image_max0.044928822897176826
get_ui_image_mean0.044928822897176826
get_ui_image_median0.044928822897176826
get_ui_image_min0.044928822897176826
in-drivable-lane_max16.900000000000105
in-drivable-lane_mean16.900000000000105
in-drivable-lane_median16.900000000000105
in-drivable-lane_min16.900000000000105
per-episodes
details{"d45-ego0": {"driven_any": 5.31358916825105, "get_ui_image": 0.044928822897176826, "step_physics": 0.08022793204383513, "survival_time": 16.900000000000105, "driven_lanedir": 0.0, "get_state_dump": 0.01837667954706513, "get_robot_state": 0.003850154820445013, "sim_render-ego0": 0.003519267810832786, "get_duckie_state": 0.08860768821738814, "in-drivable-lane": 16.900000000000105, "deviation-heading": 0.0, "agent_compute-ego0": 0.011535780268081167, "complete-iteration": 0.2646538346214632, "set_robot_commands": 0.002225045960913014, "distance-from-start": 4.567933909332722, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009365218930539832, "sim_compute_performance-ego0": 0.0019146439600131503}}
set_robot_commands_max0.002225045960913014
set_robot_commands_mean0.002225045960913014
set_robot_commands_median0.002225045960913014
set_robot_commands_min0.002225045960913014
sim_compute_performance-ego0_max0.0019146439600131503
sim_compute_performance-ego0_mean0.0019146439600131503
sim_compute_performance-ego0_median0.0019146439600131503
sim_compute_performance-ego0_min0.0019146439600131503
sim_compute_sim_state_max0.009365218930539832
sim_compute_sim_state_mean0.009365218930539832
sim_compute_sim_state_median0.009365218930539832
sim_compute_sim_state_min0.009365218930539832
sim_render-ego0_max0.003519267810832786
sim_render-ego0_mean0.003519267810832786
sim_render-ego0_median0.003519267810832786
sim_render-ego0_min0.003519267810832786
simulation-passed1
step_physics_max0.08022793204383513
step_physics_mean0.08022793204383513
step_physics_median0.08022793204383513
step_physics_min0.08022793204383513
survival_time_max16.900000000000105
survival_time_mean16.900000000000105
survival_time_median16.900000000000105
survival_time_min16.900000000000105
No reset possible
7722215555Andriy Drozdyuktemplate-randomaido-hello-sim-validation370successnonogpu-production-b-spot-0-040:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011877693913199684
agent_compute-ego0_mean0.011877693913199684
agent_compute-ego0_median0.011877693913199684
agent_compute-ego0_min0.011877693913199684
complete-iteration_max0.1372856768694791
complete-iteration_mean0.1372856768694791
complete-iteration_median0.1372856768694791
complete-iteration_min0.1372856768694791
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004397007552060214
get_duckie_state_mean0.004397007552060214
get_duckie_state_median0.004397007552060214
get_duckie_state_min0.004397007552060214
get_robot_state_max0.0037323399023576217
get_robot_state_mean0.0037323399023576217
get_robot_state_median0.0037323399023576217
get_robot_state_min0.0037323399023576217
get_state_dump_max0.0054909424348310995
get_state_dump_mean0.0054909424348310995
get_state_dump_median0.0054909424348310995
get_state_dump_min0.0054909424348310995
get_ui_image_max0.025133474306626755
get_ui_image_mean0.025133474306626755
get_ui_image_median0.025133474306626755
get_ui_image_min0.025133474306626755
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.025133474306626755, "step_physics": 0.0736059004610235, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0054909424348310995, "get_robot_state": 0.0037323399023576217, "sim_render-ego0": 0.003744109110398726, "get_duckie_state": 0.004397007552060214, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011877693913199684, "complete-iteration": 0.1372856768694791, "set_robot_commands": 0.0021933262998407536, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005087364803660999, "sim_compute_performance-ego0": 0.0019298683513294568}}
set_robot_commands_max0.0021933262998407536
set_robot_commands_mean0.0021933262998407536
set_robot_commands_median0.0021933262998407536
set_robot_commands_min0.0021933262998407536
sim_compute_performance-ego0_max0.0019298683513294568
sim_compute_performance-ego0_mean0.0019298683513294568
sim_compute_performance-ego0_median0.0019298683513294568
sim_compute_performance-ego0_min0.0019298683513294568
sim_compute_sim_state_max0.005087364803660999
sim_compute_sim_state_mean0.005087364803660999
sim_compute_sim_state_median0.005087364803660999
sim_compute_sim_state_min0.005087364803660999
sim_render-ego0_max0.003744109110398726
sim_render-ego0_mean0.003744109110398726
sim_render-ego0_median0.003744109110398726
sim_render-ego0_min0.003744109110398726
simulation-passed1
step_physics_max0.0736059004610235
step_physics_mean0.0736059004610235
step_physics_median0.0736059004610235
step_physics_min0.0736059004610235
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7721415555Andriy Drozdyuktemplate-randomaido-hello-sim-validation370successnonogpu-production-b-spot-0-040:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.010658529671755705
agent_compute-ego0_mean0.010658529671755705
agent_compute-ego0_median0.010658529671755705
agent_compute-ego0_min0.010658529671755705
complete-iteration_max0.12404946847395464
complete-iteration_mean0.12404946847395464
complete-iteration_median0.12404946847395464
complete-iteration_min0.12404946847395464
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004067870703610507
get_duckie_state_mean0.004067870703610507
get_duckie_state_median0.004067870703610507
get_duckie_state_min0.004067870703610507
get_robot_state_max0.003473704511469061
get_robot_state_mean0.003473704511469061
get_robot_state_median0.003473704511469061
get_robot_state_min0.003473704511469061
get_state_dump_max0.005367701703851873
get_state_dump_mean0.005367701703851873
get_state_dump_median0.005367701703851873
get_state_dump_min0.005367701703851873
get_ui_image_max0.023716514760797672
get_ui_image_mean0.023716514760797672
get_ui_image_median0.023716514760797672
get_ui_image_min0.023716514760797672
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.023716514760797672, "step_physics": 0.06475749882784756, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005367701703851873, "get_robot_state": 0.003473704511469061, "sim_render-ego0": 0.003567061640999534, "get_duckie_state": 0.004067870703610507, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.010658529671755705, "complete-iteration": 0.12404946847395464, "set_robot_commands": 0.001962976022200151, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004556108604777943, "sim_compute_performance-ego0": 0.0018320083618164065}}
set_robot_commands_max0.001962976022200151
set_robot_commands_mean0.001962976022200151
set_robot_commands_median0.001962976022200151
set_robot_commands_min0.001962976022200151
sim_compute_performance-ego0_max0.0018320083618164065
sim_compute_performance-ego0_mean0.0018320083618164065
sim_compute_performance-ego0_median0.0018320083618164065
sim_compute_performance-ego0_min0.0018320083618164065
sim_compute_sim_state_max0.004556108604777943
sim_compute_sim_state_mean0.004556108604777943
sim_compute_sim_state_median0.004556108604777943
sim_compute_sim_state_min0.004556108604777943
sim_render-ego0_max0.003567061640999534
sim_render-ego0_mean0.003567061640999534
sim_render-ego0_median0.003567061640999534
sim_render-ego0_min0.003567061640999534
simulation-passed1
step_physics_max0.06475749882784756
step_physics_mean0.06475749882784756
step_physics_median0.06475749882784756
step_physics_min0.06475749882784756
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7720315568Adriano Almeidatemplate-randommooc-BV1sim-2of5successnonogpu-production-b-spot-0-040:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1441359970405203


other stats
agent_compute-ego0_max0.010643643191736989
agent_compute-ego0_mean0.010643643191736989
agent_compute-ego0_median0.010643643191736989
agent_compute-ego0_min0.010643643191736989
complete-iteration_max0.23923227725884852
complete-iteration_mean0.23923227725884852
complete-iteration_median0.23923227725884852
complete-iteration_min0.23923227725884852
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1441359970405203
distance-from-start_median2.1441359970405203
distance-from-start_min2.1441359970405203
driven_any_max2.1480091563455916
driven_any_mean2.1480091563455916
driven_any_median2.1480091563455916
driven_any_min2.1480091563455916
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07462355621859558
get_duckie_state_mean0.07462355621859558
get_duckie_state_median0.07462355621859558
get_duckie_state_min0.07462355621859558
get_robot_state_max0.003679116566975912
get_robot_state_mean0.003679116566975912
get_robot_state_median0.003679116566975912
get_robot_state_min0.003679116566975912
get_state_dump_max0.01599028579190246
get_state_dump_mean0.01599028579190246
get_state_dump_median0.01599028579190246
get_state_dump_min0.01599028579190246
get_ui_image_max0.04125816801674346
get_ui_image_mean0.04125816801674346
get_ui_image_median0.04125816801674346
get_ui_image_min0.04125816801674346
in-drivable-lane_max5.799999999999987
in-drivable-lane_mean5.799999999999987
in-drivable-lane_median5.799999999999987
in-drivable-lane_min5.799999999999987
per-episodes
details{"d40-ego0": {"driven_any": 2.1480091563455916, "get_ui_image": 0.04125816801674346, "step_physics": 0.07686979546506181, "survival_time": 5.799999999999987, "driven_lanedir": 0.0, "get_state_dump": 0.01599028579190246, "get_robot_state": 0.003679116566975912, "sim_render-ego0": 0.003463086918887929, "get_duckie_state": 0.07462355621859558, "in-drivable-lane": 5.799999999999987, "deviation-heading": 0.0, "agent_compute-ego0": 0.010643643191736989, "complete-iteration": 0.23923227725884852, "set_robot_commands": 0.002060307396782769, "distance-from-start": 2.1441359970405203, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008474867568056807, "sim_compute_performance-ego0": 0.002070551244621603}}
set_robot_commands_max0.002060307396782769
set_robot_commands_mean0.002060307396782769
set_robot_commands_median0.002060307396782769
set_robot_commands_min0.002060307396782769
sim_compute_performance-ego0_max0.002070551244621603
sim_compute_performance-ego0_mean0.002070551244621603
sim_compute_performance-ego0_median0.002070551244621603
sim_compute_performance-ego0_min0.002070551244621603
sim_compute_sim_state_max0.008474867568056807
sim_compute_sim_state_mean0.008474867568056807
sim_compute_sim_state_median0.008474867568056807
sim_compute_sim_state_min0.008474867568056807
sim_render-ego0_max0.003463086918887929
sim_render-ego0_mean0.003463086918887929
sim_render-ego0_median0.003463086918887929
sim_render-ego0_min0.003463086918887929
simulation-passed1
step_physics_max0.07686979546506181
step_physics_mean0.07686979546506181
step_physics_median0.07686979546506181
step_physics_min0.07686979546506181
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_median5.799999999999987
survival_time_min5.799999999999987
No reset possible
7718415568Adriano Almeidatemplate-randommooc-BV1sim-2of5successnonogpu-production-b-spot-0-040:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1441359970405203


other stats
agent_compute-ego0_max0.011170405607957106
agent_compute-ego0_mean0.011170405607957106
agent_compute-ego0_median0.011170405607957106
agent_compute-ego0_min0.011170405607957106
complete-iteration_max0.2477986832969209
complete-iteration_mean0.2477986832969209
complete-iteration_median0.2477986832969209
complete-iteration_min0.2477986832969209
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1441359970405203
distance-from-start_median2.1441359970405203
distance-from-start_min2.1441359970405203
driven_any_max2.1480091563455916
driven_any_mean2.1480091563455916
driven_any_median2.1480091563455916
driven_any_min2.1480091563455916
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07618773085439307
get_duckie_state_mean0.07618773085439307
get_duckie_state_median0.07618773085439307
get_duckie_state_min0.07618773085439307
get_robot_state_max0.00381168341025328
get_robot_state_mean0.00381168341025328
get_robot_state_median0.00381168341025328
get_robot_state_min0.00381168341025328
get_state_dump_max0.01633841359717214
get_state_dump_mean0.01633841359717214
get_state_dump_median0.01633841359717214
get_state_dump_min0.01633841359717214
get_ui_image_max0.04385400225973537
get_ui_image_mean0.04385400225973537
get_ui_image_median0.04385400225973537
get_ui_image_min0.04385400225973537
in-drivable-lane_max5.799999999999987
in-drivable-lane_mean5.799999999999987
in-drivable-lane_median5.799999999999987
in-drivable-lane_min5.799999999999987
per-episodes
details{"d40-ego0": {"driven_any": 2.1480091563455916, "get_ui_image": 0.04385400225973537, "step_physics": 0.08017468452453613, "survival_time": 5.799999999999987, "driven_lanedir": 0.0, "get_state_dump": 0.01633841359717214, "get_robot_state": 0.00381168341025328, "sim_render-ego0": 0.003455706131763947, "get_duckie_state": 0.07618773085439307, "in-drivable-lane": 5.799999999999987, "deviation-heading": 0.0, "agent_compute-ego0": 0.011170405607957106, "complete-iteration": 0.2477986832969209, "set_robot_commands": 0.0020207299126519095, "distance-from-start": 2.1441359970405203, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008868133919870751, "sim_compute_performance-ego0": 0.00181275147658128}}
set_robot_commands_max0.0020207299126519095
set_robot_commands_mean0.0020207299126519095
set_robot_commands_median0.0020207299126519095
set_robot_commands_min0.0020207299126519095
sim_compute_performance-ego0_max0.00181275147658128
sim_compute_performance-ego0_mean0.00181275147658128
sim_compute_performance-ego0_median0.00181275147658128
sim_compute_performance-ego0_min0.00181275147658128
sim_compute_sim_state_max0.008868133919870751
sim_compute_sim_state_mean0.008868133919870751
sim_compute_sim_state_median0.008868133919870751
sim_compute_sim_state_min0.008868133919870751
sim_render-ego0_max0.003455706131763947
sim_render-ego0_mean0.003455706131763947
sim_render-ego0_median0.003455706131763947
sim_render-ego0_min0.003455706131763947
simulation-passed1
step_physics_max0.08017468452453613
step_physics_mean0.08017468452453613
step_physics_median0.08017468452453613
step_physics_min0.08017468452453613
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_median5.799999999999987
survival_time_min5.799999999999987
No reset possible
7717315568Adriano Almeidatemplate-randommooc-BV1sim-4of5successnonogpu-production-b-spot-0-040:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.065230364338155


other stats
agent_compute-ego0_max0.011247164862496512
agent_compute-ego0_mean0.011247164862496512
agent_compute-ego0_median0.011247164862496512
agent_compute-ego0_min0.011247164862496512
complete-iteration_max0.3041783366884504
complete-iteration_mean0.3041783366884504
complete-iteration_median0.3041783366884504
complete-iteration_min0.3041783366884504
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.065230364338155
distance-from-start_median1.065230364338155
distance-from-start_min1.065230364338155
driven_any_max1.0672360153840723
driven_any_mean1.0672360153840723
driven_any_median1.0672360153840723
driven_any_min1.0672360153840723
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11865368570600238
get_duckie_state_mean0.11865368570600238
get_duckie_state_median0.11865368570600238
get_duckie_state_min0.11865368570600238
get_robot_state_max0.003988456726074219
get_robot_state_mean0.003988456726074219
get_robot_state_median0.003988456726074219
get_robot_state_min0.003988456726074219
get_state_dump_max0.022550855364118303
get_state_dump_mean0.022550855364118303
get_state_dump_median0.022550855364118303
get_state_dump_min0.022550855364118303
get_ui_image_max0.04506172112056187
get_ui_image_mean0.04506172112056187
get_ui_image_median0.04506172112056187
get_ui_image_min0.04506172112056187
in-drivable-lane_max3.4499999999999957
in-drivable-lane_mean3.4499999999999957
in-drivable-lane_median3.4499999999999957
in-drivable-lane_min3.4499999999999957
per-episodes
details{"d60-ego0": {"driven_any": 1.0672360153840723, "get_ui_image": 0.04506172112056187, "step_physics": 0.08608024801526751, "survival_time": 3.4499999999999957, "driven_lanedir": 0.0, "get_state_dump": 0.022550855364118303, "get_robot_state": 0.003988456726074219, "sim_render-ego0": 0.003603145054408482, "get_duckie_state": 0.11865368570600238, "in-drivable-lane": 3.4499999999999957, "deviation-heading": 0.0, "agent_compute-ego0": 0.011247164862496512, "complete-iteration": 0.3041783366884504, "set_robot_commands": 0.002070185116359166, "distance-from-start": 1.065230364338155, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00885521684374128, "sim_compute_performance-ego0": 0.001955502373831613}}
set_robot_commands_max0.002070185116359166
set_robot_commands_mean0.002070185116359166
set_robot_commands_median0.002070185116359166
set_robot_commands_min0.002070185116359166
sim_compute_performance-ego0_max0.001955502373831613
sim_compute_performance-ego0_mean0.001955502373831613
sim_compute_performance-ego0_median0.001955502373831613
sim_compute_performance-ego0_min0.001955502373831613
sim_compute_sim_state_max0.00885521684374128
sim_compute_sim_state_mean0.00885521684374128
sim_compute_sim_state_median0.00885521684374128
sim_compute_sim_state_min0.00885521684374128
sim_render-ego0_max0.003603145054408482
sim_render-ego0_mean0.003603145054408482
sim_render-ego0_median0.003603145054408482
sim_render-ego0_min0.003603145054408482
simulation-passed1
step_physics_max0.08608024801526751
step_physics_mean0.08608024801526751
step_physics_median0.08608024801526751
step_physics_min0.08608024801526751
survival_time_max3.4499999999999957
survival_time_mean3.4499999999999957
survival_time_median3.4499999999999957
survival_time_min3.4499999999999957
No reset possible
7715815568Adriano Almeidatemplate-randommooc-BV1sim-4of5successnonogpu-production-b-spot-0-040:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.065230364338155


other stats
agent_compute-ego0_max0.010987615585327149
agent_compute-ego0_mean0.010987615585327149
agent_compute-ego0_median0.010987615585327149
agent_compute-ego0_min0.010987615585327149
complete-iteration_max0.2946976900100708
complete-iteration_mean0.2946976900100708
complete-iteration_median0.2946976900100708
complete-iteration_min0.2946976900100708
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.065230364338155
distance-from-start_median1.065230364338155
distance-from-start_min1.065230364338155
driven_any_max1.0672360153840723
driven_any_mean1.0672360153840723
driven_any_median1.0672360153840723
driven_any_min1.0672360153840723
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11163315091814312
get_duckie_state_mean0.11163315091814312
get_duckie_state_median0.11163315091814312
get_duckie_state_min0.11163315091814312
get_robot_state_max0.003633158547537667
get_robot_state_mean0.003633158547537667
get_robot_state_median0.003633158547537667
get_robot_state_min0.003633158547537667
get_state_dump_max0.02126411029270717
get_state_dump_mean0.02126411029270717
get_state_dump_median0.02126411029270717
get_state_dump_min0.02126411029270717
get_ui_image_max0.04644404138837542
get_ui_image_mean0.04644404138837542
get_ui_image_median0.04644404138837542
get_ui_image_min0.04644404138837542
in-drivable-lane_max3.4499999999999957
in-drivable-lane_mean3.4499999999999957
in-drivable-lane_median3.4499999999999957
in-drivable-lane_min3.4499999999999957
per-episodes
details{"d60-ego0": {"driven_any": 1.0672360153840723, "get_ui_image": 0.04644404138837542, "step_physics": 0.0846996443612235, "survival_time": 3.4499999999999957, "driven_lanedir": 0.0, "get_state_dump": 0.02126411029270717, "get_robot_state": 0.003633158547537667, "sim_render-ego0": 0.003401381628853934, "get_duckie_state": 0.11163315091814312, "in-drivable-lane": 3.4499999999999957, "deviation-heading": 0.0, "agent_compute-ego0": 0.010987615585327149, "complete-iteration": 0.2946976900100708, "set_robot_commands": 0.002080549512590681, "distance-from-start": 1.065230364338155, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008633341108049666, "sim_compute_performance-ego0": 0.0018247502190726144}}
set_robot_commands_max0.002080549512590681
set_robot_commands_mean0.002080549512590681
set_robot_commands_median0.002080549512590681
set_robot_commands_min0.002080549512590681
sim_compute_performance-ego0_max0.0018247502190726144
sim_compute_performance-ego0_mean0.0018247502190726144
sim_compute_performance-ego0_median0.0018247502190726144
sim_compute_performance-ego0_min0.0018247502190726144
sim_compute_sim_state_max0.008633341108049666
sim_compute_sim_state_mean0.008633341108049666
sim_compute_sim_state_median0.008633341108049666
sim_compute_sim_state_min0.008633341108049666
sim_render-ego0_max0.003401381628853934
sim_render-ego0_mean0.003401381628853934
sim_render-ego0_median0.003401381628853934
sim_render-ego0_min0.003401381628853934
simulation-passed1
step_physics_max0.0846996443612235
step_physics_mean0.0846996443612235
step_physics_median0.0846996443612235
step_physics_min0.0846996443612235
survival_time_max3.4499999999999957
survival_time_mean3.4499999999999957
survival_time_median3.4499999999999957
survival_time_min3.4499999999999957
No reset possible
7714615579Adriano Almeidatemplate-randommooc-visservoingsimsuccessnonogpu-production-b-spot-0-040:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median1.4749999999999948
deviation-center-line_median0.10290845538839624
driven_lanedir_consec_median0.8124102136429856
survival_time_median3.699999999999995


other stats
agent_compute-ego0_max0.010343557993570965
agent_compute-ego0_mean0.01030576229095459
agent_compute-ego0_median0.01030576229095459
agent_compute-ego0_min0.010267966588338217
complete-iteration_max0.13639286994934083
complete-iteration_mean0.1360510794321696
complete-iteration_median0.1360510794321696
complete-iteration_min0.13570928891499837
deviation-center-line_max0.1136845552906736
deviation-center-line_mean0.10290845538839624
deviation-center-line_min0.09213235548611892
deviation-heading_max0.27368698690305954
deviation-heading_mean0.2600156845389547
deviation-heading_median0.2600156845389547
deviation-heading_min0.24634438217484983
distance-from-start_max1.186417060961268
distance-from-start_mean1.1838662171993262
distance-from-start_median1.1838662171993262
distance-from-start_min1.1813153734373842
driven_any_max1.190758815009246
driven_any_mean1.1871375087178495
driven_any_median1.1871375087178495
driven_any_min1.1835162024264536
driven_lanedir_consec_max0.8491951747780392
driven_lanedir_consec_mean0.8124102136429856
driven_lanedir_consec_min0.7756252525079319
driven_lanedir_max0.8491951747780392
driven_lanedir_mean0.8124102136429856
driven_lanedir_median0.8124102136429856
driven_lanedir_min0.7756252525079319
get_duckie_state_max2.5177001953125e-06
get_duckie_state_mean2.2506713867187503e-06
get_duckie_state_median2.2506713867187503e-06
get_duckie_state_min1.983642578125e-06
get_robot_state_max0.0034923871358235677
get_robot_state_mean0.003462966283162435
get_robot_state_median0.003462966283162435
get_robot_state_min0.0034335454305013022
get_state_dump_max0.00460115114847819
get_state_dump_mean0.004509860674540202
get_state_dump_median0.004509860674540202
get_state_dump_min0.004418570200602214
get_ui_image_max0.04370001157124837
get_ui_image_mean0.04259575049082438
get_ui_image_median0.04259575049082438
get_ui_image_min0.041491489410400394
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean1.4749999999999948
in-drivable-lane_min1.399999999999995
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.190758815009246, "get_ui_image": 0.04370001157124837, "step_physics": 0.06328837076822917, "survival_time": 3.699999999999995, "driven_lanedir": 0.7756252525079319, "get_state_dump": 0.004418570200602214, "get_robot_state": 0.0034335454305013022, "sim_render-ego0": 0.0034560489654541014, "get_duckie_state": 2.5177001953125e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 0.24634438217484983, "agent_compute-ego0": 0.010343557993570965, "complete-iteration": 0.13570928891499837, "set_robot_commands": 0.001986659367879232, "distance-from-start": 1.186417060961268, "deviation-center-line": 0.1136845552906736, "driven_lanedir_consec": 0.7756252525079319, "sim_compute_sim_state": 0.003230918248494466, "sim_compute_performance-ego0": 0.0017662652333577471}, "LF-small-loop-001-ego0": {"driven_any": 1.1835162024264536, "get_ui_image": 0.041491489410400394, "step_physics": 0.0654212220509847, "survival_time": 3.699999999999995, "driven_lanedir": 0.8491951747780392, "get_state_dump": 0.00460115114847819, "get_robot_state": 0.0034923871358235677, "sim_render-ego0": 0.003374134699503581, "get_duckie_state": 1.983642578125e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.27368698690305954, "agent_compute-ego0": 0.010267966588338217, "complete-iteration": 0.13639286994934083, "set_robot_commands": 0.002002061208089193, "distance-from-start": 1.1813153734373842, "deviation-center-line": 0.09213235548611892, "driven_lanedir_consec": 0.8491951747780392, "sim_compute_sim_state": 0.003858553568522135, "sim_compute_performance-ego0": 0.0017982196807861328}}
set_robot_commands_max0.002002061208089193
set_robot_commands_mean0.001994360287984213
set_robot_commands_median0.001994360287984213
set_robot_commands_min0.001986659367879232
sim_compute_performance-ego0_max0.0017982196807861328
sim_compute_performance-ego0_mean0.00178224245707194
sim_compute_performance-ego0_median0.00178224245707194
sim_compute_performance-ego0_min0.0017662652333577471
sim_compute_sim_state_max0.003858553568522135
sim_compute_sim_state_mean0.003544735908508301
sim_compute_sim_state_median0.003544735908508301
sim_compute_sim_state_min0.003230918248494466
sim_render-ego0_max0.0034560489654541014
sim_render-ego0_mean0.003415091832478842
sim_render-ego0_median0.003415091832478842
sim_render-ego0_min0.003374134699503581
simulation-passed1
step_physics_max0.0654212220509847
step_physics_mean0.06435479640960694
step_physics_median0.06435479640960694
step_physics_min0.06328837076822917
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible