Duckietown Challenges Home Challenges Submissions

Evaluator 5285

ID5285
evaluatorgpu-production-spot-0-01
ownerI don't have one 😀
machinegpu-production-spot-0_51d41d257ef2
processgpu-production-spot-0-01_51d41d257ef2
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success103 78698
# timeout
# failed15 79242
# error1 78876
# aborted11 78657
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)232.0 GB
Disk (MB)969.3 GB
Disk available (MB)808.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID
submission
user
user label
challenge
step
status
up to date
evaluator
date started
date completed
duration
message
7960016077Narmada Balasooriyaexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-010:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.418026279036135


other stats
agent_compute-ego0_max0.011518581218629089
agent_compute-ego0_mean0.011518581218629089
agent_compute-ego0_median0.011518581218629089
agent_compute-ego0_min0.011518581218629089
complete-iteration_max0.25718435517984545
complete-iteration_mean0.25718435517984545
complete-iteration_median0.25718435517984545
complete-iteration_min0.25718435517984545
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.418026279036135
distance-from-start_median2.418026279036135
distance-from-start_min2.418026279036135
driven_any_max2.4731721580665575
driven_any_mean2.4731721580665575
driven_any_median2.4731721580665575
driven_any_min2.4731721580665575
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1162588969226132
get_duckie_state_mean0.1162588969226132
get_duckie_state_median0.1162588969226132
get_duckie_state_min0.1162588969226132
get_robot_state_max0.003661486774824242
get_robot_state_mean0.003661486774824242
get_robot_state_median0.003661486774824242
get_robot_state_min0.003661486774824242
get_state_dump_max0.0233967236432984
get_state_dump_mean0.0233967236432984
get_state_dump_median0.0233967236432984
get_state_dump_min0.0233967236432984
get_ui_image_max0.015739425098726535
get_ui_image_mean0.015739425098726535
get_ui_image_median0.015739425098726535
get_ui_image_min0.015739425098726535
in-drivable-lane_max10.500000000000014
in-drivable-lane_mean10.500000000000014
in-drivable-lane_median10.500000000000014
in-drivable-lane_min10.500000000000014
per-episodes
details{"d60-ego0": {"driven_any": 2.4731721580665575, "get_ui_image": 0.015739425098726535, "step_physics": 0.06962279007898123, "survival_time": 10.500000000000014, "driven_lanedir": 0.0, "get_state_dump": 0.0233967236432984, "get_robot_state": 0.003661486774824242, "sim_render-ego0": 0.0035635973039961537, "get_duckie_state": 0.1162588969226132, "in-drivable-lane": 10.500000000000014, "deviation-heading": 0.0, "agent_compute-ego0": 0.011518581218629089, "complete-iteration": 0.25718435517984545, "set_robot_commands": 0.002148372867096092, "distance-from-start": 2.418026279036135, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009344279483596295, "sim_compute_performance-ego0": 0.00183853605912195}}
set_robot_commands_max0.002148372867096092
set_robot_commands_mean0.002148372867096092
set_robot_commands_median0.002148372867096092
set_robot_commands_min0.002148372867096092
sim_compute_performance-ego0_max0.00183853605912195
sim_compute_performance-ego0_mean0.00183853605912195
sim_compute_performance-ego0_median0.00183853605912195
sim_compute_performance-ego0_min0.00183853605912195
sim_compute_sim_state_max0.009344279483596295
sim_compute_sim_state_mean0.009344279483596295
sim_compute_sim_state_median0.009344279483596295
sim_compute_sim_state_min0.009344279483596295
sim_render-ego0_max0.0035635973039961537
sim_render-ego0_mean0.0035635973039961537
sim_render-ego0_median0.0035635973039961537
sim_render-ego0_min0.0035635973039961537
simulation-passed1
step_physics_max0.06962279007898123
step_physics_mean0.06962279007898123
step_physics_median0.06962279007898123
step_physics_min0.06962279007898123
survival_time_max10.500000000000014
survival_time_mean10.500000000000014
survival_time_median10.500000000000014
survival_time_min10.500000000000014
No reset possible
7959716077Narmada Balasooriyaexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-010:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.0448272348498573


other stats
agent_compute-ego0_max0.01247454191509046
agent_compute-ego0_mean0.01247454191509046
agent_compute-ego0_median0.01247454191509046
agent_compute-ego0_min0.01247454191509046
complete-iteration_max0.26722739119278754
complete-iteration_mean0.26722739119278754
complete-iteration_median0.26722739119278754
complete-iteration_min0.26722739119278754
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.0448272348498573
distance-from-start_median1.0448272348498573
distance-from-start_min1.0448272348498573
driven_any_max1.050129535836349
driven_any_mean1.050129535836349
driven_any_median1.050129535836349
driven_any_min1.050129535836349
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.12058215141296388
get_duckie_state_mean0.12058215141296388
get_duckie_state_median0.12058215141296388
get_duckie_state_min0.12058215141296388
get_robot_state_max0.00384501156054045
get_robot_state_mean0.00384501156054045
get_robot_state_median0.00384501156054045
get_robot_state_min0.00384501156054045
get_state_dump_max0.024354949750398334
get_state_dump_mean0.024354949750398334
get_state_dump_median0.024354949750398334
get_state_dump_min0.024354949750398334
get_ui_image_max0.01630447036341617
get_ui_image_mean0.01630447036341617
get_ui_image_median0.01630447036341617
get_ui_image_min0.01630447036341617
in-drivable-lane_max4.699999999999991
in-drivable-lane_mean4.699999999999991
in-drivable-lane_median4.699999999999991
in-drivable-lane_min4.699999999999991
per-episodes
details{"d60-ego0": {"driven_any": 1.050129535836349, "get_ui_image": 0.01630447036341617, "step_physics": 0.07102308524282355, "survival_time": 4.699999999999991, "driven_lanedir": 0.0, "get_state_dump": 0.024354949750398334, "get_robot_state": 0.00384501156054045, "sim_render-ego0": 0.003738573977821752, "get_duckie_state": 0.12058215141296388, "in-drivable-lane": 4.699999999999991, "deviation-heading": 0.0, "agent_compute-ego0": 0.01247454191509046, "complete-iteration": 0.26722739119278754, "set_robot_commands": 0.002331558026765522, "distance-from-start": 1.0448272348498573, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01046857331928454, "sim_compute_performance-ego0": 0.002004216846666838}}
set_robot_commands_max0.002331558026765522
set_robot_commands_mean0.002331558026765522
set_robot_commands_median0.002331558026765522
set_robot_commands_min0.002331558026765522
sim_compute_performance-ego0_max0.002004216846666838
sim_compute_performance-ego0_mean0.002004216846666838
sim_compute_performance-ego0_median0.002004216846666838
sim_compute_performance-ego0_min0.002004216846666838
sim_compute_sim_state_max0.01046857331928454
sim_compute_sim_state_mean0.01046857331928454
sim_compute_sim_state_median0.01046857331928454
sim_compute_sim_state_min0.01046857331928454
sim_render-ego0_max0.003738573977821752
sim_render-ego0_mean0.003738573977821752
sim_render-ego0_median0.003738573977821752
sim_render-ego0_min0.003738573977821752
simulation-passed1
step_physics_max0.07102308524282355
step_physics_mean0.07102308524282355
step_physics_median0.07102308524282355
step_physics_min0.07102308524282355
survival_time_max4.699999999999991
survival_time_mean4.699999999999991
survival_time_median4.699999999999991
survival_time_min4.699999999999991
No reset possible
7959416076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.54
false_positive_rate0.53


other stats
nsamples200
No reset possible
7959216076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.55
false_positive_rate0.38


other stats
nsamples200
No reset possible
7959016076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.45
false_positive_rate0.52


other stats
nsamples200
No reset possible
7958816076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.51
false_positive_rate0.55


other stats
nsamples200
No reset possible
7958616075Awni Altabaacollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.45
false_positive_rate0.505


other stats
nsamples400
No reset possible
7958516075Awni Altabaacollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.575
false_positive_rate0.475


other stats
nsamples400
No reset possible
7958316075Awni Altabaacollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.54
false_positive_rate0.415


other stats
nsamples400
No reset possible
7958016074Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-010:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.8941077909996498


other stats
agent_compute-ego0_max0.01149794412037683
agent_compute-ego0_mean0.01149794412037683
agent_compute-ego0_median0.01149794412037683
agent_compute-ego0_min0.01149794412037683
complete-iteration_max0.2240157922108968
complete-iteration_mean0.2240157922108968
complete-iteration_median0.2240157922108968
complete-iteration_min0.2240157922108968
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.8941077909996498
distance-from-start_median2.8941077909996498
distance-from-start_min2.8941077909996498
driven_any_max2.8995579775405615
driven_any_mean2.8995579775405615
driven_any_median2.8995579775405615
driven_any_min2.8995579775405615
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08998155972314259
get_duckie_state_mean0.08998155972314259
get_duckie_state_median0.08998155972314259
get_duckie_state_min0.08998155972314259
get_robot_state_max0.0037063871111188617
get_robot_state_mean0.0037063871111188617
get_robot_state_median0.0037063871111188617
get_robot_state_min0.0037063871111188617
get_state_dump_max0.018881665335761175
get_state_dump_mean0.018881665335761175
get_state_dump_median0.018881665335761175
get_state_dump_min0.018881665335761175
get_ui_image_max0.014582138212900312
get_ui_image_mean0.014582138212900312
get_ui_image_median0.014582138212900312
get_ui_image_min0.014582138212900312
in-drivable-lane_max6.249999999999986
in-drivable-lane_mean6.249999999999986
in-drivable-lane_median6.249999999999986
in-drivable-lane_min6.249999999999986
per-episodes
details{"d45-ego0": {"driven_any": 2.8995579775405615, "get_ui_image": 0.014582138212900312, "step_physics": 0.06834091837444002, "survival_time": 6.249999999999986, "driven_lanedir": 0.0, "get_state_dump": 0.018881665335761175, "get_robot_state": 0.0037063871111188617, "sim_render-ego0": 0.0036228857343159025, "get_duckie_state": 0.08998155972314259, "in-drivable-lane": 6.249999999999986, "deviation-heading": 0.0, "agent_compute-ego0": 0.01149794412037683, "complete-iteration": 0.2240157922108968, "set_robot_commands": 0.0023201685103159102, "distance-from-start": 2.8941077909996498, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009045941489083428, "sim_compute_performance-ego0": 0.0019394386382330033}}
set_robot_commands_max0.0023201685103159102
set_robot_commands_mean0.0023201685103159102
set_robot_commands_median0.0023201685103159102
set_robot_commands_min0.0023201685103159102
sim_compute_performance-ego0_max0.0019394386382330033
sim_compute_performance-ego0_mean0.0019394386382330033
sim_compute_performance-ego0_median0.0019394386382330033
sim_compute_performance-ego0_min0.0019394386382330033
sim_compute_sim_state_max0.009045941489083428
sim_compute_sim_state_mean0.009045941489083428
sim_compute_sim_state_median0.009045941489083428
sim_compute_sim_state_min0.009045941489083428
sim_render-ego0_max0.0036228857343159025
sim_render-ego0_mean0.0036228857343159025
sim_render-ego0_median0.0036228857343159025
sim_render-ego0_min0.0036228857343159025
simulation-passed1
step_physics_max0.06834091837444002
step_physics_mean0.06834091837444002
step_physics_median0.06834091837444002
step_physics_min0.06834091837444002
survival_time_max6.249999999999986
survival_time_mean6.249999999999986
survival_time_median6.249999999999986
survival_time_min6.249999999999986
No reset possible
7957716074Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-010:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.8943130104822075


other stats
agent_compute-ego0_max0.01075193238636804
agent_compute-ego0_mean0.01075193238636804
agent_compute-ego0_median0.01075193238636804
agent_compute-ego0_min0.01075193238636804
complete-iteration_max0.2128894669669015
complete-iteration_mean0.2128894669669015
complete-iteration_median0.2128894669669015
complete-iteration_min0.2128894669669015
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.8943130104822075
distance-from-start_median2.8943130104822075
distance-from-start_min2.8943130104822075
driven_any_max2.899141288536784
driven_any_mean2.899141288536784
driven_any_median2.899141288536784
driven_any_min2.899141288536784
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08535921573638916
get_duckie_state_mean0.08535921573638916
get_duckie_state_median0.08535921573638916
get_duckie_state_min0.08535921573638916
get_robot_state_max0.0034365843212793745
get_robot_state_mean0.0034365843212793745
get_robot_state_median0.0034365843212793745
get_robot_state_min0.0034365843212793745
get_state_dump_max0.017973608440823026
get_state_dump_mean0.017973608440823026
get_state_dump_median0.017973608440823026
get_state_dump_min0.017973608440823026
get_ui_image_max0.0143514493155101
get_ui_image_mean0.0143514493155101
get_ui_image_median0.0143514493155101
get_ui_image_min0.0143514493155101
in-drivable-lane_max6.249999999999986
in-drivable-lane_mean6.249999999999986
in-drivable-lane_median6.249999999999986
in-drivable-lane_min6.249999999999986
per-episodes
details{"d45-ego0": {"driven_any": 2.899141288536784, "get_ui_image": 0.0143514493155101, "step_physics": 0.06475769527374751, "survival_time": 6.249999999999986, "driven_lanedir": 0.0, "get_state_dump": 0.017973608440823026, "get_robot_state": 0.0034365843212793745, "sim_render-ego0": 0.0034730547950381323, "get_duckie_state": 0.08535921573638916, "in-drivable-lane": 6.249999999999986, "deviation-heading": 0.0, "agent_compute-ego0": 0.01075193238636804, "complete-iteration": 0.2128894669669015, "set_robot_commands": 0.0020740789080423024, "distance-from-start": 2.8943130104822075, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008826518815661233, "sim_compute_performance-ego0": 0.0018120322908673969}}
set_robot_commands_max0.0020740789080423024
set_robot_commands_mean0.0020740789080423024
set_robot_commands_median0.0020740789080423024
set_robot_commands_min0.0020740789080423024
sim_compute_performance-ego0_max0.0018120322908673969
sim_compute_performance-ego0_mean0.0018120322908673969
sim_compute_performance-ego0_median0.0018120322908673969
sim_compute_performance-ego0_min0.0018120322908673969
sim_compute_sim_state_max0.008826518815661233
sim_compute_sim_state_mean0.008826518815661233
sim_compute_sim_state_median0.008826518815661233
sim_compute_sim_state_min0.008826518815661233
sim_render-ego0_max0.0034730547950381323
sim_render-ego0_mean0.0034730547950381323
sim_render-ego0_median0.0034730547950381323
sim_render-ego0_min0.0034730547950381323
simulation-passed1
step_physics_max0.06475769527374751
step_physics_mean0.06475769527374751
step_physics_median0.06475769527374751
step_physics_min0.06475769527374751
survival_time_max6.249999999999986
survival_time_mean6.249999999999986
survival_time_median6.249999999999986
survival_time_min6.249999999999986
No reset possible
7956116073Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-010:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1532109198288705


other stats
agent_compute-ego0_max0.011921932201574344
agent_compute-ego0_mean0.011921932201574344
agent_compute-ego0_median0.011921932201574344
agent_compute-ego0_min0.011921932201574344
complete-iteration_max0.2203176139604927
complete-iteration_mean0.2203176139604927
complete-iteration_median0.2203176139604927
complete-iteration_min0.2203176139604927
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1532109198288705
distance-from-start_median2.1532109198288705
distance-from-start_min2.1532109198288705
driven_any_max2.153271835223708
driven_any_mean2.153271835223708
driven_any_median2.153271835223708
driven_any_min2.153271835223708
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08275442312259486
get_duckie_state_mean0.08275442312259486
get_duckie_state_median0.08275442312259486
get_duckie_state_min0.08275442312259486
get_robot_state_max0.0037975358490896696
get_robot_state_mean0.0037975358490896696
get_robot_state_median0.0037975358490896696
get_robot_state_min0.0037975358490896696
get_state_dump_max0.017672033593206123
get_state_dump_mean0.017672033593206123
get_state_dump_median0.017672033593206123
get_state_dump_min0.017672033593206123
get_ui_image_max0.014860707934540095
get_ui_image_mean0.014860707934540095
get_ui_image_median0.014860707934540095
get_ui_image_min0.014860707934540095
in-drivable-lane_max4.99999999999999
in-drivable-lane_mean4.99999999999999
in-drivable-lane_median4.99999999999999
in-drivable-lane_min4.99999999999999
per-episodes
details{"d40-ego0": {"driven_any": 2.153271835223708, "get_ui_image": 0.014860707934540095, "step_physics": 0.07179614576962914, "survival_time": 4.99999999999999, "driven_lanedir": 0.0, "get_state_dump": 0.017672033593206123, "get_robot_state": 0.0037975358490896696, "sim_render-ego0": 0.0037589049575352433, "get_duckie_state": 0.08275442312259486, "in-drivable-lane": 4.99999999999999, "deviation-heading": 0.0, "agent_compute-ego0": 0.011921932201574344, "complete-iteration": 0.2203176139604927, "set_robot_commands": 0.0023031258347010848, "distance-from-start": 2.1532109198288705, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00934506878994479, "sim_compute_performance-ego0": 0.002008494764271349}}
set_robot_commands_max0.0023031258347010848
set_robot_commands_mean0.0023031258347010848
set_robot_commands_median0.0023031258347010848
set_robot_commands_min0.0023031258347010848
sim_compute_performance-ego0_max0.002008494764271349
sim_compute_performance-ego0_mean0.002008494764271349
sim_compute_performance-ego0_median0.002008494764271349
sim_compute_performance-ego0_min0.002008494764271349
sim_compute_sim_state_max0.00934506878994479
sim_compute_sim_state_mean0.00934506878994479
sim_compute_sim_state_median0.00934506878994479
sim_compute_sim_state_min0.00934506878994479
sim_render-ego0_max0.0037589049575352433
sim_render-ego0_mean0.0037589049575352433
sim_render-ego0_median0.0037589049575352433
sim_render-ego0_min0.0037589049575352433
simulation-passed1
step_physics_max0.07179614576962914
step_physics_mean0.07179614576962914
step_physics_median0.07179614576962914
step_physics_min0.07179614576962914
survival_time_max4.99999999999999
survival_time_mean4.99999999999999
survival_time_median4.99999999999999
survival_time_min4.99999999999999
No reset possible
7954916073Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-010:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.153130325150818


other stats
agent_compute-ego0_max0.0119700030525132
agent_compute-ego0_mean0.0119700030525132
agent_compute-ego0_median0.0119700030525132
agent_compute-ego0_min0.0119700030525132
complete-iteration_max0.2163165016929702
complete-iteration_mean0.2163165016929702
complete-iteration_median0.2163165016929702
complete-iteration_min0.2163165016929702
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.153130325150818
distance-from-start_median2.153130325150818
distance-from-start_min2.153130325150818
driven_any_max2.153188946055637
driven_any_mean2.153188946055637
driven_any_median2.153188946055637
driven_any_min2.153188946055637
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07894892975835517
get_duckie_state_mean0.07894892975835517
get_duckie_state_median0.07894892975835517
get_duckie_state_min0.07894892975835517
get_robot_state_max0.003715895190097318
get_robot_state_mean0.003715895190097318
get_robot_state_median0.003715895190097318
get_robot_state_min0.003715895190097318
get_state_dump_max0.01759443188657855
get_state_dump_mean0.01759443188657855
get_state_dump_median0.01759443188657855
get_state_dump_min0.01759443188657855
get_ui_image_max0.01506545047948856
get_ui_image_mean0.01506545047948856
get_ui_image_median0.01506545047948856
get_ui_image_min0.01506545047948856
in-drivable-lane_max4.99999999999999
in-drivable-lane_mean4.99999999999999
in-drivable-lane_median4.99999999999999
in-drivable-lane_min4.99999999999999
per-episodes
details{"d40-ego0": {"driven_any": 2.153188946055637, "get_ui_image": 0.01506545047948856, "step_physics": 0.0720048186802628, "survival_time": 4.99999999999999, "driven_lanedir": 0.0, "get_state_dump": 0.01759443188657855, "get_robot_state": 0.003715895190097318, "sim_render-ego0": 0.0036014873202484432, "get_duckie_state": 0.07894892975835517, "in-drivable-lane": 4.99999999999999, "deviation-heading": 0.0, "agent_compute-ego0": 0.0119700030525132, "complete-iteration": 0.2163165016929702, "set_robot_commands": 0.002245702365837475, "distance-from-start": 2.153130325150818, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009159319471604753, "sim_compute_performance-ego0": 0.0019150299601035543}}
set_robot_commands_max0.002245702365837475
set_robot_commands_mean0.002245702365837475
set_robot_commands_median0.002245702365837475
set_robot_commands_min0.002245702365837475
sim_compute_performance-ego0_max0.0019150299601035543
sim_compute_performance-ego0_mean0.0019150299601035543
sim_compute_performance-ego0_median0.0019150299601035543
sim_compute_performance-ego0_min0.0019150299601035543
sim_compute_sim_state_max0.009159319471604753
sim_compute_sim_state_mean0.009159319471604753
sim_compute_sim_state_median0.009159319471604753
sim_compute_sim_state_min0.009159319471604753
sim_render-ego0_max0.0036014873202484432
sim_render-ego0_mean0.0036014873202484432
sim_render-ego0_median0.0036014873202484432
sim_render-ego0_min0.0036014873202484432
simulation-passed1
step_physics_max0.0720048186802628
step_physics_mean0.0720048186802628
step_physics_median0.0720048186802628
step_physics_min0.0720048186802628
survival_time_max4.99999999999999
survival_time_mean4.99999999999999
survival_time_median4.99999999999999
survival_time_min4.99999999999999
No reset possible
7954516071Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-010:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.172605790343945


other stats
agent_compute-ego0_max0.011486122608184816
agent_compute-ego0_mean0.011486122608184816
agent_compute-ego0_median0.011486122608184816
agent_compute-ego0_min0.011486122608184816
complete-iteration_max0.2216043496131897
complete-iteration_mean0.2216043496131897
complete-iteration_median0.2216043496131897
complete-iteration_min0.2216043496131897
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.172605790343945
distance-from-start_median2.172605790343945
distance-from-start_min2.172605790343945
driven_any_max2.1746295053325824
driven_any_mean2.1746295053325824
driven_any_median2.1746295053325824
driven_any_min2.1746295053325824
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08755329847335816
get_duckie_state_mean0.08755329847335816
get_duckie_state_median0.08755329847335816
get_duckie_state_min0.08755329847335816
get_robot_state_max0.003626575469970703
get_robot_state_mean0.003626575469970703
get_robot_state_median0.003626575469970703
get_robot_state_min0.003626575469970703
get_state_dump_max0.019014725685119627
get_state_dump_mean0.019014725685119627
get_state_dump_median0.019014725685119627
get_state_dump_min0.019014725685119627
get_ui_image_max0.01440187931060791
get_ui_image_mean0.01440187931060791
get_ui_image_median0.01440187931060791
get_ui_image_min0.01440187931060791
in-drivable-lane_max4.94999999999999
in-drivable-lane_mean4.94999999999999
in-drivable-lane_median4.94999999999999
in-drivable-lane_min4.94999999999999
per-episodes
details{"d45-ego0": {"driven_any": 2.1746295053325824, "get_ui_image": 0.01440187931060791, "step_physics": 0.06861862421035766, "survival_time": 4.94999999999999, "driven_lanedir": 0.0, "get_state_dump": 0.019014725685119627, "get_robot_state": 0.003626575469970703, "sim_render-ego0": 0.0035653948783874513, "get_duckie_state": 0.08755329847335816, "in-drivable-lane": 4.94999999999999, "deviation-heading": 0.0, "agent_compute-ego0": 0.011486122608184816, "complete-iteration": 0.2216043496131897, "set_robot_commands": 0.002114982604980469, "distance-from-start": 2.172605790343945, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009234161376953124, "sim_compute_performance-ego0": 0.001893787384033203}}
set_robot_commands_max0.002114982604980469
set_robot_commands_mean0.002114982604980469
set_robot_commands_median0.002114982604980469
set_robot_commands_min0.002114982604980469
sim_compute_performance-ego0_max0.001893787384033203
sim_compute_performance-ego0_mean0.001893787384033203
sim_compute_performance-ego0_median0.001893787384033203
sim_compute_performance-ego0_min0.001893787384033203
sim_compute_sim_state_max0.009234161376953124
sim_compute_sim_state_mean0.009234161376953124
sim_compute_sim_state_median0.009234161376953124
sim_compute_sim_state_min0.009234161376953124
sim_render-ego0_max0.0035653948783874513
sim_render-ego0_mean0.0035653948783874513
sim_render-ego0_median0.0035653948783874513
sim_render-ego0_min0.0035653948783874513
simulation-passed1
step_physics_max0.06861862421035766
step_physics_mean0.06861862421035766
step_physics_median0.06861862421035766
step_physics_min0.06861862421035766
survival_time_max4.94999999999999
survival_time_mean4.94999999999999
survival_time_median4.94999999999999
survival_time_min4.94999999999999
No reset possible
7954016071Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-010:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.144635628300311


other stats
agent_compute-ego0_max0.011980752752284812
agent_compute-ego0_mean0.011980752752284812
agent_compute-ego0_median0.011980752752284812
agent_compute-ego0_min0.011980752752284812
complete-iteration_max0.2369724138818606
complete-iteration_mean0.2369724138818606
complete-iteration_median0.2369724138818606
complete-iteration_min0.2369724138818606
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.144635628300311
distance-from-start_median2.144635628300311
distance-from-start_min2.144635628300311
driven_any_max2.1466018480799556
driven_any_mean2.1466018480799556
driven_any_median2.1466018480799556
driven_any_min2.1466018480799556
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0926206304569437
get_duckie_state_mean0.0926206304569437
get_duckie_state_median0.0926206304569437
get_duckie_state_min0.0926206304569437
get_robot_state_max0.0037840664988816382
get_robot_state_mean0.0037840664988816382
get_robot_state_median0.0037840664988816382
get_robot_state_min0.0037840664988816382
get_state_dump_max0.01962438015022663
get_state_dump_mean0.01962438015022663
get_state_dump_median0.01962438015022663
get_state_dump_min0.01962438015022663
get_ui_image_max0.015258858902285797
get_ui_image_mean0.015258858902285797
get_ui_image_median0.015258858902285797
get_ui_image_min0.015258858902285797
in-drivable-lane_max4.899999999999991
in-drivable-lane_mean4.899999999999991
in-drivable-lane_median4.899999999999991
in-drivable-lane_min4.899999999999991
per-episodes
details{"d45-ego0": {"driven_any": 2.1466018480799556, "get_ui_image": 0.015258858902285797, "step_physics": 0.0756074683834808, "survival_time": 4.899999999999991, "driven_lanedir": 0.0, "get_state_dump": 0.01962438015022663, "get_robot_state": 0.0037840664988816382, "sim_render-ego0": 0.003808332212043531, "get_duckie_state": 0.0926206304569437, "in-drivable-lane": 4.899999999999991, "deviation-heading": 0.0, "agent_compute-ego0": 0.011980752752284812, "complete-iteration": 0.2369724138818606, "set_robot_commands": 0.002396258440884677, "distance-from-start": 2.144635628300311, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009765314333366623, "sim_compute_performance-ego0": 0.002016676796807183}}
set_robot_commands_max0.002396258440884677
set_robot_commands_mean0.002396258440884677
set_robot_commands_median0.002396258440884677
set_robot_commands_min0.002396258440884677
sim_compute_performance-ego0_max0.002016676796807183
sim_compute_performance-ego0_mean0.002016676796807183
sim_compute_performance-ego0_median0.002016676796807183
sim_compute_performance-ego0_min0.002016676796807183
sim_compute_sim_state_max0.009765314333366623
sim_compute_sim_state_mean0.009765314333366623
sim_compute_sim_state_median0.009765314333366623
sim_compute_sim_state_min0.009765314333366623
sim_render-ego0_max0.003808332212043531
sim_render-ego0_mean0.003808332212043531
sim_render-ego0_median0.003808332212043531
sim_render-ego0_min0.003808332212043531
simulation-passed1
step_physics_max0.0756074683834808
step_physics_mean0.0756074683834808
step_physics_median0.0756074683834808
step_physics_min0.0756074683834808
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_median4.899999999999991
survival_time_min4.899999999999991
No reset possible
7953716069Cagri Catikmooc-objdetmooc-objdetsimfailednogpu-production-spot-0-010:06:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 186 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7953016068Nicola Carrinotemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:15:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.124999999999997
deviation-center-line_median3.595487519982447
driven_lanedir_consec_median6.435015152200253
survival_time_median49.79999999999931


other stats
agent_compute-ego0_max0.016244234683985666
agent_compute-ego0_mean0.011322069770875695
agent_compute-ego0_median0.011322069770875695
agent_compute-ego0_min0.006399904857765725
complete-iteration_max0.1838255480465345
complete-iteration_mean0.18264561817274735
complete-iteration_median0.18264561817274735
complete-iteration_min0.1814656882989602
deviation-center-line_max4.111689234627003
deviation-center-line_mean3.595487519982447
deviation-center-line_min3.079285805337891
deviation-heading_max2.4012970665267455
deviation-heading_mean1.9078099758801936
deviation-heading_median1.9078099758801936
deviation-heading_min1.4143228852336414
distance-from-start_max8.275226815560739
distance-from-start_mean6.7825338261570955
distance-from-start_median6.7825338261570955
distance-from-start_min5.289840836753452
driven_any_max8.324238007559195
driven_any_mean6.856727202735961
driven_any_median6.856727202735961
driven_any_min5.389216397912725
driven_lanedir_consec_max8.003164843828852
driven_lanedir_consec_mean6.435015152200253
driven_lanedir_consec_min4.866865460571654
driven_lanedir_max8.003164843828852
driven_lanedir_mean6.435015152200253
driven_lanedir_median6.435015152200253
driven_lanedir_min4.866865460571654
get_duckie_state_max1.5875381990634432e-06
get_duckie_state_mean1.550665408344059e-06
get_duckie_state_median1.550665408344059e-06
get_duckie_state_min1.513792617624675e-06
get_robot_state_max0.0035650082968553833
get_robot_state_mean0.0034478030541069786
get_robot_state_median0.0034478030541069786
get_robot_state_min0.0033305978113585735
get_state_dump_max0.004540785067682957
get_state_dump_mean0.004346133533253293
get_state_dump_median0.004346133533253293
get_state_dump_min0.00415148199882363
get_ui_image_max0.04887900384240702
get_ui_image_mean0.048120857225608854
get_ui_image_median0.048120857225608854
get_ui_image_min0.04736271060881068
in-drivable-lane_max3.699999999999995
in-drivable-lane_mean3.124999999999997
in-drivable-lane_min2.549999999999999
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324238007559195, "get_ui_image": 0.04887900384240702, "step_physics": 0.08099283941778712, "survival_time": 59.99999999999873, "driven_lanedir": 8.003164843828852, "get_state_dump": 0.004540785067682957, "get_robot_state": 0.0035650082968553833, "sim_render-ego0": 0.0036367417175902817, "get_duckie_state": 1.5875381990634432e-06, "in-drivable-lane": 2.549999999999999, "deviation-heading": 1.4143228852336414, "agent_compute-ego0": 0.006399904857765725, "complete-iteration": 0.1838255480465345, "set_robot_commands": 0.0022131551016776586, "distance-from-start": 8.275226815560739, "deviation-center-line": 4.111689234627003, "driven_lanedir_consec": 8.003164843828852, "sim_compute_sim_state": 0.03161558799203687, "sim_compute_performance-ego0": 0.00190613768082872}, "LF-full-loop-001-ego0": {"driven_any": 5.389216397912725, "get_ui_image": 0.04736271060881068, "step_physics": 0.07329411705084436, "survival_time": 39.59999999999989, "driven_lanedir": 4.866865460571654, "get_state_dump": 0.00415148199882363, "get_robot_state": 0.0033305978113585735, "sim_render-ego0": 0.0034626762924098125, "get_duckie_state": 1.513792617624675e-06, "in-drivable-lane": 3.699999999999995, "deviation-heading": 2.4012970665267455, "agent_compute-ego0": 0.016244234683985666, "complete-iteration": 0.1814656882989602, "set_robot_commands": 0.0020359933451475744, "distance-from-start": 5.289840836753452, "deviation-center-line": 3.079285805337891, "driven_lanedir_consec": 4.866865460571654, "sim_compute_sim_state": 0.029741260473244126, "sim_compute_performance-ego0": 0.001771850814434499}}
set_robot_commands_max0.0022131551016776586
set_robot_commands_mean0.0021245742234126163
set_robot_commands_median0.0021245742234126163
set_robot_commands_min0.0020359933451475744
sim_compute_performance-ego0_max0.00190613768082872
sim_compute_performance-ego0_mean0.0018389942476316097
sim_compute_performance-ego0_median0.0018389942476316097
sim_compute_performance-ego0_min0.001771850814434499
sim_compute_sim_state_max0.03161558799203687
sim_compute_sim_state_mean0.0306784242326405
sim_compute_sim_state_median0.0306784242326405
sim_compute_sim_state_min0.029741260473244126
sim_render-ego0_max0.0036367417175902817
sim_render-ego0_mean0.003549709005000047
sim_render-ego0_median0.003549709005000047
sim_render-ego0_min0.0034626762924098125
simulation-passed1
step_physics_max0.08099283941778712
step_physics_mean0.07714347823431575
step_physics_median0.07714347823431575
step_physics_min0.07329411705084436
survival_time_max59.99999999999873
survival_time_mean49.79999999999931
survival_time_min39.59999999999989
No reset possible
7952716066Nicola Carrinotemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:16:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.149999999999997
deviation-center-line_median3.6027585671677596
driven_lanedir_consec_median6.429152729080409
survival_time_median49.79999999999931


other stats
agent_compute-ego0_max0.016269076817573846
agent_compute-ego0_mean0.011142867215039128
agent_compute-ego0_median0.011142867215039128
agent_compute-ego0_min0.006016657612504411
complete-iteration_max0.1888880651505267
complete-iteration_mean0.18240742328293524
complete-iteration_median0.18240742328293524
complete-iteration_min0.1759267814153438
deviation-center-line_max4.148421133184796
deviation-center-line_mean3.6027585671677596
deviation-center-line_min3.057096001150722
deviation-heading_max2.4938586632293767
deviation-heading_mean2.0423032860991372
deviation-heading_median2.0423032860991372
deviation-heading_min1.5907479089688978
distance-from-start_max8.27421934886587
distance-from-start_mean6.778928037543857
distance-from-start_median6.778928037543857
distance-from-start_min5.283636726221845
driven_any_max8.324236580166799
driven_any_mean6.856726531946187
driven_any_median6.856726531946187
driven_any_min5.3892164837255745
driven_lanedir_consec_max8.002110156644385
driven_lanedir_consec_mean6.429152729080409
driven_lanedir_consec_min4.856195301516434
driven_lanedir_max8.002110156644385
driven_lanedir_mean6.429152729080409
driven_lanedir_median6.429152729080409
driven_lanedir_min4.856195301516434
get_duckie_state_max1.2041190533439568e-06
get_duckie_state_mean1.1595937310073142e-06
get_duckie_state_median1.1595937310073142e-06
get_duckie_state_min1.1150684086706717e-06
get_robot_state_max0.003476754711827668
get_robot_state_mean0.003461747871898349
get_robot_state_median0.003461747871898349
get_robot_state_min0.0034467410319690295
get_state_dump_max0.004452689104929851
get_state_dump_mean0.0043750165324773355
get_state_dump_median0.0043750165324773355
get_state_dump_min0.00429734396002482
get_ui_image_max0.0477430129626907
get_ui_image_mean0.04729226922650387
get_ui_image_median0.04729226922650387
get_ui_image_min0.04684152549031704
in-drivable-lane_max3.7499999999999942
in-drivable-lane_mean3.149999999999997
in-drivable-lane_min2.549999999999999
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324236580166799, "get_ui_image": 0.0477430129626907, "step_physics": 0.07591620631063113, "survival_time": 59.99999999999873, "driven_lanedir": 8.002110156644385, "get_state_dump": 0.004452689104929851, "get_robot_state": 0.003476754711827668, "sim_render-ego0": 0.0035302853405624504, "get_duckie_state": 1.1150684086706717e-06, "in-drivable-lane": 2.549999999999999, "deviation-heading": 1.5907479089688978, "agent_compute-ego0": 0.006016657612504411, "complete-iteration": 0.1759267814153438, "set_robot_commands": 0.00207867491354454, "distance-from-start": 8.27421934886587, "deviation-center-line": 4.148421133184796, "driven_lanedir_consec": 8.002110156644385, "sim_compute_sim_state": 0.03079956596241109, "sim_compute_performance-ego0": 0.0018400629791590097}, "LF-full-loop-001-ego0": {"driven_any": 5.3892164837255745, "get_ui_image": 0.04684152549031704, "step_physics": 0.08047787538843527, "survival_time": 39.59999999999989, "driven_lanedir": 4.856195301516434, "get_state_dump": 0.00429734396002482, "get_robot_state": 0.0034467410319690295, "sim_render-ego0": 0.0035411592991024367, "get_duckie_state": 1.2041190533439568e-06, "in-drivable-lane": 3.7499999999999942, "deviation-heading": 2.4938586632293767, "agent_compute-ego0": 0.016269076817573846, "complete-iteration": 0.1888880651505267, "set_robot_commands": 0.00212191332784607, "distance-from-start": 5.283636726221845, "deviation-center-line": 3.057096001150722, "driven_lanedir_consec": 4.856195301516434, "sim_compute_sim_state": 0.029970899055163463, "sim_compute_performance-ego0": 0.001846824588270536}}
set_robot_commands_max0.00212191332784607
set_robot_commands_mean0.0021002941206953053
set_robot_commands_median0.0021002941206953053
set_robot_commands_min0.00207867491354454
sim_compute_performance-ego0_max0.001846824588270536
sim_compute_performance-ego0_mean0.001843443783714773
sim_compute_performance-ego0_median0.001843443783714773
sim_compute_performance-ego0_min0.0018400629791590097
sim_compute_sim_state_max0.03079956596241109
sim_compute_sim_state_mean0.03038523250878727
sim_compute_sim_state_median0.03038523250878727
sim_compute_sim_state_min0.029970899055163463
sim_render-ego0_max0.0035411592991024367
sim_render-ego0_mean0.0035357223198324433
sim_render-ego0_median0.0035357223198324433
sim_render-ego0_min0.0035302853405624504
simulation-passed1
step_physics_max0.08047787538843527
step_physics_mean0.0781970408495332
step_physics_median0.0781970408495332
step_physics_min0.07591620631063113
survival_time_max59.99999999999873
survival_time_mean49.79999999999931
survival_time_min39.59999999999989
No reset possible
7952516065Tarik Shaheentemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.01155266978523948
agent_compute-ego0_mean0.01155266978523948
agent_compute-ego0_median0.01155266978523948
agent_compute-ego0_min0.01155266978523948
complete-iteration_max0.1345253586769104
complete-iteration_mean0.1345253586769104
complete-iteration_median0.1345253586769104
complete-iteration_min0.1345253586769104
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004316351630470969
get_duckie_state_mean0.004316351630470969
get_duckie_state_median0.004316351630470969
get_duckie_state_min0.004316351630470969
get_robot_state_max0.003699031743136319
get_robot_state_mean0.003699031743136319
get_robot_state_median0.003699031743136319
get_robot_state_min0.003699031743136319
get_state_dump_max0.005389262329448353
get_state_dump_mean0.005389262329448353
get_state_dump_median0.005389262329448353
get_state_dump_min0.005389262329448353
get_ui_image_max0.02652718804099343
get_ui_image_mean0.02652718804099343
get_ui_image_median0.02652718804099343
get_ui_image_min0.02652718804099343
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02652718804099343, "step_physics": 0.06978752938183871, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005389262329448353, "get_robot_state": 0.003699031743136319, "sim_render-ego0": 0.003861091353676536, "get_duckie_state": 0.004316351630470969, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01155266978523948, "complete-iteration": 0.1345253586769104, "set_robot_commands": 0.002242955294522372, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005035763437097723, "sim_compute_performance-ego0": 0.0020312125032598324}}
set_robot_commands_max0.002242955294522372
set_robot_commands_mean0.002242955294522372
set_robot_commands_median0.002242955294522372
set_robot_commands_min0.002242955294522372
sim_compute_performance-ego0_max0.0020312125032598324
sim_compute_performance-ego0_mean0.0020312125032598324
sim_compute_performance-ego0_median0.0020312125032598324
sim_compute_performance-ego0_min0.0020312125032598324
sim_compute_sim_state_max0.005035763437097723
sim_compute_sim_state_mean0.005035763437097723
sim_compute_sim_state_median0.005035763437097723
sim_compute_sim_state_min0.005035763437097723
sim_render-ego0_max0.003861091353676536
sim_render-ego0_mean0.003861091353676536
sim_render-ego0_median0.003861091353676536
sim_render-ego0_min0.003861091353676536
simulation-passed1
step_physics_max0.06978752938183871
step_physics_mean0.06978752938183871
step_physics_median0.06978752938183871
step_physics_min0.06978752938183871
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7952416065Tarik Shaheentemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011177458546378395
agent_compute-ego0_mean0.011177458546378395
agent_compute-ego0_median0.011177458546378395
agent_compute-ego0_min0.011177458546378395
complete-iteration_max0.13819459893486716
complete-iteration_mean0.13819459893486716
complete-iteration_median0.13819459893486716
complete-iteration_min0.13819459893486716
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004330933094024658
get_duckie_state_mean0.004330933094024658
get_duckie_state_median0.004330933094024658
get_duckie_state_min0.004330933094024658
get_robot_state_max0.003724439577622847
get_robot_state_mean0.003724439577622847
get_robot_state_median0.003724439577622847
get_robot_state_min0.003724439577622847
get_state_dump_max0.005641525441950018
get_state_dump_mean0.005641525441950018
get_state_dump_median0.005641525441950018
get_state_dump_min0.005641525441950018
get_ui_image_max0.027325489304282448
get_ui_image_mean0.027325489304282448
get_ui_image_median0.027325489304282448
get_ui_image_min0.027325489304282448
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.027325489304282448, "step_physics": 0.07233035564422607, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005641525441950018, "get_robot_state": 0.003724439577622847, "sim_render-ego0": 0.003961438482457941, "get_duckie_state": 0.004330933094024658, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011177458546378395, "complete-iteration": 0.13819459893486716, "set_robot_commands": 0.0023255456577647815, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005140179937536066, "sim_compute_performance-ego0": 0.002146016467701305}}
set_robot_commands_max0.0023255456577647815
set_robot_commands_mean0.0023255456577647815
set_robot_commands_median0.0023255456577647815
set_robot_commands_min0.0023255456577647815
sim_compute_performance-ego0_max0.002146016467701305
sim_compute_performance-ego0_mean0.002146016467701305
sim_compute_performance-ego0_median0.002146016467701305
sim_compute_performance-ego0_min0.002146016467701305
sim_compute_sim_state_max0.005140179937536066
sim_compute_sim_state_mean0.005140179937536066
sim_compute_sim_state_median0.005140179937536066
sim_compute_sim_state_min0.005140179937536066
sim_render-ego0_max0.003961438482457941
sim_render-ego0_mean0.003961438482457941
sim_render-ego0_median0.003961438482457941
sim_render-ego0_min0.003961438482457941
simulation-passed1
step_physics_max0.07233035564422607
step_physics_mean0.07233035564422607
step_physics_median0.07233035564422607
step_physics_min0.07233035564422607
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7952016062Huy Tran Tientemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011005504564805464
agent_compute-ego0_mean0.011005504564805464
agent_compute-ego0_median0.011005504564805464
agent_compute-ego0_min0.011005504564805464
complete-iteration_max0.13234628330577505
complete-iteration_mean0.13234628330577505
complete-iteration_median0.13234628330577505
complete-iteration_min0.13234628330577505
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004266180775382302
get_duckie_state_mean0.004266180775382302
get_duckie_state_median0.004266180775382302
get_duckie_state_min0.004266180775382302
get_robot_state_max0.00368577241897583
get_robot_state_mean0.00368577241897583
get_robot_state_median0.00368577241897583
get_robot_state_min0.00368577241897583
get_state_dump_max0.005324304103851318
get_state_dump_mean0.005324304103851318
get_state_dump_median0.005324304103851318
get_state_dump_min0.005324304103851318
get_ui_image_max0.02654397487640381
get_ui_image_mean0.02654397487640381
get_ui_image_median0.02654397487640381
get_ui_image_min0.02654397487640381
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02654397487640381, "step_physics": 0.06847238540649414, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005324304103851318, "get_robot_state": 0.00368577241897583, "sim_render-ego0": 0.003747679970481179, "get_duckie_state": 0.004266180775382302, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011005504564805464, "complete-iteration": 0.13234628330577505, "set_robot_commands": 0.0021643963727084074, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005085273222489791, "sim_compute_performance-ego0": 0.001964525742964311}}
set_robot_commands_max0.0021643963727084074
set_robot_commands_mean0.0021643963727084074
set_robot_commands_median0.0021643963727084074
set_robot_commands_min0.0021643963727084074
sim_compute_performance-ego0_max0.001964525742964311
sim_compute_performance-ego0_mean0.001964525742964311
sim_compute_performance-ego0_median0.001964525742964311
sim_compute_performance-ego0_min0.001964525742964311
sim_compute_sim_state_max0.005085273222489791
sim_compute_sim_state_mean0.005085273222489791
sim_compute_sim_state_median0.005085273222489791
sim_compute_sim_state_min0.005085273222489791
sim_render-ego0_max0.003747679970481179
sim_render-ego0_mean0.003747679970481179
sim_render-ego0_median0.003747679970481179
sim_render-ego0_min0.003747679970481179
simulation-passed1
step_physics_max0.06847238540649414
step_physics_mean0.06847238540649414
step_physics_median0.06847238540649414
step_physics_min0.06847238540649414
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7951816061Cagri Catikmooc-objdetmooc-objdetsimfailednogpu-production-spot-0-010:06:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 84 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7951216060Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.818061492703443


other stats
agent_compute-ego0_max0.011092266535650106
agent_compute-ego0_mean0.011092266535650106
agent_compute-ego0_median0.011092266535650106
agent_compute-ego0_min0.011092266535650106
complete-iteration_max0.18421472915231368
complete-iteration_mean0.18421472915231368
complete-iteration_median0.18421472915231368
complete-iteration_min0.18421472915231368
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.818061492703443
distance-from-start_median5.818061492703443
distance-from-start_min5.818061492703443
driven_any_max5.8273898463852865
driven_any_mean5.8273898463852865
driven_any_median5.8273898463852865
driven_any_min5.8273898463852865
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05984409105832174
get_duckie_state_mean0.05984409105832174
get_duckie_state_median0.05984409105832174
get_duckie_state_min0.05984409105832174
get_robot_state_max0.003609160854391856
get_robot_state_mean0.003609160854391856
get_robot_state_median0.003609160854391856
get_robot_state_min0.003609160854391856
get_state_dump_max0.013937025854032331
get_state_dump_mean0.013937025854032331
get_state_dump_median0.013937025854032331
get_state_dump_min0.013937025854032331
get_ui_image_max0.013535710774600234
get_ui_image_mean0.013535710774600234
get_ui_image_median0.013535710774600234
get_ui_image_min0.013535710774600234
in-drivable-lane_max10.90000000000002
in-drivable-lane_mean10.90000000000002
in-drivable-lane_median10.90000000000002
in-drivable-lane_min10.90000000000002
per-episodes
details{"d30-ego0": {"driven_any": 5.8273898463852865, "get_ui_image": 0.013535710774600234, "step_physics": 0.06628367672227833, "survival_time": 10.90000000000002, "driven_lanedir": 0.0, "get_state_dump": 0.013937025854032331, "get_robot_state": 0.003609160854391856, "sim_render-ego0": 0.003562190216970226, "get_duckie_state": 0.05984409105832174, "in-drivable-lane": 10.90000000000002, "deviation-heading": 0.0, "agent_compute-ego0": 0.011092266535650106, "complete-iteration": 0.18421472915231368, "set_robot_commands": 0.0022298179260671954, "distance-from-start": 5.818061492703443, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008138024099341267, "sim_compute_performance-ego0": 0.0018900279040750304}}
set_robot_commands_max0.0022298179260671954
set_robot_commands_mean0.0022298179260671954
set_robot_commands_median0.0022298179260671954
set_robot_commands_min0.0022298179260671954
sim_compute_performance-ego0_max0.0018900279040750304
sim_compute_performance-ego0_mean0.0018900279040750304
sim_compute_performance-ego0_median0.0018900279040750304
sim_compute_performance-ego0_min0.0018900279040750304
sim_compute_sim_state_max0.008138024099341267
sim_compute_sim_state_mean0.008138024099341267
sim_compute_sim_state_median0.008138024099341267
sim_compute_sim_state_min0.008138024099341267
sim_render-ego0_max0.003562190216970226
sim_render-ego0_mean0.003562190216970226
sim_render-ego0_median0.003562190216970226
sim_render-ego0_min0.003562190216970226
simulation-passed1
step_physics_max0.06628367672227833
step_physics_mean0.06628367672227833
step_physics_median0.06628367672227833
step_physics_min0.06628367672227833
survival_time_max10.90000000000002
survival_time_mean10.90000000000002
survival_time_median10.90000000000002
survival_time_min10.90000000000002
No reset possible
7950416060Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.81791535396395


other stats
agent_compute-ego0_max0.011408849393940408
agent_compute-ego0_mean0.011408849393940408
agent_compute-ego0_median0.011408849393940408
agent_compute-ego0_min0.011408849393940408
complete-iteration_max0.18889942887711195
complete-iteration_mean0.18889942887711195
complete-iteration_median0.18889942887711195
complete-iteration_min0.18889942887711195
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.81791535396395
distance-from-start_median5.81791535396395
distance-from-start_min5.81791535396395
driven_any_max5.827341543221683
driven_any_mean5.827341543221683
driven_any_median5.827341543221683
driven_any_min5.827341543221683
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05937950905055216
get_duckie_state_mean0.05937950905055216
get_duckie_state_median0.05937950905055216
get_duckie_state_min0.05937950905055216
get_robot_state_max0.0037375138774854407
get_robot_state_mean0.0037375138774854407
get_robot_state_median0.0037375138774854407
get_robot_state_min0.0037375138774854407
get_state_dump_max0.014137779740982404
get_state_dump_mean0.014137779740982404
get_state_dump_median0.014137779740982404
get_state_dump_min0.014137779740982404
get_ui_image_max0.013937965375647695
get_ui_image_mean0.013937965375647695
get_ui_image_median0.013937965375647695
get_ui_image_min0.013937965375647695
in-drivable-lane_max10.90000000000002
in-drivable-lane_mean10.90000000000002
in-drivable-lane_median10.90000000000002
in-drivable-lane_min10.90000000000002
per-episodes
details{"d30-ego0": {"driven_any": 5.827341543221683, "get_ui_image": 0.013937965375647695, "step_physics": 0.07036074438051546, "survival_time": 10.90000000000002, "driven_lanedir": 0.0, "get_state_dump": 0.014137779740982404, "get_robot_state": 0.0037375138774854407, "sim_render-ego0": 0.00357418517543845, "get_duckie_state": 0.05937950905055216, "in-drivable-lane": 10.90000000000002, "deviation-heading": 0.0, "agent_compute-ego0": 0.011408849393940408, "complete-iteration": 0.18889942887711195, "set_robot_commands": 0.002271241793349453, "distance-from-start": 5.81791535396395, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00810424269062199, "sim_compute_performance-ego0": 0.001888689929491853}}
set_robot_commands_max0.002271241793349453
set_robot_commands_mean0.002271241793349453
set_robot_commands_median0.002271241793349453
set_robot_commands_min0.002271241793349453
sim_compute_performance-ego0_max0.001888689929491853
sim_compute_performance-ego0_mean0.001888689929491853
sim_compute_performance-ego0_median0.001888689929491853
sim_compute_performance-ego0_min0.001888689929491853
sim_compute_sim_state_max0.00810424269062199
sim_compute_sim_state_mean0.00810424269062199
sim_compute_sim_state_median0.00810424269062199
sim_compute_sim_state_min0.00810424269062199
sim_render-ego0_max0.00357418517543845
sim_render-ego0_mean0.00357418517543845
sim_render-ego0_median0.00357418517543845
sim_render-ego0_min0.00357418517543845
simulation-passed1
step_physics_max0.07036074438051546
step_physics_mean0.07036074438051546
step_physics_median0.07036074438051546
step_physics_min0.07036074438051546
survival_time_max10.90000000000002
survival_time_mean10.90000000000002
survival_time_median10.90000000000002
survival_time_min10.90000000000002
No reset possible
7949916059Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.836932182324292


other stats
agent_compute-ego0_max0.01121194056975536
agent_compute-ego0_mean0.01121194056975536
agent_compute-ego0_median0.01121194056975536
agent_compute-ego0_min0.01121194056975536
complete-iteration_max0.182323276079618
complete-iteration_mean0.182323276079618
complete-iteration_median0.182323276079618
complete-iteration_min0.182323276079618
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.836932182324292
distance-from-start_median4.836932182324292
distance-from-start_min4.836932182324292
driven_any_max4.956285027589387
driven_any_mean4.956285027589387
driven_any_median4.956285027589387
driven_any_min4.956285027589387
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05830542368766589
get_duckie_state_mean0.05830542368766589
get_duckie_state_median0.05830542368766589
get_duckie_state_min0.05830542368766589
get_robot_state_max0.003573895723391802
get_robot_state_mean0.003573895723391802
get_robot_state_median0.003573895723391802
get_robot_state_min0.003573895723391802
get_state_dump_max0.013685496648152669
get_state_dump_mean0.013685496648152669
get_state_dump_median0.013685496648152669
get_state_dump_min0.013685496648152669
get_ui_image_max0.013285163732675406
get_ui_image_mean0.013285163732675406
get_ui_image_median0.013285163732675406
get_ui_image_min0.013285163732675406
in-drivable-lane_max9.700000000000005
in-drivable-lane_mean9.700000000000005
in-drivable-lane_median9.700000000000005
in-drivable-lane_min9.700000000000005
per-episodes
details{"d30-ego0": {"driven_any": 4.956285027589387, "get_ui_image": 0.013285163732675406, "step_physics": 0.06718290035541241, "survival_time": 9.700000000000005, "driven_lanedir": 0.0, "get_state_dump": 0.013685496648152669, "get_robot_state": 0.003573895723391802, "sim_render-ego0": 0.00347903080475636, "get_duckie_state": 0.05830542368766589, "in-drivable-lane": 9.700000000000005, "deviation-heading": 0.0, "agent_compute-ego0": 0.01121194056975536, "complete-iteration": 0.182323276079618, "set_robot_commands": 0.002180807407085712, "distance-from-start": 4.836932182324292, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007505091642722106, "sim_compute_performance-ego0": 0.0018282560201791616}}
set_robot_commands_max0.002180807407085712
set_robot_commands_mean0.002180807407085712
set_robot_commands_median0.002180807407085712
set_robot_commands_min0.002180807407085712
sim_compute_performance-ego0_max0.0018282560201791616
sim_compute_performance-ego0_mean0.0018282560201791616
sim_compute_performance-ego0_median0.0018282560201791616
sim_compute_performance-ego0_min0.0018282560201791616
sim_compute_sim_state_max0.007505091642722106
sim_compute_sim_state_mean0.007505091642722106
sim_compute_sim_state_median0.007505091642722106
sim_compute_sim_state_min0.007505091642722106
sim_render-ego0_max0.00347903080475636
sim_render-ego0_mean0.00347903080475636
sim_render-ego0_median0.00347903080475636
sim_render-ego0_min0.00347903080475636
simulation-passed1
step_physics_max0.06718290035541241
step_physics_mean0.06718290035541241
step_physics_median0.06718290035541241
step_physics_min0.06718290035541241
survival_time_max9.700000000000005
survival_time_mean9.700000000000005
survival_time_median9.700000000000005
survival_time_min9.700000000000005
No reset possible
7949216059Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-010:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.7721646091012138


other stats
agent_compute-ego0_max0.010374243060747782
agent_compute-ego0_mean0.010374243060747782
agent_compute-ego0_median0.010374243060747782
agent_compute-ego0_min0.010374243060747782
complete-iteration_max0.2136937379837036
complete-iteration_mean0.2136937379837036
complete-iteration_median0.2136937379837036
complete-iteration_min0.2136937379837036
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.7721646091012138
distance-from-start_median0.7721646091012138
distance-from-start_min0.7721646091012138
driven_any_max0.7723158506804995
driven_any_mean0.7723158506804995
driven_any_median0.7723158506804995
driven_any_min0.7723158506804995
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07780660192171733
get_duckie_state_mean0.07780660192171733
get_duckie_state_median0.07780660192171733
get_duckie_state_min0.07780660192171733
get_robot_state_max0.0036440640687942505
get_robot_state_mean0.0036440640687942505
get_robot_state_median0.0036440640687942505
get_robot_state_min0.0036440640687942505
get_state_dump_max0.017330701152483623
get_state_dump_mean0.017330701152483623
get_state_dump_median0.017330701152483623
get_state_dump_min0.017330701152483623
get_ui_image_max0.01426352063814799
get_ui_image_mean0.01426352063814799
get_ui_image_median0.01426352063814799
get_ui_image_min0.01426352063814799
in-drivable-lane_max2.3499999999999996
in-drivable-lane_mean2.3499999999999996
in-drivable-lane_median2.3499999999999996
in-drivable-lane_min2.3499999999999996
per-episodes
details{"d40-ego0": {"driven_any": 0.7723158506804995, "get_ui_image": 0.01426352063814799, "step_physics": 0.07418820758660634, "survival_time": 2.3499999999999996, "driven_lanedir": 0.0, "get_state_dump": 0.017330701152483623, "get_robot_state": 0.0036440640687942505, "sim_render-ego0": 0.0035819957653681436, "get_duckie_state": 0.07780660192171733, "in-drivable-lane": 2.3499999999999996, "deviation-heading": 0.0, "agent_compute-ego0": 0.010374243060747782, "complete-iteration": 0.2136937379837036, "set_robot_commands": 0.0022166122992833457, "distance-from-start": 0.7721646091012138, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008310402433077494, "sim_compute_performance-ego0": 0.0018895467122395833}}
set_robot_commands_max0.0022166122992833457
set_robot_commands_mean0.0022166122992833457
set_robot_commands_median0.0022166122992833457
set_robot_commands_min0.0022166122992833457
sim_compute_performance-ego0_max0.0018895467122395833
sim_compute_performance-ego0_mean0.0018895467122395833
sim_compute_performance-ego0_median0.0018895467122395833
sim_compute_performance-ego0_min0.0018895467122395833
sim_compute_sim_state_max0.008310402433077494
sim_compute_sim_state_mean0.008310402433077494
sim_compute_sim_state_median0.008310402433077494
sim_compute_sim_state_min0.008310402433077494
sim_render-ego0_max0.0035819957653681436
sim_render-ego0_mean0.0035819957653681436
sim_render-ego0_median0.0035819957653681436
sim_render-ego0_min0.0035819957653681436
simulation-passed1
step_physics_max0.07418820758660634
step_physics_mean0.07418820758660634
step_physics_median0.07418820758660634
step_physics_min0.07418820758660634
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_median2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
7948716057Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.107880390675835


other stats
agent_compute-ego0_max0.011306302589282656
agent_compute-ego0_mean0.011306302589282656
agent_compute-ego0_median0.011306302589282656
agent_compute-ego0_min0.011306302589282656
complete-iteration_max0.18493408487554183
complete-iteration_mean0.18493408487554183
complete-iteration_median0.18493408487554183
complete-iteration_min0.18493408487554183
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.107880390675835
distance-from-start_median6.107880390675835
distance-from-start_min6.107880390675835
driven_any_max6.109652933981009
driven_any_mean6.109652933981009
driven_any_median6.109652933981009
driven_any_min6.109652933981009
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0589431785700614
get_duckie_state_mean0.0589431785700614
get_duckie_state_median0.0589431785700614
get_duckie_state_min0.0589431785700614
get_robot_state_max0.003633296280576472
get_robot_state_mean0.003633296280576472
get_robot_state_median0.003633296280576472
get_robot_state_min0.003633296280576472
get_state_dump_max0.013898488722349467
get_state_dump_mean0.013898488722349467
get_state_dump_median0.013898488722349467
get_state_dump_min0.013898488722349467
get_ui_image_max0.013677903434686492
get_ui_image_mean0.013677903434686492
get_ui_image_median0.013677903434686492
get_ui_image_min0.013677903434686492
in-drivable-lane_max11.350000000000026
in-drivable-lane_mean11.350000000000026
in-drivable-lane_median11.350000000000026
in-drivable-lane_min11.350000000000026
per-episodes
details{"d30-ego0": {"driven_any": 6.109652933981009, "get_ui_image": 0.013677903434686492, "step_physics": 0.06783293318330195, "survival_time": 11.350000000000026, "driven_lanedir": 0.0, "get_state_dump": 0.013898488722349467, "get_robot_state": 0.003633296280576472, "sim_render-ego0": 0.0035273945122434383, "get_duckie_state": 0.0589431785700614, "in-drivable-lane": 11.350000000000026, "deviation-heading": 0.0, "agent_compute-ego0": 0.011306302589282656, "complete-iteration": 0.18493408487554183, "set_robot_commands": 0.0022198693794116637, "distance-from-start": 6.107880390675835, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007929171386517976, "sim_compute_performance-ego0": 0.0018792466113441869}}
set_robot_commands_max0.0022198693794116637
set_robot_commands_mean0.0022198693794116637
set_robot_commands_median0.0022198693794116637
set_robot_commands_min0.0022198693794116637
sim_compute_performance-ego0_max0.0018792466113441869
sim_compute_performance-ego0_mean0.0018792466113441869
sim_compute_performance-ego0_median0.0018792466113441869
sim_compute_performance-ego0_min0.0018792466113441869
sim_compute_sim_state_max0.007929171386517976
sim_compute_sim_state_mean0.007929171386517976
sim_compute_sim_state_median0.007929171386517976
sim_compute_sim_state_min0.007929171386517976
sim_render-ego0_max0.0035273945122434383
sim_render-ego0_mean0.0035273945122434383
sim_render-ego0_median0.0035273945122434383
sim_render-ego0_min0.0035273945122434383
simulation-passed1
step_physics_max0.06783293318330195
step_physics_mean0.06783293318330195
step_physics_median0.06783293318330195
step_physics_min0.06783293318330195
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_median11.350000000000026
survival_time_min11.350000000000026
No reset possible
7947616055Nicola Carrinotemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.77500000000009
deviation-center-line_median0.455260411272332
driven_lanedir_consec_median0.6220053909032834
survival_time_median19.550000000000143


other stats
agent_compute-ego0_max0.01643798986682099
agent_compute-ego0_mean0.011549798486673842
agent_compute-ego0_median0.011549798486673842
agent_compute-ego0_min0.006661607106526693
complete-iteration_max0.1848022809529946
complete-iteration_mean0.18031864510499665
complete-iteration_median0.18031864510499665
complete-iteration_min0.1758350092569987
deviation-center-line_max0.6386554922961303
deviation-center-line_mean0.455260411272332
deviation-center-line_min0.2718653302485337
deviation-heading_max1.6527972252799867
deviation-heading_mean1.621790980129978
deviation-heading_median1.621790980129978
deviation-heading_min1.5907847349799689
distance-from-start_max2.5308680344292873
distance-from-start_mean2.489979848046385
distance-from-start_median2.489979848046385
distance-from-start_min2.4490916616634832
driven_any_max2.7057990625865593
driven_any_mean2.5800133554089397
driven_any_median2.5800133554089397
driven_any_min2.4542276482313197
driven_lanedir_consec_max0.9028420376347656
driven_lanedir_consec_mean0.6220053909032834
driven_lanedir_consec_min0.3411687441718012
driven_lanedir_max0.9028420376347656
driven_lanedir_mean0.6220053909032834
driven_lanedir_median0.6220053909032834
driven_lanedir_min0.3411687441718012
get_duckie_state_max1.2664794921875e-06
get_duckie_state_mean1.2418191998395475e-06
get_duckie_state_median1.2418191998395475e-06
get_duckie_state_min1.2171589074915954e-06
get_robot_state_max0.003524302164713542
get_robot_state_mean0.0034738396719984632
get_robot_state_median0.0034738396719984632
get_robot_state_min0.0034233771792833846
get_state_dump_max0.004455403645833333
get_state_dump_mean0.004426021969211519
get_state_dump_median0.004426021969211519
get_state_dump_min0.004396640292589705
get_ui_image_max0.04671531168619791
get_ui_image_mean0.04667144691293183
get_ui_image_median0.04667144691293183
get_ui_image_min0.046627582139665745
in-drivable-lane_max17.500000000000114
in-drivable-lane_mean14.77500000000009
in-drivable-lane_min12.050000000000065
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.4542276482313197, "get_ui_image": 0.04671531168619791, "step_physics": 0.07644983100891113, "survival_time": 18.70000000000013, "driven_lanedir": 0.9028420376347656, "get_state_dump": 0.004455403645833333, "get_robot_state": 0.003524302164713542, "sim_render-ego0": 0.0037148907979329426, "get_duckie_state": 1.2664794921875e-06, "in-drivable-lane": 12.050000000000065, "deviation-heading": 1.5907847349799689, "agent_compute-ego0": 0.006661607106526693, "complete-iteration": 0.1758350092569987, "set_robot_commands": 0.00219345219930013, "distance-from-start": 2.4490916616634832, "deviation-center-line": 0.6386554922961303, "driven_lanedir_consec": 0.9028420376347656, "sim_compute_sim_state": 0.030119171778361004, "sim_compute_performance-ego0": 0.0019296073913574216}, "LF-full-loop-001-ego0": {"driven_any": 2.7057990625865593, "get_ui_image": 0.046627582139665745, "step_physics": 0.07776057691037801, "survival_time": 20.400000000000155, "driven_lanedir": 0.3411687441718012, "get_state_dump": 0.004396640292589705, "get_robot_state": 0.0034233771792833846, "sim_render-ego0": 0.0035929231014111807, "get_duckie_state": 1.2171589074915954e-06, "in-drivable-lane": 17.500000000000114, "deviation-heading": 1.6527972252799867, "agent_compute-ego0": 0.01643798986682099, "complete-iteration": 0.1848022809529946, "set_robot_commands": 0.002085153514423697, "distance-from-start": 2.5308680344292873, "deviation-center-line": 0.2718653302485337, "driven_lanedir_consec": 0.3411687441718012, "sim_compute_sim_state": 0.028553301081389263, "sim_compute_performance-ego0": 0.0018534858535729291}}
set_robot_commands_max0.00219345219930013
set_robot_commands_mean0.0021393028568619135
set_robot_commands_median0.0021393028568619135
set_robot_commands_min0.002085153514423697
sim_compute_performance-ego0_max0.0019296073913574216
sim_compute_performance-ego0_mean0.0018915466224651756
sim_compute_performance-ego0_median0.0018915466224651756
sim_compute_performance-ego0_min0.0018534858535729291
sim_compute_sim_state_max0.030119171778361004
sim_compute_sim_state_mean0.029336236429875137
sim_compute_sim_state_median0.029336236429875137
sim_compute_sim_state_min0.028553301081389263
sim_render-ego0_max0.0037148907979329426
sim_render-ego0_mean0.0036539069496720616
sim_render-ego0_median0.0036539069496720616
sim_render-ego0_min0.0035929231014111807
simulation-passed1
step_physics_max0.07776057691037801
step_physics_mean0.07710520395964457
step_physics_median0.07710520395964457
step_physics_min0.07644983100891113
survival_time_max20.400000000000155
survival_time_mean19.550000000000143
survival_time_min18.70000000000013
No reset possible
7947516054Nicola Carrinotemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.77500000000009
deviation-center-line_median0.4511482671171883
driven_lanedir_consec_median0.6183408767538692
survival_time_median19.52500000000014


other stats
agent_compute-ego0_max0.016425555827570895
agent_compute-ego0_mean0.011225497068143358
agent_compute-ego0_median0.011225497068143358
agent_compute-ego0_min0.00602543830871582
complete-iteration_max0.18946688490755417
complete-iteration_mean0.181627273071046
complete-iteration_median0.181627273071046
complete-iteration_min0.17378766123453776
deviation-center-line_max0.6296317479012012
deviation-center-line_mean0.4511482671171883
deviation-center-line_min0.27266478633317554
deviation-heading_max1.6589194100745768
deviation-heading_mean1.6200435650532676
deviation-heading_median1.6200435650532676
deviation-heading_min1.5811677200319587
distance-from-start_max2.5237879481301566
distance-from-start_mean2.486413360010852
distance-from-start_median2.486413360010852
distance-from-start_min2.449038771891547
driven_any_max2.6988109388743737
driven_any_mean2.5765192947067104
driven_any_median2.5765192947067104
driven_any_min2.454227650539047
driven_lanedir_consec_max0.8959765504322306
driven_lanedir_consec_mean0.6183408767538692
driven_lanedir_consec_min0.3407052030755078
driven_lanedir_max0.8959765504322306
driven_lanedir_mean0.6183408767538692
driven_lanedir_median0.6183408767538692
driven_lanedir_min0.3407052030755078
get_duckie_state_max1.203780080757889e-06
get_duckie_state_mean1.1550211438945694e-06
get_duckie_state_median1.1550211438945694e-06
get_duckie_state_min1.10626220703125e-06
get_robot_state_max0.003444541295369466
get_robot_state_mean0.003436852015700995
get_robot_state_median0.003436852015700995
get_robot_state_min0.0034291627360325235
get_state_dump_max0.0044486300618040795
get_state_dump_mean0.004331815742978863
get_state_dump_median0.004331815742978863
get_state_dump_min0.004215001424153646
get_ui_image_max0.04731711324055989
get_ui_image_mean0.047237649499201305
get_ui_image_median0.047237649499201305
get_ui_image_min0.04715818575784272
in-drivable-lane_max17.450000000000113
in-drivable-lane_mean14.77500000000009
in-drivable-lane_min12.100000000000064
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.454227650539047, "get_ui_image": 0.04731711324055989, "step_physics": 0.07515027300516765, "survival_time": 18.70000000000013, "driven_lanedir": 0.8959765504322306, "get_state_dump": 0.004215001424153646, "get_robot_state": 0.003444541295369466, "sim_render-ego0": 0.0035230496724446615, "get_duckie_state": 1.10626220703125e-06, "in-drivable-lane": 12.100000000000064, "deviation-heading": 1.5811677200319587, "agent_compute-ego0": 0.00602543830871582, "complete-iteration": 0.17378766123453776, "set_robot_commands": 0.0021277027130126953, "distance-from-start": 2.449038771891547, "deviation-center-line": 0.6296317479012012, "driven_lanedir_consec": 0.8959765504322306, "sim_compute_sim_state": 0.030109291076660157, "sim_compute_performance-ego0": 0.0018037865956624349}, "LF-full-loop-001-ego0": {"driven_any": 2.6988109388743737, "get_ui_image": 0.04715818575784272, "step_physics": 0.08149149254256603, "survival_time": 20.35000000000015, "driven_lanedir": 0.3407052030755078, "get_state_dump": 0.0044486300618040795, "get_robot_state": 0.0034291627360325235, "sim_render-ego0": 0.003613910254310159, "get_duckie_state": 1.203780080757889e-06, "in-drivable-lane": 17.450000000000113, "deviation-heading": 1.6589194100745768, "agent_compute-ego0": 0.016425555827570895, "complete-iteration": 0.18946688490755417, "set_robot_commands": 0.0021234031985787783, "distance-from-start": 2.5237879481301566, "deviation-center-line": 0.27266478633317554, "driven_lanedir_consec": 0.3407052030755078, "sim_compute_sim_state": 0.028856480238484403, "sim_compute_performance-ego0": 0.0018474775202134077}}
set_robot_commands_max0.0021277027130126953
set_robot_commands_mean0.002125552955795737
set_robot_commands_median0.002125552955795737
set_robot_commands_min0.0021234031985787783
sim_compute_performance-ego0_max0.0018474775202134077
sim_compute_performance-ego0_mean0.0018256320579379212
sim_compute_performance-ego0_median0.0018256320579379212
sim_compute_performance-ego0_min0.0018037865956624349
sim_compute_sim_state_max0.030109291076660157
sim_compute_sim_state_mean0.02948288565757228
sim_compute_sim_state_median0.02948288565757228
sim_compute_sim_state_min0.028856480238484403
sim_render-ego0_max0.003613910254310159
sim_render-ego0_mean0.0035684799633774102
sim_render-ego0_median0.0035684799633774102
sim_render-ego0_min0.0035230496724446615
simulation-passed1
step_physics_max0.08149149254256603
step_physics_mean0.07832088277386684
step_physics_median0.07832088277386684
step_physics_min0.07515027300516765
survival_time_max20.35000000000015
survival_time_mean19.52500000000014
survival_time_min18.70000000000013
No reset possible
7947316052Nicola Carrinotemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:09:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median16.500000000000135
deviation-center-line_median0.50657599189068
driven_lanedir_consec_median0.5923950923072748
survival_time_median21.825000000000173


other stats
agent_compute-ego0_max0.016457274882462774
agent_compute-ego0_mean0.011250686156578447
agent_compute-ego0_median0.011250686156578447
agent_compute-ego0_min0.006044097430694123
complete-iteration_max0.18999411415879744
complete-iteration_mean0.18118840066617284
complete-iteration_median0.18118840066617284
complete-iteration_min0.17238268717354824
deviation-center-line_max0.8087598391037415
deviation-center-line_mean0.50657599189068
deviation-center-line_min0.2043921446776185
deviation-heading_max5.02044624326797
deviation-heading_mean3.399825206879048
deviation-heading_median3.399825206879048
deviation-heading_min1.7792041704901265
distance-from-start_max3.660499572438999
distance-from-start_mean2.6291543780003583
distance-from-start_median2.6291543780003583
distance-from-start_min1.597809183561718
driven_any_max4.0335368890228365
driven_any_mean2.897968022216409
driven_any_median2.897968022216409
driven_any_min1.7623991554099816
driven_lanedir_consec_max0.9818220594517416
driven_lanedir_consec_mean0.5923950923072748
driven_lanedir_consec_min0.20296812516280793
driven_lanedir_max0.9818220594517416
driven_lanedir_mean0.5923950923072748
driven_lanedir_median0.5923950923072748
driven_lanedir_min0.20296812516280793
get_duckie_state_max1.1860019099103273e-06
get_duckie_state_mean1.153145769749517e-06
get_duckie_state_median1.153145769749517e-06
get_duckie_state_min1.1202896295887064e-06
get_robot_state_max0.0035839446269682724
get_robot_state_mean0.0034676867840666126
get_robot_state_median0.0034676867840666126
get_robot_state_min0.003351428941164953
get_state_dump_max0.004414615839937307
get_state_dump_mean0.0043241324651704174
get_state_dump_median0.0043241324651704174
get_state_dump_min0.004233649090403527
get_ui_image_max0.04669644710791372
get_ui_image_mean0.04659690377501939
get_ui_image_median0.04659690377501939
get_ui_image_min0.04649736044212506
in-drivable-lane_max21.50000000000023
in-drivable-lane_mean16.500000000000135
in-drivable-lane_min11.500000000000044
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 4.0335368890228365, "get_ui_image": 0.04649736044212506, "step_physics": 0.07402923261861437, "survival_time": 30.00000000000029, "driven_lanedir": 0.9818220594517416, "get_state_dump": 0.004233649090403527, "get_robot_state": 0.003351428941164953, "sim_render-ego0": 0.0035336505553488326, "get_duckie_state": 1.1202896295887064e-06, "in-drivable-lane": 21.50000000000023, "deviation-heading": 5.02044624326797, "agent_compute-ego0": 0.006044097430694123, "complete-iteration": 0.17238268717354824, "set_robot_commands": 0.0021210799796410685, "distance-from-start": 3.660499572438999, "deviation-center-line": 0.8087598391037415, "driven_lanedir_consec": 0.9818220594517416, "sim_compute_sim_state": 0.03071634424307977, "sim_compute_performance-ego0": 0.0017840640120419012}, "LF-full-loop-001-ego0": {"driven_any": 1.7623991554099816, "get_ui_image": 0.04669644710791372, "step_physics": 0.08038846506689587, "survival_time": 13.65000000000006, "driven_lanedir": 0.20296812516280793, "get_state_dump": 0.004414615839937307, "get_robot_state": 0.0035839446269682724, "sim_render-ego0": 0.003734916666128339, "get_duckie_state": 1.1860019099103273e-06, "in-drivable-lane": 11.500000000000044, "deviation-heading": 1.7792041704901265, "agent_compute-ego0": 0.016457274882462774, "complete-iteration": 0.18999411415879744, "set_robot_commands": 0.002169647356019403, "distance-from-start": 1.597809183561718, "deviation-center-line": 0.2043921446776185, "driven_lanedir_consec": 0.20296812516280793, "sim_compute_sim_state": 0.030495398236017157, "sim_compute_performance-ego0": 0.001979421525105943}}
set_robot_commands_max0.002169647356019403
set_robot_commands_mean0.0021453636678302355
set_robot_commands_median0.0021453636678302355
set_robot_commands_min0.0021210799796410685
sim_compute_performance-ego0_max0.001979421525105943
sim_compute_performance-ego0_mean0.001881742768573922
sim_compute_performance-ego0_median0.001881742768573922
sim_compute_performance-ego0_min0.0017840640120419012
sim_compute_sim_state_max0.03071634424307977
sim_compute_sim_state_mean0.030605871239548464
sim_compute_sim_state_median0.030605871239548464
sim_compute_sim_state_min0.030495398236017157
sim_render-ego0_max0.003734916666128339
sim_render-ego0_mean0.003634283610738586
sim_render-ego0_median0.003634283610738586
sim_render-ego0_min0.0035336505553488326
simulation-passed1
step_physics_max0.08038846506689587
step_physics_mean0.07720884884275511
step_physics_median0.07720884884275511
step_physics_min0.07402923261861437
survival_time_max30.00000000000029
survival_time_mean21.825000000000173
survival_time_min13.65000000000006
No reset possible
7947216051Cagri Catikmooc-objdetmooc-objdetsimfailednogpu-production-spot-0-010:05:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 24 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7947116050Cagri Catikmooc-objdetmooc-objdetsimabortednogpu-production-spot-0-010:03:37
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7943716049Brian Leckiebase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-010:14:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.3999999999998067
deviation-center-line_median1.7388947962880152
driven_lanedir_consec_median4.988996308493508
survival_time_median52.97499999999913


other stats
agent_compute-ego0_max0.006952785409015158
agent_compute-ego0_mean0.006680759946696552
agent_compute-ego0_median0.006680759946696552
agent_compute-ego0_min0.006408734484377948
complete-iteration_max0.11783525429597802
complete-iteration_mean0.11525187779507776
complete-iteration_median0.11525187779507776
complete-iteration_min0.1126685012941775
deviation-center-line_max2.17667426899626
deviation-center-line_mean1.7388947962880152
deviation-center-line_min1.30111532357977
deviation-heading_max12.532844028229356
deviation-heading_mean10.397633135598934
deviation-heading_median10.397633135598934
deviation-heading_min8.262422242968512
distance-from-start_max1.6330798460208698
distance-from-start_mean1.4302497455546097
distance-from-start_median1.4302497455546097
distance-from-start_min1.2274196450883497
driven_any_max6.24820338480415
driven_any_mean5.472580451051978
driven_any_median5.472580451051978
driven_any_min4.696957517299806
driven_lanedir_consec_max6.047509200594005
driven_lanedir_consec_mean4.988996308493508
driven_lanedir_consec_min3.930483416393012
driven_lanedir_max6.047509200594005
driven_lanedir_mean4.988996308493508
driven_lanedir_median4.988996308493508
driven_lanedir_min3.930483416393012
get_duckie_state_max1.8770280091658885e-06
get_duckie_state_mean1.8038483811888651e-06
get_duckie_state_median1.8038483811888651e-06
get_duckie_state_min1.7306687532118415e-06
get_robot_state_max0.003509163955764707
get_robot_state_mean0.0034998147880271925
get_robot_state_median0.0034998147880271925
get_robot_state_min0.003490465620289678
get_state_dump_max0.004362127366014365
get_state_dump_mean0.004356291138478055
get_state_dump_median0.004356291138478055
get_state_dump_min0.004350454910941746
get_ui_image_max0.028305301458939263
get_ui_image_mean0.028106525477883837
get_ui_image_median0.028106525477883837
get_ui_image_min0.027907749496828407
in-drivable-lane_max6.7999999999996135
in-drivable-lane_mean3.3999999999998067
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 4.696957517299806, "get_ui_image": 0.028305301458939263, "step_physics": 0.058258570277172586, "survival_time": 45.94999999999953, "driven_lanedir": 3.930483416393012, "get_state_dump": 0.004350454910941746, "get_robot_state": 0.003490465620289678, "sim_render-ego0": 0.0035458341888759447, "get_duckie_state": 1.8770280091658885e-06, "in-drivable-lane": 6.7999999999996135, "deviation-heading": 8.262422242968512, "agent_compute-ego0": 0.006952785409015158, "complete-iteration": 0.1126685012941775, "set_robot_commands": 0.0022756428822227146, "distance-from-start": 1.2274196450883497, "deviation-center-line": 1.30111532357977, "driven_lanedir_consec": 3.930483416393012, "sim_compute_sim_state": 0.003524022257846335, "sim_compute_performance-ego0": 0.0018869843171990437}, "LF-small-loop-001-ego0": {"driven_any": 6.24820338480415, "get_ui_image": 0.027907749496828407, "step_physics": 0.0642733401204029, "survival_time": 59.99999999999873, "driven_lanedir": 6.047509200594005, "get_state_dump": 0.004362127366014365, "get_robot_state": 0.003509163955764707, "sim_render-ego0": 0.003475520731904525, "get_duckie_state": 1.7306687532118415e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.532844028229356, "agent_compute-ego0": 0.006408734484377948, "complete-iteration": 0.11783525429597802, "set_robot_commands": 0.0022055427795842127, "distance-from-start": 1.6330798460208698, "deviation-center-line": 2.17667426899626, "driven_lanedir_consec": 6.047509200594005, "sim_compute_sim_state": 0.00377696717807792, "sim_compute_performance-ego0": 0.0018416473410905747}}
set_robot_commands_max0.0022756428822227146
set_robot_commands_mean0.0022405928309034637
set_robot_commands_median0.0022405928309034637
set_robot_commands_min0.0022055427795842127
sim_compute_performance-ego0_max0.0018869843171990437
sim_compute_performance-ego0_mean0.0018643158291448093
sim_compute_performance-ego0_median0.0018643158291448093
sim_compute_performance-ego0_min0.0018416473410905747
sim_compute_sim_state_max0.00377696717807792
sim_compute_sim_state_mean0.003650494717962127
sim_compute_sim_state_median0.003650494717962127
sim_compute_sim_state_min0.003524022257846335
sim_render-ego0_max0.0035458341888759447
sim_render-ego0_mean0.003510677460390235
sim_render-ego0_median0.003510677460390235
sim_render-ego0_min0.003475520731904525
simulation-passed1
step_physics_max0.0642733401204029
step_physics_mean0.06126595519878774
step_physics_median0.06126595519878774
step_physics_min0.058258570277172586
survival_time_max59.99999999999873
survival_time_mean52.97499999999913
survival_time_min45.94999999999953
No reset possible
7943616048Ed Murphytemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median18.45000000000015
deviation-center-line_median0.9017171646647328
driven_lanedir_consec_median1.2379061114715737
survival_time_median27.80000000000026


other stats
agent_compute-ego0_max0.01610440894511411
agent_compute-ego0_mean0.011187607830476516
agent_compute-ego0_median0.011187607830476516
agent_compute-ego0_min0.006270806715838922
complete-iteration_max0.1898811642695913
complete-iteration_mean0.1850353548786715
complete-iteration_median0.1850353548786715
complete-iteration_min0.18018954548775176
deviation-center-line_max1.2769373971723494
deviation-center-line_mean0.9017171646647328
deviation-center-line_min0.5264969321571162
deviation-heading_max1.581024843558827
deviation-heading_mean1.569301212975892
deviation-heading_median1.569301212975892
deviation-heading_min1.5575775823929563
distance-from-start_max3.69293880994821
distance-from-start_mean3.685205901128736
distance-from-start_median3.685205901128736
distance-from-start_min3.677472992309262
driven_any_max3.781969869385867
driven_any_mean3.733053206939677
driven_any_median3.733053206939677
driven_any_min3.6841365444934873
driven_lanedir_consec_max1.781800813761322
driven_lanedir_consec_mean1.2379061114715737
driven_lanedir_consec_min0.694011409181825
driven_lanedir_max1.781800813761322
driven_lanedir_mean1.2379061114715737
driven_lanedir_median1.2379061114715737
driven_lanedir_min0.694011409181825
get_duckie_state_max1.1624493776799097e-06
get_duckie_state_mean1.126645049924382e-06
get_duckie_state_median1.126645049924382e-06
get_duckie_state_min1.0908407221688549e-06
get_robot_state_max0.003480449129578855
get_robot_state_mean0.003451851871143198
get_robot_state_median0.003451851871143198
get_robot_state_min0.003423254612707541
get_state_dump_max0.004399990739026248
get_state_dump_mean0.004390071224802867
get_state_dump_median0.004390071224802867
get_state_dump_min0.004380151710579486
get_ui_image_max0.04715893056561423
get_ui_image_mean0.04688873398860541
get_ui_image_median0.04688873398860541
get_ui_image_min0.04661853741159659
in-drivable-lane_max22.25000000000018
in-drivable-lane_mean18.45000000000015
in-drivable-lane_min14.650000000000116
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.6841365444934873, "get_ui_image": 0.04715893056561423, "step_physics": 0.08099389249313549, "survival_time": 27.500000000000256, "driven_lanedir": 1.781800813761322, "get_state_dump": 0.004380151710579486, "get_robot_state": 0.003480449129578855, "sim_render-ego0": 0.003635407792245411, "get_duckie_state": 1.0908407221688549e-06, "in-drivable-lane": 14.650000000000116, "deviation-heading": 1.581024843558827, "agent_compute-ego0": 0.006270806715838922, "complete-iteration": 0.18018954548775176, "set_robot_commands": 0.0021326957294166412, "distance-from-start": 3.677472992309262, "deviation-center-line": 1.2769373971723494, "driven_lanedir_consec": 1.781800813761322, "sim_compute_sim_state": 0.03018262425265165, "sim_compute_performance-ego0": 0.001881380911963821}, "LF-full-loop-001-ego0": {"driven_any": 3.781969869385867, "get_ui_image": 0.04661853741159659, "step_physics": 0.08247154305290372, "survival_time": 28.100000000000264, "driven_lanedir": 0.694011409181825, "get_state_dump": 0.004399990739026248, "get_robot_state": 0.003423254612707541, "sim_render-ego0": 0.003600998839518952, "get_duckie_state": 1.1624493776799097e-06, "in-drivable-lane": 22.25000000000018, "deviation-heading": 1.5575775823929563, "agent_compute-ego0": 0.01610440894511411, "complete-iteration": 0.1898811642695913, "set_robot_commands": 0.002050593310096971, "distance-from-start": 3.69293880994821, "deviation-center-line": 0.5264969321571162, "driven_lanedir_consec": 0.694011409181825, "sim_compute_sim_state": 0.02930296039073124, "sim_compute_performance-ego0": 0.00183654551395938}}
set_robot_commands_max0.0021326957294166412
set_robot_commands_mean0.0020916445197568063
set_robot_commands_median0.0020916445197568063
set_robot_commands_min0.002050593310096971
sim_compute_performance-ego0_max0.001881380911963821
sim_compute_performance-ego0_mean0.0018589632129616003
sim_compute_performance-ego0_median0.0018589632129616003
sim_compute_performance-ego0_min0.00183654551395938
sim_compute_sim_state_max0.03018262425265165
sim_compute_sim_state_mean0.02974279232169145
sim_compute_sim_state_median0.02974279232169145
sim_compute_sim_state_min0.02930296039073124
sim_render-ego0_max0.003635407792245411
sim_render-ego0_mean0.003618203315882182
sim_render-ego0_median0.003618203315882182
sim_render-ego0_min0.003600998839518952
simulation-passed1
step_physics_max0.08247154305290372
step_physics_mean0.0817327177730196
step_physics_median0.0817327177730196
step_physics_min0.08099389249313549
survival_time_max28.100000000000264
survival_time_mean27.80000000000026
survival_time_min27.500000000000256
No reset possible
7943516047Waipot Ngamsaadtemplate-randomaido-hello-sim-validation370abortedyesgpu-production-spot-0-010:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.010477775877172297
agent_compute-ego0_mean0.010477775877172297
agent_compute-ego0_median0.010477775877172297
agent_compute-ego0_min0.010477775877172297
complete-iteration_max0.13758164102380926
complete-iteration_mean0.13758164102380926
complete-iteration_median0.13758164102380926
complete-iteration_min0.13758164102380926
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004136275161396374
get_duckie_state_mean0.004136275161396374
get_duckie_state_median0.004136275161396374
get_duckie_state_min0.004136275161396374
get_robot_state_max0.0036020116372541947
get_robot_state_mean0.0036020116372541947
get_robot_state_median0.0036020116372541947
get_robot_state_min0.0036020116372541947
get_state_dump_max0.005385079167105935
get_state_dump_mean0.005385079167105935
get_state_dump_median0.005385079167105935
get_state_dump_min0.005385079167105935
get_ui_image_max0.027408052574504505
get_ui_image_mean0.027408052574504505
get_ui_image_median0.027408052574504505
get_ui_image_min0.027408052574504505
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.027408052574504505, "step_physics": 0.07372457872737538, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005385079167105935, "get_robot_state": 0.0036020116372541947, "sim_render-ego0": 0.003713781183416193, "get_duckie_state": 0.004136275161396374, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.010477775877172297, "complete-iteration": 0.13758164102380926, "set_robot_commands": 0.002122748981822621, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005012875253503973, "sim_compute_performance-ego0": 0.00192481821233576}}
set_robot_commands_max0.002122748981822621
set_robot_commands_mean0.002122748981822621
set_robot_commands_median0.002122748981822621
set_robot_commands_min0.002122748981822621
sim_compute_performance-ego0_max0.00192481821233576
sim_compute_performance-ego0_mean0.00192481821233576
sim_compute_performance-ego0_median0.00192481821233576
sim_compute_performance-ego0_min0.00192481821233576
sim_compute_sim_state_max0.005012875253503973
sim_compute_sim_state_mean0.005012875253503973
sim_compute_sim_state_median0.005012875253503973
sim_compute_sim_state_min0.005012875253503973
sim_render-ego0_max0.003713781183416193
sim_render-ego0_mean0.003713781183416193
sim_render-ego0_median0.003713781183416193
sim_render-ego0_min0.003713781183416193
simulation-passed1
step_physics_max0.07372457872737538
step_physics_mean0.07372457872737538
step_physics_median0.07372457872737538
step_physics_min0.07372457872737538
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7943016046Zoe Nolanexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-010:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.439477852790993


other stats
agent_compute-ego0_max0.011639432149703028
agent_compute-ego0_mean0.011639432149703028
agent_compute-ego0_median0.011639432149703028
agent_compute-ego0_min0.011639432149703028
complete-iteration_max0.223669193424189
complete-iteration_mean0.223669193424189
complete-iteration_median0.223669193424189
complete-iteration_min0.223669193424189
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.439477852790993
distance-from-start_median3.439477852790993
distance-from-start_min3.439477852790993
driven_any_max3.6753537814125714
driven_any_mean3.6753537814125714
driven_any_median3.6753537814125714
driven_any_min3.6753537814125714
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09045615245092638
get_duckie_state_mean0.09045615245092638
get_duckie_state_median0.09045615245092638
get_duckie_state_min0.09045615245092638
get_robot_state_max0.0037113842447021902
get_robot_state_mean0.0037113842447021902
get_robot_state_median0.0037113842447021902
get_robot_state_min0.0037113842447021902
get_state_dump_max0.01867283316986058
get_state_dump_mean0.01867283316986058
get_state_dump_median0.01867283316986058
get_state_dump_min0.01867283316986058
get_ui_image_max0.015017298121008478
get_ui_image_mean0.015017298121008478
get_ui_image_median0.015017298121008478
get_ui_image_min0.015017298121008478
in-drivable-lane_max58.49999999999881
in-drivable-lane_mean58.49999999999881
in-drivable-lane_median58.49999999999881
in-drivable-lane_min58.49999999999881
per-episodes
details{"d45-ego0": {"driven_any": 3.6753537814125714, "get_ui_image": 0.015017298121008478, "step_physics": 0.06664871517966488, "survival_time": 58.49999999999881, "driven_lanedir": 0.0, "get_state_dump": 0.01867283316986058, "get_robot_state": 0.0037113842447021902, "sim_render-ego0": 0.003609400544789589, "get_duckie_state": 0.09045615245092638, "in-drivable-lane": 58.49999999999881, "deviation-heading": 0.0, "agent_compute-ego0": 0.011639432149703028, "complete-iteration": 0.223669193424189, "set_robot_commands": 0.002225026221075799, "distance-from-start": 3.439477852790993, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00967041149188269, "sim_compute_performance-ego0": 0.0019289742770304953}}
set_robot_commands_max0.002225026221075799
set_robot_commands_mean0.002225026221075799
set_robot_commands_median0.002225026221075799
set_robot_commands_min0.002225026221075799
sim_compute_performance-ego0_max0.0019289742770304953
sim_compute_performance-ego0_mean0.0019289742770304953
sim_compute_performance-ego0_median0.0019289742770304953
sim_compute_performance-ego0_min0.0019289742770304953
sim_compute_sim_state_max0.00967041149188269
sim_compute_sim_state_mean0.00967041149188269
sim_compute_sim_state_median0.00967041149188269
sim_compute_sim_state_min0.00967041149188269
sim_render-ego0_max0.003609400544789589
sim_render-ego0_mean0.003609400544789589
sim_render-ego0_median0.003609400544789589
sim_render-ego0_min0.003609400544789589
simulation-passed1
step_physics_max0.06664871517966488
step_physics_mean0.06664871517966488
step_physics_median0.06664871517966488
step_physics_min0.06664871517966488
survival_time_max58.49999999999881
survival_time_mean58.49999999999881
survival_time_median58.49999999999881
survival_time_min58.49999999999881
No reset possible
7942516045Zoe Nolanexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:11:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.849980790041014


other stats
agent_compute-ego0_max0.011070467054000206
agent_compute-ego0_mean0.011070467054000206
agent_compute-ego0_median0.011070467054000206
agent_compute-ego0_min0.011070467054000206
complete-iteration_max0.23384995127002167
complete-iteration_mean0.23384995127002167
complete-iteration_median0.23384995127002167
complete-iteration_min0.23384995127002167
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.849980790041014
distance-from-start_median2.849980790041014
distance-from-start_min2.849980790041014
driven_any_max4.093720089923245
driven_any_mean4.093720089923245
driven_any_median4.093720089923245
driven_any_min4.093720089923245
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10122736169337036
get_duckie_state_mean0.10122736169337036
get_duckie_state_median0.10122736169337036
get_duckie_state_min0.10122736169337036
get_robot_state_max0.0037129048403851898
get_robot_state_mean0.0037129048403851898
get_robot_state_median0.0037129048403851898
get_robot_state_min0.0037129048403851898
get_state_dump_max0.020092459344347748
get_state_dump_mean0.020092459344347748
get_state_dump_median0.020092459344347748
get_state_dump_min0.020092459344347748
get_ui_image_max0.015016213741826576
get_ui_image_mean0.015016213741826576
get_ui_image_median0.015016213741826576
get_ui_image_min0.015016213741826576
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 4.093720089923245, "get_ui_image": 0.015016213741826576, "step_physics": 0.0655194170568309, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.020092459344347748, "get_robot_state": 0.0037129048403851898, "sim_render-ego0": 0.003548884967483152, "get_duckie_state": 0.10122736169337036, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.011070467054000206, "complete-iteration": 0.23384995127002167, "set_robot_commands": 0.002216584080958942, "distance-from-start": 2.849980790041014, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00945888173073952, "sim_compute_performance-ego0": 0.0019008652752980303}}
set_robot_commands_max0.002216584080958942
set_robot_commands_mean0.002216584080958942
set_robot_commands_median0.002216584080958942
set_robot_commands_min0.002216584080958942
sim_compute_performance-ego0_max0.0019008652752980303
sim_compute_performance-ego0_mean0.0019008652752980303
sim_compute_performance-ego0_median0.0019008652752980303
sim_compute_performance-ego0_min0.0019008652752980303
sim_compute_sim_state_max0.00945888173073952
sim_compute_sim_state_mean0.00945888173073952
sim_compute_sim_state_median0.00945888173073952
sim_compute_sim_state_min0.00945888173073952
sim_render-ego0_max0.003548884967483152
sim_render-ego0_mean0.003548884967483152
sim_render-ego0_median0.003548884967483152
sim_render-ego0_min0.003548884967483152
simulation-passed1
step_physics_max0.0655194170568309
step_physics_mean0.0655194170568309
step_physics_median0.0655194170568309
step_physics_min0.0655194170568309
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7942216044Zoe Nolanexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-010:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.05831205315045


other stats
agent_compute-ego0_max0.011472991660789206
agent_compute-ego0_mean0.011472991660789206
agent_compute-ego0_median0.011472991660789206
agent_compute-ego0_min0.011472991660789206
complete-iteration_max0.205197236651466
complete-iteration_mean0.205197236651466
complete-iteration_median0.205197236651466
complete-iteration_min0.205197236651466
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.05831205315045
distance-from-start_median2.05831205315045
distance-from-start_min2.05831205315045
driven_any_max3.3635057629858784
driven_any_mean3.3635057629858784
driven_any_median3.3635057629858784
driven_any_min3.3635057629858784
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07775534019268379
get_duckie_state_mean0.07775534019268379
get_duckie_state_median0.07775534019268379
get_duckie_state_min0.07775534019268379
get_robot_state_max0.003561511872306703
get_robot_state_mean0.003561511872306703
get_robot_state_median0.003561511872306703
get_robot_state_min0.003561511872306703
get_state_dump_max0.01683744400266617
get_state_dump_mean0.01683744400266617
get_state_dump_median0.01683744400266617
get_state_dump_min0.01683744400266617
get_ui_image_max0.014208831736650416
get_ui_image_mean0.014208831736650416
get_ui_image_median0.014208831736650416
get_ui_image_min0.014208831736650416
in-drivable-lane_max47.199999999999456
in-drivable-lane_mean47.199999999999456
in-drivable-lane_median47.199999999999456
in-drivable-lane_min47.199999999999456
per-episodes
details{"d40-ego0": {"driven_any": 3.3635057629858784, "get_ui_image": 0.014208831736650416, "step_physics": 0.06386081932713746, "survival_time": 47.199999999999456, "driven_lanedir": 0.0, "get_state_dump": 0.01683744400266617, "get_robot_state": 0.003561511872306703, "sim_render-ego0": 0.003523803135705373, "get_duckie_state": 0.07775534019268379, "in-drivable-lane": 47.199999999999456, "deviation-heading": 0.0, "agent_compute-ego0": 0.011472991660789206, "complete-iteration": 0.205197236651466, "set_robot_commands": 0.0022229383862207804, "distance-from-start": 2.05831205315045, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009831207769888418, "sim_compute_performance-ego0": 0.001835794549770456}}
set_robot_commands_max0.0022229383862207804
set_robot_commands_mean0.0022229383862207804
set_robot_commands_median0.0022229383862207804
set_robot_commands_min0.0022229383862207804
sim_compute_performance-ego0_max0.001835794549770456
sim_compute_performance-ego0_mean0.001835794549770456
sim_compute_performance-ego0_median0.001835794549770456
sim_compute_performance-ego0_min0.001835794549770456
sim_compute_sim_state_max0.009831207769888418
sim_compute_sim_state_mean0.009831207769888418
sim_compute_sim_state_median0.009831207769888418
sim_compute_sim_state_min0.009831207769888418
sim_render-ego0_max0.003523803135705373
sim_render-ego0_mean0.003523803135705373
sim_render-ego0_median0.003523803135705373
sim_render-ego0_min0.003523803135705373
simulation-passed1
step_physics_max0.06386081932713746
step_physics_mean0.06386081932713746
step_physics_median0.06386081932713746
step_physics_min0.06386081932713746
survival_time_max47.199999999999456
survival_time_mean47.199999999999456
survival_time_median47.199999999999456
survival_time_min47.199999999999456
No reset possible
7941216043Zoe Nolanexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.579600000000537


other stats
agent_compute-ego0_max0.010927443500363164
agent_compute-ego0_mean0.010927443500363164
agent_compute-ego0_median0.010927443500363164
agent_compute-ego0_min0.010927443500363164
complete-iteration_max0.18381952782852465
complete-iteration_mean0.18381952782852465
complete-iteration_median0.18381952782852465
complete-iteration_min0.18381952782852465
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.579600000000537
distance-from-start_median3.579600000000537
distance-from-start_min3.579600000000537
driven_any_max3.5796000000006214
driven_any_mean3.5796000000006214
driven_any_median3.5796000000006214
driven_any_min3.5796000000006214
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05915944780735648
get_duckie_state_mean0.05915944780735648
get_duckie_state_median0.05915944780735648
get_duckie_state_min0.05915944780735648
get_robot_state_max0.0035840948852869396
get_robot_state_mean0.0035840948852869396
get_robot_state_median0.0035840948852869396
get_robot_state_min0.0035840948852869396
get_state_dump_max0.013532552592065513
get_state_dump_mean0.013532552592065513
get_state_dump_median0.013532552592065513
get_state_dump_min0.013532552592065513
get_ui_image_max0.013460385610817076
get_ui_image_mean0.013460385610817076
get_ui_image_median0.013460385610817076
get_ui_image_min0.013460385610817076
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 3.5796000000006214, "get_ui_image": 0.013460385610817076, "step_physics": 0.06643686504983386, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.013532552592065513, "get_robot_state": 0.0035840948852869396, "sim_render-ego0": 0.0035272645116547164, "get_duckie_state": 0.05915944780735648, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010927443500363164, "complete-iteration": 0.18381952782852465, "set_robot_commands": 0.002168078108889971, "distance-from-start": 3.579600000000537, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009082830915046075, "sim_compute_performance-ego0": 0.0018585554070516392}}
set_robot_commands_max0.002168078108889971
set_robot_commands_mean0.002168078108889971
set_robot_commands_median0.002168078108889971
set_robot_commands_min0.002168078108889971
sim_compute_performance-ego0_max0.0018585554070516392
sim_compute_performance-ego0_mean0.0018585554070516392
sim_compute_performance-ego0_median0.0018585554070516392
sim_compute_performance-ego0_min0.0018585554070516392
sim_compute_sim_state_max0.009082830915046075
sim_compute_sim_state_mean0.009082830915046075
sim_compute_sim_state_median0.009082830915046075
sim_compute_sim_state_min0.009082830915046075
sim_render-ego0_max0.0035272645116547164
sim_render-ego0_mean0.0035272645116547164
sim_render-ego0_median0.0035272645116547164
sim_render-ego0_min0.0035272645116547164
simulation-passed1
step_physics_max0.06643686504983386
step_physics_mean0.06643686504983386
step_physics_median0.06643686504983386
step_physics_min0.06643686504983386
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7940616042Zoe Nolanexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.2954034397349616


other stats
agent_compute-ego0_max0.011288594766096637
agent_compute-ego0_mean0.011288594766096637
agent_compute-ego0_median0.011288594766096637
agent_compute-ego0_min0.011288594766096637
complete-iteration_max0.18676244302229447
complete-iteration_mean0.18676244302229447
complete-iteration_median0.18676244302229447
complete-iteration_min0.18676244302229447
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.2954034397349616
distance-from-start_median2.2954034397349616
distance-from-start_min2.2954034397349616
driven_any_max2.326415414810225
driven_any_mean2.326415414810225
driven_any_median2.326415414810225
driven_any_min2.326415414810225
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05940475767309016
get_duckie_state_mean0.05940475767309016
get_duckie_state_median0.05940475767309016
get_duckie_state_min0.05940475767309016
get_robot_state_max0.0036240027167580343
get_robot_state_mean0.0036240027167580343
get_robot_state_median0.0036240027167580343
get_robot_state_min0.0036240027167580343
get_state_dump_max0.014063444571061567
get_state_dump_mean0.014063444571061567
get_state_dump_median0.014063444571061567
get_state_dump_min0.014063444571061567
get_ui_image_max0.013701389919627795
get_ui_image_mean0.013701389919627795
get_ui_image_median0.013701389919627795
get_ui_image_min0.013701389919627795
in-drivable-lane_max27.450000000000255
in-drivable-lane_mean27.450000000000255
in-drivable-lane_median27.450000000000255
in-drivable-lane_min27.450000000000255
per-episodes
details{"d30-ego0": {"driven_any": 2.326415414810225, "get_ui_image": 0.013701389919627795, "step_physics": 0.06796780066056685, "survival_time": 27.450000000000255, "driven_lanedir": 0.0, "get_state_dump": 0.014063444571061567, "get_robot_state": 0.0036240027167580343, "sim_render-ego0": 0.003572582331570712, "get_duckie_state": 0.05940475767309016, "in-drivable-lane": 27.450000000000255, "deviation-heading": 0.0, "agent_compute-ego0": 0.011288594766096637, "complete-iteration": 0.18676244302229447, "set_robot_commands": 0.002197420380332254, "distance-from-start": 2.2954034397349616, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00898792570287531, "sim_compute_performance-ego0": 0.001866870793429288}}
set_robot_commands_max0.002197420380332254
set_robot_commands_mean0.002197420380332254
set_robot_commands_median0.002197420380332254
set_robot_commands_min0.002197420380332254
sim_compute_performance-ego0_max0.001866870793429288
sim_compute_performance-ego0_mean0.001866870793429288
sim_compute_performance-ego0_median0.001866870793429288
sim_compute_performance-ego0_min0.001866870793429288
sim_compute_sim_state_max0.00898792570287531
sim_compute_sim_state_mean0.00898792570287531
sim_compute_sim_state_median0.00898792570287531
sim_compute_sim_state_min0.00898792570287531
sim_render-ego0_max0.003572582331570712
sim_render-ego0_mean0.003572582331570712
sim_render-ego0_median0.003572582331570712
sim_render-ego0_min0.003572582331570712
simulation-passed1
step_physics_max0.06796780066056685
step_physics_mean0.06796780066056685
step_physics_median0.06796780066056685
step_physics_min0.06796780066056685
survival_time_max27.450000000000255
survival_time_mean27.450000000000255
survival_time_median27.450000000000255
survival_time_min27.450000000000255
No reset possible
7939516040Zoe Nolanexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-010:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.5737563610347713


other stats
agent_compute-ego0_max0.010245582841020342
agent_compute-ego0_mean0.010245582841020342
agent_compute-ego0_median0.010245582841020342
agent_compute-ego0_min0.010245582841020342
complete-iteration_max0.21068390561182437
complete-iteration_mean0.21068390561182437
complete-iteration_median0.21068390561182437
complete-iteration_min0.21068390561182437
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.5737563610347713
distance-from-start_median3.5737563610347713
distance-from-start_min3.5737563610347713
driven_any_max3.630308635094468
driven_any_mean3.630308635094468
driven_any_median3.630308635094468
driven_any_min3.630308635094468
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08523074375600441
get_duckie_state_mean0.08523074375600441
get_duckie_state_median0.08523074375600441
get_duckie_state_min0.08523074375600441
get_robot_state_max0.003448166517691251
get_robot_state_mean0.003448166517691251
get_robot_state_median0.003448166517691251
get_robot_state_min0.003448166517691251
get_state_dump_max0.01787174532157396
get_state_dump_mean0.01787174532157396
get_state_dump_median0.01787174532157396
get_state_dump_min0.01787174532157396
get_ui_image_max0.0142863422111111
get_ui_image_mean0.0142863422111111
get_ui_image_median0.0142863422111111
get_ui_image_min0.0142863422111111
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 3.630308635094468, "get_ui_image": 0.0142863422111111, "step_physics": 0.06276192077490611, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.01787174532157396, "get_robot_state": 0.003448166517691251, "sim_render-ego0": 0.0034253974441286923, "get_duckie_state": 0.08523074375600441, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010245582841020342, "complete-iteration": 0.21068390561182437, "set_robot_commands": 0.00203566507534818, "distance-from-start": 3.5737563610347713, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009514132109807987, "sim_compute_performance-ego0": 0.0017897370058134335}}
set_robot_commands_max0.00203566507534818
set_robot_commands_mean0.00203566507534818
set_robot_commands_median0.00203566507534818
set_robot_commands_min0.00203566507534818
sim_compute_performance-ego0_max0.0017897370058134335
sim_compute_performance-ego0_mean0.0017897370058134335
sim_compute_performance-ego0_median0.0017897370058134335
sim_compute_performance-ego0_min0.0017897370058134335
sim_compute_sim_state_max0.009514132109807987
sim_compute_sim_state_mean0.009514132109807987
sim_compute_sim_state_median0.009514132109807987
sim_compute_sim_state_min0.009514132109807987
sim_render-ego0_max0.0034253974441286923
sim_render-ego0_mean0.0034253974441286923
sim_render-ego0_median0.0034253974441286923
sim_render-ego0_min0.0034253974441286923
simulation-passed1
step_physics_max0.06276192077490611
step_physics_mean0.06276192077490611
step_physics_median0.06276192077490611
step_physics_min0.06276192077490611
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7938816039Zoe Nolanexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-010:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.5296525037843196


other stats
agent_compute-ego0_max0.011327887019251344
agent_compute-ego0_mean0.011327887019251344
agent_compute-ego0_median0.011327887019251344
agent_compute-ego0_min0.011327887019251344
complete-iteration_max0.2189675424254199
complete-iteration_mean0.2189675424254199
complete-iteration_median0.2189675424254199
complete-iteration_min0.2189675424254199
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.5296525037843196
distance-from-start_median3.5296525037843196
distance-from-start_min3.5296525037843196
driven_any_max5.27048663181426
driven_any_mean5.27048663181426
driven_any_median5.27048663181426
driven_any_min5.27048663181426
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08906433817142238
get_duckie_state_mean0.08906433817142238
get_duckie_state_median0.08906433817142238
get_duckie_state_min0.08906433817142238
get_robot_state_max0.00365416693170003
get_robot_state_mean0.00365416693170003
get_robot_state_median0.00365416693170003
get_robot_state_min0.00365416693170003
get_state_dump_max0.018178242275830304
get_state_dump_mean0.018178242275830304
get_state_dump_median0.018178242275830304
get_state_dump_min0.018178242275830304
get_ui_image_max0.014406767432797134
get_ui_image_mean0.014406767432797134
get_ui_image_median0.014406767432797134
get_ui_image_min0.014406767432797134
in-drivable-lane_max59.84999999999874
in-drivable-lane_mean59.84999999999874
in-drivable-lane_median59.84999999999874
in-drivable-lane_min59.84999999999874
per-episodes
details{"d45-ego0": {"driven_any": 5.27048663181426, "get_ui_image": 0.014406767432797134, "step_physics": 0.06595884639154094, "survival_time": 59.84999999999874, "driven_lanedir": 0.0, "get_state_dump": 0.018178242275830304, "get_robot_state": 0.00365416693170003, "sim_render-ego0": 0.003516975547714106, "get_duckie_state": 0.08906433817142238, "in-drivable-lane": 59.84999999999874, "deviation-heading": 0.0, "agent_compute-ego0": 0.011327887019251344, "complete-iteration": 0.2189675424254199, "set_robot_commands": 0.0021995980671928803, "distance-from-start": 3.5296525037843196, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008706656839692333, "sim_compute_performance-ego0": 0.0018737077314985016}}
set_robot_commands_max0.0021995980671928803
set_robot_commands_mean0.0021995980671928803
set_robot_commands_median0.0021995980671928803
set_robot_commands_min0.0021995980671928803
sim_compute_performance-ego0_max0.0018737077314985016
sim_compute_performance-ego0_mean0.0018737077314985016
sim_compute_performance-ego0_median0.0018737077314985016
sim_compute_performance-ego0_min0.0018737077314985016
sim_compute_sim_state_max0.008706656839692333
sim_compute_sim_state_mean0.008706656839692333
sim_compute_sim_state_median0.008706656839692333
sim_compute_sim_state_min0.008706656839692333
sim_render-ego0_max0.003516975547714106
sim_render-ego0_mean0.003516975547714106
sim_render-ego0_median0.003516975547714106
sim_render-ego0_min0.003516975547714106
simulation-passed1
step_physics_max0.06595884639154094
step_physics_mean0.06595884639154094
step_physics_median0.06595884639154094
step_physics_min0.06595884639154094
survival_time_max59.84999999999874
survival_time_mean59.84999999999874
survival_time_median59.84999999999874
survival_time_min59.84999999999874
No reset possible
7938016037Jerry Kuchexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.7958685507834464


other stats
agent_compute-ego0_max0.011274389938922106
agent_compute-ego0_mean0.011274389938922106
agent_compute-ego0_median0.011274389938922106
agent_compute-ego0_min0.011274389938922106
complete-iteration_max0.2315726551498313
complete-iteration_mean0.2315726551498313
complete-iteration_median0.2315726551498313
complete-iteration_min0.2315726551498313
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.7958685507834464
distance-from-start_median1.7958685507834464
distance-from-start_min1.7958685507834464
driven_any_max1.8315909938956805
driven_any_mean1.8315909938956805
driven_any_median1.8315909938956805
driven_any_min1.8315909938956805
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09653178555177652
get_duckie_state_mean0.09653178555177652
get_duckie_state_median0.09653178555177652
get_duckie_state_min0.09653178555177652
get_robot_state_max0.003588408818651863
get_robot_state_mean0.003588408818651863
get_robot_state_median0.003588408818651863
get_robot_state_min0.003588408818651863
get_state_dump_max0.020037502376464577
get_state_dump_mean0.020037502376464577
get_state_dump_median0.020037502376464577
get_state_dump_min0.020037502376464577
get_ui_image_max0.014823694458675592
get_ui_image_mean0.014823694458675592
get_ui_image_median0.014823694458675592
get_ui_image_min0.014823694458675592
in-drivable-lane_max22.80000000000019
in-drivable-lane_mean22.80000000000019
in-drivable-lane_median22.80000000000019
in-drivable-lane_min22.80000000000019
per-episodes
details{"d50-ego0": {"driven_any": 1.8315909938956805, "get_ui_image": 0.014823694458675592, "step_physics": 0.067430312576127, "survival_time": 22.80000000000019, "driven_lanedir": 0.0, "get_state_dump": 0.020037502376464577, "get_robot_state": 0.003588408818651863, "sim_render-ego0": 0.0034894452835850954, "get_duckie_state": 0.09653178555177652, "in-drivable-lane": 22.80000000000019, "deviation-heading": 0.0, "agent_compute-ego0": 0.011274389938922106, "complete-iteration": 0.2315726551498313, "set_robot_commands": 0.002151592033436314, "distance-from-start": 1.7958685507834464, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010348214623182032, "sim_compute_performance-ego0": 0.0018112784663227507}}
set_robot_commands_max0.002151592033436314
set_robot_commands_mean0.002151592033436314
set_robot_commands_median0.002151592033436314
set_robot_commands_min0.002151592033436314
sim_compute_performance-ego0_max0.0018112784663227507
sim_compute_performance-ego0_mean0.0018112784663227507
sim_compute_performance-ego0_median0.0018112784663227507
sim_compute_performance-ego0_min0.0018112784663227507
sim_compute_sim_state_max0.010348214623182032
sim_compute_sim_state_mean0.010348214623182032
sim_compute_sim_state_median0.010348214623182032
sim_compute_sim_state_min0.010348214623182032
sim_render-ego0_max0.0034894452835850954
sim_render-ego0_mean0.0034894452835850954
sim_render-ego0_median0.0034894452835850954
sim_render-ego0_min0.0034894452835850954
simulation-passed1
step_physics_max0.067430312576127
step_physics_mean0.067430312576127
step_physics_median0.067430312576127
step_physics_min0.067430312576127
survival_time_max22.80000000000019
survival_time_mean22.80000000000019
survival_time_median22.80000000000019
survival_time_min22.80000000000019
No reset possible
7937416037Jerry Kuchexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8893776655153665


other stats
agent_compute-ego0_max0.011543428259236472
agent_compute-ego0_mean0.011543428259236472
agent_compute-ego0_median0.011543428259236472
agent_compute-ego0_min0.011543428259236472
complete-iteration_max0.23254610172339849
complete-iteration_mean0.23254610172339849
complete-iteration_median0.23254610172339849
complete-iteration_min0.23254610172339849
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8893776655153665
distance-from-start_median0.8893776655153665
distance-from-start_min0.8893776655153665
driven_any_max0.9012285400562552
driven_any_mean0.9012285400562552
driven_any_median0.9012285400562552
driven_any_min0.9012285400562552
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0973780740584646
get_duckie_state_mean0.0973780740584646
get_duckie_state_median0.0973780740584646
get_duckie_state_min0.0973780740584646
get_robot_state_max0.003575978534562247
get_robot_state_mean0.003575978534562247
get_robot_state_median0.003575978534562247
get_robot_state_min0.003575978534562247
get_state_dump_max0.019786977342196872
get_state_dump_mean0.019786977342196872
get_state_dump_median0.019786977342196872
get_state_dump_min0.019786977342196872
get_ui_image_max0.014959147998264855
get_ui_image_mean0.014959147998264855
get_ui_image_median0.014959147998264855
get_ui_image_min0.014959147998264855
in-drivable-lane_max11.150000000000023
in-drivable-lane_mean11.150000000000023
in-drivable-lane_median11.150000000000023
in-drivable-lane_min11.150000000000023
per-episodes
details{"d50-ego0": {"driven_any": 0.9012285400562552, "get_ui_image": 0.014959147998264855, "step_physics": 0.0671707157577787, "survival_time": 11.150000000000023, "driven_lanedir": 0.0, "get_state_dump": 0.019786977342196872, "get_robot_state": 0.003575978534562247, "sim_render-ego0": 0.0035305949194090708, "get_duckie_state": 0.0973780740584646, "in-drivable-lane": 11.150000000000023, "deviation-heading": 0.0, "agent_compute-ego0": 0.011543428259236472, "complete-iteration": 0.23254610172339849, "set_robot_commands": 0.0021603362900870188, "distance-from-start": 0.8893776655153665, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010540378945214408, "sim_compute_performance-ego0": 0.001819622303758349}}
set_robot_commands_max0.0021603362900870188
set_robot_commands_mean0.0021603362900870188
set_robot_commands_median0.0021603362900870188
set_robot_commands_min0.0021603362900870188
sim_compute_performance-ego0_max0.001819622303758349
sim_compute_performance-ego0_mean0.001819622303758349
sim_compute_performance-ego0_median0.001819622303758349
sim_compute_performance-ego0_min0.001819622303758349
sim_compute_sim_state_max0.010540378945214408
sim_compute_sim_state_mean0.010540378945214408
sim_compute_sim_state_median0.010540378945214408
sim_compute_sim_state_min0.010540378945214408
sim_render-ego0_max0.0035305949194090708
sim_render-ego0_mean0.0035305949194090708
sim_render-ego0_median0.0035305949194090708
sim_render-ego0_min0.0035305949194090708
simulation-passed1
step_physics_max0.0671707157577787
step_physics_mean0.0671707157577787
step_physics_median0.0671707157577787
step_physics_min0.0671707157577787
survival_time_max11.150000000000023
survival_time_mean11.150000000000023
survival_time_median11.150000000000023
survival_time_min11.150000000000023
No reset possible
7937216035Luigi Cappellabase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-010:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.525000000000048
deviation-center-line_median0.37639684069599016
driven_lanedir_consec_median0.8482679057122156
survival_time_median12.32500000000004


other stats
agent_compute-ego0_max0.0068049209733163155
agent_compute-ego0_mean0.006609959203097471
agent_compute-ego0_median0.006609959203097471
agent_compute-ego0_min0.006414997432878626
complete-iteration_max0.11933820450354202
complete-iteration_mean0.11613879410898592
complete-iteration_median0.11613879410898592
complete-iteration_min0.1129393837144298
deviation-center-line_max0.4123305293486221
deviation-center-line_mean0.37639684069599016
deviation-center-line_min0.34046315204335825
deviation-heading_max1.6284004618854246
deviation-heading_mean1.3320346178992124
deviation-heading_median1.3320346178992124
deviation-heading_min1.0356687739130002
distance-from-start_max1.17427993029249
distance-from-start_mean1.1741278963328312
distance-from-start_median1.1741278963328312
distance-from-start_min1.1739758623731724
driven_any_max1.175052447329473
driven_any_mean1.1750524433442262
driven_any_median1.1750524433442262
driven_any_min1.1750524393589796
driven_lanedir_consec_max0.9497440477563096
driven_lanedir_consec_mean0.8482679057122156
driven_lanedir_consec_min0.7467917636681216
driven_lanedir_max0.9497440477563096
driven_lanedir_mean0.8482679057122156
driven_lanedir_median0.8482679057122156
driven_lanedir_min0.7467917636681216
get_duckie_state_max1.2934449230611083e-06
get_duckie_state_mean1.2788201057211888e-06
get_duckie_state_median1.2788201057211888e-06
get_duckie_state_min1.264195288381269e-06
get_robot_state_max0.003522458576386974
get_robot_state_mean0.003479016810729545
get_robot_state_median0.003479016810729545
get_robot_state_min0.0034355750450721155
get_state_dump_max0.0044120848178863525
get_state_dump_mean0.004411575946248011
get_state_dump_median0.004411575946248011
get_state_dump_min0.004411067074609671
get_ui_image_max0.028444301744221676
get_ui_image_mean0.028078152791426544
get_ui_image_median0.028078152791426544
get_ui_image_min0.027712003838631413
in-drivable-lane_max4.55000000000006
in-drivable-lane_mean3.525000000000048
in-drivable-lane_min2.5000000000000355
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.175052447329473, "get_ui_image": 0.027712003838631413, "step_physics": 0.05923749554541803, "survival_time": 12.35000000000004, "driven_lanedir": 0.7467917636681216, "get_state_dump": 0.0044120848178863525, "get_robot_state": 0.003522458576386974, "sim_render-ego0": 0.003520240706782187, "get_duckie_state": 1.264195288381269e-06, "in-drivable-lane": 4.55000000000006, "deviation-heading": 1.0356687739130002, "agent_compute-ego0": 0.0068049209733163155, "complete-iteration": 0.1129393837144298, "set_robot_commands": 0.002470460630232288, "distance-from-start": 1.17427993029249, "deviation-center-line": 0.34046315204335825, "driven_lanedir_consec": 0.7467917636681216, "sim_compute_sim_state": 0.003330959427741266, "sim_compute_performance-ego0": 0.001848050663548131}, "LF-small-loop-001-ego0": {"driven_any": 1.1750524393589796, "get_ui_image": 0.028444301744221676, "step_physics": 0.06524160033778141, "survival_time": 12.30000000000004, "driven_lanedir": 0.9497440477563096, "get_state_dump": 0.004411067074609671, "get_robot_state": 0.0034355750450721155, "sim_render-ego0": 0.0034381262203942425, "get_duckie_state": 1.2934449230611083e-06, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 1.6284004618854246, "agent_compute-ego0": 0.006414997432878626, "complete-iteration": 0.11933820450354202, "set_robot_commands": 0.002087786130094335, "distance-from-start": 1.1739758623731724, "deviation-center-line": 0.4123305293486221, "driven_lanedir_consec": 0.9497440477563096, "sim_compute_sim_state": 0.003991536283299991, "sim_compute_performance-ego0": 0.0017995081449809827}}
set_robot_commands_max0.002470460630232288
set_robot_commands_mean0.0022791233801633115
set_robot_commands_median0.0022791233801633115
set_robot_commands_min0.002087786130094335
sim_compute_performance-ego0_max0.001848050663548131
sim_compute_performance-ego0_mean0.001823779404264557
sim_compute_performance-ego0_median0.001823779404264557
sim_compute_performance-ego0_min0.0017995081449809827
sim_compute_sim_state_max0.003991536283299991
sim_compute_sim_state_mean0.0036612478555206286
sim_compute_sim_state_median0.0036612478555206286
sim_compute_sim_state_min0.003330959427741266
sim_render-ego0_max0.003520240706782187
sim_render-ego0_mean0.003479183463588215
sim_render-ego0_median0.003479183463588215
sim_render-ego0_min0.0034381262203942425
simulation-passed1
step_physics_max0.06524160033778141
step_physics_mean0.06223954794159972
step_physics_median0.06223954794159972
step_physics_min0.05923749554541803
survival_time_max12.35000000000004
survival_time_mean12.32500000000004
survival_time_min12.30000000000004
No reset possible
7937116034Luigi Cappellatemplate-rosmooc-visservoingsimfailednogpu-production-spot-0-010:02:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7937016034Luigi Cappellatemplate-rosmooc-visservoingsimfailednogpu-production-spot-0-010:04:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7936816032Emanuele Noninoobjdet exercisemooc-objdetsimsuccessnogpu-production-spot-0-010:15:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median42.59999999999947
driven_lanedir_consec_median4.669692931303486


other stats
agent_compute-ego0_max0.00927876393860524
agent_compute-ego0_mean0.009025496099228338
agent_compute-ego0_median0.009025496099228338
agent_compute-ego0_min0.008772228259851437
complete-iteration_max0.18349404636767383
complete-iteration_mean0.17665044255571566
complete-iteration_median0.17665044255571566
complete-iteration_min0.1698068387437575
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.7895372300147867
deviation-center-line_median0.7895372300147867
deviation-center-line_min0.16369121646881216
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.73934300422758
distance-from-start_mean4.669461836815373
distance-from-start_median4.669461836815373
distance-from-start_min2.5995806694031653
driven_any_max6.73934300422758
driven_any_mean4.669461836815373
driven_any_median4.669461836815373
driven_any_min2.5995806694031653
driven_lanedir_consec_max6.739416375324249
driven_lanedir_consec_mean4.669692931303486
driven_lanedir_consec_min2.599969487282723
driven_lanedir_max6.739416375324249
driven_lanedir_mean4.669692931303486
driven_lanedir_median4.669692931303486
driven_lanedir_min2.599969487282723
get_duckie_state_max0.019269669879783104
get_duckie_state_mean0.019158834040756075
get_duckie_state_median0.019158834040756075
get_duckie_state_min0.019047998201729047
get_robot_state_max0.003494341506449805
get_robot_state_mean0.0034684287278306516
get_robot_state_median0.0034684287278306516
get_robot_state_min0.003442515949211498
get_state_dump_max0.007534052593873279
get_state_dump_mean0.007525424022635093
get_state_dump_median0.007525424022635093
get_state_dump_min0.007516795451396907
get_ui_image_max0.029645821931062393
get_ui_image_mean0.029566597632114267
get_ui_image_median0.029566597632114267
get_ui_image_min0.02948737333316614
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.73934300422758, "get_ui_image": 0.02948737333316614, "step_physics": 0.06768761483749541, "survival_time": 25.200000000000223, "driven_lanedir": 6.739416375324249, "get_state_dump": 0.007534052593873279, "get_robot_state": 0.003442515949211498, "sim_render-ego0": 0.003451074940143245, "get_duckie_state": 0.019047998201729047, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.008772228259851437, "complete-iteration": 0.1698068387437575, "set_robot_commands": 0.0020764936314951075, "distance-from-start": 6.73934300422758, "deviation-center-line": 0.16369121646881216, "driven_lanedir_consec": 6.739416375324249, "sim_compute_sim_state": 0.02641030396565352, "sim_compute_performance-ego0": 0.00181920315959666}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.5995806694031653, "get_ui_image": 0.029645821931062393, "step_physics": 0.07323962445064548, "survival_time": 59.99999999999873, "driven_lanedir": 2.599969487282723, "get_state_dump": 0.007516795451396907, "get_robot_state": 0.003494341506449805, "sim_render-ego0": 0.003578269809211522, "get_duckie_state": 0.019269669879783104, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.00927876393860524, "complete-iteration": 0.18349404636767383, "set_robot_commands": 0.002108617190218885, "distance-from-start": 2.5995806694031653, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.599969487282723, "sim_compute_sim_state": 0.03340105450619865, "sim_compute_performance-ego0": 0.001884343324354745}}
set_robot_commands_max0.002108617190218885
set_robot_commands_mean0.0020925554108569963
set_robot_commands_median0.0020925554108569963
set_robot_commands_min0.0020764936314951075
sim_compute_performance-ego0_max0.001884343324354745
sim_compute_performance-ego0_mean0.0018517732419757024
sim_compute_performance-ego0_median0.0018517732419757024
sim_compute_performance-ego0_min0.00181920315959666
sim_compute_sim_state_max0.03340105450619865
sim_compute_sim_state_mean0.02990567923592609
sim_compute_sim_state_median0.02990567923592609
sim_compute_sim_state_min0.02641030396565352
sim_render-ego0_max0.003578269809211522
sim_render-ego0_mean0.0035146723746773832
sim_render-ego0_median0.0035146723746773832
sim_render-ego0_min0.003451074940143245
simulation-passed1
step_physics_max0.07323962445064548
step_physics_mean0.07046361964407044
step_physics_median0.07046361964407044
step_physics_min0.06768761483749541
survival_time_max59.99999999999873
survival_time_mean42.59999999999947
survival_time_min25.200000000000223
No reset possible
7936616030Haridas P Ttemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:20:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median16.07499999999961
deviation-center-line_median4.9391342982256266
driven_lanedir_consec_median6.1364459628842924
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.01616428297425587
agent_compute-ego0_mean0.011064098538407478
agent_compute-ego0_median0.011064098538407478
agent_compute-ego0_min0.005963914102559086
complete-iteration_max0.183957505484207
complete-iteration_mean0.17973245262206344
complete-iteration_median0.17973245262206344
complete-iteration_min0.1755073997599199
deviation-center-line_max6.343362682306687
deviation-center-line_mean4.9391342982256266
deviation-center-line_min3.5349059141445665
deviation-heading_max1.5715071433811536
deviation-heading_mean0.9420176859001638
deviation-heading_median0.9420176859001638
deviation-heading_min0.31252822841917394
distance-from-start_max8.324124123549
distance-from-start_mean8.32222332644481
distance-from-start_median8.32222332644481
distance-from-start_min8.32032252934062
driven_any_max8.338217658490077
driven_any_mean8.331232569527536
driven_any_median8.331232569527536
driven_any_min8.324247480564997
driven_lanedir_consec_max6.93900568562609
driven_lanedir_consec_mean6.1364459628842924
driven_lanedir_consec_min5.333886240142495
driven_lanedir_max6.93900568562609
driven_lanedir_mean6.1364459628842924
driven_lanedir_median6.1364459628842924
driven_lanedir_min5.333886240142495
get_duckie_state_max1.204003898626958e-06
get_duckie_state_mean1.191398086992529e-06
get_duckie_state_median1.191398086992529e-06
get_duckie_state_min1.1787922753581e-06
get_robot_state_max0.0034610865812913067
get_robot_state_mean0.0034007462335565904
get_robot_state_median0.0034007462335565904
get_robot_state_min0.0033404058858218736
get_state_dump_max0.004244103221273938
get_state_dump_mean0.00421197825327801
get_state_dump_median0.00421197825327801
get_state_dump_min0.004179853285282081
get_ui_image_max0.04748087143719345
get_ui_image_mean0.047300809527515475
get_ui_image_median0.047300809527515475
get_ui_image_min0.047120747617837494
in-drivable-lane_max21.799999999999205
in-drivable-lane_mean16.07499999999961
in-drivable-lane_min10.350000000000012
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324247480564997, "get_ui_image": 0.04748087143719345, "step_physics": 0.07567632644996357, "survival_time": 59.99999999999873, "driven_lanedir": 6.93900568562609, "get_state_dump": 0.004244103221273938, "get_robot_state": 0.0034610865812913067, "sim_render-ego0": 0.0035473369341111004, "get_duckie_state": 1.204003898626958e-06, "in-drivable-lane": 10.350000000000012, "deviation-heading": 0.31252822841917394, "agent_compute-ego0": 0.005963914102559086, "complete-iteration": 0.1755073997599199, "set_robot_commands": 0.0021246992281136368, "distance-from-start": 8.32032252934062, "deviation-center-line": 6.343362682306687, "driven_lanedir_consec": 6.93900568562609, "sim_compute_sim_state": 0.031076201193537142, "sim_compute_performance-ego0": 0.001860428809325562}, "LF-full-loop-001-ego0": {"driven_any": 8.338217658490077, "get_ui_image": 0.047120747617837494, "step_physics": 0.07481027542800332, "survival_time": 59.99999999999873, "driven_lanedir": 5.333886240142495, "get_state_dump": 0.004179853285282081, "get_robot_state": 0.0033404058858218736, "sim_render-ego0": 0.0034636534024634824, "get_duckie_state": 1.1787922753581e-06, "in-drivable-lane": 21.799999999999205, "deviation-heading": 1.5715071433811536, "agent_compute-ego0": 0.01616428297425587, "complete-iteration": 0.183957505484207, "set_robot_commands": 0.002010678371521555, "distance-from-start": 8.324124123549, "deviation-center-line": 3.5349059141445665, "driven_lanedir_consec": 5.333886240142495, "sim_compute_sim_state": 0.03099970317303787, "sim_compute_performance-ego0": 0.0017968762625663306}}
set_robot_commands_max0.0021246992281136368
set_robot_commands_mean0.0020676887998175957
set_robot_commands_median0.0020676887998175957
set_robot_commands_min0.002010678371521555
sim_compute_performance-ego0_max0.001860428809325562
sim_compute_performance-ego0_mean0.0018286525359459463
sim_compute_performance-ego0_median0.0018286525359459463
sim_compute_performance-ego0_min0.0017968762625663306
sim_compute_sim_state_max0.031076201193537142
sim_compute_sim_state_mean0.031037952183287507
sim_compute_sim_state_median0.031037952183287507
sim_compute_sim_state_min0.03099970317303787
sim_render-ego0_max0.0035473369341111004
sim_render-ego0_mean0.003505495168287291
sim_render-ego0_median0.003505495168287291
sim_render-ego0_min0.0034636534024634824
simulation-passed1
step_physics_max0.07567632644996357
step_physics_mean0.07524330093898345
step_physics_median0.07524330093898345
step_physics_min0.07481027542800332
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7936516029Chang Duanbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-010:15:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median8.074999999999712
deviation-center-line_median4.5051510210359895
driven_lanedir_consec_median5.288762512581984
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.0064587259570525945
agent_compute-ego0_mean0.006391594848664575
agent_compute-ego0_median0.006391594848664575
agent_compute-ego0_min0.006324463740276556
complete-iteration_max0.115536601418361
complete-iteration_mean0.11482437276324069
complete-iteration_median0.11482437276324069
complete-iteration_min0.11411214410812034
deviation-center-line_max5.58748468756365
deviation-center-line_mean4.5051510210359895
deviation-center-line_min3.422817354508328
deviation-heading_max11.946630535415844
deviation-heading_mean8.002167474654742
deviation-heading_median8.002167474654742
deviation-heading_min4.05770441389364
distance-from-start_max1.6701053597762363
distance-from-start_mean1.3916955927357448
distance-from-start_median1.3916955927357448
distance-from-start_min1.1132858256952534
driven_any_max6.248409928348594
driven_any_mean6.245776671540609
driven_any_median6.245776671540609
driven_any_min6.243143414732623
driven_lanedir_consec_max6.055739802643193
driven_lanedir_consec_mean5.288762512581984
driven_lanedir_consec_min4.5217852225207755
driven_lanedir_max6.055739802643193
driven_lanedir_mean5.288762512581984
driven_lanedir_median5.288762512581984
driven_lanedir_min4.5217852225207755
get_duckie_state_max1.196063229880861e-06
get_duckie_state_mean1.155863594353745e-06
get_duckie_state_median1.155863594353745e-06
get_duckie_state_min1.1156639588266289e-06
get_robot_state_max0.003423710647570303
get_robot_state_mean0.003412389040588836
get_robot_state_median0.003412389040588836
get_robot_state_min0.00340106743360737
get_state_dump_max0.004410602766508663
get_state_dump_mean0.004345189820320581
get_state_dump_median0.004345189820320581
get_state_dump_min0.004279776874132498
get_ui_image_max0.02843666751617
get_ui_image_mean0.028283953071136857
get_ui_image_median0.028283953071136857
get_ui_image_min0.028131238626103713
in-drivable-lane_max16.149999999999423
in-drivable-lane_mean8.074999999999712
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.243143414732623, "get_ui_image": 0.028131238626103713, "step_physics": 0.06045986948958245, "survival_time": 59.99999999999873, "driven_lanedir": 6.055739802643193, "get_state_dump": 0.004279776874132498, "get_robot_state": 0.003423710647570303, "sim_render-ego0": 0.003507972656936074, "get_duckie_state": 1.1156639588266289e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.946630535415844, "agent_compute-ego0": 0.0064587259570525945, "complete-iteration": 0.11411214410812034, "set_robot_commands": 0.002285217861648801, "distance-from-start": 1.1132858256952534, "deviation-center-line": 3.422817354508328, "driven_lanedir_consec": 6.055739802643193, "sim_compute_sim_state": 0.003669949991319896, "sim_compute_performance-ego0": 0.0018205275444265808}, "LF-small-loop-001-ego0": {"driven_any": 6.248409928348594, "get_ui_image": 0.02843666751617, "step_physics": 0.06166460730451827, "survival_time": 59.99999999999873, "driven_lanedir": 4.5217852225207755, "get_state_dump": 0.004410602766508663, "get_robot_state": 0.00340106743360737, "sim_render-ego0": 0.0034137351824580185, "get_duckie_state": 1.196063229880861e-06, "in-drivable-lane": 16.149999999999423, "deviation-heading": 4.05770441389364, "agent_compute-ego0": 0.006324463740276556, "complete-iteration": 0.115536601418361, "set_robot_commands": 0.002333191411878346, "distance-from-start": 1.6701053597762363, "deviation-center-line": 5.58748468756365, "driven_lanedir_consec": 4.5217852225207755, "sim_compute_sim_state": 0.003674593297369177, "sim_compute_performance-ego0": 0.001802014073761774}}
set_robot_commands_max0.002333191411878346
set_robot_commands_mean0.0023092046367635738
set_robot_commands_median0.0023092046367635738
set_robot_commands_min0.002285217861648801
sim_compute_performance-ego0_max0.0018205275444265808
sim_compute_performance-ego0_mean0.001811270809094177
sim_compute_performance-ego0_median0.001811270809094177
sim_compute_performance-ego0_min0.001802014073761774
sim_compute_sim_state_max0.003674593297369177
sim_compute_sim_state_mean0.003672271644344536
sim_compute_sim_state_median0.003672271644344536
sim_compute_sim_state_min0.003669949991319896
sim_render-ego0_max0.003507972656936074
sim_render-ego0_mean0.0034608539196970462
sim_render-ego0_median0.0034608539196970462
sim_render-ego0_min0.0034137351824580185
simulation-passed1
step_physics_max0.06166460730451827
step_physics_mean0.06106223839705035
step_physics_median0.06106223839705035
step_physics_min0.06045986948958245
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7936216028Andrew Luotemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:18:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.899999999999409
deviation-center-line_median3.4956588919169738
driven_lanedir_consec_median6.296504725541089
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.016210218948885167
agent_compute-ego0_mean0.011175732132199403
agent_compute-ego0_median0.011175732132199403
agent_compute-ego0_min0.006141245315513643
complete-iteration_max0.1910620283623917
complete-iteration_mean0.1828553223987106
complete-iteration_median0.1828553223987106
complete-iteration_min0.17464861643502952
deviation-center-line_max3.6157260587631153
deviation-center-line_mean3.4956588919169738
deviation-center-line_min3.3755917250708327
deviation-heading_max1.9045291472120491
deviation-heading_mean1.532573904882355
deviation-heading_median1.532573904882355
deviation-heading_min1.160618662552661
distance-from-start_max8.305471234246172
distance-from-start_mean8.305190005762643
distance-from-start_median8.305190005762643
distance-from-start_min8.304908777279117
driven_any_max8.338216116288066
driven_any_mean8.33123151786865
driven_any_median8.33123151786865
driven_any_min8.324246919449234
driven_lanedir_consec_max7.712408405484002
driven_lanedir_consec_mean6.296504725541089
driven_lanedir_consec_min4.880601045598175
driven_lanedir_max7.712408405484002
driven_lanedir_mean6.296504725541089
driven_lanedir_median6.296504725541089
driven_lanedir_min4.880601045598175
get_duckie_state_max1.1303541960069085e-06
get_duckie_state_mean1.1146713752333666e-06
get_duckie_state_median1.1146713752333666e-06
get_duckie_state_min1.0989885544598251e-06
get_robot_state_max0.0034099764669070533
get_robot_state_mean0.003380548745567455
get_robot_state_median0.003380548745567455
get_robot_state_min0.003351121024227857
get_state_dump_max0.0042970345280351095
get_state_dump_mean0.00429378471009241
get_state_dump_median0.00429378471009241
get_state_dump_min0.00429053489214971
get_ui_image_max0.0473830334649892
get_ui_image_mean0.04711731853929785
get_ui_image_median0.04711731853929785
get_ui_image_min0.0468516036136065
in-drivable-lane_max25.049999999998825
in-drivable-lane_mean14.899999999999409
in-drivable-lane_min4.749999999999991
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324246919449234, "get_ui_image": 0.0473830334649892, "step_physics": 0.0751001016980504, "survival_time": 59.99999999999873, "driven_lanedir": 4.880601045598175, "get_state_dump": 0.00429053489214971, "get_robot_state": 0.0034099764669070533, "sim_render-ego0": 0.003513211513141311, "get_duckie_state": 1.1303541960069085e-06, "in-drivable-lane": 25.049999999998825, "deviation-heading": 1.160618662552661, "agent_compute-ego0": 0.006141245315513643, "complete-iteration": 0.17464861643502952, "set_robot_commands": 0.0021595633297935312, "distance-from-start": 8.305471234246172, "deviation-center-line": 3.3755917250708327, "driven_lanedir_consec": 4.880601045598175, "sim_compute_sim_state": 0.03075038423943182, "sim_compute_performance-ego0": 0.0018289776070727396}, "LF-full-loop-001-ego0": {"driven_any": 8.338216116288066, "get_ui_image": 0.0468516036136065, "step_physics": 0.0821333828814123, "survival_time": 59.99999999999873, "driven_lanedir": 7.712408405484002, "get_state_dump": 0.0042970345280351095, "get_robot_state": 0.003351121024227857, "sim_render-ego0": 0.0034922155909097564, "get_duckie_state": 1.0989885544598251e-06, "in-drivable-lane": 4.749999999999991, "deviation-heading": 1.9045291472120491, "agent_compute-ego0": 0.016210218948885167, "complete-iteration": 0.1910620283623917, "set_robot_commands": 0.002046400660976184, "distance-from-start": 8.304908777279117, "deviation-center-line": 3.6157260587631153, "driven_lanedir_consec": 7.712408405484002, "sim_compute_sim_state": 0.030813814102858925, "sim_compute_performance-ego0": 0.0017952224197832372}}
set_robot_commands_max0.0021595633297935312
set_robot_commands_mean0.0021029819953848577
set_robot_commands_median0.0021029819953848577
set_robot_commands_min0.002046400660976184
sim_compute_performance-ego0_max0.0018289776070727396
sim_compute_performance-ego0_mean0.0018121000134279884
sim_compute_performance-ego0_median0.0018121000134279884
sim_compute_performance-ego0_min0.0017952224197832372
sim_compute_sim_state_max0.030813814102858925
sim_compute_sim_state_mean0.030782099171145372
sim_compute_sim_state_median0.030782099171145372
sim_compute_sim_state_min0.03075038423943182
sim_render-ego0_max0.003513211513141311
sim_render-ego0_mean0.003502713552025534
sim_render-ego0_median0.003502713552025534
sim_render-ego0_min0.0034922155909097564
simulation-passed1
step_physics_max0.0821333828814123
step_physics_mean0.07861674228973134
step_physics_median0.07861674228973134
step_physics_min0.0751001016980504
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7936116027Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6832320998744943


other stats
agent_compute-ego0_max0.011845309819493974
agent_compute-ego0_mean0.011845309819493974
agent_compute-ego0_median0.011845309819493974
agent_compute-ego0_min0.011845309819493974
complete-iteration_max0.2358394988945552
complete-iteration_mean0.2358394988945552
complete-iteration_median0.2358394988945552
complete-iteration_min0.2358394988945552
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6832320998744943
distance-from-start_median2.6832320998744943
distance-from-start_min2.6832320998744943
driven_any_max2.683233635326225
driven_any_mean2.683233635326225
driven_any_median2.683233635326225
driven_any_min2.683233635326225
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10078953206539154
get_duckie_state_mean0.10078953206539154
get_duckie_state_median0.10078953206539154
get_duckie_state_min0.10078953206539154
get_robot_state_max0.00376564690044948
get_robot_state_mean0.00376564690044948
get_robot_state_median0.00376564690044948
get_robot_state_min0.00376564690044948
get_state_dump_max0.02033646191869463
get_state_dump_mean0.02033646191869463
get_state_dump_median0.02033646191869463
get_state_dump_min0.02033646191869463
get_ui_image_max0.014913820794650487
get_ui_image_mean0.014913820794650487
get_ui_image_median0.014913820794650487
get_ui_image_min0.014913820794650487
in-drivable-lane_max5.549999999999988
in-drivable-lane_mean5.549999999999988
in-drivable-lane_median5.549999999999988
in-drivable-lane_min5.549999999999988
per-episodes
details{"d50-ego0": {"driven_any": 2.683233635326225, "get_ui_image": 0.014913820794650487, "step_physics": 0.06724278203078679, "survival_time": 5.549999999999988, "driven_lanedir": 0.0, "get_state_dump": 0.02033646191869463, "get_robot_state": 0.00376564690044948, "sim_render-ego0": 0.003656491637229919, "get_duckie_state": 0.10078953206539154, "in-drivable-lane": 5.549999999999988, "deviation-heading": 0.0, "agent_compute-ego0": 0.011845309819493974, "complete-iteration": 0.2358394988945552, "set_robot_commands": 0.002269472394670759, "distance-from-start": 2.6832320998744943, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008972387228693281, "sim_compute_performance-ego0": 0.0019481309822627477}}
set_robot_commands_max0.002269472394670759
set_robot_commands_mean0.002269472394670759
set_robot_commands_median0.002269472394670759
set_robot_commands_min0.002269472394670759
sim_compute_performance-ego0_max0.0019481309822627477
sim_compute_performance-ego0_mean0.0019481309822627477
sim_compute_performance-ego0_median0.0019481309822627477
sim_compute_performance-ego0_min0.0019481309822627477
sim_compute_sim_state_max0.008972387228693281
sim_compute_sim_state_mean0.008972387228693281
sim_compute_sim_state_median0.008972387228693281
sim_compute_sim_state_min0.008972387228693281
sim_render-ego0_max0.003656491637229919
sim_render-ego0_mean0.003656491637229919
sim_render-ego0_median0.003656491637229919
sim_render-ego0_min0.003656491637229919
simulation-passed1
step_physics_max0.06724278203078679
step_physics_mean0.06724278203078679
step_physics_median0.06724278203078679
step_physics_min0.06724278203078679
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_median5.549999999999988
survival_time_min5.549999999999988
No reset possible
7935416027Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6832336340048193


other stats
agent_compute-ego0_max0.011694233332361494
agent_compute-ego0_mean0.011694233332361494
agent_compute-ego0_median0.011694233332361494
agent_compute-ego0_min0.011694233332361494
complete-iteration_max0.23665534598486765
complete-iteration_mean0.23665534598486765
complete-iteration_median0.23665534598486765
complete-iteration_min0.23665534598486765
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6832336340048193
distance-from-start_median2.6832336340048193
distance-from-start_min2.6832336340048193
driven_any_max2.6832351078561376
driven_any_mean2.6832351078561376
driven_any_median2.6832351078561376
driven_any_min2.6832351078561376
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10088868013450078
get_duckie_state_mean0.10088868013450078
get_duckie_state_median0.10088868013450078
get_duckie_state_min0.10088868013450078
get_robot_state_max0.0036786645650863647
get_robot_state_mean0.0036786645650863647
get_robot_state_median0.0036786645650863647
get_robot_state_min0.0036786645650863647
get_state_dump_max0.020239400012152537
get_state_dump_mean0.020239400012152537
get_state_dump_median0.020239400012152537
get_state_dump_min0.020239400012152537
get_ui_image_max0.014925648059163774
get_ui_image_mean0.014925648059163774
get_ui_image_median0.014925648059163774
get_ui_image_min0.014925648059163774
in-drivable-lane_max5.549999999999988
in-drivable-lane_mean5.549999999999988
in-drivable-lane_median5.549999999999988
in-drivable-lane_min5.549999999999988
per-episodes
details{"d50-ego0": {"driven_any": 2.6832351078561376, "get_ui_image": 0.014925648059163774, "step_physics": 0.06835129431315831, "survival_time": 5.549999999999988, "driven_lanedir": 0.0, "get_state_dump": 0.020239400012152537, "get_robot_state": 0.0036786645650863647, "sim_render-ego0": 0.0036080628633499146, "get_duckie_state": 0.10088868013450078, "in-drivable-lane": 5.549999999999988, "deviation-heading": 0.0, "agent_compute-ego0": 0.011694233332361494, "complete-iteration": 0.23665534598486765, "set_robot_commands": 0.002249010971614293, "distance-from-start": 2.6832336340048193, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008996816618101937, "sim_compute_performance-ego0": 0.001921172652925764}}
set_robot_commands_max0.002249010971614293
set_robot_commands_mean0.002249010971614293
set_robot_commands_median0.002249010971614293
set_robot_commands_min0.002249010971614293
sim_compute_performance-ego0_max0.001921172652925764
sim_compute_performance-ego0_mean0.001921172652925764
sim_compute_performance-ego0_median0.001921172652925764
sim_compute_performance-ego0_min0.001921172652925764
sim_compute_sim_state_max0.008996816618101937
sim_compute_sim_state_mean0.008996816618101937
sim_compute_sim_state_median0.008996816618101937
sim_compute_sim_state_min0.008996816618101937
sim_render-ego0_max0.0036080628633499146
sim_render-ego0_mean0.0036080628633499146
sim_render-ego0_median0.0036080628633499146
sim_render-ego0_min0.0036080628633499146
simulation-passed1
step_physics_max0.06835129431315831
step_physics_mean0.06835129431315831
step_physics_median0.06835129431315831
step_physics_min0.06835129431315831
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_median5.549999999999988
survival_time_min5.549999999999988
No reset possible
7934916027Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.6832086472055496


other stats
agent_compute-ego0_max0.011453319873128618
agent_compute-ego0_mean0.011453319873128618
agent_compute-ego0_median0.011453319873128618
agent_compute-ego0_min0.011453319873128618
complete-iteration_max0.22757444424288617
complete-iteration_mean0.22757444424288617
complete-iteration_median0.22757444424288617
complete-iteration_min0.22757444424288617
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.6832086472055496
distance-from-start_median2.6832086472055496
distance-from-start_min2.6832086472055496
driven_any_max2.683210258834093
driven_any_mean2.683210258834093
driven_any_median2.683210258834093
driven_any_min2.683210258834093
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0957535058259964
get_duckie_state_mean0.0957535058259964
get_duckie_state_median0.0957535058259964
get_duckie_state_min0.0957535058259964
get_robot_state_max0.0035764979464667185
get_robot_state_mean0.0035764979464667185
get_robot_state_median0.0035764979464667185
get_robot_state_min0.0035764979464667185
get_state_dump_max0.019737394792693003
get_state_dump_mean0.019737394792693003
get_state_dump_median0.019737394792693003
get_state_dump_min0.019737394792693003
get_ui_image_max0.014850143875394548
get_ui_image_mean0.014850143875394548
get_ui_image_median0.014850143875394548
get_ui_image_min0.014850143875394548
in-drivable-lane_max5.549999999999988
in-drivable-lane_mean5.549999999999988
in-drivable-lane_median5.549999999999988
in-drivable-lane_min5.549999999999988
per-episodes
details{"d50-ego0": {"driven_any": 2.683210258834093, "get_ui_image": 0.014850143875394548, "step_physics": 0.06573218745844704, "survival_time": 5.549999999999988, "driven_lanedir": 0.0, "get_state_dump": 0.019737394792693003, "get_robot_state": 0.0035764979464667185, "sim_render-ego0": 0.003473403198378427, "get_duckie_state": 0.0957535058259964, "in-drivable-lane": 5.549999999999988, "deviation-heading": 0.0, "agent_compute-ego0": 0.011453319873128618, "complete-iteration": 0.22757444424288617, "set_robot_commands": 0.002163889152663095, "distance-from-start": 2.6832086472055496, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008944394333021981, "sim_compute_performance-ego0": 0.0018081835338047572}}
set_robot_commands_max0.002163889152663095
set_robot_commands_mean0.002163889152663095
set_robot_commands_median0.002163889152663095
set_robot_commands_min0.002163889152663095
sim_compute_performance-ego0_max0.0018081835338047572
sim_compute_performance-ego0_mean0.0018081835338047572
sim_compute_performance-ego0_median0.0018081835338047572
sim_compute_performance-ego0_min0.0018081835338047572
sim_compute_sim_state_max0.008944394333021981
sim_compute_sim_state_mean0.008944394333021981
sim_compute_sim_state_median0.008944394333021981
sim_compute_sim_state_min0.008944394333021981
sim_render-ego0_max0.003473403198378427
sim_render-ego0_mean0.003473403198378427
sim_render-ego0_median0.003473403198378427
sim_render-ego0_min0.003473403198378427
simulation-passed1
step_physics_max0.06573218745844704
step_physics_mean0.06573218745844704
step_physics_median0.06573218745844704
step_physics_min0.06573218745844704
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_median5.549999999999988
survival_time_min5.549999999999988
No reset possible
7934716026Ethan Frankcollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.09
false_positive_rate0.01


other stats
nsamples200
No reset possible
7934616026Ethan Frankcollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.09
false_positive_rate0.01


other stats
nsamples200
No reset possible
7934416026Ethan Frankcollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.09
false_positive_rate0.01


other stats
nsamples200
No reset possible
7934216025Ethan Frankcollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.07
false_positive_rate0.005


other stats
nsamples400
No reset possible
7934016025Ethan Frankcollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.07
false_positive_rate0.005


other stats
nsamples400
No reset possible
7933916025Ethan Frankcollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.07
false_positive_rate0.005


other stats
nsamples400
No reset possible
7933816024Dimitrios Dimopoulosobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-010:06:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 198 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7933716023Anushka Parmanandtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011500456116416235
agent_compute-ego0_mean0.011500456116416235
agent_compute-ego0_median0.011500456116416235
agent_compute-ego0_min0.011500456116416235
complete-iteration_max0.13097240708091043
complete-iteration_mean0.13097240708091043
complete-iteration_median0.13097240708091043
complete-iteration_min0.13097240708091043
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004303076050498269
get_duckie_state_mean0.004303076050498269
get_duckie_state_median0.004303076050498269
get_duckie_state_min0.004303076050498269
get_robot_state_max0.00365857102654197
get_robot_state_mean0.00365857102654197
get_robot_state_median0.00365857102654197
get_robot_state_min0.00365857102654197
get_state_dump_max0.005455260927026922
get_state_dump_mean0.005455260927026922
get_state_dump_median0.005455260927026922
get_state_dump_min0.005455260927026922
get_ui_image_max0.02608390287919478
get_ui_image_mean0.02608390287919478
get_ui_image_median0.02608390287919478
get_ui_image_min0.02608390287919478
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02608390287919478, "step_physics": 0.06689255345951427, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005455260927026922, "get_robot_state": 0.00365857102654197, "sim_render-ego0": 0.003782136873765425, "get_duckie_state": 0.004303076050498269, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011500456116416235, "complete-iteration": 0.13097240708091043, "set_robot_commands": 0.002208070321516557, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004983262582258744, "sim_compute_performance-ego0": 0.0020234855738553133}}
set_robot_commands_max0.002208070321516557
set_robot_commands_mean0.002208070321516557
set_robot_commands_median0.002208070321516557
set_robot_commands_min0.002208070321516557
sim_compute_performance-ego0_max0.0020234855738553133
sim_compute_performance-ego0_mean0.0020234855738553133
sim_compute_performance-ego0_median0.0020234855738553133
sim_compute_performance-ego0_min0.0020234855738553133
sim_compute_sim_state_max0.004983262582258744
sim_compute_sim_state_mean0.004983262582258744
sim_compute_sim_state_median0.004983262582258744
sim_compute_sim_state_min0.004983262582258744
sim_render-ego0_max0.003782136873765425
sim_render-ego0_mean0.003782136873765425
sim_render-ego0_median0.003782136873765425
sim_render-ego0_min0.003782136873765425
simulation-passed1
step_physics_max0.06689255345951427
step_physics_mean0.06689255345951427
step_physics_median0.06689255345951427
step_physics_min0.06689255345951427
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7933616023Anushka Parmanandtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.010556703264063057
agent_compute-ego0_mean0.010556703264063057
agent_compute-ego0_median0.010556703264063057
agent_compute-ego0_min0.010556703264063057
complete-iteration_max0.13156218962235883
complete-iteration_mean0.13156218962235883
complete-iteration_median0.13156218962235883
complete-iteration_min0.13156218962235883
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.0041252320463007145
get_duckie_state_mean0.0041252320463007145
get_duckie_state_median0.0041252320463007145
get_duckie_state_min0.0041252320463007145
get_robot_state_max0.00361301682212136
get_robot_state_mean0.00361301682212136
get_robot_state_median0.00361301682212136
get_robot_state_min0.00361301682212136
get_state_dump_max0.005249651995572177
get_state_dump_mean0.005249651995572177
get_state_dump_median0.005249651995572177
get_state_dump_min0.005249651995572177
get_ui_image_max0.02629907022822987
get_ui_image_mean0.02629907022822987
get_ui_image_median0.02629907022822987
get_ui_image_min0.02629907022822987
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02629907022822987, "step_physics": 0.06902689825404774, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005249651995572177, "get_robot_state": 0.00361301682212136, "sim_render-ego0": 0.003691873767159202, "get_duckie_state": 0.0041252320463007145, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.010556703264063057, "complete-iteration": 0.13156218962235883, "set_robot_commands": 0.002092952078038996, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004926735704595392, "sim_compute_performance-ego0": 0.001897627657110041}}
set_robot_commands_max0.002092952078038996
set_robot_commands_mean0.002092952078038996
set_robot_commands_median0.002092952078038996
set_robot_commands_min0.002092952078038996
sim_compute_performance-ego0_max0.001897627657110041
sim_compute_performance-ego0_mean0.001897627657110041
sim_compute_performance-ego0_median0.001897627657110041
sim_compute_performance-ego0_min0.001897627657110041
sim_compute_sim_state_max0.004926735704595392
sim_compute_sim_state_mean0.004926735704595392
sim_compute_sim_state_median0.004926735704595392
sim_compute_sim_state_min0.004926735704595392
sim_render-ego0_max0.003691873767159202
sim_render-ego0_mean0.003691873767159202
sim_render-ego0_median0.003691873767159202
sim_render-ego0_min0.003691873767159202
simulation-passed1
step_physics_max0.06902689825404774
step_physics_mean0.06902689825404774
step_physics_median0.06902689825404774
step_physics_min0.06902689825404774
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7933516022Lin Wei-Chihbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-010:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median28.02499999999938
deviation-center-line_median0.5407754792472905
driven_lanedir_consec_median0.7736709737212613
survival_time_median37.149999999999395


other stats
agent_compute-ego0_max0.006410821389653542
agent_compute-ego0_mean0.006198444681232041
agent_compute-ego0_median0.006198444681232041
agent_compute-ego0_min0.005986067972810541
complete-iteration_max0.11548109918521256
complete-iteration_mean0.1127066765419706
complete-iteration_median0.1127066765419706
complete-iteration_min0.1099322538987286
deviation-center-line_max0.7161000473683765
deviation-center-line_mean0.5407754792472905
deviation-center-line_min0.3654509111262046
deviation-heading_max3.503433838200169
deviation-heading_mean2.7619472228898805
deviation-heading_median2.7619472228898805
deviation-heading_min2.020460607579592
distance-from-start_max1.1311420683599058
distance-from-start_mean1.1250076742180692
distance-from-start_median1.1250076742180692
distance-from-start_min1.1188732800762329
driven_any_max6.247933741694463
driven_any_mean3.813684479072211
driven_any_median3.813684479072211
driven_any_min1.37943521644996
driven_lanedir_consec_max0.791854527780287
driven_lanedir_consec_mean0.7736709737212613
driven_lanedir_consec_min0.7554874196622354
driven_lanedir_max0.8069647712175549
driven_lanedir_mean0.8066437808462186
driven_lanedir_median0.8066437808462186
driven_lanedir_min0.8063227904748821
get_duckie_state_max1.158863825249755e-06
get_duckie_state_mean1.153145229530386e-06
get_duckie_state_median1.153145229530386e-06
get_duckie_state_min1.1474266338110169e-06
get_robot_state_max0.003455211891945231
get_robot_state_mean0.0034208443718825423
get_robot_state_median0.0034208443718825423
get_robot_state_min0.003386476851819854
get_state_dump_max0.004353985138471119
get_state_dump_mean0.004283393518807408
get_state_dump_median0.004283393518807408
get_state_dump_min0.004212801899143698
get_ui_image_max0.028435096256341864
get_ui_image_mean0.028303490157293207
get_ui_image_median0.028303490157293207
get_ui_image_min0.028171884058244553
in-drivable-lane_max50.64999999999869
in-drivable-lane_mean28.02499999999938
in-drivable-lane_min5.400000000000075
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.37943521644996, "get_ui_image": 0.028171884058244553, "step_physics": 0.06208169418760293, "survival_time": 14.300000000000068, "driven_lanedir": 0.8069647712175549, "get_state_dump": 0.004353985138471119, "get_robot_state": 0.003455211891945231, "sim_render-ego0": 0.0034806570524953382, "get_duckie_state": 1.158863825249755e-06, "in-drivable-lane": 5.400000000000075, "deviation-heading": 2.020460607579592, "agent_compute-ego0": 0.006410821389653542, "complete-iteration": 0.11548109918521256, "set_robot_commands": 0.0022564490913098696, "distance-from-start": 1.1311420683599058, "deviation-center-line": 0.3654509111262046, "driven_lanedir_consec": 0.7554874196622354, "sim_compute_sim_state": 0.003339573896720434, "sim_compute_performance-ego0": 0.0018595544303335796}, "LF-small-loop-001-ego0": {"driven_any": 6.247933741694463, "get_ui_image": 0.028435096256341864, "step_physics": 0.05682343864917358, "survival_time": 59.99999999999873, "driven_lanedir": 0.8063227904748821, "get_state_dump": 0.004212801899143698, "get_robot_state": 0.003386476851819854, "sim_render-ego0": 0.0034142175780843436, "get_duckie_state": 1.1474266338110169e-06, "in-drivable-lane": 50.64999999999869, "deviation-heading": 3.503433838200169, "agent_compute-ego0": 0.005986067972810541, "complete-iteration": 0.1099322538987286, "set_robot_commands": 0.002104812220272474, "distance-from-start": 1.1188732800762329, "deviation-center-line": 0.7161000473683765, "driven_lanedir_consec": 0.791854527780287, "sim_compute_sim_state": 0.003720073279095728, "sim_compute_performance-ego0": 0.001780800577206576}}
set_robot_commands_max0.0022564490913098696
set_robot_commands_mean0.0021806306557911716
set_robot_commands_median0.0021806306557911716
set_robot_commands_min0.002104812220272474
sim_compute_performance-ego0_max0.0018595544303335796
sim_compute_performance-ego0_mean0.0018201775037700776
sim_compute_performance-ego0_median0.0018201775037700776
sim_compute_performance-ego0_min0.001780800577206576
sim_compute_sim_state_max0.003720073279095728
sim_compute_sim_state_mean0.0035298235879080812
sim_compute_sim_state_median0.0035298235879080812
sim_compute_sim_state_min0.003339573896720434
sim_render-ego0_max0.0034806570524953382
sim_render-ego0_mean0.003447437315289841
sim_render-ego0_median0.003447437315289841
sim_render-ego0_min0.0034142175780843436
simulation-passed1
step_physics_max0.06208169418760293
step_physics_mean0.05945256641838825
step_physics_median0.05945256641838825
step_physics_min0.05682343864917358
survival_time_max59.99999999999873
survival_time_mean37.149999999999395
survival_time_min14.300000000000068
No reset possible
7933416021Jerry Kuchtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.01122838258743286
agent_compute-ego0_mean0.01122838258743286
agent_compute-ego0_median0.01122838258743286
agent_compute-ego0_min0.01122838258743286
complete-iteration_max0.13091311129656705
complete-iteration_mean0.13091311129656705
complete-iteration_median0.13091311129656705
complete-iteration_min0.13091311129656705
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004176231947812167
get_duckie_state_mean0.004176231947812167
get_duckie_state_median0.004176231947812167
get_duckie_state_min0.004176231947812167
get_robot_state_max0.003598484126004306
get_robot_state_mean0.003598484126004306
get_robot_state_median0.003598484126004306
get_robot_state_min0.003598484126004306
get_state_dump_max0.005300039594823664
get_state_dump_mean0.005300039594823664
get_state_dump_median0.005300039594823664
get_state_dump_min0.005300039594823664
get_ui_image_max0.025976256890730423
get_ui_image_mean0.025976256890730423
get_ui_image_median0.025976256890730423
get_ui_image_min0.025976256890730423
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.025976256890730423, "step_physics": 0.06770937551151622, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005300039594823664, "get_robot_state": 0.003598484126004306, "sim_render-ego0": 0.003784212199124423, "get_duckie_state": 0.004176231947812167, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01122838258743286, "complete-iteration": 0.13091311129656705, "set_robot_commands": 0.0021678588607094503, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004914012822237882, "sim_compute_performance-ego0": 0.001982607624747536}}
set_robot_commands_max0.0021678588607094503
set_robot_commands_mean0.0021678588607094503
set_robot_commands_median0.0021678588607094503
set_robot_commands_min0.0021678588607094503
sim_compute_performance-ego0_max0.001982607624747536
sim_compute_performance-ego0_mean0.001982607624747536
sim_compute_performance-ego0_median0.001982607624747536
sim_compute_performance-ego0_min0.001982607624747536
sim_compute_sim_state_max0.004914012822237882
sim_compute_sim_state_mean0.004914012822237882
sim_compute_sim_state_median0.004914012822237882
sim_compute_sim_state_min0.004914012822237882
sim_render-ego0_max0.003784212199124423
sim_render-ego0_mean0.003784212199124423
sim_render-ego0_median0.003784212199124423
sim_render-ego0_min0.003784212199124423
simulation-passed1
step_physics_max0.06770937551151622
step_physics_mean0.06770937551151622
step_physics_median0.06770937551151622
step_physics_min0.06770937551151622
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7933316021Jerry Kuchtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011039988561110064
agent_compute-ego0_mean0.011039988561110064
agent_compute-ego0_median0.011039988561110064
agent_compute-ego0_min0.011039988561110064
complete-iteration_max0.13285455920479514
complete-iteration_mean0.13285455920479514
complete-iteration_median0.13285455920479514
complete-iteration_min0.13285455920479514
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004134378649971702
get_duckie_state_mean0.004134378649971702
get_duckie_state_median0.004134378649971702
get_duckie_state_min0.004134378649971702
get_robot_state_max0.003604894334619696
get_robot_state_mean0.003604894334619696
get_robot_state_median0.003604894334619696
get_robot_state_min0.003604894334619696
get_state_dump_max0.005148004401813854
get_state_dump_mean0.005148004401813854
get_state_dump_median0.005148004401813854
get_state_dump_min0.005148004401813854
get_ui_image_max0.026184390891682015
get_ui_image_mean0.026184390891682015
get_ui_image_median0.026184390891682015
get_ui_image_min0.026184390891682015
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.026184390891682015, "step_physics": 0.07003410296006636, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005148004401813854, "get_robot_state": 0.003604894334619696, "sim_render-ego0": 0.0037119280208240857, "get_duckie_state": 0.004134378649971702, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011039988561110064, "complete-iteration": 0.13285455920479514, "set_robot_commands": 0.002132529562169855, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004873357035896995, "sim_compute_performance-ego0": 0.001914457841352983}}
set_robot_commands_max0.002132529562169855
set_robot_commands_mean0.002132529562169855
set_robot_commands_median0.002132529562169855
set_robot_commands_min0.002132529562169855
sim_compute_performance-ego0_max0.001914457841352983
sim_compute_performance-ego0_mean0.001914457841352983
sim_compute_performance-ego0_median0.001914457841352983
sim_compute_performance-ego0_min0.001914457841352983
sim_compute_sim_state_max0.004873357035896995
sim_compute_sim_state_mean0.004873357035896995
sim_compute_sim_state_median0.004873357035896995
sim_compute_sim_state_min0.004873357035896995
sim_render-ego0_max0.0037119280208240857
sim_render-ego0_mean0.0037119280208240857
sim_render-ego0_median0.0037119280208240857
sim_render-ego0_min0.0037119280208240857
simulation-passed1
step_physics_max0.07003410296006636
step_physics_mean0.07003410296006636
step_physics_median0.07003410296006636
step_physics_min0.07003410296006636
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7933216021Jerry Kuchtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011534457856958565
agent_compute-ego0_mean0.011534457856958565
agent_compute-ego0_median0.011534457856958565
agent_compute-ego0_min0.011534457856958565
complete-iteration_max0.12973188270222058
complete-iteration_mean0.12973188270222058
complete-iteration_median0.12973188270222058
complete-iteration_min0.12973188270222058
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004365720532157205
get_duckie_state_mean0.004365720532157205
get_duckie_state_median0.004365720532157205
get_duckie_state_min0.004365720532157205
get_robot_state_max0.003790275617079302
get_robot_state_mean0.003790275617079302
get_robot_state_median0.003790275617079302
get_robot_state_min0.003790275617079302
get_state_dump_max0.005588981238278476
get_state_dump_mean0.005588981238278476
get_state_dump_median0.005588981238278476
get_state_dump_min0.005588981238278476
get_ui_image_max0.026051017371090977
get_ui_image_mean0.026051017371090977
get_ui_image_median0.026051017371090977
get_ui_image_min0.026051017371090977
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.026051017371090977, "step_physics": 0.06540814313021573, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005588981238278476, "get_robot_state": 0.003790275617079302, "sim_render-ego0": 0.0037947134538130326, "get_duckie_state": 0.004365720532157205, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011534457856958565, "complete-iteration": 0.12973188270222058, "set_robot_commands": 0.0022086609493602405, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004910301078449596, "sim_compute_performance-ego0": 0.0020014697855169124}}
set_robot_commands_max0.0022086609493602405
set_robot_commands_mean0.0022086609493602405
set_robot_commands_median0.0022086609493602405
set_robot_commands_min0.0022086609493602405
sim_compute_performance-ego0_max0.0020014697855169124
sim_compute_performance-ego0_mean0.0020014697855169124
sim_compute_performance-ego0_median0.0020014697855169124
sim_compute_performance-ego0_min0.0020014697855169124
sim_compute_sim_state_max0.004910301078449596
sim_compute_sim_state_mean0.004910301078449596
sim_compute_sim_state_median0.004910301078449596
sim_compute_sim_state_min0.004910301078449596
sim_render-ego0_max0.0037947134538130326
sim_render-ego0_mean0.0037947134538130326
sim_render-ego0_median0.0037947134538130326
sim_render-ego0_min0.0037947134538130326
simulation-passed1
step_physics_max0.06540814313021573
step_physics_mean0.06540814313021573
step_physics_median0.06540814313021573
step_physics_min0.06540814313021573
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7933116021Jerry Kuchtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011209726333618164
agent_compute-ego0_mean0.011209726333618164
agent_compute-ego0_median0.011209726333618164
agent_compute-ego0_min0.011209726333618164
complete-iteration_max0.13235656239769675
complete-iteration_mean0.13235656239769675
complete-iteration_median0.13235656239769675
complete-iteration_min0.13235656239769675
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.00426748665896329
get_duckie_state_mean0.00426748665896329
get_duckie_state_median0.00426748665896329
get_duckie_state_min0.00426748665896329
get_robot_state_max0.003622911193154075
get_robot_state_mean0.003622911193154075
get_robot_state_median0.003622911193154075
get_robot_state_min0.003622911193154075
get_state_dump_max0.0053622993555935946
get_state_dump_mean0.0053622993555935946
get_state_dump_median0.0053622993555935946
get_state_dump_min0.0053622993555935946
get_ui_image_max0.02634688399054787
get_ui_image_mean0.02634688399054787
get_ui_image_median0.02634688399054787
get_ui_image_min0.02634688399054787
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02634688399054787, "step_physics": 0.068525569005446, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0053622993555935946, "get_robot_state": 0.003622911193154075, "sim_render-ego0": 0.003793521360917525, "get_duckie_state": 0.00426748665896329, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011209726333618164, "complete-iteration": 0.13235656239769675, "set_robot_commands": 0.002178148789839311, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004972913048484109, "sim_compute_performance-ego0": 0.001994544809514826}}
set_robot_commands_max0.002178148789839311
set_robot_commands_mean0.002178148789839311
set_robot_commands_median0.002178148789839311
set_robot_commands_min0.002178148789839311
sim_compute_performance-ego0_max0.001994544809514826
sim_compute_performance-ego0_mean0.001994544809514826
sim_compute_performance-ego0_median0.001994544809514826
sim_compute_performance-ego0_min0.001994544809514826
sim_compute_sim_state_max0.004972913048484109
sim_compute_sim_state_mean0.004972913048484109
sim_compute_sim_state_median0.004972913048484109
sim_compute_sim_state_min0.004972913048484109
sim_render-ego0_max0.003793521360917525
sim_render-ego0_mean0.003793521360917525
sim_render-ego0_median0.003793521360917525
sim_render-ego0_min0.003793521360917525
simulation-passed1
step_physics_max0.068525569005446
step_physics_mean0.068525569005446
step_physics_median0.068525569005446
step_physics_min0.068525569005446
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7933016020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.02
false_positive_rate0.05


other stats
nsamples200
No reset possible
7932816020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1abortednogpu-production-spot-0-010:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.02
false_positive_rate0.05


other stats
nsamples200
No reset possible
7932716020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1abortednogpu-production-spot-0-010:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.02
false_positive_rate0.05


other stats
nsamples200
No reset possible
7932616019Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.035
false_positive_rate0.055


other stats
nsamples400
No reset possible
7931816015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.14


other stats
nsamples200
No reset possible
7931516015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-010:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.14


other stats
nsamples200
No reset possible
7931216014Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.11


other stats
nsamples400
No reset possible
7931116014Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.11


other stats
nsamples400
No reset possible
7931016014Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.11


other stats
nsamples400
No reset possible
7930916014Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-010:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.11


other stats
nsamples400
No reset possible
7930816013Ivan Danovobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-010:09:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 699 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7930716012Haridas P Ttemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:17:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median7.074999999999983
deviation-center-line_median3.895511881021464
driven_lanedir_consec_median5.922398691724938
survival_time_median49.82499999999931


other stats
agent_compute-ego0_max0.016393474127243388
agent_compute-ego0_mean0.011177675327101112
agent_compute-ego0_median0.011177675327101112
agent_compute-ego0_min0.005961876526958837
complete-iteration_max0.1877622793543549
complete-iteration_mean0.1793790933882814
complete-iteration_median0.1793790933882814
complete-iteration_min0.17099590742220788
deviation-center-line_max4.635662608586676
deviation-center-line_mean3.895511881021464
deviation-center-line_min3.155361153456252
deviation-heading_max1.5772332626037555
deviation-heading_mean1.0376963355989075
deviation-heading_median1.0376963355989075
deviation-heading_min0.4981594085940597
distance-from-start_max8.318764750695815
distance-from-start_mean6.849689072298396
distance-from-start_median6.849689072298396
distance-from-start_min5.380613393900977
driven_any_max8.324247315197095
driven_any_mean6.860232806160446
driven_any_median6.860232806160446
driven_any_min5.396218297123797
driven_lanedir_consec_max7.343680299299661
driven_lanedir_consec_mean5.922398691724938
driven_lanedir_consec_min4.5011170841502155
driven_lanedir_max7.343680299299661
driven_lanedir_mean5.922398691724938
driven_lanedir_median5.922398691724938
driven_lanedir_min4.5011170841502155
get_duckie_state_max1.1620653666537114e-06
get_duckie_state_mean1.110278255254221e-06
get_duckie_state_median1.110278255254221e-06
get_duckie_state_min1.0584911438547304e-06
get_robot_state_max0.0034192952387140357
get_robot_state_mean0.0034139534050862605
get_robot_state_median0.0034139534050862605
get_robot_state_min0.003408611571458485
get_state_dump_max0.004302920562494312
get_state_dump_mean0.00420648331738129
get_state_dump_median0.00420648331738129
get_state_dump_min0.004110046072268268
get_ui_image_max0.046664710309103095
get_ui_image_mean0.0466502274910162
get_ui_image_median0.0466502274910162
get_ui_image_min0.04663574467292931
in-drivable-lane_max7.449999999999981
in-drivable-lane_mean7.074999999999983
in-drivable-lane_min6.699999999999984
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324247315197095, "get_ui_image": 0.04663574467292931, "step_physics": 0.07281563224443091, "survival_time": 59.99999999999873, "driven_lanedir": 7.343680299299661, "get_state_dump": 0.004110046072268268, "get_robot_state": 0.0034192952387140357, "sim_render-ego0": 0.0034626705461894345, "get_duckie_state": 1.0584911438547304e-06, "in-drivable-lane": 7.449999999999981, "deviation-heading": 0.4981594085940597, "agent_compute-ego0": 0.005961876526958837, "complete-iteration": 0.17099590742220788, "set_robot_commands": 0.002113961855835164, "distance-from-start": 8.318764750695815, "deviation-center-line": 4.635662608586676, "driven_lanedir_consec": 7.343680299299661, "sim_compute_sim_state": 0.030619274269631264, "sim_compute_performance-ego0": 0.001788336271846622}, "LF-full-loop-001-ego0": {"driven_any": 5.396218297123797, "get_ui_image": 0.046664710309103095, "step_physics": 0.07933747077768936, "survival_time": 39.649999999999885, "driven_lanedir": 4.5011170841502155, "get_state_dump": 0.004302920562494312, "get_robot_state": 0.003408611571458485, "sim_render-ego0": 0.003582634613555985, "get_duckie_state": 1.1620653666537114e-06, "in-drivable-lane": 6.699999999999984, "deviation-heading": 1.5772332626037555, "agent_compute-ego0": 0.016393474127243388, "complete-iteration": 0.1877622793543549, "set_robot_commands": 0.002120931743074124, "distance-from-start": 5.380613393900977, "deviation-center-line": 3.155361153456252, "driven_lanedir_consec": 4.5011170841502155, "sim_compute_sim_state": 0.03003756825809815, "sim_compute_performance-ego0": 0.0018411082044356415}}
set_robot_commands_max0.002120931743074124
set_robot_commands_mean0.002117446799454644
set_robot_commands_median0.002117446799454644
set_robot_commands_min0.002113961855835164
sim_compute_performance-ego0_max0.0018411082044356415
sim_compute_performance-ego0_mean0.001814722238141132
sim_compute_performance-ego0_median0.001814722238141132
sim_compute_performance-ego0_min0.001788336271846622
sim_compute_sim_state_max0.030619274269631264
sim_compute_sim_state_mean0.03032842126386471
sim_compute_sim_state_median0.03032842126386471
sim_compute_sim_state_min0.03003756825809815
sim_render-ego0_max0.003582634613555985
sim_render-ego0_mean0.00352265257987271
sim_render-ego0_median0.00352265257987271
sim_render-ego0_min0.0034626705461894345
simulation-passed1
step_physics_max0.07933747077768936
step_physics_mean0.07607655151106013
step_physics_median0.07607655151106013
step_physics_min0.07281563224443091
survival_time_max59.99999999999873
survival_time_mean49.82499999999931
survival_time_min39.649999999999885
No reset possible
7930616011N ? RO botconfirm class filter causes breaking: eval both bbox+class filtersmooc-objdetsimfailednogpu-production-spot-0-010:06:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 156 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7930516010N ? RO botbbox filter only, print clas, w. tokenmooc-objdetsimsuccessnogpu-production-spot-0-010:17:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median4.305396699470475


other stats
agent_compute-ego0_max0.008966948368666471
agent_compute-ego0_mean0.008582503968333325
agent_compute-ego0_median0.008582503968333325
agent_compute-ego0_min0.008198059568000177
complete-iteration_max0.17017912150024872
complete-iteration_mean0.17003168710363992
complete-iteration_median0.17003168710363992
complete-iteration_min0.16988425270703114
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.192872014045978
distance-from-start_mean4.305380780697024
distance-from-start_median4.305380780697024
distance-from-start_min2.4178895473480697
driven_any_max6.192872014045978
driven_any_mean4.305380780697024
driven_any_median4.305380780697024
driven_any_min2.4178895473480697
driven_lanedir_consec_max6.1929263916356705
driven_lanedir_consec_mean4.305396699470475
driven_lanedir_consec_min2.4178670073052806
driven_lanedir_max6.1929263916356705
driven_lanedir_mean4.305396699470475
driven_lanedir_median4.305396699470475
driven_lanedir_min2.4178670073052806
get_duckie_state_max0.018870911530709883
get_duckie_state_mean0.018839032524928363
get_duckie_state_median0.018839032524928363
get_duckie_state_min0.018807153519146847
get_robot_state_max0.0034092876138933294
get_robot_state_mean0.003394303174936007
get_robot_state_median0.003394303174936007
get_robot_state_min0.0033793187359786848
get_state_dump_max0.007426406819060085
get_state_dump_mean0.00733653562055043
get_state_dump_median0.00733653562055043
get_state_dump_min0.007246664422040776
get_ui_image_max0.029437722611883897
get_ui_image_mean0.029275134044523345
get_ui_image_median0.029275134044523345
get_ui_image_min0.02911254547716279
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.192872014045978, "get_ui_image": 0.02911254547716279, "step_physics": 0.0677778339703613, "survival_time": 59.99999999999873, "driven_lanedir": 6.1929263916356705, "get_state_dump": 0.007426406819060085, "get_robot_state": 0.0034092876138933294, "sim_render-ego0": 0.0034229402041852128, "get_duckie_state": 0.018870911530709883, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.008198059568000177, "complete-iteration": 0.16988425270703114, "set_robot_commands": 0.0020318618920522366, "distance-from-start": 6.192872014045978, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.1929263916356705, "sim_compute_sim_state": 0.027766736520517876, "sim_compute_performance-ego0": 0.0017946270681439987}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.4178895473480697, "get_ui_image": 0.029437722611883897, "step_physics": 0.061990000822462706, "survival_time": 59.99999999999873, "driven_lanedir": 2.4178670073052806, "get_state_dump": 0.007246664422040776, "get_robot_state": 0.0033793187359786848, "sim_render-ego0": 0.0034308215164324325, "get_duckie_state": 0.018807153519146847, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.008966948368666471, "complete-iteration": 0.17017912150024872, "set_robot_commands": 0.002001291111446638, "distance-from-start": 2.4178895473480697, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.4178670073052806, "sim_compute_sim_state": 0.03309200685486805, "sim_compute_performance-ego0": 0.0017554676602226213}}
set_robot_commands_max0.0020318618920522366
set_robot_commands_mean0.002016576501749437
set_robot_commands_median0.002016576501749437
set_robot_commands_min0.002001291111446638
sim_compute_performance-ego0_max0.0017946270681439987
sim_compute_performance-ego0_mean0.00177504736418331
sim_compute_performance-ego0_median0.00177504736418331
sim_compute_performance-ego0_min0.0017554676602226213
sim_compute_sim_state_max0.03309200685486805
sim_compute_sim_state_mean0.03042937168769296
sim_compute_sim_state_median0.03042937168769296
sim_compute_sim_state_min0.027766736520517876
sim_render-ego0_max0.0034308215164324325
sim_render-ego0_mean0.003426880860308822
sim_render-ego0_median0.003426880860308822
sim_render-ego0_min0.0034229402041852128
simulation-passed1
step_physics_max0.0677778339703613
step_physics_mean0.064883917396412
step_physics_median0.064883917396412
step_physics_min0.061990000822462706
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7930416009N ? RO botclass filter only w. tokenmooc-objdetsimfailednogpu-production-spot-0-010:03:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 163 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7930316009N ? RO botclass filter only w. tokenmooc-objdetsimfailednogpu-production-spot-0-010:05:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 156 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7930216008Shubhra Aichtemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median16.400000000000123
deviation-center-line_median0.22449142146491124
driven_lanedir_consec_median0.24027175376799192
survival_time_median18.725000000000144


other stats
agent_compute-ego0_max0.016575862688497072
agent_compute-ego0_mean0.011759207378728091
agent_compute-ego0_median0.011759207378728091
agent_compute-ego0_min0.006942552068959112
complete-iteration_max0.1831573203181754
complete-iteration_mean0.1763700958707134
complete-iteration_median0.1763700958707134
complete-iteration_min0.16958287142325135
deviation-center-line_max0.32105968663745355
deviation-center-line_mean0.22449142146491124
deviation-center-line_min0.12792315629236897
deviation-heading_max1.664937539449841
deviation-heading_mean1.5871324332793542
deviation-heading_median1.5871324332793542
deviation-heading_min1.509327327108868
distance-from-start_max3.6832417573829863
distance-from-start_mean2.1411184271739954
distance-from-start_median2.1411184271739954
distance-from-start_min0.5989950969650049
driven_any_max4.131239876928566
driven_any_mean2.464628408441466
driven_any_median2.464628408441466
driven_any_min0.7980169399543654
driven_lanedir_consec_max0.375055626804273
driven_lanedir_consec_mean0.24027175376799192
driven_lanedir_consec_min0.10548788073171078
driven_lanedir_max0.375055626804273
driven_lanedir_mean0.24027175376799192
driven_lanedir_median0.24027175376799192
driven_lanedir_min0.10548788073171078
get_duckie_state_max1.2745476080192826e-06
get_duckie_state_mean1.2393670997842391e-06
get_duckie_state_median1.2393670997842391e-06
get_duckie_state_min1.204186591549196e-06
get_robot_state_max0.003596039785855058
get_robot_state_mean0.00352030942481576
get_robot_state_median0.00352030942481576
get_robot_state_min0.0034445790637764612
get_state_dump_max0.004489976426829462
get_state_dump_mean0.004447114388142353
get_state_dump_median0.004447114388142353
get_state_dump_min0.004404252349455243
get_ui_image_max0.04683852195739746
get_ui_image_mean0.04683287769896366
get_ui_image_median0.04683287769896366
get_ui_image_min0.04682723344052985
in-drivable-lane_max27.450000000000255
in-drivable-lane_mean16.400000000000123
in-drivable-lane_min5.349999999999989
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 0.7980169399543654, "get_ui_image": 0.04683852195739746, "step_physics": 0.07189095365828362, "survival_time": 6.849999999999984, "driven_lanedir": 0.10548788073171078, "get_state_dump": 0.004489976426829462, "get_robot_state": 0.003596039785855058, "sim_render-ego0": 0.003709853559300519, "get_duckie_state": 1.204186591549196e-06, "in-drivable-lane": 5.349999999999989, "deviation-heading": 1.509327327108868, "agent_compute-ego0": 0.006942552068959112, "complete-iteration": 0.16958287142325135, "set_robot_commands": 0.0023386132889899654, "distance-from-start": 0.5989950969650049, "deviation-center-line": 0.12792315629236897, "driven_lanedir_consec": 0.10548788073171078, "sim_compute_sim_state": 0.02776782927305802, "sim_compute_performance-ego0": 0.0019306739171346028}, "LF-full-loop-001-ego0": {"driven_any": 4.131239876928566, "get_ui_image": 0.04682723344052985, "step_physics": 0.07525582609129963, "survival_time": 30.6000000000003, "driven_lanedir": 0.375055626804273, "get_state_dump": 0.004404252349455243, "get_robot_state": 0.0034445790637764612, "sim_render-ego0": 0.003669282934988498, "get_duckie_state": 1.2745476080192826e-06, "in-drivable-lane": 27.450000000000255, "deviation-heading": 1.664937539449841, "agent_compute-ego0": 0.016575862688497072, "complete-iteration": 0.1831573203181754, "set_robot_commands": 0.0021628648966404975, "distance-from-start": 3.6832417573829863, "deviation-center-line": 0.32105968663745355, "driven_lanedir_consec": 0.375055626804273, "sim_compute_sim_state": 0.028864616670966344, "sim_compute_performance-ego0": 0.001877789007314461}}
set_robot_commands_max0.0023386132889899654
set_robot_commands_mean0.0022507390928152315
set_robot_commands_median0.0022507390928152315
set_robot_commands_min0.0021628648966404975
sim_compute_performance-ego0_max0.0019306739171346028
sim_compute_performance-ego0_mean0.001904231462224532
sim_compute_performance-ego0_median0.001904231462224532
sim_compute_performance-ego0_min0.001877789007314461
sim_compute_sim_state_max0.028864616670966344
sim_compute_sim_state_mean0.02831622297201218
sim_compute_sim_state_median0.02831622297201218
sim_compute_sim_state_min0.02776782927305802
sim_render-ego0_max0.003709853559300519
sim_render-ego0_mean0.0036895682471445087
sim_render-ego0_median0.0036895682471445087
sim_render-ego0_min0.003669282934988498
simulation-passed1
step_physics_max0.07525582609129963
step_physics_mean0.07357338987479162
step_physics_median0.07357338987479162
step_physics_min0.07189095365828362
survival_time_max30.6000000000003
survival_time_mean18.725000000000144
survival_time_min6.849999999999984
No reset possible
7930016006N ? RO botdefault (no code) but w. tokenmooc-objdetsimsuccessnogpu-production-spot-0-010:17:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median1.3362319004050038


other stats
agent_compute-ego0_max0.009128575321041874
agent_compute-ego0_mean0.008666572820931848
agent_compute-ego0_median0.008666572820931848
agent_compute-ego0_min0.00820457032082182
complete-iteration_max0.1751693055393495
complete-iteration_mean0.17029962889062278
complete-iteration_median0.17029962889062278
complete-iteration_min0.165429952241896
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.055904927253704
distance-from-start_mean1.336128559112532
distance-from-start_median1.336128559112532
distance-from-start_min0.6163521909713601
driven_any_max2.055904927253704
driven_any_mean1.336128559112532
driven_any_median1.336128559112532
driven_any_min0.6163521909713601
driven_lanedir_consec_max2.0559864460919868
driven_lanedir_consec_mean1.3362319004050038
driven_lanedir_consec_min0.6164773547180209
driven_lanedir_max2.0559864460919868
driven_lanedir_mean1.3362319004050038
driven_lanedir_median1.3362319004050038
driven_lanedir_min0.6164773547180209
get_duckie_state_max0.019235892061587673
get_duckie_state_mean0.01921756400553809
get_duckie_state_median0.01921756400553809
get_duckie_state_min0.019199235949488504
get_robot_state_max0.003442646958845839
get_robot_state_mean0.0034322229452077597
get_robot_state_median0.0034322229452077597
get_robot_state_min0.00342179893156968
get_state_dump_max0.0073322650296404205
get_state_dump_mean0.007324176763714005
get_state_dump_median0.007324176763714005
get_state_dump_min0.00731608849778759
get_ui_image_max0.029287564367378484
get_ui_image_mean0.029259266900976532
get_ui_image_median0.029259266900976532
get_ui_image_min0.02923096943457458
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 2.055904927253704, "get_ui_image": 0.02923096943457458, "step_physics": 0.06400121856390883, "survival_time": 59.99999999999873, "driven_lanedir": 2.0559864460919868, "get_state_dump": 0.0073322650296404205, "get_robot_state": 0.003442646958845839, "sim_render-ego0": 0.0034246647189201465, "get_duckie_state": 0.019235892061587673, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.00820457032082182, "complete-iteration": 0.165429952241896, "set_robot_commands": 0.002063065345440181, "distance-from-start": 2.055904927253704, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 2.0559864460919868, "sim_compute_sim_state": 0.02660713108453425, "sim_compute_performance-ego0": 0.0018100595593353195}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 0.6163521909713601, "get_ui_image": 0.029287564367378484, "step_physics": 0.06645170159383579, "survival_time": 59.99999999999873, "driven_lanedir": 0.6164773547180209, "get_state_dump": 0.00731608849778759, "get_robot_state": 0.00342179893156968, "sim_render-ego0": 0.0035140806193355717, "get_duckie_state": 0.019199235949488504, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.009128575321041874, "complete-iteration": 0.1751693055393495, "set_robot_commands": 0.0020739375105706184, "distance-from-start": 0.6163521909713601, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 0.6164773547180209, "sim_compute_sim_state": 0.03285834394227853, "sim_compute_performance-ego0": 0.001838678920596565}}
set_robot_commands_max0.0020739375105706184
set_robot_commands_mean0.0020685014280053997
set_robot_commands_median0.0020685014280053997
set_robot_commands_min0.002063065345440181
sim_compute_performance-ego0_max0.001838678920596565
sim_compute_performance-ego0_mean0.0018243692399659425
sim_compute_performance-ego0_median0.0018243692399659425
sim_compute_performance-ego0_min0.0018100595593353195
sim_compute_sim_state_max0.03285834394227853
sim_compute_sim_state_mean0.02973273751340639
sim_compute_sim_state_median0.02973273751340639
sim_compute_sim_state_min0.02660713108453425
sim_render-ego0_max0.0035140806193355717
sim_render-ego0_mean0.003469372669127859
sim_render-ego0_median0.003469372669127859
sim_render-ego0_min0.0034246647189201465
simulation-passed1
step_physics_max0.06645170159383579
step_physics_mean0.06522646007887231
step_physics_median0.06522646007887231
step_physics_min0.06400121856390883
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7929916005N ? RO botporting old code w. tokenmooc-objdetsimfailednogpu-production-spot-0-010:05:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 108 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7929516003Franz Puchertemplate-rosmooc-modconsimabortednogpu-production-spot-0-010:13:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1202 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7929115999Ryan Arya Pratamatemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:15:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median37.999999999999446
deviation-center-line_median0.44674311925438315
driven_lanedir_consec_median0.26522150631751396
survival_time_median42.34999999999947


other stats
agent_compute-ego0_max0.0282005285975909
agent_compute-ego0_mean0.02355178373924867
agent_compute-ego0_median0.02355178373924867
agent_compute-ego0_min0.018903038880906435
complete-iteration_max0.196041692386974
complete-iteration_mean0.18885667019433233
complete-iteration_median0.18885667019433233
complete-iteration_min0.1816716480016907
deviation-center-line_max0.7210676597748051
deviation-center-line_mean0.44674311925438315
deviation-center-line_min0.17241857873396113
deviation-heading_max6.139866133136317
deviation-heading_mean3.9926725802731737
deviation-heading_median3.9926725802731737
deviation-heading_min1.8454790274100297
distance-from-start_max1.9557172863034784
distance-from-start_mean1.731623248541955
distance-from-start_median1.731623248541955
distance-from-start_min1.5075292107804317
driven_any_max8.322289216789283
driven_any_mean5.814513541797613
driven_any_median5.814513541797613
driven_any_min3.3067378668059426
driven_lanedir_consec_max0.391966007236199
driven_lanedir_consec_mean0.26522150631751396
driven_lanedir_consec_min0.1384770053988289
driven_lanedir_max0.5234600094426185
driven_lanedir_mean0.3309685074207237
driven_lanedir_median0.3309685074207237
driven_lanedir_min0.1384770053988289
get_duckie_state_max1.1771616309580176e-06
get_duckie_state_mean1.1671577919915015e-06
get_duckie_state_median1.1671577919915015e-06
get_duckie_state_min1.1571539530249856e-06
get_robot_state_max0.0033804234815179857
get_robot_state_mean0.003368776313334109
get_robot_state_median0.003368776313334109
get_robot_state_min0.003357129145150233
get_state_dump_max0.0042455909228084066
get_state_dump_mean0.004180120199632752
get_state_dump_median0.004180120199632752
get_state_dump_min0.004114649476457098
get_ui_image_max0.04641416309080354
get_ui_image_mean0.04637754165877303
get_ui_image_median0.04637754165877303
get_ui_image_min0.04634092022674252
in-drivable-lane_max53.14999999999867
in-drivable-lane_mean37.999999999999446
in-drivable-lane_min22.85000000000022
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.322289216789283, "get_ui_image": 0.04641416309080354, "step_physics": 0.07297091996242959, "survival_time": 59.99999999999873, "driven_lanedir": 0.5234600094426185, "get_state_dump": 0.004114649476457098, "get_robot_state": 0.0033804234815179857, "sim_render-ego0": 0.003595727170933097, "get_duckie_state": 1.1571539530249856e-06, "in-drivable-lane": 53.14999999999867, "deviation-heading": 6.139866133136317, "agent_compute-ego0": 0.018903038880906435, "complete-iteration": 0.1816716480016907, "set_robot_commands": 0.002085518777420082, "distance-from-start": 1.9557172863034784, "deviation-center-line": 0.7210676597748051, "driven_lanedir_consec": 0.391966007236199, "sim_compute_sim_state": 0.028342753226909902, "sim_compute_performance-ego0": 0.0017924112245304002}, "LF-full-loop-001-ego0": {"driven_any": 3.3067378668059426, "get_ui_image": 0.04634092022674252, "step_physics": 0.07551912009113967, "survival_time": 24.700000000000216, "driven_lanedir": 0.1384770053988289, "get_state_dump": 0.0042455909228084066, "get_robot_state": 0.003357129145150233, "sim_render-ego0": 0.0035417691625729956, "get_duckie_state": 1.1771616309580176e-06, "in-drivable-lane": 22.85000000000022, "deviation-heading": 1.8454790274100297, "agent_compute-ego0": 0.0282005285975909, "complete-iteration": 0.196041692386974, "set_robot_commands": 0.002086141374376085, "distance-from-start": 1.5075292107804317, "deviation-center-line": 0.17241857873396113, "driven_lanedir_consec": 0.1384770053988289, "sim_compute_sim_state": 0.030882578185110383, "sim_compute_performance-ego0": 0.0017968057381986368}}
set_robot_commands_max0.002086141374376085
set_robot_commands_mean0.0020858300758980833
set_robot_commands_median0.0020858300758980833
set_robot_commands_min0.002085518777420082
sim_compute_performance-ego0_max0.0017968057381986368
sim_compute_performance-ego0_mean0.0017946084813645186
sim_compute_performance-ego0_median0.0017946084813645186
sim_compute_performance-ego0_min0.0017924112245304002
sim_compute_sim_state_max0.030882578185110383
sim_compute_sim_state_mean0.029612665706010143
sim_compute_sim_state_median0.029612665706010143
sim_compute_sim_state_min0.028342753226909902
sim_render-ego0_max0.003595727170933097
sim_render-ego0_mean0.0035687481667530463
sim_render-ego0_median0.0035687481667530463
sim_render-ego0_min0.0035417691625729956
simulation-passed1
step_physics_max0.07551912009113967
step_physics_mean0.07424502002678462
step_physics_median0.07424502002678462
step_physics_min0.07297091996242959
survival_time_max59.99999999999873
survival_time_mean42.34999999999947
survival_time_min24.700000000000216
No reset possible
7928915998Kirill Muravyevtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.0106221003965898
agent_compute-ego0_mean0.0106221003965898
agent_compute-ego0_median0.0106221003965898
agent_compute-ego0_min0.0106221003965898
complete-iteration_max0.13798783042214133
complete-iteration_mean0.13798783042214133
complete-iteration_median0.13798783042214133
complete-iteration_min0.13798783042214133
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004158551042730158
get_duckie_state_mean0.004158551042730158
get_duckie_state_median0.004158551042730158
get_duckie_state_min0.004158551042730158
get_robot_state_max0.0035998983816667037
get_robot_state_mean0.0035998983816667037
get_robot_state_median0.0035998983816667037
get_robot_state_min0.0035998983816667037
get_state_dump_max0.00530309026891535
get_state_dump_mean0.00530309026891535
get_state_dump_median0.00530309026891535
get_state_dump_min0.00530309026891535
get_ui_image_max0.026844880797646263
get_ui_image_mean0.026844880797646263
get_ui_image_median0.026844880797646263
get_ui_image_min0.026844880797646263
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.026844880797646263, "step_physics": 0.07442177967591719, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.00530309026891535, "get_robot_state": 0.0035998983816667037, "sim_render-ego0": 0.003775201060555198, "get_duckie_state": 0.004158551042730158, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.0106221003965898, "complete-iteration": 0.13798783042214133, "set_robot_commands": 0.0021442120725458317, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005010442300276322, "sim_compute_performance-ego0": 0.0020365877584977584}}
set_robot_commands_max0.0021442120725458317
set_robot_commands_mean0.0021442120725458317
set_robot_commands_median0.0021442120725458317
set_robot_commands_min0.0021442120725458317
sim_compute_performance-ego0_max0.0020365877584977584
sim_compute_performance-ego0_mean0.0020365877584977584
sim_compute_performance-ego0_median0.0020365877584977584
sim_compute_performance-ego0_min0.0020365877584977584
sim_compute_sim_state_max0.005010442300276322
sim_compute_sim_state_mean0.005010442300276322
sim_compute_sim_state_median0.005010442300276322
sim_compute_sim_state_min0.005010442300276322
sim_render-ego0_max0.003775201060555198
sim_render-ego0_mean0.003775201060555198
sim_render-ego0_median0.003775201060555198
sim_render-ego0_min0.003775201060555198
simulation-passed1
step_physics_max0.07442177967591719
step_physics_mean0.07442177967591719
step_physics_median0.07442177967591719
step_physics_min0.07442177967591719
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7928815998Kirill Muravyevtemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-010:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011239799586209385
agent_compute-ego0_mean0.011239799586209385
agent_compute-ego0_median0.011239799586209385
agent_compute-ego0_min0.011239799586209385
complete-iteration_max0.13707057454369284
complete-iteration_mean0.13707057454369284
complete-iteration_median0.13707057454369284
complete-iteration_min0.13707057454369284
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004267838868227872
get_duckie_state_mean0.004267838868227872
get_duckie_state_median0.004267838868227872
get_duckie_state_min0.004267838868227872
get_robot_state_max0.003731294111772017
get_robot_state_mean0.003731294111772017
get_robot_state_median0.003731294111772017
get_robot_state_min0.003731294111772017
get_state_dump_max0.005679666996002197
get_state_dump_mean0.005679666996002197
get_state_dump_median0.005679666996002197
get_state_dump_min0.005679666996002197
get_ui_image_max0.027061186053536156
get_ui_image_mean0.027061186053536156
get_ui_image_median0.027061186053536156
get_ui_image_min0.027061186053536156
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.027061186053536156, "step_physics": 0.07207649404352362, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005679666996002197, "get_robot_state": 0.003731294111772017, "sim_render-ego0": 0.0037662766196511007, "get_duckie_state": 0.004267838868227872, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011239799586209385, "complete-iteration": 0.13707057454369284, "set_robot_commands": 0.002239086411216042, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004940813237970526, "sim_compute_performance-ego0": 0.001987121321938255}}
set_robot_commands_max0.002239086411216042
set_robot_commands_mean0.002239086411216042
set_robot_commands_median0.002239086411216042
set_robot_commands_min0.002239086411216042
sim_compute_performance-ego0_max0.001987121321938255
sim_compute_performance-ego0_mean0.001987121321938255
sim_compute_performance-ego0_median0.001987121321938255
sim_compute_performance-ego0_min0.001987121321938255
sim_compute_sim_state_max0.004940813237970526
sim_compute_sim_state_mean0.004940813237970526
sim_compute_sim_state_median0.004940813237970526
sim_compute_sim_state_min0.004940813237970526
sim_render-ego0_max0.0037662766196511007
sim_render-ego0_mean0.0037662766196511007
sim_render-ego0_median0.0037662766196511007
sim_render-ego0_min0.0037662766196511007
simulation-passed1
step_physics_max0.07207649404352362
step_physics_mean0.07207649404352362
step_physics_median0.07207649404352362
step_physics_min0.07207649404352362
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7928615996Shuhao Liangtemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:10:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median23.250000000000227
deviation-center-line_median0.31959994463525176
driven_lanedir_consec_median0.19348018398354583
survival_time_median26.50000000000024


other stats
agent_compute-ego0_max0.016414903322308487
agent_compute-ego0_mean0.011519255492782102
agent_compute-ego0_median0.011519255492782102
agent_compute-ego0_min0.0066236076632557195
complete-iteration_max0.1810268235493855
complete-iteration_mean0.176406100977967
complete-iteration_median0.176406100977967
complete-iteration_min0.17178537840654845
deviation-center-line_max0.3648701168797536
deviation-center-line_mean0.31959994463525176
deviation-center-line_min0.27432977239074996
deviation-heading_max3.8022005618250487
deviation-heading_mean3.556870430790914
deviation-heading_median3.556870430790914
deviation-heading_min3.3115402997567793
distance-from-start_max1.9515177178942105
distance-from-start_mean1.8126760615571624
distance-from-start_median1.8126760615571624
distance-from-start_min1.6738344052201142
driven_any_max3.907668409489299
driven_any_mean3.5512976127150897
driven_any_median3.5512976127150897
driven_any_min3.19492681594088
driven_lanedir_consec_max0.2890026042018705
driven_lanedir_consec_mean0.19348018398354583
driven_lanedir_consec_min0.09795776376522114
driven_lanedir_max0.2890026042018705
driven_lanedir_mean0.20242072512898424
driven_lanedir_median0.20242072512898424
driven_lanedir_min0.11583884605609795
get_duckie_state_max1.2598021305366556e-06
get_duckie_state_mean1.1944722951990548e-06
get_duckie_state_median1.1944722951990548e-06
get_duckie_state_min1.129142459861454e-06
get_robot_state_max0.0035328503210182746
get_robot_state_mean0.0034599919375135697
get_robot_state_median0.0034599919375135697
get_robot_state_min0.003387133554008865
get_state_dump_max0.004353100941235707
get_state_dump_mean0.004273574624952653
get_state_dump_median0.004273574624952653
get_state_dump_min0.004194048308669597
get_ui_image_max0.04685985857361155
get_ui_image_mean0.04682445347049546
get_ui_image_median0.04682445347049546
get_ui_image_min0.04678904836737936
in-drivable-lane_max26.350000000000268
in-drivable-lane_mean23.250000000000227
in-drivable-lane_min20.15000000000019
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.19492681594088, "get_ui_image": 0.04678904836737936, "step_physics": 0.07215190627718666, "survival_time": 24.00000000000021, "driven_lanedir": 0.2890026042018705, "get_state_dump": 0.004353100941235707, "get_robot_state": 0.0035328503210182746, "sim_render-ego0": 0.003694454002776909, "get_duckie_state": 1.129142459861454e-06, "in-drivable-lane": 20.15000000000019, "deviation-heading": 3.8022005618250487, "agent_compute-ego0": 0.0066236076632557195, "complete-iteration": 0.17178537840654845, "set_robot_commands": 0.0022378617165737984, "distance-from-start": 1.9515177178942105, "deviation-center-line": 0.3648701168797536, "driven_lanedir_consec": 0.2890026042018705, "sim_compute_sim_state": 0.03043398440751613, "sim_compute_performance-ego0": 0.0018911693795059423}, "LF-full-loop-001-ego0": {"driven_any": 3.907668409489299, "get_ui_image": 0.04685985857361155, "step_physics": 0.07200829051242638, "survival_time": 29.000000000000277, "driven_lanedir": 0.11583884605609795, "get_state_dump": 0.004194048308669597, "get_robot_state": 0.003387133554008865, "sim_render-ego0": 0.00358292814376227, "get_duckie_state": 1.2598021305366556e-06, "in-drivable-lane": 26.350000000000268, "deviation-heading": 3.3115402997567793, "agent_compute-ego0": 0.016414903322308487, "complete-iteration": 0.1810268235493855, "set_robot_commands": 0.0021322458828583026, "distance-from-start": 1.6738344052201142, "deviation-center-line": 0.27432977239074996, "driven_lanedir_consec": 0.09795776376522114, "sim_compute_sim_state": 0.0305638235325247, "sim_compute_performance-ego0": 0.0018097455653389224}}
set_robot_commands_max0.0022378617165737984
set_robot_commands_mean0.0021850537997160505
set_robot_commands_median0.0021850537997160505
set_robot_commands_min0.0021322458828583026
sim_compute_performance-ego0_max0.0018911693795059423
sim_compute_performance-ego0_mean0.0018504574724224328
sim_compute_performance-ego0_median0.0018504574724224328
sim_compute_performance-ego0_min0.0018097455653389224
sim_compute_sim_state_max0.0305638235325247
sim_compute_sim_state_mean0.030498903970020412
sim_compute_sim_state_median0.030498903970020412
sim_compute_sim_state_min0.03043398440751613
sim_render-ego0_max0.003694454002776909
sim_render-ego0_mean0.0036386910732695895
sim_render-ego0_median0.0036386910732695895
sim_render-ego0_min0.00358292814376227
simulation-passed1
step_physics_max0.07215190627718666
step_physics_mean0.07208009839480653
step_physics_median0.07208009839480653
step_physics_min0.07200829051242638
survival_time_max29.000000000000277
survival_time_mean26.50000000000024
survival_time_min24.00000000000021
No reset possible
7928415994N ? RO botobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-010:06:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 187 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7928215992N ? RO botobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-010:06:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 162 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7928115991Ivan Danovobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-010:06:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 699 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7928015991Ivan Danovobjdet exercisemooc-objdetsimabortednogpu-production-spot-0-010:06:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 171 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7927915990Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:15:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median11.225000000000056
deviation-center-line_median2.30469795093242
driven_lanedir_consec_median4.535697588482502
survival_time_median43.79999999999949


other stats
agent_compute-ego0_max0.01619265566682729
agent_compute-ego0_mean0.01137887899933505
agent_compute-ego0_median0.01137887899933505
agent_compute-ego0_min0.006565102331842808
complete-iteration_max0.18019057441145775
complete-iteration_mean0.1763022923118711
complete-iteration_median0.1763022923118711
complete-iteration_min0.17241401021228445
deviation-center-line_max3.6621006561452023
deviation-center-line_mean2.30469795093242
deviation-center-line_min0.9472952457196372
deviation-heading_max3.0491749263470846
deviation-heading_mean2.3160564376238346
deviation-heading_median2.3160564376238346
deviation-heading_min1.582937948900585
distance-from-start_max8.302711415326918
distance-from-start_mean5.993027997719359
distance-from-start_median5.993027997719359
distance-from-start_min3.6833445801118
driven_any_max8.324247918377106
driven_any_mean6.018167621955518
driven_any_median6.018167621955518
driven_any_min3.71208732553393
driven_lanedir_consec_max7.720139562202414
driven_lanedir_consec_mean4.535697588482502
driven_lanedir_consec_min1.351255614762589
driven_lanedir_max7.720139562202414
driven_lanedir_mean4.535697588482502
driven_lanedir_median4.535697588482502
driven_lanedir_min1.351255614762589
get_duckie_state_max1.123111028136655e-06
get_duckie_state_mean1.1222659859021022e-06
get_duckie_state_median1.1222659859021022e-06
get_duckie_state_min1.1214209436675492e-06
get_robot_state_max0.003460077719327115
get_robot_state_mean0.0034139144816454628
get_robot_state_median0.0034139144816454628
get_robot_state_min0.0033677512439638105
get_state_dump_max0.004258575685613856
get_state_dump_mean0.004250467545938219
get_state_dump_median0.004250467545938219
get_state_dump_min0.004242359406262582
get_ui_image_max0.04660036780256514
get_ui_image_mean0.04647882599487893
get_ui_image_median0.04647882599487893
get_ui_image_min0.046357284187192725
in-drivable-lane_max17.800000000000118
in-drivable-lane_mean11.225000000000056
in-drivable-lane_min4.6499999999999915
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324247918377106, "get_ui_image": 0.04660036780256514, "step_physics": 0.07294570397179291, "survival_time": 59.99999999999873, "driven_lanedir": 7.720139562202414, "get_state_dump": 0.004258575685613856, "get_robot_state": 0.003460077719327115, "sim_render-ego0": 0.003603634687387179, "get_duckie_state": 1.1214209436675492e-06, "in-drivable-lane": 4.6499999999999915, "deviation-heading": 3.0491749263470846, "agent_compute-ego0": 0.006565102331842808, "complete-iteration": 0.17241401021228445, "set_robot_commands": 0.0022398397189989177, "distance-from-start": 8.302711415326918, "deviation-center-line": 3.6621006561452023, "driven_lanedir_consec": 7.720139562202414, "sim_compute_sim_state": 0.030796709902379833, "sim_compute_performance-ego0": 0.0018754658552133272}, "LF-full-loop-001-ego0": {"driven_any": 3.71208732553393, "get_ui_image": 0.046357284187192725, "step_physics": 0.07273935193825803, "survival_time": 27.600000000000257, "driven_lanedir": 1.351255614762589, "get_state_dump": 0.004242359406262582, "get_robot_state": 0.0033677512439638105, "sim_render-ego0": 0.0034993483834844384, "get_duckie_state": 1.123111028136655e-06, "in-drivable-lane": 17.800000000000118, "deviation-heading": 1.582937948900585, "agent_compute-ego0": 0.01619265566682729, "complete-iteration": 0.18019057441145775, "set_robot_commands": 0.002094972413875311, "distance-from-start": 3.6833445801118, "deviation-center-line": 0.9472952457196372, "driven_lanedir_consec": 1.351255614762589, "sim_compute_sim_state": 0.029838753867537374, "sim_compute_performance-ego0": 0.0017906748580242798}}
set_robot_commands_max0.0022398397189989177
set_robot_commands_mean0.0021674060664371143
set_robot_commands_median0.0021674060664371143
set_robot_commands_min0.002094972413875311
sim_compute_performance-ego0_max0.0018754658552133272
sim_compute_performance-ego0_mean0.0018330703566188035
sim_compute_performance-ego0_median0.0018330703566188035
sim_compute_performance-ego0_min0.0017906748580242798
sim_compute_sim_state_max0.030796709902379833
sim_compute_sim_state_mean0.030317731884958603
sim_compute_sim_state_median0.030317731884958603
sim_compute_sim_state_min0.029838753867537374
sim_render-ego0_max0.003603634687387179
sim_render-ego0_mean0.003551491535435809
sim_render-ego0_median0.003551491535435809
sim_render-ego0_min0.0034993483834844384
simulation-passed1
step_physics_max0.07294570397179291
step_physics_mean0.07284252795502547
step_physics_median0.07284252795502547
step_physics_min0.07273935193825803
survival_time_max59.99999999999873
survival_time_mean43.79999999999949
survival_time_min27.600000000000257
No reset possible
7927815989Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:12:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median8.300000000000018
deviation-center-line_median2.7135695714822883
driven_lanedir_consec_median4.314165874019594
survival_time_median39.39999999999943


other stats
agent_compute-ego0_max0.015922025280858856
agent_compute-ego0_mean0.010932720769816743
agent_compute-ego0_median0.010932720769816743
agent_compute-ego0_min0.005943416258774629
complete-iteration_max0.1846600628658062
complete-iteration_mean0.17932226515156552
complete-iteration_median0.17932226515156552
complete-iteration_min0.17398446743732487
deviation-center-line_max4.821323500578807
deviation-center-line_mean2.7135695714822883
deviation-center-line_min0.6058156423857691
deviation-heading_max4.746899033404734
deviation-heading_mean3.165324023235872
deviation-heading_median3.165324023235872
deviation-heading_min1.5837490130670095
distance-from-start_max8.278127846335796
distance-from-start_mean5.360890508898761
distance-from-start_median5.360890508898761
distance-from-start_min2.443653171461726
driven_any_max8.324247706748288
driven_any_mean5.403213023161009
driven_any_median5.403213023161009
driven_any_min2.48217833957373
driven_lanedir_consec_max7.768564964625977
driven_lanedir_consec_mean4.314165874019594
driven_lanedir_consec_min0.8597667834132094
driven_lanedir_max7.768564964625977
driven_lanedir_mean4.314165874019594
driven_lanedir_median4.314165874019594
driven_lanedir_min0.8597667834132094
get_duckie_state_max1.0472709999792773e-06
get_duckie_state_mean1.0453374366082118e-06
get_duckie_state_median1.0453374366082118e-06
get_duckie_state_min1.043403873237146e-06
get_robot_state_max0.003416677597261885
get_robot_state_mean0.003370293053570581
get_robot_state_median0.003370293053570581
get_robot_state_min0.003323908509879277
get_state_dump_max0.004217530435213043
get_state_dump_mean0.004199961473921704
get_state_dump_median0.004199961473921704
get_state_dump_min0.004182392512630364
get_ui_image_max0.047221020794629455
get_ui_image_mean0.04708813997539667
get_ui_image_median0.04708813997539667
get_ui_image_min0.04695525915616387
in-drivable-lane_max12.450000000000042
in-drivable-lane_mean8.300000000000018
in-drivable-lane_min4.149999999999993
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324247706748288, "get_ui_image": 0.047221020794629455, "step_physics": 0.07474168849725905, "survival_time": 59.99999999999873, "driven_lanedir": 7.768564964625977, "get_state_dump": 0.004182392512630364, "get_robot_state": 0.003416677597261885, "sim_render-ego0": 0.0035077800957189808, "get_duckie_state": 1.043403873237146e-06, "in-drivable-lane": 4.149999999999993, "deviation-heading": 4.746899033404734, "agent_compute-ego0": 0.005943416258774629, "complete-iteration": 0.17398446743732487, "set_robot_commands": 0.0021581395678873564, "distance-from-start": 8.278127846335796, "deviation-center-line": 4.821323500578807, "driven_lanedir_consec": 7.768564964625977, "sim_compute_sim_state": 0.0309434481008563, "sim_compute_performance-ego0": 0.001799201687408625}, "LF-full-loop-001-ego0": {"driven_any": 2.48217833957373, "get_ui_image": 0.04695525915616387, "step_physics": 0.07738649434056775, "survival_time": 18.800000000000132, "driven_lanedir": 0.8597667834132094, "get_state_dump": 0.004217530435213043, "get_robot_state": 0.003323908509879277, "sim_render-ego0": 0.0034872049994430746, "get_duckie_state": 1.0472709999792773e-06, "in-drivable-lane": 12.450000000000042, "deviation-heading": 1.5837490130670095, "agent_compute-ego0": 0.015922025280858856, "complete-iteration": 0.1846600628658062, "set_robot_commands": 0.0020199176171097895, "distance-from-start": 2.443653171461726, "deviation-center-line": 0.6058156423857691, "driven_lanedir_consec": 0.8597667834132094, "sim_compute_sim_state": 0.02951343306179704, "sim_compute_performance-ego0": 0.0017637093440291103}}
set_robot_commands_max0.0021581395678873564
set_robot_commands_mean0.002089028592498573
set_robot_commands_median0.002089028592498573
set_robot_commands_min0.0020199176171097895
sim_compute_performance-ego0_max0.001799201687408625
sim_compute_performance-ego0_mean0.0017814555157188675
sim_compute_performance-ego0_median0.0017814555157188675
sim_compute_performance-ego0_min0.0017637093440291103
sim_compute_sim_state_max0.0309434481008563
sim_compute_sim_state_mean0.03022844058132667
sim_compute_sim_state_median0.03022844058132667
sim_compute_sim_state_min0.02951343306179704
sim_render-ego0_max0.0035077800957189808
sim_render-ego0_mean0.003497492547581028
sim_render-ego0_median0.003497492547581028
sim_render-ego0_min0.0034872049994430746
simulation-passed1
step_physics_max0.07738649434056775
step_physics_mean0.0760640914189134
step_physics_median0.0760640914189134
step_physics_min0.07474168849725905
survival_time_max59.99999999999873
survival_time_mean39.39999999999943
survival_time_min18.800000000000132
No reset possible
7927415985Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:14:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median12.500000000000028
deviation-center-line_median2.660885309252578
driven_lanedir_consec_median3.719188778947875
survival_time_median39.449999999999434


other stats
agent_compute-ego0_max0.016158153010547002
agent_compute-ego0_mean0.011259250316443583
agent_compute-ego0_median0.011259250316443583
agent_compute-ego0_min0.006360347622340168
complete-iteration_max0.18843138186472383
complete-iteration_mean0.18340965829181108
complete-iteration_median0.18340965829181108
complete-iteration_min0.1783879347188983
deviation-center-line_max4.839660237460517
deviation-center-line_mean2.660885309252578
deviation-center-line_min0.482110381044639
deviation-heading_max5.855416195677757
deviation-heading_mean3.7301484767923943
deviation-heading_median3.7301484767923943
deviation-heading_min1.6048807579070328
distance-from-start_max8.253008834635136
distance-from-start_mean5.350026996637507
distance-from-start_median5.350026996637507
distance-from-start_min2.4470451586398787
driven_any_max8.32424742362309
driven_any_mean5.410201006413448
driven_any_median5.410201006413448
driven_any_min2.496154589203806
driven_lanedir_consec_max6.767963066647795
driven_lanedir_consec_mean3.719188778947875
driven_lanedir_consec_min0.6704144912479557
driven_lanedir_max6.767963066647795
driven_lanedir_mean3.719188778947875
driven_lanedir_median3.719188778947875
driven_lanedir_min0.6704144912479557
get_duckie_state_max1.6959283274476674e-06
get_duckie_state_mean1.6343051238213357e-06
get_duckie_state_median1.6343051238213357e-06
get_duckie_state_min1.5726819201950031e-06
get_robot_state_max0.0035143231968137395
get_robot_state_mean0.0034736228078398354
get_robot_state_median0.0034736228078398354
get_robot_state_min0.0034329224188659312
get_state_dump_max0.004321561325194024
get_state_dump_mean0.004265810655709848
get_state_dump_median0.004265810655709848
get_state_dump_min0.004210059986225671
get_ui_image_max0.04874910204535619
get_ui_image_mean0.0486642747737764
get_ui_image_median0.0486642747737764
get_ui_image_min0.04857944750219662
in-drivable-lane_max13.850000000000062
in-drivable-lane_mean12.500000000000028
in-drivable-lane_min11.149999999999991
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.32424742362309, "get_ui_image": 0.04874910204535619, "step_physics": 0.07693747140088744, "survival_time": 59.99999999999873, "driven_lanedir": 6.767963066647795, "get_state_dump": 0.004210059986225671, "get_robot_state": 0.0034329224188659312, "sim_render-ego0": 0.0035898445250092696, "get_duckie_state": 1.6959283274476674e-06, "in-drivable-lane": 11.149999999999991, "deviation-heading": 5.855416195677757, "agent_compute-ego0": 0.006360347622340168, "complete-iteration": 0.1783879347188983, "set_robot_commands": 0.0021541295301705774, "distance-from-start": 8.253008834635136, "deviation-center-line": 4.839660237460517, "driven_lanedir_consec": 6.767963066647795, "sim_compute_sim_state": 0.031026892022824507, "sim_compute_performance-ego0": 0.0018535075239297452}, "LF-full-loop-001-ego0": {"driven_any": 2.496154589203806, "get_ui_image": 0.04857944750219662, "step_physics": 0.0783785326814274, "survival_time": 18.900000000000137, "driven_lanedir": 0.6704144912479557, "get_state_dump": 0.004321561325194024, "get_robot_state": 0.0035143231968137395, "sim_render-ego0": 0.003609139560709528, "get_duckie_state": 1.5726819201950031e-06, "in-drivable-lane": 13.850000000000062, "deviation-heading": 1.6048807579070328, "agent_compute-ego0": 0.016158153010547002, "complete-iteration": 0.18843138186472383, "set_robot_commands": 0.002137931481514883, "distance-from-start": 2.4470451586398787, "deviation-center-line": 0.482110381044639, "driven_lanedir_consec": 0.6704144912479557, "sim_compute_sim_state": 0.029748371848959405, "sim_compute_performance-ego0": 0.0019113029842326385}}
set_robot_commands_max0.0021541295301705774
set_robot_commands_mean0.0021460305058427303
set_robot_commands_median0.0021460305058427303
set_robot_commands_min0.002137931481514883
sim_compute_performance-ego0_max0.0019113029842326385
sim_compute_performance-ego0_mean0.0018824052540811916
sim_compute_performance-ego0_median0.0018824052540811916
sim_compute_performance-ego0_min0.0018535075239297452
sim_compute_sim_state_max0.031026892022824507
sim_compute_sim_state_mean0.030387631935891956
sim_compute_sim_state_median0.030387631935891956
sim_compute_sim_state_min0.029748371848959405
sim_render-ego0_max0.003609139560709528
sim_render-ego0_mean0.003599492042859399
sim_render-ego0_median0.003599492042859399
sim_render-ego0_min0.0035898445250092696
simulation-passed1
step_physics_max0.0783785326814274
step_physics_mean0.07765800204115741
step_physics_median0.07765800204115741
step_physics_min0.07693747140088744
survival_time_max59.99999999999873
survival_time_mean39.449999999999434
survival_time_min18.900000000000137
No reset possible
7927015981Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median22.099999999999937
deviation-center-line_median0.7223404231177699
driven_lanedir_consec_median0.9555711642409636
survival_time_median29.65000000000001


other stats
agent_compute-ego0_max0.01631908355615078
agent_compute-ego0_mean0.011404412216089448
agent_compute-ego0_median0.011404412216089448
agent_compute-ego0_min0.006489740876028114
complete-iteration_max0.1851258999262101
complete-iteration_mean0.17909962304047083
complete-iteration_median0.17909962304047083
complete-iteration_min0.1730733461547316
deviation-center-line_max1.1741766567427552
deviation-center-line_mean0.7223404231177699
deviation-center-line_min0.27050418949278476
deviation-heading_max4.847482510243782
deviation-heading_mean3.259360448774737
deviation-heading_median3.259360448774737
deviation-heading_min1.671238387305692
distance-from-start_max5.191969349873501
distance-from-start_mean3.81592338947139
distance-from-start_median3.81592338947139
distance-from-start_min2.4398774290692793
driven_any_max5.410198680239773
driven_any_mean3.991610181599105
driven_any_median3.991610181599105
driven_any_min2.573021682958437
driven_lanedir_consec_max1.5794849717016606
driven_lanedir_consec_mean0.9555711642409636
driven_lanedir_consec_min0.33165735678026653
driven_lanedir_max1.5794849717016606
driven_lanedir_mean0.9555711642409636
driven_lanedir_median0.9555711642409636
driven_lanedir_min0.33165735678026653
get_duckie_state_max1.1200892895385436e-06
get_duckie_state_mean1.1081017118578635e-06
get_duckie_state_median1.1081017118578635e-06
get_duckie_state_min1.0961141341771834e-06
get_robot_state_max0.0034702950551695096
get_robot_state_mean0.0034162849182105375
get_robot_state_median0.0034162849182105375
get_robot_state_min0.003362274781251565
get_state_dump_max0.004315800236580067
get_state_dump_mean0.004287023573728892
get_state_dump_median0.004287023573728892
get_state_dump_min0.004258246910877717
get_ui_image_max0.04676554973860432
get_ui_image_mean0.0466587948826712
get_ui_image_median0.0466587948826712
get_ui_image_min0.046552040026738094
in-drivable-lane_max27.59999999999977
in-drivable-lane_mean22.099999999999937
in-drivable-lane_min16.600000000000104
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.410198680239773, "get_ui_image": 0.04676554973860432, "step_physics": 0.07333282211370636, "survival_time": 39.84999999999987, "driven_lanedir": 1.5794849717016606, "get_state_dump": 0.004315800236580067, "get_robot_state": 0.0034702950551695096, "sim_render-ego0": 0.0036516670595135607, "get_duckie_state": 1.1200892895385436e-06, "in-drivable-lane": 27.59999999999977, "deviation-heading": 4.847482510243782, "agent_compute-ego0": 0.006489740876028114, "complete-iteration": 0.1730733461547316, "set_robot_commands": 0.0022013333805820396, "distance-from-start": 5.191969349873501, "deviation-center-line": 1.1741766567427552, "driven_lanedir_consec": 1.5794849717016606, "sim_compute_sim_state": 0.030912699854762332, "sim_compute_performance-ego0": 0.0018613702970041069}, "LF-full-loop-001-ego0": {"driven_any": 2.573021682958437, "get_ui_image": 0.046552040026738094, "step_physics": 0.07661119607778696, "survival_time": 19.45000000000014, "driven_lanedir": 0.33165735678026653, "get_state_dump": 0.004258246910877717, "get_robot_state": 0.003362274781251565, "sim_render-ego0": 0.003584101872566419, "get_duckie_state": 1.0961141341771834e-06, "in-drivable-lane": 16.600000000000104, "deviation-heading": 1.671238387305692, "agent_compute-ego0": 0.01631908355615078, "complete-iteration": 0.1851258999262101, "set_robot_commands": 0.002057639757792155, "distance-from-start": 2.4398774290692793, "deviation-center-line": 0.27050418949278476, "driven_lanedir_consec": 0.33165735678026653, "sim_compute_sim_state": 0.03052012064518073, "sim_compute_performance-ego0": 0.0017917339618389425}}
set_robot_commands_max0.0022013333805820396
set_robot_commands_mean0.0021294865691870975
set_robot_commands_median0.0021294865691870975
set_robot_commands_min0.002057639757792155
sim_compute_performance-ego0_max0.0018613702970041069
sim_compute_performance-ego0_mean0.0018265521294215249
sim_compute_performance-ego0_median0.0018265521294215249
sim_compute_performance-ego0_min0.0017917339618389425
sim_compute_sim_state_max0.030912699854762332
sim_compute_sim_state_mean0.03071641024997153
sim_compute_sim_state_median0.03071641024997153
sim_compute_sim_state_min0.03052012064518073
sim_render-ego0_max0.0036516670595135607
sim_render-ego0_mean0.0036178844660399896
sim_render-ego0_median0.0036178844660399896
sim_render-ego0_min0.003584101872566419
simulation-passed1
step_physics_max0.07661119607778696
step_physics_mean0.07497200909574667
step_physics_median0.07497200909574667
step_physics_min0.07333282211370636
survival_time_max39.84999999999987
survival_time_mean29.65000000000001
survival_time_min19.45000000000014
No reset possible
7926915980Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.75000000000011
deviation-center-line_median0.40684766223237623
driven_lanedir_consec_median0.5533856001728159
survival_time_median19.025000000000137


other stats
agent_compute-ego0_max0.016508113506228425
agent_compute-ego0_mean0.011416021651528012
agent_compute-ego0_median0.011416021651528012
agent_compute-ego0_min0.0063239297968276
complete-iteration_max0.1834951291096611
complete-iteration_mean0.17937088428213976
complete-iteration_median0.17937088428213976
complete-iteration_min0.1752466394546184
deviation-center-line_max0.4864434087937505
deviation-center-line_mean0.40684766223237623
deviation-center-line_min0.3272519156710019
deviation-heading_max1.638818547011743
deviation-heading_mean1.6181757638392713
deviation-heading_median1.6181757638392713
deviation-heading_min1.5975329806668
distance-from-start_max2.4546878698881582
distance-from-start_mean2.441165560062492
distance-from-start_median2.441165560062492
distance-from-start_min2.4276432502368257
driven_any_max2.5520596802116855
driven_any_mean2.5066372608524015
driven_any_median2.5066372608524015
driven_any_min2.461214841493117
driven_lanedir_consec_max0.6780335483097719
driven_lanedir_consec_mean0.5533856001728159
driven_lanedir_consec_min0.4287376520358599
driven_lanedir_max0.6780335483097719
driven_lanedir_mean0.5533856001728159
driven_lanedir_median0.5533856001728159
driven_lanedir_min0.4287376520358599
get_duckie_state_max1.1514323626377783e-06
get_duckie_state_mean1.1391068928394698e-06
get_duckie_state_median1.1391068928394698e-06
get_duckie_state_min1.1267814230411612e-06
get_robot_state_max0.0034886363973008826
get_robot_state_mean0.0034304026847517743
get_robot_state_median0.0034304026847517743
get_robot_state_min0.0033721689722026656
get_state_dump_max0.004229580468319832
get_state_dump_mean0.0041886314277016085
get_state_dump_median0.0041886314277016085
get_state_dump_min0.004147682387083384
get_ui_image_max0.04717647690489619
get_ui_image_mean0.04702863974023713
get_ui_image_median0.04702863974023713
get_ui_image_min0.04688080257557808
in-drivable-lane_max15.85000000000009
in-drivable-lane_mean14.75000000000011
in-drivable-lane_min13.65000000000013
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.461214841493117, "get_ui_image": 0.04688080257557808, "step_physics": 0.0759737269675478, "survival_time": 18.75000000000013, "driven_lanedir": 0.6780335483097719, "get_state_dump": 0.004229580468319832, "get_robot_state": 0.0034886363973008826, "sim_render-ego0": 0.003655355661473375, "get_duckie_state": 1.1267814230411612e-06, "in-drivable-lane": 13.65000000000013, "deviation-heading": 1.5975329806668, "agent_compute-ego0": 0.0063239297968276, "complete-iteration": 0.1752466394546184, "set_robot_commands": 0.0021417483370354835, "distance-from-start": 2.4276432502368257, "deviation-center-line": 0.4864434087937505, "driven_lanedir_consec": 0.6780335483097719, "sim_compute_sim_state": 0.03063071534988728, "sim_compute_performance-ego0": 0.0018515751716938424}, "LF-full-loop-001-ego0": {"driven_any": 2.5520596802116855, "get_ui_image": 0.04717647690489619, "step_physics": 0.0746717046397601, "survival_time": 19.30000000000014, "driven_lanedir": 0.4287376520358599, "get_state_dump": 0.004147682387083384, "get_robot_state": 0.0033721689722026656, "sim_render-ego0": 0.003557999928792318, "get_duckie_state": 1.1514323626377783e-06, "in-drivable-lane": 15.85000000000009, "deviation-heading": 1.638818547011743, "agent_compute-ego0": 0.016508113506228425, "complete-iteration": 0.1834951291096611, "set_robot_commands": 0.0021083330307203976, "distance-from-start": 2.4546878698881582, "deviation-center-line": 0.3272519156710019, "driven_lanedir_consec": 0.4287376520358599, "sim_compute_sim_state": 0.030053106697338804, "sim_compute_performance-ego0": 0.0018280575133725347}}
set_robot_commands_max0.0021417483370354835
set_robot_commands_mean0.0021250406838779403
set_robot_commands_median0.0021250406838779403
set_robot_commands_min0.0021083330307203976
sim_compute_performance-ego0_max0.0018515751716938424
sim_compute_performance-ego0_mean0.0018398163425331889
sim_compute_performance-ego0_median0.0018398163425331889
sim_compute_performance-ego0_min0.0018280575133725347
sim_compute_sim_state_max0.03063071534988728
sim_compute_sim_state_mean0.03034191102361304
sim_compute_sim_state_median0.03034191102361304
sim_compute_sim_state_min0.030053106697338804
sim_render-ego0_max0.003655355661473375
sim_render-ego0_mean0.0036066777951328463
sim_render-ego0_median0.0036066777951328463
sim_render-ego0_min0.003557999928792318
simulation-passed1
step_physics_max0.0759737269675478
step_physics_mean0.07532271580365395
step_physics_median0.07532271580365395
step_physics_min0.0746717046397601
survival_time_max19.30000000000014
survival_time_mean19.025000000000137
survival_time_min18.75000000000013
No reset possible
7926715978Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.775000000000109
deviation-center-line_median0.40651466257759983
driven_lanedir_consec_median0.5533981815812059
survival_time_median19.050000000000136


other stats
agent_compute-ego0_max0.016278053681875012
agent_compute-ego0_mean0.011640079710064656
agent_compute-ego0_median0.011640079710064656
agent_compute-ego0_min0.007002105738254304
complete-iteration_max0.18665491797260403
complete-iteration_mean0.1793780258269811
complete-iteration_median0.1793780258269811
complete-iteration_min0.17210113368135818
deviation-center-line_max0.4925575973457454
deviation-center-line_mean0.40651466257759983
deviation-center-line_min0.3204717278094542
deviation-heading_max1.6304338395832294
deviation-heading_mean1.6151210417959123
deviation-heading_median1.6151210417959123
deviation-heading_min1.599808244008595
distance-from-start_max2.4586422485632604
distance-from-start_mean2.4436589720943145
distance-from-start_median2.4436589720943145
distance-from-start_min2.428675695625368
driven_any_max2.5590478304237405
driven_any_mean2.5101313597933483
driven_any_median2.5101313597933483
driven_any_min2.4612148891629557
driven_lanedir_consec_max0.6852618042102274
driven_lanedir_consec_mean0.5533981815812059
driven_lanedir_consec_min0.4215345589521844
driven_lanedir_max0.6852618042102274
driven_lanedir_mean0.5533981815812059
driven_lanedir_median0.5533981815812059
driven_lanedir_min0.4215345589521844
get_duckie_state_max1.1711678606398563e-06
get_duckie_state_mean1.1290922633491344e-06
get_duckie_state_median1.1290922633491344e-06
get_duckie_state_min1.0870166660584125e-06
get_robot_state_max0.003537649169881293
get_robot_state_mean0.0034682783615853237
get_robot_state_median0.0034682783615853237
get_robot_state_min0.0033989075532893545
get_state_dump_max0.004372513040583184
get_state_dump_mean0.004301468056266468
get_state_dump_median0.004301468056266468
get_state_dump_min0.004230423071949752
get_ui_image_max0.04695600968726138
get_ui_image_mean0.04687616393463631
get_ui_image_median0.04687616393463631
get_ui_image_min0.04679631818201124
in-drivable-lane_max15.950000000000092
in-drivable-lane_mean14.775000000000109
in-drivable-lane_min13.600000000000128
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.4612148891629557, "get_ui_image": 0.04695600968726138, "step_physics": 0.0718687246454523, "survival_time": 18.75000000000013, "driven_lanedir": 0.6852618042102274, "get_state_dump": 0.004372513040583184, "get_robot_state": 0.003537649169881293, "sim_render-ego0": 0.0037018092388802384, "get_duckie_state": 1.1711678606398563e-06, "in-drivable-lane": 13.600000000000128, "deviation-heading": 1.599808244008595, "agent_compute-ego0": 0.007002105738254304, "complete-iteration": 0.17210113368135818, "set_robot_commands": 0.0025680718269753965, "distance-from-start": 2.428675695625368, "deviation-center-line": 0.4925575973457454, "driven_lanedir_consec": 0.6852618042102274, "sim_compute_sim_state": 0.030120790004730225, "sim_compute_performance-ego0": 0.0019026037226331997}, "LF-full-loop-001-ego0": {"driven_any": 2.5590478304237405, "get_ui_image": 0.04679631818201124, "step_physics": 0.07851259487191427, "survival_time": 19.35000000000014, "driven_lanedir": 0.4215345589521844, "get_state_dump": 0.004230423071949752, "get_robot_state": 0.0033989075532893545, "sim_render-ego0": 0.0035421885165971578, "get_duckie_state": 1.0870166660584125e-06, "in-drivable-lane": 15.950000000000092, "deviation-heading": 1.6304338395832294, "agent_compute-ego0": 0.016278053681875012, "complete-iteration": 0.18665491797260403, "set_robot_commands": 0.002112585859200389, "distance-from-start": 2.4586422485632604, "deviation-center-line": 0.3204717278094542, "driven_lanedir_consec": 0.4215345589521844, "sim_compute_sim_state": 0.029899260432449812, "sim_compute_performance-ego0": 0.0018150050615526967}}
set_robot_commands_max0.0025680718269753965
set_robot_commands_mean0.002340328843087893
set_robot_commands_median0.002340328843087893
set_robot_commands_min0.002112585859200389
sim_compute_performance-ego0_max0.0019026037226331997
sim_compute_performance-ego0_mean0.001858804392092948
sim_compute_performance-ego0_median0.001858804392092948
sim_compute_performance-ego0_min0.0018150050615526967
sim_compute_sim_state_max0.030120790004730225
sim_compute_sim_state_mean0.030010025218590017
sim_compute_sim_state_median0.030010025218590017
sim_compute_sim_state_min0.029899260432449812
sim_render-ego0_max0.0037018092388802384
sim_render-ego0_mean0.003621998877738698
sim_render-ego0_median0.003621998877738698
sim_render-ego0_min0.0035421885165971578
simulation-passed1
step_physics_max0.07851259487191427
step_physics_mean0.07519065975868328
step_physics_median0.07519065975868328
step_physics_min0.0718687246454523
survival_time_max19.35000000000014
survival_time_mean19.050000000000136
survival_time_min18.75000000000013
No reset possible
7926615978Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.725000000000108
deviation-center-line_median0.4097731759906517
driven_lanedir_consec_median0.5570897722558691
survival_time_median19.025000000000137


other stats
agent_compute-ego0_max0.016266248638931786
agent_compute-ego0_mean0.011159555230672077
agent_compute-ego0_median0.011159555230672077
agent_compute-ego0_min0.006052861822412369
complete-iteration_max0.17908651452963975
complete-iteration_mean0.17555247306614005
complete-iteration_median0.17555247306614005
complete-iteration_min0.17201843160264035
deviation-center-line_max0.4858910290986062
deviation-center-line_mean0.4097731759906517
deviation-center-line_min0.3336553228826972
deviation-heading_max1.6453647762973376
deviation-heading_mean1.6202816844450778
deviation-heading_median1.6202816844450778
deviation-heading_min1.5951985925928185
distance-from-start_max2.457116853236878
distance-from-start_mean2.442704811387462
distance-from-start_median2.442704811387462
distance-from-start_min2.4282927695380456
driven_any_max2.552059661327302
driven_any_mean2.506637276484294
driven_any_median2.506637276484294
driven_any_min2.461214891641286
driven_lanedir_consec_max0.6781396144397969
driven_lanedir_consec_mean0.5570897722558691
driven_lanedir_consec_min0.4360399300719413
driven_lanedir_max0.6781396144397969
driven_lanedir_mean0.5570897722558691
driven_lanedir_median0.5570897722558691
driven_lanedir_min0.4360399300719413
get_duckie_state_max1.1350246185952044e-06
get_duckie_state_mean1.130599082679587e-06
get_duckie_state_median1.130599082679587e-06
get_duckie_state_min1.1261735467639696e-06
get_robot_state_max0.003373075672920714
get_robot_state_mean0.003356457296471132
get_robot_state_median0.003356457296471132
get_robot_state_min0.00333983892002155
get_state_dump_max0.004126323664442022
get_state_dump_mean0.004112919052861366
get_state_dump_median0.004112919052861366
get_state_dump_min0.00409951444128071
get_ui_image_max0.047191307265707784
get_ui_image_mean0.04695605017329607
get_ui_image_median0.04695605017329607
get_ui_image_min0.04672079308088436
in-drivable-lane_max15.80000000000009
in-drivable-lane_mean14.725000000000108
in-drivable-lane_min13.650000000000126
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.461214891641286, "get_ui_image": 0.047191307265707784, "step_physics": 0.07350002577964296, "survival_time": 18.75000000000013, "driven_lanedir": 0.6781396144397969, "get_state_dump": 0.004126323664442022, "get_robot_state": 0.003373075672920714, "sim_render-ego0": 0.003535212354457125, "get_duckie_state": 1.1350246185952044e-06, "in-drivable-lane": 13.650000000000126, "deviation-heading": 1.5951985925928185, "agent_compute-ego0": 0.006052861822412369, "complete-iteration": 0.17201843160264035, "set_robot_commands": 0.0020537534926800016, "distance-from-start": 2.4282927695380456, "deviation-center-line": 0.4858910290986062, "driven_lanedir_consec": 0.6781396144397969, "sim_compute_sim_state": 0.0303220216264116, "sim_compute_performance-ego0": 0.0017931271106638809}, "LF-full-loop-001-ego0": {"driven_any": 2.552059661327302, "get_ui_image": 0.04672079308088436, "step_physics": 0.07182075872593764, "survival_time": 19.30000000000014, "driven_lanedir": 0.4360399300719413, "get_state_dump": 0.00409951444128071, "get_robot_state": 0.00333983892002155, "sim_render-ego0": 0.003447748277846541, "get_duckie_state": 1.1261735467639696e-06, "in-drivable-lane": 15.80000000000009, "deviation-heading": 1.6453647762973376, "agent_compute-ego0": 0.016266248638931786, "complete-iteration": 0.17908651452963975, "set_robot_commands": 0.0020348902512582387, "distance-from-start": 2.457116853236878, "deviation-center-line": 0.3336553228826972, "driven_lanedir_consec": 0.4360399300719413, "sim_compute_sim_state": 0.02952673638513846, "sim_compute_performance-ego0": 0.0017613348110701687}}
set_robot_commands_max0.0020537534926800016
set_robot_commands_mean0.00204432187196912
set_robot_commands_median0.00204432187196912
set_robot_commands_min0.0020348902512582387
sim_compute_performance-ego0_max0.0017931271106638809
sim_compute_performance-ego0_mean0.0017772309608670247
sim_compute_performance-ego0_median0.0017772309608670247
sim_compute_performance-ego0_min0.0017613348110701687
sim_compute_sim_state_max0.0303220216264116
sim_compute_sim_state_mean0.02992437900577503
sim_compute_sim_state_median0.02992437900577503
sim_compute_sim_state_min0.02952673638513846
sim_render-ego0_max0.003535212354457125
sim_render-ego0_mean0.003491480316151833
sim_render-ego0_median0.003491480316151833
sim_render-ego0_min0.003447748277846541
simulation-passed1
step_physics_max0.07350002577964296
step_physics_mean0.0726603922527903
step_physics_median0.0726603922527903
step_physics_min0.07182075872593764
survival_time_max19.30000000000014
survival_time_mean19.025000000000137
survival_time_min18.75000000000013
No reset possible
7926415978Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.72500000000011
deviation-center-line_median0.4101479599850648
driven_lanedir_consec_median0.5570107011813994
survival_time_median19.025000000000137


other stats
agent_compute-ego0_max0.016035045456208617
agent_compute-ego0_mean0.011038573051935584
agent_compute-ego0_median0.011038573051935584
agent_compute-ego0_min0.0060421006476625485
complete-iteration_max0.1793502683171314
complete-iteration_mean0.1753279817149234
complete-iteration_median0.1753279817149234
complete-iteration_min0.17130569511271537
deviation-center-line_max0.4864460325269459
deviation-center-line_mean0.4101479599850648
deviation-center-line_min0.33384988744318367
deviation-heading_max1.6470233185798788
deviation-heading_mean1.6217336151464958
deviation-heading_median1.6217336151464958
deviation-heading_min1.596443911713113
distance-from-start_max2.456458669636933
distance-from-start_mean2.442077705167235
distance-from-start_median2.442077705167235
distance-from-start_min2.4276967406975376
driven_any_max2.552059675241525
driven_any_mean2.5066372621856816
driven_any_median2.5066372621856816
driven_any_min2.4612148491298385
driven_lanedir_consec_max0.6780833129624613
driven_lanedir_consec_mean0.5570107011813994
driven_lanedir_consec_min0.4359380894003375
driven_lanedir_max0.6780833129624613
driven_lanedir_mean0.5570107011813994
driven_lanedir_median0.5570107011813994
driven_lanedir_min0.4359380894003375
get_duckie_state_max1.1834679339899266e-06
get_duckie_state_mean1.149417850824283e-06
get_duckie_state_median1.149417850824283e-06
get_duckie_state_min1.1153677676586397e-06
get_robot_state_max0.0033647697022620667
get_robot_state_mean0.003341121740499529
get_robot_state_median0.003341121740499529
get_robot_state_min0.0033174737787369916
get_state_dump_max0.004125399792448003
get_state_dump_mean0.004108830936614766
get_state_dump_median0.004108830936614766
get_state_dump_min0.0040922620807815275
get_ui_image_max0.04684924064798558
get_ui_image_mean0.04682425181437983
get_ui_image_median0.04682425181437983
get_ui_image_min0.04679926298077408
in-drivable-lane_max15.80000000000009
in-drivable-lane_mean14.72500000000011
in-drivable-lane_min13.65000000000013
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.4612148491298385, "get_ui_image": 0.04684924064798558, "step_physics": 0.07307278222226082, "survival_time": 18.75000000000013, "driven_lanedir": 0.6780833129624613, "get_state_dump": 0.004125399792448003, "get_robot_state": 0.0033647697022620667, "sim_render-ego0": 0.0035406357430397195, "get_duckie_state": 1.1153677676586397e-06, "in-drivable-lane": 13.65000000000013, "deviation-heading": 1.596443911713113, "agent_compute-ego0": 0.0060421006476625485, "complete-iteration": 0.17130569511271537, "set_robot_commands": 0.0020250456130250973, "distance-from-start": 2.4276967406975376, "deviation-center-line": 0.4864460325269459, "driven_lanedir_consec": 0.6780833129624613, "sim_compute_sim_state": 0.030431401856402137, "sim_compute_performance-ego0": 0.001785353143164452}, "LF-full-loop-001-ego0": {"driven_any": 2.552059675241525, "get_ui_image": 0.04679926298077408, "step_physics": 0.07219757836610464, "survival_time": 19.30000000000014, "driven_lanedir": 0.4359380894003375, "get_state_dump": 0.0040922620807815275, "get_robot_state": 0.0033174737787369916, "sim_render-ego0": 0.0034540019910156883, "get_duckie_state": 1.1834679339899266e-06, "in-drivable-lane": 15.80000000000009, "deviation-heading": 1.6470233185798788, "agent_compute-ego0": 0.016035045456208617, "complete-iteration": 0.1793502683171314, "set_robot_commands": 0.0020069238135364937, "distance-from-start": 2.456458669636933, "deviation-center-line": 0.33384988744318367, "driven_lanedir_consec": 0.4359380894003375, "sim_compute_sim_state": 0.02961934690943676, "sim_compute_performance-ego0": 0.00175826925331924}}
set_robot_commands_max0.0020250456130250973
set_robot_commands_mean0.0020159847132807957
set_robot_commands_median0.0020159847132807957
set_robot_commands_min0.0020069238135364937
sim_compute_performance-ego0_max0.001785353143164452
sim_compute_performance-ego0_mean0.001771811198241846
sim_compute_performance-ego0_median0.001771811198241846
sim_compute_performance-ego0_min0.00175826925331924
sim_compute_sim_state_max0.030431401856402137
sim_compute_sim_state_mean0.030025374382919447
sim_compute_sim_state_median0.030025374382919447
sim_compute_sim_state_min0.02961934690943676
sim_render-ego0_max0.0035406357430397195
sim_render-ego0_mean0.003497318867027704
sim_render-ego0_median0.003497318867027704
sim_render-ego0_min0.0034540019910156883
simulation-passed1
step_physics_max0.07307278222226082
step_physics_mean0.07263518029418273
step_physics_median0.07263518029418273
step_physics_min0.07219757836610464
survival_time_max19.30000000000014
survival_time_mean19.025000000000137
survival_time_min18.75000000000013
No reset possible
7926315977Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median14.75000000000011
deviation-center-line_median0.4072711978003295
driven_lanedir_consec_median0.5533125543567528
survival_time_median19.025000000000137


other stats
agent_compute-ego0_max0.016237100581482092
agent_compute-ego0_mean0.011344415806997825
agent_compute-ego0_median0.011344415806997825
agent_compute-ego0_min0.006451731032513557
complete-iteration_max0.18862095298077092
complete-iteration_mean0.18048366974221847
complete-iteration_median0.18048366974221847
complete-iteration_min0.17234638650366602
deviation-center-line_max0.4869784200022153
deviation-center-line_mean0.4072711978003295
deviation-center-line_min0.3275639755984437
deviation-heading_max1.6405209238342549
deviation-heading_mean1.6193090817213929
deviation-heading_median1.6193090817213929
deviation-heading_min1.598097239608531
distance-from-start_max2.455139570439463
distance-from-start_mean2.44157422095424
distance-from-start_median2.44157422095424
distance-from-start_min2.428008871469017
driven_any_max2.5520596542651344
driven_any_mean2.506637267125835
driven_any_median2.506637267125835
driven_any_min2.461214879986535
driven_lanedir_consec_max0.6780106636139189
driven_lanedir_consec_mean0.5533125543567528
driven_lanedir_consec_min0.42861444509958657
driven_lanedir_max0.6780106636139189
driven_lanedir_mean0.5533125543567528
driven_lanedir_median0.5533125543567528
driven_lanedir_min0.42861444509958657
get_duckie_state_max1.1803875905906814e-06
get_duckie_state_mean1.126952644256704e-06
get_duckie_state_median1.126952644256704e-06
get_duckie_state_min1.0735176979227269e-06
get_robot_state_max0.003399782992423849
get_robot_state_mean0.003383218766936593
get_robot_state_median0.003383218766936593
get_robot_state_min0.003366654541449338
get_state_dump_max0.004255801824328203
get_state_dump_mean0.004239138011994242
get_state_dump_median0.004239138011994242
get_state_dump_min0.004222474199660281
get_ui_image_max0.04703227002569969
get_ui_image_mean0.04681600188139384
get_ui_image_median0.04681600188139384
get_ui_image_min0.04659973373708799
in-drivable-lane_max15.85000000000009
in-drivable-lane_mean14.75000000000011
in-drivable-lane_min13.650000000000128
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.461214879986535, "get_ui_image": 0.04703227002569969, "step_physics": 0.0733070322807799, "survival_time": 18.75000000000013, "driven_lanedir": 0.6780106636139189, "get_state_dump": 0.004222474199660281, "get_robot_state": 0.003399782992423849, "sim_render-ego0": 0.0035435379819667087, "get_duckie_state": 1.0735176979227269e-06, "in-drivable-lane": 13.650000000000128, "deviation-heading": 1.598097239608531, "agent_compute-ego0": 0.006451731032513557, "complete-iteration": 0.17234638650366602, "set_robot_commands": 0.002115181151856767, "distance-from-start": 2.428008871469017, "deviation-center-line": 0.4869784200022153, "driven_lanedir_consec": 0.6780106636139189, "sim_compute_sim_state": 0.030418560225912866, "sim_compute_performance-ego0": 0.0017870360232414082}, "LF-full-loop-001-ego0": {"driven_any": 2.5520596542651344, "get_ui_image": 0.04659973373708799, "step_physics": 0.0804593717097004, "survival_time": 19.30000000000014, "driven_lanedir": 0.42861444509958657, "get_state_dump": 0.004255801824328203, "get_robot_state": 0.003366654541449338, "sim_render-ego0": 0.0035599399290651623, "get_duckie_state": 1.1803875905906814e-06, "in-drivable-lane": 15.85000000000009, "deviation-heading": 1.6405209238342549, "agent_compute-ego0": 0.016237100581482092, "complete-iteration": 0.18862095298077092, "set_robot_commands": 0.002073600310687871, "distance-from-start": 2.455139570439463, "deviation-center-line": 0.3275639755984437, "driven_lanedir_consec": 0.42861444509958657, "sim_compute_sim_state": 0.03018812492528319, "sim_compute_performance-ego0": 0.0018124235384840064}}
set_robot_commands_max0.002115181151856767
set_robot_commands_mean0.0020943907312723194
set_robot_commands_median0.0020943907312723194
set_robot_commands_min0.002073600310687871
sim_compute_performance-ego0_max0.0018124235384840064
sim_compute_performance-ego0_mean0.0017997297808627073
sim_compute_performance-ego0_median0.0017997297808627073
sim_compute_performance-ego0_min0.0017870360232414082
sim_compute_sim_state_max0.030418560225912866
sim_compute_sim_state_mean0.030303342575598028
sim_compute_sim_state_median0.030303342575598028
sim_compute_sim_state_min0.03018812492528319
sim_render-ego0_max0.0035599399290651623
sim_render-ego0_mean0.0035517389555159355
sim_render-ego0_median0.0035517389555159355
sim_render-ego0_min0.0035435379819667087
simulation-passed1
step_physics_max0.0804593717097004
step_physics_mean0.07688320199524015
step_physics_median0.07688320199524015
step_physics_min0.0733070322807799
survival_time_max19.30000000000014
survival_time_mean19.025000000000137
survival_time_min18.75000000000013
No reset possible
7925615970N ? RO botbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-010:16:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median3.897893418742513
driven_lanedir_consec_median5.95461470924416
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.0059790791917303816
agent_compute-ego0_mean0.005968761880828578
agent_compute-ego0_median0.005968761880828578
agent_compute-ego0_min0.005958444569926774
complete-iteration_max0.1095246184775474
complete-iteration_mean0.10906718940560169
complete-iteration_median0.10906718940560169
complete-iteration_min0.10860976033365598
deviation-center-line_max4.044422547243363
deviation-center-line_mean3.897893418742513
deviation-center-line_min3.7513642902416624
deviation-heading_max20.123559877200016
deviation-heading_mean14.54407317687756
deviation-heading_median14.54407317687756
deviation-heading_min8.964586476555104
distance-from-start_max1.5281770130032848
distance-from-start_mean1.2854092252676512
distance-from-start_median1.2854092252676512
distance-from-start_min1.042641437532018
driven_any_max6.24838023545054
driven_any_mean6.245749413267436
driven_any_median6.245749413267436
driven_any_min6.243118591084332
driven_lanedir_consec_max6.136398196450751
driven_lanedir_consec_mean5.95461470924416
driven_lanedir_consec_min5.772831222037569
driven_lanedir_max6.136398196450751
driven_lanedir_mean5.95461470924416
driven_lanedir_median5.95461470924416
driven_lanedir_min5.772831222037569
get_duckie_state_max1.100378171490392e-06
get_duckie_state_mean1.060674827759907e-06
get_duckie_state_median1.060674827759907e-06
get_duckie_state_min1.020971484029422e-06
get_robot_state_max0.0033955566094975784
get_robot_state_mean0.00337604906636412
get_robot_state_median0.00337604906636412
get_robot_state_min0.0033565415232306613
get_state_dump_max0.004209032662206645
get_state_dump_mean0.004205099351201625
get_state_dump_median0.004205099351201625
get_state_dump_min0.004201166040196606
get_ui_image_max0.02840230486772142
get_ui_image_mean0.02814528586763228
get_ui_image_median0.02814528586763228
get_ui_image_min0.02788826686754314
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.243118591084332, "get_ui_image": 0.02788826686754314, "step_physics": 0.056136834829872, "survival_time": 59.99999999999873, "driven_lanedir": 5.772831222037569, "get_state_dump": 0.004201166040196606, "get_robot_state": 0.0033955566094975784, "sim_render-ego0": 0.0034400017235697955, "get_duckie_state": 1.020971484029422e-06, "in-drivable-lane": 0.0, "deviation-heading": 20.123559877200016, "agent_compute-ego0": 0.0059790791917303816, "complete-iteration": 0.10860976033365598, "set_robot_commands": 0.002141714294586054, "distance-from-start": 1.042641437532018, "deviation-center-line": 4.044422547243363, "driven_lanedir_consec": 5.772831222037569, "sim_compute_sim_state": 0.003577066003829613, "sim_compute_performance-ego0": 0.0017825086150538613}, "LF-small-loop-001-ego0": {"driven_any": 6.24838023545054, "get_ui_image": 0.02840230486772142, "step_physics": 0.05654053902447372, "survival_time": 59.99999999999873, "driven_lanedir": 6.136398196450751, "get_state_dump": 0.004209032662206645, "get_robot_state": 0.0033565415232306613, "sim_render-ego0": 0.003397044690820597, "get_duckie_state": 1.100378171490392e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.964586476555104, "agent_compute-ego0": 0.005958444569926774, "complete-iteration": 0.1095246184775474, "set_robot_commands": 0.0021984819369351835, "distance-from-start": 1.5281770130032848, "deviation-center-line": 3.7513642902416624, "driven_lanedir_consec": 6.136398196450751, "sim_compute_sim_state": 0.0036310889540266534, "sim_compute_performance-ego0": 0.0017624469125002843}}
set_robot_commands_max0.0021984819369351835
set_robot_commands_mean0.002170098115760619
set_robot_commands_median0.002170098115760619
set_robot_commands_min0.002141714294586054
sim_compute_performance-ego0_max0.0017825086150538613
sim_compute_performance-ego0_mean0.001772477763777073
sim_compute_performance-ego0_median0.001772477763777073
sim_compute_performance-ego0_min0.0017624469125002843
sim_compute_sim_state_max0.0036310889540266534
sim_compute_sim_state_mean0.003604077478928133
sim_compute_sim_state_median0.003604077478928133
sim_compute_sim_state_min0.003577066003829613
sim_render-ego0_max0.0034400017235697955
sim_render-ego0_mean0.0034185232071951965
sim_render-ego0_median0.0034185232071951965
sim_render-ego0_min0.003397044690820597
simulation-passed1
step_physics_max0.05654053902447372
step_physics_mean0.056338686927172865
step_physics_median0.056338686927172865
step_physics_min0.056136834829872
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7925215969Rayed Wahedexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.513346635937006


other stats
agent_compute-ego0_max0.010919955614450815
agent_compute-ego0_mean0.010919955614450815
agent_compute-ego0_median0.010919955614450815
agent_compute-ego0_min0.010919955614450815
complete-iteration_max0.1810694288563084
complete-iteration_mean0.1810694288563084
complete-iteration_median0.1810694288563084
complete-iteration_min0.1810694288563084
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.513346635937006
distance-from-start_median5.513346635937006
distance-from-start_min5.513346635937006
driven_any_max5.624013239710804
driven_any_mean5.624013239710804
driven_any_median5.624013239710804
driven_any_min5.624013239710804
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05848516580220815
get_duckie_state_mean0.05848516580220815
get_duckie_state_median0.05848516580220815
get_duckie_state_min0.05848516580220815
get_robot_state_max0.0035885379121110244
get_robot_state_mean0.0035885379121110244
get_robot_state_median0.0035885379121110244
get_robot_state_min0.0035885379121110244
get_state_dump_max0.013760265144141944
get_state_dump_mean0.013760265144141944
get_state_dump_median0.013760265144141944
get_state_dump_min0.013760265144141944
get_ui_image_max0.013343212411210344
get_ui_image_mean0.013343212411210344
get_ui_image_median0.013343212411210344
get_ui_image_min0.013343212411210344
in-drivable-lane_max18.450000000000127
in-drivable-lane_mean18.450000000000127
in-drivable-lane_median18.450000000000127
in-drivable-lane_min18.450000000000127
per-episodes
details{"d30-ego0": {"driven_any": 5.624013239710804, "get_ui_image": 0.013343212411210344, "step_physics": 0.06519825329651703, "survival_time": 18.450000000000127, "driven_lanedir": 0.0, "get_state_dump": 0.013760265144141944, "get_robot_state": 0.0035885379121110244, "sim_render-ego0": 0.0034844005430066907, "get_duckie_state": 0.05848516580220815, "in-drivable-lane": 18.450000000000127, "deviation-heading": 0.0, "agent_compute-ego0": 0.010919955614450815, "complete-iteration": 0.1810694288563084, "set_robot_commands": 0.0022238557403152052, "distance-from-start": 5.513346635937006, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008136826592522699, "sim_compute_performance-ego0": 0.0018472362209010769}}
set_robot_commands_max0.0022238557403152052
set_robot_commands_mean0.0022238557403152052
set_robot_commands_median0.0022238557403152052
set_robot_commands_min0.0022238557403152052
sim_compute_performance-ego0_max0.0018472362209010769
sim_compute_performance-ego0_mean0.0018472362209010769
sim_compute_performance-ego0_median0.0018472362209010769
sim_compute_performance-ego0_min0.0018472362209010769
sim_compute_sim_state_max0.008136826592522699
sim_compute_sim_state_mean0.008136826592522699
sim_compute_sim_state_median0.008136826592522699
sim_compute_sim_state_min0.008136826592522699
sim_render-ego0_max0.0034844005430066907
sim_render-ego0_mean0.0034844005430066907
sim_render-ego0_median0.0034844005430066907
sim_render-ego0_min0.0034844005430066907
simulation-passed1
step_physics_max0.06519825329651703
step_physics_mean0.06519825329651703
step_physics_median0.06519825329651703
step_physics_min0.06519825329651703
survival_time_max18.450000000000127
survival_time_mean18.450000000000127
survival_time_median18.450000000000127
survival_time_min18.450000000000127
No reset possible
7924815969Rayed Wahedexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.5097388897223505


other stats
agent_compute-ego0_max0.011124621855246054
agent_compute-ego0_mean0.011124621855246054
agent_compute-ego0_median0.011124621855246054
agent_compute-ego0_min0.011124621855246054
complete-iteration_max0.1858002849527307
complete-iteration_mean0.1858002849527307
complete-iteration_median0.1858002849527307
complete-iteration_min0.1858002849527307
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.5097388897223505
distance-from-start_median5.5097388897223505
distance-from-start_min5.5097388897223505
driven_any_max5.621858641208398
driven_any_mean5.621858641208398
driven_any_median5.621858641208398
driven_any_min5.621858641208398
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05916188665338465
get_duckie_state_mean0.05916188665338465
get_duckie_state_median0.05916188665338465
get_duckie_state_min0.05916188665338465
get_robot_state_max0.003604560929375726
get_robot_state_mean0.003604560929375726
get_robot_state_median0.003604560929375726
get_robot_state_min0.003604560929375726
get_state_dump_max0.013954833391550426
get_state_dump_mean0.013954833391550426
get_state_dump_median0.013954833391550426
get_state_dump_min0.013954833391550426
get_ui_image_max0.01387689629116574
get_ui_image_mean0.01387689629116574
get_ui_image_median0.01387689629116574
get_ui_image_min0.01387689629116574
in-drivable-lane_max18.450000000000127
in-drivable-lane_mean18.450000000000127
in-drivable-lane_median18.450000000000127
in-drivable-lane_min18.450000000000127
per-episodes
details{"d30-ego0": {"driven_any": 5.621858641208398, "get_ui_image": 0.01387689629116574, "step_physics": 0.06805571156579095, "survival_time": 18.450000000000127, "driven_lanedir": 0.0, "get_state_dump": 0.013954833391550426, "get_robot_state": 0.003604560929375726, "sim_render-ego0": 0.0035129218488126187, "get_duckie_state": 0.05916188665338465, "in-drivable-lane": 18.450000000000127, "deviation-heading": 0.0, "agent_compute-ego0": 0.011124621855246054, "complete-iteration": 0.1858002849527307, "set_robot_commands": 0.002193704166927853, "distance-from-start": 5.5097388897223505, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00837261741225784, "sim_compute_performance-ego0": 0.0018591249311292496}}
set_robot_commands_max0.002193704166927853
set_robot_commands_mean0.002193704166927853
set_robot_commands_median0.002193704166927853
set_robot_commands_min0.002193704166927853
sim_compute_performance-ego0_max0.0018591249311292496
sim_compute_performance-ego0_mean0.0018591249311292496
sim_compute_performance-ego0_median0.0018591249311292496
sim_compute_performance-ego0_min0.0018591249311292496
sim_compute_sim_state_max0.00837261741225784
sim_compute_sim_state_mean0.00837261741225784
sim_compute_sim_state_median0.00837261741225784
sim_compute_sim_state_min0.00837261741225784
sim_render-ego0_max0.0035129218488126187
sim_render-ego0_mean0.0035129218488126187
sim_render-ego0_median0.0035129218488126187
sim_render-ego0_min0.0035129218488126187
simulation-passed1
step_physics_max0.06805571156579095
step_physics_mean0.06805571156579095
step_physics_median0.06805571156579095
step_physics_min0.06805571156579095
survival_time_max18.450000000000127
survival_time_mean18.450000000000127
survival_time_median18.450000000000127
survival_time_min18.450000000000127
No reset possible
7924315966Andreas Zieglertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-010:13:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median26.400000000000013
deviation-center-line_median1.3834608844182272
driven_lanedir_consec_median1.5055986991311403
survival_time_median37.1749999999994


other stats
agent_compute-ego0_max0.016183604796727497
agent_compute-ego0_mean0.011242760901083192
agent_compute-ego0_median0.011242760901083192
agent_compute-ego0_min0.006301917005438888
complete-iteration_max0.18274450053771335
complete-iteration_mean0.18100996085840929
complete-iteration_median0.18100996085840929
complete-iteration_min0.1792754211791052
deviation-center-line_max2.7669217688364545
deviation-center-line_mean1.3834608844182272
deviation-center-line_min0.0
deviation-heading_max0.5030249371733163
deviation-heading_mean0.25151246858665816
deviation-heading_median0.25151246858665816
deviation-heading_min0.0
distance-from-start_max8.324190655346857
distance-from-start_mean5.091899613435533
distance-from-start_median5.091899613435533
distance-from-start_min1.8596085715242097
driven_any_max8.324248821862865
driven_any_mean5.092243208005218
driven_any_median5.092243208005218
driven_any_min1.860237594147571
driven_lanedir_consec_max3.011197398262281
driven_lanedir_consec_mean1.5055986991311403
driven_lanedir_consec_min0.0
driven_lanedir_max3.011197398262281
driven_lanedir_mean1.5055986991311403
driven_lanedir_median1.5055986991311403
driven_lanedir_min0.0
get_duckie_state_max1.2472805432931866e-06
get_duckie_state_mean1.2018881101967371e-06
get_duckie_state_median1.2018881101967371e-06
get_duckie_state_min1.1564956771002876e-06
get_robot_state_max0.0034744046709122606
get_robot_state_mean0.003427755629743918
get_robot_state_median0.003427755629743918
get_robot_state_min0.003381106588575575
get_state_dump_max0.004375230660545737
get_state_dump_mean0.004292920094649615
get_state_dump_median0.004292920094649615
get_state_dump_min0.004210609528753493
get_ui_image_max0.0480742065442933
get_ui_image_mean0.04800916194553203
get_ui_image_median0.04800916194553203
get_ui_image_min0.04794411734677076
in-drivable-lane_max38.44999999999995
in-drivable-lane_mean26.400000000000013
in-drivable-lane_min14.350000000000067
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324248821862865, "get_ui_image": 0.04794411734677076, "step_physics": 0.07828835662854502, "survival_time": 59.99999999999873, "driven_lanedir": 3.011197398262281, "get_state_dump": 0.004375230660545737, "get_robot_state": 0.0034744046709122606, "sim_render-ego0": 0.003596189119337401, "get_duckie_state": 1.2472805432931866e-06, "in-drivable-lane": 38.44999999999995, "deviation-heading": 0.5030249371733163, "agent_compute-ego0": 0.006301917005438888, "complete-iteration": 0.1792754211791052, "set_robot_commands": 0.002135135450529913, "distance-from-start": 8.324190655346857, "deviation-center-line": 2.7669217688364545, "driven_lanedir_consec": 3.011197398262281, "sim_compute_sim_state": 0.03124435914743949, "sim_compute_performance-ego0": 0.00184466797148159}, "LF-full-loop-001-ego0": {"driven_any": 1.860237594147571, "get_ui_image": 0.0480742065442933, "step_physics": 0.07667456650071675, "survival_time": 14.350000000000067, "driven_lanedir": 0.0, "get_state_dump": 0.004210609528753493, "get_robot_state": 0.003381106588575575, "sim_render-ego0": 0.0036219333608945217, "get_duckie_state": 1.1564956771002876e-06, "in-drivable-lane": 14.350000000000067, "deviation-heading": 0.0, "agent_compute-ego0": 0.016183604796727497, "complete-iteration": 0.18274450053771335, "set_robot_commands": 0.0020350441336631775, "distance-from-start": 1.8596085715242097, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02668958488437865, "sim_compute_performance-ego0": 0.001804147329595354}}
set_robot_commands_max0.002135135450529913
set_robot_commands_mean0.0020850897920965455
set_robot_commands_median0.0020850897920965455
set_robot_commands_min0.0020350441336631775
sim_compute_performance-ego0_max0.00184466797148159
sim_compute_performance-ego0_mean0.001824407650538472
sim_compute_performance-ego0_median0.001824407650538472
sim_compute_performance-ego0_min0.001804147329595354
sim_compute_sim_state_max0.03124435914743949
sim_compute_sim_state_mean0.028966972015909063
sim_compute_sim_state_median0.028966972015909063
sim_compute_sim_state_min0.02668958488437865
sim_render-ego0_max0.0036219333608945217
sim_render-ego0_mean0.003609061240115961
sim_render-ego0_median0.003609061240115961
sim_render-ego0_min0.003596189119337401
simulation-passed1
step_physics_max0.07828835662854502
step_physics_mean0.07748146156463089
step_physics_median0.07748146156463089
step_physics_min0.07667456650071675
survival_time_max59.99999999999873
survival_time_mean37.1749999999994
survival_time_min14.350000000000067
No reset possible
7924215965Dimitrios Dimopoulosobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-010:06:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 156 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7924015963Manuel HerediaRun 1: Nice graphmooc-modconsimsuccessnogpu-production-spot-0-010:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median24.299999999999976
deviation-center-line_median0.9622738115797904
driven_lanedir_consec_median1.0879638782979804
survival_time_median34.34999999999998


other stats
agent_compute-ego0_max0.01609967731294178
agent_compute-ego0_mean0.011043265584559642
agent_compute-ego0_median0.011043265584559642
agent_compute-ego0_min0.005986853856177503
complete-iteration_max0.1808773626599993
complete-iteration_mean0.17700176002316093
complete-iteration_median0.17700176002316093
complete-iteration_min0.17312615738632256
deviation-center-line_max1.285528333388278
deviation-center-line_mean0.9622738115797904
deviation-center-line_min0.639019289771303
deviation-heading_max8.41759400138446
deviation-heading_mean6.835503397255438
deviation-heading_median6.835503397255438
deviation-heading_min5.253412793126418
distance-from-start_max5.19772209374736
distance-from-start_mean4.089226642435959
distance-from-start_median4.089226642435959
distance-from-start_min2.9807311911245584
driven_any_max5.780552123807357
driven_any_mean4.648477404729417
driven_any_median4.648477404729417
driven_any_min3.5164026856514767
driven_lanedir_consec_max1.5146167367424164
driven_lanedir_consec_mean1.0879638782979804
driven_lanedir_consec_min0.6613110198535441
driven_lanedir_max1.5146167367424164
driven_lanedir_mean1.0879638782979804
driven_lanedir_median1.0879638782979804
driven_lanedir_min0.6613110198535441
get_duckie_state_max1.117161342075893e-06
get_duckie_state_mean1.104477969956154e-06
get_duckie_state_median1.104477969956154e-06
get_duckie_state_min1.0917945978364148e-06
get_robot_state_max0.0033750478025048655
get_robot_state_mean0.003356624253948443
get_robot_state_median0.003356624253948443
get_robot_state_min0.00333820070539202
get_state_dump_max0.004111281573142064
get_state_dump_mean0.004109951312737675
get_state_dump_median0.004109951312737675
get_state_dump_min0.004108621052333287
get_ui_image_max0.04781233662023668
get_ui_image_mean0.04726114982336878
get_ui_image_median0.04726114982336878
get_ui_image_min0.046709963026500885
in-drivable-lane_max29.099999999999778
in-drivable-lane_mean24.299999999999976
in-drivable-lane_min19.50000000000018
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.780552123807357, "get_ui_image": 0.04781233662023668, "step_physics": 0.07335571200531042, "survival_time": 42.49999999999972, "driven_lanedir": 1.5146167367424164, "get_state_dump": 0.004111281573142064, "get_robot_state": 0.0033750478025048655, "sim_render-ego0": 0.003509064258615783, "get_duckie_state": 1.0917945978364148e-06, "in-drivable-lane": 29.099999999999778, "deviation-heading": 8.41759400138446, "agent_compute-ego0": 0.005986853856177503, "complete-iteration": 0.17312615738632256, "set_robot_commands": 0.002057108279540872, "distance-from-start": 5.19772209374736, "deviation-center-line": 1.285528333388278, "driven_lanedir_consec": 1.5146167367424164, "sim_compute_sim_state": 0.03106212924145924, "sim_compute_performance-ego0": 0.0017886657692430725}, "LF-full-loop-001-ego0": {"driven_any": 3.5164026856514767, "get_ui_image": 0.046709963026500885, "step_physics": 0.07273149762834821, "survival_time": 26.200000000000237, "driven_lanedir": 0.6613110198535441, "get_state_dump": 0.004108621052333287, "get_robot_state": 0.00333820070539202, "sim_render-ego0": 0.003490844454084124, "get_duckie_state": 1.117161342075893e-06, "in-drivable-lane": 19.50000000000018, "deviation-heading": 5.253412793126418, "agent_compute-ego0": 0.01609967731294178, "complete-iteration": 0.1808773626599993, "set_robot_commands": 0.002024854024251302, "distance-from-start": 2.9807311911245584, "deviation-center-line": 0.639019289771303, "driven_lanedir_consec": 0.6613110198535441, "sim_compute_sim_state": 0.030532716115315755, "sim_compute_performance-ego0": 0.0017740567525227865}}
set_robot_commands_max0.002057108279540872
set_robot_commands_mean0.0020409811518960867
set_robot_commands_median0.0020409811518960867
set_robot_commands_min0.002024854024251302
sim_compute_performance-ego0_max0.0017886657692430725
sim_compute_performance-ego0_mean0.0017813612608829294
sim_compute_performance-ego0_median0.0017813612608829294
sim_compute_performance-ego0_min0.0017740567525227865
sim_compute_sim_state_max0.03106212924145924
sim_compute_sim_state_mean0.030797422678387497
sim_compute_sim_state_median0.030797422678387497
sim_compute_sim_state_min0.030532716115315755
sim_render-ego0_max0.003509064258615783
sim_render-ego0_mean0.0034999543563499535
sim_render-ego0_median0.0034999543563499535
sim_render-ego0_min0.003490844454084124
simulation-passed1
step_physics_max0.07335571200531042
step_physics_mean0.07304360481682931
step_physics_median0.07304360481682931
step_physics_min0.07273149762834821
survival_time_max42.49999999999972
survival_time_mean34.34999999999998
survival_time_min26.200000000000237
No reset possible
7923115957Alessandro Zanardi 🇨🇭minimal-agent-fullaido-LFVI_multi_full-sim-validationsim-2of4successyesgpu-production-spot-0-010:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7920915955Alessandro Zanardi 🇨🇭minimal-agent-fullaido-LFVI_multi_full-sim-validationsim-0of4successyesgpu-production-spot-0-010:28:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.690951394717371
deviation-center-line_median0.16994010715202887


other stats
agent_compute-ego0_max0.04362810759818326
agent_compute-ego0_mean0.04362810759818326
agent_compute-ego0_median0.04362810759818326
agent_compute-ego0_min0.04362810759818326
agent_compute-ego1_max0.04285376137440449
agent_compute-ego1_mean0.04285376137440449
agent_compute-ego1_median0.04285376137440449
agent_compute-ego1_min0.04285376137440449
agent_compute-ego2_max0.04299043556931215
agent_compute-ego2_mean0.04299043556931215
agent_compute-ego2_median0.04299043556931215
agent_compute-ego2_min0.04299043556931215
agent_compute-ego3_max0.04189167908089643
agent_compute-ego3_mean0.04189167908089643
agent_compute-ego3_median0.04189167908089643
agent_compute-ego3_min0.04189167908089643
complete-iteration_max0.4830533705782037
complete-iteration_mean0.4830533705782037
complete-iteration_median0.4830533705782037
complete-iteration_min0.4830533705782037
deviation-center-line_max0.20036533664529055
deviation-center-line_mean0.16224919594063122
deviation-center-line_min0.1087512328131766
deviation-heading_max1.7744896314828416
deviation-heading_mean1.448956789083492
deviation-heading_median1.5774140389628593
deviation-heading_min0.8665094469254077
distance-from-start_max3.144555501114038
distance-from-start_mean2.5897591023388613
distance-from-start_median2.588170096659101
distance-from-start_min2.038140714923206
driven_any_max6.1174549878164965
driven_any_mean5.6814692755823835
driven_any_median5.846751817786442
driven_any_min4.914918478940152
driven_lanedir_consec_max6.115054874064871
driven_lanedir_consec_mean5.472047938725504
driven_lanedir_consec_min4.391234091402401
driven_lanedir_max6.115055250533706
driven_lanedir_mean5.675822646882174
driven_lanedir_median5.839583743049825
driven_lanedir_min4.909067850895337
get_duckie_state_max1.4434150613217826e-06
get_duckie_state_mean1.4434150613217826e-06
get_duckie_state_median1.4434150613217826e-06
get_duckie_state_min1.4434150613217826e-06
get_robot_state_max0.014640882350721526
get_robot_state_mean0.014640882350721526
get_robot_state_median0.014640882350721526
get_robot_state_min0.014640882350721526
get_state_dump_max0.009639778899511233
get_state_dump_mean0.009639778899511233
get_state_dump_median0.009639778899511233
get_state_dump_min0.009639778899511233
get_ui_image_max0.03063440878722789
get_ui_image_mean0.03063440878722789
get_ui_image_median0.03063440878722789
get_ui_image_min0.03063440878722789
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-4way-000-ego0": {"driven_any": 5.968348344520469, "get_ui_image": 0.03063440878722789, "step_physics": 0.188496974584562, "survival_time": 59.99999999999873, "driven_lanedir": 5.9604787002547415, "get_state_dump": 0.009639778899511233, "get_robot_state": 0.014640882350721526, "sim_render-ego0": 0.003784554288548097, "sim_render-ego1": 0.003769086461380856, "sim_render-ego2": 0.0037589537710273993, "sim_render-ego3": 0.003772293697487405, "get_duckie_state": 1.4434150613217826e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.4608239041890445, "agent_compute-ego0": 0.04362810759818326, "agent_compute-ego1": 0.04285376137440449, "agent_compute-ego2": 0.04299043556931215, "agent_compute-ego3": 0.04189167908089643, "complete-iteration": 0.4830533705782037, "set_robot_commands": 0.0024144381508045053, "distance-from-start": 3.1334794649630213, "deviation-center-line": 0.14309878507607315, "driven_lanedir_consec": 5.663214025237355, "sim_compute_sim_state": 0.0347735456979642, "sim_compute_performance-ego0": 0.0021083682502536947, "sim_compute_performance-ego1": 0.0021759951541465484, "sim_compute_performance-ego2": 0.0021829003596881545, "sim_compute_performance-ego3": 0.0021267137757745216}, "LFVI_multi-full-4way-000-ego1": {"driven_any": 5.725155291052416, "get_ui_image": 0.03063440878722789, "step_physics": 0.188496974584562, "survival_time": 59.99999999999873, "driven_lanedir": 5.718688785844909, "get_state_dump": 0.009639778899511233, "get_robot_state": 0.014640882350721526, "sim_render-ego0": 0.003784554288548097, "sim_render-ego1": 0.003769086461380856, "sim_render-ego2": 0.0037589537710273993, "sim_render-ego3": 0.003772293697487405, "get_duckie_state": 1.4434150613217826e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.7744896314828416, "agent_compute-ego0": 0.04362810759818326, "agent_compute-ego1": 0.04285376137440449, "agent_compute-ego2": 0.04299043556931215, "agent_compute-ego3": 0.04189167908089643, "complete-iteration": 0.4830533705782037, "set_robot_commands": 0.0024144381508045053, "distance-from-start": 2.0428607283551803, "deviation-center-line": 0.20036533664529055, "driven_lanedir_consec": 5.7186887641973865, "sim_compute_sim_state": 0.0347735456979642, "sim_compute_performance-ego0": 0.0021083682502536947, "sim_compute_performance-ego1": 0.0021759951541465484, "sim_compute_performance-ego2": 0.0021829003596881545, "sim_compute_performance-ego3": 0.0021267137757745216}, "LFVI_multi-full-4way-000-ego2": {"driven_any": 6.1174549878164965, "get_ui_image": 0.03063440878722789, "step_physics": 0.188496974584562, "survival_time": 59.99999999999873, "driven_lanedir": 6.115055250533706, "get_state_dump": 0.009639778899511233, "get_robot_state": 0.014640882350721526, "sim_render-ego0": 0.003784554288548097, "sim_render-ego1": 0.003769086461380856, "sim_render-ego2": 0.0037589537710273993, "sim_render-ego3": 0.003772293697487405, "get_duckie_state": 1.4434150613217826e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.8665094469254077, "agent_compute-ego0": 0.04362810759818326, "agent_compute-ego1": 0.04285376137440449, "agent_compute-ego2": 0.04299043556931215, "agent_compute-ego3": 0.04189167908089643, "complete-iteration": 0.4830533705782037, "set_robot_commands": 0.0024144381508045053, "distance-from-start": 3.144555501114038, "deviation-center-line": 0.1087512328131766, "driven_lanedir_consec": 6.115054874064871, "sim_compute_sim_state": 0.0347735456979642, "sim_compute_performance-ego0": 0.0021083682502536947, "sim_compute_performance-ego1": 0.0021759951541465484, "sim_compute_performance-ego2": 0.0021829003596881545, "sim_compute_performance-ego3": 0.0021267137757745216}, "LFVI_multi-full-4way-000-ego3": {"driven_any": 4.914918478940152, "get_ui_image": 0.03063440878722789, "step_physics": 0.188496974584562, "survival_time": 59.99999999999873, "driven_lanedir": 4.909067850895337, "get_state_dump": 0.009639778899511233, "get_robot_state": 0.014640882350721526, "sim_render-ego0": 0.003784554288548097, "sim_render-ego1": 0.003769086461380856, "sim_render-ego2": 0.0037589537710273993, "sim_render-ego3": 0.003772293697487405, "get_duckie_state": 1.4434150613217826e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6940041737366742, "agent_compute-ego0": 0.04362810759818326, "agent_compute-ego1": 0.04285376137440449, "agent_compute-ego2": 0.04299043556931215, "agent_compute-ego3": 0.04189167908089643, "complete-iteration": 0.4830533705782037, "set_robot_commands": 0.0024144381508045053, "distance-from-start": 2.038140714923206, "deviation-center-line": 0.19678142922798456, "driven_lanedir_consec": 4.391234091402401, "sim_compute_sim_state": 0.0347735456979642, "sim_compute_performance-ego0": 0.0021083682502536947, "sim_compute_performance-ego1": 0.0021759951541465484, "sim_compute_performance-ego2": 0.0021829003596881545, "sim_compute_performance-ego3": 0.0021267137757745216}}
set_robot_commands_max0.0024144381508045053
set_robot_commands_mean0.0024144381508045053
set_robot_commands_median0.0024144381508045053
set_robot_commands_min0.0024144381508045053
sim_compute_performance-ego0_max0.0021083682502536947
sim_compute_performance-ego0_mean0.0021083682502536947
sim_compute_performance-ego0_median0.0021083682502536947
sim_compute_performance-ego0_min0.0021083682502536947
sim_compute_performance-ego1_max0.0021759951541465484
sim_compute_performance-ego1_mean0.0021759951541465484
sim_compute_performance-ego1_median0.0021759951541465484
sim_compute_performance-ego1_min0.0021759951541465484
sim_compute_performance-ego2_max0.0021829003596881545
sim_compute_performance-ego2_mean0.0021829003596881545
sim_compute_performance-ego2_median0.0021829003596881545
sim_compute_performance-ego2_min0.0021829003596881545
sim_compute_performance-ego3_max0.0021267137757745216
sim_compute_performance-ego3_mean0.0021267137757745216
sim_compute_performance-ego3_median0.0021267137757745216
sim_compute_performance-ego3_min0.0021267137757745216
sim_compute_sim_state_max0.0347735456979642
sim_compute_sim_state_mean0.0347735456979642
sim_compute_sim_state_median0.0347735456979642
sim_compute_sim_state_min0.0347735456979642
sim_render-ego0_max0.003784554288548097
sim_render-ego0_mean0.003784554288548097
sim_render-ego0_median0.003784554288548097
sim_render-ego0_min0.003784554288548097
sim_render-ego1_max0.003769086461380856
sim_render-ego1_mean0.003769086461380856
sim_render-ego1_median0.003769086461380856
sim_render-ego1_min0.003769086461380856
sim_render-ego2_max0.0037589537710273993
sim_render-ego2_mean0.0037589537710273993
sim_render-ego2_median0.0037589537710273993
sim_render-ego2_min0.0037589537710273993
sim_render-ego3_max0.003772293697487405
sim_render-ego3_mean0.003772293697487405
sim_render-ego3_median0.003772293697487405
sim_render-ego3_min0.003772293697487405
simulation-passed1
step_physics_max0.188496974584562
step_physics_mean0.188496974584562
step_physics_median0.188496974584562
step_physics_min0.188496974584562
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7920615953Shubhra Aichexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-010:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.2929006970202694


other stats
agent_compute-ego0_max0.010969905074004534
agent_compute-ego0_mean0.010969905074004534
agent_compute-ego0_median0.010969905074004534
agent_compute-ego0_min0.010969905074004534
complete-iteration_max0.209640785645882
complete-iteration_mean0.209640785645882
complete-iteration_median0.209640785645882
complete-iteration_min0.209640785645882
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.2929006970202694
distance-from-start_median3.2929006970202694
distance-from-start_min3.2929006970202694
driven_any_max3.4263773052775495
driven_any_mean3.4263773052775495
driven_any_median3.4263773052775495
driven_any_min3.4263773052775495
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0790659687862322
get_duckie_state_mean0.0790659687862322
get_duckie_state_median0.0790659687862322
get_duckie_state_min0.0790659687862322
get_robot_state_max0.003715950923207205
get_robot_state_mean0.003715950923207205
get_robot_state_median0.003715950923207205
get_robot_state_min0.003715950923207205
get_state_dump_max0.017145607953869414
get_state_dump_mean0.017145607953869414
get_state_dump_median0.017145607953869414
get_state_dump_min0.017145607953869414
get_ui_image_max0.014301622424144223
get_ui_image_mean0.014301622424144223
get_ui_image_median0.014301622424144223
get_ui_image_min0.014301622424144223
in-drivable-lane_max51.34999999999922
in-drivable-lane_mean51.34999999999922
in-drivable-lane_median51.34999999999922
in-drivable-lane_min51.34999999999922
per-episodes
details{"d40-ego0": {"driven_any": 3.4263773052775495, "get_ui_image": 0.014301622424144223, "step_physics": 0.06768960270900207, "survival_time": 51.34999999999922, "driven_lanedir": 0.0, "get_state_dump": 0.017145607953869414, "get_robot_state": 0.003715950923207205, "sim_render-ego0": 0.0035722506185449977, "get_duckie_state": 0.0790659687862322, "in-drivable-lane": 51.34999999999922, "deviation-heading": 0.0, "agent_compute-ego0": 0.010969905074004534, "complete-iteration": 0.209640785645882, "set_robot_commands": 0.002256628836175347, "distance-from-start": 3.2929006970202694, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00894394482156182, "sim_compute_performance-ego0": 0.0018853918587651232}}
set_robot_commands_max0.002256628836175347
set_robot_commands_mean0.002256628836175347
set_robot_commands_median0.002256628836175347
set_robot_commands_min0.002256628836175347
sim_compute_performance-ego0_max0.0018853918587651232
sim_compute_performance-ego0_mean0.0018853918587651232
sim_compute_performance-ego0_median0.0018853918587651232
sim_compute_performance-ego0_min0.0018853918587651232
sim_compute_sim_state_max0.00894394482156182
sim_compute_sim_state_mean0.00894394482156182
sim_compute_sim_state_median0.00894394482156182
sim_compute_sim_state_min0.00894394482156182
sim_render-ego0_max0.0035722506185449977
sim_render-ego0_mean0.0035722506185449977
sim_render-ego0_median0.0035722506185449977
sim_render-ego0_min0.0035722506185449977
simulation-passed1
step_physics_max0.06768960270900207
step_physics_mean0.06768960270900207
step_physics_median0.06768960270900207
step_physics_min0.06768960270900207
survival_time_max51.34999999999922
survival_time_mean51.34999999999922
survival_time_median51.34999999999922
survival_time_min51.34999999999922
No reset possible
7910715921Tanmay Samakexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.090101410258223


other stats
agent_compute-ego0_max0.011027457412688362
agent_compute-ego0_mean0.011027457412688362
agent_compute-ego0_median0.011027457412688362
agent_compute-ego0_min0.011027457412688362
complete-iteration_max0.2360463159547435
complete-iteration_mean0.2360463159547435
complete-iteration_median0.2360463159547435
complete-iteration_min0.2360463159547435
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.090101410258223
distance-from-start_median6.090101410258223
distance-from-start_min6.090101410258223
driven_any_max6.856478615152682
driven_any_mean6.856478615152682
driven_any_median6.856478615152682
driven_any_min6.856478615152682
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09989625282914888
get_duckie_state_mean0.09989625282914888
get_duckie_state_median0.09989625282914888
get_duckie_state_min0.09989625282914888
get_robot_state_max0.003708001153442132
get_robot_state_mean0.003708001153442132
get_robot_state_median0.003708001153442132
get_robot_state_min0.003708001153442132
get_state_dump_max0.020377655313536903
get_state_dump_mean0.020377655313536903
get_state_dump_median0.020377655313536903
get_state_dump_min0.020377655313536903
get_ui_image_max0.0148220099011036
get_ui_image_mean0.0148220099011036
get_ui_image_median0.0148220099011036
get_ui_image_min0.0148220099011036
in-drivable-lane_max48.599999999999376
in-drivable-lane_mean48.599999999999376
in-drivable-lane_median48.599999999999376
in-drivable-lane_min48.599999999999376
per-episodes
details{"d50-ego0": {"driven_any": 6.856478615152682, "get_ui_image": 0.0148220099011036, "step_physics": 0.06999249644539217, "survival_time": 48.599999999999376, "driven_lanedir": 0.0, "get_state_dump": 0.020377655313536903, "get_robot_state": 0.003708001153442132, "sim_render-ego0": 0.0035541518251550404, "get_duckie_state": 0.09989625282914888, "in-drivable-lane": 48.599999999999376, "deviation-heading": 0.0, "agent_compute-ego0": 0.011027457412688362, "complete-iteration": 0.2360463159547435, "set_robot_commands": 0.0022215277170963424, "distance-from-start": 6.090101410258223, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008470178753106959, "sim_compute_performance-ego0": 0.0018841514607005104}}
set_robot_commands_max0.0022215277170963424
set_robot_commands_mean0.0022215277170963424
set_robot_commands_median0.0022215277170963424
set_robot_commands_min0.0022215277170963424
sim_compute_performance-ego0_max0.0018841514607005104
sim_compute_performance-ego0_mean0.0018841514607005104
sim_compute_performance-ego0_median0.0018841514607005104
sim_compute_performance-ego0_min0.0018841514607005104
sim_compute_sim_state_max0.008470178753106959
sim_compute_sim_state_mean0.008470178753106959
sim_compute_sim_state_median0.008470178753106959
sim_compute_sim_state_min0.008470178753106959
sim_render-ego0_max0.0035541518251550404
sim_render-ego0_mean0.0035541518251550404
sim_render-ego0_median0.0035541518251550404
sim_render-ego0_min0.0035541518251550404
simulation-passed1
step_physics_max0.06999249644539217
step_physics_mean0.06999249644539217
step_physics_median0.06999249644539217
step_physics_min0.06999249644539217
survival_time_max48.599999999999376
survival_time_mean48.599999999999376
survival_time_median48.599999999999376
survival_time_min48.599999999999376
No reset possible
7909815919Christian Wagnerexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.01800000000031


other stats
agent_compute-ego0_max0.011347428563075143
agent_compute-ego0_mean0.011347428563075143
agent_compute-ego0_median0.011347428563075143
agent_compute-ego0_min0.011347428563075143
complete-iteration_max0.18807787647202223
complete-iteration_mean0.18807787647202223
complete-iteration_median0.18807787647202223
complete-iteration_min0.18807787647202223
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.01800000000031
distance-from-start_median6.01800000000031
distance-from-start_min6.01800000000031
driven_any_max6.018000000000353
driven_any_mean6.018000000000353
driven_any_median6.018000000000353
driven_any_min6.018000000000353
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05990168276126221
get_duckie_state_mean0.05990168276126221
get_duckie_state_median0.05990168276126221
get_duckie_state_min0.05990168276126221
get_robot_state_max0.0037026241879654833
get_robot_state_mean0.0037026241879654833
get_robot_state_median0.0037026241879654833
get_robot_state_min0.0037026241879654833
get_state_dump_max0.01414288922122748
get_state_dump_mean0.01414288922122748
get_state_dump_median0.01414288922122748
get_state_dump_min0.01414288922122748
get_ui_image_max0.01398319386421366
get_ui_image_mean0.01398319386421366
get_ui_image_median0.01398319386421366
get_ui_image_min0.01398319386421366
in-drivable-lane_max21.100000000000165
in-drivable-lane_mean21.100000000000165
in-drivable-lane_median21.100000000000165
in-drivable-lane_min21.100000000000165
per-episodes
details{"d30-ego0": {"driven_any": 6.018000000000353, "get_ui_image": 0.01398319386421366, "step_physics": 0.06931834694341565, "survival_time": 21.100000000000165, "driven_lanedir": 0.0, "get_state_dump": 0.01414288922122748, "get_robot_state": 0.0037026241879654833, "sim_render-ego0": 0.0035417880290507142, "get_duckie_state": 0.05990168276126221, "in-drivable-lane": 21.100000000000165, "deviation-heading": 0.0, "agent_compute-ego0": 0.011347428563075143, "complete-iteration": 0.18807787647202223, "set_robot_commands": 0.002230073825123744, "distance-from-start": 6.01800000000031, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007945515021646558, "sim_compute_performance-ego0": 0.001879039949277332}}
set_robot_commands_max0.002230073825123744
set_robot_commands_mean0.002230073825123744
set_robot_commands_median0.002230073825123744
set_robot_commands_min0.002230073825123744
sim_compute_performance-ego0_max0.001879039949277332
sim_compute_performance-ego0_mean0.001879039949277332
sim_compute_performance-ego0_median0.001879039949277332
sim_compute_performance-ego0_min0.001879039949277332
sim_compute_sim_state_max0.007945515021646558
sim_compute_sim_state_mean0.007945515021646558
sim_compute_sim_state_median0.007945515021646558
sim_compute_sim_state_min0.007945515021646558
sim_render-ego0_max0.0035417880290507142
sim_render-ego0_mean0.0035417880290507142
sim_render-ego0_median0.0035417880290507142
sim_render-ego0_min0.0035417880290507142
simulation-passed1
step_physics_max0.06931834694341565
step_physics_mean0.06931834694341565
step_physics_median0.06931834694341565
step_physics_min0.06931834694341565
survival_time_max21.100000000000165
survival_time_mean21.100000000000165
survival_time_median21.100000000000165
survival_time_min21.100000000000165
No reset possible
7899515893Shengjie Hu 🇨🇭All truemooc-collision-check-valistep1successnogpu-production-spot-0-010:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples400
No reset possible
7896415876b mcgexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-010:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.925585324450497


other stats
agent_compute-ego0_max0.011197192980586045
agent_compute-ego0_mean0.011197192980586045
agent_compute-ego0_median0.011197192980586045
agent_compute-ego0_min0.011197192980586045
complete-iteration_max0.23421245470928412
complete-iteration_mean0.23421245470928412
complete-iteration_median0.23421245470928412
complete-iteration_min0.23421245470928412
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.925585324450497
distance-from-start_median3.925585324450497
distance-from-start_min3.925585324450497
driven_any_max3.9627395241985486
driven_any_mean3.9627395241985486
driven_any_median3.9627395241985486
driven_any_min3.9627395241985486
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.10112433886150832
get_duckie_state_mean0.10112433886150832
get_duckie_state_median0.10112433886150832
get_duckie_state_min0.10112433886150832
get_robot_state_max0.003714884052070154
get_robot_state_mean0.003714884052070154
get_robot_state_median0.003714884052070154
get_robot_state_min0.003714884052070154
get_state_dump_max0.02015582508687473
get_state_dump_mean0.02015582508687473
get_state_dump_median0.02015582508687473
get_state_dump_min0.02015582508687473
get_ui_image_max0.015034595000356758
get_ui_image_mean0.015034595000356758
get_ui_image_median0.015034595000356758
get_ui_image_min0.015034595000356758
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 3.9627395241985486, "get_ui_image": 0.015034595000356758, "step_physics": 0.06649069921063146, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.02015582508687473, "get_robot_state": 0.003714884052070154, "sim_render-ego0": 0.0035485266448059844, "get_duckie_state": 0.10112433886150832, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.011197192980586045, "complete-iteration": 0.23421245470928412, "set_robot_commands": 0.0022563721913282917, "distance-from-start": 3.925585324450497, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008717941106308708, "sim_compute_performance-ego0": 0.0018871116399963531}}
set_robot_commands_max0.0022563721913282917
set_robot_commands_mean0.0022563721913282917
set_robot_commands_median0.0022563721913282917
set_robot_commands_min0.0022563721913282917
sim_compute_performance-ego0_max0.0018871116399963531
sim_compute_performance-ego0_mean0.0018871116399963531
sim_compute_performance-ego0_median0.0018871116399963531
sim_compute_performance-ego0_min0.0018871116399963531
sim_compute_sim_state_max0.008717941106308708
sim_compute_sim_state_mean0.008717941106308708
sim_compute_sim_state_median0.008717941106308708
sim_compute_sim_state_min0.008717941106308708
sim_render-ego0_max0.0035485266448059844
sim_render-ego0_mean0.0035485266448059844
sim_render-ego0_median0.0035485266448059844
sim_render-ego0_min0.0035485266448059844
simulation-passed1
step_physics_max0.06649069921063146
step_physics_mean0.06649069921063146
step_physics_median0.06649069921063146
step_physics_min0.06649069921063146
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7892215868Bea Baselines 🐤dummy_collision_checkermooc-collision-check-valistep1abortednogpu-production-spot-0-010:00:38
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7887615864Bea Baselines 🐤dummy_collision_checkermooc-collision-check-teststep1errornogpu-production-spot-0-010:00:24
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 124, in planning_checker_main
    _.set_evaluation_dir('results', d_results)
AttributeError: 'str' object has no attribute 'set_evaluation_dir'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
performance0.5
No reset possible
7878115854Juan Ramirezexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-010:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.0388838193403127


other stats
agent_compute-ego0_max0.010164687662948795
agent_compute-ego0_mean0.010164687662948795
agent_compute-ego0_median0.010164687662948795
agent_compute-ego0_min0.010164687662948795
complete-iteration_max0.2653905992154722
complete-iteration_mean0.2653905992154722
complete-iteration_median0.2653905992154722
complete-iteration_min0.2653905992154722
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.0388838193403127
distance-from-start_median1.0388838193403127
distance-from-start_min1.0388838193403127
driven_any_max1.1584529321627417
driven_any_mean1.1584529321627417
driven_any_median1.1584529321627417
driven_any_min1.1584529321627417
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11892321963369112
get_duckie_state_mean0.11892321963369112
get_duckie_state_median0.11892321963369112
get_duckie_state_min0.11892321963369112
get_robot_state_max0.003786296020319433
get_robot_state_mean0.003786296020319433
get_robot_state_median0.003786296020319433
get_robot_state_min0.003786296020319433
get_state_dump_max0.02375268347469377
get_state_dump_mean0.02375268347469377
get_state_dump_median0.02375268347469377
get_state_dump_min0.02375268347469377
get_ui_image_max0.015830372586662388
get_ui_image_mean0.015830372586662388
get_ui_image_median0.015830372586662388
get_ui_image_min0.015830372586662388
in-drivable-lane_max3.999999999999994
in-drivable-lane_mean3.999999999999994
in-drivable-lane_median3.999999999999994
in-drivable-lane_min3.999999999999994
per-episodes
details{"d60-ego0": {"driven_any": 1.1584529321627417, "get_ui_image": 0.015830372586662388, "step_physics": 0.07548143245555737, "survival_time": 3.999999999999994, "driven_lanedir": 0.0, "get_state_dump": 0.02375268347469377, "get_robot_state": 0.003786296020319433, "sim_render-ego0": 0.0036972128314736448, "get_duckie_state": 0.11892321963369112, "in-drivable-lane": 3.999999999999994, "deviation-heading": 0.0, "agent_compute-ego0": 0.010164687662948795, "complete-iteration": 0.2653905992154722, "set_robot_commands": 0.00215423548663104, "distance-from-start": 1.0388838193403127, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009514935222672828, "sim_compute_performance-ego0": 0.002000446672792788}}
set_robot_commands_max0.00215423548663104
set_robot_commands_mean0.00215423548663104
set_robot_commands_median0.00215423548663104
set_robot_commands_min0.00215423548663104
sim_compute_performance-ego0_max0.002000446672792788
sim_compute_performance-ego0_mean0.002000446672792788
sim_compute_performance-ego0_median0.002000446672792788
sim_compute_performance-ego0_min0.002000446672792788
sim_compute_sim_state_max0.009514935222672828
sim_compute_sim_state_mean0.009514935222672828
sim_compute_sim_state_median0.009514935222672828
sim_compute_sim_state_min0.009514935222672828
sim_render-ego0_max0.0036972128314736448
sim_render-ego0_mean0.0036972128314736448
sim_render-ego0_median0.0036972128314736448
sim_render-ego0_min0.0036972128314736448
simulation-passed1
step_physics_max0.07548143245555737
step_physics_mean0.07548143245555737
step_physics_median0.07548143245555737
step_physics_min0.07548143245555737
survival_time_max3.999999999999994
survival_time_mean3.999999999999994
survival_time_median3.999999999999994
survival_time_min3.999999999999994
No reset possible
7877915854Juan Ramirezexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-010:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.052402786063526


other stats
agent_compute-ego0_max0.01080586992461106
agent_compute-ego0_mean0.01080586992461106
agent_compute-ego0_median0.01080586992461106
agent_compute-ego0_min0.01080586992461106
complete-iteration_max0.25957054653386963
complete-iteration_mean0.25957054653386963
complete-iteration_median0.25957054653386963
complete-iteration_min0.25957054653386963
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.052402786063526
distance-from-start_median1.052402786063526
distance-from-start_min1.052402786063526
driven_any_max1.194835638826309
driven_any_mean1.194835638826309
driven_any_median1.194835638826309
driven_any_min1.194835638826309
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11685572273429784
get_duckie_state_mean0.11685572273429784
get_duckie_state_median0.11685572273429784
get_duckie_state_min0.11685572273429784
get_robot_state_max0.003661410561923323
get_robot_state_mean0.003661410561923323
get_robot_state_median0.003661410561923323
get_robot_state_min0.003661410561923323
get_state_dump_max0.023248814988410336
get_state_dump_mean0.023248814988410336
get_state_dump_median0.023248814988410336
get_state_dump_min0.023248814988410336
get_ui_image_max0.015541153392572511
get_ui_image_mean0.015541153392572511
get_ui_image_median0.015541153392572511
get_ui_image_min0.015541153392572511
in-drivable-lane_max4.299999999999993
in-drivable-lane_mean4.299999999999993
in-drivable-lane_median4.299999999999993
in-drivable-lane_min4.299999999999993
per-episodes
details{"d60-ego0": {"driven_any": 1.194835638826309, "get_ui_image": 0.015541153392572511, "step_physics": 0.07235401252220416, "survival_time": 4.299999999999993, "driven_lanedir": 0.0, "get_state_dump": 0.023248814988410336, "get_robot_state": 0.003661410561923323, "sim_render-ego0": 0.0035942587359198207, "get_duckie_state": 0.11685572273429784, "in-drivable-lane": 4.299999999999993, "deviation-heading": 0.0, "agent_compute-ego0": 0.01080586992461106, "complete-iteration": 0.25957054653386963, "set_robot_commands": 0.0021374746300708287, "distance-from-start": 1.052402786063526, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009409148117591595, "sim_compute_performance-ego0": 0.0018861924094715336}}
set_robot_commands_max0.0021374746300708287
set_robot_commands_mean0.0021374746300708287
set_robot_commands_median0.0021374746300708287
set_robot_commands_min0.0021374746300708287
sim_compute_performance-ego0_max0.0018861924094715336
sim_compute_performance-ego0_mean0.0018861924094715336
sim_compute_performance-ego0_median0.0018861924094715336
sim_compute_performance-ego0_min0.0018861924094715336
sim_compute_sim_state_max0.009409148117591595
sim_compute_sim_state_mean0.009409148117591595
sim_compute_sim_state_median0.009409148117591595
sim_compute_sim_state_min0.009409148117591595
sim_render-ego0_max0.0035942587359198207
sim_render-ego0_mean0.0035942587359198207
sim_render-ego0_median0.0035942587359198207
sim_render-ego0_min0.0035942587359198207
simulation-passed1
step_physics_max0.07235401252220416
step_physics_mean0.07235401252220416
step_physics_median0.07235401252220416
step_physics_min0.07235401252220416
survival_time_max4.299999999999993
survival_time_mean4.299999999999993
survival_time_median4.299999999999993
survival_time_min4.299999999999993
No reset possible
7875615851Juan Ramirezexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-010:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.3113162964880775


other stats
agent_compute-ego0_max0.011160119720127272
agent_compute-ego0_mean0.011160119720127272
agent_compute-ego0_median0.011160119720127272
agent_compute-ego0_min0.011160119720127272
complete-iteration_max0.18591751223025116
complete-iteration_mean0.18591751223025116
complete-iteration_median0.18591751223025116
complete-iteration_min0.18591751223025116
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.3113162964880775
distance-from-start_median0.3113162964880775
distance-from-start_min0.3113162964880775
driven_any_max0.4527875897847037
driven_any_mean0.4527875897847037
driven_any_median0.4527875897847037
driven_any_min0.4527875897847037
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05873217271721881
get_duckie_state_mean0.05873217271721881
get_duckie_state_median0.05873217271721881
get_duckie_state_min0.05873217271721881
get_robot_state_max0.003725979639136273
get_robot_state_mean0.003725979639136273
get_robot_state_median0.003725979639136273
get_robot_state_min0.003725979639136273
get_state_dump_max0.01414917862933615
get_state_dump_mean0.01414917862933615
get_state_dump_median0.01414917862933615
get_state_dump_min0.01414917862933615
get_ui_image_max0.013817465823629627
get_ui_image_mean0.013817465823629627
get_ui_image_median0.013817465823629627
get_ui_image_min0.013817465823629627
in-drivable-lane_max2.25
in-drivable-lane_mean2.25
in-drivable-lane_median2.25
in-drivable-lane_min2.25
per-episodes
details{"d30-ego0": {"driven_any": 0.4527875897847037, "get_ui_image": 0.013817465823629627, "step_physics": 0.06828967384670091, "survival_time": 2.25, "driven_lanedir": 0.0, "get_state_dump": 0.01414917862933615, "get_robot_state": 0.003725979639136273, "sim_render-ego0": 0.0035019024558689284, "get_duckie_state": 0.05873217271721881, "in-drivable-lane": 2.25, "deviation-heading": 0.0, "agent_compute-ego0": 0.011160119720127272, "complete-iteration": 0.18591751223025116, "set_robot_commands": 0.0022411139115043307, "distance-from-start": 0.3113162964880775, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008281344952790634, "sim_compute_performance-ego0": 0.0019198396931523864}}
set_robot_commands_max0.0022411139115043307
set_robot_commands_mean0.0022411139115043307
set_robot_commands_median0.0022411139115043307
set_robot_commands_min0.0022411139115043307
sim_compute_performance-ego0_max0.0019198396931523864
sim_compute_performance-ego0_mean0.0019198396931523864
sim_compute_performance-ego0_median0.0019198396931523864
sim_compute_performance-ego0_min0.0019198396931523864
sim_compute_sim_state_max0.008281344952790634
sim_compute_sim_state_mean0.008281344952790634
sim_compute_sim_state_median0.008281344952790634
sim_compute_sim_state_min0.008281344952790634
sim_render-ego0_max0.0035019024558689284
sim_render-ego0_mean0.0035019024558689284
sim_render-ego0_median0.0035019024558689284
sim_render-ego0_min0.0035019024558689284
simulation-passed1
step_physics_max0.06828967384670091
step_physics_mean0.06828967384670091
step_physics_median0.06828967384670091
step_physics_min0.06828967384670091
survival_time_max2.25
survival_time_mean2.25
survival_time_median2.25
survival_time_min2.25
No reset possible
7875215851Juan Ramirezexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-010:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.2908778314573951


other stats
agent_compute-ego0_max0.0114584139415196
agent_compute-ego0_mean0.0114584139415196
agent_compute-ego0_median0.0114584139415196
agent_compute-ego0_min0.0114584139415196
complete-iteration_max0.2585408063161941
complete-iteration_mean0.2585408063161941
complete-iteration_median0.2585408063161941
complete-iteration_min0.2585408063161941
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.2908778314573951
distance-from-start_median0.2908778314573951
distance-from-start_min0.2908778314573951
driven_any_max0.3785219215194092
driven_any_mean0.3785219215194092
driven_any_median0.3785219215194092
driven_any_min0.3785219215194092
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11614877837044851
get_duckie_state_mean0.11614877837044851
get_duckie_state_median0.11614877837044851
get_duckie_state_min0.11614877837044851
get_robot_state_max0.003701976367405483
get_robot_state_mean0.003701976367405483
get_robot_state_median0.003701976367405483
get_robot_state_min0.003701976367405483
get_state_dump_max0.023151647476922894
get_state_dump_mean0.023151647476922894
get_state_dump_median0.023151647476922894
get_state_dump_min0.023151647476922894
get_ui_image_max0.015833860351925806
get_ui_image_mean0.015833860351925806
get_ui_image_median0.015833860351925806
get_ui_image_min0.015833860351925806
in-drivable-lane_max2.0500000000000007
in-drivable-lane_mean2.0500000000000007
in-drivable-lane_median2.0500000000000007
in-drivable-lane_min2.0500000000000007
per-episodes
details{"d60-ego0": {"driven_any": 0.3785219215194092, "get_ui_image": 0.015833860351925806, "step_physics": 0.07216510318574451, "survival_time": 2.0500000000000007, "driven_lanedir": 0.0, "get_state_dump": 0.023151647476922894, "get_robot_state": 0.003701976367405483, "sim_render-ego0": 0.003468944912865048, "get_duckie_state": 0.11614877837044851, "in-drivable-lane": 2.0500000000000007, "deviation-heading": 0.0, "agent_compute-ego0": 0.0114584139415196, "complete-iteration": 0.2585408063161941, "set_robot_commands": 0.0022009100232805523, "distance-from-start": 0.2908778314573951, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008441084907168434, "sim_compute_performance-ego0": 0.0018748158500308085}}
set_robot_commands_max0.0022009100232805523
set_robot_commands_mean0.0022009100232805523
set_robot_commands_median0.0022009100232805523
set_robot_commands_min0.0022009100232805523
sim_compute_performance-ego0_max0.0018748158500308085
sim_compute_performance-ego0_mean0.0018748158500308085
sim_compute_performance-ego0_median0.0018748158500308085
sim_compute_performance-ego0_min0.0018748158500308085
sim_compute_sim_state_max0.008441084907168434
sim_compute_sim_state_mean0.008441084907168434
sim_compute_sim_state_median0.008441084907168434
sim_compute_sim_state_min0.008441084907168434
sim_render-ego0_max0.003468944912865048
sim_render-ego0_mean0.003468944912865048
sim_render-ego0_median0.003468944912865048
sim_render-ego0_min0.003468944912865048
simulation-passed1
step_physics_max0.07216510318574451
step_physics_mean0.07216510318574451
step_physics_median0.07216510318574451
step_physics_min0.07216510318574451
survival_time_max2.0500000000000007
survival_time_mean2.0500000000000007
survival_time_median2.0500000000000007
survival_time_min2.0500000000000007
No reset possible
7870415847Juan Ramirezexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-010:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2721332662722131


other stats
agent_compute-ego0_max0.011336328936558143
agent_compute-ego0_mean0.011336328936558143
agent_compute-ego0_median0.011336328936558143
agent_compute-ego0_min0.011336328936558143
complete-iteration_max0.21152123282937443
complete-iteration_mean0.21152123282937443
complete-iteration_median0.21152123282937443
complete-iteration_min0.21152123282937443
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2721332662722131
distance-from-start_median1.2721332662722131
distance-from-start_min1.2721332662722131
driven_any_max1.7526981382978273
driven_any_mean1.7526981382978273
driven_any_median1.7526981382978273
driven_any_min1.7526981382978273
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07747443517049153
get_duckie_state_mean0.07747443517049153
get_duckie_state_median0.07747443517049153
get_duckie_state_min0.07747443517049153
get_robot_state_max0.0036803530711753698
get_robot_state_mean0.0036803530711753698
get_robot_state_median0.0036803530711753698
get_robot_state_min0.0036803530711753698
get_state_dump_max0.016951799392700195
get_state_dump_mean0.016951799392700195
get_state_dump_median0.016951799392700195
get_state_dump_min0.016951799392700195
get_ui_image_max0.014433753256704294
get_ui_image_mean0.014433753256704294
get_ui_image_median0.014433753256704294
get_ui_image_min0.014433753256704294
in-drivable-lane_max5.04999999999999
in-drivable-lane_mean5.04999999999999
in-drivable-lane_median5.04999999999999
in-drivable-lane_min5.04999999999999
per-episodes
details{"d40-ego0": {"driven_any": 1.7526981382978273, "get_ui_image": 0.014433753256704294, "step_physics": 0.07000918715607886, "survival_time": 5.04999999999999, "driven_lanedir": 0.0, "get_state_dump": 0.016951799392700195, "get_robot_state": 0.0036803530711753698, "sim_render-ego0": 0.0035020533730002012, "get_duckie_state": 0.07747443517049153, "in-drivable-lane": 5.04999999999999, "deviation-heading": 0.0, "agent_compute-ego0": 0.011336328936558143, "complete-iteration": 0.21152123282937443, "set_robot_commands": 0.002271741044287588, "distance-from-start": 1.2721332662722131, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00982058048248291, "sim_compute_performance-ego0": 0.0019358209535187368}}
set_robot_commands_max0.002271741044287588
set_robot_commands_mean0.002271741044287588
set_robot_commands_median0.002271741044287588
set_robot_commands_min0.002271741044287588
sim_compute_performance-ego0_max0.0019358209535187368
sim_compute_performance-ego0_mean0.0019358209535187368
sim_compute_performance-ego0_median0.0019358209535187368
sim_compute_performance-ego0_min0.0019358209535187368
sim_compute_sim_state_max0.00982058048248291
sim_compute_sim_state_mean0.00982058048248291
sim_compute_sim_state_median0.00982058048248291
sim_compute_sim_state_min0.00982058048248291
sim_render-ego0_max0.0035020533730002012
sim_render-ego0_mean0.0035020533730002012
sim_render-ego0_median0.0035020533730002012
sim_render-ego0_min0.0035020533730002012
simulation-passed1
step_physics_max0.07000918715607886
step_physics_mean0.07000918715607886
step_physics_median0.07000918715607886
step_physics_min0.07000918715607886
survival_time_max5.04999999999999
survival_time_mean5.04999999999999
survival_time_median5.04999999999999
survival_time_min5.04999999999999
No reset possible
7869815847Juan Ramirezexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-010:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.20648222396610633


other stats
agent_compute-ego0_max0.011127446560149495
agent_compute-ego0_mean0.011127446560149495
agent_compute-ego0_median0.011127446560149495
agent_compute-ego0_min0.011127446560149495
complete-iteration_max0.24567443259218905
complete-iteration_mean0.24567443259218905
complete-iteration_median0.24567443259218905
complete-iteration_min0.24567443259218905
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.20648222396610633
distance-from-start_median0.20648222396610633
distance-from-start_min0.20648222396610633
driven_any_max0.4502205328880587
driven_any_mean0.4502205328880587
driven_any_median0.4502205328880587
driven_any_min0.4502205328880587
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11397170005960668
get_duckie_state_mean0.11397170005960668
get_duckie_state_median0.11397170005960668
get_duckie_state_min0.11397170005960668
get_robot_state_max0.003484523042719415
get_robot_state_mean0.003484523042719415
get_robot_state_median0.003484523042719415
get_robot_state_min0.003484523042719415
get_state_dump_max0.02276090865439557
get_state_dump_mean0.02276090865439557
get_state_dump_median0.02276090865439557
get_state_dump_min0.02276090865439557
get_ui_image_max0.015122367980632377
get_ui_image_mean0.015122367980632377
get_ui_image_median0.015122367980632377
get_ui_image_min0.015122367980632377
in-drivable-lane_max2.3
in-drivable-lane_mean2.3
in-drivable-lane_median2.3
in-drivable-lane_min2.3
per-episodes
details{"d60-ego0": {"driven_any": 0.4502205328880587, "get_ui_image": 0.015122367980632377, "step_physics": 0.06338328503547831, "survival_time": 2.3, "driven_lanedir": 0.0, "get_state_dump": 0.02276090865439557, "get_robot_state": 0.003484523042719415, "sim_render-ego0": 0.0033557770100045713, "get_duckie_state": 0.11397170005960668, "in-drivable-lane": 2.3, "deviation-heading": 0.0, "agent_compute-ego0": 0.011127446560149495, "complete-iteration": 0.24567443259218905, "set_robot_commands": 0.0021703699801830533, "distance-from-start": 0.20648222396610633, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008414785912696352, "sim_compute_performance-ego0": 0.001803043040823429}}
set_robot_commands_max0.0021703699801830533
set_robot_commands_mean0.0021703699801830533
set_robot_commands_median0.0021703699801830533
set_robot_commands_min0.0021703699801830533
sim_compute_performance-ego0_max0.001803043040823429
sim_compute_performance-ego0_mean0.001803043040823429
sim_compute_performance-ego0_median0.001803043040823429
sim_compute_performance-ego0_min0.001803043040823429
sim_compute_sim_state_max0.008414785912696352
sim_compute_sim_state_mean0.008414785912696352
sim_compute_sim_state_median0.008414785912696352
sim_compute_sim_state_min0.008414785912696352
sim_render-ego0_max0.0033557770100045713
sim_render-ego0_mean0.0033557770100045713
sim_render-ego0_median0.0033557770100045713
sim_render-ego0_min0.0033557770100045713
simulation-passed1
step_physics_max0.06338328503547831
step_physics_mean0.06338328503547831
step_physics_median0.06338328503547831
step_physics_min0.06338328503547831
survival_time_max2.3
survival_time_mean2.3
survival_time_median2.3
survival_time_min2.3
No reset possible
7866013798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesgpu-production-spot-0-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7865913798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesgpu-production-spot-0-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7865813798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesgpu-production-spot-0-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7865713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesgpu-production-spot-0-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible