Duckietown Challenges Home Challenges Submissions

Evaluator 533

ID533
evaluatoridsc-rudolf-16007
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-16007
versiond-c:4.0.7;d-c-r:4.0.9;d-s:4.0.10
first heard
last heard
statusinactive
# evaluating
# success9 17132
# timeout1 17122
# failed
# error3 17117
# aborted2 17130
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
171912249Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-160070:30:42
Timeout: Waited 180 [...]
Timeout:

Waited 1803.8632202148438 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171822268Andrea Censi 🇨🇭Solution templateaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16108847536691806
agent_compute-ego_mean0.15509333335874015
agent_compute-ego_median0.15342528100997682
agent_compute-ego_min0.15175401463228114
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003429139361662023, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06851464509963989, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15175401463228114, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07769021567176371, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04264951804104973, "sim_compute_performance-ego": 0.06609624974867877, "sim_compute_robot_state-ego": 0.2600628838819616}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0034828905075315443, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06795952055189344, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15342528100997682, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07755487684219603, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04250099545433408, "sim_compute_performance-ego": 0.0674661568232945, "sim_compute_robot_state-ego": 0.07815198671250116}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0033277694995586687, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06845196577218862, "in-drivable-lane": 0, "agent_compute-ego": 0.1533436811887301, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07707828008211576, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04206275939941406, "sim_compute_performance-ego": 0.0697629268352802, "sim_compute_robot_state-ego": 0.07713129703815166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003434562101596739, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07356678567281584, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16108847536691806, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08101688943258147, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04586935915598055, "sim_compute_performance-ego": 0.0715453333970977, "sim_compute_robot_state-ego": 0.08312342515805872}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003559410572052002, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.0700726866722107, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15585521459579468, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07897107362747192, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.042718968391418456, "sim_compute_performance-ego": 0.0692133903503418, "sim_compute_robot_state-ego": 0.07819197416305541}}
set_robot_commands_max0.08101688943258147
set_robot_commands_mean0.07846226713122577
set_robot_commands_median0.07769021567176371
set_robot_commands_min0.07707828008211576
sim_compute_performance-ego_max0.0715453333970977
sim_compute_performance-ego_mean0.06881681143093858
sim_compute_performance-ego_median0.0692133903503418
sim_compute_performance-ego_min0.06609624974867877
sim_compute_robot_state-ego_max0.2600628838819616
sim_compute_robot_state-ego_mean0.11533231339074572
sim_compute_robot_state-ego_median0.07819197416305541
sim_compute_robot_state-ego_min0.07713129703815166
sim_compute_sim_state_max0.04586935915598055
sim_compute_sim_state_mean0.043160320088439376
sim_compute_sim_state_median0.04264951804104973
sim_compute_sim_state_min0.04206275939941406
sim_physics_max0.003559410572052002
sim_physics_mean0.003446754408480195
sim_physics_median0.003434562101596739
sim_physics_min0.0033277694995586687
sim_render-ego_max0.07356678567281584
sim_render-ego_mean0.06971312075374969
sim_render-ego_median0.06851464509963989
sim_render-ego_min0.06795952055189344
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171772284Andrea Censi 🇨🇭Minimal agentaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.15913260533259466
agent_compute-ego_mean0.15569208393782005
agent_compute-ego_median0.15643042471350693
agent_compute-ego_min0.15132664498828707
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003433799042421229, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06940605009303373, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15834098353105433, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0814790971138898, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04298544981900383, "sim_compute_performance-ego": 0.06631247436299044, "sim_compute_robot_state-ego": 0.2521142118117389}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003285192307971773, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06565011115301222, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15132664498828707, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07606286472744411, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.041499205998012, "sim_compute_performance-ego": 0.06480374790373303, "sim_compute_robot_state-ego": 0.07260822492932516}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.003568139443030724, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07418900636526254, "in-drivable-lane": 0, "agent_compute-ego": 0.15913260533259466, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08110811160160945, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04380179918729342, "sim_compute_performance-ego": 0.0687865477341872, "sim_compute_robot_state-ego": 0.07659764656653771}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0036881086302966606, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.0709665315907176, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15643042471350693, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08031365348071587, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04282454165016732, "sim_compute_performance-ego": 0.06807525855738943, "sim_compute_robot_state-ego": 0.07842346517051138}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003412315845489502, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07057632923126221, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15322976112365722, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07995773315429687, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04266624450683594, "sim_compute_performance-ego": 0.06921570062637329, "sim_compute_robot_state-ego": 0.08028152942657471}}
set_robot_commands_max0.0814790971138898
set_robot_commands_mean0.07978429201559123
set_robot_commands_median0.08031365348071587
set_robot_commands_min0.07606286472744411
sim_compute_performance-ego_max0.06921570062637329
sim_compute_performance-ego_mean0.06743874583693468
sim_compute_performance-ego_median0.06807525855738943
sim_compute_performance-ego_min0.06480374790373303
sim_compute_robot_state-ego_max0.2521142118117389
sim_compute_robot_state-ego_mean0.1120050155809376
sim_compute_robot_state-ego_median0.07842346517051138
sim_compute_robot_state-ego_min0.07260822492932516
sim_compute_sim_state_max0.04380179918729342
sim_compute_sim_state_mean0.0427554482322625
sim_compute_sim_state_median0.04282454165016732
sim_compute_sim_state_min0.041499205998012
sim_physics_max0.0036881086302966606
sim_physics_mean0.0034775110538419777
sim_physics_median0.003433799042421229
sim_physics_min0.003285192307971773
sim_render-ego_max0.07418900636526254
sim_render-ego_mean0.07015760568665766
sim_render-ego_median0.07057632923126221
sim_render-ego_min0.06565011115301222
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171712292Andrea Censi 🇨🇭Minimal agentaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-160070:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16219229936599733
agent_compute-ego_mean0.15709887293447158
agent_compute-ego_median0.1566106488065022
agent_compute-ego_min0.15382283831399585
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003168337485369514, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06462046328712912, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1576474203782923, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07788444967830882, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.035524270113776714, "sim_compute_performance-ego": 0.0663227263618918, "sim_compute_robot_state-ego": 0.25029505000394936, "sim_compute_robot_state-npc0": 0.07438960496117086, "sim_compute_robot_state-npc1": 0.06502378688139074, "sim_compute_robot_state-npc2": 0.06202858686447144, "sim_compute_robot_state-npc3": 0.06226427414838005}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0029837668888152593, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.05923895987253341, "in-drivable-lane": 0, "agent_compute-ego": 0.15382283831399585, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07690285501025972, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03267625021556067, "sim_compute_performance-ego": 0.06076933467198932, "sim_compute_robot_state-ego": 0.08326420329865955, "sim_compute_robot_state-npc0": 0.0704485537513854, "sim_compute_robot_state-npc1": 0.06285760137769911, "sim_compute_robot_state-npc2": 0.06094706247723291, "sim_compute_robot_state-npc3": 0.06149163700285412}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0033528731419489935, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.06630455530606784, "in-drivable-lane": 0, "agent_compute-ego": 0.15522115780757023, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07892052210294283, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.03655743598937988, "sim_compute_performance-ego": 0.06467201893146221, "sim_compute_robot_state-ego": 0.08356267122121958, "sim_compute_robot_state-npc0": 0.07491640677818885, "sim_compute_robot_state-npc1": 0.06748357919546275, "sim_compute_robot_state-npc2": 0.06486655748807467, "sim_compute_robot_state-npc3": 0.06715299166165865}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0034425840145204125, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06748217198906875, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1566106488065022, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07900761976474668, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.03702897560305712, "sim_compute_performance-ego": 0.06870224999218452, "sim_compute_robot_state-ego": 0.08713188113235845, "sim_compute_robot_state-npc0": 0.07731713608997624, "sim_compute_robot_state-npc1": 0.07051027693399568, "sim_compute_robot_state-npc2": 0.06817323987076922, "sim_compute_robot_state-npc3": 0.06818301794005603}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0035498881340026854, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.06922850370407105, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.16219229936599733, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07955130338668823, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.038852415084838866, "sim_compute_performance-ego": 0.06808069705963135, "sim_compute_robot_state-ego": 0.08547727584838867, "sim_compute_robot_state-npc0": 0.07668142557144166, "sim_compute_robot_state-npc1": 0.07175606489181519, "sim_compute_robot_state-npc2": 0.06989626169204712, "sim_compute_robot_state-npc3": 0.07080627918243408}}
set_robot_commands_max0.07955130338668823
set_robot_commands_mean0.07845334998858926
set_robot_commands_median0.07892052210294283
set_robot_commands_min0.07690285501025972
sim_compute_performance-ego_max0.06870224999218452
sim_compute_performance-ego_mean0.06570940540343184
sim_compute_performance-ego_median0.0663227263618918
sim_compute_performance-ego_min0.06076933467198932
sim_compute_robot_state-ego_max0.25029505000394936
sim_compute_robot_state-ego_mean0.11794621630091512
sim_compute_robot_state-ego_median0.08547727584838867
sim_compute_robot_state-ego_min0.08326420329865955
sim_compute_robot_state-npc0_max0.07731713608997624
sim_compute_robot_state-npc0_mean0.07475062543043261
sim_compute_robot_state-npc0_median0.07491640677818885
sim_compute_robot_state-npc0_min0.0704485537513854
sim_compute_robot_state-npc1_max0.07175606489181519
sim_compute_robot_state-npc1_mean0.06752626185607269
sim_compute_robot_state-npc1_median0.06748357919546275
sim_compute_robot_state-npc1_min0.06285760137769911
sim_compute_robot_state-npc2_max0.06989626169204712
sim_compute_robot_state-npc2_mean0.06518234167851908
sim_compute_robot_state-npc2_median0.06486655748807467
sim_compute_robot_state-npc2_min0.06094706247723291
sim_compute_robot_state-npc3_max0.07080627918243408
sim_compute_robot_state-npc3_mean0.0659796399870766
sim_compute_robot_state-npc3_median0.06715299166165865
sim_compute_robot_state-npc3_min0.06149163700285412
sim_compute_sim_state_max0.038852415084838866
sim_compute_sim_state_mean0.03612786940132265
sim_compute_sim_state_median0.03655743598937988
sim_compute_sim_state_min0.03267625021556067
sim_physics_max0.0035498881340026854
sim_physics_mean0.003299489932931373
sim_physics_median0.0033528731419489935
sim_physics_min0.0029837668888152593
sim_render-ego_max0.06922850370407105
sim_render-ego_mean0.06537493083177404
sim_render-ego_median0.06630455530606784
sim_render-ego_min0.05923895987253341
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171622313FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-160070:30:40
Timeout: Waited 180 [...]
Timeout:

Waited 1800.7076151371002 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171582318FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.319514778943256
survival_time_median3.399999999999996
deviation-center-line_median0.14321219721956907
in-drivable-lane_median2.0499999999999967


other stats
agent_compute-ego_max0.16174074481515324
agent_compute-ego_mean0.15159503423164716
agent_compute-ego_median0.14950578808784484
agent_compute-ego_min0.14678519422357733
deviation-center-line_max0.21768105498084453
deviation-center-line_mean0.12271561500230632
deviation-center-line_min0.027720906512798266
deviation-heading_max3.655032594749009
deviation-heading_mean1.6074827418142192
deviation-heading_median1.266099663893892
deviation-heading_min0.4886362551025064
driven_any_max2.4910168350063504
driven_any_mean1.309921017625998
driven_any_median1.3062827501309398
driven_any_min0.43303832405777215
driven_lanedir_consec_max0.703692114523236
driven_lanedir_consec_mean0.3340026075124708
driven_lanedir_consec_min0.07680271452255027
driven_lanedir_max0.703692114523236
driven_lanedir_mean0.33758711178837875
driven_lanedir_median0.319514778943256
driven_lanedir_min0.09472523590209024
in-drivable-lane_max4.349999999999996
in-drivable-lane_mean1.9999999999999984
in-drivable-lane_min0.40000000000000013
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3062827501309398, "sim_physics": 0.0030599411796121035, "survival_time": 3.399999999999996, "driven_lanedir": 0.09472523590209024, "sim_render-ego": 0.06820242895799525, "in-drivable-lane": 2.1499999999999977, "agent_compute-ego": 0.16174074481515324, "deviation-heading": 1.0178378189114463, "set_robot_commands": 0.08161951864466947, "deviation-center-line": 0.14321219721956907, "driven_lanedir_consec": 0.07680271452255027, "sim_compute_sim_state": 0.04377225216697244, "sim_compute_performance-ego": 0.06947987219866585, "sim_compute_robot_state-ego": 0.30516089060727286}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5487627104102557, "sim_physics": 0.0033202916383743286, "survival_time": 3.999999999999994, "driven_lanedir": 0.4280473165409451, "sim_render-ego": 0.06689688265323639, "in-drivable-lane": 2.0499999999999967, "agent_compute-ego": 0.14950578808784484, "deviation-heading": 1.6098073764142418, "set_robot_commands": 0.0764259159564972, "deviation-center-line": 0.14839142624591525, "driven_lanedir_consec": 0.4280473165409451, "sim_compute_sim_state": 0.04381081759929657, "sim_compute_performance-ego": 0.0674383670091629, "sim_compute_robot_state-ego": 0.07735752761363983}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7705044685246707, "sim_physics": 0.002904794045857021, "survival_time": 2.799999999999998, "driven_lanedir": 0.319514778943256, "sim_render-ego": 0.06046055470194135, "in-drivable-lane": 1.05, "agent_compute-ego": 0.15057029468672617, "deviation-heading": 1.266099663893892, "set_robot_commands": 0.0806111650807517, "deviation-center-line": 0.07657249005240453, "driven_lanedir_consec": 0.319514778943256, "sim_compute_sim_state": 0.04090938823563712, "sim_compute_performance-ego": 0.0631860111440931, "sim_compute_robot_state-ego": 0.07660846625055585}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4910168350063504, "sim_physics": 0.0029373498252742197, "survival_time": 9.049999999999994, "driven_lanedir": 0.703692114523236, "sim_render-ego": 0.062378078534458224, "in-drivable-lane": 4.349999999999996, "agent_compute-ego": 0.1493731493449343, "deviation-heading": 3.655032594749009, "set_robot_commands": 0.07809541370328618, "deviation-center-line": 0.21768105498084453, "driven_lanedir_consec": 0.703692114523236, "sim_compute_sim_state": 0.04142575764524344, "sim_compute_performance-ego": 0.061617026671520254, "sim_compute_robot_state-ego": 0.0732912016178363}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.43303832405777215, "sim_physics": 0.00268521092154763, "survival_time": 1.1000000000000003, "driven_lanedir": 0.14195611303236655, "sim_render-ego": 0.06052477793260054, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.14678519422357733, "deviation-heading": 0.4886362551025064, "set_robot_commands": 0.08250635320490057, "deviation-center-line": 0.027720906512798266, "driven_lanedir_consec": 0.14195611303236655, "sim_compute_sim_state": 0.041995026848532936, "sim_compute_performance-ego": 0.0628415888006037, "sim_compute_robot_state-ego": 0.0757414536042647}}
set_robot_commands_max0.08250635320490057
set_robot_commands_mean0.07985167331802102
set_robot_commands_median0.0806111650807517
set_robot_commands_min0.0764259159564972
sim_compute_performance-ego_max0.06947987219866585
sim_compute_performance-ego_mean0.06491257316480917
sim_compute_performance-ego_median0.0631860111440931
sim_compute_performance-ego_min0.061617026671520254
sim_compute_robot_state-ego_max0.30516089060727286
sim_compute_robot_state-ego_mean0.1216319079387139
sim_compute_robot_state-ego_median0.07660846625055585
sim_compute_robot_state-ego_min0.0732912016178363
sim_compute_sim_state_max0.04381081759929657
sim_compute_sim_state_mean0.0423826484991365
sim_compute_sim_state_median0.041995026848532936
sim_compute_sim_state_min0.04090938823563712
sim_physics_max0.0033202916383743286
sim_physics_mean0.0029815175221330607
sim_physics_median0.0029373498252742197
sim_physics_min0.00268521092154763
sim_render-ego_max0.06820242895799525
sim_render-ego_mean0.06369254455604634
sim_render-ego_median0.062378078534458224
sim_render-ego_min0.06046055470194135
simulation-passed1
survival_time_max9.049999999999994
survival_time_mean4.069999999999997
survival_time_min1.1000000000000003
No reset possible
171542327Konstantin ChaikaMinimal agentaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16690572859748962
agent_compute-ego_mean0.1597727029995556
agent_compute-ego_median0.15857300525758325
agent_compute-ego_min0.15634998908409706
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0032445227398591884, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.0712538151180043, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.159215790383956, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.08327805995941162, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04423305918188656, "sim_compute_performance-ego": 0.06977247490602381, "sim_compute_robot_state-ego": 0.26530837311464195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0035361221858433317, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07259529355972533, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.16690572859748962, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07929691057356578, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.044052914967612614, "sim_compute_performance-ego": 0.0708230904170445, "sim_compute_robot_state-ego": 0.08186030009436229}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0036014740283672624, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07218944476200984, "in-drivable-lane": 0, "agent_compute-ego": 0.15634998908409706, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07829890984755296, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04357173993037297, "sim_compute_performance-ego": 0.07313368137066181, "sim_compute_robot_state-ego": 0.08045861904437725}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.00351679034349395, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07279230036386629, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15857300525758325, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07907071636944282, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.043940227206160386, "sim_compute_performance-ego": 0.07151447563636594, "sim_compute_robot_state-ego": 0.0811015512885117}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0035137009620666505, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07003946542739868, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1578190016746521, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07729371309280396, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04180469751358032, "sim_compute_performance-ego": 0.06830455541610718, "sim_compute_robot_state-ego": 0.0778219199180603}}
set_robot_commands_max0.08327805995941162
set_robot_commands_mean0.07944766196855543
set_robot_commands_median0.07907071636944282
set_robot_commands_min0.07729371309280396
sim_compute_performance-ego_max0.07313368137066181
sim_compute_performance-ego_mean0.07070965554924066
sim_compute_performance-ego_median0.0708230904170445
sim_compute_performance-ego_min0.06830455541610718
sim_compute_robot_state-ego_max0.26530837311464195
sim_compute_robot_state-ego_mean0.1173101526919907
sim_compute_robot_state-ego_median0.0811015512885117
sim_compute_robot_state-ego_min0.0778219199180603
sim_compute_sim_state_max0.04423305918188656
sim_compute_sim_state_mean0.04352052775992257
sim_compute_sim_state_median0.043940227206160386
sim_compute_sim_state_min0.04180469751358032
sim_physics_max0.0036014740283672624
sim_physics_mean0.0034825220519260763
sim_physics_median0.00351679034349395
sim_physics_min0.0032445227398591884
sim_render-ego_max0.07279230036386629
sim_render-ego_mean0.07177406384620089
sim_render-ego_median0.07218944476200984
sim_render-ego_min0.07003946542739868
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171462333Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-160070:22:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.6760228236109347
survival_time_median14.950000000000076
deviation-center-line_median0.2349287147361276
in-drivable-lane_median7.500000000000039


other stats
agent_compute-ego_max0.17000613689422608
agent_compute-ego_mean0.1665477754275004
agent_compute-ego_median0.16734947681427
agent_compute-ego_min0.16361301501592002
deviation-center-line_max0.2349306604543784
deviation-center-line_mean0.2349290643247573
deviation-center-line_min0.23492851696102396
deviation-heading_max5.833940015674341
deviation-heading_mean5.83394001567434
deviation-heading_median5.83394001567434
deviation-heading_min5.83394001567434
driven_any_max8.841232955081617
driven_any_mean8.841232955081612
driven_any_median8.84123295508161
driven_any_min8.841232955081608
driven_lanedir_consec_max-2.67601614789072
driven_lanedir_consec_mean-2.6760240395458146
driven_lanedir_consec_min-2.676035221377435
driven_lanedir_max-2.67601614789072
driven_lanedir_mean-2.6760240395458146
driven_lanedir_median-2.6760228236109347
driven_lanedir_min-2.676035221377435
in-drivable-lane_max7.500000000000039
in-drivable-lane_mean7.50000000000004
in-drivable-lane_min7.500000000000039
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 8.841232955081617, "sim_physics": 0.003185315132141114, "survival_time": 14.950000000000076, "driven_lanedir": -2.6760228236109347, "sim_render-ego": 0.06328420718510945, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.16418031533559163, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.07653710206349691, "deviation-center-line": 0.2349287147361289, "driven_lanedir_consec": -2.6760228236109347, "sim_compute_sim_state": 0.04354617436726888, "sim_compute_performance-ego": 0.06563482284545899, "sim_compute_robot_state-ego": 0.12136285781860352}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 8.84123295508161, "sim_physics": 0.0030370791753133136, "survival_time": 14.950000000000076, "driven_lanedir": -2.676029856959261, "sim_render-ego": 0.06667255798975627, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.1675899330774943, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.07860051949818929, "deviation-center-line": 0.2349306604543784, "driven_lanedir_consec": -2.676029856959261, "sim_compute_sim_state": 0.043842872778574626, "sim_compute_performance-ego": 0.0668258015314738, "sim_compute_robot_state-ego": 0.07824211359024048}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 8.841232955081612, "sim_physics": 0.002865112622578939, "survival_time": 14.950000000000076, "driven_lanedir": -2.676035221377435, "sim_render-ego": 0.06609967390696207, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.16361301501592002, "deviation-heading": 5.833940015674341, "set_robot_commands": 0.07766127983729045, "deviation-center-line": 0.23492851696102396, "driven_lanedir_consec": -2.676035221377435, "sim_compute_sim_state": 0.04272719621658325, "sim_compute_performance-ego": 0.06506348927815755, "sim_compute_robot_state-ego": 0.0777858837445577}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 8.841232955081608, "sim_physics": 0.0032431705792744956, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06753344297409057, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.16734947681427, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08005588293075562, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.0428636376063029, "sim_compute_performance-ego": 0.0674896264076233, "sim_compute_robot_state-ego": 0.07712311267852784}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 8.841232955081608, "sim_physics": 0.0034549053510030112, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06785641113917033, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17000613689422608, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.07761965036392211, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.04425624450047811, "sim_compute_performance-ego": 0.06842396338780721, "sim_compute_robot_state-ego": 0.07871404727300008}}
set_robot_commands_max0.08005588293075562
set_robot_commands_mean0.07809488693873087
set_robot_commands_median0.07766127983729045
set_robot_commands_min0.07653710206349691
sim_compute_performance-ego_max0.06842396338780721
sim_compute_performance-ego_mean0.06668754069010416
sim_compute_performance-ego_median0.0668258015314738
sim_compute_performance-ego_min0.06506348927815755
sim_compute_robot_state-ego_max0.12136285781860352
sim_compute_robot_state-ego_mean0.08664560302098592
sim_compute_robot_state-ego_median0.07824211359024048
sim_compute_robot_state-ego_min0.07712311267852784
sim_compute_sim_state_max0.04425624450047811
sim_compute_sim_state_mean0.04344722509384155
sim_compute_sim_state_median0.04354617436726888
sim_compute_sim_state_min0.04272719621658325
sim_physics_max0.0034549053510030112
sim_physics_mean0.0031571165720621747
sim_physics_median0.003185315132141114
sim_physics_min0.002865112622578939
sim_render-ego_max0.06785641113917033
sim_render-ego_mean0.06628925863901775
sim_render-ego_median0.06667255798975627
sim_render-ego_min0.06328420718510945
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
171392333Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationsuccessnoidsc-rudolf-160070:22:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.6760228236109347
survival_time_median14.950000000000076
deviation-center-line_median0.2349287147361276
in-drivable-lane_median7.500000000000039


other stats
agent_compute-ego_max0.17536739905675253
agent_compute-ego_mean0.1731416303316752
agent_compute-ego_median0.17318819681803385
agent_compute-ego_min0.17018280188242593
deviation-center-line_max0.2349306604543784
deviation-center-line_mean0.2349290643247573
deviation-center-line_min0.23492851696102396
deviation-heading_max5.833940015674341
deviation-heading_mean5.83394001567434
deviation-heading_median5.83394001567434
deviation-heading_min5.83394001567434
driven_any_max8.841232955081617
driven_any_mean8.841232955081612
driven_any_median8.84123295508161
driven_any_min8.841232955081608
driven_lanedir_consec_max-2.67601614789072
driven_lanedir_consec_mean-2.6760240395458146
driven_lanedir_consec_min-2.676035221377435
driven_lanedir_max-2.67601614789072
driven_lanedir_mean-2.6760240395458146
driven_lanedir_median-2.6760228236109347
driven_lanedir_min-2.676035221377435
in-drivable-lane_max7.500000000000039
in-drivable-lane_mean7.50000000000004
in-drivable-lane_min7.500000000000039
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 8.841232955081617, "sim_physics": 0.003734909693400065, "survival_time": 14.950000000000076, "driven_lanedir": -2.6760228236109347, "sim_render-ego": 0.075882834593455, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17225707769393922, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08072811603546143, "deviation-center-line": 0.2349287147361289, "driven_lanedir_consec": -2.6760228236109347, "sim_compute_sim_state": 0.04602961540222168, "sim_compute_performance-ego": 0.07329297383626301, "sim_compute_robot_state-ego": 0.11741482814153036}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 8.84123295508161, "sim_physics": 0.0037738180160522463, "survival_time": 14.950000000000076, "driven_lanedir": -2.676029856959261, "sim_render-ego": 0.07598739862442017, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17318819681803385, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08102426767349243, "deviation-center-line": 0.2349306604543784, "driven_lanedir_consec": -2.676029856959261, "sim_compute_sim_state": 0.04610706726710002, "sim_compute_performance-ego": 0.07268331289291381, "sim_compute_robot_state-ego": 0.08119651556015015}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 8.841232955081612, "sim_physics": 0.0031742215156555175, "survival_time": 14.950000000000076, "driven_lanedir": -2.676035221377435, "sim_render-ego": 0.06746062676111857, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17536739905675253, "deviation-heading": 5.833940015674341, "set_robot_commands": 0.08200763543446858, "deviation-center-line": 0.23492851696102396, "driven_lanedir_consec": -2.676035221377435, "sim_compute_sim_state": 0.045781927903493246, "sim_compute_performance-ego": 0.06904930194218953, "sim_compute_robot_state-ego": 0.0820286758740743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 8.841232955081608, "sim_physics": 0.0032025790214538575, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06980853954950969, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17471267620722453, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.08326441526412964, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.04643571138381958, "sim_compute_performance-ego": 0.0694140632947286, "sim_compute_robot_state-ego": 0.08265830834706624}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 8.841232955081608, "sim_physics": 0.003114305337270101, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.06874533891677856, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.17018280188242593, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.081183180809021, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.045883890787760416, "sim_compute_performance-ego": 0.06827832778294882, "sim_compute_robot_state-ego": 0.08087632179260254}}
set_robot_commands_max0.08326441526412964
set_robot_commands_mean0.08164152304331461
set_robot_commands_median0.081183180809021
set_robot_commands_min0.08072811603546143
sim_compute_performance-ego_max0.07329297383626301
sim_compute_performance-ego_mean0.07054359594980877
sim_compute_performance-ego_median0.0694140632947286
sim_compute_performance-ego_min0.06827832778294882
sim_compute_robot_state-ego_max0.11741482814153036
sim_compute_robot_state-ego_mean0.0888349299430847
sim_compute_robot_state-ego_median0.0820286758740743
sim_compute_robot_state-ego_min0.08087632179260254
sim_compute_sim_state_max0.04643571138381958
sim_compute_sim_state_mean0.04604764254887899
sim_compute_sim_state_median0.04602961540222168
sim_compute_sim_state_min0.045781927903493246
sim_physics_max0.0037738180160522463
sim_physics_mean0.0033999667167663576
sim_physics_median0.0032025790214538575
sim_physics_min0.003114305337270101
sim_render-ego_max0.07598739862442017
sim_render-ego_mean0.0715769476890564
sim_render-ego_median0.06980853954950969
sim_render-ego_min0.06746062676111857
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
171382321Egor ZamotaevPredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-160070:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11367620719230018
error_L20.020246837187118595


No reset possible
171362323Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationabortednoidsc-rudolf-160070:03:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171322329Konstantin ChaikaMinimal agentaido2_LFVI_r1-v4step1-simulationsuccessnoidsc-rudolf-160070:14:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.1665033535523848
agent_compute-ego_mean0.16487815267849878
agent_compute-ego_median0.16584294543546788
agent_compute-ego_min0.1618356425711449
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.003605826147671404, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.07559756903812803, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.16413869364508268, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.079157253791546, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.042374926599962955, "sim_compute_performance-ego": 0.07325494536038103, "sim_compute_robot_state-ego": 0.1630914359257139, "sim_compute_robot_state-npc0": 0.07954247244473162, "sim_compute_robot_state-npc1": 0.07581493772309401, "sim_compute_robot_state-npc2": 0.07466525538214322, "sim_compute_robot_state-npc3": 0.07477167228172565}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.003639766664216013, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.0742736765832612, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1665033535523848, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.08061502196572044, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.04228951714255593, "sim_compute_performance-ego": 0.07355305281552402, "sim_compute_robot_state-ego": 0.09410521117123692, "sim_compute_robot_state-npc0": 0.08063047221212676, "sim_compute_robot_state-npc1": 0.07594927874478427, "sim_compute_robot_state-npc2": 0.07496049548640396, "sim_compute_robot_state-npc3": 0.07759987585472339}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.0035622094539885826, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.07402402289370273, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.1618356425711449, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.07901641409447853, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.04207040147578463, "sim_compute_performance-ego": 0.0717377079294083, "sim_compute_robot_state-ego": 0.08919171323167517, "sim_compute_robot_state-npc0": 0.07778383315877711, "sim_compute_robot_state-npc1": 0.07560805056957488, "sim_compute_robot_state-npc2": 0.07453335853333169, "sim_compute_robot_state-npc3": 0.07425592808013266}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.0035296916961669923, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.074885014926686, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.16584294543546788, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.07811175795162426, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.042312055475571576, "sim_compute_performance-ego": 0.07218670564539292, "sim_compute_robot_state-ego": 0.08930023417753331, "sim_compute_robot_state-npc0": 0.07783231454737047, "sim_compute_robot_state-npc1": 0.07387948877671185, "sim_compute_robot_state-npc2": 0.07329613180721507, "sim_compute_robot_state-npc3": 0.07346375970279469}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.003635981503654929, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.07853906996109906, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.16607012818841374, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.08042366013807409, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.042848324074464685, "sim_compute_performance-ego": 0.07263997372458963, "sim_compute_robot_state-ego": 0.08722982687108657, "sim_compute_robot_state-npc0": 0.08014310808742747, "sim_compute_robot_state-npc1": 0.07660154735340792, "sim_compute_robot_state-npc2": 0.075010944815243, "sim_compute_robot_state-npc3": 0.07508752626531265}}
set_robot_commands_max0.08061502196572044
set_robot_commands_mean0.07946482158828867
set_robot_commands_median0.079157253791546
set_robot_commands_min0.07811175795162426
sim_compute_performance-ego_max0.07355305281552402
sim_compute_performance-ego_mean0.07267447709505918
sim_compute_performance-ego_median0.07263997372458963
sim_compute_performance-ego_min0.0717377079294083
sim_compute_robot_state-ego_max0.1630914359257139
sim_compute_robot_state-ego_mean0.10458368427544916
sim_compute_robot_state-ego_median0.08930023417753331
sim_compute_robot_state-ego_min0.08722982687108657
sim_compute_robot_state-npc0_max0.08063047221212676
sim_compute_robot_state-npc0_mean0.0791864400900867
sim_compute_robot_state-npc0_median0.07954247244473162
sim_compute_robot_state-npc0_min0.07778383315877711
sim_compute_robot_state-npc1_max0.07660154735340792
sim_compute_robot_state-npc1_mean0.07557066063351459
sim_compute_robot_state-npc1_median0.07581493772309401
sim_compute_robot_state-npc1_min0.07387948877671185
sim_compute_robot_state-npc2_max0.075010944815243
sim_compute_robot_state-npc2_mean0.07449323720486739
sim_compute_robot_state-npc2_median0.07466525538214322
sim_compute_robot_state-npc2_min0.07329613180721507
sim_compute_robot_state-npc3_max0.07759987585472339
sim_compute_robot_state-npc3_mean0.0750357524369378
sim_compute_robot_state-npc3_median0.07477167228172565
sim_compute_robot_state-npc3_min0.07346375970279469
sim_compute_sim_state_max0.042848324074464685
sim_compute_sim_state_mean0.042379044953667955
sim_compute_sim_state_median0.042312055475571576
sim_compute_sim_state_min0.04207040147578463
sim_physics_max0.003639766664216013
sim_physics_mean0.003594695093139584
sim_physics_median0.003605826147671404
sim_physics_min0.0035296916961669923
sim_render-ego_max0.07853906996109906
sim_render-ego_mean0.0754638706805754
sim_render-ego_median0.074885014926686
sim_render-ego_min0.07402402289370273
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
171302324Nikhil Khedekar 🇮🇳PredictorLastaido2-PREDstep1-simulationabortednoidsc-rudolf-160070:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11862072964919444
error_L20.02167979792340312


No reset possible
171222327Konstantin ChaikaMinimal agentaido2_LF_r2-v4step1-simulationtimeoutnoidsc-rudolf-16007----No reset possible
171172319FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:05:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible