Duckietown Challenges Home Challenges Submissions

Evaluator 1292

ID1292
evaluatorip-172-31-42-167-7357
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7357
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success49 23395
# timeout
# failed6 24008
# error33 23294
# aborted1 23561
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242504026Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06764961440318373
survival_time_median1.5500000000000007
deviation-center-line_median0.05353922704599162
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.17584759189236548
agent_compute-ego_mean0.15967225935874169
agent_compute-ego_median0.1637249443982099
agent_compute-ego_min0.13013916015625
deviation-center-line_max0.07228728063544432
deviation-center-line_mean0.05568939937029442
deviation-center-line_min0.04595955293841583
deviation-heading_max0.8102797062752097
deviation-heading_mean0.7189929988229335
deviation-heading_median0.7076820869772857
deviation-heading_min0.6413040214090833
driven_any_max0.23414043196558365
driven_any_mean0.1817946759897741
driven_any_median0.19494332741715545
driven_any_min0.07983512896685699
driven_lanedir_consec_max0.13269067689543812
driven_lanedir_consec_mean0.08174405942753796
driven_lanedir_consec_min0.031163125050107876
driven_lanedir_max0.13269067689543812
driven_lanedir_mean0.08174405942753796
driven_lanedir_median0.06764961440318373
driven_lanedir_min0.031163125050107876
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.3700000000000003
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20758257325870597, "sim_physics": 0.11502810426660486, "survival_time": 1.850000000000001, "driven_lanedir": 0.06764961440318373, "sim_render-ego": 0.06213520668648385, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1637249443982099, "deviation-heading": 0.7396387120695755, "set_robot_commands": 0.0851498487833384, "deviation-center-line": 0.05988062769741462, "driven_lanedir_consec": 0.06764961440318373, "sim_compute_sim_state": 0.038930544982085355, "sim_compute_performance-ego": 0.06618240717295054, "sim_compute_robot_state-ego": 0.07183823714385161}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19494332741715545, "sim_physics": 0.11551086107889812, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12003769089090845, "sim_render-ego": 0.0598755677541097, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15996412436167398, "deviation-heading": 0.6960604673835139, "set_robot_commands": 0.09281915823618572, "deviation-center-line": 0.04595955293841583, "driven_lanedir_consec": 0.12003769089090845, "sim_compute_sim_state": 0.03924883206685384, "sim_compute_performance-ego": 0.06790339946746826, "sim_compute_robot_state-ego": 0.07411030133565268}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.07983512896685699, "sim_physics": 0.08087834119796752, "survival_time": 1.0000000000000002, "driven_lanedir": 0.031163125050107876, "sim_render-ego": 0.04409643411636353, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.13013916015625, "deviation-heading": 0.6413040214090833, "set_robot_commands": 0.06736184358596801, "deviation-center-line": 0.07228728063544432, "driven_lanedir_consec": 0.031163125050107876, "sim_compute_sim_state": 0.02943474054336548, "sim_compute_performance-ego": 0.05043606758117676, "sim_compute_robot_state-ego": 0.05418543815612793}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1924719183405686, "sim_physics": 0.11269831657409668, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0571791898980516, "sim_render-ego": 0.06678268217271374, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17584759189236548, "deviation-heading": 0.8102797062752097, "set_robot_commands": 0.11099821521389867, "deviation-center-line": 0.0467803085342057, "driven_lanedir_consec": 0.0571791898980516, "sim_compute_sim_state": 0.08366520943180207, "sim_compute_performance-ego": 0.07453630047459756, "sim_compute_robot_state-ego": 0.08079055816896501}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.23414043196558365, "sim_physics": 0.10849816931618585, "survival_time": 1.800000000000001, "driven_lanedir": 0.13269067689543812, "sim_render-ego": 0.060362941688961454, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.16868547598520914, "deviation-heading": 0.7076820869772857, "set_robot_commands": 0.0898665255970425, "deviation-center-line": 0.05353922704599162, "driven_lanedir_consec": 0.13269067689543812, "sim_compute_sim_state": 0.03742991553412543, "sim_compute_performance-ego": 0.06548131174511379, "sim_compute_robot_state-ego": 0.06767360369364421}}
set_robot_commands_max0.11099821521389867
set_robot_commands_mean0.08923911828328666
set_robot_commands_median0.0898665255970425
set_robot_commands_min0.06736184358596801
sim_compute_performance-ego_max0.07453630047459756
sim_compute_performance-ego_mean0.06490789728826138
sim_compute_performance-ego_median0.06618240717295054
sim_compute_performance-ego_min0.05043606758117676
sim_compute_robot_state-ego_max0.08079055816896501
sim_compute_robot_state-ego_mean0.06971962769964829
sim_compute_robot_state-ego_median0.07183823714385161
sim_compute_robot_state-ego_min0.05418543815612793
sim_compute_sim_state_max0.08366520943180207
sim_compute_sim_state_mean0.045741848511646435
sim_compute_sim_state_median0.038930544982085355
sim_compute_sim_state_min0.02943474054336548
sim_physics_max0.11551086107889812
sim_physics_mean0.1065227584867506
sim_physics_median0.11269831657409668
sim_physics_min0.08087834119796752
sim_render-ego_max0.06678268217271374
sim_render-ego_mean0.05865056648372645
sim_render-ego_median0.060362941688961454
sim_render-ego_min0.04409643411636353
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5400000000000005
survival_time_min1.0000000000000002
No reset possible
242494027Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1040164350658957
error_L20.01700436587691519


No reset possible
242484028Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10569992223446162
error_L20.016952521931323884


No reset possible
242474029Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1138016477386455
error_L20.020892323812484737


No reset possible
242464030Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1084108905153192
error_L20.01915055244104676


No reset possible
242454031Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10092962609094744
error_L20.015567438662365382


No reset possible
242444034Frank (Chude) Qian 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07387472235638162
agent_compute-ego_mean0.06776243373835977
agent_compute-ego_median0.06671712795893352
agent_compute-ego_min0.06208847463130951
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11159967704558035, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.0639638900756836, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07063607094993055, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09488685366133567, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04010172629020584, "sim_compute_performance-ego": 0.07024488314776353, "sim_compute_robot_state-ego": 0.07419886387569803}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11420814593633016, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05980888605117798, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06671712795893352, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09478038549423218, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.039321517944335936, "sim_compute_performance-ego": 0.06505465507507324, "sim_compute_robot_state-ego": 0.07204765876134236}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11151326786388052, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.05780239538712935, "in-drivable-lane": 0, "agent_compute-ego": 0.0654957727952437, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.090634671124545, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.03758197480982, "sim_compute_performance-ego": 0.06671703945506703, "sim_compute_robot_state-ego": 0.06981999223882501}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.101223220427831, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05602602660655975, "in-drivable-lane": 0, "agent_compute-ego": 0.06208847463130951, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.08518689374128978, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03486282626787821, "sim_compute_performance-ego": 0.06647999087969463, "sim_compute_robot_state-ego": 0.06664476792017619}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.1181959691254989, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.061122220495472786, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07387472235638162, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09428653509720512, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.039995820625968605, "sim_compute_performance-ego": 0.06951054282810377, "sim_compute_robot_state-ego": 0.07086284264274266}}
set_robot_commands_max0.09488685366133567
set_robot_commands_mean0.09195506782372156
set_robot_commands_median0.09428653509720512
set_robot_commands_min0.08518689374128978
sim_compute_performance-ego_max0.07024488314776353
sim_compute_performance-ego_mean0.06760142227714044
sim_compute_performance-ego_median0.06671703945506703
sim_compute_performance-ego_min0.06505465507507324
sim_compute_robot_state-ego_max0.07419886387569803
sim_compute_robot_state-ego_mean0.07071482508775687
sim_compute_robot_state-ego_median0.07086284264274266
sim_compute_robot_state-ego_min0.06664476792017619
sim_compute_sim_state_max0.04010172629020584
sim_compute_sim_state_mean0.03837277318764172
sim_compute_sim_state_median0.039321517944335936
sim_compute_sim_state_min0.03486282626787821
sim_physics_max0.1181959691254989
sim_physics_mean0.1113480560798242
sim_physics_median0.11159967704558035
sim_physics_min0.101223220427831
sim_render-ego_max0.0639638900756836
sim_render-ego_mean0.0597446837232047
sim_render-ego_median0.05980888605117798
sim_render-ego_min0.05602602660655975
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
No reset possible
242404039Frank (Chude) Qian 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:07:27
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242374042Leul Shiferaw 🇩🇪PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11179044971560376
error_L20.01930513216973891


No reset possible
242314024Scott HixsonPredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11132477878434434
error_L20.01886465972354833


No reset possible
242294023Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242274022Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242264021Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242254013Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242204017Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242104004Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242094003Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242084002Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242023997Kenechukwu Nnodu 🇨🇦CNN-8logs-60by80-300aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:12:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6491524015194221
survival_time_median7.7499999999999805
deviation-center-line_median0.298159762582589
in-drivable-lane_median2.3499999999999917


other stats
agent_compute-ego_max0.13979810899303804
agent_compute-ego_mean0.12227577906954874
agent_compute-ego_median0.1187941866100959
agent_compute-ego_min0.1167394765337607
deviation-center-line_max0.35748352735032685
deviation-center-line_mean0.2706053587683885
deviation-center-line_min0.1426722627851455
deviation-heading_max1.6310745373495217
deviation-heading_mean1.2601255519307408
deviation-heading_median1.3033231817169522
deviation-heading_min0.9398180550756896
driven_any_max1.6761163956593674
driven_any_mean0.9779301726988652
driven_any_median0.992764740238928
driven_any_min0.22811936416882608
driven_lanedir_consec_max1.2352099622008397
driven_lanedir_consec_mean0.7302314087109985
driven_lanedir_consec_min0.19930484547145577
driven_lanedir_max1.2352099622008397
driven_lanedir_mean0.7302314087109985
driven_lanedir_median0.6491524015194221
driven_lanedir_min0.19930484547145577
in-drivable-lane_max3.4000000000000483
in-drivable-lane_mean1.6300000000000143
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.992764740238928, "sim_physics": 0.10615214070966168, "survival_time": 7.7499999999999805, "driven_lanedir": 0.6491524015194221, "sim_render-ego": 0.043186776868758665, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.13979810899303804, "deviation-heading": 0.9694596828753403, "set_robot_commands": 0.06584599095006143, "deviation-center-line": 0.33616364716269703, "driven_lanedir_consec": 0.6491524015194221, "sim_compute_sim_state": 0.02646426077811949, "sim_compute_performance-ego": 0.04569629853771579, "sim_compute_robot_state-ego": 0.04782005433113344, "sim_compute_robot_state-npc0": 0.04687885469005954, "sim_compute_robot_state-npc1": 0.046975714160550026, "sim_compute_robot_state-npc2": 0.04575025804581181, "sim_compute_robot_state-npc3": 0.0464610222847231}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4029992407055608, "sim_physics": 0.09050892746966818, "survival_time": 3.4499999999999957, "driven_lanedir": 0.37142321755188945, "sim_render-ego": 0.0344750432000644, "in-drivable-lane": 0, "agent_compute-ego": 0.1171731257784194, "deviation-heading": 1.3033231817169522, "set_robot_commands": 0.05403304445570794, "deviation-center-line": 0.21854759396118417, "driven_lanedir_consec": 0.37142321755188945, "sim_compute_sim_state": 0.02214203710141389, "sim_compute_performance-ego": 0.037969108940898506, "sim_compute_robot_state-ego": 0.04022457288659137, "sim_compute_robot_state-npc0": 0.040077986924544624, "sim_compute_robot_state-npc1": 0.03876313264819159, "sim_compute_robot_state-npc2": 0.038589373878810715, "sim_compute_robot_state-npc3": 0.03875874781954116}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.589651122721644, "sim_physics": 0.08535975960065734, "survival_time": 13.250000000000052, "driven_lanedir": 1.2352099622008397, "sim_render-ego": 0.03501664467577664, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.1187941866100959, "deviation-heading": 1.6310745373495217, "set_robot_commands": 0.05410081845409465, "deviation-center-line": 0.298159762582589, "driven_lanedir_consec": 1.2352099622008397, "sim_compute_sim_state": 0.02215164922318369, "sim_compute_performance-ego": 0.03852760926732477, "sim_compute_robot_state-ego": 0.04002250005614083, "sim_compute_robot_state-npc0": 0.04100292943558603, "sim_compute_robot_state-npc1": 0.0388627457168867, "sim_compute_robot_state-npc2": 0.03861392129142329, "sim_compute_robot_state-npc3": 0.0418024369005887}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6761163956593674, "sim_physics": 0.08663078358298854, "survival_time": 13.300000000000054, "driven_lanedir": 1.1960666168113852, "sim_render-ego": 0.03511620912336765, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.1167394765337607, "deviation-heading": 1.4569523026362, "set_robot_commands": 0.05410893250228767, "deviation-center-line": 0.35748352735032685, "driven_lanedir_consec": 1.1960666168113852, "sim_compute_sim_state": 0.023349989625744354, "sim_compute_performance-ego": 0.03804863754071688, "sim_compute_robot_state-ego": 0.04016167418401044, "sim_compute_robot_state-npc0": 0.03961514530325294, "sim_compute_robot_state-npc1": 0.03875484054249929, "sim_compute_robot_state-npc2": 0.03867209047303164, "sim_compute_robot_state-npc3": 0.03868743261896578}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22811936416882608, "sim_physics": 0.08989255021258098, "survival_time": 2.0500000000000007, "driven_lanedir": 0.19930484547145577, "sim_render-ego": 0.036626827426073025, "in-drivable-lane": 0, "agent_compute-ego": 0.11887399743242962, "deviation-heading": 0.9398180550756896, "set_robot_commands": 0.05463023883540456, "deviation-center-line": 0.1426722627851455, "driven_lanedir_consec": 0.19930484547145577, "sim_compute_sim_state": 0.023356106223129645, "sim_compute_performance-ego": 0.03941139942262231, "sim_compute_robot_state-ego": 0.04060751635853837, "sim_compute_robot_state-npc0": 0.04063352724400962, "sim_compute_robot_state-npc1": 0.04039428292251215, "sim_compute_robot_state-npc2": 0.04113325840089379, "sim_compute_robot_state-npc3": 0.04022834940654475}}
set_robot_commands_max0.06584599095006143
set_robot_commands_mean0.05654380503951125
set_robot_commands_median0.05410893250228767
set_robot_commands_min0.05403304445570794
sim_compute_performance-ego_max0.04569629853771579
sim_compute_performance-ego_mean0.03993061074185565
sim_compute_performance-ego_median0.03852760926732477
sim_compute_performance-ego_min0.037969108940898506
sim_compute_robot_state-ego_max0.04782005433113344
sim_compute_robot_state-ego_mean0.0417672635632829
sim_compute_robot_state-ego_median0.04022457288659137
sim_compute_robot_state-ego_min0.04002250005614083
sim_compute_robot_state-npc0_max0.04687885469005954
sim_compute_robot_state-npc0_mean0.04164168871949055
sim_compute_robot_state-npc0_median0.04063352724400962
sim_compute_robot_state-npc0_min0.03961514530325294
sim_compute_robot_state-npc1_max0.046975714160550026
sim_compute_robot_state-npc1_mean0.04075014319812795
sim_compute_robot_state-npc1_median0.0388627457168867
sim_compute_robot_state-npc1_min0.03875484054249929
sim_compute_robot_state-npc2_max0.04575025804581181
sim_compute_robot_state-npc2_mean0.040551780417994246
sim_compute_robot_state-npc2_median0.03867209047303164
sim_compute_robot_state-npc2_min0.038589373878810715
sim_compute_robot_state-npc3_max0.0464610222847231
sim_compute_robot_state-npc3_mean0.041187597806072694
sim_compute_robot_state-npc3_median0.04022834940654475
sim_compute_robot_state-npc3_min0.03868743261896578
sim_compute_sim_state_max0.02646426077811949
sim_compute_sim_state_mean0.023492808590318215
sim_compute_sim_state_median0.023349989625744354
sim_compute_sim_state_min0.02214203710141389
sim_physics_max0.10615214070966168
sim_physics_mean0.09170883231511132
sim_physics_median0.08989255021258098
sim_physics_min0.08535975960065734
sim_render-ego_max0.043186776868758665
sim_render-ego_mean0.03688430025880808
sim_render-ego_median0.03511620912336765
sim_render-ego_min0.0344750432000644
simulation-passed1
survival_time_max13.300000000000054
survival_time_mean7.960000000000017
survival_time_min2.0500000000000007
No reset possible
242003995Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13500147650407524
survival_time_median1.7000000000000008
deviation-center-line_median0.09347815402527108
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13373474847702754
agent_compute-ego_mean0.1248160060647489
agent_compute-ego_median0.1271025573506075
agent_compute-ego_min0.10777777784010945
deviation-center-line_max0.09807564877200577
deviation-center-line_mean0.0908409692147764
deviation-center-line_min0.0761656551873965
deviation-heading_max1.026322316484246
deviation-heading_mean0.8669480645103753
deviation-heading_median0.9392355268045351
deviation-heading_min0.5956093376057996
driven_any_max0.24588078734609584
driven_any_mean0.2006102799716876
driven_any_median0.21535840211668977
driven_any_min0.10610082794214762
driven_lanedir_consec_max0.1933669468962771
driven_lanedir_consec_mean0.1401030533669637
driven_lanedir_consec_min0.07575073737565585
driven_lanedir_max0.1933669468962771
driven_lanedir_mean0.1401030533669637
driven_lanedir_median0.13500147650407524
driven_lanedir_min0.07575073737565585
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.030000000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21535840211668977, "sim_physics": 0.08313416753496443, "survival_time": 1.7500000000000009, "driven_lanedir": 0.12402400378940204, "sim_render-ego": 0.04602439744131906, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1269242559160505, "deviation-heading": 1.026322316484246, "set_robot_commands": 0.0708148683820452, "deviation-center-line": 0.09807564877200577, "driven_lanedir_consec": 0.12402400378940204, "sim_compute_sim_state": 0.02963085174560547, "sim_compute_performance-ego": 0.05155196189880371, "sim_compute_robot_state-ego": 0.052898291179112024}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24588078734609584, "sim_physics": 0.0778801160700181, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1933669468962771, "sim_render-ego": 0.04623878002166748, "in-drivable-lane": 0, "agent_compute-ego": 0.1271025573506075, "deviation-heading": 0.783000417545756, "set_robot_commands": 0.06847026067621567, "deviation-center-line": 0.0761656551873965, "driven_lanedir_consec": 0.1933669468962771, "sim_compute_sim_state": 0.029986234272227567, "sim_compute_performance-ego": 0.05234433622921214, "sim_compute_robot_state-ego": 0.054125379113590014}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10610082794214762, "sim_physics": 0.07846747125898089, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07575073737565585, "sim_render-ego": 0.0457764466603597, "in-drivable-lane": 0, "agent_compute-ego": 0.13373474847702754, "deviation-heading": 0.5956093376057996, "set_robot_commands": 0.06790685653686523, "deviation-center-line": 0.0929654751914286, "driven_lanedir_consec": 0.07575073737565585, "sim_compute_sim_state": 0.02841971034095401, "sim_compute_performance-ego": 0.0486847786676316, "sim_compute_robot_state-ego": 0.051993006751650854}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2335001009317751, "sim_physics": 0.0891603946685791, "survival_time": 1.5000000000000009, "driven_lanedir": 0.17237210226940824, "sim_render-ego": 0.04299335479736328, "in-drivable-lane": 0, "agent_compute-ego": 0.12854069073994953, "deviation-heading": 0.9392355268045351, "set_robot_commands": 0.06133202711741129, "deviation-center-line": 0.09347815402527108, "driven_lanedir_consec": 0.17237210226940824, "sim_compute_sim_state": 0.028332098325093587, "sim_compute_performance-ego": 0.04871930281321208, "sim_compute_robot_state-ego": 0.04915723005930583}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2022112815217296, "sim_physics": 0.08018624081331141, "survival_time": 1.7000000000000008, "driven_lanedir": 0.13500147650407524, "sim_render-ego": 0.039191729882184195, "in-drivable-lane": 0, "agent_compute-ego": 0.10777777784010945, "deviation-heading": 0.9905727241115394, "set_robot_commands": 0.056110045489142925, "deviation-center-line": 0.09351991289778012, "driven_lanedir_consec": 0.13500147650407524, "sim_compute_sim_state": 0.024882211404688215, "sim_compute_performance-ego": 0.04361400884740493, "sim_compute_robot_state-ego": 0.045941219610326434}}
set_robot_commands_max0.0708148683820452
set_robot_commands_mean0.06492681164033606
set_robot_commands_median0.06790685653686523
set_robot_commands_min0.056110045489142925
sim_compute_performance-ego_max0.05234433622921214
sim_compute_performance-ego_mean0.04898287769125289
sim_compute_performance-ego_median0.04871930281321208
sim_compute_performance-ego_min0.04361400884740493
sim_compute_robot_state-ego_max0.054125379113590014
sim_compute_robot_state-ego_mean0.050823025342797035
sim_compute_robot_state-ego_median0.051993006751650854
sim_compute_robot_state-ego_min0.045941219610326434
sim_compute_sim_state_max0.029986234272227567
sim_compute_sim_state_mean0.028250221217713773
sim_compute_sim_state_median0.02841971034095401
sim_compute_sim_state_min0.024882211404688215
sim_physics_max0.0891603946685791
sim_physics_mean0.08176567806917079
sim_physics_median0.08018624081331141
sim_physics_min0.0778801160700181
sim_render-ego_max0.04623878002166748
sim_render-ego_mean0.04404494176057874
sim_render-ego_median0.0457764466603597
sim_render-ego_min0.039191729882184195
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.5400000000000007
survival_time_min1.0500000000000005
No reset possible
241963991Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09103428707701776
survival_time_median1.4000000000000006
deviation-center-line_median0.07347504166725541
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.09854443611637238
agent_compute-ego_mean0.09485947170968062
agent_compute-ego_median0.09409027298291524
agent_compute-ego_min0.09370070119057931
deviation-center-line_max0.1045220519706366
deviation-center-line_mean0.07850302544892365
deviation-center-line_min0.04486851266996518
deviation-heading_max0.9013842713603002
deviation-heading_mean0.7287210431313083
deviation-heading_median0.8008927403046802
deviation-heading_min0.5025545349268744
driven_any_max0.2018261316383413
driven_any_mean0.1614488397293403
driven_any_median0.15047536487366542
driven_any_min0.12455944125342223
driven_lanedir_consec_max0.11903877827275532
driven_lanedir_consec_mean0.0885219379313386
driven_lanedir_consec_min0.0660902909208313
driven_lanedir_max0.11903877827275532
driven_lanedir_mean0.0885219379313386
driven_lanedir_median0.09103428707701776
driven_lanedir_min0.0660902909208313
in-drivable-lane_max0.30000000000000027
in-drivable-lane_mean0.16000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.18592795226350772, "sim_physics": 0.0985280083071801, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07225083220351491, "sim_render-ego": 0.04495601500234296, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09854443611637238, "deviation-heading": 0.9013842713603002, "set_robot_commands": 0.054713118460870555, "deviation-center-line": 0.07347504166725541, "driven_lanedir_consec": 0.07225083220351491, "sim_compute_sim_state": 0.02189280140784479, "sim_compute_performance-ego": 0.03804942869370984, "sim_compute_robot_state-ego": 0.0401391290849255, "sim_compute_robot_state-npc0": 0.039419820231776086, "sim_compute_robot_state-npc1": 0.0388704115344632, "sim_compute_robot_state-npc2": 0.03849018773724956, "sim_compute_robot_state-npc3": 0.03843785870459772}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2018261316383413, "sim_physics": 0.08815604640591529, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0941955011825737, "sim_render-ego": 0.034242606932117094, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09370070119057931, "deviation-heading": 0.9004772329163044, "set_robot_commands": 0.0545677908005253, "deviation-center-line": 0.06569388843425034, "driven_lanedir_consec": 0.0941955011825737, "sim_compute_sim_state": 0.02192492638864825, "sim_compute_performance-ego": 0.037655099745719664, "sim_compute_robot_state-ego": 0.040070495297831875, "sim_compute_robot_state-npc0": 0.0394017388743739, "sim_compute_robot_state-npc1": 0.03876724550800939, "sim_compute_robot_state-npc2": 0.038429006453483336, "sim_compute_robot_state-npc3": 0.03849099528404974}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12455944125342223, "sim_physics": 0.09763179222742716, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09103428707701776, "sim_render-ego": 0.03500562906265259, "in-drivable-lane": 0, "agent_compute-ego": 0.09409027298291524, "deviation-heading": 0.5382964361483829, "set_robot_commands": 0.0541115403175354, "deviation-center-line": 0.10395563250251068, "driven_lanedir_consec": 0.09103428707701776, "sim_compute_sim_state": 0.021876821915308636, "sim_compute_performance-ego": 0.04899753133455912, "sim_compute_robot_state-ego": 0.03994985421498617, "sim_compute_robot_state-npc0": 0.03915905952453613, "sim_compute_robot_state-npc1": 0.03853991627693176, "sim_compute_robot_state-npc2": 0.038557747999827065, "sim_compute_robot_state-npc3": 0.03835801283518473}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15047536487366542, "sim_physics": 0.10246379852294922, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11903877827275532, "sim_render-ego": 0.03515209197998047, "in-drivable-lane": 0, "agent_compute-ego": 0.09418904304504394, "deviation-heading": 0.5025545349268744, "set_robot_commands": 0.05506420135498047, "deviation-center-line": 0.1045220519706366, "driven_lanedir_consec": 0.11903877827275532, "sim_compute_sim_state": 0.02196080207824707, "sim_compute_performance-ego": 0.03750899314880371, "sim_compute_robot_state-ego": 0.04000725746154785, "sim_compute_robot_state-npc0": 0.03945415496826172, "sim_compute_robot_state-npc1": 0.03841639518737793, "sim_compute_robot_state-npc2": 0.03836333274841309, "sim_compute_robot_state-npc3": 0.03836407661437989}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1444553086177646, "sim_physics": 0.08823115485055107, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0660902909208313, "sim_render-ego": 0.03487658500671387, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09377290521349226, "deviation-heading": 0.8008927403046802, "set_robot_commands": 0.05380064249038696, "deviation-center-line": 0.04486851266996518, "driven_lanedir_consec": 0.0660902909208313, "sim_compute_sim_state": 0.022076972893306183, "sim_compute_performance-ego": 0.03757727997643607, "sim_compute_robot_state-ego": 0.039757771151406426, "sim_compute_robot_state-npc0": 0.03945342983518328, "sim_compute_robot_state-npc1": 0.03850806610924857, "sim_compute_robot_state-npc2": 0.03844536202294486, "sim_compute_robot_state-npc3": 0.038510773863111226}}
set_robot_commands_max0.05506420135498047
set_robot_commands_mean0.054451458684859746
set_robot_commands_median0.0545677908005253
set_robot_commands_min0.05380064249038696
sim_compute_performance-ego_max0.04899753133455912
sim_compute_performance-ego_mean0.03995766657984568
sim_compute_performance-ego_median0.037655099745719664
sim_compute_performance-ego_min0.03750899314880371
sim_compute_robot_state-ego_max0.0401391290849255
sim_compute_robot_state-ego_mean0.03998490144213957
sim_compute_robot_state-ego_median0.04000725746154785
sim_compute_robot_state-ego_min0.039757771151406426
sim_compute_robot_state-npc0_max0.03945415496826172
sim_compute_robot_state-npc0_mean0.03937764068682622
sim_compute_robot_state-npc0_median0.039419820231776086
sim_compute_robot_state-npc0_min0.03915905952453613
sim_compute_robot_state-npc1_max0.0388704115344632
sim_compute_robot_state-npc1_mean0.03862040692320617
sim_compute_robot_state-npc1_median0.03853991627693176
sim_compute_robot_state-npc1_min0.03841639518737793
sim_compute_robot_state-npc2_max0.038557747999827065
sim_compute_robot_state-npc2_mean0.03845712739238358
sim_compute_robot_state-npc2_median0.03844536202294486
sim_compute_robot_state-npc2_min0.03836333274841309
sim_compute_robot_state-npc3_max0.038510773863111226
sim_compute_robot_state-npc3_mean0.038432343460264654
sim_compute_robot_state-npc3_median0.03843785870459772
sim_compute_robot_state-npc3_min0.03835801283518473
sim_compute_sim_state_max0.022076972893306183
sim_compute_sim_state_mean0.021946464936670983
sim_compute_sim_state_median0.02192492638864825
sim_compute_sim_state_min0.021876821915308636
sim_physics_max0.10246379852294922
sim_physics_mean0.09500216006280456
sim_physics_median0.09763179222742716
sim_physics_min0.08815604640591529
sim_render-ego_max0.04495601500234296
sim_render-ego_mean0.03684658559676139
sim_render-ego_median0.03500562906265259
sim_render-ego_min0.034242606932117094
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3900000000000006
survival_time_min1.2000000000000004
No reset possible
241953983Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:03:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241913987Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:13:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07146177434456735
survival_time_median1.5500000000000007
deviation-center-line_median0.09820782984989168
in-drivable-lane_median0.6000000000000004


other stats
agent_compute-ego_max0.16060907610001102
agent_compute-ego_mean0.1555725130309395
agent_compute-ego_median0.15475966612497966
agent_compute-ego_min0.15204803148905435
deviation-center-line_max0.5200348808056056
deviation-center-line_mean0.17415405516010057
deviation-center-line_min0.025131035096672444
deviation-heading_max6.105377691907242
deviation-heading_mean2.1592233310877096
deviation-heading_median0.6474877438208156
deviation-heading_min0.5710291486499823
driven_any_max1.942029678670349
driven_any_mean0.6349466193437678
driven_any_median0.1402937237589409
driven_any_min0.115556871569795
driven_lanedir_consec_max0.7049888387731444
driven_lanedir_consec_mean0.23792754022849713
driven_lanedir_consec_min0.04709428225818912
driven_lanedir_max0.7049888387731444
driven_lanedir_mean0.23792754022849713
driven_lanedir_median0.07146177434456735
driven_lanedir_min0.04709428225818912
in-drivable-lane_max6.800000000000031
in-drivable-lane_mean2.140000000000005
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8606932970119399, "sim_physics": 0.1676585353012626, "survival_time": 7.049999999999983, "driven_lanedir": 0.2978622256185588, "sim_render-ego": 0.06106623182905481, "in-drivable-lane": 3.1499999999999924, "agent_compute-ego": 0.1577698051506746, "deviation-heading": 2.8559928359992424, "set_robot_commands": 0.0871270108730235, "deviation-center-line": 0.14104270650948947, "driven_lanedir_consec": 0.2978622256185588, "sim_compute_sim_state": 0.038335732534422094, "sim_compute_performance-ego": 0.068674513634215, "sim_compute_robot_state-ego": 0.07341446775071164, "sim_compute_robot_state-npc0": 0.06486501930453253, "sim_compute_robot_state-npc1": 0.0643276221363257, "sim_compute_robot_state-npc2": 0.06501558824633875, "sim_compute_robot_state-npc3": 0.0658463180487883}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.942029678670349, "sim_physics": 0.1440636126200358, "survival_time": 14.950000000000076, "driven_lanedir": 0.7049888387731444, "sim_render-ego": 0.05833797216415405, "in-drivable-lane": 6.800000000000031, "agent_compute-ego": 0.15475966612497966, "deviation-heading": 6.105377691907242, "set_robot_commands": 0.08509961684544881, "deviation-center-line": 0.5200348808056056, "driven_lanedir_consec": 0.7049888387731444, "sim_compute_sim_state": 0.035726904074350994, "sim_compute_performance-ego": 0.06546767632166545, "sim_compute_robot_state-ego": 0.06671229521433512, "sim_compute_robot_state-npc0": 0.06244592348734538, "sim_compute_robot_state-npc1": 0.062186246713002526, "sim_compute_robot_state-npc2": 0.06081218242645264, "sim_compute_robot_state-npc3": 0.06124133268992106}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.115556871569795, "sim_physics": 0.17407425244649252, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07146177434456735, "sim_render-ego": 0.05858718355496725, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15267598628997803, "deviation-heading": 0.6162292350612638, "set_robot_commands": 0.08865949511528015, "deviation-center-line": 0.09820782984989168, "driven_lanedir_consec": 0.07146177434456735, "sim_compute_sim_state": 0.03710872928301493, "sim_compute_performance-ego": 0.06157435973485311, "sim_compute_robot_state-ego": 0.0642133355140686, "sim_compute_robot_state-npc0": 0.06425828735033672, "sim_compute_robot_state-npc1": 0.06738489866256714, "sim_compute_robot_state-npc2": 0.06444990634918213, "sim_compute_robot_state-npc3": 0.06732812523841858}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.11615952570781404, "sim_physics": 0.15970670183499655, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06823058014802585, "sim_render-ego": 0.05923012892405192, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15204803148905435, "deviation-heading": 0.5710291486499823, "set_robot_commands": 0.08405160903930664, "deviation-center-line": 0.08635382353884369, "driven_lanedir_consec": 0.06823058014802585, "sim_compute_sim_state": 0.034205387036005654, "sim_compute_performance-ego": 0.06282452742258708, "sim_compute_robot_state-ego": 0.06609043478965759, "sim_compute_robot_state-npc0": 0.06006335218747457, "sim_compute_robot_state-npc1": 0.06309638420740764, "sim_compute_robot_state-npc2": 0.06406288345654805, "sim_compute_robot_state-npc3": 0.058907767136891685}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1402937237589409, "sim_physics": 0.14049113181329542, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04709428225818912, "sim_render-ego": 0.05883980566455472, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.16060907610001102, "deviation-heading": 0.6474877438208156, "set_robot_commands": 0.08471695838436004, "deviation-center-line": 0.025131035096672444, "driven_lanedir_consec": 0.04709428225818912, "sim_compute_sim_state": 0.03679993075709189, "sim_compute_performance-ego": 0.06178972028916882, "sim_compute_robot_state-ego": 0.06520485108898531, "sim_compute_robot_state-npc0": 0.06419608669896279, "sim_compute_robot_state-npc1": 0.06608050869357202, "sim_compute_robot_state-npc2": 0.06452193567829748, "sim_compute_robot_state-npc3": 0.06289558256826093}}
set_robot_commands_max0.08865949511528015
set_robot_commands_mean0.08593093805148383
set_robot_commands_median0.08509961684544881
set_robot_commands_min0.08405160903930664
sim_compute_performance-ego_max0.068674513634215
sim_compute_performance-ego_mean0.0640661594804979
sim_compute_performance-ego_median0.06282452742258708
sim_compute_performance-ego_min0.06157435973485311
sim_compute_robot_state-ego_max0.07341446775071164
sim_compute_robot_state-ego_mean0.06712707687155166
sim_compute_robot_state-ego_median0.06609043478965759
sim_compute_robot_state-ego_min0.0642133355140686
sim_compute_robot_state-npc0_max0.06486501930453253
sim_compute_robot_state-npc0_mean0.06316573380573039
sim_compute_robot_state-npc0_median0.06419608669896279
sim_compute_robot_state-npc0_min0.06006335218747457
sim_compute_robot_state-npc1_max0.06738489866256714
sim_compute_robot_state-npc1_mean0.064615132082575
sim_compute_robot_state-npc1_median0.0643276221363257
sim_compute_robot_state-npc1_min0.062186246713002526
sim_compute_robot_state-npc2_max0.06501558824633875
sim_compute_robot_state-npc2_mean0.06377249923136381
sim_compute_robot_state-npc2_median0.06444990634918213
sim_compute_robot_state-npc2_min0.06081218242645264
sim_compute_robot_state-npc3_max0.06732812523841858
sim_compute_robot_state-npc3_mean0.06324382513645611
sim_compute_robot_state-npc3_median0.06289558256826093
sim_compute_robot_state-npc3_min0.058907767136891685
sim_compute_sim_state_max0.038335732534422094
sim_compute_sim_state_mean0.03643533673697712
sim_compute_sim_state_median0.03679993075709189
sim_compute_sim_state_min0.034205387036005654
sim_physics_max0.17407425244649252
sim_physics_mean0.15719884680321658
sim_physics_median0.15970670183499655
sim_physics_min0.14049113181329542
sim_render-ego_max0.06106623182905481
sim_render-ego_mean0.059212264427356553
sim_render-ego_median0.05883980566455472
sim_render-ego_min0.05833797216415405
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.190000000000012
survival_time_min1.2000000000000004
No reset possible
241753958Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:04:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241733959Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1173463944928188
survival_time_median1.4500000000000006
deviation-center-line_median0.08130657099986943
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17554755210876466
agent_compute-ego_mean0.1575145538931596
agent_compute-ego_median0.1561292944283321
agent_compute-ego_min0.14622875360342172
deviation-center-line_max0.08852313630411515
deviation-center-line_mean0.07789499700688966
deviation-center-line_min0.06089457356967892
deviation-heading_max0.966259800659606
deviation-heading_mean0.8167423095226483
deviation-heading_median0.8148900608222223
deviation-heading_min0.6147916915952095
driven_any_max0.23691052383568212
driven_any_mean0.19149548732735375
driven_any_median0.20967115839525363
driven_any_min0.1023272008529338
driven_lanedir_consec_max0.1625563878937013
driven_lanedir_consec_mean0.12148942792311748
driven_lanedir_consec_min0.06473575684808974
driven_lanedir_max0.1625563878937013
driven_lanedir_mean0.12148942792311748
driven_lanedir_median0.1173463944928188
driven_lanedir_min0.06473575684808974
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21028901847479736, "sim_physics": 0.12450808684031169, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11426161755672704, "sim_render-ego": 0.07786980470021566, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17554755210876466, "deviation-heading": 0.9171186957686566, "set_robot_commands": 0.09257846673329671, "deviation-center-line": 0.08560118198542152, "driven_lanedir_consec": 0.11426161755672704, "sim_compute_sim_state": 0.03615020116170247, "sim_compute_performance-ego": 0.06908659934997559, "sim_compute_robot_state-ego": 0.08005922635396322}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23691052383568212, "sim_physics": 0.10106054219332608, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1625563878937013, "sim_render-ego": 0.0587959217302727, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16107242035143304, "deviation-heading": 0.8148900608222223, "set_robot_commands": 0.0881774497754646, "deviation-center-line": 0.06089457356967892, "driven_lanedir_consec": 0.1625563878937013, "sim_compute_sim_state": 0.03738436554417466, "sim_compute_performance-ego": 0.06548928491996997, "sim_compute_robot_state-ego": 0.06782144488710345}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1023272008529338, "sim_physics": 0.10855575799942016, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06473575684808974, "sim_render-ego": 0.05670520067214966, "in-drivable-lane": 0, "agent_compute-ego": 0.14859474897384645, "deviation-heading": 0.6147916915952095, "set_robot_commands": 0.08407092094421387, "deviation-center-line": 0.08852313630411515, "driven_lanedir_consec": 0.06473575684808974, "sim_compute_sim_state": 0.03782958984375, "sim_compute_performance-ego": 0.060715782642364505, "sim_compute_robot_state-ego": 0.06124976873397827}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1982795350781019, "sim_physics": 0.11382654997018668, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1173463944928188, "sim_render-ego": 0.05634486675262451, "in-drivable-lane": 0, "agent_compute-ego": 0.14622875360342172, "deviation-heading": 0.966259800659606, "set_robot_commands": 0.0824439158806434, "deviation-center-line": 0.08130657099986943, "driven_lanedir_consec": 0.1173463944928188, "sim_compute_sim_state": 0.03672404472644512, "sim_compute_performance-ego": 0.05866836584531344, "sim_compute_robot_state-ego": 0.06412026515373817}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20967115839525363, "sim_physics": 0.11195031527815194, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1485469828242505, "sim_render-ego": 0.05472037709992507, "in-drivable-lane": 0, "agent_compute-ego": 0.1561292944283321, "deviation-heading": 0.7706512987675468, "set_robot_commands": 0.08358370024582436, "deviation-center-line": 0.07314952217536333, "driven_lanedir_consec": 0.1485469828242505, "sim_compute_sim_state": 0.034836588234737, "sim_compute_performance-ego": 0.06206196752087823, "sim_compute_robot_state-ego": 0.06510832391936204}}
set_robot_commands_max0.09257846673329671
set_robot_commands_mean0.08617089071588858
set_robot_commands_median0.08407092094421387
set_robot_commands_min0.0824439158806434
sim_compute_performance-ego_max0.06908659934997559
sim_compute_performance-ego_mean0.06320440005570034
sim_compute_performance-ego_median0.06206196752087823
sim_compute_performance-ego_min0.05866836584531344
sim_compute_robot_state-ego_max0.08005922635396322
sim_compute_robot_state-ego_mean0.06767180580962903
sim_compute_robot_state-ego_median0.06510832391936204
sim_compute_robot_state-ego_min0.06124976873397827
sim_compute_sim_state_max0.03782958984375
sim_compute_sim_state_mean0.03658495790216185
sim_compute_sim_state_median0.03672404472644512
sim_compute_sim_state_min0.034836588234737
sim_physics_max0.12450808684031169
sim_physics_mean0.11198025045627932
sim_physics_median0.11195031527815194
sim_physics_min0.10106054219332608
sim_render-ego_max0.07786980470021566
sim_render-ego_mean0.06088723419103752
sim_render-ego_median0.05670520067214966
sim_render-ego_min0.05472037709992507
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.3800000000000003
survival_time_min1.0000000000000002
No reset possible
241703964Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:15:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.17936025855289817
survival_time_median1.4000000000000006
deviation-center-line_median0.09708644074530565
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1886042356491089
agent_compute-ego_mean0.16255350838944002
agent_compute-ego_median0.1613065997759501
agent_compute-ego_min0.1297280192375183
deviation-center-line_max0.12341601105462724
deviation-center-line_mean0.09685347038459828
deviation-center-line_min0.05797792697912947
deviation-heading_max1.0592490920783189
deviation-heading_mean0.6765103124740133
deviation-heading_median0.6922725404679463
deviation-heading_min0.4053793220622803
driven_any_max0.35627781537910846
driven_any_mean0.22359049981023343
driven_any_median0.20921291960226565
driven_any_min0.14676607039500444
driven_lanedir_consec_max0.29822512704750803
driven_lanedir_consec_mean0.1756226449002365
driven_lanedir_consec_min0.1130676053863513
driven_lanedir_max0.29822512704750803
driven_lanedir_mean0.1756226449002365
driven_lanedir_median0.17936025855289817
driven_lanedir_min0.1130676053863513
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.003333333333333336
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.23579476020261456, "sim_physics": 0.19333495299021403, "survival_time": 1.5000000000000009, "driven_lanedir": 0.15796808196981127, "sim_render-ego": 0.05521849791208903, "in-drivable-lane": 0, "agent_compute-ego": 0.16232415040334067, "deviation-heading": 0.9080098114650692, "set_robot_commands": 0.08827861150105794, "deviation-center-line": 0.09708644074530565, "driven_lanedir_consec": 0.15796808196981127, "sim_compute_sim_state": 0.03679037094116211, "sim_compute_performance-ego": 0.06522380510965983, "sim_compute_robot_state-ego": 0.07292789618174235, "sim_compute_robot_state-npc0": 0.06611181100209554, "sim_compute_robot_state-npc1": 0.06499384244283041, "sim_compute_robot_state-npc2": 0.07075115044911702, "sim_compute_robot_state-npc3": 0.06996377309163411}, "udem1-1-0": {"driven_any": 0.20320264893367565, "sim_physics": 0.19019656711154517, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1130676053863513, "sim_render-ego": 0.060755270498770254, "in-drivable-lane": 0, "agent_compute-ego": 0.15227486469127513, "deviation-heading": 1.0592490920783189, "set_robot_commands": 0.0869563862129494, "deviation-center-line": 0.09148243006180272, "driven_lanedir_consec": 0.1130676053863513, "sim_compute_sim_state": 0.040322445057056566, "sim_compute_performance-ego": 0.06695216673391836, "sim_compute_robot_state-ego": 0.06362081457067419, "sim_compute_robot_state-npc0": 0.06425015131632487, "sim_compute_robot_state-npc1": 0.06426267270688657, "sim_compute_robot_state-npc2": 0.05938362192224573, "sim_compute_robot_state-npc3": 0.06424245127925167}, "udem1-2-0": {"driven_any": 0.20380318813798484, "sim_physics": 0.24588819650503305, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18057193799716664, "sim_render-ego": 0.06155106654533973, "in-drivable-lane": 0, "agent_compute-ego": 0.17700595122117263, "deviation-heading": 0.4081718850052205, "set_robot_commands": 0.0978408593397874, "deviation-center-line": 0.12074350072278324, "driven_lanedir_consec": 0.18057193799716664, "sim_compute_sim_state": 0.03898540826944205, "sim_compute_performance-ego": 0.06753117304581863, "sim_compute_robot_state-ego": 0.07438155320974496, "sim_compute_robot_state-npc0": 0.06881980712597187, "sim_compute_robot_state-npc1": 0.06934010982513428, "sim_compute_robot_state-npc2": 0.06802655183351956, "sim_compute_robot_state-npc3": 0.06542680813716008}, "udem1-3-0": {"driven_any": 0.24483696923572004, "sim_physics": 0.19645270807989712, "survival_time": 1.4500000000000006, "driven_lanedir": 0.21284385987680188, "sim_render-ego": 0.06383727336752004, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16144625071821542, "deviation-heading": 0.4053793220622803, "set_robot_commands": 0.09210349773538525, "deviation-center-line": 0.12097630888718072, "driven_lanedir_consec": 0.21284385987680188, "sim_compute_sim_state": 0.03613416901950178, "sim_compute_performance-ego": 0.0710220090274153, "sim_compute_robot_state-ego": 0.07203688292667784, "sim_compute_robot_state-npc0": 0.07000687204558274, "sim_compute_robot_state-npc1": 0.06514477729797363, "sim_compute_robot_state-npc2": 0.06072905967975485, "sim_compute_robot_state-npc3": 0.0572624946462697}, "udem1-4-0": {"driven_any": 0.17720936396218126, "sim_physics": 0.19787264863650003, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12931117307408857, "sim_render-ego": 0.06160968542098999, "in-drivable-lane": 0, "agent_compute-ego": 0.15771469473838806, "deviation-heading": 0.6922725404679463, "set_robot_commands": 0.09791415929794312, "deviation-center-line": 0.0638666557147622, "driven_lanedir_consec": 0.12931117307408857, "sim_compute_sim_state": 0.04042185346285502, "sim_compute_performance-ego": 0.06882428129514058, "sim_compute_robot_state-ego": 0.07101779182751973, "sim_compute_robot_state-npc0": 0.06534675757090251, "sim_compute_robot_state-npc1": 0.07285383343696594, "sim_compute_robot_state-npc2": 0.06907065709431966, "sim_compute_robot_state-npc3": 0.07073378562927246}, "udem1-5-0": {"driven_any": 0.35627781537910846, "sim_physics": 0.19316827945220164, "survival_time": 1.950000000000001, "driven_lanedir": 0.29822512704750803, "sim_render-ego": 0.06402840369786972, "in-drivable-lane": 0, "agent_compute-ego": 0.17296352141942734, "deviation-heading": 0.8630060737823859, "set_robot_commands": 0.09175573251186273, "deviation-center-line": 0.11465523612918252, "driven_lanedir_consec": 0.29822512704750803, "sim_compute_sim_state": 0.03932508444174742, "sim_compute_performance-ego": 0.06862192276196602, "sim_compute_robot_state-ego": 0.07539656834724622, "sim_compute_robot_state-npc0": 0.06952736927912785, "sim_compute_robot_state-npc1": 0.07143790293962528, "sim_compute_robot_state-npc2": 0.06788421899844439, "sim_compute_robot_state-npc3": 0.06956213559859838}, "udem1-6-0": {"driven_any": 0.1877413005213298, "sim_physics": 0.18856299916903177, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1558162105759866, "sim_render-ego": 0.05048587918281555, "in-drivable-lane": 0, "agent_compute-ego": 0.1297280192375183, "deviation-heading": 0.4862609758451484, "set_robot_commands": 0.06787663698196411, "deviation-center-line": 0.09542367316869196, "driven_lanedir_consec": 0.1558162105759866, "sim_compute_sim_state": 0.032961895068486534, "sim_compute_performance-ego": 0.05395974715550741, "sim_compute_robot_state-ego": 0.05788166324297587, "sim_compute_robot_state-npc0": 0.055108447869618736, "sim_compute_robot_state-npc1": 0.055827091137568154, "sim_compute_robot_state-npc2": 0.05769388874371847, "sim_compute_robot_state-npc3": 0.056799362103144325}, "udem1-7-0": {"driven_any": 0.20921291960226565, "sim_physics": 0.20340645754778827, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17936025855289817, "sim_render-ego": 0.05908625214188187, "in-drivable-lane": 0, "agent_compute-ego": 0.14620867481938116, "deviation-heading": 0.5105276571185644, "set_robot_commands": 0.08025766302038122, "deviation-center-line": 0.11152915772838728, "driven_lanedir_consec": 0.17936025855289817, "sim_compute_sim_state": 0.03530297455964265, "sim_compute_performance-ego": 0.06328754071836118, "sim_compute_robot_state-ego": 0.06371902536462855, "sim_compute_robot_state-npc0": 0.06073088116115994, "sim_compute_robot_state-npc1": 0.05980684139110424, "sim_compute_robot_state-npc2": 0.059475713306003146, "sim_compute_robot_state-npc3": 0.05932613655372902}, "udem1-8-0": {"driven_any": 0.20730821649567988, "sim_physics": 0.18796583811442055, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14657137290761213, "sim_render-ego": 0.06138500372568766, "in-drivable-lane": 0, "agent_compute-ego": 0.18140757083892825, "deviation-heading": 0.8281639837843198, "set_robot_commands": 0.08880741596221924, "deviation-center-line": 0.07326062201892533, "driven_lanedir_consec": 0.14657137290761213, "sim_compute_sim_state": 0.040300973256429035, "sim_compute_performance-ego": 0.06962114969889323, "sim_compute_robot_state-ego": 0.07729551792144776, "sim_compute_robot_state-npc0": 0.06092475255330403, "sim_compute_robot_state-npc1": 0.07464617093404134, "sim_compute_robot_state-npc2": 0.06847843329111734, "sim_compute_robot_state-npc3": 0.06705987453460693}, "udem1-9-0": {"driven_any": 0.23257586339389705, "sim_physics": 0.2285673107419695, "survival_time": 1.4000000000000006, "driven_lanedir": 0.18485765709412205, "sim_render-ego": 0.05893785612923758, "in-drivable-lane": 0, "agent_compute-ego": 0.15874783481870378, "deviation-heading": 0.7504580247963909, "set_robot_commands": 0.09391022580010552, "deviation-center-line": 0.07494748969837904, "driven_lanedir_consec": 0.18485765709412205, "sim_compute_sim_state": 0.04062385218484061, "sim_compute_performance-ego": 0.0643782104764666, "sim_compute_robot_state-ego": 0.06841410057885307, "sim_compute_robot_state-npc0": 0.06487103019441877, "sim_compute_robot_state-npc1": 0.06617950541632515, "sim_compute_robot_state-npc2": 0.06780705281666347, "sim_compute_robot_state-npc3": 0.0658777015549796}, "udem1-10-0": {"driven_any": 0.1819260291319965, "sim_physics": 0.19317898154258728, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13075085236402706, "sim_render-ego": 0.06040326754252116, "in-drivable-lane": 0, "agent_compute-ego": 0.1613065997759501, "deviation-heading": 0.7357306113386274, "set_robot_commands": 0.08487412333488464, "deviation-center-line": 0.05797792697912947, "driven_lanedir_consec": 0.13075085236402706, "sim_compute_sim_state": 0.03788940111796061, "sim_compute_performance-ego": 0.0641375184059143, "sim_compute_robot_state-ego": 0.0634571115175883, "sim_compute_robot_state-npc0": 0.06437504291534424, "sim_compute_robot_state-npc1": 0.06388988097508748, "sim_compute_robot_state-npc2": 0.060592194398244224, "sim_compute_robot_state-npc3": 0.06488218903541565}, "udem1-11-0": {"driven_any": 0.14676607039500444, "sim_physics": 0.1824332909150557, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11713116028757664, "sim_render-ego": 0.06017588485370983, "in-drivable-lane": 0, "agent_compute-ego": 0.15179563652385364, "deviation-heading": 0.4875222646218349, "set_robot_commands": 0.08530980890447443, "deviation-center-line": 0.09798103554681388, "driven_lanedir_consec": 0.11713116028757664, "sim_compute_sim_state": 0.037645849314602936, "sim_compute_performance-ego": 0.06278737024827437, "sim_compute_robot_state-ego": 0.06692695617675781, "sim_compute_robot_state-npc0": 0.06807448647238991, "sim_compute_robot_state-npc1": 0.06365292722528632, "sim_compute_robot_state-npc2": 0.060471328822049225, "sim_compute_robot_state-npc3": 0.061105262149464}, "udem1-12-0": {"driven_any": 0.28105391361126775, "sim_physics": 0.22695302282060895, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2034192718431933, "sim_render-ego": 0.06317354610988073, "in-drivable-lane": 0, "agent_compute-ego": 0.1828521864754813, "deviation-heading": 0.9296058691932696, "set_robot_commands": 0.0944192750113351, "deviation-center-line": 0.1138620899288437, "driven_lanedir_consec": 0.2034192718431933, "sim_compute_sim_state": 0.03925652503967285, "sim_compute_performance-ego": 0.0695728029523577, "sim_compute_robot_state-ego": 0.07589712142944335, "sim_compute_robot_state-npc0": 0.06880971363612584, "sim_compute_robot_state-npc1": 0.06922625132969447, "sim_compute_robot_state-npc2": 0.06718613760811942, "sim_compute_robot_state-npc3": 0.06656340871538435}, "udem1-13-0": {"driven_any": 0.24282372757293413, "sim_physics": 0.1825281340500404, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2185645234991722, "sim_render-ego": 0.05802263884708799, "in-drivable-lane": 0, "agent_compute-ego": 0.15392243451085583, "deviation-heading": 0.4616363755948083, "set_robot_commands": 0.08973632187678895, "deviation-center-line": 0.12341601105462724, "driven_lanedir_consec": 0.2185645234991722, "sim_compute_sim_state": 0.03423213136607203, "sim_compute_performance-ego": 0.06572871372617524, "sim_compute_robot_state-ego": 0.06737161504811254, "sim_compute_robot_state-npc0": 0.06177870980624495, "sim_compute_robot_state-npc1": 0.06577768819085483, "sim_compute_robot_state-npc2": 0.06407816656704607, "sim_compute_robot_state-npc3": 0.06421360476263638}, "udem1-14-0": {"driven_any": 0.2433247105778423, "sim_physics": 0.2194858471552531, "survival_time": 1.5000000000000009, "driven_lanedir": 0.20588058102723128, "sim_render-ego": 0.06826727390289307, "in-drivable-lane": 0, "agent_compute-ego": 0.1886042356491089, "deviation-heading": 0.6216601999560148, "set_robot_commands": 0.09847163359324138, "deviation-center-line": 0.09559347738415924, "driven_lanedir_consec": 0.20588058102723128, "sim_compute_sim_state": 0.04056087334950765, "sim_compute_performance-ego": 0.0744309663772583, "sim_compute_robot_state-ego": 0.08548933664957682, "sim_compute_robot_state-npc0": 0.06656737327575683, "sim_compute_robot_state-npc1": 0.0668702522913615, "sim_compute_robot_state-npc2": 0.06861433982849122, "sim_compute_robot_state-npc3": 0.07288192907969157}}
set_robot_commands_max0.09847163359324138
set_robot_commands_mean0.08923415673895871
set_robot_commands_median0.08973632187678895
set_robot_commands_min0.06787663698196411
sim_compute_performance-ego_max0.0744309663772583
sim_compute_performance-ego_mean0.06640529184887514
sim_compute_performance-ego_median0.06695216673391836
sim_compute_performance-ego_min0.05395974715550741
sim_compute_robot_state-ego_max0.08548933664957682
sim_compute_robot_state-ego_mean0.07038893033286596
sim_compute_robot_state-ego_median0.07101779182751973
sim_compute_robot_state-ego_min0.05788166324297587
sim_compute_robot_state-npc0_max0.07000687204558274
sim_compute_robot_state-npc0_mean0.06502021374829123
sim_compute_robot_state-npc0_median0.06534675757090251
sim_compute_robot_state-npc0_min0.055108447869618736
sim_compute_robot_state-npc1_max0.07464617093404134
sim_compute_robot_state-npc1_mean0.0662606498360493
sim_compute_robot_state-npc1_median0.06577768819085483
sim_compute_robot_state-npc1_min0.055827091137568154
sim_compute_robot_state-npc2_max0.07075115044911702
sim_compute_robot_state-npc2_mean0.06468283435725691
sim_compute_robot_state-npc2_median0.06718613760811942
sim_compute_robot_state-npc2_min0.05769388874371847
sim_compute_robot_state-npc3_max0.07288192907969157
sim_compute_robot_state-npc3_mean0.06506006112474921
sim_compute_robot_state-npc3_median0.06542680813716008
sim_compute_robot_state-npc3_min0.056799362103144325
sim_compute_sim_state_max0.04062385218484061
sim_compute_sim_state_mean0.03805025376326532
sim_compute_sim_state_median0.03898540826944205
sim_compute_sim_state_min0.032961895068486534
sim_physics_max0.24588819650503305
sim_physics_mean0.2019996823221431
sim_physics_median0.19333495299021403
sim_physics_min0.1824332909150557
sim_render-ego_max0.06826727390289307
sim_render-ego_mean0.06046251999188628
sim_render-ego_median0.060755270498770254
sim_render-ego_min0.05048587918281555
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.4133333333333338
survival_time_min1.1000000000000003
No reset possible
241663955Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08258472576149511
survival_time_median1.2000000000000004
deviation-center-line_median0.06470910686335131
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13219820459683737
agent_compute-ego_mean0.12729924812902862
agent_compute-ego_median0.1278234286741777
agent_compute-ego_min0.11944710124622691
deviation-center-line_max0.09563817321808844
deviation-center-line_mean0.07383801819164318
deviation-center-line_min0.05370163102480888
deviation-heading_max0.8598728343355607
deviation-heading_mean0.6838311478963103
deviation-heading_median0.7216060600533464
deviation-heading_min0.5039361222611668
driven_any_max0.2301571669272056
driven_any_mean0.1585928458767151
driven_any_median0.1392677637202442
driven_any_min0.11225536755816816
driven_lanedir_consec_max0.09807774570084817
driven_lanedir_consec_mean0.07932298033490275
driven_lanedir_consec_min0.044014170759389515
driven_lanedir_max0.09807774570084817
driven_lanedir_mean0.07932298033490275
driven_lanedir_median0.08258472576149511
driven_lanedir_min0.044014170759389515
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.2500000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2301571669272056, "sim_physics": 0.13015250257543615, "survival_time": 1.850000000000001, "driven_lanedir": 0.09807774570084817, "sim_render-ego": 0.04943788373792494, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1306811667777397, "deviation-heading": 0.7216060600533464, "set_robot_commands": 0.07425433236199457, "deviation-center-line": 0.06470910686335131, "driven_lanedir_consec": 0.09807774570084817, "sim_compute_sim_state": 0.02904821086574245, "sim_compute_performance-ego": 0.05459990372528901, "sim_compute_robot_state-ego": 0.05548690460823678, "sim_compute_robot_state-npc0": 0.05245100485311972, "sim_compute_robot_state-npc1": 0.05248973176286027, "sim_compute_robot_state-npc2": 0.05118297886204075, "sim_compute_robot_state-npc3": 0.051107503272391656}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18572062038559808, "sim_physics": 0.10648352449590508, "survival_time": 1.6500000000000008, "driven_lanedir": 0.044014170759389515, "sim_render-ego": 0.04136149811022209, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.11944710124622691, "deviation-heading": 0.7950848129663886, "set_robot_commands": 0.059123537757179954, "deviation-center-line": 0.05370163102480888, "driven_lanedir_consec": 0.044014170759389515, "sim_compute_sim_state": 0.025744365923332447, "sim_compute_performance-ego": 0.04658019181453821, "sim_compute_robot_state-ego": 0.048639160214048446, "sim_compute_robot_state-npc0": 0.04619655464634751, "sim_compute_robot_state-npc1": 0.045867537007187355, "sim_compute_robot_state-npc2": 0.04551775527722908, "sim_compute_robot_state-npc3": 0.04468917124199145}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11225536755816816, "sim_physics": 0.12571154941212048, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07973049862663606, "sim_render-ego": 0.04815646735104648, "in-drivable-lane": 0, "agent_compute-ego": 0.1278234286741777, "deviation-heading": 0.5039361222611668, "set_robot_commands": 0.07082749496806752, "deviation-center-line": 0.09309050451942784, "driven_lanedir_consec": 0.07973049862663606, "sim_compute_sim_state": 0.028899853879755192, "sim_compute_performance-ego": 0.0515926642851396, "sim_compute_robot_state-ego": 0.0559422644701871, "sim_compute_robot_state-npc0": 0.05118878321214155, "sim_compute_robot_state-npc1": 0.05444982918826016, "sim_compute_robot_state-npc2": 0.05197585712779652, "sim_compute_robot_state-npc3": 0.052249366586858574}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.12556331079235947, "sim_physics": 0.13040946877521015, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0922077608261449, "sim_render-ego": 0.04080974537393321, "in-drivable-lane": 0, "agent_compute-ego": 0.12634633935016135, "deviation-heading": 0.5386559098650887, "set_robot_commands": 0.07606585129447606, "deviation-center-line": 0.09563817321808844, "driven_lanedir_consec": 0.0922077608261449, "sim_compute_sim_state": 0.0285042783488398, "sim_compute_performance-ego": 0.04476689255755881, "sim_compute_robot_state-ego": 0.048499864080677864, "sim_compute_robot_state-npc0": 0.05266180245772652, "sim_compute_robot_state-npc1": 0.04890688605930494, "sim_compute_robot_state-npc2": 0.051390554593956986, "sim_compute_robot_state-npc3": 0.05280517495196799}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1392677637202442, "sim_physics": 0.12326038877169292, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08258472576149511, "sim_render-ego": 0.04993957281112671, "in-drivable-lane": 0, "agent_compute-ego": 0.13219820459683737, "deviation-heading": 0.8598728343355607, "set_robot_commands": 0.06959737340609233, "deviation-center-line": 0.06205067533253946, "driven_lanedir_consec": 0.08258472576149511, "sim_compute_sim_state": 0.030709465344746903, "sim_compute_performance-ego": 0.055053512255350746, "sim_compute_robot_state-ego": 0.055200149615605675, "sim_compute_robot_state-npc0": 0.053974300622940063, "sim_compute_robot_state-npc1": 0.04883870482444763, "sim_compute_robot_state-npc2": 0.05278351902961731, "sim_compute_robot_state-npc3": 0.055048088232676186}}
set_robot_commands_max0.07606585129447606
set_robot_commands_mean0.06997371795756209
set_robot_commands_median0.07082749496806752
set_robot_commands_min0.059123537757179954
sim_compute_performance-ego_max0.055053512255350746
sim_compute_performance-ego_mean0.05051863292757527
sim_compute_performance-ego_median0.0515926642851396
sim_compute_performance-ego_min0.04476689255755881
sim_compute_robot_state-ego_max0.0559422644701871
sim_compute_robot_state-ego_mean0.05275366859775117
sim_compute_robot_state-ego_median0.055200149615605675
sim_compute_robot_state-ego_min0.048499864080677864
sim_compute_robot_state-npc0_max0.053974300622940063
sim_compute_robot_state-npc0_mean0.05129448915845507
sim_compute_robot_state-npc0_median0.05245100485311972
sim_compute_robot_state-npc0_min0.04619655464634751
sim_compute_robot_state-npc1_max0.05444982918826016
sim_compute_robot_state-npc1_mean0.05011053776841208
sim_compute_robot_state-npc1_median0.04890688605930494
sim_compute_robot_state-npc1_min0.045867537007187355
sim_compute_robot_state-npc2_max0.05278351902961731
sim_compute_robot_state-npc2_mean0.05057013297812813
sim_compute_robot_state-npc2_median0.051390554593956986
sim_compute_robot_state-npc2_min0.04551775527722908
sim_compute_robot_state-npc3_max0.055048088232676186
sim_compute_robot_state-npc3_mean0.05117986085717717
sim_compute_robot_state-npc3_median0.052249366586858574
sim_compute_robot_state-npc3_min0.04468917124199145
sim_compute_sim_state_max0.030709465344746903
sim_compute_sim_state_mean0.028581234872483357
sim_compute_sim_state_median0.028899853879755192
sim_compute_sim_state_min0.025744365923332447
sim_physics_max0.13040946877521015
sim_physics_mean0.12320348680607296
sim_physics_median0.12571154941212048
sim_physics_min0.10648352449590508
sim_render-ego_max0.04993957281112671
sim_render-ego_mean0.04594103347685069
sim_render-ego_median0.04815646735104648
sim_render-ego_min0.04080974537393321
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.3900000000000006
survival_time_min1.1000000000000003
No reset possible
241613951Kenechukwu Nnodu 🇨🇦ResNet-Combined-100aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:14:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.28060955217450045
survival_time_median5.799999999999987
deviation-center-line_median0.2104956156699747
in-drivable-lane_median2.7499999999999902


other stats
agent_compute-ego_max0.18340906603582977
agent_compute-ego_mean0.1758094011767257
agent_compute-ego_median0.17790821939706802
agent_compute-ego_min0.16034225261572635
deviation-center-line_max0.75548417971092
deviation-center-line_mean0.3289196853136922
deviation-center-line_min0.09908689143204732
deviation-heading_max1.5132624379137651
deviation-heading_mean1.168137102186191
deviation-heading_median1.3145146580698246
deviation-heading_min0.7172574151741051
driven_any_max1.661541838650526
driven_any_mean0.7661523652116193
driven_any_median0.6261051300120908
driven_any_min0.19654792412116248
driven_lanedir_consec_max0.7105357709254481
driven_lanedir_consec_mean0.39228597329948667
driven_lanedir_consec_min0.15395063280478627
driven_lanedir_max0.7105357709254481
driven_lanedir_mean0.39228597329948667
driven_lanedir_median0.28060955217450045
driven_lanedir_min0.15395063280478627
in-drivable-lane_max6.800000000000044
in-drivable-lane_mean2.6200000000000045
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0032717328069511, "sim_physics": 0.11496723905394347, "survival_time": 7.89999999999998, "driven_lanedir": 0.5373572615196172, "sim_render-ego": 0.045829246315775035, "in-drivable-lane": 3.399999999999988, "agent_compute-ego": 0.1775542784340774, "deviation-heading": 0.7172574151741051, "set_robot_commands": 0.06890408902228633, "deviation-center-line": 0.38929681629978546, "driven_lanedir_consec": 0.5373572615196172, "sim_compute_sim_state": 0.03336433971984477, "sim_compute_performance-ego": 0.04929684234570853, "sim_compute_robot_state-ego": 0.050899505615234375, "sim_compute_robot_state-npc0": 0.05296091791949695, "sim_compute_robot_state-npc1": 0.05176372920410543, "sim_compute_robot_state-npc2": 0.050961337512052514, "sim_compute_robot_state-npc3": 0.05247787282436709}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3432952004673659, "sim_physics": 0.1199398823082447, "survival_time": 3.1999999999999966, "driven_lanedir": 0.28060955217450045, "sim_render-ego": 0.04453368857502937, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.17790821939706802, "deviation-heading": 1.5132624379137651, "set_robot_commands": 0.06929562240839005, "deviation-center-line": 0.2104956156699747, "driven_lanedir_consec": 0.28060955217450045, "sim_compute_sim_state": 0.029513459652662277, "sim_compute_performance-ego": 0.05112124979496002, "sim_compute_robot_state-ego": 0.0528290681540966, "sim_compute_robot_state-npc0": 0.05271143093705177, "sim_compute_robot_state-npc1": 0.04999784007668495, "sim_compute_robot_state-npc2": 0.049344342201948166, "sim_compute_robot_state-npc3": 0.05057342350482941}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6261051300120908, "sim_physics": 0.1069599986076355, "survival_time": 5.799999999999987, "driven_lanedir": 0.2789766490730812, "sim_render-ego": 0.04560322186042522, "in-drivable-lane": 2.7499999999999902, "agent_compute-ego": 0.18340906603582977, "deviation-heading": 1.3145146580698246, "set_robot_commands": 0.07013061745413418, "deviation-center-line": 0.19023492345573367, "driven_lanedir_consec": 0.2789766490730812, "sim_compute_sim_state": 0.029291707893897748, "sim_compute_performance-ego": 0.05176744789912783, "sim_compute_robot_state-ego": 0.05125161491591355, "sim_compute_robot_state-npc0": 0.052991749911472714, "sim_compute_robot_state-npc1": 0.05186732267511302, "sim_compute_robot_state-npc2": 0.050503623896631704, "sim_compute_robot_state-npc3": 0.05097448414769666}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.661541838650526, "sim_physics": 0.11312152612163294, "survival_time": 12.950000000000047, "driven_lanedir": 0.7105357709254481, "sim_render-ego": 0.045411720239057506, "in-drivable-lane": 6.800000000000044, "agent_compute-ego": 0.179833189400927, "deviation-heading": 1.3901219388111603, "set_robot_commands": 0.06983397365997196, "deviation-center-line": 0.75548417971092, "driven_lanedir_consec": 0.7105357709254481, "sim_compute_sim_state": 0.02898637576453014, "sim_compute_performance-ego": 0.05044967879659881, "sim_compute_robot_state-ego": 0.054860334138612486, "sim_compute_robot_state-npc0": 0.05141776777142263, "sim_compute_robot_state-npc1": 0.05027904473676645, "sim_compute_robot_state-npc2": 0.05054121312027272, "sim_compute_robot_state-npc3": 0.05098091589437949}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19654792412116248, "sim_physics": 0.09732648820588084, "survival_time": 1.6500000000000008, "driven_lanedir": 0.15395063280478627, "sim_render-ego": 0.04032645803509337, "in-drivable-lane": 0, "agent_compute-ego": 0.16034225261572635, "deviation-heading": 0.9055290609620998, "set_robot_commands": 0.06128761985085227, "deviation-center-line": 0.09908689143204732, "driven_lanedir_consec": 0.15395063280478627, "sim_compute_sim_state": 0.023860469008937027, "sim_compute_performance-ego": 0.04363312143268007, "sim_compute_robot_state-ego": 0.0454793626611883, "sim_compute_robot_state-npc0": 0.0479610977750836, "sim_compute_robot_state-npc1": 0.04615597291426225, "sim_compute_robot_state-npc2": 0.04128356413407759, "sim_compute_robot_state-npc3": 0.042086254466663704}}
set_robot_commands_max0.07013061745413418
set_robot_commands_mean0.06789038447912696
set_robot_commands_median0.06929562240839005
set_robot_commands_min0.06128761985085227
sim_compute_performance-ego_max0.05176744789912783
sim_compute_performance-ego_mean0.04925366805381505
sim_compute_performance-ego_median0.05044967879659881
sim_compute_performance-ego_min0.04363312143268007
sim_compute_robot_state-ego_max0.054860334138612486
sim_compute_robot_state-ego_mean0.051063977097009064
sim_compute_robot_state-ego_median0.05125161491591355
sim_compute_robot_state-ego_min0.0454793626611883
sim_compute_robot_state-npc0_max0.052991749911472714
sim_compute_robot_state-npc0_mean0.051608592862905533
sim_compute_robot_state-npc0_median0.05271143093705177
sim_compute_robot_state-npc0_min0.0479610977750836
sim_compute_robot_state-npc1_max0.05186732267511302
sim_compute_robot_state-npc1_mean0.05001278192138642
sim_compute_robot_state-npc1_median0.05027904473676645
sim_compute_robot_state-npc1_min0.04615597291426225
sim_compute_robot_state-npc2_max0.050961337512052514
sim_compute_robot_state-npc2_mean0.048526816172996534
sim_compute_robot_state-npc2_median0.050503623896631704
sim_compute_robot_state-npc2_min0.04128356413407759
sim_compute_robot_state-npc3_max0.05247787282436709
sim_compute_robot_state-npc3_mean0.04941859016758726
sim_compute_robot_state-npc3_median0.05097448414769666
sim_compute_robot_state-npc3_min0.042086254466663704
sim_compute_sim_state_max0.03336433971984477
sim_compute_sim_state_mean0.02900327040797439
sim_compute_sim_state_median0.029291707893897748
sim_compute_sim_state_min0.023860469008937027
sim_physics_max0.1199398823082447
sim_physics_mean0.11046302685946748
sim_physics_median0.11312152612163294
sim_physics_min0.09732648820588084
sim_render-ego_max0.045829246315775035
sim_render-ego_mean0.0443408670050761
sim_render-ego_median0.045411720239057506
sim_render-ego_min0.04032645803509337
simulation-passed1
survival_time_max12.950000000000047
survival_time_mean6.3000000000000025
survival_time_min1.6500000000000008
No reset possible
241563946Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241513941Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-400aido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:04:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241493939Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-400aido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:07:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241453933Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-300aido2-LFV-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:35:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241423934Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-300aido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:04:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241403927Gabriel Descoteaux 🇨🇦aido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:19:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241393926Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-100aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:13:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5823469785610742
survival_time_median7.099999999999983
deviation-center-line_median0.2462242769502076
in-drivable-lane_median2.9999999999999893


other stats
agent_compute-ego_max0.1172220143404874
agent_compute-ego_mean0.11677453970898943
agent_compute-ego_median0.1165895938873291
agent_compute-ego_min0.11642199436823528
deviation-center-line_max0.7234022578611767
deviation-center-line_mean0.3838123461238029
deviation-center-line_min0.09348761400350478
deviation-heading_max1.7368278966785715
deviation-heading_mean1.1697005877313944
deviation-heading_median0.9214712692643042
deviation-heading_min0.6853803059852271
driven_any_max2.3878033606962408
driven_any_mean1.2871329498128028
driven_any_median1.0966925948574613
driven_any_min0.19025671959919832
driven_lanedir_consec_max1.110391889411491
driven_lanedir_consec_mean0.6592420863834139
driven_lanedir_consec_min0.1455143349710638
driven_lanedir_max1.110391889411491
driven_lanedir_mean0.6592420863834139
driven_lanedir_median0.5823469785610742
driven_lanedir_min0.1455143349710638
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.6100000000000136
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0966925948574613, "sim_physics": 0.09128769686524298, "survival_time": 7.099999999999983, "driven_lanedir": 0.5823469785610742, "sim_render-ego": 0.035862125141519895, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.1170585961409018, "deviation-heading": 0.9214712692643042, "set_robot_commands": 0.05432745100746692, "deviation-center-line": 0.2462242769502076, "driven_lanedir_consec": 0.5823469785610742, "sim_compute_sim_state": 0.022632563617867484, "sim_compute_performance-ego": 0.0384472776466692, "sim_compute_robot_state-ego": 0.04051704641798852, "sim_compute_robot_state-npc0": 0.039982127471708914, "sim_compute_robot_state-npc1": 0.03936095976493728, "sim_compute_robot_state-npc2": 0.03920985443491331, "sim_compute_robot_state-npc3": 0.03929865528160418}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3696968276848964, "sim_physics": 0.09505954504013062, "survival_time": 14.950000000000076, "driven_lanedir": 1.110391889411491, "sim_render-ego": 0.03653227170308431, "in-drivable-lane": 7.450000000000038, "agent_compute-ego": 0.11658049980799357, "deviation-heading": 1.7368278966785715, "set_robot_commands": 0.05369458675384522, "deviation-center-line": 0.663451838798104, "driven_lanedir_consec": 1.110391889411491, "sim_compute_sim_state": 0.022725499471028646, "sim_compute_performance-ego": 0.03854618310928345, "sim_compute_robot_state-ego": 0.04049475987752279, "sim_compute_robot_state-npc0": 0.04015259901682536, "sim_compute_robot_state-npc1": 0.03975240707397461, "sim_compute_robot_state-npc2": 0.039515305360158286, "sim_compute_robot_state-npc3": 0.03948990027109782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3878033606962408, "sim_physics": 0.08854622681935628, "survival_time": 14.950000000000076, "driven_lanedir": 1.0936644498344046, "sim_render-ego": 0.03588967323303223, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.11642199436823528, "deviation-heading": 1.643366469437867, "set_robot_commands": 0.054195801417032875, "deviation-center-line": 0.7234022578611767, "driven_lanedir_consec": 1.0936644498344046, "sim_compute_sim_state": 0.022788169384002684, "sim_compute_performance-ego": 0.03857185443242391, "sim_compute_robot_state-ego": 0.04052853107452393, "sim_compute_robot_state-npc0": 0.040067747433980304, "sim_compute_robot_state-npc1": 0.03946624914805094, "sim_compute_robot_state-npc2": 0.039429489771525064, "sim_compute_robot_state-npc3": 0.04087004979451497}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3912152462262175, "sim_physics": 0.10090804533524948, "survival_time": 2.7499999999999982, "driven_lanedir": 0.3642927791390358, "sim_render-ego": 0.036938775669444694, "in-drivable-lane": 0, "agent_compute-ego": 0.1172220143404874, "deviation-heading": 0.6853803059852271, "set_robot_commands": 0.05369790250604803, "deviation-center-line": 0.19249574300602157, "driven_lanedir_consec": 0.3642927791390358, "sim_compute_sim_state": 0.022864172675392844, "sim_compute_performance-ego": 0.038607853109186345, "sim_compute_robot_state-ego": 0.04052263606678356, "sim_compute_robot_state-npc0": 0.04011996442621405, "sim_compute_robot_state-npc1": 0.03957732374017889, "sim_compute_robot_state-npc2": 0.039454165371981535, "sim_compute_robot_state-npc3": 0.03950595422224565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19025671959919832, "sim_physics": 0.08873693943023682, "survival_time": 1.5000000000000009, "driven_lanedir": 0.1455143349710638, "sim_render-ego": 0.03563062349955241, "in-drivable-lane": 0, "agent_compute-ego": 0.1165895938873291, "deviation-heading": 0.8614569972910021, "set_robot_commands": 0.05425286293029785, "deviation-center-line": 0.09348761400350478, "driven_lanedir_consec": 0.1455143349710638, "sim_compute_sim_state": 0.022525922457377116, "sim_compute_performance-ego": 0.038512984911600746, "sim_compute_robot_state-ego": 0.04039136568705241, "sim_compute_robot_state-npc0": 0.04003702799479167, "sim_compute_robot_state-npc1": 0.0392817497253418, "sim_compute_robot_state-npc2": 0.03912380536397298, "sim_compute_robot_state-npc3": 0.038997284571329754}}
set_robot_commands_max0.05432745100746692
set_robot_commands_mean0.05403372092293818
set_robot_commands_median0.054195801417032875
set_robot_commands_min0.05369458675384522
sim_compute_performance-ego_max0.038607853109186345
sim_compute_performance-ego_mean0.03853723064183273
sim_compute_performance-ego_median0.03854618310928345
sim_compute_performance-ego_min0.0384472776466692
sim_compute_robot_state-ego_max0.04052853107452393
sim_compute_robot_state-ego_mean0.040490867824774235
sim_compute_robot_state-ego_median0.04051704641798852
sim_compute_robot_state-ego_min0.04039136568705241
sim_compute_robot_state-npc0_max0.04015259901682536
sim_compute_robot_state-npc0_mean0.040071893268704056
sim_compute_robot_state-npc0_median0.040067747433980304
sim_compute_robot_state-npc0_min0.039982127471708914
sim_compute_robot_state-npc1_max0.03975240707397461
sim_compute_robot_state-npc1_mean0.039487737890496706
sim_compute_robot_state-npc1_median0.03946624914805094
sim_compute_robot_state-npc1_min0.0392817497253418
sim_compute_robot_state-npc2_max0.039515305360158286
sim_compute_robot_state-npc2_mean0.03934652406051024
sim_compute_robot_state-npc2_median0.039429489771525064
sim_compute_robot_state-npc2_min0.03912380536397298
sim_compute_robot_state-npc3_max0.04087004979451497
sim_compute_robot_state-npc3_mean0.039632368828158474
sim_compute_robot_state-npc3_median0.03948990027109782
sim_compute_robot_state-npc3_min0.038997284571329754
sim_compute_sim_state_max0.022864172675392844
sim_compute_sim_state_mean0.022707265521133755
sim_compute_sim_state_median0.022725499471028646
sim_compute_sim_state_min0.022525922457377116
sim_physics_max0.10090804533524948
sim_physics_mean0.09290769069804322
sim_physics_median0.09128769686524298
sim_physics_min0.08854622681935628
sim_render-ego_max0.036938775669444694
sim_render-ego_mean0.03617069384932671
sim_render-ego_median0.03588967323303223
sim_render-ego_min0.03563062349955241
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.250000000000028
survival_time_min1.5000000000000009
No reset possible
241373918Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241343924Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:02:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241263912Gabriel Descoteaux 🇨🇦challenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:03:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241223911Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:04:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8738231708415505
survival_time_median3.099999999999997
deviation-center-line_median0.1847162605179493
in-drivable-lane_median0.8999999999999968


other stats
agent_compute-ego_max0.09753886345894106
agent_compute-ego_mean0.09634420655608632
agent_compute-ego_median0.09664022922515868
agent_compute-ego_min0.09454602124739668
deviation-center-line_max0.5921431212461046
deviation-center-line_mean0.2575017218594127
deviation-center-line_min0.1051202872202727
deviation-heading_max1.8520704133301364
deviation-heading_mean0.7655696111328215
deviation-heading_median0.6174853774728838
deviation-heading_min0.2826315501819024
driven_any_max3.064981160840033
driven_any_mean1.649108502300494
driven_any_median1.2797328979906255
driven_any_min1.0121624679769583
driven_lanedir_consec_max2.1770904199396357
driven_lanedir_consec_mean1.1034292597580089
driven_lanedir_consec_min0.4056124083139392
driven_lanedir_max2.1770904199396357
driven_lanedir_mean1.1036387883150651
driven_lanedir_median0.8738231708415505
driven_lanedir_min0.4056124083139392
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean1.1099999999999968
in-drivable-lane_min0.14999999999999947
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0121624679769583, "sim_physics": 0.05659782652761422, "survival_time": 2.549999999999999, "driven_lanedir": 0.6697678922681867, "sim_render-ego": 0.03667261553745644, "in-drivable-lane": 0.6999999999999982, "agent_compute-ego": 0.09684026942533604, "deviation-heading": 0.41852124132079976, "set_robot_commands": 0.054810411789838, "deviation-center-line": 0.1051202872202727, "driven_lanedir_consec": 0.6687202494829045, "sim_compute_sim_state": 0.023063014535342947, "sim_compute_performance-ego": 0.04050919121386958, "sim_compute_robot_state-ego": 0.04081484850715189}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.015724397125961, "sim_physics": 0.054215241451652685, "survival_time": 2.4499999999999993, "driven_lanedir": 0.8738231708415505, "sim_render-ego": 0.03573679437442702, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09454602124739668, "deviation-heading": 0.6571394733583847, "set_robot_commands": 0.05420502837823362, "deviation-center-line": 0.1847162605179493, "driven_lanedir_consec": 0.8738231708415505, "sim_compute_sim_state": 0.023228771832524513, "sim_compute_performance-ego": 0.03901850447362783, "sim_compute_robot_state-ego": 0.04020327937846281}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.064981160840033, "sim_physics": 0.05775255113840103, "survival_time": 7.99999999999998, "driven_lanedir": 2.1770904199396357, "sim_render-ego": 0.03729516863822937, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.09615564942359923, "deviation-heading": 1.8520704133301364, "set_robot_commands": 0.0555449515581131, "deviation-center-line": 0.5921431212461046, "driven_lanedir_consec": 2.1770904199396357, "sim_compute_sim_state": 0.02343703061342239, "sim_compute_performance-ego": 0.03904695957899094, "sim_compute_robot_state-ego": 0.04085390865802765}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2797328979906255, "sim_physics": 0.058775190384157246, "survival_time": 3.099999999999997, "driven_lanedir": 0.4056124083139392, "sim_render-ego": 0.036311757179998586, "in-drivable-lane": 1.7999999999999965, "agent_compute-ego": 0.09753886345894106, "deviation-heading": 0.2826315501819024, "set_robot_commands": 0.05474475506813296, "deviation-center-line": 0.1185731000208567, "driven_lanedir_consec": 0.4056124083139392, "sim_compute_sim_state": 0.023574433019084316, "sim_compute_performance-ego": 0.039578591623613914, "sim_compute_robot_state-ego": 0.04090753678352602}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.872941587568892, "sim_physics": 0.05462557619268244, "survival_time": 4.399999999999992, "driven_lanedir": 1.3919000502120136, "sim_render-ego": 0.0359617065299641, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.09664022922515868, "deviation-heading": 0.6174853774728838, "set_robot_commands": 0.054906454953280365, "deviation-center-line": 0.2869558402918804, "driven_lanedir_consec": 1.3919000502120136, "sim_compute_sim_state": 0.023744371804324062, "sim_compute_performance-ego": 0.039045450362292206, "sim_compute_robot_state-ego": 0.040892313827167855}}
set_robot_commands_max0.0555449515581131
set_robot_commands_mean0.054842320349519615
set_robot_commands_median0.054810411789838
set_robot_commands_min0.05420502837823362
sim_compute_performance-ego_max0.04050919121386958
sim_compute_performance-ego_mean0.03943973945047889
sim_compute_performance-ego_median0.03904695957899094
sim_compute_performance-ego_min0.03901850447362783
sim_compute_robot_state-ego_max0.04090753678352602
sim_compute_robot_state-ego_mean0.04073437743086724
sim_compute_robot_state-ego_median0.04085390865802765
sim_compute_robot_state-ego_min0.04020327937846281
sim_compute_sim_state_max0.023744371804324062
sim_compute_sim_state_mean0.023409524360939647
sim_compute_sim_state_median0.02343703061342239
sim_compute_sim_state_min0.023063014535342947
sim_physics_max0.058775190384157246
sim_physics_mean0.05639327713890152
sim_physics_median0.05659782652761422
sim_physics_min0.054215241451652685
sim_render-ego_max0.03729516863822937
sim_render-ego_mean0.0363956084520151
sim_render-ego_median0.036311757179998586
sim_render-ego_min0.03573679437442702
simulation-passed1
survival_time_max7.99999999999998
survival_time_mean4.099999999999993
survival_time_min2.4499999999999993
No reset possible
241213910Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:02:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241203909Inderpal Singh 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05993730129531016
survival_time_median1.5000000000000009
deviation-center-line_median0.09124544136904356
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.10344248016675311
agent_compute-ego_mean0.09801451938031916
agent_compute-ego_median0.09650859038035074
agent_compute-ego_min0.09597037347514978
deviation-center-line_max0.48002780354973745
deviation-center-line_mean0.15731180228851607
deviation-center-line_min0.03334001494833579
deviation-heading_max6.083839113260557
deviation-heading_mean2.0103512124819156
deviation-heading_median0.7763961697467976
deviation-heading_min0.6218288529291067
driven_any_max1.60250245026633
driven_any_mean0.4919191722727621
driven_any_median0.14826824466145777
driven_any_min0.10356461439159542
driven_lanedir_consec_max0.5605743419139819
driven_lanedir_consec_mean0.17613814858272692
driven_lanedir_consec_min0.04567833602559679
driven_lanedir_max0.5605743419139819
driven_lanedir_mean0.17613814858272692
driven_lanedir_median0.05993730129531016
driven_lanedir_min0.04567833602559679
in-drivable-lane_max6.850000000000027
in-drivable-lane_mean1.930000000000005
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.60250245026633, "sim_physics": 0.09540316343307496, "survival_time": 14.950000000000076, "driven_lanedir": 0.5605743419139819, "sim_render-ego": 0.03696027596791585, "in-drivable-lane": 6.850000000000027, "agent_compute-ego": 0.09790218909581502, "deviation-heading": 6.083839113260557, "set_robot_commands": 0.05638434966405233, "deviation-center-line": 0.48002780354973745, "driven_lanedir_consec": 0.5605743419139819, "sim_compute_sim_state": 0.023322717348734538, "sim_compute_performance-ego": 0.03959758122762044, "sim_compute_robot_state-ego": 0.041045053005218504, "sim_compute_robot_state-npc0": 0.040843264261881514, "sim_compute_robot_state-npc1": 0.040427969296773274, "sim_compute_robot_state-npc2": 0.04041035811106364, "sim_compute_robot_state-npc3": 0.04037842988967896}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4898976687431165, "sim_physics": 0.09177291259337007, "survival_time": 4.449999999999992, "driven_lanedir": 0.16675055322956167, "sim_render-ego": 0.03609767120875669, "in-drivable-lane": 1.949999999999997, "agent_compute-ego": 0.09597037347514978, "deviation-heading": 1.9183914169387688, "set_robot_commands": 0.0552641541770335, "deviation-center-line": 0.09124544136904356, "driven_lanedir_consec": 0.16675055322956167, "sim_compute_sim_state": 0.023305619700571125, "sim_compute_performance-ego": 0.03954453414745545, "sim_compute_robot_state-ego": 0.04098522797059477, "sim_compute_robot_state-npc0": 0.04092117641749007, "sim_compute_robot_state-npc1": 0.04040898365920849, "sim_compute_robot_state-npc2": 0.04021664951624495, "sim_compute_robot_state-npc3": 0.040541038084565925}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11536288330131056, "sim_physics": 0.10237376689910888, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04775021044918404, "sim_render-ego": 0.03636945883433024, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09650859038035074, "deviation-heading": 0.6218288529291067, "set_robot_commands": 0.05502699216206868, "deviation-center-line": 0.08991747854111154, "driven_lanedir_consec": 0.04775021044918404, "sim_compute_sim_state": 0.023089011510213215, "sim_compute_performance-ego": 0.039226682980855306, "sim_compute_robot_state-ego": 0.04264354705810547, "sim_compute_robot_state-npc0": 0.0404877503712972, "sim_compute_robot_state-npc1": 0.03991045157114665, "sim_compute_robot_state-npc2": 0.04007203578948974, "sim_compute_robot_state-npc3": 0.04022255738576253}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.10356461439159542, "sim_physics": 0.10517905155817668, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05993730129531016, "sim_render-ego": 0.03669308622678121, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.10344248016675311, "deviation-heading": 0.6513005095343489, "set_robot_commands": 0.056304325660069786, "deviation-center-line": 0.0920282730343519, "driven_lanedir_consec": 0.05993730129531016, "sim_compute_sim_state": 0.02327723304430644, "sim_compute_performance-ego": 0.03972575068473816, "sim_compute_robot_state-ego": 0.04099212090174357, "sim_compute_robot_state-npc0": 0.04057340820630392, "sim_compute_robot_state-npc1": 0.04024451971054077, "sim_compute_robot_state-npc2": 0.040054251750310264, "sim_compute_robot_state-npc3": 0.04029778639475504}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14826824466145777, "sim_physics": 0.09026474788271148, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04567833602559679, "sim_render-ego": 0.03643679618835449, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09624896378352724, "deviation-heading": 0.7763961697467976, "set_robot_commands": 0.054992256493403995, "deviation-center-line": 0.03334001494833579, "driven_lanedir_consec": 0.04567833602559679, "sim_compute_sim_state": 0.0234865402353221, "sim_compute_performance-ego": 0.03930405912728145, "sim_compute_robot_state-ego": 0.04110744903827536, "sim_compute_robot_state-npc0": 0.040615311984358166, "sim_compute_robot_state-npc1": 0.04017978701098212, "sim_compute_robot_state-npc2": 0.03986473741202519, "sim_compute_robot_state-npc3": 0.04044685692622744}}
set_robot_commands_max0.05638434966405233
set_robot_commands_mean0.05559441563132565
set_robot_commands_median0.0552641541770335
set_robot_commands_min0.054992256493403995
sim_compute_performance-ego_max0.03972575068473816
sim_compute_performance-ego_mean0.03947972163359016
sim_compute_performance-ego_median0.03954453414745545
sim_compute_performance-ego_min0.039226682980855306
sim_compute_robot_state-ego_max0.04264354705810547
sim_compute_robot_state-ego_mean0.04135467959478754
sim_compute_robot_state-ego_median0.041045053005218504
sim_compute_robot_state-ego_min0.04098522797059477
sim_compute_robot_state-npc0_max0.04092117641749007
sim_compute_robot_state-npc0_mean0.040688182248266175
sim_compute_robot_state-npc0_median0.040615311984358166
sim_compute_robot_state-npc0_min0.0404877503712972
sim_compute_robot_state-npc1_max0.040427969296773274
sim_compute_robot_state-npc1_mean0.04023434224973026
sim_compute_robot_state-npc1_median0.04024451971054077
sim_compute_robot_state-npc1_min0.03991045157114665
sim_compute_robot_state-npc2_max0.04041035811106364
sim_compute_robot_state-npc2_mean0.04012360651582676
sim_compute_robot_state-npc2_median0.04007203578948974
sim_compute_robot_state-npc2_min0.03986473741202519
sim_compute_robot_state-npc3_max0.040541038084565925
sim_compute_robot_state-npc3_mean0.04037733373619797
sim_compute_robot_state-npc3_median0.04037842988967896
sim_compute_robot_state-npc3_min0.04022255738576253
sim_compute_sim_state_max0.0234865402353221
sim_compute_sim_state_mean0.023296224367829483
sim_compute_sim_state_median0.023305619700571125
sim_compute_sim_state_min0.023089011510213215
sim_physics_max0.10517905155817668
sim_physics_mean0.0969987284732884
sim_physics_median0.09540316343307496
sim_physics_min0.09026474788271148
sim_render-ego_max0.03696027596791585
sim_render-ego_mean0.0365114576852277
sim_render-ego_median0.03643679618835449
sim_render-ego_min0.03609767120875669
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.710000000000013
survival_time_min1.2000000000000004
No reset possible
241193908Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Dataaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:14:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8936428657453378
survival_time_median8.09999999999998
deviation-center-line_median0.6533737097593046
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12001619467864164
agent_compute-ego_mean0.11834180474020237
agent_compute-ego_median0.11866332054138184
agent_compute-ego_min0.1160298390821977
deviation-center-line_max0.7065503092229627
deviation-center-line_mean0.4680173452714424
deviation-center-line_min0.1141606231065044
deviation-heading_max2.7568685844528136
deviation-heading_mean1.9286619884845393
deviation-heading_median1.940865311703626
deviation-heading_min0.9307058364726996
driven_any_max1.6124532443383175
driven_any_mean0.9429580794158662
driven_any_median0.9624279028242054
driven_any_min0.2108938186902563
driven_lanedir_consec_max1.5662383687505643
driven_lanedir_consec_mean0.8915256997446666
driven_lanedir_consec_min0.16843961896752346
driven_lanedir_max1.5662383687505643
driven_lanedir_mean0.8915256997446666
driven_lanedir_median0.8936428657453378
driven_lanedir_min0.16843961896752346
in-drivable-lane_max0.05000000000000071
in-drivable-lane_mean0.02000000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9624279028242054, "sim_physics": 0.09399969342314168, "survival_time": 8.09999999999998, "driven_lanedir": 0.8936428657453378, "sim_render-ego": 0.03701057257475676, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.11911249749454451, "deviation-heading": 1.940865311703626, "set_robot_commands": 0.06223123014709096, "deviation-center-line": 0.6533737097593046, "driven_lanedir_consec": 0.8936428657453378, "sim_compute_sim_state": 0.02318217724929621, "sim_compute_performance-ego": 0.039521508746676974, "sim_compute_robot_state-ego": 0.04120851151737166, "sim_compute_robot_state-npc0": 0.040861175384050534, "sim_compute_robot_state-npc1": 0.04031964143117269, "sim_compute_robot_state-npc2": 0.04014536333672794, "sim_compute_robot_state-npc3": 0.04034876381909406}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.31663853937234065, "sim_physics": 0.08897447152571245, "survival_time": 2.7499999999999982, "driven_lanedir": 0.26572808895546274, "sim_render-ego": 0.0357942667874423, "in-drivable-lane": 0, "agent_compute-ego": 0.1160298390821977, "deviation-heading": 1.4196186008322311, "set_robot_commands": 0.05467003475536, "deviation-center-line": 0.18844304457520145, "driven_lanedir_consec": 0.26572808895546274, "sim_compute_sim_state": 0.026607335697520863, "sim_compute_performance-ego": 0.03847584290937944, "sim_compute_robot_state-ego": 0.04049020247025923, "sim_compute_robot_state-npc0": 0.04006812355735085, "sim_compute_robot_state-npc1": 0.039248293096368965, "sim_compute_robot_state-npc2": 0.03922657533125444, "sim_compute_robot_state-npc3": 0.03938872597434304}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6123768918542107, "sim_physics": 0.08817929585774739, "survival_time": 14.950000000000076, "driven_lanedir": 1.563579556304444, "sim_render-ego": 0.036444456577301027, "in-drivable-lane": 0, "agent_compute-ego": 0.11866332054138184, "deviation-heading": 2.7568685844528136, "set_robot_commands": 0.05573586861292521, "deviation-center-line": 0.7065503092229627, "driven_lanedir_consec": 1.563579556304444, "sim_compute_sim_state": 0.02311342716217041, "sim_compute_performance-ego": 0.03933230320612589, "sim_compute_robot_state-ego": 0.041027147769927975, "sim_compute_robot_state-npc0": 0.04095956087112427, "sim_compute_robot_state-npc1": 0.04023998022079467, "sim_compute_robot_state-npc2": 0.040168048540751136, "sim_compute_robot_state-npc3": 0.040396267573038734}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6124532443383175, "sim_physics": 0.08901315689086914, "survival_time": 14.950000000000076, "driven_lanedir": 1.5662383687505643, "sim_render-ego": 0.036423585414886474, "in-drivable-lane": 0, "agent_compute-ego": 0.117887171904246, "deviation-heading": 2.595251608961326, "set_robot_commands": 0.05462333997090658, "deviation-center-line": 0.677559039693239, "driven_lanedir_consec": 1.5662383687505643, "sim_compute_sim_state": 0.0230680513381958, "sim_compute_performance-ego": 0.03966015338897705, "sim_compute_robot_state-ego": 0.04091893037160237, "sim_compute_robot_state-npc0": 0.04076119184494018, "sim_compute_robot_state-npc1": 0.0402402933438619, "sim_compute_robot_state-npc2": 0.039996399879455566, "sim_compute_robot_state-npc3": 0.04021590868631999}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2108938186902563, "sim_physics": 0.088890739389368, "survival_time": 1.850000000000001, "driven_lanedir": 0.16843961896752346, "sim_render-ego": 0.03676014977532464, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.12001619467864164, "deviation-heading": 0.9307058364726996, "set_robot_commands": 0.05456769144212877, "deviation-center-line": 0.1141606231065044, "driven_lanedir_consec": 0.16843961896752346, "sim_compute_sim_state": 0.023426629401542044, "sim_compute_performance-ego": 0.039576569119015255, "sim_compute_robot_state-ego": 0.04092759055060309, "sim_compute_robot_state-npc0": 0.04091717101432182, "sim_compute_robot_state-npc1": 0.04057875839439598, "sim_compute_robot_state-npc2": 0.040360180107322896, "sim_compute_robot_state-npc3": 0.04041783874099319}}
set_robot_commands_max0.06223123014709096
set_robot_commands_mean0.0563656329856823
set_robot_commands_median0.05467003475536
set_robot_commands_min0.05456769144212877
sim_compute_performance-ego_max0.03966015338897705
sim_compute_performance-ego_mean0.03931327547403492
sim_compute_performance-ego_median0.039521508746676974
sim_compute_performance-ego_min0.03847584290937944
sim_compute_robot_state-ego_max0.04120851151737166
sim_compute_robot_state-ego_mean0.04091447653595287
sim_compute_robot_state-ego_median0.04092759055060309
sim_compute_robot_state-ego_min0.04049020247025923
sim_compute_robot_state-npc0_max0.04095956087112427
sim_compute_robot_state-npc0_mean0.04071344453435753
sim_compute_robot_state-npc0_median0.040861175384050534
sim_compute_robot_state-npc0_min0.04006812355735085
sim_compute_robot_state-npc1_max0.04057875839439598
sim_compute_robot_state-npc1_mean0.04012539329731884
sim_compute_robot_state-npc1_median0.0402402933438619
sim_compute_robot_state-npc1_min0.039248293096368965
sim_compute_robot_state-npc2_max0.040360180107322896
sim_compute_robot_state-npc2_mean0.0399793134391024
sim_compute_robot_state-npc2_median0.04014536333672794
sim_compute_robot_state-npc2_min0.03922657533125444
sim_compute_robot_state-npc3_max0.04041783874099319
sim_compute_robot_state-npc3_mean0.04015350095875781
sim_compute_robot_state-npc3_median0.04034876381909406
sim_compute_robot_state-npc3_min0.03938872597434304
sim_compute_sim_state_max0.026607335697520863
sim_compute_sim_state_mean0.023879524169745064
sim_compute_sim_state_median0.02318217724929621
sim_compute_sim_state_min0.0230680513381958
sim_physics_max0.09399969342314168
sim_physics_mean0.08981147141736774
sim_physics_median0.08897447152571245
sim_physics_min0.08817929585774739
sim_render-ego_max0.03701057257475676
sim_render-ego_mean0.03648660622594224
sim_render-ego_median0.036444456577301027
sim_render-ego_min0.0357942667874423
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.520000000000026
survival_time_min1.850000000000001
No reset possible
241043900Gabriel Descoteaux 🇨🇦challenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241013906Gabriel Descoteaux 🇨🇦challenge-aido_LF-template-tensorflowaido2-LFVI-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:03:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241003898Gabriel Descoteaux 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11351778082302792
error_L20.01956142903332538


No reset possible
240993897Kenechukwu Nnodu 🇨🇦ResNet-Adam-More-Data_Falseaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4438999586060821
survival_time_median5.14999999999999
deviation-center-line_median0.20275788369254177
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.14836933091282845
agent_compute-ego_mean0.13286050123339313
agent_compute-ego_median0.12917438316345214
agent_compute-ego_min0.12822555851291967
deviation-center-line_max0.2943546077145885
deviation-center-line_mean0.20839014196495764
deviation-center-line_min0.10366535944645584
deviation-heading_max2.5349941502063107
deviation-heading_mean1.3727143927298473
deviation-heading_median1.096166276274921
deviation-heading_min0.8056422156561436
driven_any_max1.1040790456463907
driven_any_mean0.7119005882503009
driven_any_median0.7818440434074347
driven_any_min0.24686111395257837
driven_lanedir_consec_max0.9152421510629468
driven_lanedir_consec_mean0.5442981068539632
driven_lanedir_consec_min0.2103504262366628
driven_lanedir_max0.9152421510629468
driven_lanedir_mean0.5442981068539632
driven_lanedir_median0.4438999586060821
driven_lanedir_min0.2103504262366628
in-drivable-lane_max3.049999999999989
in-drivable-lane_mean0.6499999999999977
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.46260415693224394, "sim_physics": 0.0969257727265358, "survival_time": 3.1999999999999966, "driven_lanedir": 0.41356332966372866, "sim_render-ego": 0.03636891394853592, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.14836933091282845, "deviation-heading": 1.0380189428218096, "set_robot_commands": 0.054949987679719925, "deviation-center-line": 0.20275788369254177, "driven_lanedir_consec": 0.41356332966372866, "sim_compute_sim_state": 0.02282505109906197, "sim_compute_performance-ego": 0.039131343364715576, "sim_compute_robot_state-ego": 0.041041433811187744, "sim_compute_robot_state-npc0": 0.040525369346141815, "sim_compute_robot_state-npc1": 0.04081733897328377, "sim_compute_robot_state-npc2": 0.03971102461218834, "sim_compute_robot_state-npc3": 0.03973708674311638}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9641145813128564, "sim_physics": 0.09606391906738282, "survival_time": 6.249999999999986, "driven_lanedir": 0.9152421510629468, "sim_render-ego": 0.035696306228637696, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.12917438316345214, "deviation-heading": 1.388750378690051, "set_robot_commands": 0.05428948402404785, "deviation-center-line": 0.24684117904697375, "driven_lanedir_consec": 0.9152421510629468, "sim_compute_sim_state": 0.02280546760559082, "sim_compute_performance-ego": 0.03912789726257324, "sim_compute_robot_state-ego": 0.042385921478271485, "sim_compute_robot_state-npc0": 0.040370975494384766, "sim_compute_robot_state-npc1": 0.04011882781982422, "sim_compute_robot_state-npc2": 0.03961717414855957, "sim_compute_robot_state-npc3": 0.039715017318725586}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7818440434074347, "sim_physics": 0.09143761060770277, "survival_time": 5.14999999999999, "driven_lanedir": 0.7384346687003958, "sim_render-ego": 0.0360762100775265, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.12871205228046306, "deviation-heading": 1.096166276274921, "set_robot_commands": 0.05479214955302118, "deviation-center-line": 0.1943316799242284, "driven_lanedir_consec": 0.7384346687003958, "sim_compute_sim_state": 0.023121961112161284, "sim_compute_performance-ego": 0.0385117345643275, "sim_compute_robot_state-ego": 0.04088048333103217, "sim_compute_robot_state-npc0": 0.040387500837011245, "sim_compute_robot_state-npc1": 0.03981629621635363, "sim_compute_robot_state-npc2": 0.039463096451990816, "sim_compute_robot_state-npc3": 0.03955288998131613}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1040790456463907, "sim_physics": 0.08822766659964978, "survival_time": 7.099999999999983, "driven_lanedir": 0.4438999586060821, "sim_render-ego": 0.03598020614033014, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.12982118129730225, "deviation-heading": 2.5349941502063107, "set_robot_commands": 0.05432315779403901, "deviation-center-line": 0.2943546077145885, "driven_lanedir_consec": 0.4438999586060821, "sim_compute_sim_state": 0.02260211655791377, "sim_compute_performance-ego": 0.038629149047421735, "sim_compute_robot_state-ego": 0.04075506203611133, "sim_compute_robot_state-npc0": 0.04023938279756358, "sim_compute_robot_state-npc1": 0.03957523090738646, "sim_compute_robot_state-npc2": 0.03931487278199531, "sim_compute_robot_state-npc3": 0.03946158919535892}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.24686111395257837, "sim_physics": 0.08660764307589144, "survival_time": 1.850000000000001, "driven_lanedir": 0.2103504262366628, "sim_render-ego": 0.03592326834395125, "in-drivable-lane": 0, "agent_compute-ego": 0.12822555851291967, "deviation-heading": 0.8056422156561436, "set_robot_commands": 0.053970556001405455, "deviation-center-line": 0.10366535944645584, "driven_lanedir_consec": 0.2103504262366628, "sim_compute_sim_state": 0.022591507112657703, "sim_compute_performance-ego": 0.03849753817996463, "sim_compute_robot_state-ego": 0.04063263454952755, "sim_compute_robot_state-npc0": 0.04006495346894135, "sim_compute_robot_state-npc1": 0.03942837586274018, "sim_compute_robot_state-npc2": 0.03932547569274902, "sim_compute_robot_state-npc3": 0.03921272947981551}}
set_robot_commands_max0.054949987679719925
set_robot_commands_mean0.05446506701044668
set_robot_commands_median0.05432315779403901
set_robot_commands_min0.053970556001405455
sim_compute_performance-ego_max0.039131343364715576
sim_compute_performance-ego_mean0.03877953248380053
sim_compute_performance-ego_median0.038629149047421735
sim_compute_performance-ego_min0.03849753817996463
sim_compute_robot_state-ego_max0.042385921478271485
sim_compute_robot_state-ego_mean0.04113910704122606
sim_compute_robot_state-ego_median0.04088048333103217
sim_compute_robot_state-ego_min0.04063263454952755
sim_compute_robot_state-npc0_max0.040525369346141815
sim_compute_robot_state-npc0_mean0.040317636388808545
sim_compute_robot_state-npc0_median0.040370975494384766
sim_compute_robot_state-npc0_min0.04006495346894135
sim_compute_robot_state-npc1_max0.04081733897328377
sim_compute_robot_state-npc1_mean0.03995121395591765
sim_compute_robot_state-npc1_median0.03981629621635363
sim_compute_robot_state-npc1_min0.03942837586274018
sim_compute_robot_state-npc2_max0.03971102461218834
sim_compute_robot_state-npc2_mean0.039486328737496613
sim_compute_robot_state-npc2_median0.039463096451990816
sim_compute_robot_state-npc2_min0.03931487278199531
sim_compute_robot_state-npc3_max0.03973708674311638
sim_compute_robot_state-npc3_mean0.03953586254366651
sim_compute_robot_state-npc3_median0.03955288998131613
sim_compute_robot_state-npc3_min0.03921272947981551
sim_compute_sim_state_max0.023121961112161284
sim_compute_sim_state_mean0.022789220697477103
sim_compute_sim_state_median0.02280546760559082
sim_compute_sim_state_min0.022591507112657703
sim_physics_max0.0969257727265358
sim_physics_mean0.09185252241543251
sim_physics_median0.09143761060770277
sim_physics_min0.08660764307589144
sim_render-ego_max0.03636891394853592
sim_render-ego_mean0.036008980947796296
sim_render-ego_median0.03598020614033014
sim_render-ego_min0.035696306228637696
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean4.709999999999991
survival_time_min1.850000000000001
No reset possible
240983896Kenechukwu Nnodu 🇨🇦ResNet-Adam-More-Data_Trueaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:10:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.38181189179976505
survival_time_median2.9499999999999975
deviation-center-line_median0.17417353922182804
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.14555698330119504
agent_compute-ego_mean0.14336878999249192
agent_compute-ego_median0.14324696643932447
agent_compute-ego_min0.14156593322753908
deviation-center-line_max0.422746773420424
deviation-center-line_mean0.22684136827408272
deviation-center-line_min0.11029528813103152
deviation-heading_max1.3081583841821005
deviation-heading_mean1.1043020953521463
deviation-heading_median1.154748559143698
deviation-heading_min0.809955607284917
driven_any_max1.8871359605244824
driven_any_mean0.7687047249397547
driven_any_median0.4233267579654081
driven_any_min0.2459901159489359
driven_lanedir_consec_max0.8849934910987494
driven_lanedir_consec_mean0.48627374622512864
driven_lanedir_consec_min0.1970993379198025
driven_lanedir_max0.8849934910987494
driven_lanedir_mean0.48627374622512864
driven_lanedir_median0.38181189179976505
driven_lanedir_min0.1970993379198025
in-drivable-lane_max7.250000000000019
in-drivable-lane_mean1.4900000000000038
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4233267579654081, "sim_physics": 0.09708991293179786, "survival_time": 2.9499999999999975, "driven_lanedir": 0.38181189179976505, "sim_render-ego": 0.03541027893454342, "in-drivable-lane": 0, "agent_compute-ego": 0.14555698330119504, "deviation-heading": 1.01327013926464, "set_robot_commands": 0.054100497294280486, "deviation-center-line": 0.17417353922182804, "driven_lanedir_consec": 0.38181189179976505, "sim_compute_sim_state": 0.022203506049463303, "sim_compute_performance-ego": 0.03783478575237727, "sim_compute_robot_state-ego": 0.04014983015545344, "sim_compute_robot_state-npc0": 0.03953614881483175, "sim_compute_robot_state-npc1": 0.03904293755353507, "sim_compute_robot_state-npc2": 0.04204815121020301, "sim_compute_robot_state-npc3": 0.03878827822410454}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.35109804124067595, "sim_physics": 0.09417648792266846, "survival_time": 2.499999999999999, "driven_lanedir": 0.297128895258691, "sim_render-ego": 0.03435197353363037, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.14156593322753908, "deviation-heading": 1.154748559143698, "set_robot_commands": 0.05355273723602295, "deviation-center-line": 0.16534596861550704, "driven_lanedir_consec": 0.297128895258691, "sim_compute_sim_state": 0.022088284492492675, "sim_compute_performance-ego": 0.03851229667663574, "sim_compute_robot_state-ego": 0.039782719612121584, "sim_compute_robot_state-npc0": 0.03954390525817871, "sim_compute_robot_state-npc1": 0.03876924514770508, "sim_compute_robot_state-npc2": 0.038435420989990234, "sim_compute_robot_state-npc3": 0.0386226749420166}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9359727490192716, "sim_physics": 0.097384403963558, "survival_time": 6.099999999999986, "driven_lanedir": 0.8849934910987494, "sim_render-ego": 0.03540008967040015, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.14339753643411104, "deviation-heading": 1.3081583841821005, "set_robot_commands": 0.05382151095593562, "deviation-center-line": 0.2616452719816231, "driven_lanedir_consec": 0.8849934910987494, "sim_compute_sim_state": 0.02219590202706759, "sim_compute_performance-ego": 0.037790693220545034, "sim_compute_robot_state-ego": 0.04014691759328373, "sim_compute_robot_state-npc0": 0.039523390472912395, "sim_compute_robot_state-npc1": 0.038822451575857696, "sim_compute_robot_state-npc2": 0.038682765648013255, "sim_compute_robot_state-npc3": 0.0387901321786349}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.8871359605244824, "sim_physics": 0.08709247341714643, "survival_time": 11.950000000000037, "driven_lanedir": 0.6703351150486352, "sim_render-ego": 0.03493358500333012, "in-drivable-lane": 7.250000000000019, "agent_compute-ego": 0.14307653056028996, "deviation-heading": 1.2353777868853764, "set_robot_commands": 0.05398438166374941, "deviation-center-line": 0.422746773420424, "driven_lanedir_consec": 0.6703351150486352, "sim_compute_sim_state": 0.02216891364572437, "sim_compute_performance-ego": 0.03794004827363721, "sim_compute_robot_state-ego": 0.04024566267324791, "sim_compute_robot_state-npc0": 0.03957825026252779, "sim_compute_robot_state-npc1": 0.039710696272271445, "sim_compute_robot_state-npc2": 0.03872265975345627, "sim_compute_robot_state-npc3": 0.03893853331210723}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2459901159489359, "sim_physics": 0.08743840294915277, "survival_time": 1.850000000000001, "driven_lanedir": 0.1970993379198025, "sim_render-ego": 0.03504748602171202, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14324696643932447, "deviation-heading": 0.809955607284917, "set_robot_commands": 0.06110590857428473, "deviation-center-line": 0.11029528813103152, "driven_lanedir_consec": 0.1970993379198025, "sim_compute_sim_state": 0.022229085097441804, "sim_compute_performance-ego": 0.037627349028716214, "sim_compute_robot_state-ego": 0.03999235823347762, "sim_compute_robot_state-npc0": 0.03971126272871688, "sim_compute_robot_state-npc1": 0.039163041759181665, "sim_compute_robot_state-npc2": 0.03869235193407213, "sim_compute_robot_state-npc3": 0.03985772261748443}}
set_robot_commands_max0.06110590857428473
set_robot_commands_mean0.05531300714485464
set_robot_commands_median0.05398438166374941
set_robot_commands_min0.05355273723602295
sim_compute_performance-ego_max0.03851229667663574
sim_compute_performance-ego_mean0.0379410345903823
sim_compute_performance-ego_median0.03783478575237727
sim_compute_performance-ego_min0.037627349028716214
sim_compute_robot_state-ego_max0.04024566267324791
sim_compute_robot_state-ego_mean0.040063497653516855
sim_compute_robot_state-ego_median0.04014691759328373
sim_compute_robot_state-ego_min0.039782719612121584
sim_compute_robot_state-npc0_max0.03971126272871688
sim_compute_robot_state-npc0_mean0.0395785915074335
sim_compute_robot_state-npc0_median0.03954390525817871
sim_compute_robot_state-npc0_min0.039523390472912395
sim_compute_robot_state-npc1_max0.039710696272271445
sim_compute_robot_state-npc1_mean0.039101674461710194
sim_compute_robot_state-npc1_median0.03904293755353507
sim_compute_robot_state-npc1_min0.03876924514770508
sim_compute_robot_state-npc2_max0.04204815121020301
sim_compute_robot_state-npc2_mean0.039316269907146977
sim_compute_robot_state-npc2_median0.03869235193407213
sim_compute_robot_state-npc2_min0.038435420989990234
sim_compute_robot_state-npc3_max0.03985772261748443
sim_compute_robot_state-npc3_mean0.03899946825486954
sim_compute_robot_state-npc3_median0.0387901321786349
sim_compute_robot_state-npc3_min0.0386226749420166
sim_compute_sim_state_max0.022229085097441804
sim_compute_sim_state_mean0.02217713826243795
sim_compute_sim_state_median0.02219590202706759
sim_compute_sim_state_min0.022088284492492675
sim_physics_max0.097384403963558
sim_physics_mean0.09263633623686472
sim_physics_median0.09417648792266846
sim_physics_min0.08709247341714643
sim_render-ego_max0.03541027893454342
sim_render-ego_mean0.03502868263272321
sim_render-ego_median0.03504748602171202
sim_render-ego_min0.03435197353363037
simulation-passed1
survival_time_max11.950000000000037
survival_time_mean5.070000000000004
survival_time_min1.850000000000001
No reset possible
240953893Yeong-Jia ChuChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-73570:02:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240943892Kenechukwu Nnodu 🇨🇦CNN-Float64-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46759642203499974
survival_time_median3.4999999999999956
deviation-center-line_median0.24216074504327992
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.11947724590562794
agent_compute-ego_mean0.11701455023234825
agent_compute-ego_median0.11677664379740872
agent_compute-ego_min0.11571027718338311
deviation-center-line_max0.2993156262582763
deviation-center-line_mean0.2317539738596809
deviation-center-line_min0.14875595276289963
deviation-heading_max1.2084736867160086
deviation-heading_mean0.8383957307171247
deviation-heading_median0.8359849514396611
deviation-heading_min0.5216047095947761
driven_any_max0.5245441269518737
driven_any_mean0.4290818302136724
driven_any_median0.5005268760341138
driven_any_min0.27839214141659074
driven_lanedir_consec_max0.5135606888508422
driven_lanedir_consec_mean0.3986890592612478
driven_lanedir_consec_min0.2458924450324338
driven_lanedir_max0.5135606888508422
driven_lanedir_mean0.3986890592612478
driven_lanedir_median0.46759642203499974
driven_lanedir_min0.2458924450324338
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.039999999999999855
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5067840441136184, "sim_physics": 0.09522117653938188, "survival_time": 3.649999999999995, "driven_lanedir": 0.46759642203499974, "sim_render-ego": 0.035920793063020054, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.11947724590562794, "deviation-heading": 1.0865430356039325, "set_robot_commands": 0.05501680831386618, "deviation-center-line": 0.24216074504327992, "driven_lanedir_consec": 0.46759642203499974, "sim_compute_sim_state": 0.022497193454063105, "sim_compute_performance-ego": 0.03849287555642324, "sim_compute_robot_state-ego": 0.04469345693718897, "sim_compute_robot_state-npc0": 0.0402179090944055, "sim_compute_robot_state-npc1": 0.039437810035601054, "sim_compute_robot_state-npc2": 0.03917741122311109, "sim_compute_robot_state-npc3": 0.03917050361633301}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3351619625521655, "sim_physics": 0.0885168945088106, "survival_time": 2.549999999999999, "driven_lanedir": 0.2760347313070346, "sim_render-ego": 0.03469399377411487, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.11571027718338311, "deviation-heading": 1.2084736867160086, "set_robot_commands": 0.05702982696832395, "deviation-center-line": 0.17469061192042695, "driven_lanedir_consec": 0.2760347313070346, "sim_compute_sim_state": 0.02252648858463063, "sim_compute_performance-ego": 0.03892047732484107, "sim_compute_robot_state-ego": 0.04035591611675188, "sim_compute_robot_state-npc0": 0.03977589046253877, "sim_compute_robot_state-npc1": 0.039288595610973885, "sim_compute_robot_state-npc2": 0.03901246014763327, "sim_compute_robot_state-npc3": 0.03917564130296894}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5005268760341138, "sim_physics": 0.09422015462602888, "survival_time": 3.4999999999999956, "driven_lanedir": 0.49036100908092894, "sim_render-ego": 0.03550552640642438, "in-drivable-lane": 0, "agent_compute-ego": 0.11622908796582904, "deviation-heading": 0.5216047095947761, "set_robot_commands": 0.05437332221439906, "deviation-center-line": 0.2993156262582763, "driven_lanedir_consec": 0.49036100908092894, "sim_compute_sim_state": 0.024394815308707105, "sim_compute_performance-ego": 0.0382915735244751, "sim_compute_robot_state-ego": 0.040437449727739605, "sim_compute_robot_state-npc0": 0.04001073156084333, "sim_compute_robot_state-npc1": 0.039475532940455846, "sim_compute_robot_state-npc2": 0.039169417108808245, "sim_compute_robot_state-npc3": 0.03973229953220912}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5245441269518737, "sim_physics": 0.09437227580282424, "survival_time": 3.599999999999995, "driven_lanedir": 0.5135606888508422, "sim_render-ego": 0.035799493392308555, "in-drivable-lane": 0, "agent_compute-ego": 0.11687949630949232, "deviation-heading": 0.5393722702312453, "set_robot_commands": 0.05485544270939297, "deviation-center-line": 0.2938469333135217, "driven_lanedir_consec": 0.5135606888508422, "sim_compute_sim_state": 0.02231586641735501, "sim_compute_performance-ego": 0.03821056087811788, "sim_compute_robot_state-ego": 0.043054540952046715, "sim_compute_robot_state-npc0": 0.040060589710871376, "sim_compute_robot_state-npc1": 0.039242681529786855, "sim_compute_robot_state-npc2": 0.03888603382640415, "sim_compute_robot_state-npc3": 0.03889295789930555}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.27839214141659074, "sim_physics": 0.087633726208709, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2458924450324338, "sim_render-ego": 0.03561627033144929, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.11677664379740872, "deviation-heading": 0.8359849514396611, "set_robot_commands": 0.05871545436770417, "deviation-center-line": 0.14875595276289963, "driven_lanedir_consec": 0.2458924450324338, "sim_compute_sim_state": 0.022278087083683455, "sim_compute_performance-ego": 0.03918466457100802, "sim_compute_robot_state-ego": 0.04045169852500738, "sim_compute_robot_state-npc0": 0.04010858092197152, "sim_compute_robot_state-npc1": 0.03916385561920876, "sim_compute_robot_state-npc2": 0.03883013059926588, "sim_compute_robot_state-npc3": 0.039002335348794624}}
set_robot_commands_max0.05871545436770417
set_robot_commands_mean0.055998170914737265
set_robot_commands_median0.05501680831386618
set_robot_commands_min0.05437332221439906
sim_compute_performance-ego_max0.03918466457100802
sim_compute_performance-ego_mean0.038620030370973064
sim_compute_performance-ego_median0.03849287555642324
sim_compute_performance-ego_min0.03821056087811788
sim_compute_robot_state-ego_max0.04469345693718897
sim_compute_robot_state-ego_mean0.04179861245174691
sim_compute_robot_state-ego_median0.04045169852500738
sim_compute_robot_state-ego_min0.04035591611675188
sim_compute_robot_state-npc0_max0.0402179090944055
sim_compute_robot_state-npc0_mean0.040034740350126094
sim_compute_robot_state-npc0_median0.040060589710871376
sim_compute_robot_state-npc0_min0.03977589046253877
sim_compute_robot_state-npc1_max0.039475532940455846
sim_compute_robot_state-npc1_mean0.03932169514720528
sim_compute_robot_state-npc1_median0.039288595610973885
sim_compute_robot_state-npc1_min0.03916385561920876
sim_compute_robot_state-npc2_max0.03917741122311109
sim_compute_robot_state-npc2_mean0.03901509058104453
sim_compute_robot_state-npc2_median0.03901246014763327
sim_compute_robot_state-npc2_min0.03883013059926588
sim_compute_robot_state-npc3_max0.03973229953220912
sim_compute_robot_state-npc3_mean0.039194747539922255
sim_compute_robot_state-npc3_median0.03917050361633301
sim_compute_robot_state-npc3_min0.03889295789930555
sim_compute_sim_state_max0.024394815308707105
sim_compute_sim_state_mean0.022802490169687856
sim_compute_sim_state_median0.022497193454063105
sim_compute_sim_state_min0.022278087083683455
sim_physics_max0.09522117653938188
sim_physics_mean0.09199284553715092
sim_physics_median0.09422015462602888
sim_physics_min0.087633726208709
sim_render-ego_max0.035920793063020054
sim_render-ego_mean0.03550721539346343
sim_render-ego_median0.03561627033144929
sim_render-ego_min0.03469399377411487
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean3.0899999999999967
survival_time_min2.1500000000000004
No reset possible
240933891Kenechukwu Nnodu 🇨🇦ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:08:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3991905460241121
survival_time_median4.94999999999999
deviation-center-line_median0.24229018356912108
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.10763954425203628
agent_compute-ego_mean0.10647327234782582
agent_compute-ego_median0.10632132220741929
agent_compute-ego_min0.1054262184515232
deviation-center-line_max0.4417072683654324
deviation-center-line_mean0.26457207338178734
deviation-center-line_min0.1397504796816527
deviation-heading_max2.4712644616211517
deviation-heading_mean1.378562703077527
deviation-heading_median1.0380357121602806
deviation-heading_min0.855530480882093
driven_any_max1.1209851258973405
driven_any_mean0.8048461705979761
driven_any_median0.700271710340483
driven_any_min0.585842624678965
driven_lanedir_consec_max0.6873661888879385
driven_lanedir_consec_mean0.4516522601491437
driven_lanedir_consec_min0.27147203845563306
driven_lanedir_max0.6904228304510398
driven_lanedir_mean0.45407004531749456
driven_lanedir_median0.3991905460241121
driven_lanedir_min0.27147203845563306
in-drivable-lane_max2.549999999999991
in-drivable-lane_mean1.8299999999999936
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1209851258973405, "sim_physics": 0.08774823700355379, "survival_time": 7.549999999999981, "driven_lanedir": 0.6347563092369906, "sim_render-ego": 0.035323586684978564, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.10632132220741929, "deviation-heading": 1.525197595553191, "set_robot_commands": 0.05447855216777877, "deviation-center-line": 0.3534109672234653, "driven_lanedir_consec": 0.6257240249583376, "sim_compute_sim_state": 0.02266210751817716, "sim_compute_performance-ego": 0.03823572594598429, "sim_compute_robot_state-ego": 0.0401586081018511, "sim_compute_robot_state-npc0": 0.03975145706277809, "sim_compute_robot_state-npc1": 0.03907561460078157, "sim_compute_robot_state-npc2": 0.03882096145326728, "sim_compute_robot_state-npc3": 0.03894313123841949}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.700271710340483, "sim_physics": 0.09775730335351192, "survival_time": 4.94999999999999, "driven_lanedir": 0.3991905460241121, "sim_render-ego": 0.03534867065121429, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.10595181012394451, "deviation-heading": 0.855530480882093, "set_robot_commands": 0.05442011717594031, "deviation-center-line": 0.24229018356912108, "driven_lanedir_consec": 0.3991905460241121, "sim_compute_sim_state": 0.022363378544046426, "sim_compute_performance-ego": 0.038108204350327, "sim_compute_robot_state-ego": 0.04013008541531033, "sim_compute_robot_state-npc0": 0.040102850307117806, "sim_compute_robot_state-npc1": 0.03895624960311735, "sim_compute_robot_state-npc2": 0.03878874971409037, "sim_compute_robot_state-npc3": 0.038839130690603546}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5862873422480862, "sim_physics": 0.08646989740976473, "survival_time": 4.099999999999993, "driven_lanedir": 0.27147203845563306, "sim_render-ego": 0.03473831967609685, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1054262184515232, "deviation-heading": 1.0380357121602806, "set_robot_commands": 0.054558140475575514, "deviation-center-line": 0.14570146806926526, "driven_lanedir_consec": 0.27147203845563306, "sim_compute_sim_state": 0.022234454387571753, "sim_compute_performance-ego": 0.038017866088122854, "sim_compute_robot_state-ego": 0.04012385228785073, "sim_compute_robot_state-npc0": 0.03964814034903922, "sim_compute_robot_state-npc1": 0.03892076306226777, "sim_compute_robot_state-npc2": 0.03907135347040688, "sim_compute_robot_state-npc3": 0.03892021062897473}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.585842624678965, "sim_physics": 0.0847932129371457, "survival_time": 4.099999999999993, "driven_lanedir": 0.2745085024196974, "sim_render-ego": 0.0348028293470057, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.10702746670420576, "deviation-heading": 1.0027852651709186, "set_robot_commands": 0.05691554197450963, "deviation-center-line": 0.1397504796816527, "driven_lanedir_consec": 0.2745085024196974, "sim_compute_sim_state": 0.02231046630115044, "sim_compute_performance-ego": 0.038753762477781714, "sim_compute_robot_state-ego": 0.040164729443992055, "sim_compute_robot_state-npc0": 0.03954717008078971, "sim_compute_robot_state-npc1": 0.03895781389096888, "sim_compute_robot_state-npc2": 0.038852671297585094, "sim_compute_robot_state-npc3": 0.03886998281246278}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0308440498250055, "sim_physics": 0.08525754921678183, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6904228304510398, "sim_render-ego": 0.03557658541029778, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10763954425203628, "deviation-heading": 2.4712644616211517, "set_robot_commands": 0.05473290319028108, "deviation-center-line": 0.4417072683654324, "driven_lanedir_consec": 0.6873661888879385, "sim_compute_sim_state": 0.02223445885423301, "sim_compute_performance-ego": 0.03810760594796443, "sim_compute_robot_state-ego": 0.04009898330854333, "sim_compute_robot_state-npc0": 0.039681139199630074, "sim_compute_robot_state-npc1": 0.038988802743994674, "sim_compute_robot_state-npc2": 0.03875795136327329, "sim_compute_robot_state-npc3": 0.039258758227030434}}
set_robot_commands_max0.05691554197450963
set_robot_commands_mean0.05502105099681707
set_robot_commands_median0.054558140475575514
set_robot_commands_min0.05442011717594031
sim_compute_performance-ego_max0.038753762477781714
sim_compute_performance-ego_mean0.03824463296203605
sim_compute_performance-ego_median0.038108204350327
sim_compute_performance-ego_min0.038017866088122854
sim_compute_robot_state-ego_max0.040164729443992055
sim_compute_robot_state-ego_mean0.040135251711509515
sim_compute_robot_state-ego_median0.04013008541531033
sim_compute_robot_state-ego_min0.04009898330854333
sim_compute_robot_state-npc0_max0.040102850307117806
sim_compute_robot_state-npc0_mean0.03974615139987098
sim_compute_robot_state-npc0_median0.039681139199630074
sim_compute_robot_state-npc0_min0.03954717008078971
sim_compute_robot_state-npc1_max0.03907561460078157
sim_compute_robot_state-npc1_mean0.038979848780226055
sim_compute_robot_state-npc1_median0.03895781389096888
sim_compute_robot_state-npc1_min0.03892076306226777
sim_compute_robot_state-npc2_max0.03907135347040688
sim_compute_robot_state-npc2_mean0.038858337459724585
sim_compute_robot_state-npc2_median0.03882096145326728
sim_compute_robot_state-npc2_min0.03875795136327329
sim_compute_robot_state-npc3_max0.039258758227030434
sim_compute_robot_state-npc3_mean0.038966242719498195
sim_compute_robot_state-npc3_median0.03892021062897473
sim_compute_robot_state-npc3_min0.038839130690603546
sim_compute_sim_state_max0.02266210751817716
sim_compute_sim_state_mean0.022360973121035754
sim_compute_sim_state_median0.02231046630115044
sim_compute_sim_state_min0.022234454387571753
sim_physics_max0.09775730335351192
sim_physics_mean0.08840523998415159
sim_physics_median0.08646989740976473
sim_physics_min0.0847932129371457
sim_render-ego_max0.03557658541029778
sim_render-ego_mean0.03515799835391864
sim_render-ego_median0.035323586684978564
sim_render-ego_min0.03473831967609685
simulation-passed1
survival_time_max7.549999999999981
survival_time_mean5.519999999999989
survival_time_min4.099999999999993
No reset possible
240923890Kenechukwu Nnodu 🇨🇦ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:05:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240883884Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:15:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09464642109782218
survival_time_median1.2000000000000004
deviation-center-line_median0.08492785202182568
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.15396762745721
agent_compute-ego_mean0.11931572957186493
agent_compute-ego_median0.1203229029973348
agent_compute-ego_min0.09536440805955368
deviation-center-line_max0.5949931812686031
deviation-center-line_mean0.1086534447623132
deviation-center-line_min0.039850256773165914
deviation-heading_max4.999633616469041
deviation-heading_mean0.9768231104466104
deviation-heading_median0.713210573131171
deviation-heading_min0.5200301131468128
driven_any_max2.383651133034539
driven_any_mean0.3142300897889911
driven_any_median0.15315713481207294
driven_any_min0.09645557459617794
driven_lanedir_consec_max0.4282642183367859
driven_lanedir_consec_mean0.11890167803900162
driven_lanedir_consec_min0.054629316238435255
driven_lanedir_max0.4282642183367859
driven_lanedir_mean0.11890167803900162
driven_lanedir_median0.09464642109782218
driven_lanedir_min0.054629316238435255
in-drivable-lane_max9.600000000000062
in-drivable-lane_mean0.7600000000000041
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2169381569683068, "sim_physics": 0.19368364129747664, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1207617980224005, "sim_render-ego": 0.05642277002334595, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15396762745721, "deviation-heading": 0.8348307021929493, "set_robot_commands": 0.09085551330021448, "deviation-center-line": 0.07926129411248894, "driven_lanedir_consec": 0.1207617980224005, "sim_compute_sim_state": 0.04276849542345319, "sim_compute_performance-ego": 0.06628356661115374, "sim_compute_robot_state-ego": 0.06638609511511666, "sim_compute_robot_state-npc0": 0.06818064621516637, "sim_compute_robot_state-npc1": 0.06418060404913765, "sim_compute_robot_state-npc2": 0.0648796728679112, "sim_compute_robot_state-npc3": 0.07045877831322807}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.383651133034539, "sim_physics": 0.13925752719243367, "survival_time": 14.950000000000076, "driven_lanedir": 0.4282642183367859, "sim_render-ego": 0.05234039386113485, "in-drivable-lane": 9.600000000000062, "agent_compute-ego": 0.14147676388422648, "deviation-heading": 4.999633616469041, "set_robot_commands": 0.07847106138865154, "deviation-center-line": 0.5949931812686031, "driven_lanedir_consec": 0.4282642183367859, "sim_compute_sim_state": 0.033446121215820315, "sim_compute_performance-ego": 0.05662838141123454, "sim_compute_robot_state-ego": 0.05939232110977173, "sim_compute_robot_state-npc0": 0.059979031880696615, "sim_compute_robot_state-npc1": 0.056641065279642744, "sim_compute_robot_state-npc2": 0.058220168749491374, "sim_compute_robot_state-npc3": 0.05739686886469523}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12994206019093676, "sim_physics": 0.1312263011932373, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0952374949104553, "sim_render-ego": 0.04760041444197945, "in-drivable-lane": 0, "agent_compute-ego": 0.13711768647898798, "deviation-heading": 0.5385069644586731, "set_robot_commands": 0.0689934958582339, "deviation-center-line": 0.0994934994483332, "driven_lanedir_consec": 0.0952374949104553, "sim_compute_sim_state": 0.02905559539794922, "sim_compute_performance-ego": 0.05120415272920028, "sim_compute_robot_state-ego": 0.05330252647399902, "sim_compute_robot_state-npc0": 0.05147458159405252, "sim_compute_robot_state-npc1": 0.051004316495812455, "sim_compute_robot_state-npc2": 0.052701836046965225, "sim_compute_robot_state-npc3": 0.051170121068539826}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1471752446927979, "sim_physics": 0.13749612932619842, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10717368812276272, "sim_render-ego": 0.042471553968346634, "in-drivable-lane": 0, "agent_compute-ego": 0.11599596686985182, "deviation-heading": 0.5200301131468128, "set_robot_commands": 0.0675116310948911, "deviation-center-line": 0.09365497826042356, "driven_lanedir_consec": 0.10717368812276272, "sim_compute_sim_state": 0.027966177981832752, "sim_compute_performance-ego": 0.04762149893719217, "sim_compute_robot_state-ego": 0.049395944761193314, "sim_compute_robot_state-npc0": 0.05110902371613875, "sim_compute_robot_state-npc1": 0.050802811332370926, "sim_compute_robot_state-npc2": 0.04896519495093304, "sim_compute_robot_state-npc3": 0.04905642633852751}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1510041372310482, "sim_physics": 0.11758848031361896, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09464642109782218, "sim_render-ego": 0.05385173360506693, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.11435118317604064, "deviation-heading": 0.7667562947873823, "set_robot_commands": 0.06364004810651143, "deviation-center-line": 0.05743555216142518, "driven_lanedir_consec": 0.09464642109782218, "sim_compute_sim_state": 0.028602053721745808, "sim_compute_performance-ego": 0.04955236117045085, "sim_compute_robot_state-ego": 0.047390639781951904, "sim_compute_robot_state-npc0": 0.048745701710383095, "sim_compute_robot_state-npc1": 0.04914548993110657, "sim_compute_robot_state-npc2": 0.049005607763926186, "sim_compute_robot_state-npc3": 0.05067160725593567}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2768066726686924, "sim_physics": 0.11809584341551128, "survival_time": 1.900000000000001, "driven_lanedir": 0.14095475221873377, "sim_render-ego": 0.044280202765213814, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.12081958118237948, "deviation-heading": 0.7871070322801896, "set_robot_commands": 0.06711953564694054, "deviation-center-line": 0.06691018742577635, "driven_lanedir_consec": 0.14095475221873377, "sim_compute_sim_state": 0.02756236101451673, "sim_compute_performance-ego": 0.05113836966062847, "sim_compute_robot_state-ego": 0.050507896824886926, "sim_compute_robot_state-npc0": 0.04977216218647204, "sim_compute_robot_state-npc1": 0.05012666551690353, "sim_compute_robot_state-npc2": 0.05182892397830361, "sim_compute_robot_state-npc3": 0.04791023856715152}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.13235082773159487, "sim_physics": 0.14058497677678647, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09202433632990736, "sim_render-ego": 0.04732066652049189, "in-drivable-lane": 0, "agent_compute-ego": 0.1451940743819527, "deviation-heading": 0.6354606059372034, "set_robot_commands": 0.07004475593566895, "deviation-center-line": 0.08564640653410699, "driven_lanedir_consec": 0.09202433632990736, "sim_compute_sim_state": 0.031027265216993248, "sim_compute_performance-ego": 0.05547931919927183, "sim_compute_robot_state-ego": 0.05476229087166165, "sim_compute_robot_state-npc0": 0.051355569258980126, "sim_compute_robot_state-npc1": 0.052590888479481575, "sim_compute_robot_state-npc2": 0.05145232573799465, "sim_compute_robot_state-npc3": 0.05143707731495733}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1343330226789773, "sim_physics": 0.13072068794913913, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09451693155127484, "sim_render-ego": 0.047941974971605385, "in-drivable-lane": 0, "agent_compute-ego": 0.11274652895720108, "deviation-heading": 0.5485659700079921, "set_robot_commands": 0.0626298655634341, "deviation-center-line": 0.08492785202182568, "driven_lanedir_consec": 0.09451693155127484, "sim_compute_sim_state": 0.02695191424825917, "sim_compute_performance-ego": 0.05464542430380116, "sim_compute_robot_state-ego": 0.05362454704616381, "sim_compute_robot_state-npc0": 0.051082123880800995, "sim_compute_robot_state-npc1": 0.04748973639115043, "sim_compute_robot_state-npc2": 0.04598322121993355, "sim_compute_robot_state-npc3": 0.04798801048942234}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2125423320810019, "sim_physics": 0.12391820820895108, "survival_time": 1.6500000000000008, "driven_lanedir": 0.11227964866586726, "sim_render-ego": 0.04380813511935147, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12153488216978132, "deviation-heading": 0.713210573131171, "set_robot_commands": 0.06634340864239317, "deviation-center-line": 0.039850256773165914, "driven_lanedir_consec": 0.11227964866586726, "sim_compute_sim_state": 0.034091039137406784, "sim_compute_performance-ego": 0.04841249639337713, "sim_compute_robot_state-ego": 0.05129738287492232, "sim_compute_robot_state-npc0": 0.050176259243127075, "sim_compute_robot_state-npc1": 0.04881585005557898, "sim_compute_robot_state-npc2": 0.0483325177972967, "sim_compute_robot_state-npc3": 0.05006989565762607}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1705422482206573, "sim_physics": 0.12413460237008554, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07147872369992792, "sim_render-ego": 0.045106455131813335, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.12272327034561722, "deviation-heading": 0.7924963042460201, "set_robot_commands": 0.07096343570285374, "deviation-center-line": 0.0408213194150243, "driven_lanedir_consec": 0.07147872369992792, "sim_compute_sim_state": 0.028765492969089083, "sim_compute_performance-ego": 0.051578380443431715, "sim_compute_robot_state-ego": 0.05085244885197392, "sim_compute_robot_state-npc0": 0.05169189417803729, "sim_compute_robot_state-npc1": 0.052217960357666016, "sim_compute_robot_state-npc2": 0.05016806390550402, "sim_compute_robot_state-npc3": 0.05072670512729221}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15315713481207294, "sim_physics": 0.13392606377601624, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08614546493986364, "sim_render-ego": 0.04801710446675619, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1203229029973348, "deviation-heading": 0.8598516045028022, "set_robot_commands": 0.06506309906641643, "deviation-center-line": 0.05710949895002309, "driven_lanedir_consec": 0.08614546493986364, "sim_compute_sim_state": 0.02670477827390035, "sim_compute_performance-ego": 0.05047269662221273, "sim_compute_robot_state-ego": 0.05194553732872009, "sim_compute_robot_state-npc0": 0.05345850189526876, "sim_compute_robot_state-npc1": 0.0496842364470164, "sim_compute_robot_state-npc2": 0.05008699496587118, "sim_compute_robot_state-npc3": 0.05342152714729309}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09645557459617794, "sim_physics": 0.09377309083938598, "survival_time": 1.0000000000000002, "driven_lanedir": 0.054629316238435255, "sim_render-ego": 0.03668016195297241, "in-drivable-lane": 0, "agent_compute-ego": 0.09657022953033448, "deviation-heading": 0.63772223540468, "set_robot_commands": 0.05552936792373657, "deviation-center-line": 0.08644813848361921, "driven_lanedir_consec": 0.054629316238435255, "sim_compute_sim_state": 0.02373499870300293, "sim_compute_performance-ego": 0.04021471738815307, "sim_compute_robot_state-ego": 0.04127472639083862, "sim_compute_robot_state-npc0": 0.04141225814819336, "sim_compute_robot_state-npc1": 0.04415287971496582, "sim_compute_robot_state-npc2": 0.040843427181243896, "sim_compute_robot_state-npc3": 0.041016900539398195}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.23017531496557964, "sim_physics": 0.0960474077023958, "survival_time": 1.900000000000001, "driven_lanedir": 0.09454393651016868, "sim_render-ego": 0.03652028661025198, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09581414021943745, "deviation-heading": 0.7279772434349133, "set_robot_commands": 0.05465370730349892, "deviation-center-line": 0.06575066821449864, "driven_lanedir_consec": 0.09454393651016868, "sim_compute_sim_state": 0.022987265335886103, "sim_compute_performance-ego": 0.03908419609069824, "sim_compute_robot_state-ego": 0.04077482223510742, "sim_compute_robot_state-npc0": 0.040388766087983786, "sim_compute_robot_state-npc1": 0.03991152738270007, "sim_compute_robot_state-npc2": 0.03980066274341784, "sim_compute_robot_state-npc3": 0.039807840397483425}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11655141042153444, "sim_physics": 0.10001468658447266, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07435551761806014, "sim_render-ego": 0.03607606887817383, "in-drivable-lane": 0, "agent_compute-ego": 0.09536440805955368, "deviation-heading": 0.6027586212287058, "set_robot_commands": 0.05394143407995051, "deviation-center-line": 0.087640768931293, "driven_lanedir_consec": 0.07435551761806014, "sim_compute_sim_state": 0.022705273194746536, "sim_compute_performance-ego": 0.03852435675534335, "sim_compute_robot_state-ego": 0.04066796736283736, "sim_compute_robot_state-npc0": 0.04663211649114435, "sim_compute_robot_state-npc1": 0.03968923742120916, "sim_compute_robot_state-npc2": 0.039297418160872025, "sim_compute_robot_state-npc3": 0.03940920396284624}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1618260765409495, "sim_physics": 0.09627190342655888, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11651292232255894, "sim_render-ego": 0.03628029646696867, "in-drivable-lane": 0, "agent_compute-ego": 0.0957366978680646, "deviation-heading": 0.687438775470617, "set_robot_commands": 0.0552858864819562, "deviation-center-line": 0.08985806943409097, "driven_lanedir_consec": 0.11651292232255894, "sim_compute_sim_state": 0.023534474549470125, "sim_compute_performance-ego": 0.04113757168805158, "sim_compute_robot_state-ego": 0.04068303108215332, "sim_compute_robot_state-npc0": 0.04063289253800004, "sim_compute_robot_state-npc1": 0.04020673257333261, "sim_compute_robot_state-npc2": 0.040311062777483905, "sim_compute_robot_state-npc3": 0.04007356255142777}}
set_robot_commands_max0.09085551330021448
set_robot_commands_mean0.06606974973969011
set_robot_commands_median0.06634340864239317
set_robot_commands_min0.05394143407995051
sim_compute_performance-ego_max0.06628356661115374
sim_compute_performance-ego_mean0.04946516596028006
sim_compute_performance-ego_median0.05047269662221273
sim_compute_performance-ego_min0.03852435675534335
sim_compute_robot_state-ego_max0.06638609511511666
sim_compute_robot_state-ego_mean0.05015054520741987
sim_compute_robot_state-ego_median0.05085244885197392
sim_compute_robot_state-ego_min0.04066796736283736
sim_compute_robot_state-npc0_max0.06818064621516637
sim_compute_robot_state-npc0_mean0.05040610193496302
sim_compute_robot_state-npc0_median0.051082123880800995
sim_compute_robot_state-npc0_min0.040388766087983786
sim_compute_robot_state-npc1_max0.06418060404913765
sim_compute_robot_state-npc1_mean0.04911066676187166
sim_compute_robot_state-npc1_median0.0496842364470164
sim_compute_robot_state-npc1_min0.03968923742120916
sim_compute_robot_state-npc2_max0.0648796728679112
sim_compute_robot_state-npc2_mean0.048791806589809895
sim_compute_robot_state-npc2_median0.049005607763926186
sim_compute_robot_state-npc2_min0.039297418160872025
sim_compute_robot_state-npc3_max0.07045877831322807
sim_compute_robot_state-npc3_mean0.049374317573054965
sim_compute_robot_state-npc3_median0.05006989565762607
sim_compute_robot_state-npc3_min0.03940920396284624
sim_compute_sim_state_max0.04276849542345319
sim_compute_sim_state_mean0.028660220425604822
sim_compute_sim_state_median0.027966177981832752
sim_compute_sim_state_min0.022705273194746536
sim_physics_max0.19368364129747664
sim_physics_mean0.12511597002481786
sim_physics_median0.12413460237008554
sim_physics_min0.09377309083938598
sim_render-ego_max0.05642277002334595
sim_render-ego_mean0.04498121458556485
sim_render-ego_median0.045106455131813335
sim_render-ego_min0.03607606887817383
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean2.240000000000006
survival_time_min1.0000000000000002
No reset possible
240873887Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240803875Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6541878729054376
survival_time_median6.499999999999985
deviation-center-line_median0.21285536434279484
in-drivable-lane_median1.7999999999999936


other stats
agent_compute-ego_max0.13311968198636684
agent_compute-ego_mean0.12998987339837637
agent_compute-ego_median0.12897844951931792
agent_compute-ego_min0.12855414334189127
deviation-center-line_max0.2996643414830513
deviation-center-line_mean0.21741217969364596
deviation-center-line_min0.1469637483843213
deviation-heading_max1.2883364790119565
deviation-heading_mean1.0833946686631195
deviation-heading_median1.1537219833965882
deviation-heading_min0.733110378110384
driven_any_max1.5927816095366192
driven_any_mean0.971123632434774
driven_any_median1.0001875883999296
driven_any_min0.2784453903590132
driven_lanedir_consec_max1.2484562083427075
driven_lanedir_consec_mean0.7503156088781218
driven_lanedir_consec_min0.2588688143675444
driven_lanedir_max1.2484562083427075
driven_lanedir_mean0.7503156088781218
driven_lanedir_median0.6541878729054376
driven_lanedir_min0.2588688143675444
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean1.14000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0001875883999296, "sim_physics": 0.09355184481694148, "survival_time": 6.499999999999985, "driven_lanedir": 0.6541878729054376, "sim_render-ego": 0.03620147705078125, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13064285058241623, "deviation-heading": 1.2883364790119565, "set_robot_commands": 0.05423404436845046, "deviation-center-line": 0.21285536434279484, "driven_lanedir_consec": 0.6541878729054376, "sim_compute_sim_state": 0.02281950620504526, "sim_compute_performance-ego": 0.03882919825040377, "sim_compute_robot_state-ego": 0.041160944791940546, "sim_compute_robot_state-npc0": 0.040582746725815994, "sim_compute_robot_state-npc1": 0.03983729252448449, "sim_compute_robot_state-npc2": 0.03977323495424711, "sim_compute_robot_state-npc3": 0.0398505687713623}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4000494818438822, "sim_physics": 0.09699961117335729, "survival_time": 2.799999999999998, "driven_lanedir": 0.3704956406403946, "sim_render-ego": 0.03571613345827375, "in-drivable-lane": 0, "agent_compute-ego": 0.12865424156188965, "deviation-heading": 1.0579718738836832, "set_robot_commands": 0.05383766123226711, "deviation-center-line": 0.20804453979512696, "driven_lanedir_consec": 0.3704956406403946, "sim_compute_sim_state": 0.0229494571685791, "sim_compute_performance-ego": 0.039141676255634854, "sim_compute_robot_state-ego": 0.04119184187480381, "sim_compute_robot_state-npc0": 0.04081609419413975, "sim_compute_robot_state-npc1": 0.04085782170295715, "sim_compute_robot_state-npc2": 0.0398946361882346, "sim_compute_robot_state-npc3": 0.04005725468908038}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5841540920344257, "sim_physics": 0.09303592573298086, "survival_time": 10.100000000000009, "driven_lanedir": 1.2484562083427075, "sim_render-ego": 0.03602271622950488, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.12897844951931792, "deviation-heading": 1.1838326289129877, "set_robot_commands": 0.05393652514655992, "deviation-center-line": 0.2996643414830513, "driven_lanedir_consec": 1.2484562083427075, "sim_compute_sim_state": 0.023954271089912643, "sim_compute_performance-ego": 0.038933945174264434, "sim_compute_robot_state-ego": 0.041364440823545554, "sim_compute_robot_state-npc0": 0.04088006397285083, "sim_compute_robot_state-npc1": 0.04013344675007433, "sim_compute_robot_state-npc2": 0.04015981088770498, "sim_compute_robot_state-npc3": 0.04011748922933446}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5927816095366192, "sim_physics": 0.09484373524858448, "survival_time": 10.15000000000001, "driven_lanedir": 1.219569508134525, "sim_render-ego": 0.03926158773488011, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.12855414334189127, "deviation-heading": 1.1537219833965882, "set_robot_commands": 0.05431305128952552, "deviation-center-line": 0.2195329044629353, "driven_lanedir_consec": 1.219569508134525, "sim_compute_sim_state": 0.02308144475438912, "sim_compute_performance-ego": 0.039383946968416864, "sim_compute_robot_state-ego": 0.04128232495538119, "sim_compute_robot_state-npc0": 0.040982439012950275, "sim_compute_robot_state-npc1": 0.040271773126912234, "sim_compute_robot_state-npc2": 0.04011071961501549, "sim_compute_robot_state-npc3": 0.04028053001817224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2784453903590132, "sim_physics": 0.09054381091420244, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2588688143675444, "sim_render-ego": 0.03630098482457603, "in-drivable-lane": 0, "agent_compute-ego": 0.13311968198636684, "deviation-heading": 0.733110378110384, "set_robot_commands": 0.053614790846661826, "deviation-center-line": 0.1469637483843213, "driven_lanedir_consec": 0.2588688143675444, "sim_compute_sim_state": 0.02286113762274021, "sim_compute_performance-ego": 0.038873620149565906, "sim_compute_robot_state-ego": 0.041360546902912416, "sim_compute_robot_state-npc0": 0.040987590464150035, "sim_compute_robot_state-npc1": 0.039886474609375, "sim_compute_robot_state-npc2": 0.039785047856772816, "sim_compute_robot_state-npc3": 0.03989816293483827}}
set_robot_commands_max0.05431305128952552
set_robot_commands_mean0.05398721457669296
set_robot_commands_median0.05393652514655992
set_robot_commands_min0.053614790846661826
sim_compute_performance-ego_max0.039383946968416864
sim_compute_performance-ego_mean0.03903247735965717
sim_compute_performance-ego_median0.038933945174264434
sim_compute_performance-ego_min0.03882919825040377
sim_compute_robot_state-ego_max0.041364440823545554
sim_compute_robot_state-ego_mean0.0412720198697167
sim_compute_robot_state-ego_median0.04128232495538119
sim_compute_robot_state-ego_min0.041160944791940546
sim_compute_robot_state-npc0_max0.040987590464150035
sim_compute_robot_state-npc0_mean0.04084978687398138
sim_compute_robot_state-npc0_median0.04088006397285083
sim_compute_robot_state-npc0_min0.040582746725815994
sim_compute_robot_state-npc1_max0.04085782170295715
sim_compute_robot_state-npc1_mean0.04019736174276064
sim_compute_robot_state-npc1_median0.04013344675007433
sim_compute_robot_state-npc1_min0.03983729252448449
sim_compute_robot_state-npc2_max0.04015981088770498
sim_compute_robot_state-npc2_mean0.039944689900395
sim_compute_robot_state-npc2_median0.0398946361882346
sim_compute_robot_state-npc2_min0.03977323495424711
sim_compute_robot_state-npc3_max0.04028053001817224
sim_compute_robot_state-npc3_mean0.04004080112855753
sim_compute_robot_state-npc3_median0.04005725468908038
sim_compute_robot_state-npc3_min0.0398505687713623
sim_compute_sim_state_max0.023954271089912643
sim_compute_sim_state_mean0.023133163368133265
sim_compute_sim_state_median0.0229494571685791
sim_compute_sim_state_min0.02281950620504526
sim_physics_max0.09699961117335729
sim_physics_mean0.0937949855772133
sim_physics_median0.09355184481694148
sim_physics_min0.09054381091420244
sim_render-ego_max0.03926158773488011
sim_render-ego_mean0.036700579859603205
sim_render-ego_median0.03620147705078125
sim_render-ego_min0.03571613345827375
simulation-passed1
survival_time_max10.15000000000001
survival_time_mean6.32
survival_time_min2.0500000000000007
No reset possible
240723867Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:02:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240703859Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflow-keneaido2-LF-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-73570:01:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240663862Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-73570:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240533854Junghyun Seo 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:16:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1371598542005299
survival_time_median1.3000000000000005
deviation-center-line_median0.09292786499235496
in-drivable-lane_median0


other stats
agent_compute-ego_max0.18579840660095215
agent_compute-ego_mean0.16500386581662657
agent_compute-ego_median0.16753902218558572
agent_compute-ego_min0.13757304711775345
deviation-center-line_max0.11261393365794942
deviation-center-line_mean0.08655641482136449
deviation-center-line_min0.05231169064260295
deviation-heading_max1.0309560039059604
deviation-heading_mean0.6975068417402392
deviation-heading_median0.6987638844609522
deviation-heading_min0.4373801024398298
driven_any_max0.28053613392423
driven_any_mean0.19278626560320836
driven_any_median0.1869157628808118
driven_any_min0.1449308162543998
driven_lanedir_consec_max0.2067562456801104
driven_lanedir_consec_mean0.13808585631987003
driven_lanedir_consec_min0.08270646924739555
driven_lanedir_max0.2067562456801104
driven_lanedir_mean0.13808585631987003
driven_lanedir_median0.1371598542005299
driven_lanedir_min0.08270646924739555
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.01666666666666668
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22783281827078045, "sim_physics": 0.1872801701227824, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14377534685426596, "sim_render-ego": 0.056652164459228514, "in-drivable-lane": 0, "agent_compute-ego": 0.16776099999745686, "deviation-heading": 0.9402545504069424, "set_robot_commands": 0.09128880500793456, "deviation-center-line": 0.098102811796838, "driven_lanedir_consec": 0.14377534685426596, "sim_compute_sim_state": 0.036708648999532065, "sim_compute_performance-ego": 0.06441977024078369, "sim_compute_robot_state-ego": 0.07285064856211344, "sim_compute_robot_state-npc0": 0.06928630669911702, "sim_compute_robot_state-npc1": 0.06723169485727946, "sim_compute_robot_state-npc2": 0.062271714210510254, "sim_compute_robot_state-npc3": 0.06117169857025147}, "udem1-1-0": {"driven_any": 0.1869157628808118, "sim_physics": 0.2689271890200101, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08270646924739555, "sim_render-ego": 0.0625298756819505, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1669391210262592, "deviation-heading": 1.0309560039059604, "set_robot_commands": 0.08903074264526367, "deviation-center-line": 0.08286759334036747, "driven_lanedir_consec": 0.08270646924739555, "sim_compute_sim_state": 0.03923145624307486, "sim_compute_performance-ego": 0.06953957447638878, "sim_compute_robot_state-ego": 0.07070011358994704, "sim_compute_robot_state-npc0": 0.06470822370969333, "sim_compute_robot_state-npc1": 0.06569979741023137, "sim_compute_robot_state-npc2": 0.06478359149052547, "sim_compute_robot_state-npc3": 0.06502033196962796}, "udem1-2-0": {"driven_any": 0.19168168441627384, "sim_physics": 0.2365947818756103, "survival_time": 1.2500000000000004, "driven_lanedir": 0.16363354821873077, "sim_render-ego": 0.062076539993286134, "in-drivable-lane": 0, "agent_compute-ego": 0.16893345832824708, "deviation-heading": 0.4373801024398298, "set_robot_commands": 0.08716030120849609, "deviation-center-line": 0.11261393365794942, "driven_lanedir_consec": 0.16363354821873077, "sim_compute_sim_state": 0.038523015975952146, "sim_compute_performance-ego": 0.06781340599060058, "sim_compute_robot_state-ego": 0.07347149848937988, "sim_compute_robot_state-npc0": 0.06602313995361328, "sim_compute_robot_state-npc1": 0.06296246528625488, "sim_compute_robot_state-npc2": 0.0622218132019043, "sim_compute_robot_state-npc3": 0.06600969314575195}, "udem1-3-0": {"driven_any": 0.16642043959668368, "sim_physics": 0.21113449096679687, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13487665729593457, "sim_render-ego": 0.06617709159851075, "in-drivable-lane": 0, "agent_compute-ego": 0.16947630882263184, "deviation-heading": 0.5109010353914598, "set_robot_commands": 0.0897713565826416, "deviation-center-line": 0.10736284269551488, "driven_lanedir_consec": 0.13487665729593457, "sim_compute_sim_state": 0.037936191558837894, "sim_compute_performance-ego": 0.06672269821166993, "sim_compute_robot_state-ego": 0.08328328132629395, "sim_compute_robot_state-npc0": 0.06788670539855957, "sim_compute_robot_state-npc1": 0.0644350528717041, "sim_compute_robot_state-npc2": 0.06335843086242676, "sim_compute_robot_state-npc3": 0.062271137237548825}, "udem1-4-0": {"driven_any": 0.14991609321504437, "sim_physics": 0.2053361264142123, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1003252625085762, "sim_render-ego": 0.05950606953014027, "in-drivable-lane": 0, "agent_compute-ego": 0.15542833371595902, "deviation-heading": 0.6987638844609522, "set_robot_commands": 0.08553024855527011, "deviation-center-line": 0.05451821635175491, "driven_lanedir_consec": 0.1003252625085762, "sim_compute_sim_state": 0.0421573899009011, "sim_compute_performance-ego": 0.06838505918329413, "sim_compute_robot_state-ego": 0.06819997050545433, "sim_compute_robot_state-npc0": 0.0660637075250799, "sim_compute_robot_state-npc1": 0.06619884751059792, "sim_compute_robot_state-npc2": 0.07096363197673451, "sim_compute_robot_state-npc3": 0.07140315662730824}, "udem1-5-0": {"driven_any": 0.28007110621056813, "sim_physics": 0.13850387164524625, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2067562456801104, "sim_render-ego": 0.04852980886186872, "in-drivable-lane": 0, "agent_compute-ego": 0.15310047013419015, "deviation-heading": 0.94791127198013, "set_robot_commands": 0.07475220135280064, "deviation-center-line": 0.09819857319933724, "driven_lanedir_consec": 0.2067562456801104, "sim_compute_sim_state": 0.03024789265223912, "sim_compute_performance-ego": 0.04943130356924874, "sim_compute_robot_state-ego": 0.05313466617039272, "sim_compute_robot_state-npc0": 0.05234537124633789, "sim_compute_robot_state-npc1": 0.053537818363734654, "sim_compute_robot_state-npc2": 0.05205169405255999, "sim_compute_robot_state-npc3": 0.05157243864876883}, "udem1-6-0": {"driven_any": 0.1449308162543998, "sim_physics": 0.2355520725250244, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10785108907885776, "sim_render-ego": 0.06068704345009544, "in-drivable-lane": 0, "agent_compute-ego": 0.18579840660095215, "deviation-heading": 0.5276241181076088, "set_robot_commands": 0.08484922755848277, "deviation-center-line": 0.08360544191861158, "driven_lanedir_consec": 0.10785108907885776, "sim_compute_sim_state": 0.03598497130654075, "sim_compute_performance-ego": 0.08184806867079301, "sim_compute_robot_state-ego": 0.07781931486996738, "sim_compute_robot_state-npc0": 0.06035684455524792, "sim_compute_robot_state-npc1": 0.06451882015575063, "sim_compute_robot_state-npc2": 0.062589092688127, "sim_compute_robot_state-npc3": 0.09882928024638785}, "udem1-7-0": {"driven_any": 0.1881170879548005, "sim_physics": 0.21730143290299636, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15205239869563014, "sim_render-ego": 0.06631347766289344, "in-drivable-lane": 0, "agent_compute-ego": 0.1787296166786781, "deviation-heading": 0.5528147265350744, "set_robot_commands": 0.10027300394498384, "deviation-center-line": 0.10117560760183122, "driven_lanedir_consec": 0.15205239869563014, "sim_compute_sim_state": 0.04124137071462778, "sim_compute_performance-ego": 0.07233170362619254, "sim_compute_robot_state-ego": 0.07881722083458534, "sim_compute_robot_state-npc0": 0.06970692597902738, "sim_compute_robot_state-npc1": 0.07159142310802753, "sim_compute_robot_state-npc2": 0.07072402880742, "sim_compute_robot_state-npc3": 0.06863686671623817}, "udem1-8-0": {"driven_any": 0.23920496220878856, "sim_physics": 0.20028194304435484, "survival_time": 1.5500000000000007, "driven_lanedir": 0.17655627353083947, "sim_render-ego": 0.06095598589989447, "in-drivable-lane": 0, "agent_compute-ego": 0.15968458114131803, "deviation-heading": 0.786157493154267, "set_robot_commands": 0.0933083257367534, "deviation-center-line": 0.06402934126263829, "driven_lanedir_consec": 0.17655627353083947, "sim_compute_sim_state": 0.04134562707716419, "sim_compute_performance-ego": 0.06520863502256331, "sim_compute_robot_state-ego": 0.07337607875947029, "sim_compute_robot_state-npc0": 0.06486282040995936, "sim_compute_robot_state-npc1": 0.06638474618234942, "sim_compute_robot_state-npc2": 0.06605490561454527, "sim_compute_robot_state-npc3": 0.06688547903491605}, "udem1-9-0": {"driven_any": 0.18024741724286616, "sim_physics": 0.20129212049337533, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1104881292730131, "sim_render-ego": 0.05873758976276104, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16785922417273888, "deviation-heading": 0.8473445623984381, "set_robot_commands": 0.09174740314483644, "deviation-center-line": 0.05826237887534931, "driven_lanedir_consec": 0.1104881292730131, "sim_compute_sim_state": 0.03584491289578951, "sim_compute_performance-ego": 0.06221193533677321, "sim_compute_robot_state-ego": 0.07036058719341572, "sim_compute_robot_state-npc0": 0.06262434445894681, "sim_compute_robot_state-npc1": 0.0606230038862962, "sim_compute_robot_state-npc2": 0.060671549576979414, "sim_compute_robot_state-npc3": 0.05996836148775541}, "udem1-10-0": {"driven_any": 0.15798818541595136, "sim_physics": 0.19105988199060617, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09933152372287311, "sim_render-ego": 0.06220794807780872, "in-drivable-lane": 0, "agent_compute-ego": 0.16753902218558572, "deviation-heading": 0.7602820761914708, "set_robot_commands": 0.0933679992502386, "deviation-center-line": 0.05231169064260295, "driven_lanedir_consec": 0.09933152372287311, "sim_compute_sim_state": 0.03549266945232044, "sim_compute_performance-ego": 0.06332627209750089, "sim_compute_robot_state-ego": 0.06802324815229936, "sim_compute_robot_state-npc0": 0.0679442665793679, "sim_compute_robot_state-npc1": 0.07029416344382546, "sim_compute_robot_state-npc2": 0.06319348378614946, "sim_compute_robot_state-npc3": 0.0638445182280107}, "udem1-11-0": {"driven_any": 0.16312973523126456, "sim_physics": 0.15451682697642932, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1371598542005299, "sim_render-ego": 0.05602303418246182, "in-drivable-lane": 0, "agent_compute-ego": 0.13757304711775345, "deviation-heading": 0.4449012050557953, "set_robot_commands": 0.07747678323225542, "deviation-center-line": 0.09959085088620726, "driven_lanedir_consec": 0.1371598542005299, "sim_compute_sim_state": 0.02816571972586892, "sim_compute_performance-ego": 0.05658142133192583, "sim_compute_robot_state-ego": 0.06233693252910267, "sim_compute_robot_state-npc0": 0.05613564361225475, "sim_compute_robot_state-npc1": 0.05458421056920832, "sim_compute_robot_state-npc2": 0.053262309594587845, "sim_compute_robot_state-npc3": 0.05088052966377952}, "udem1-12-0": {"driven_any": 0.28053613392423, "sim_physics": 0.18895691633224487, "survival_time": 1.800000000000001, "driven_lanedir": 0.1888935037178869, "sim_render-ego": 0.05913208590613471, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15931777821646798, "deviation-heading": 0.895955649658398, "set_robot_commands": 0.07940828800201416, "deviation-center-line": 0.10491426239839526, "driven_lanedir_consec": 0.1888935037178869, "sim_compute_sim_state": 0.03285072909461127, "sim_compute_performance-ego": 0.05963895055982801, "sim_compute_robot_state-ego": 0.06202723582585653, "sim_compute_robot_state-npc0": 0.055852923128339976, "sim_compute_robot_state-npc1": 0.058699230353037514, "sim_compute_robot_state-npc2": 0.056205418374803334, "sim_compute_robot_state-npc3": 0.05467958582772149}, "udem1-13-0": {"driven_any": 0.1464734232978125, "sim_physics": 0.19727246327833697, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11759590043772584, "sim_render-ego": 0.055433002385226166, "in-drivable-lane": 0, "agent_compute-ego": 0.17048739303242078, "deviation-heading": 0.459152378083727, "set_robot_commands": 0.09765049544247714, "deviation-center-line": 0.0878648127007144, "driven_lanedir_consec": 0.11759590043772584, "sim_compute_sim_state": 0.03930010578849099, "sim_compute_performance-ego": 0.06211214715784246, "sim_compute_robot_state-ego": 0.06721818447113037, "sim_compute_robot_state-npc0": 0.07040354338559238, "sim_compute_robot_state-npc1": 0.06630426103418524, "sim_compute_robot_state-npc2": 0.06684204665097324, "sim_compute_robot_state-npc3": 0.07060130075974898}, "udem1-14-0": {"driven_any": 0.18832831792784943, "sim_physics": 0.19635727670457628, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1492856423356812, "sim_render-ego": 0.060224727348045064, "in-drivable-lane": 0, "agent_compute-ego": 0.16643022607873986, "deviation-heading": 0.622203568333533, "set_robot_commands": 0.1020048635977286, "deviation-center-line": 0.09292786499235496, "driven_lanedir_consec": 0.1492856423356812, "sim_compute_sim_state": 0.03748536992956091, "sim_compute_performance-ego": 0.06627879319367586, "sim_compute_robot_state-ego": 0.07196825521963614, "sim_compute_robot_state-npc0": 0.07367396354675293, "sim_compute_robot_state-npc1": 0.06801936361524794, "sim_compute_robot_state-npc2": 0.06457308486655906, "sim_compute_robot_state-npc3": 0.06544495511938024}}
set_robot_commands_max0.1020048635977286
set_robot_commands_mean0.08917466968414513
set_robot_commands_median0.0897713565826416
set_robot_commands_min0.07475220135280064
sim_compute_performance-ego_max0.08184806867079301
sim_compute_performance-ego_mean0.0650566492446054
sim_compute_performance-ego_median0.06520863502256331
sim_compute_performance-ego_min0.04943130356924874
sim_compute_robot_state-ego_max0.08328328132629395
sim_compute_robot_state-ego_mean0.07023914909993634
sim_compute_robot_state-ego_median0.07070011358994704
sim_compute_robot_state-ego_min0.05313466617039272
sim_compute_robot_state-npc0_max0.07367396354675293
sim_compute_robot_state-npc0_mean0.06452498201252603
sim_compute_robot_state-npc0_median0.06602313995361328
sim_compute_robot_state-npc0_min0.05234537124633789
sim_compute_robot_state-npc1_max0.07159142310802753
sim_compute_robot_state-npc1_mean0.06407232657651536
sim_compute_robot_state-npc1_median0.06569979741023137
sim_compute_robot_state-npc1_min0.053537818363734654
sim_compute_robot_state-npc2_max0.07096363197673451
sim_compute_robot_state-npc2_mean0.06265111971698706
sim_compute_robot_state-npc2_median0.06319348378614946
sim_compute_robot_state-npc2_min0.05205169405255999
sim_compute_robot_state-npc3_max0.09882928024638785
sim_compute_robot_state-npc3_mean0.06514795555221305
sim_compute_robot_state-npc3_median0.06502033196962796
sim_compute_robot_state-npc3_min0.05088052966377952
sim_compute_sim_state_max0.0421573899009011
sim_compute_sim_state_mean0.03683440475436746
sim_compute_sim_state_median0.03748536992956091
sim_compute_sim_state_min0.02816571972586892
sim_physics_max0.2689271890200101
sim_physics_mean0.20202450428617352
sim_physics_median0.20028194304435484
sim_physics_min0.13850387164524625
sim_render-ego_max0.06631347766289344
sim_render-ego_mean0.05967909632002038
sim_render-ego_median0.060224727348045064
sim_render-ego_min0.04852980886186872
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.323333333333334
survival_time_min1.1000000000000003
No reset possible
240483845Kenechukwu Nnodu 🇨🇦kene-template-randomaido2-LFVI-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-73570:10:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240433836Philippe LaferrierePredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-73570:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1134056246363382
error_L20.020543502496268455


No reset possible
240413827Donghoon Leechallenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09853991077945869
survival_time_median1.3000000000000005
deviation-center-line_median0.07278338816431716
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.13545525074005127
agent_compute-ego_mean0.1246676366144208
agent_compute-ego_median0.12817369699478148
agent_compute-ego_min0.10521774456418792
deviation-center-line_max0.11575411683258724
deviation-center-line_mean0.07287303182326406
deviation-center-line_min0.03477991694866784
deviation-heading_max0.9321483401134256
deviation-heading_mean0.6714893475414192
deviation-heading_median0.6793494373621005
deviation-heading_min0.392317376911526
driven_any_max0.21361167422931532
driven_any_mean0.1641776858945669
driven_any_median0.16475358325407058
driven_any_min0.1076250695166834
driven_lanedir_consec_max0.15446570437600782
driven_lanedir_consec_mean0.09964816406830242
driven_lanedir_consec_min0.06646211710974725
driven_lanedir_max0.15446570437600782
driven_lanedir_mean0.09964816406830242
driven_lanedir_median0.09853991077945869
driven_lanedir_min0.06646211710974725
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.10000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21361167422931532, "sim_physics": 0.08272887678707347, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06646211710974725, "sim_render-ego": 0.04861913007848403, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.13545525074005127, "deviation-heading": 0.6752071176558541, "set_robot_commands": 0.07354937581455007, "deviation-center-line": 0.05856314138961787, "driven_lanedir_consec": 0.06646211710974725, "sim_compute_sim_state": 0.029696892289554373, "sim_compute_performance-ego": 0.0501942424213185, "sim_compute_robot_state-ego": 0.050756216049194336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.168720742680579, "sim_physics": 0.0825040170124599, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08211406685946765, "sim_render-ego": 0.04629279885973249, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.12997389691216604, "deviation-heading": 0.6795917279335619, "set_robot_commands": 0.08368198360715594, "deviation-center-line": 0.03477991694866784, "driven_lanedir_consec": 0.08211406685946765, "sim_compute_sim_state": 0.030511345182146345, "sim_compute_performance-ego": 0.05162380422864642, "sim_compute_robot_state-ego": 0.05539630992071969}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13592775682666047, "sim_physics": 0.08166595697402954, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1071275341837774, "sim_render-ego": 0.04345148801803589, "in-drivable-lane": 0, "agent_compute-ego": 0.12817369699478148, "deviation-heading": 0.49705251497530345, "set_robot_commands": 0.07601308822631836, "deviation-center-line": 0.0936563504252406, "driven_lanedir_consec": 0.1071275341837774, "sim_compute_sim_state": 0.027845215797424317, "sim_compute_performance-ego": 0.0474449634552002, "sim_compute_robot_state-ego": 0.04770184755325317}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18584729875645828, "sim_physics": 0.08405514863821176, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0993768499335741, "sim_render-ego": 0.04407639686877911, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12020298150869516, "deviation-heading": 0.8756731253994221, "set_robot_commands": 0.06453315111306998, "deviation-center-line": 0.0655501080445978, "driven_lanedir_consec": 0.0993768499335741, "sim_compute_sim_state": 0.02779349913963905, "sim_compute_performance-ego": 0.050340744165273815, "sim_compute_robot_state-ego": 0.052060301487262435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1953388582881024, "sim_physics": 0.08071158672201223, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11167554690566694, "sim_render-ego": 0.050895320958104624, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.12948978358301624, "deviation-heading": 0.7088073994112413, "set_robot_commands": 0.0754426018945102, "deviation-center-line": 0.05037038883056152, "driven_lanedir_consec": 0.11167554690566694, "sim_compute_sim_state": 0.030752650622663823, "sim_compute_performance-ego": 0.048421333576070855, "sim_compute_robot_state-ego": 0.052400778079855034}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.19133773776132343, "sim_physics": 0.08001810770768386, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09619843846010134, "sim_render-ego": 0.04685034201695369, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12866279712090126, "deviation-heading": 0.9321483401134256, "set_robot_commands": 0.06835561532240647, "deviation-center-line": 0.07580912950287826, "driven_lanedir_consec": 0.09619843846010134, "sim_compute_sim_state": 0.03059562352987436, "sim_compute_performance-ego": 0.05482347194965069, "sim_compute_robot_state-ego": 0.05370264786940355}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19713290317072696, "sim_physics": 0.0791018179484776, "survival_time": 1.4000000000000006, "driven_lanedir": 0.15446570437600782, "sim_render-ego": 0.04446329389299665, "in-drivable-lane": 0, "agent_compute-ego": 0.11633963244301931, "deviation-heading": 0.6742409540091541, "set_robot_commands": 0.0675654411315918, "deviation-center-line": 0.10088184901270492, "driven_lanedir_consec": 0.15446570437600782, "sim_compute_sim_state": 0.026526595864977156, "sim_compute_performance-ego": 0.047887367861611504, "sim_compute_robot_state-ego": 0.04885802098682949}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1076250695166834, "sim_physics": 0.07416939735412598, "survival_time": 0.9500000000000004, "driven_lanedir": 0.07346733252519844, "sim_render-ego": 0.050861747641312446, "in-drivable-lane": 0, "agent_compute-ego": 0.12757224785654167, "deviation-heading": 0.5536005323435644, "set_robot_commands": 0.07286376702158075, "deviation-center-line": 0.08096847263704883, "driven_lanedir_consec": 0.07346733252519844, "sim_compute_sim_state": 0.03057149836891576, "sim_compute_performance-ego": 0.0535248831698769, "sim_compute_robot_state-ego": 0.05379227588051244}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.16475358325407058, "sim_physics": 0.07681849369635949, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10477575797079997, "sim_render-ego": 0.04179925184983473, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12691367589510405, "deviation-heading": 0.6925177095610329, "set_robot_commands": 0.0788108568925124, "deviation-center-line": 0.048603917916147925, "driven_lanedir_consec": 0.10477575797079997, "sim_compute_sim_state": 0.029417734879713792, "sim_compute_performance-ego": 0.046737762597891, "sim_compute_robot_state-ego": 0.04919348313258244}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.11832924911584897, "sim_physics": 0.08576639838840651, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07154564918534634, "sim_render-ego": 0.05020324043605639, "in-drivable-lane": 0, "agent_compute-ego": 0.13354703654413638, "deviation-heading": 0.6793494373621005, "set_robot_commands": 0.07725259532099185, "deviation-center-line": 0.08041326071935247, "driven_lanedir_consec": 0.07154564918534634, "sim_compute_sim_state": 0.03276867451875106, "sim_compute_performance-ego": 0.050776066987410835, "sim_compute_robot_state-ego": 0.05293385878853176}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.14285644881769605, "sim_physics": 0.07725795455600905, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11112680923832108, "sim_render-ego": 0.04266662183015243, "in-drivable-lane": 0, "agent_compute-ego": 0.11548063029413638, "deviation-heading": 0.5048470766573037, "set_robot_commands": 0.06669354438781738, "deviation-center-line": 0.10340747884493988, "driven_lanedir_consec": 0.11112680923832108, "sim_compute_sim_state": 0.02458144270855447, "sim_compute_performance-ego": 0.045714678971663765, "sim_compute_robot_state-ego": 0.04743417449619459}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14104348546622464, "sim_physics": 0.09335608067719832, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09478783032320226, "sim_render-ego": 0.049534331197324005, "in-drivable-lane": 0, "agent_compute-ego": 0.13199357364488684, "deviation-heading": 0.6604787843909117, "set_robot_commands": 0.07430207211038341, "deviation-center-line": 0.07278338816431716, "driven_lanedir_consec": 0.09478783032320226, "sim_compute_sim_state": 0.03067615757817807, "sim_compute_performance-ego": 0.052826394205508026, "sim_compute_robot_state-ego": 0.05613565444946289}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.1905387201139992, "sim_physics": 0.07421320060203815, "survival_time": 1.4500000000000006, "driven_lanedir": 0.09853991077945869, "sim_render-ego": 0.04072509962936927, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.10521774456418792, "deviation-heading": 0.7398436384456799, "set_robot_commands": 0.06369448530262914, "deviation-center-line": 0.056224096421286535, "driven_lanedir_consec": 0.09853991077945869, "sim_compute_sim_state": 0.02532313609945363, "sim_compute_performance-ego": 0.04485001235172666, "sim_compute_robot_state-ego": 0.04689782241295124}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.15087571537709227, "sim_physics": 0.08077092170715332, "survival_time": 1.2500000000000004, "driven_lanedir": 0.0880338508168923, "sim_render-ego": 0.04673678398132324, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1325953197479248, "deviation-heading": 0.8066644779512048, "set_robot_commands": 0.07094217300415039, "deviation-center-line": 0.05532986165901217, "driven_lanedir_consec": 0.0880338508168923, "sim_compute_sim_state": 0.03169510841369629, "sim_compute_performance-ego": 0.04797802925109863, "sim_compute_robot_state-ego": 0.05175393104553223}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.15872604504372284, "sim_physics": 0.07145138408826746, "survival_time": 1.1500000000000004, "driven_lanedir": 0.13502506235697442, "sim_render-ego": 0.04221897539885148, "in-drivable-lane": 0, "agent_compute-ego": 0.10839628136676292, "deviation-heading": 0.392317376911526, "set_robot_commands": 0.060012921043064285, "deviation-center-line": 0.11575411683258724, "driven_lanedir_consec": 0.13502506235697442, "sim_compute_sim_state": 0.024806592775427776, "sim_compute_performance-ego": 0.047549019689145294, "sim_compute_robot_state-ego": 0.049333292505015496}}
set_robot_commands_max0.08368198360715594
set_robot_commands_mean0.07158091147951548
set_robot_commands_median0.07286376702158075
set_robot_commands_min0.060012921043064285
sim_compute_performance-ego_max0.05482347194965069
sim_compute_performance-ego_mean0.049379518325472875
sim_compute_performance-ego_median0.048421333576070855
sim_compute_performance-ego_min0.04485001235172666
sim_compute_robot_state-ego_max0.05613565444946289
sim_compute_robot_state-ego_mean0.05122337431048672
sim_compute_robot_state-ego_median0.05175393104553223
sim_compute_robot_state-ego_min0.04689782241295124
sim_compute_sim_state_max0.03276867451875106
sim_compute_sim_state_mean0.02890414451793135
sim_compute_sim_state_median0.029696892289554373
sim_compute_sim_state_min0.02458144270855447
sim_physics_max0.09335608067719832
sim_physics_mean0.08030595619063377
sim_physics_median0.08071158672201223
sim_physics_min0.07145138408826746
sim_render-ego_max0.050895320958104624
sim_render-ego_mean0.045959654843820696
sim_render-ego_median0.04629279885973249
sim_render-ego_min0.04072509962936927
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.273333333333334
survival_time_min0.9500000000000004
No reset possible
240393833Donghoon Leechallenge-aido_LF-template-pytorchaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:14:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0875803973752296
survival_time_median1.2500000000000004
deviation-center-line_median0.0700468629145065
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.18732131004333497
agent_compute-ego_mean0.15620000858285665
agent_compute-ego_median0.15278907255692917
agent_compute-ego_min0.12169053337790749
deviation-center-line_max0.09508646653274742
deviation-center-line_mean0.06894959871776825
deviation-center-line_min0.039189881310697346
deviation-heading_max0.820892512143236
deviation-heading_mean0.6714219507387233
deviation-heading_median0.6984518885029765
deviation-heading_min0.4866475290309002
driven_any_max0.26828136803138736
driven_any_mean0.16823814545126686
driven_any_median0.15228728099063116
driven_any_min0.1137382727048478
driven_lanedir_consec_max0.12236725100266543
driven_lanedir_consec_mean0.08829116530307837
driven_lanedir_consec_min0.06204846139059139
driven_lanedir_max0.12236725100266543
driven_lanedir_mean0.08829116530307837
driven_lanedir_median0.0875803973752296
driven_lanedir_min0.06204846139059139
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.21333333333333349
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.21964728004749645, "sim_physics": 0.1456470200509736, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07292538366783252, "sim_render-ego": 0.05651362014539314, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.12169053337790749, "deviation-heading": 0.7410483135911415, "set_robot_commands": 0.06602720058325565, "deviation-center-line": 0.0618240182177843, "driven_lanedir_consec": 0.07292538366783252, "sim_compute_sim_state": 0.028396750941421047, "sim_compute_performance-ego": 0.05332561695214474, "sim_compute_robot_state-ego": 0.05436304121306448, "sim_compute_robot_state-npc0": 0.05066625999681877, "sim_compute_robot_state-npc1": 0.048656434723825165, "sim_compute_robot_state-npc2": 0.049198793642448654, "sim_compute_robot_state-npc3": 0.052028742703524505}, "udem1-1-0": {"driven_any": 0.2076793136258609, "sim_physics": 0.1615874543786049, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06204846139059139, "sim_render-ego": 0.04926791042089462, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.135684996843338, "deviation-heading": 0.8023503534686567, "set_robot_commands": 0.09027715772390366, "deviation-center-line": 0.055804997410965826, "driven_lanedir_consec": 0.06204846139059139, "sim_compute_sim_state": 0.029538296163082123, "sim_compute_performance-ego": 0.051372647285461426, "sim_compute_robot_state-ego": 0.0529678538441658, "sim_compute_robot_state-npc0": 0.053115084767341614, "sim_compute_robot_state-npc1": 0.05123989284038544, "sim_compute_robot_state-npc2": 0.05194102227687836, "sim_compute_robot_state-npc3": 0.05168857425451279}, "udem1-2-0": {"driven_any": 0.12714798694228982, "sim_physics": 0.2329187826676802, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09701676997898724, "sim_render-ego": 0.06100183183496648, "in-drivable-lane": 0, "agent_compute-ego": 0.1668626286766746, "deviation-heading": 0.4866475290309002, "set_robot_commands": 0.09903443943370473, "deviation-center-line": 0.09467420699855696, "driven_lanedir_consec": 0.09701676997898724, "sim_compute_sim_state": 0.03814082795923406, "sim_compute_performance-ego": 0.06738100268624046, "sim_compute_robot_state-ego": 0.06784170324152167, "sim_compute_robot_state-npc0": 0.06590196219357577, "sim_compute_robot_state-npc1": 0.06168300455266779, "sim_compute_robot_state-npc2": 0.06296241283416748, "sim_compute_robot_state-npc3": 0.06366568261926825}, "udem1-3-0": {"driven_any": 0.13254063345252473, "sim_physics": 0.19889243789341135, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09377046023372282, "sim_render-ego": 0.061135903648708176, "in-drivable-lane": 0, "agent_compute-ego": 0.1651875350786292, "deviation-heading": 0.5530149740540866, "set_robot_commands": 0.08789715559586235, "deviation-center-line": 0.09383057539989138, "driven_lanedir_consec": 0.09377046023372282, "sim_compute_sim_state": 0.03422159733979598, "sim_compute_performance-ego": 0.06644332927206288, "sim_compute_robot_state-ego": 0.07071801890497623, "sim_compute_robot_state-npc0": 0.0577160586481509, "sim_compute_robot_state-npc1": 0.05770523651786472, "sim_compute_robot_state-npc2": 0.058158833047618035, "sim_compute_robot_state-npc3": 0.0626748333806577}, "udem1-4-0": {"driven_any": 0.14232408895994345, "sim_physics": 0.18279642860094705, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07725314077315204, "sim_render-ego": 0.05389846364657084, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1516252557436625, "deviation-heading": 0.6984518885029765, "set_robot_commands": 0.08974496523539226, "deviation-center-line": 0.043198665313520415, "driven_lanedir_consec": 0.07725314077315204, "sim_compute_sim_state": 0.044597903887430825, "sim_compute_performance-ego": 0.058204869429270424, "sim_compute_robot_state-ego": 0.06511951486269633, "sim_compute_robot_state-npc0": 0.0643464724222819, "sim_compute_robot_state-npc1": 0.06483180324236552, "sim_compute_robot_state-npc2": 0.06584805250167847, "sim_compute_robot_state-npc3": 0.06765297055244446}, "udem1-5-0": {"driven_any": 0.26828136803138736, "sim_physics": 0.1696488857269287, "survival_time": 1.900000000000001, "driven_lanedir": 0.12236725100266543, "sim_render-ego": 0.058410700998808206, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15802847084246183, "deviation-heading": 0.7656040145210071, "set_robot_commands": 0.08777858709034167, "deviation-center-line": 0.0618915661559995, "driven_lanedir_consec": 0.12236725100266543, "sim_compute_sim_state": 0.03586073925620631, "sim_compute_performance-ego": 0.06539743197591681, "sim_compute_robot_state-ego": 0.062855275053727, "sim_compute_robot_state-npc0": 0.06102002294440018, "sim_compute_robot_state-npc1": 0.06452130016527678, "sim_compute_robot_state-npc2": 0.06220970655742444, "sim_compute_robot_state-npc3": 0.06310228297584936}, "udem1-6-0": {"driven_any": 0.12107310443760257, "sim_physics": 0.2010809833353216, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07923656320654837, "sim_render-ego": 0.04924952983856201, "in-drivable-lane": 0, "agent_compute-ego": 0.15046154369007458, "deviation-heading": 0.6256036906134279, "set_robot_commands": 0.101183067668568, "deviation-center-line": 0.08215905224958883, "driven_lanedir_consec": 0.07923656320654837, "sim_compute_sim_state": 0.031745379621332344, "sim_compute_performance-ego": 0.06378112056038597, "sim_compute_robot_state-ego": 0.06399436430497603, "sim_compute_robot_state-npc0": 0.05780153924768621, "sim_compute_robot_state-npc1": 0.06073935465379195, "sim_compute_robot_state-npc2": 0.060646468942815605, "sim_compute_robot_state-npc3": 0.05845153331756592}, "udem1-7-0": {"driven_any": 0.14177101726346522, "sim_physics": 0.1957597827911377, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09802409114952848, "sim_render-ego": 0.05447254180908203, "in-drivable-lane": 0, "agent_compute-ego": 0.15179090499877929, "deviation-heading": 0.6539091444323728, "set_robot_commands": 0.0767740821838379, "deviation-center-line": 0.09508646653274742, "driven_lanedir_consec": 0.09802409114952848, "sim_compute_sim_state": 0.03428807258605957, "sim_compute_performance-ego": 0.06560992240905762, "sim_compute_robot_state-ego": 0.06618973731994629, "sim_compute_robot_state-npc0": 0.06456689834594727, "sim_compute_robot_state-npc1": 0.06326815605163574, "sim_compute_robot_state-npc2": 0.060074567794799805, "sim_compute_robot_state-npc3": 0.06312380790710449}, "udem1-8-0": {"driven_any": 0.17726655883854228, "sim_physics": 0.2159534352166312, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09397084469055894, "sim_render-ego": 0.06370701960154943, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17165340696062362, "deviation-heading": 0.7156416320637832, "set_robot_commands": 0.09805214405059814, "deviation-center-line": 0.043432952085162374, "driven_lanedir_consec": 0.09397084469055894, "sim_compute_sim_state": 0.04001978465488979, "sim_compute_performance-ego": 0.06868041413170951, "sim_compute_robot_state-ego": 0.07522621325084142, "sim_compute_robot_state-npc0": 0.06805912937436785, "sim_compute_robot_state-npc1": 0.06568828650883266, "sim_compute_robot_state-npc2": 0.06505283287593297, "sim_compute_robot_state-npc3": 0.0676182849066598}, "udem1-9-0": {"driven_any": 0.18625075454587595, "sim_physics": 0.20379608677279565, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07941037782272531, "sim_render-ego": 0.06616297075825353, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16511444122560562, "deviation-heading": 0.7432629932199054, "set_robot_commands": 0.09057555660124748, "deviation-center-line": 0.039189881310697346, "driven_lanedir_consec": 0.07941037782272531, "sim_compute_sim_state": 0.03963921916100287, "sim_compute_performance-ego": 0.06713443417702952, "sim_compute_robot_state-ego": 0.07328319549560547, "sim_compute_robot_state-npc0": 0.06648247472701534, "sim_compute_robot_state-npc1": 0.06921885090489541, "sim_compute_robot_state-npc2": 0.06948541056725287, "sim_compute_robot_state-npc3": 0.06753320078695974}, "udem1-10-0": {"driven_any": 0.15228728099063116, "sim_physics": 0.2053448486328125, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07199054957869522, "sim_render-ego": 0.06352425575256347, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.18732131004333497, "deviation-heading": 0.820892512143236, "set_robot_commands": 0.09475714683532716, "deviation-center-line": 0.04363819196188982, "driven_lanedir_consec": 0.07199054957869522, "sim_compute_sim_state": 0.03637958526611328, "sim_compute_performance-ego": 0.06818182945251465, "sim_compute_robot_state-ego": 0.07114643096923828, "sim_compute_robot_state-npc0": 0.06919716835021973, "sim_compute_robot_state-npc1": 0.06429437637329101, "sim_compute_robot_state-npc2": 0.060930910110473635, "sim_compute_robot_state-npc3": 0.0658583927154541}, "udem1-11-0": {"driven_any": 0.11818738675429058, "sim_physics": 0.18143458366394044, "survival_time": 1.0000000000000002, "driven_lanedir": 0.0875803973752296, "sim_render-ego": 0.06034750938415527, "in-drivable-lane": 0, "agent_compute-ego": 0.14915773868560792, "deviation-heading": 0.501607121056961, "set_robot_commands": 0.08621410131454468, "deviation-center-line": 0.08760017941622678, "driven_lanedir_consec": 0.0875803973752296, "sim_compute_sim_state": 0.049074649810791016, "sim_compute_performance-ego": 0.058039617538452146, "sim_compute_robot_state-ego": 0.06144459247589111, "sim_compute_robot_state-npc0": 0.06478822231292725, "sim_compute_robot_state-npc1": 0.06416499614715576, "sim_compute_robot_state-npc2": 0.06150155067443848, "sim_compute_robot_state-npc3": 0.05852639675140381}, "udem1-12-0": {"driven_any": 0.2551390754805052, "sim_physics": 0.1872230554238344, "survival_time": 1.950000000000001, "driven_lanedir": 0.11422975411350644, "sim_render-ego": 0.05890489847232134, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.15213899734692696, "deviation-heading": 0.6336228034581314, "set_robot_commands": 0.0857234184558575, "deviation-center-line": 0.0700468629145065, "driven_lanedir_consec": 0.11422975411350644, "sim_compute_sim_state": 0.034622284082266, "sim_compute_performance-ego": 0.06533550604795799, "sim_compute_robot_state-ego": 0.0659014628483699, "sim_compute_robot_state-npc0": 0.06601332395504682, "sim_compute_robot_state-npc1": 0.06119062961676182, "sim_compute_robot_state-npc2": 0.06208405127892128, "sim_compute_robot_state-npc3": 0.06059981003785745}, "udem1-13-0": {"driven_any": 0.1137382727048478, "sim_physics": 0.18840281529860065, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07295281791175068, "sim_render-ego": 0.05758299610831521, "in-drivable-lane": 0, "agent_compute-ego": 0.15278907255692917, "deviation-heading": 0.6268488568642862, "set_robot_commands": 0.09064511819319292, "deviation-center-line": 0.08787713103108766, "driven_lanedir_consec": 0.07295281791175068, "sim_compute_sim_state": 0.03610382296822288, "sim_compute_performance-ego": 0.06289913437583229, "sim_compute_robot_state-ego": 0.06486945802515204, "sim_compute_robot_state-npc0": 0.06250698999925093, "sim_compute_robot_state-npc1": 0.06442808021198619, "sim_compute_robot_state-npc2": 0.06497889215295966, "sim_compute_robot_state-npc3": 0.06519170240922408}, "udem1-14-0": {"driven_any": 0.16023805969373994, "sim_physics": 0.18541241543633596, "survival_time": 1.4000000000000006, "driven_lanedir": 0.10159061665068105, "sim_render-ego": 0.059354339327131, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16349329267229354, "deviation-heading": 0.7028234340599764, "set_robot_commands": 0.08147980485643659, "deviation-center-line": 0.07398923376789888, "driven_lanedir_consec": 0.10159061665068105, "sim_compute_sim_state": 0.03539666959217617, "sim_compute_performance-ego": 0.062476822308131626, "sim_compute_robot_state-ego": 0.06418132781982422, "sim_compute_robot_state-npc0": 0.059438935347965786, "sim_compute_robot_state-npc1": 0.0625983646937779, "sim_compute_robot_state-npc2": 0.060919804232461114, "sim_compute_robot_state-npc3": 0.06104418209620884}}
set_robot_commands_max0.101183067668568
set_robot_commands_mean0.0884109297214714
set_robot_commands_median0.08974496523539226
set_robot_commands_min0.06602720058325565
sim_compute_performance-ego_max0.06868041413170951
sim_compute_performance-ego_mean0.06295091324014454
sim_compute_performance-ego_median0.06533550604795799
sim_compute_performance-ego_min0.051372647285461426
sim_compute_robot_state-ego_max0.07522621325084142
sim_compute_robot_state-ego_mean0.06534014597533308
sim_compute_robot_state-ego_median0.06511951486269633
sim_compute_robot_state-ego_min0.0529678538441658
sim_compute_robot_state-npc0_max0.06919716835021973
sim_compute_robot_state-npc0_mean0.06210803617553308
sim_compute_robot_state-npc0_median0.0643464724222819
sim_compute_robot_state-npc0_min0.05066625999681877
sim_compute_robot_state-npc1_max0.06921885090489541
sim_compute_robot_state-npc1_mean0.061615251146967594
sim_compute_robot_state-npc1_median0.06326815605163574
sim_compute_robot_state-npc1_min0.048656434723825165
sim_compute_robot_state-npc2_max0.06948541056725287
sim_compute_robot_state-npc2_mean0.06106622063268473
sim_compute_robot_state-npc2_median0.06150155067443848
sim_compute_robot_state-npc2_min0.049198793642448654
sim_compute_robot_state-npc3_max0.06765297055244446
sim_compute_robot_state-npc3_mean0.06191735982764635
sim_compute_robot_state-npc3_median0.06310228297584936
sim_compute_robot_state-npc3_min0.05168857425451279
sim_compute_sim_state_max0.049074649810791016
sim_compute_sim_state_mean0.03653503888600162
sim_compute_sim_state_median0.03586073925620631
sim_compute_sim_state_min0.028396750941421047
sim_physics_max0.2329187826676802
sim_physics_mean0.19039326772599707
sim_physics_median0.18840281529860065
sim_physics_min0.1456470200509736
sim_render-ego_max0.06616297075825353
sim_render-ego_mean0.05823563278315165
sim_render-ego_median0.05890489847232134
sim_render-ego_min0.04924952983856201
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.3733333333333342
survival_time_min1.0000000000000002
No reset possible
240363828Donghoon Leechallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08515586115450846
survival_time_median1.6500000000000008
deviation-center-line_median0.051175840509904834
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.1615884644644601
agent_compute-ego_mean0.15082187565890226
agent_compute-ego_median0.1534788247310754
agent_compute-ego_min0.13137833731515067
deviation-center-line_max0.0976586320939753
deviation-center-line_mean0.06095924754271091
deviation-center-line_min0.04308959071166261
deviation-heading_max0.8521299867591798
deviation-heading_mean0.7150531872317982
deviation-heading_median0.7183542298843986
deviation-heading_min0.6060281802559326
driven_any_max0.22131609545252057
driven_any_mean0.18801667374753145
driven_any_median0.20571004262912596
driven_any_min0.1165218747396892
driven_lanedir_consec_max0.10444782094824756
driven_lanedir_consec_mean0.08980237265683211
driven_lanedir_consec_min0.0771454998296095
driven_lanedir_max0.10444782094824756
driven_lanedir_mean0.08980237265683211
driven_lanedir_median0.08515586115450846
driven_lanedir_min0.0771454998296095
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.3300000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22131609545252057, "sim_physics": 0.0871865885598319, "survival_time": 1.7500000000000009, "driven_lanedir": 0.08515586115450846, "sim_render-ego": 0.047872373035975864, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.13137833731515067, "deviation-heading": 0.7183542298843986, "set_robot_commands": 0.0764068399156843, "deviation-center-line": 0.06391221603719843, "driven_lanedir_consec": 0.08515586115450846, "sim_compute_sim_state": 0.03191408429827009, "sim_compute_performance-ego": 0.06311344419206892, "sim_compute_robot_state-ego": 0.05610061373029437}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17642557570413123, "sim_physics": 0.1006557856287275, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0990252488306268, "sim_render-ego": 0.0610115613256182, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1615884644644601, "deviation-heading": 0.7573748235883266, "set_robot_commands": 0.09388384648731776, "deviation-center-line": 0.048959958360813405, "driven_lanedir_consec": 0.0990252488306268, "sim_compute_sim_state": 0.03874353000095913, "sim_compute_performance-ego": 0.06822669506072998, "sim_compute_robot_state-ego": 0.07111593655177526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1165218747396892, "sim_physics": 0.1138369810013544, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08323743252116822, "sim_render-ego": 0.05746760822477795, "in-drivable-lane": 0, "agent_compute-ego": 0.15090776625133695, "deviation-heading": 0.6060281802559326, "set_robot_commands": 0.08897729147048224, "deviation-center-line": 0.0976586320939753, "driven_lanedir_consec": 0.08323743252116822, "sim_compute_sim_state": 0.03712907291594006, "sim_compute_performance-ego": 0.06295450528462727, "sim_compute_robot_state-ego": 0.06614392144339425}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20571004262912596, "sim_physics": 0.10576826153379498, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0771454998296095, "sim_render-ego": 0.058250600641424, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1534788247310754, "deviation-heading": 0.8521299867591798, "set_robot_commands": 0.08496941219676625, "deviation-center-line": 0.051175840509904834, "driven_lanedir_consec": 0.0771454998296095, "sim_compute_sim_state": 0.03348750779123017, "sim_compute_performance-ego": 0.06173102060953776, "sim_compute_robot_state-ego": 0.06683459426417496}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22010978021219008, "sim_physics": 0.11613928249904087, "survival_time": 1.7500000000000009, "driven_lanedir": 0.10444782094824756, "sim_render-ego": 0.05866314343043736, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15675598553248815, "deviation-heading": 0.6413787156711532, "set_robot_commands": 0.09011868749346053, "deviation-center-line": 0.04308959071166261, "driven_lanedir_consec": 0.10444782094824756, "sim_compute_sim_state": 0.03629251888820103, "sim_compute_performance-ego": 0.06420403889247349, "sim_compute_robot_state-ego": 0.06816906929016113}}
set_robot_commands_max0.09388384648731776
set_robot_commands_mean0.08687121551274221
set_robot_commands_median0.08897729147048224
set_robot_commands_min0.0764068399156843
sim_compute_performance-ego_max0.06822669506072998
sim_compute_performance-ego_mean0.06404594080788749
sim_compute_performance-ego_median0.06311344419206892
sim_compute_performance-ego_min0.06173102060953776
sim_compute_robot_state-ego_max0.07111593655177526
sim_compute_robot_state-ego_mean0.06567282705595999
sim_compute_robot_state-ego_median0.06683459426417496
sim_compute_robot_state-ego_min0.05610061373029437
sim_compute_sim_state_max0.03874353000095913
sim_compute_sim_state_mean0.0355133427789201
sim_compute_sim_state_median0.03629251888820103
sim_compute_sim_state_min0.03191408429827009
sim_physics_max0.11613928249904087
sim_physics_mean0.10471737984454994
sim_physics_median0.10576826153379498
sim_physics_min0.0871865885598319
sim_render-ego_max0.0610115613256182
sim_render-ego_mean0.05665305733164668
sim_render-ego_median0.058250600641424
sim_render-ego_min0.047872373035975864
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.5200000000000005
survival_time_min1.0500000000000005
No reset possible
240293823Eric LuStudent A043022aido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:12:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.7842447419938745
survival_time_median14.950000000000076
deviation-center-line_median0.7593448748215907
in-drivable-lane_median5.500000000000045


other stats
agent_compute-ego_max0.09677886247634888
agent_compute-ego_mean0.09544791491826374
agent_compute-ego_median0.0953039026260376
agent_compute-ego_min0.09455347696940104
deviation-center-line_max1.3912766006209938
deviation-center-line_mean0.8616512040234087
deviation-center-line_min0.26673270483572
deviation-heading_max8.114760811115872
deviation-heading_mean6.873101715551771
deviation-heading_median6.776226158971605
deviation-heading_min5.560369873334478
driven_any_max4.363759853514355
driven_any_mean4.2574798572627675
driven_any_median4.27452094923519
driven_any_min4.034987875731287
driven_lanedir_consec_max-0.4196664417961835
driven_lanedir_consec_mean-0.8736370279897091
driven_lanedir_consec_min-1.374969994699355
driven_lanedir_max-1.3162778246721856
driven_lanedir_mean-1.8953012556002768
driven_lanedir_median-1.7938652535876516
driven_lanedir_min-2.571057763916258
in-drivable-lane_max7.650000000000041
in-drivable-lane_mean5.090000000000034
in-drivable-lane_min2.5500000000000136
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.2638629791922575, "sim_physics": 0.05347385803858439, "survival_time": 14.950000000000076, "driven_lanedir": -1.771562388157243, "sim_render-ego": 0.035513214270273846, "in-drivable-lane": 5.550000000000043, "agent_compute-ego": 0.0952502417564392, "deviation-heading": 6.70577311747521, "set_robot_commands": 0.0546810245513916, "deviation-center-line": 0.702198093390439, "driven_lanedir_consec": -0.4196664417961835, "sim_compute_sim_state": 0.022544771830240885, "sim_compute_performance-ego": 0.03864837328592936, "sim_compute_robot_state-ego": 0.04001734733581543}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.350267628640751, "sim_physics": 0.05561238447825114, "survival_time": 14.950000000000076, "driven_lanedir": -2.571057763916258, "sim_render-ego": 0.035167405605316164, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.09677886247634888, "deviation-heading": 8.114760811115872, "set_robot_commands": 0.05991046667098999, "deviation-center-line": 1.3912766006209938, "driven_lanedir_consec": -1.374969994699355, "sim_compute_sim_state": 0.022669231096903483, "sim_compute_performance-ego": 0.03878042538960775, "sim_compute_robot_state-ego": 0.04006999095280965}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.363759853514355, "sim_physics": 0.053241286277771, "survival_time": 14.950000000000076, "driven_lanedir": -1.3162778246721856, "sim_render-ego": 0.03493795315424601, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.09455347696940104, "deviation-heading": 5.560369873334478, "set_robot_commands": 0.05464803775151571, "deviation-center-line": 0.26673270483572, "driven_lanedir_consec": -1.3162778246721856, "sim_compute_sim_state": 0.022540887196858723, "sim_compute_performance-ego": 0.03840334256490072, "sim_compute_robot_state-ego": 0.03960770050684611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.27452094923519, "sim_physics": 0.0550038997332255, "survival_time": 14.950000000000076, "driven_lanedir": -1.7938652535876516, "sim_render-ego": 0.03512762149175008, "in-drivable-lane": 5.500000000000045, "agent_compute-ego": 0.0953039026260376, "deviation-heading": 6.776226158971605, "set_robot_commands": 0.05604676723480224, "deviation-center-line": 0.7593448748215907, "driven_lanedir_consec": -0.4730261367869466, "sim_compute_sim_state": 0.022504760424296066, "sim_compute_performance-ego": 0.03803289572397868, "sim_compute_robot_state-ego": 0.04107101519902547}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.034987875731287, "sim_physics": 0.053964194456736246, "survival_time": 14.950000000000076, "driven_lanedir": -2.0237430476680456, "sim_render-ego": 0.03513992468516032, "in-drivable-lane": 4.200000000000029, "agent_compute-ego": 0.09535309076309204, "deviation-heading": 7.208378616861684, "set_robot_commands": 0.05523855845133464, "deviation-center-line": 1.1887037464483, "driven_lanedir_consec": -0.7842447419938745, "sim_compute_sim_state": 0.02243898868560791, "sim_compute_performance-ego": 0.03828523000081381, "sim_compute_robot_state-ego": 0.03980517307917277}}
set_robot_commands_max0.05991046667098999
set_robot_commands_mean0.05610497093200684
set_robot_commands_median0.05523855845133464
set_robot_commands_min0.05464803775151571
sim_compute_performance-ego_max0.03878042538960775
sim_compute_performance-ego_mean0.03843005339304606
sim_compute_performance-ego_median0.03840334256490072
sim_compute_performance-ego_min0.03803289572397868
sim_compute_robot_state-ego_max0.04107101519902547
sim_compute_robot_state-ego_mean0.04011424541473389
sim_compute_robot_state-ego_median0.04001734733581543
sim_compute_robot_state-ego_min0.03960770050684611
sim_compute_sim_state_max0.022669231096903483
sim_compute_sim_state_mean0.02253972784678141
sim_compute_sim_state_median0.022540887196858723
sim_compute_sim_state_min0.02243898868560791
sim_physics_max0.05561238447825114
sim_physics_mean0.054259124596913656
sim_physics_median0.053964194456736246
sim_physics_min0.053241286277771
sim_render-ego_max0.035513214270273846
sim_render-ego_mean0.03517722384134928
sim_render-ego_median0.03513992468516032
sim_render-ego_min0.03493795315424601
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
240283822Eric LuStudent 0756813aido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:14:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.339366254383536
survival_time_median14.950000000000076
deviation-center-line_median1.4012763877174277
in-drivable-lane_median2.500000000000013


other stats
agent_compute-ego_max0.09503714323043824
agent_compute-ego_mean0.0946847817103068
agent_compute-ego_median0.09491835673650106
agent_compute-ego_min0.09387556473414103
deviation-center-line_max1.5195321274571807
deviation-center-line_mean1.1744866247661871
deviation-center-line_min0.26894128230124625
deviation-heading_max8.502617994731205
deviation-heading_mean7.586929268377434
deviation-heading_median8.166880118443581
deviation-heading_min5.592005976497815
driven_any_max4.378506444052817
driven_any_mean4.378506444052766
driven_any_median4.378506444052808
driven_any_min4.378506444052668
driven_lanedir_consec_max-1.3108775667758272
driven_lanedir_consec_mean-1.343008792507249
driven_lanedir_consec_min-1.375791811242245
driven_lanedir_max-1.339366254383536
driven_lanedir_mean-2.354333468541115
driven_lanedir_median-2.597399307713328
driven_lanedir_min-2.7107548643591612
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.5700000000000194
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052729, "sim_physics": 0.056204049587249755, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643591612, "sim_render-ego": 0.034827849864959716, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.09503714323043824, "deviation-heading": 8.372894374860556, "set_robot_commands": 0.053768206437428794, "deviation-center-line": 1.5195321274571807, "driven_lanedir_consec": -1.3108775667758272, "sim_compute_sim_state": 0.022248427867889404, "sim_compute_performance-ego": 0.03763689041137695, "sim_compute_robot_state-ego": 0.03929269631703695}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052808, "sim_physics": 0.05273879130681356, "survival_time": 14.950000000000076, "driven_lanedir": -2.4475297684769592, "sim_render-ego": 0.03485749880472819, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.09491835673650106, "deviation-heading": 7.300247877354014, "set_robot_commands": 0.05284985303878784, "deviation-center-line": 1.1660826179431376, "driven_lanedir_consec": -1.375791811242245, "sim_compute_sim_state": 0.02264345089594523, "sim_compute_performance-ego": 0.0378560733795166, "sim_compute_robot_state-ego": 0.039517374833424886}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.05077322244644165, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.034558211962382, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.09456005334854126, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.053880064487457274, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.022239251136779783, "sim_compute_performance-ego": 0.03765857458114624, "sim_compute_robot_state-ego": 0.039268980820973715}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052817, "sim_physics": 0.05390488227208456, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725886, "sim_render-ego": 0.03488411029179891, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.09503279050191243, "deviation-heading": 8.502617994731205, "set_robot_commands": 0.05348504066467285, "deviation-center-line": 1.516600708411944, "driven_lanedir_consec": -1.3215500552073598, "sim_compute_sim_state": 0.02224846124649048, "sim_compute_performance-ego": 0.03753826856613159, "sim_compute_robot_state-ego": 0.03930157899856567}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052668, "sim_physics": 0.05428494691848755, "survival_time": 14.950000000000076, "driven_lanedir": -2.597399307713328, "sim_render-ego": 0.03485797961552938, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.09387556473414103, "deviation-heading": 8.166880118443581, "set_robot_commands": 0.05307129224141439, "deviation-center-line": 1.4012763877174277, "driven_lanedir_consec": -1.3674582749272766, "sim_compute_sim_state": 0.02230023701985677, "sim_compute_performance-ego": 0.037710952758789065, "sim_compute_robot_state-ego": 0.03905942042668661}}
set_robot_commands_max0.053880064487457274
set_robot_commands_mean0.05341089137395223
set_robot_commands_median0.05348504066467285
set_robot_commands_min0.05284985303878784
sim_compute_performance-ego_max0.0378560733795166
sim_compute_performance-ego_mean0.037680151939392094
sim_compute_performance-ego_median0.03765857458114624
sim_compute_performance-ego_min0.03753826856613159
sim_compute_robot_state-ego_max0.039517374833424886
sim_compute_robot_state-ego_mean0.039288010279337565
sim_compute_robot_state-ego_median0.03929269631703695
sim_compute_robot_state-ego_min0.03905942042668661
sim_compute_sim_state_max0.02264345089594523
sim_compute_sim_state_mean0.02233596563339233
sim_compute_sim_state_median0.02224846124649048
sim_compute_sim_state_min0.022239251136779783
sim_physics_max0.056204049587249755
sim_physics_mean0.05358117850621541
sim_physics_median0.05390488227208456
sim_physics_min0.05077322244644165
sim_render-ego_max0.03488411029179891
sim_render-ego_mean0.03479713010787964
sim_render-ego_median0.03485749880472819
sim_render-ego_min0.034558211962382
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
240233809Amaury Camus 🇨🇭Let's do this one todayaido2-LF-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:14:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.15973213139702291
agent_compute-ego_mean0.14256934625898127
agent_compute-ego_median0.14659096049023912
agent_compute-ego_min0.11010756913353414
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10893855271516024, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06137797567579481, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15177612834506565, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09485457561634204, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03729135901839645, "sim_compute_performance-ego": 0.07146651215023464, "sim_compute_robot_state-ego": 0.07694454546327945}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10506008653079764, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05545682065627154, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14757839838663736, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08927110597199085, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03574997303532619, "sim_compute_performance-ego": 0.06288462526658002, "sim_compute_robot_state-ego": 0.07639691876430138}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11035463389228373, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05436907095067641, "in-drivable-lane": 0, "agent_compute-ego": 0.12534006904153264, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08706801077898811, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03861696579877068, "sim_compute_performance-ego": 0.06096469654756434, "sim_compute_robot_state-ego": 0.06949556575101964}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1242861557006836, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.057070980072021486, "in-drivable-lane": 0, "agent_compute-ego": 0.1547385597229004, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09685988426208496, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03717270851135254, "sim_compute_performance-ego": 0.0644914150238037, "sim_compute_robot_state-ego": 0.07243706703186036}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10729149323475512, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06036240541482273, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14088605627228942, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08902493307862101, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.037447096426275715, "sim_compute_performance-ego": 0.0661162032356745, "sim_compute_robot_state-ego": 0.07223468490793736}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1029530836611378, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.057390358983253946, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1494741829074159, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08961862447310467, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03818649175215741, "sim_compute_performance-ego": 0.06230932839062749, "sim_compute_robot_state-ego": 0.06906392622967156}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.09439063497952052, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.0550321170261928, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1406604221888951, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08586227893829346, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.037163998399462016, "sim_compute_performance-ego": 0.059965589216777256, "sim_compute_robot_state-ego": 0.06679316929408483}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.12735958326430546, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06079920132954915, "in-drivable-lane": 0, "agent_compute-ego": 0.15595132963997976, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.0925369489760626, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.03871964272998628, "sim_compute_performance-ego": 0.06798436528160459, "sim_compute_robot_state-ego": 0.07665900957016718}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11566585201328083, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06178766185954466, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15372520786220745, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09942880323377706, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04237668797121209, "sim_compute_performance-ego": 0.06640203928543349, "sim_compute_robot_state-ego": 0.07376243300357108}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.09775055105035955, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.05573388446461071, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1344092152335427, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.08658397414467552, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03591122193769975, "sim_compute_performance-ego": 0.05993060198697177, "sim_compute_robot_state-ego": 0.06289222023703835}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.10811615299868892, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05709393922384683, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14659096049023912, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.0926281229242102, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03617402175804237, "sim_compute_performance-ego": 0.06156461579459054, "sim_compute_robot_state-ego": 0.06666508587923917}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.1012524025780814, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.056510397366115024, "in-drivable-lane": 0, "agent_compute-ego": 0.14046270506722586, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.08964816161564418, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.034647626536233087, "sim_compute_performance-ego": 0.06202949796404157, "sim_compute_robot_state-ego": 0.0661494391305106}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.12207667967852424, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.0644844466564702, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15973213139702291, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.106111302095301, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03919189116534065, "sim_compute_performance-ego": 0.07157088261024624, "sim_compute_robot_state-ego": 0.08035442408393412}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.0947235072100604, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05293624489395707, "in-drivable-lane": 0, "agent_compute-ego": 0.12710725819623028, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.0789666529054995, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03218934271070692, "sim_compute_performance-ego": 0.05675713221232096, "sim_compute_robot_state-ego": 0.06447430010195132}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.07137076761208329, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.04204324881235758, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.11010756913353414, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.06927337599735633, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.02842235798929252, "sim_compute_performance-ego": 0.04556251273435705, "sim_compute_robot_state-ego": 0.05009611447652181}}
set_robot_commands_max0.106111302095301
set_robot_commands_mean0.08984911700079676
set_robot_commands_median0.08961862447310467
set_robot_commands_min0.06927337599735633
sim_compute_performance-ego_max0.07157088261024624
sim_compute_performance-ego_mean0.06266666784672187
sim_compute_performance-ego_median0.06230932839062749
sim_compute_performance-ego_min0.04556251273435705
sim_compute_robot_state-ego_max0.08035442408393412
sim_compute_robot_state-ego_mean0.06962792692833922
sim_compute_robot_state-ego_median0.06949556575101964
sim_compute_robot_state-ego_min0.05009611447652181
sim_compute_sim_state_max0.04237668797121209
sim_compute_sim_state_mean0.03661742571601698
sim_compute_sim_state_median0.03717270851135254
sim_compute_sim_state_min0.02842235798929252
sim_physics_max0.12735958326430546
sim_physics_mean0.10610600914131486
sim_physics_median0.10729149323475512
sim_physics_min0.07137076761208329
sim_render-ego_max0.0644844466564702
sim_render-ego_mean0.05682991689236568
sim_render-ego_median0.057070980072021486
sim_render-ego_min0.04204324881235758
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
240223810Amaury Camus 🇨🇭Let's do this one todayaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:05:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17656994819641114
agent_compute-ego_mean0.14602085561384906
agent_compute-ego_median0.1386466247064096
agent_compute-ego_min0.1348127617555506
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0967915764561406, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.055392715666029185, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1386466247064096, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08981648197880497, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03628019050315574, "sim_compute_performance-ego": 0.05971178743574354, "sim_compute_robot_state-ego": 0.0641973062797829}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10455957113527783, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05944370755962297, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1425000172035367, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08898366666307636, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03941873943104463, "sim_compute_performance-ego": 0.06802739349066042, "sim_compute_robot_state-ego": 0.06849181885812797}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11252929182613595, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05378038742963005, "in-drivable-lane": 0, "agent_compute-ego": 0.1348127617555506, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08620201840120204, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.037408127504236555, "sim_compute_performance-ego": 0.06086394366096048, "sim_compute_robot_state-ego": 0.07464780527002671}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13993474960327149, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06347359657287598, "in-drivable-lane": 0, "agent_compute-ego": 0.17656994819641114, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09627043724060058, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04014341354370117, "sim_compute_performance-ego": 0.07151741981506347, "sim_compute_robot_state-ego": 0.08114251136779785}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1061452823349192, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05846556530723089, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1375749262073372, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0847887691063217, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.036324549324904816, "sim_compute_performance-ego": 0.0607283024848262, "sim_compute_robot_state-ego": 0.06613983081865914}}
set_robot_commands_max0.09627043724060058
set_robot_commands_mean0.08921227467800112
set_robot_commands_median0.08898366666307636
set_robot_commands_min0.0847887691063217
sim_compute_performance-ego_max0.07151741981506347
sim_compute_performance-ego_mean0.06416976937745082
sim_compute_performance-ego_median0.06086394366096048
sim_compute_performance-ego_min0.05971178743574354
sim_compute_robot_state-ego_max0.08114251136779785
sim_compute_robot_state-ego_mean0.07092385451887892
sim_compute_robot_state-ego_median0.06849181885812797
sim_compute_robot_state-ego_min0.0641973062797829
sim_compute_sim_state_max0.04014341354370117
sim_compute_sim_state_mean0.03791500406140859
sim_compute_sim_state_median0.037408127504236555
sim_compute_sim_state_min0.03628019050315574
sim_physics_max0.13993474960327149
sim_physics_mean0.11199209427114902
sim_physics_median0.1061452823349192
sim_physics_min0.0967915764561406
sim_render-ego_max0.06347359657287598
sim_render-ego_mean0.05811119450707782
sim_render-ego_median0.05846556530723089
sim_render-ego_min0.05378038742963005
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
240193814Amaury Camus 🇨🇭Let's do this one todayaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:08:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15508319437503815
agent_compute-ego_mean0.14503994207004656
agent_compute-ego_median0.14705229710929002
agent_compute-ego_min0.1276782126653762
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1946193598493745, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05695091621785224, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14705229710929002, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09414172172546388, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03580845458598077, "sim_compute_performance-ego": 0.06354237206374543, "sim_compute_robot_state-ego": 0.06887081001378313, "sim_compute_robot_state-npc0": 0.06678372696985173, "sim_compute_robot_state-npc1": 0.06470878818367101, "sim_compute_robot_state-npc2": 0.06248279764682432, "sim_compute_robot_state-npc3": 0.060416450983361354}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2263670819146293, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06203487941196987, "in-drivable-lane": 0, "agent_compute-ego": 0.15401949201311385, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09765346561159406, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.034285153661455424, "sim_compute_performance-ego": 0.07362098353249687, "sim_compute_robot_state-ego": 0.07844580071313041, "sim_compute_robot_state-npc0": 0.07180358682359968, "sim_compute_robot_state-npc1": 0.06955058234078544, "sim_compute_robot_state-npc2": 0.06457031624657768, "sim_compute_robot_state-npc3": 0.06466995818274361}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18755376917644612, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05932720425059494, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1413665141874147, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0906167840494693, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.036485030813124576, "sim_compute_performance-ego": 0.06573676368565236, "sim_compute_robot_state-ego": 0.07048427479938396, "sim_compute_robot_state-npc0": 0.06744032693140715, "sim_compute_robot_state-npc1": 0.06362626159075395, "sim_compute_robot_state-npc2": 0.06319258513959866, "sim_compute_robot_state-npc3": 0.06347140756625573}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.23180940250555673, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06403110921382904, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15508319437503815, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.096975843111674, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03903831044832865, "sim_compute_performance-ego": 0.07578137516975403, "sim_compute_robot_state-ego": 0.07538750767707825, "sim_compute_robot_state-npc0": 0.07121410965919495, "sim_compute_robot_state-npc1": 0.07176051537195842, "sim_compute_robot_state-npc2": 0.07248426973819733, "sim_compute_robot_state-npc3": 0.07026684284210205}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1474514575231643, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04706534885224842, "in-drivable-lane": 0, "agent_compute-ego": 0.1276782126653762, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.0805580388932001, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.030593588238670713, "sim_compute_performance-ego": 0.05318304470607212, "sim_compute_robot_state-ego": 0.05449926285516648, "sim_compute_robot_state-npc0": 0.054117043813069664, "sim_compute_robot_state-npc1": 0.05551460811070034, "sim_compute_robot_state-npc2": 0.05257361275809152, "sim_compute_robot_state-npc3": 0.05339443115960984}}
set_robot_commands_max0.09765346561159406
set_robot_commands_mean0.09198917067828025
set_robot_commands_median0.09414172172546388
set_robot_commands_min0.0805580388932001
sim_compute_performance-ego_max0.07578137516975403
sim_compute_performance-ego_mean0.06637290783154416
sim_compute_performance-ego_median0.06573676368565236
sim_compute_performance-ego_min0.05318304470607212
sim_compute_robot_state-ego_max0.07844580071313041
sim_compute_robot_state-ego_mean0.06953753121170844
sim_compute_robot_state-ego_median0.07048427479938396
sim_compute_robot_state-ego_min0.05449926285516648
sim_compute_robot_state-npc0_max0.07180358682359968
sim_compute_robot_state-npc0_mean0.06627175883942463
sim_compute_robot_state-npc0_median0.06744032693140715
sim_compute_robot_state-npc0_min0.054117043813069664
sim_compute_robot_state-npc1_max0.07176051537195842
sim_compute_robot_state-npc1_mean0.06503215111957385
sim_compute_robot_state-npc1_median0.06470878818367101
sim_compute_robot_state-npc1_min0.05551460811070034
sim_compute_robot_state-npc2_max0.07248426973819733
sim_compute_robot_state-npc2_mean0.0630607163058579
sim_compute_robot_state-npc2_median0.06319258513959866
sim_compute_robot_state-npc2_min0.05257361275809152
sim_compute_robot_state-npc3_max0.07026684284210205
sim_compute_robot_state-npc3_mean0.06244381814681453
sim_compute_robot_state-npc3_median0.06347140756625573
sim_compute_robot_state-npc3_min0.05339443115960984
sim_compute_sim_state_max0.03903831044832865
sim_compute_sim_state_mean0.03524210754951203
sim_compute_sim_state_median0.03580845458598077
sim_compute_sim_state_min0.030593588238670713
sim_physics_max0.23180940250555673
sim_physics_mean0.19756021419383415
sim_physics_median0.1946193598493745
sim_physics_min0.1474514575231643
sim_render-ego_max0.06403110921382904
sim_render-ego_mean0.057881891589298906
sim_render-ego_median0.05932720425059494
sim_render-ego_min0.04706534885224842
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
240143805Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1588863253105712
survival_time_median3.349999999999996
deviation-center-line_median0.23152540164094593
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.10013601673183156
agent_compute-ego_mean0.0983446488262993
agent_compute-ego_median0.09814946009562564
agent_compute-ego_min0.09710530704922146
deviation-center-line_max0.45726768098468296
deviation-center-line_mean0.25858627282798385
deviation-center-line_min0.1324028904613364
deviation-heading_max1.3097523026601403
deviation-heading_mean0.5699572942154596
deviation-heading_median0.5573952301476408
deviation-heading_min0.18048456555704137
driven_any_max3.3158982023624892
driven_any_mean1.7515242569446083
driven_any_median1.6055151883308336
driven_any_min1.0711135302286476
driven_lanedir_consec_max2.430472078042259
driven_lanedir_consec_mean1.2916303467209322
driven_lanedir_consec_min0.5411619350867007
driven_lanedir_max2.430472078042259
driven_lanedir_mean1.2916303467209322
driven_lanedir_median1.1588863253105712
driven_lanedir_min0.5411619350867007
in-drivable-lane_max2.749999999999994
in-drivable-lane_mean1.0599999999999974
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0817794093679205, "sim_physics": 0.06356657009858352, "survival_time": 2.5999999999999988, "driven_lanedir": 0.5411619350867007, "sim_render-ego": 0.03652138434923612, "in-drivable-lane": 1.149999999999998, "agent_compute-ego": 0.09814946009562564, "deviation-heading": 0.18048456555704137, "set_robot_commands": 0.056084197301131025, "deviation-center-line": 0.1324028904613364, "driven_lanedir_consec": 0.5411619350867007, "sim_compute_sim_state": 0.023369569044846755, "sim_compute_performance-ego": 0.039545233433063216, "sim_compute_robot_state-ego": 0.04112910765867967}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0711135302286476, "sim_physics": 0.05577190187242296, "survival_time": 2.25, "driven_lanedir": 1.0062892601892677, "sim_render-ego": 0.0358732541402181, "in-drivable-lane": 0, "agent_compute-ego": 0.09710530704922146, "deviation-heading": 0.5869229296649252, "set_robot_commands": 0.05487275653415256, "deviation-center-line": 0.17206865231850688, "driven_lanedir_consec": 1.0062892601892677, "sim_compute_sim_state": 0.023410632875230576, "sim_compute_performance-ego": 0.03876216676500109, "sim_compute_robot_state-ego": 0.0409334659576416}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.3158982023624892, "sim_physics": 0.05887285001350172, "survival_time": 8.249999999999982, "driven_lanedir": 2.430472078042259, "sim_render-ego": 0.036576912619850854, "in-drivable-lane": 2.749999999999994, "agent_compute-ego": 0.0983204278078946, "deviation-heading": 1.3097523026601403, "set_robot_commands": 0.05507134668754809, "deviation-center-line": 0.45726768098468296, "driven_lanedir_consec": 2.430472078042259, "sim_compute_sim_state": 0.023716678041400333, "sim_compute_performance-ego": 0.03972379077564586, "sim_compute_robot_state-ego": 0.04152763540094549}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6833149544331505, "sim_physics": 0.06141012055533273, "survival_time": 3.8499999999999943, "driven_lanedir": 1.3213421349758625, "sim_render-ego": 0.03690960809781954, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0980120324469232, "deviation-heading": 0.5573952301476408, "set_robot_commands": 0.055693044290914165, "deviation-center-line": 0.29966673873444727, "driven_lanedir_consec": 1.3213421349758625, "sim_compute_sim_state": 0.024277971936510753, "sim_compute_performance-ego": 0.040186916078839986, "sim_compute_robot_state-ego": 0.04162903575154094}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6055151883308336, "sim_physics": 0.058039181268037254, "survival_time": 3.349999999999996, "driven_lanedir": 1.1588863253105712, "sim_render-ego": 0.037069477252106166, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10013601673183156, "deviation-heading": 0.2152314430475497, "set_robot_commands": 0.05480877677006508, "deviation-center-line": 0.23152540164094593, "driven_lanedir_consec": 1.1588863253105712, "sim_compute_sim_state": 0.023776549011913697, "sim_compute_performance-ego": 0.040182320039663745, "sim_compute_robot_state-ego": 0.04132951907257536}}
set_robot_commands_max0.056084197301131025
set_robot_commands_mean0.05530602431676218
set_robot_commands_median0.05507134668754809
set_robot_commands_min0.05480877677006508
sim_compute_performance-ego_max0.040186916078839986
sim_compute_performance-ego_mean0.03968008541844278
sim_compute_performance-ego_median0.03972379077564586
sim_compute_performance-ego_min0.03876216676500109
sim_compute_robot_state-ego_max0.04162903575154094
sim_compute_robot_state-ego_mean0.04130975276827661
sim_compute_robot_state-ego_median0.04132951907257536
sim_compute_robot_state-ego_min0.0409334659576416
sim_compute_sim_state_max0.024277971936510753
sim_compute_sim_state_mean0.023710280181980424
sim_compute_sim_state_median0.023716678041400333
sim_compute_sim_state_min0.023369569044846755
sim_physics_max0.06356657009858352
sim_physics_mean0.059532124761575635
sim_physics_median0.05887285001350172
sim_physics_min0.05577190187242296
sim_render-ego_max0.037069477252106166
sim_render-ego_mean0.03659012729184616
sim_render-ego_median0.036576912619850854
sim_render-ego_min0.0358732541402181
simulation-passed1
survival_time_max8.249999999999982
survival_time_mean4.059999999999993
survival_time_min2.25
No reset possible
240123803Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2972791937967472
survival_time_median3.399999999999996
deviation-center-line_median0.19992088041052256
in-drivable-lane_median0.6999999999999991


other stats
agent_compute-ego_max0.1138873981392902
agent_compute-ego_mean0.10610625305246849
agent_compute-ego_median0.10442959308624268
agent_compute-ego_min0.1035031325676862
deviation-center-line_max0.41180979962200315
deviation-center-line_mean0.21893197704697295
deviation-center-line_min0.1226676307821295
deviation-heading_max1.4221461625389653
deviation-heading_mean0.6666341281365264
deviation-heading_median0.5229383535739406
deviation-heading_min0.19718051848408008
driven_any_max3.343709174267414
driven_any_mean1.790626481260936
driven_any_median1.661049939038666
driven_any_min1.0422217679001116
driven_lanedir_consec_max2.22794375294721
driven_lanedir_consec_mean1.2313864230696403
driven_lanedir_consec_min0.6079868960781842
driven_lanedir_max2.229414328108656
driven_lanedir_mean1.2316805381019296
driven_lanedir_median1.2972791937967472
driven_lanedir_min0.6079868960781842
in-drivable-lane_max3.199999999999992
in-drivable-lane_mean1.1899999999999975
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0422217679001116, "sim_physics": 0.06210486266923987, "survival_time": 2.3, "driven_lanedir": 0.6888787772479481, "sim_render-ego": 0.03652795501377271, "in-drivable-lane": 0.6999999999999991, "agent_compute-ego": 0.1138873981392902, "deviation-heading": 0.19718051848408008, "set_robot_commands": 0.05825607154680335, "deviation-center-line": 0.1226676307821295, "driven_lanedir_consec": 0.6888787772479481, "sim_compute_sim_state": 0.023301850194516388, "sim_compute_performance-ego": 0.03872096538543701, "sim_compute_robot_state-ego": 0.04132158859916355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.192373968565878, "sim_physics": 0.05981991767883301, "survival_time": 2.499999999999999, "driven_lanedir": 0.6079868960781842, "sim_render-ego": 0.03710982322692871, "in-drivable-lane": 0.8500000000000008, "agent_compute-ego": 0.10442959308624268, "deviation-heading": 0.7223919727599728, "set_robot_commands": 0.058016085624694826, "deviation-center-line": 0.13046840351765712, "driven_lanedir_consec": 0.6079868960781842, "sim_compute_sim_state": 0.023806591033935547, "sim_compute_performance-ego": 0.03961285591125488, "sim_compute_robot_state-ego": 0.04117805480957031}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.343709174267414, "sim_physics": 0.05631509549690015, "survival_time": 8.249999999999982, "driven_lanedir": 2.229414328108656, "sim_render-ego": 0.03639275666439172, "in-drivable-lane": 3.199999999999992, "agent_compute-ego": 0.10492087133003004, "deviation-heading": 1.4221461625389653, "set_robot_commands": 0.05376246192238548, "deviation-center-line": 0.41180979962200315, "driven_lanedir_consec": 2.22794375294721, "sim_compute_sim_state": 0.023225725058353307, "sim_compute_performance-ego": 0.03854154528993549, "sim_compute_robot_state-ego": 0.04109529003952489}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.661049939038666, "sim_physics": 0.05692572463048647, "survival_time": 3.649999999999995, "driven_lanedir": 1.2972791937967472, "sim_render-ego": 0.036360227898375626, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10379027013909328, "deviation-heading": 0.5229383535739406, "set_robot_commands": 0.054191540365349754, "deviation-center-line": 0.19992088041052256, "driven_lanedir_consec": 1.2972791937967472, "sim_compute_sim_state": 0.023217139178759432, "sim_compute_performance-ego": 0.03876540432237599, "sim_compute_robot_state-ego": 0.04086693672284688}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.713777556532612, "sim_physics": 0.056592208497664505, "survival_time": 3.399999999999996, "driven_lanedir": 1.3348434952781132, "sim_render-ego": 0.03614077497931088, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1035031325676862, "deviation-heading": 0.4685136333256734, "set_robot_commands": 0.05406180900685927, "deviation-center-line": 0.2297931709025524, "driven_lanedir_consec": 1.3348434952781132, "sim_compute_sim_state": 0.023232028764836928, "sim_compute_performance-ego": 0.03854428669985603, "sim_compute_robot_state-ego": 0.041331252631019146}}
set_robot_commands_max0.05825607154680335
set_robot_commands_mean0.05565759369321853
set_robot_commands_median0.054191540365349754
set_robot_commands_min0.05376246192238548
sim_compute_performance-ego_max0.03961285591125488
sim_compute_performance-ego_mean0.03883701152177188
sim_compute_performance-ego_median0.03872096538543701
sim_compute_performance-ego_min0.03854154528993549
sim_compute_robot_state-ego_max0.041331252631019146
sim_compute_robot_state-ego_mean0.041158624560424954
sim_compute_robot_state-ego_median0.04117805480957031
sim_compute_robot_state-ego_min0.04086693672284688
sim_compute_sim_state_max0.023806591033935547
sim_compute_sim_state_mean0.02335666684608032
sim_compute_sim_state_median0.023232028764836928
sim_compute_sim_state_min0.023217139178759432
sim_physics_max0.06210486266923987
sim_physics_mean0.05835156179462481
sim_physics_median0.05692572463048647
sim_physics_min0.05631509549690015
sim_render-ego_max0.03710982322692871
sim_render-ego_mean0.03650630755655593
sim_render-ego_median0.03639275666439172
sim_render-ego_min0.03614077497931088
simulation-passed1
survival_time_max8.249999999999982
survival_time_mean4.019999999999994
survival_time_min2.3
No reset possible
240113802Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-73570:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 81, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 50, in compute_action
               ||     print(observation.size())
               || TypeError: 'int' object is not callable
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise TypeError(msg) from e
               || TypeError: Cannot call function <bound method PytorchRLBaseline.on_received_get_commands of <__main__.PytorchRLBaseline object at 0x7fe275072f28>> with arguments {'context': <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fe21f5407f0>}.
               ||
               || argspec: FullArgSpec(args=['self', 'context'], varargs=None, varkw=None, defaults=None, kwonlyargs=[], kwonlydefaults=None, annotations={'context': <class 'zuper_nodes_wrapper.interface.Context'>})
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240103801Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-73570:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 79, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 48, in compute_action
               ||     observation /= observation.max()
               || TypeError: No loop matching the specified signature and casting
               || was found for ufunc true_divide
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise TypeError(msg) from e
               || TypeError: Cannot call function <bound method PytorchRLBaseline.on_received_get_commands of <__main__.PytorchRLBaseline object at 0x7f57915b1ef0>> with arguments {'context': <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f5751684be0>}.
               ||
               || argspec: FullArgSpec(args=['self', 'context'], varargs=None, varkw=None, defaults=None, kwonlyargs=[], kwonlydefaults=None, annotations={'context': <class 'zuper_nodes_wrapper.interface.Context'>})
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240093800Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1779706500090832
survival_time_median3.2499999999999964
deviation-center-line_median0.25040531780111785
in-drivable-lane_median1.1999999999999993


other stats
agent_compute-ego_max0.09727288694942698
agent_compute-ego_mean0.09648970671542484
agent_compute-ego_median0.09629928320646286
agent_compute-ego_min0.09561865146343523
deviation-center-line_max0.3769150969088316
deviation-center-line_mean0.2417260446986368
deviation-center-line_min0.13863834695435018
deviation-heading_max1.171945720356933
deviation-heading_mean0.5893031392096364
deviation-heading_median0.5585268168063817
deviation-heading_min0.19881301562346537
driven_any_max3.344122066636058
driven_any_mean1.7981792738753897
driven_any_median1.6301783771744984
driven_any_min0.998586419751354
driven_lanedir_consec_max2.1924131524168704
driven_lanedir_consec_mean1.1796700160852456
driven_lanedir_consec_min0.5428774088437708
driven_lanedir_max2.1924131524168704
driven_lanedir_mean1.1796700160852456
driven_lanedir_median1.1779706500090832
driven_lanedir_min0.5428774088437708
in-drivable-lane_max3.2499999999999893
in-drivable-lane_mean1.5499999999999956
in-drivable-lane_min0.7999999999999972
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.998586419751354, "sim_physics": 0.0559585839509964, "survival_time": 3.1999999999999966, "driven_lanedir": 0.6787016403434145, "sim_render-ego": 0.03600187599658966, "in-drivable-lane": 1.4999999999999958, "agent_compute-ego": 0.09629928320646286, "deviation-heading": 0.2576716737575899, "set_robot_commands": 0.05541538819670677, "deviation-center-line": 0.13863834695435018, "driven_lanedir_consec": 0.6787016403434145, "sim_compute_sim_state": 0.023557480424642563, "sim_compute_performance-ego": 0.03918953612446785, "sim_compute_robot_state-ego": 0.04051482304930687}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2862682888653014, "sim_physics": 0.056621271988441205, "survival_time": 2.8999999999999977, "driven_lanedir": 0.5428774088437708, "sim_render-ego": 0.036068706676877775, "in-drivable-lane": 1.1999999999999993, "agent_compute-ego": 0.09620387800808612, "deviation-heading": 0.759558469503812, "set_robot_commands": 0.05381471946321685, "deviation-center-line": 0.1411818998396067, "driven_lanedir_consec": 0.5428774088437708, "sim_compute_sim_state": 0.023319606123299433, "sim_compute_performance-ego": 0.039227091032883216, "sim_compute_robot_state-ego": 0.04106749337295006}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.344122066636058, "sim_physics": 0.05683745572596421, "survival_time": 8.09999999999998, "driven_lanedir": 2.1924131524168704, "sim_render-ego": 0.03605513513824086, "in-drivable-lane": 3.2499999999999893, "agent_compute-ego": 0.09705383394971306, "deviation-heading": 1.171945720356933, "set_robot_commands": 0.054757895293059175, "deviation-center-line": 0.3769150969088316, "driven_lanedir_consec": 2.1924131524168704, "sim_compute_sim_state": 0.023257011248741626, "sim_compute_performance-ego": 0.039390615475030595, "sim_compute_robot_state-ego": 0.04065277841356066}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7317412169497366, "sim_physics": 0.05570567074943991, "survival_time": 4.249999999999993, "driven_lanedir": 1.306387228813089, "sim_render-ego": 0.03631725591771743, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.09727288694942698, "deviation-heading": 0.5585268168063817, "set_robot_commands": 0.053684719871072206, "deviation-center-line": 0.3014895619892776, "driven_lanedir_consec": 1.306387228813089, "sim_compute_sim_state": 0.02333668260013356, "sim_compute_performance-ego": 0.03897839153514189, "sim_compute_robot_state-ego": 0.04086967917049632}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6301783771744984, "sim_physics": 0.05581498879652757, "survival_time": 3.2499999999999964, "driven_lanedir": 1.1779706500090832, "sim_render-ego": 0.03547922647916354, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.09561865146343523, "deviation-heading": 0.19881301562346537, "set_robot_commands": 0.053747910719651446, "deviation-center-line": 0.25040531780111785, "driven_lanedir_consec": 1.1779706500090832, "sim_compute_sim_state": 0.023244557013878456, "sim_compute_performance-ego": 0.03954048890333909, "sim_compute_robot_state-ego": 0.04044064008272611}}
set_robot_commands_max0.05541538819670677
set_robot_commands_mean0.05428412670874129
set_robot_commands_median0.05381471946321685
set_robot_commands_min0.053684719871072206
sim_compute_performance-ego_max0.03954048890333909
sim_compute_performance-ego_mean0.03926522461417253
sim_compute_performance-ego_median0.039227091032883216
sim_compute_performance-ego_min0.03897839153514189
sim_compute_robot_state-ego_max0.04106749337295006
sim_compute_robot_state-ego_mean0.04070908281780801
sim_compute_robot_state-ego_median0.04065277841356066
sim_compute_robot_state-ego_min0.04044064008272611
sim_compute_sim_state_max0.023557480424642563
sim_compute_sim_state_mean0.02334306748213912
sim_compute_sim_state_median0.023319606123299433
sim_compute_sim_state_min0.023244557013878456
sim_physics_max0.05683745572596421
sim_physics_mean0.056187594242273854
sim_physics_median0.0559585839509964
sim_physics_min0.05570567074943991
sim_render-ego_max0.03631725591771743
sim_render-ego_mean0.03598444004171785
sim_render-ego_median0.03605513513824086
sim_render-ego_min0.03547922647916354
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean4.339999999999993
survival_time_min2.8999999999999977
No reset possible
240083799Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-73570:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 78, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     observation /= observation.max()
               || TypeError: No loop matching the specified signature and casting
               || was found for ufunc true_divide
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise TypeError(msg) from e
               || TypeError: Cannot call function <bound method PytorchRLBaseline.on_received_get_commands of <__main__.PytorchRLBaseline object at 0x7fd1cab3beb8>> with arguments {'context': <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fd175003cf8>}.
               ||
               || argspec: FullArgSpec(args=['self', 'context'], varargs=None, varkw=None, defaults=None, kwonlyargs=[], kwonlydefaults=None, annotations={'context': <class 'zuper_nodes_wrapper.interface.Context'>})
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240073798Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240063797Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.244243767536708
survival_time_median3.4499999999999957
deviation-center-line_median0.19553582247490095
in-drivable-lane_median0.9500000000000008


other stats
agent_compute-ego_max0.0983372201452722
agent_compute-ego_mean0.09660479881067773
agent_compute-ego_median0.09621976769488792
agent_compute-ego_min0.09593208742813324
deviation-center-line_max0.40729481009657825
deviation-center-line_mean0.21381106061492244
deviation-center-line_min0.11899879724438864
deviation-heading_max1.296916504190604
deviation-heading_mean0.5872806340629769
deviation-heading_median0.4780604256375672
deviation-heading_min0.200086553631852
driven_any_max3.285179685806149
driven_any_mean1.7448977578831524
driven_any_median1.6049817588077175
driven_any_min0.9952880617019196
driven_lanedir_consec_max2.2943031225190547
driven_lanedir_consec_mean1.2081669127892485
driven_lanedir_consec_min0.5594381299717874
driven_lanedir_max2.2943031225190547
driven_lanedir_mean1.2081669127892485
driven_lanedir_median1.244243767536708
driven_lanedir_min0.5594381299717874
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean1.149999999999997
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9952880617019196, "sim_physics": 0.05957422653834025, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6585572753451054, "sim_render-ego": 0.03711240688959758, "in-drivable-lane": 1.3999999999999966, "agent_compute-ego": 0.0964160680770874, "deviation-heading": 0.200086553631852, "set_robot_commands": 0.05478712717692057, "deviation-center-line": 0.14129653149190685, "driven_lanedir_consec": 0.6585572753451054, "sim_compute_sim_state": 0.02346965471903483, "sim_compute_performance-ego": 0.03886263370513916, "sim_compute_robot_state-ego": 0.04088996648788453}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.199010320600831, "sim_physics": 0.05938982963562012, "survival_time": 2.499999999999999, "driven_lanedir": 0.5594381299717874, "sim_render-ego": 0.036587367057800295, "in-drivable-lane": 0.9500000000000008, "agent_compute-ego": 0.0961188507080078, "deviation-heading": 0.6991779986934736, "set_robot_commands": 0.05490993976593018, "deviation-center-line": 0.11899879724438864, "driven_lanedir_consec": 0.5594381299717874, "sim_compute_sim_state": 0.02339139461517334, "sim_compute_performance-ego": 0.038963394165039064, "sim_compute_robot_state-ego": 0.040863137245178226}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.285179685806149, "sim_physics": 0.05651483168968788, "survival_time": 7.149999999999983, "driven_lanedir": 2.2943031225190547, "sim_render-ego": 0.036980902398382864, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0983372201452722, "deviation-heading": 1.296916504190604, "set_robot_commands": 0.05526719893608893, "deviation-center-line": 0.40729481009657825, "driven_lanedir_consec": 2.2943031225190547, "sim_compute_sim_state": 0.0237996161400855, "sim_compute_performance-ego": 0.03922575503796131, "sim_compute_robot_state-ego": 0.04082702089856555}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6400289624991455, "sim_physics": 0.05804591783335511, "survival_time": 3.5499999999999954, "driven_lanedir": 1.2842922685735867, "sim_render-ego": 0.036326448682328344, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09593208742813324, "deviation-heading": 0.4780604256375672, "set_robot_commands": 0.05496461962310361, "deviation-center-line": 0.20592934176683733, "driven_lanedir_consec": 1.2842922685735867, "sim_compute_sim_state": 0.023348462413734113, "sim_compute_performance-ego": 0.03932432389595139, "sim_compute_robot_state-ego": 0.04074496282658107}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6049817588077175, "sim_physics": 0.06302127285280089, "survival_time": 3.4499999999999957, "driven_lanedir": 1.244243767536708, "sim_render-ego": 0.03620828752932341, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.09621976769488792, "deviation-heading": 0.2621616881613876, "set_robot_commands": 0.05736769800600798, "deviation-center-line": 0.19553582247490095, "driven_lanedir_consec": 1.244243767536708, "sim_compute_sim_state": 0.02339317833167919, "sim_compute_performance-ego": 0.04018942860589511, "sim_compute_robot_state-ego": 0.04069427130878835}}
set_robot_commands_max0.05736769800600798
set_robot_commands_mean0.055459316701610264
set_robot_commands_median0.05496461962310361
set_robot_commands_min0.05478712717692057
sim_compute_performance-ego_max0.04018942860589511
sim_compute_performance-ego_mean0.03931310708199721
sim_compute_performance-ego_median0.03922575503796131
sim_compute_performance-ego_min0.03886263370513916
sim_compute_robot_state-ego_max0.04088996648788453
sim_compute_robot_state-ego_mean0.04080387175339954
sim_compute_robot_state-ego_median0.04082702089856555
sim_compute_robot_state-ego_min0.04069427130878835
sim_compute_sim_state_max0.0237996161400855
sim_compute_sim_state_mean0.023480461243941396
sim_compute_sim_state_median0.02339317833167919
sim_compute_sim_state_min0.023348462413734113
sim_physics_max0.06302127285280089
sim_physics_mean0.05930921570996085
sim_physics_median0.05938982963562012
sim_physics_min0.05651483168968788
sim_render-ego_max0.03711240688959758
sim_render-ego_mean0.0366430825114865
sim_render-ego_median0.036587367057800295
sim_render-ego_min0.03620828752932341
simulation-passed1
survival_time_max7.149999999999983
survival_time_mean3.929999999999994
survival_time_min2.499999999999999
No reset possible
240033795Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-73570:01:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239853784Andrés Calderón 🇨🇴challenge-aido_LF-template-randomaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-73570:05:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17988154411315918
agent_compute-ego_mean0.1536102693583829
agent_compute-ego_median0.15454616733625823
agent_compute-ego_min0.12836158976835363
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.09658401983755606, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05507183957982947, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1590509193914908, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09531801718252676, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04628773530324301, "sim_compute_performance-ego": 0.06621753727948224, "sim_compute_robot_state-ego": 0.06305410685362639}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11868873764486874, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.062057270723230695, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15454616733625823, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09532534374910244, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04114621293311026, "sim_compute_performance-ego": 0.07199929274764716, "sim_compute_robot_state-ego": 0.07316795984903972}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10587285546695484, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05678265235003303, "in-drivable-lane": 0, "agent_compute-ego": 0.12836158976835363, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08580136299133301, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.036262161591473746, "sim_compute_performance-ego": 0.06101731693043428, "sim_compute_robot_state-ego": 0.06205818232368021}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1425476551055908, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.07150968551635742, "in-drivable-lane": 0, "agent_compute-ego": 0.17988154411315918, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1110304069519043, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04363409042358399, "sim_compute_performance-ego": 0.07822474479675293, "sim_compute_robot_state-ego": 0.08693365097045898}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10486400881900064, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.060106956506077246, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14621112618265272, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09362970726399482, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03702580476108985, "sim_compute_performance-ego": 0.06756785247899309, "sim_compute_robot_state-ego": 0.07269380967828291}}
set_robot_commands_max0.1110304069519043
set_robot_commands_mean0.09622096762777228
set_robot_commands_median0.09531801718252676
set_robot_commands_min0.08580136299133301
sim_compute_performance-ego_max0.07822474479675293
sim_compute_performance-ego_mean0.06900534884666194
sim_compute_performance-ego_median0.06756785247899309
sim_compute_performance-ego_min0.06101731693043428
sim_compute_robot_state-ego_max0.08693365097045898
sim_compute_robot_state-ego_mean0.07158154193501765
sim_compute_robot_state-ego_median0.07269380967828291
sim_compute_robot_state-ego_min0.06205818232368021
sim_compute_sim_state_max0.04628773530324301
sim_compute_sim_state_mean0.04087120100250017
sim_compute_sim_state_median0.04114621293311026
sim_compute_sim_state_min0.036262161591473746
sim_physics_max0.1425476551055908
sim_physics_mean0.1137114553747942
sim_physics_median0.10587285546695484
sim_physics_min0.09658401983755606
sim_render-ego_max0.07150968551635742
sim_render-ego_mean0.06110568093510558
sim_render-ego_median0.060106956506077246
sim_render-ego_min0.05507183957982947
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
237483759Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-42-167-73570:39:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237433749sebastian glatzaido2-LFV-sim-testingstep1-simulationsuccessyesip-172-31-42-167-73570:12:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.11471105063403096
agent_compute-ego_mean0.09188274060224416
agent_compute-ego_median0.08652210235595703
agent_compute-ego_min0.08603063777641014
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11240424933256926, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04450094258343732, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11471105063403096, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0727119313346015, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.028263679257145635, "sim_compute_performance-ego": 0.05029237711871112, "sim_compute_robot_state-ego": 0.052201284302605525, "sim_compute_robot_state-npc0": 0.05062058236863878, "sim_compute_robot_state-npc1": 0.05248792966206869, "sim_compute_robot_state-npc2": 0.05344392193688287, "sim_compute_robot_state-npc3": 0.05016410792315448}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.123404541015625, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.046174535751342775, "in-drivable-lane": 0, "agent_compute-ego": 0.10784406661987304, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.06869266510009765, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.027157115936279296, "sim_compute_performance-ego": 0.04855607986450195, "sim_compute_robot_state-ego": 0.05171023368835449, "sim_compute_robot_state-npc0": 0.0492319393157959, "sim_compute_robot_state-npc1": 0.04986615180969238, "sim_compute_robot_state-npc2": 0.04786275863647461, "sim_compute_robot_state-npc3": 0.04599470138549805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12088166726262946, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0420559613328231, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11145182032334178, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.06872682508669402, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.027234889959034166, "sim_compute_performance-ego": 0.047592266609794216, "sim_compute_robot_state-ego": 0.04970563085455643, "sim_compute_robot_state-npc0": 0.05044773377870258, "sim_compute_robot_state-npc1": 0.04916344504607351, "sim_compute_robot_state-npc2": 0.04948840956938894, "sim_compute_robot_state-npc3": 0.05031911950362356}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.13537006136737292, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.03505245945121668, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.08614797531803951, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05678679671468614, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.022272429888761495, "sim_compute_performance-ego": 0.038283779651303834, "sim_compute_robot_state-ego": 0.04023056694223911, "sim_compute_robot_state-npc0": 0.03992650478701048, "sim_compute_robot_state-npc1": 0.03897002678883227, "sim_compute_robot_state-npc2": 0.03887293912187408, "sim_compute_robot_state-npc3": 0.03881658179850518}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.09103688171931676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.03561298336301531, "in-drivable-lane": 0, "agent_compute-ego": 0.08717866454805646, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05519106558391026, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.022425762244633267, "sim_compute_performance-ego": 0.038574159145355225, "sim_compute_robot_state-ego": 0.04051596777779715, "sim_compute_robot_state-npc0": 0.03964836256844657, "sim_compute_robot_state-npc1": 0.03913944108145578, "sim_compute_robot_state-npc2": 0.03916803428104946, "sim_compute_robot_state-npc3": 0.03925152335848127}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08492616812388103, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.035111166812755445, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08603063777641014, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.054876614499975135, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.022144330872429743, "sim_compute_performance-ego": 0.03831842652073613, "sim_compute_robot_state-ego": 0.03998624836957013, "sim_compute_robot_state-npc0": 0.04191342548087791, "sim_compute_robot_state-npc1": 0.039616787875140155, "sim_compute_robot_state-npc2": 0.03876676824357775, "sim_compute_robot_state-npc3": 0.03869112332661947}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0875048107571072, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.035238442597565825, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08639093240102132, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05483976999918619, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.022377398278978135, "sim_compute_performance-ego": 0.038319000491389525, "sim_compute_robot_state-ego": 0.04013890248757822, "sim_compute_robot_state-npc0": 0.03943702909681532, "sim_compute_robot_state-npc1": 0.03901992020783601, "sim_compute_robot_state-npc2": 0.03911685060571741, "sim_compute_robot_state-npc3": 0.03904143969217936}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.10398458374871147, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.0352417786916097, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08676069577534994, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05499156845940484, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.022236516740587024, "sim_compute_performance-ego": 0.03817938168843587, "sim_compute_robot_state-ego": 0.04123997688293457, "sim_compute_robot_state-npc0": 0.0393116103278266, "sim_compute_robot_state-npc1": 0.03913311428493923, "sim_compute_robot_state-npc2": 0.03889259762234158, "sim_compute_robot_state-npc3": 0.060362460878160266}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.08436141843381136, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03515476247538691, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08625316619873047, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05494280483411706, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.022244183913521145, "sim_compute_performance-ego": 0.0382503893064416, "sim_compute_robot_state-ego": 0.04023222819618557, "sim_compute_robot_state-npc0": 0.039405656897503395, "sim_compute_robot_state-npc1": 0.03914682243181312, "sim_compute_robot_state-npc2": 0.038709531659665314, "sim_compute_robot_state-npc3": 0.03903104947960895}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.1155332899093628, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.034946351051330565, "in-drivable-lane": 0, "agent_compute-ego": 0.08613057136535644, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05488933563232422, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02506941795349121, "sim_compute_performance-ego": 0.03887814044952392, "sim_compute_robot_state-ego": 0.04042298793792724, "sim_compute_robot_state-npc0": 0.0394152307510376, "sim_compute_robot_state-npc1": 0.03900943279266358, "sim_compute_robot_state-npc2": 0.03886136531829834, "sim_compute_robot_state-npc3": 0.03890852451324463}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.10702074766159056, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.035391271114349365, "in-drivable-lane": 0, "agent_compute-ego": 0.08699120283126831, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05529739856719971, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.02228999137878418, "sim_compute_performance-ego": 0.03840994834899902, "sim_compute_robot_state-ego": 0.04062608480453491, "sim_compute_robot_state-npc0": 0.03933863639831543, "sim_compute_robot_state-npc1": 0.03892912864685059, "sim_compute_robot_state-npc2": 0.03873568773269653, "sim_compute_robot_state-npc3": 0.03891223669052124}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08695874716106214, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.035558688013177166, "in-drivable-lane": 0, "agent_compute-ego": 0.09319181191293816, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05576434888337787, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02263262397364566, "sim_compute_performance-ego": 0.03856623800177323, "sim_compute_robot_state-ego": 0.040993100718448035, "sim_compute_robot_state-npc0": 0.03971497636092337, "sim_compute_robot_state-npc1": 0.03945136070251465, "sim_compute_robot_state-npc2": 0.039058409239116465, "sim_compute_robot_state-npc3": 0.03923308221917403}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08398649215698242, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.034802603721618655, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.08636300086975097, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.054903807640075686, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.02223757266998291, "sim_compute_performance-ego": 0.03818500518798828, "sim_compute_robot_state-ego": 0.04007328987121582, "sim_compute_robot_state-npc0": 0.03943102836608887, "sim_compute_robot_state-npc1": 0.0389306640625, "sim_compute_robot_state-npc2": 0.03975080966949463, "sim_compute_robot_state-npc3": 0.03895270824432373}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1053216890855269, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.035432956435463646, "in-drivable-lane": 0, "agent_compute-ego": 0.08627341010353783, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.055165583437139336, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02219245650551536, "sim_compute_performance-ego": 0.03815847093408758, "sim_compute_robot_state-ego": 0.04020809043537487, "sim_compute_robot_state-npc0": 0.039451674981550736, "sim_compute_robot_state-npc1": 0.03896654735911976, "sim_compute_robot_state-npc2": 0.038840651512146, "sim_compute_robot_state-npc3": 0.03888243978673762}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10094436334103954, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.03557725341952577, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08652210235595703, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.055469770820773374, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02233609374688596, "sim_compute_performance-ego": 0.038225339383495094, "sim_compute_robot_state-ego": 0.04037859975075235, "sim_compute_robot_state-npc0": 0.039779205711520445, "sim_compute_robot_state-npc1": 0.039127291465292174, "sim_compute_robot_state-npc2": 0.03901326899625817, "sim_compute_robot_state-npc3": 0.0388533387865339}}
set_robot_commands_max0.0727119313346015
set_robot_commands_mean0.0582166857729042
set_robot_commands_median0.05519106558391026
set_robot_commands_min0.05483976999918619
sim_compute_performance-ego_max0.05029237711871112
sim_compute_performance-ego_mean0.04045260018016909
sim_compute_performance-ego_median0.038319000491389525
sim_compute_performance-ego_min0.03815847093408758
sim_compute_robot_state-ego_max0.052201284302605525
sim_compute_robot_state-ego_mean0.04257754620133829
sim_compute_robot_state-ego_median0.04042298793792724
sim_compute_robot_state-ego_min0.03998624836957013
sim_compute_robot_state-npc0_max0.05062058236863878
sim_compute_robot_state-npc0_mean0.04180490647940361
sim_compute_robot_state-npc0_median0.03964836256844657
sim_compute_robot_state-npc0_min0.0393116103278266
sim_compute_robot_state-npc1_max0.05248792966206869
sim_compute_robot_state-npc1_mean0.041397204281119454
sim_compute_robot_state-npc1_median0.03913311428493923
sim_compute_robot_state-npc1_min0.03892912864685059
sim_compute_robot_state-npc2_max0.05344392193688287
sim_compute_robot_state-npc2_mean0.04123880027633213
sim_compute_robot_state-npc2_median0.03901326899625817
sim_compute_robot_state-npc2_min0.038709531659665314
sim_compute_robot_state-npc3_max0.060362460878160266
sim_compute_robot_state-npc3_mean0.04236096250575771
sim_compute_robot_state-npc3_median0.03903104947960895
sim_compute_robot_state-npc3_min0.03869112332661947
sim_compute_sim_state_max0.028263679257145635
sim_compute_sim_state_mean0.02354096422131168
sim_compute_sim_state_median0.02233609374688596
sim_compute_sim_state_min0.022144330872429743
sim_physics_max0.13537006136737292
sim_physics_mean0.1029093140717726
sim_physics_median0.10398458374871147
sim_physics_min0.08398649215698242
sim_render-ego_max0.046174535751342775
sim_render-ego_mean0.037056810454307886
sim_render-ego_median0.035391271114349365
sim_render-ego_min0.034802603721618655
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
236663713jiang pengfinal test - whaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-73570:15:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6739581230281155
survival_time_median14.950000000000076
deviation-center-line_median0.3941025175869708
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13150811910629273
agent_compute-ego_mean0.10875458971659344
agent_compute-ego_median0.1030660343170166
agent_compute-ego_min0.10279983282089232
deviation-center-line_max0.9855884436071732
deviation-center-line_mean0.5476643542236538
deviation-center-line_min0.23333145765200997
deviation-heading_max2.1061508052597033
deviation-heading_mean1.6356790124350682
deviation-heading_median1.7956846372515745
deviation-heading_min1.1260002628763528
driven_any_max3.653830750759253
driven_any_mean1.472677231067218
driven_any_median0.6768233729223686
driven_any_min0.11389696543724508
driven_lanedir_consec_max3.400719543411479
driven_lanedir_consec_mean1.4113265755217477
driven_lanedir_consec_min0.11179182472364468
driven_lanedir_max3.400719543411479
driven_lanedir_mean1.4113265755217477
driven_lanedir_median0.6739581230281155
driven_lanedir_min0.11179182472364468
in-drivable-lane_max0.4499999999999984
in-drivable-lane_mean0.08999999999999968
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.11389696543724508, "sim_physics": 0.05695484479268392, "survival_time": 14.950000000000076, "driven_lanedir": 0.11179182472364468, "sim_render-ego": 0.03533862590789795, "in-drivable-lane": 0, "agent_compute-ego": 0.10301037470499674, "deviation-heading": 1.833621982041104, "set_robot_commands": 0.05600987911224365, "deviation-center-line": 0.7431676310222219, "driven_lanedir_consec": 0.11179182472364468, "sim_compute_sim_state": 0.022619492212931316, "sim_compute_performance-ego": 0.03855545441309611, "sim_compute_robot_state-ego": 0.04010685284932455}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.653830750759253, "sim_physics": 0.0694495924313863, "survival_time": 14.950000000000076, "driven_lanedir": 3.400719543411479, "sim_render-ego": 0.04206794500350952, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.13150811910629273, "deviation-heading": 1.7956846372515745, "set_robot_commands": 0.0658201297124227, "deviation-center-line": 0.9855884436071732, "driven_lanedir_consec": 3.400719543411479, "sim_compute_sim_state": 0.028022180398305258, "sim_compute_performance-ego": 0.050351463953653974, "sim_compute_robot_state-ego": 0.052902581691741946}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.456852320408123, "sim_physics": 0.0554482102394104, "survival_time": 14.950000000000076, "driven_lanedir": 2.4115549377940235, "sim_render-ego": 0.03509377717971802, "in-drivable-lane": 0, "agent_compute-ego": 0.10279983282089232, "deviation-heading": 2.1061508052597033, "set_robot_commands": 0.05487285137176514, "deviation-center-line": 0.3941025175869708, "driven_lanedir_consec": 2.4115549377940235, "sim_compute_sim_state": 0.02258399248123169, "sim_compute_performance-ego": 0.03828751643498739, "sim_compute_robot_state-ego": 0.040739080905914306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6768233729223686, "sim_physics": 0.05502998113632202, "survival_time": 14.950000000000076, "driven_lanedir": 0.6739581230281155, "sim_render-ego": 0.034974555969238284, "in-drivable-lane": 0, "agent_compute-ego": 0.10338858763376872, "deviation-heading": 1.3169373747466062, "set_robot_commands": 0.05480600357055664, "deviation-center-line": 0.23333145765200997, "driven_lanedir_consec": 0.6739581230281155, "sim_compute_sim_state": 0.02244361400604248, "sim_compute_performance-ego": 0.03818320751190186, "sim_compute_robot_state-ego": 0.03969473361968994}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4619827458091008, "sim_physics": 0.05393163998921712, "survival_time": 14.950000000000076, "driven_lanedir": 0.45860844865147543, "sim_render-ego": 0.03526963790257772, "in-drivable-lane": 0, "agent_compute-ego": 0.1030660343170166, "deviation-heading": 1.1260002628763528, "set_robot_commands": 0.054875619411468506, "deviation-center-line": 0.3821317212498929, "driven_lanedir_consec": 0.45860844865147543, "sim_compute_sim_state": 0.022913331985473632, "sim_compute_performance-ego": 0.03922961076100667, "sim_compute_robot_state-ego": 0.039781322479248045}}
set_robot_commands_max0.0658201297124227
set_robot_commands_mean0.057276896635691334
set_robot_commands_median0.054875619411468506
set_robot_commands_min0.05480600357055664
sim_compute_performance-ego_max0.050351463953653974
sim_compute_performance-ego_mean0.0409214506149292
sim_compute_performance-ego_median0.03855545441309611
sim_compute_performance-ego_min0.03818320751190186
sim_compute_robot_state-ego_max0.052902581691741946
sim_compute_robot_state-ego_mean0.042644914309183754
sim_compute_robot_state-ego_median0.04010685284932455
sim_compute_robot_state-ego_min0.03969473361968994
sim_compute_sim_state_max0.028022180398305258
sim_compute_sim_state_mean0.023716522216796876
sim_compute_sim_state_median0.022619492212931316
sim_compute_sim_state_min0.02244361400604248
sim_physics_max0.0694495924313863
sim_physics_mean0.05816285371780395
sim_physics_median0.0554482102394104
sim_physics_min0.05393163998921712
sim_render-ego_max0.04206794500350952
sim_render-ego_mean0.0365489083925883
sim_render-ego_median0.03526963790257772
sim_render-ego_min0.034974555969238284
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
236163704Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-73570:25:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.44374302000365046
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.3197508462270101
agent_compute-ego_mean0.31775930325190227
agent_compute-ego_median0.3177070148785909
agent_compute-ego_min0.3161770526568095
deviation-center-line_max0.7337965812416224
deviation-center-line_mean0.4812214119502003
deviation-center-line_min0.29799505396684733
deviation-heading_max5.990117020581061
deviation-heading_mean5.864380088201328
deviation-heading_median5.951617305849203
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.185306548531142
driven_any_median2.1853065485311407
driven_any_min2.1853065485311367
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.6949286260456211
driven_lanedir_consec_min0.6933707706415575
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.6949286260456211
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6933707706415575
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.260000000000038
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.08476901213328043, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.047888081868489585, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.3177070148785909, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.07052671432495117, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.031415512561798094, "sim_compute_performance-ego": 0.0521331516901652, "sim_compute_robot_state-ego": 0.053901416460673014}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.08436025381088257, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.04933545430501302, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.3170484240849813, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.0720005170504252, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.03269251743952433, "sim_compute_performance-ego": 0.053415780067443845, "sim_compute_robot_state-ego": 0.05342173973719279}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.08236098368962606, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.04959067583084106, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.3161770526568095, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.07095826546351115, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.03348989486694336, "sim_compute_performance-ego": 0.05184664726257325, "sim_compute_robot_state-ego": 0.0534023912747701}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.08569215377171835, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.04746804475784302, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.31811317841211956, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.0694225549697876, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.031480868657430015, "sim_compute_performance-ego": 0.054878294467926025, "sim_compute_robot_state-ego": 0.05296042521794637}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.08119772434234619, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.04788433233896891, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.3197508462270101, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.07357893943786621, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.031820533275604246, "sim_compute_performance-ego": 0.05165429512659709, "sim_compute_robot_state-ego": 0.057551425298055015}}
set_robot_commands_max0.07357893943786621
set_robot_commands_mean0.07129739824930827
set_robot_commands_median0.07095826546351115
set_robot_commands_min0.0694225549697876
sim_compute_performance-ego_max0.054878294467926025
sim_compute_performance-ego_mean0.05278563372294108
sim_compute_performance-ego_median0.0521331516901652
sim_compute_performance-ego_min0.05165429512659709
sim_compute_robot_state-ego_max0.057551425298055015
sim_compute_robot_state-ego_mean0.05424747959772745
sim_compute_robot_state-ego_median0.05342173973719279
sim_compute_robot_state-ego_min0.05296042521794637
sim_compute_sim_state_max0.03348989486694336
sim_compute_sim_state_mean0.032179865360260004
sim_compute_sim_state_median0.031820533275604246
sim_compute_sim_state_min0.031415512561798094
sim_physics_max0.08569215377171835
sim_physics_mean0.08367602554957072
sim_physics_median0.08436025381088257
sim_physics_min0.08119772434234619
sim_render-ego_max0.04959067583084106
sim_render-ego_mean0.04843331782023112
sim_render-ego_median0.047888081868489585
sim_render-ego_min0.04746804475784302
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
235953697Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-42-167-73570:15:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235663686Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-73570:16:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.44374302000365046
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.22655071338017785
agent_compute-ego_mean0.2227938249905904
agent_compute-ego_median0.2221819519996643
agent_compute-ego_min0.22104305823644
deviation-center-line_max0.7337965812416224
deviation-center-line_mean0.4812214119502003
deviation-center-line_min0.29799505396684733
deviation-heading_max5.990117020581061
deviation-heading_mean5.864380088201328
deviation-heading_median5.951617305849203
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.185306548531142
driven_any_median2.1853065485311407
driven_any_min2.1853065485311367
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.6949286260456211
driven_lanedir_consec_min0.6933707706415575
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.6949286260456211
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6933707706415575
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.260000000000038
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.05647529363632202, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.035842928091684975, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.22107329527537029, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.055648913383483885, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.022841852506001792, "sim_compute_performance-ego": 0.038620770772298176, "sim_compute_robot_state-ego": 0.04013902266820272}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.0540275231997172, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.03542458454767863, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2221819519996643, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.05392236471176148, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.022667551040649415, "sim_compute_performance-ego": 0.039041029612223305, "sim_compute_robot_state-ego": 0.040305404663085936}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.05784837007522583, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.035155583222707114, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.22104305823644, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.057120868364969886, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.02274115244547526, "sim_compute_performance-ego": 0.038365705013275145, "sim_compute_robot_state-ego": 0.04011585791905721}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.0542753012975057, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.035435707569122316, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.22312010606129964, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05438274939854939, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.02422943115234375, "sim_compute_performance-ego": 0.03845947583516439, "sim_compute_robot_state-ego": 0.041093522707621254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.05710412025451661, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.03501381953557332, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.22655071338017785, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.055101755460103354, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.022825934886932377, "sim_compute_performance-ego": 0.038042199611663816, "sim_compute_robot_state-ego": 0.03996617952982585}}
set_robot_commands_max0.057120868364969886
set_robot_commands_mean0.0552353302637736
set_robot_commands_median0.055101755460103354
set_robot_commands_min0.05392236471176148
sim_compute_performance-ego_max0.039041029612223305
sim_compute_performance-ego_mean0.038505836168924966
sim_compute_performance-ego_median0.03845947583516439
sim_compute_performance-ego_min0.038042199611663816
sim_compute_robot_state-ego_max0.041093522707621254
sim_compute_robot_state-ego_mean0.04032399749755859
sim_compute_robot_state-ego_median0.04013902266820272
sim_compute_robot_state-ego_min0.03996617952982585
sim_compute_sim_state_max0.02422943115234375
sim_compute_sim_state_mean0.02306118440628052
sim_compute_sim_state_median0.022825934886932377
sim_compute_sim_state_min0.022667551040649415
sim_physics_max0.05784837007522583
sim_physics_mean0.05594612169265747
sim_physics_median0.05647529363632202
sim_physics_min0.0540275231997172
sim_render-ego_max0.035842928091684975
sim_render-ego_mean0.035374524593353274
sim_render-ego_median0.03542458454767863
sim_render-ego_min0.03501381953557332
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
235613687Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationabortedyesip-172-31-42-167-73570:15:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235563682Anastasiya Nikolskaya 🇷🇺Submission 01aido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-73570:10:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.422651809660398
survival_time_median8.199999999999982
deviation-center-line_median0.6257883809066043
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05111038103336241
agent_compute-ego_mean0.04935077495265598
agent_compute-ego_median0.05020163249384406
agent_compute-ego_min0.04729539155960083
deviation-center-line_max0.9579801037902312
deviation-center-line_mean0.5872113106406243
deviation-center-line_min0.17622398297250572
deviation-heading_max4.840773403748196
deviation-heading_mean2.430266033265879
deviation-heading_median2.557372147856163
deviation-heading_min0.37041614299191894
driven_any_max2.7575506306596673
driven_any_mean1.5256560871497111
driven_any_median1.4840847449067072
driven_any_min0.2766208937559502
driven_lanedir_consec_max2.4514960053285946
driven_lanedir_consec_mean1.404307239382241
driven_lanedir_consec_min0.27059756039014715
driven_lanedir_max2.4514960053285946
driven_lanedir_mean1.404307239382241
driven_lanedir_median1.422651809660398
driven_lanedir_min0.27059756039014715
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.11999999999999993
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6354483681962906, "sim_physics": 0.06224086139742182, "survival_time": 9.049999999999994, "driven_lanedir": 1.5226932805301854, "sim_render-ego": 0.03754823774264004, "in-drivable-lane": 0, "agent_compute-ego": 0.050769171003478664, "deviation-heading": 2.557372147856163, "set_robot_commands": 0.056602547840518845, "deviation-center-line": 0.7265710131946099, "driven_lanedir_consec": 1.5226932805301854, "sim_compute_sim_state": 0.024351941946461713, "sim_compute_performance-ego": 0.040723572778438334, "sim_compute_robot_state-ego": 0.04300519379462985}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7575506306596673, "sim_physics": 0.05927839756011963, "survival_time": 14.950000000000076, "driven_lanedir": 2.4514960053285946, "sim_render-ego": 0.037482986450195314, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04737729867299398, "deviation-heading": 4.840773403748196, "set_robot_commands": 0.05640496095021566, "deviation-center-line": 0.9579801037902312, "driven_lanedir_consec": 2.4514960053285946, "sim_compute_sim_state": 0.024302876790364584, "sim_compute_performance-ego": 0.040114956696828206, "sim_compute_robot_state-ego": 0.04265688180923462}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2766208937559502, "sim_physics": 0.06376591655943128, "survival_time": 1.800000000000001, "driven_lanedir": 0.27059756039014715, "sim_render-ego": 0.03669107622570462, "in-drivable-lane": 0, "agent_compute-ego": 0.04729539155960083, "deviation-heading": 0.37041614299191894, "set_robot_commands": 0.054660300413767494, "deviation-center-line": 0.17622398297250572, "driven_lanedir_consec": 0.27059756039014715, "sim_compute_sim_state": 0.02501495016945733, "sim_compute_performance-ego": 0.04053062862820096, "sim_compute_robot_state-ego": 0.05264225271013048}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.474575798229941, "sim_physics": 0.0694755849662734, "survival_time": 8.14999999999998, "driven_lanedir": 1.3540975410018796, "sim_render-ego": 0.03704758802074596, "in-drivable-lane": 0, "agent_compute-ego": 0.05020163249384406, "deviation-heading": 2.913686363408195, "set_robot_commands": 0.062292542194296245, "deviation-center-line": 0.4494930723391705, "driven_lanedir_consec": 1.3540975410018796, "sim_compute_sim_state": 0.027258314238004157, "sim_compute_performance-ego": 0.04351236922609294, "sim_compute_robot_state-ego": 0.04809297228152035}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4840847449067072, "sim_physics": 0.07809049617953417, "survival_time": 8.199999999999982, "driven_lanedir": 1.422651809660398, "sim_render-ego": 0.037443646570531335, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.05111038103336241, "deviation-heading": 1.469082108324921, "set_robot_commands": 0.07012814283370972, "deviation-center-line": 0.6257883809066043, "driven_lanedir_consec": 1.422651809660398, "sim_compute_sim_state": 0.029531880122859303, "sim_compute_performance-ego": 0.04395823217019802, "sim_compute_robot_state-ego": 0.04874322181794702}}
set_robot_commands_max0.07012814283370972
set_robot_commands_mean0.060017698846501585
set_robot_commands_median0.056602547840518845
set_robot_commands_min0.054660300413767494
sim_compute_performance-ego_max0.04395823217019802
sim_compute_performance-ego_mean0.041767951899951694
sim_compute_performance-ego_median0.040723572778438334
sim_compute_performance-ego_min0.040114956696828206
sim_compute_robot_state-ego_max0.05264225271013048
sim_compute_robot_state-ego_mean0.047028104482692464
sim_compute_robot_state-ego_median0.04809297228152035
sim_compute_robot_state-ego_min0.04265688180923462
sim_compute_sim_state_max0.029531880122859303
sim_compute_sim_state_mean0.02609199265342942
sim_compute_sim_state_median0.02501495016945733
sim_compute_sim_state_min0.024302876790364584
sim_physics_max0.07809049617953417
sim_physics_mean0.06657025133255606
sim_physics_median0.06376591655943128
sim_physics_min0.05927839756011963
sim_render-ego_max0.03754823774264004
sim_render-ego_mean0.03724270700196346
sim_render-ego_median0.037443646570531335
sim_render-ego_min0.03669107622570462
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.430000000000007
survival_time_min1.800000000000001
No reset possible
233953627Nicky Eichmannaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-73570:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7844848176668209
survival_time_median2.25
deviation-center-line_median0.16432855023302684
in-drivable-lane_median0.6999999999999993


other stats
agent_compute-ego_max0.13314243880185214
agent_compute-ego_mean0.13008323805296065
agent_compute-ego_median0.12929619740748752
agent_compute-ego_min0.12720149471646264
deviation-center-line_max0.4637715822030247
deviation-center-line_mean0.1917409410379035
deviation-center-line_min0.07142240775654032
deviation-heading_max0.750213746231227
deviation-heading_mean0.43110988204604783
deviation-heading_median0.33936691829842386
deviation-heading_min0.19652940452560944
driven_any_max2.21670895586739
driven_any_mean1.2682400059863554
driven_any_median1.014439070190444
driven_any_min0.4560705346067614
driven_lanedir_consec_max2.000812679704868
driven_lanedir_consec_mean0.9553515859426176
driven_lanedir_consec_min0.4345453281728786
driven_lanedir_max2.000812679704868
driven_lanedir_mean0.9553515859426176
driven_lanedir_median0.7844848176668209
driven_lanedir_min0.4345453281728786
in-drivable-lane_max5.049999999999983
in-drivable-lane_mean1.8199999999999936
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0116875356397412, "sim_physics": 0.08910990291171604, "survival_time": 2.25, "driven_lanedir": 0.6697553564194623, "sim_render-ego": 0.0474338796403673, "in-drivable-lane": 0.6999999999999993, "agent_compute-ego": 0.132470703125, "deviation-heading": 0.25835188233260464, "set_robot_commands": 0.07464659478929307, "deviation-center-line": 0.09456974525815567, "driven_lanedir_consec": 0.6697553564194623, "sim_compute_sim_state": 0.030844847361246742, "sim_compute_performance-ego": 0.05286883248223199, "sim_compute_robot_state-ego": 0.05559528668721517}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.014439070190444, "sim_physics": 0.06960235890888032, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8871597477490597, "sim_render-ego": 0.04712452774956113, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.12720149471646264, "deviation-heading": 0.611087458842374, "set_robot_commands": 0.06766458352406819, "deviation-center-line": 0.16432855023302684, "driven_lanedir_consec": 0.8871597477490597, "sim_compute_sim_state": 0.029162037940252395, "sim_compute_performance-ego": 0.048914489291963126, "sim_compute_robot_state-ego": 0.05125523748851958}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.21670895586739, "sim_physics": 0.07666321165242772, "survival_time": 7.84999999999998, "driven_lanedir": 2.000812679704868, "sim_render-ego": 0.045518721744513053, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.1283053562140009, "deviation-heading": 0.750213746231227, "set_robot_commands": 0.07069820811034767, "deviation-center-line": 0.4637715822030247, "driven_lanedir_consec": 2.000812679704868, "sim_compute_sim_state": 0.030574570795533003, "sim_compute_performance-ego": 0.05062306762500933, "sim_compute_robot_state-ego": 0.051720122622836165}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4560705346067614, "sim_physics": 0.09416700493205678, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4345453281728786, "sim_render-ego": 0.04614145105535334, "in-drivable-lane": 0, "agent_compute-ego": 0.13314243880185214, "deviation-heading": 0.33936691829842386, "set_robot_commands": 0.07086128538305109, "deviation-center-line": 0.07142240775654032, "driven_lanedir_consec": 0.4345453281728786, "sim_compute_sim_state": 0.028569297357039017, "sim_compute_performance-ego": 0.05931391499259255, "sim_compute_robot_state-ego": 0.05185069821097634}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6422939336274407, "sim_physics": 0.0732127877249234, "survival_time": 6.8999999999999835, "driven_lanedir": 0.7844848176668209, "sim_render-ego": 0.04768277769503386, "in-drivable-lane": 5.049999999999983, "agent_compute-ego": 0.12929619740748752, "deviation-heading": 0.19652940452560944, "set_robot_commands": 0.07223768165146095, "deviation-center-line": 0.16461241973877003, "driven_lanedir_consec": 0.7844848176668209, "sim_compute_sim_state": 0.03128200510273809, "sim_compute_performance-ego": 0.05093463780223459, "sim_compute_robot_state-ego": 0.053306475929591965}}
set_robot_commands_max0.07464659478929307
set_robot_commands_mean0.07122167069164419
set_robot_commands_median0.07086128538305109
set_robot_commands_min0.06766458352406819
sim_compute_performance-ego_max0.05931391499259255
sim_compute_performance-ego_mean0.05253098843880631
sim_compute_performance-ego_median0.05093463780223459
sim_compute_performance-ego_min0.048914489291963126
sim_compute_robot_state-ego_max0.05559528668721517
sim_compute_robot_state-ego_mean0.052745564187827845
sim_compute_robot_state-ego_median0.05185069821097634
sim_compute_robot_state-ego_min0.05125523748851958
sim_compute_sim_state_max0.03128200510273809
sim_compute_sim_state_mean0.030086551711361847
sim_compute_sim_state_median0.030574570795533003
sim_compute_sim_state_min0.028569297357039017
sim_physics_max0.09416700493205678
sim_physics_mean0.08055105322600084
sim_physics_median0.07666321165242772
sim_physics_min0.06960235890888032
sim_render-ego_max0.04768277769503386
sim_render-ego_mean0.04678027157696574
sim_render-ego_median0.04712452774956113
sim_render-ego_min0.045518721744513053
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean4.039999999999993
survival_time_min1.1000000000000003
No reset possible
233593606Riza Velioglu 🇩🇪aido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-73570:05:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
232943509Bea Baselines 🐤challenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-42-167-73570:10:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible