Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 18587
2864
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-20 08:21:13+00:00 2019-04-20 08:45:19+00:00 0:24:06 Waited 1201 seconds [...] Waited 1201 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18575
2819
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-validation
step1-simulation host-error no idsc-rudolf-114212
2019-04-20 08:15:41+00:00 2019-04-20 08:20:53+00:00 0:05:12 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 691, in run_one
container = client.containers.get(container_id)
File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
resp = self.client.api.inspect_container(container_id)
File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
self._get(self._url("/containers/{0}/json", container)), True
File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/c19b908606c4cfc259d3d9252ab3389da06d36c04db14c833d8edf338425b6aa/json
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18561
2856
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 17:32:39+00:00 2019-04-19 17:44:17+00:00 0:11:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.42685117886480706 survival_time_median 6.799999999999984 deviation-center-line_median 0.14007343777145315 in-drivable-lane_median 0.04999999999999982
other stats agent_compute-ego_max 0.07853861224083673 agent_compute-ego_mean 0.07691414923621237 agent_compute-ego_median 0.07719520479440689 agent_compute-ego_min 0.0745099145312642 deviation-center-line_max 0.2492640454620712 deviation-center-line_mean 0.15688510483650875 deviation-center-line_min 0.09279421907702638 deviation-heading_max 1.6421943468476687 deviation-heading_mean 1.5730795440390124 deviation-heading_median 1.554748338966532 deviation-heading_min 1.5181458141874535 driven_any_max 1.1766862437605816 driven_any_mean 0.6070660332609548 driven_any_median 0.522913922623257 driven_any_min 0.3220181139305358 driven_lanedir_consec_max 0.6204353162090315 driven_lanedir_consec_mean 0.4290942269640001 driven_lanedir_consec_min 0.27181669232095595 driven_lanedir_max 0.6204353162090315 driven_lanedir_mean 0.4290942269640001 driven_lanedir_median 0.42685117886480706 driven_lanedir_min 0.27181669232095595 in-drivable-lane_max 7.7000000000000925 in-drivable-lane_mean 1.690000000000018 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1766862437605816, "sim_physics": 0.014423799514770509, "survival_time": 14.950000000000076, "driven_lanedir": 0.5138716543764477, "sim_render-ego": 0.052058904965718585, "in-drivable-lane": 7.7000000000000925, "agent_compute-ego": 0.07723072767257691, "deviation-heading": 1.5181458141874535, "set_robot_commands": 0.07085735003153483, "deviation-center-line": 0.16636071709519903, "driven_lanedir_consec": 0.5138716543764477, "sim_compute_sim_state": 0.033097922801971436, "sim_compute_performance-ego": 0.05354370911916097, "sim_compute_robot_state-ego": 0.05517455259958903}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3621995745957728, "sim_physics": 0.015607766807079315, "survival_time": 4.799999999999991, "driven_lanedir": 0.3124962930487586, "sim_render-ego": 0.05212897310654322, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.07719520479440689, "deviation-heading": 1.6421943468476687, "set_robot_commands": 0.0718516285220782, "deviation-center-line": 0.14007343777145315, "driven_lanedir_consec": 0.3124962930487586, "sim_compute_sim_state": 0.03397795309623083, "sim_compute_performance-ego": 0.05361577123403549, "sim_compute_robot_state-ego": 0.056169124941031136}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3220181139305358, "sim_physics": 0.016795635223388672, "survival_time": 4.299999999999993, "driven_lanedir": 0.27181669232095595, "sim_render-ego": 0.05101863728013149, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.0745099145312642, "deviation-heading": 1.5420907071975565, "set_robot_commands": 0.07130026262859966, "deviation-center-line": 0.13593310477679407, "driven_lanedir_consec": 0.27181669232095595, "sim_compute_sim_state": 0.03345313183096952, "sim_compute_performance-ego": 0.05478471933409225, "sim_compute_robot_state-ego": 0.056130339932996175}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6515123113946268, "sim_physics": 0.014568273510251726, "survival_time": 8.399999999999984, "driven_lanedir": 0.6204353162090315, "sim_render-ego": 0.05507934377306983, "in-drivable-lane": 0, "agent_compute-ego": 0.07853861224083673, "deviation-heading": 1.6082185129958506, "set_robot_commands": 0.07145356564294725, "deviation-center-line": 0.2492640454620712, "driven_lanedir_consec": 0.6204353162090315, "sim_compute_sim_state": 0.033444990714391075, "sim_compute_performance-ego": 0.05570764910607111, "sim_compute_robot_state-ego": 0.05733821647507804}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.522913922623257, "sim_physics": 0.016679143204408532, "survival_time": 6.799999999999984, "driven_lanedir": 0.42685117886480706, "sim_render-ego": 0.05230497437364915, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.07709628694197711, "deviation-heading": 1.554748338966532, "set_robot_commands": 0.0710224333931418, "deviation-center-line": 0.09279421907702638, "driven_lanedir_consec": 0.42685117886480706, "sim_compute_sim_state": 0.03292193833519431, "sim_compute_performance-ego": 0.053443324916503006, "sim_compute_robot_state-ego": 0.05453439495142769}}set_robot_commands_max 0.0718516285220782 set_robot_commands_mean 0.07129704804366035 set_robot_commands_median 0.07130026262859966 set_robot_commands_min 0.07085735003153483 sim_compute_performance-ego_max 0.05570764910607111 sim_compute_performance-ego_mean 0.05421903474197256 sim_compute_performance-ego_median 0.05361577123403549 sim_compute_performance-ego_min 0.053443324916503006 sim_compute_robot_state-ego_max 0.05733821647507804 sim_compute_robot_state-ego_mean 0.05586932578002442 sim_compute_robot_state-ego_median 0.056130339932996175 sim_compute_robot_state-ego_min 0.05453439495142769 sim_compute_sim_state_max 0.03397795309623083 sim_compute_sim_state_mean 0.03337918735575143 sim_compute_sim_state_median 0.033444990714391075 sim_compute_sim_state_min 0.03292193833519431 sim_physics_max 0.016795635223388672 sim_physics_mean 0.01561492365197975 sim_physics_median 0.015607766807079315 sim_physics_min 0.014423799514770509 sim_render-ego_max 0.05507934377306983 sim_render-ego_mean 0.052518166699822455 sim_render-ego_median 0.05212897310654322 sim_render-ego_min 0.05101863728013149 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.850000000000006 survival_time_min 4.299999999999993
No reset possible 18558
2363
Andrea Censi 🇨🇭random_agent aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 16:27:54+00:00 2019-04-19 16:33:43+00:00 0:05:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.13552136719226837 agent_compute-ego_mean 0.13050419168485844 agent_compute-ego_median 0.1298673947652181 agent_compute-ego_min 0.1283311037456288 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01747381012394743, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06394457817077637, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12882279899885068, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07981120865300016, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.041605764964841446, "sim_compute_performance-ego": 0.06560452029390156, "sim_compute_robot_state-ego": 0.06572000485546184}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016993793574246494, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06028887358578769, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1299782937223261, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07962345535104925, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.039512997323816475, "sim_compute_performance-ego": 0.06391950087113814, "sim_compute_robot_state-ego": 0.06594229286367242}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01739103529188368, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06901810434129503, "in-drivable-lane": 0, "agent_compute-ego": 0.1298673947652181, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07766059769524468, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.044177606370713975, "sim_compute_performance-ego": 0.06540604697333442, "sim_compute_robot_state-ego": 0.06748444769117568}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01824319362640381, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06850217282772064, "in-drivable-lane": 0, "agent_compute-ego": 0.13552136719226837, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08139745891094208, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04284753402074178, "sim_compute_performance-ego": 0.06867842376232147, "sim_compute_robot_state-ego": 0.06848973035812378}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.017962795846602497, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06527833026998184, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1283311037456288, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07823952506570254, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.040736776940962845, "sim_compute_performance-ego": 0.06720360237009385, "sim_compute_robot_state-ego": 0.06637201940312105}}set_robot_commands_max 0.08139745891094208 set_robot_commands_mean 0.07934644913518775 set_robot_commands_median 0.07962345535104925 set_robot_commands_min 0.07766059769524468 sim_compute_performance-ego_max 0.06867842376232147 sim_compute_performance-ego_mean 0.06616241885415788 sim_compute_performance-ego_median 0.06560452029390156 sim_compute_performance-ego_min 0.06391950087113814 sim_compute_robot_state-ego_max 0.06848973035812378 sim_compute_robot_state-ego_mean 0.06680169903431096 sim_compute_robot_state-ego_median 0.06637201940312105 sim_compute_robot_state-ego_min 0.06572000485546184 sim_compute_sim_state_max 0.044177606370713975 sim_compute_sim_state_mean 0.0417761359242153 sim_compute_sim_state_median 0.041605764964841446 sim_compute_sim_state_min 0.039512997323816475 sim_physics_max 0.01824319362640381 sim_physics_mean 0.01761292569261678 sim_physics_median 0.01747381012394743 sim_physics_min 0.016993793574246494 sim_render-ego_max 0.06901810434129503 sim_render-ego_mean 0.0654064118391123 sim_render-ego_median 0.06527833026998184 sim_render-ego_min 0.06028887358578769 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18550
2379
Liam Paull 🇨🇦minimal_agent_python2 (Python 2) aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 16:08:38+00:00 2019-04-19 16:27:28+00:00 0:18:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8244511241236911 survival_time_median 7.499999999999981 deviation-center-line_median 0.047569031980078 in-drivable-lane_median 0.9999999999999964
other stats agent_compute-ego_max 0.056926844914754235 agent_compute-ego_mean 0.05459092864031514 agent_compute-ego_median 0.0542086091621843 agent_compute-ego_min 0.051588853200276695 deviation-center-line_max 0.06628196467609633 deviation-center-line_mean 0.05505403025885901 deviation-center-line_min 0.04756875132822712 deviation-heading_max 0.39021176689361736 deviation-heading_mean 0.37246663720294737 deviation-heading_median 0.39020884946165607 deviation-heading_min 0.3458510169318359 driven_any_max 2.7471689201187193 driven_any_mean 1.8111689201989123 driven_any_median 2.162168920118711 driven_any_min 0.992168920319208 driven_lanedir_consec_max 2.409463474029825 driven_lanedir_consec_mean 1.5156362024376104 driven_lanedir_consec_min 0.6544573089689321 driven_lanedir_max 2.409463474029825 driven_lanedir_mean 1.515636204039579 driven_lanedir_median 1.8244511241236911 driven_lanedir_min 0.6544573089689321 in-drivable-lane_max 1.0000000000000142 in-drivable-lane_mean 0.8800000000000004 in-drivable-lane_min 0.6999999999999975 per-episodes details {"udem1-0-0": {"driven_any": 2.162168920118711, "sim_physics": 0.03093277136484782, "survival_time": 7.499999999999981, "driven_lanedir": 1.929907885087471, "sim_render-ego": 0.06454267183939616, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.056926844914754235, "deviation-heading": 0.3458510169318359, "set_robot_commands": 0.07961683909098308, "deviation-center-line": 0.06628196467609633, "driven_lanedir_consec": 1.9299078770776288, "sim_compute_sim_state": 0.035693278312683104, "sim_compute_performance-ego": 0.06488014062245687, "sim_compute_robot_state-ego": 0.06469016234079997, "sim_compute_robot_state-npc0": 0.07265646775563558, "sim_compute_robot_state-npc1": 0.06747068881988526, "sim_compute_robot_state-npc2": 0.06603604475657145, "sim_compute_robot_state-npc3": 0.06670192718505859}, "udem1-1-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.031850440634621516, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544573089689321, "sim_render-ego": 0.06656506326463488, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.056444399886661105, "deviation-heading": 0.39021176689361736, "set_robot_commands": 0.07845238182279798, "deviation-center-line": 0.047569008894155274, "driven_lanedir_consec": 0.6544573089689321, "sim_compute_sim_state": 0.03699347707960341, "sim_compute_performance-ego": 0.06569548447926839, "sim_compute_robot_state-ego": 0.06547230813238356, "sim_compute_robot_state-npc0": 0.07103267974323696, "sim_compute_robot_state-npc1": 0.06538275877634685, "sim_compute_robot_state-npc2": 0.06575336721208361, "sim_compute_robot_state-npc3": 0.06658787859810723}, "udem1-2-0": {"driven_any": 2.1621689201187144, "sim_physics": 0.03163438638051351, "survival_time": 7.499999999999981, "driven_lanedir": 1.8244511241236911, "sim_render-ego": 0.06452681541442871, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.053785936037699385, "deviation-heading": 0.39020924817202335, "set_robot_commands": 0.07331724961598714, "deviation-center-line": 0.047569031980078, "driven_lanedir_consec": 1.8244511241236911, "sim_compute_sim_state": 0.036604453722635905, "sim_compute_performance-ego": 0.06320244948069255, "sim_compute_robot_state-ego": 0.06366324424743652, "sim_compute_robot_state-npc0": 0.07204496065775554, "sim_compute_robot_state-npc1": 0.0675996987024943, "sim_compute_robot_state-npc2": 0.06704200585683187, "sim_compute_robot_state-npc3": 0.06661564350128174}, "udem1-3-0": {"driven_any": 2.7471689201187193, "sim_physics": 0.03029082313416496, "survival_time": 9.45, "driven_lanedir": 2.409463474029825, "sim_render-ego": 0.06573968589621246, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.0542086091621843, "deviation-heading": 0.39020884946165607, "set_robot_commands": 0.0755232503174474, "deviation-center-line": 0.04756875132822712, "driven_lanedir_consec": 2.409463474029825, "sim_compute_sim_state": 0.03624207002145273, "sim_compute_performance-ego": 0.06405213144090441, "sim_compute_robot_state-ego": 0.06389208823915511, "sim_compute_robot_state-npc0": 0.07112180871307534, "sim_compute_robot_state-npc1": 0.06699334755145683, "sim_compute_robot_state-npc2": 0.0648490966312469, "sim_compute_robot_state-npc3": 0.0648543431014611}, "udem1-4-0": {"driven_any": 0.992168920319208, "sim_physics": 0.029769215318891738, "survival_time": 3.599999999999995, "driven_lanedir": 0.7599012279879753, "sim_render-ego": 0.06265425682067871, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.051588853200276695, "deviation-heading": 0.3458523045556041, "set_robot_commands": 0.0730458398660024, "deviation-center-line": 0.06628139441573833, "driven_lanedir_consec": 0.7599012279879753, "sim_compute_sim_state": 0.033686200777689614, "sim_compute_performance-ego": 0.06209524472554525, "sim_compute_robot_state-ego": 0.061747233072916664, "sim_compute_robot_state-npc0": 0.06569172607527839, "sim_compute_robot_state-npc1": 0.06344865096939935, "sim_compute_robot_state-npc2": 0.06110623810026381, "sim_compute_robot_state-npc3": 0.05970120098855761}}set_robot_commands_max 0.07961683909098308 set_robot_commands_mean 0.07599111214264359 set_robot_commands_median 0.0755232503174474 set_robot_commands_min 0.0730458398660024 sim_compute_performance-ego_max 0.06569548447926839 sim_compute_performance-ego_mean 0.06398509014977348 sim_compute_performance-ego_median 0.06405213144090441 sim_compute_performance-ego_min 0.06209524472554525 sim_compute_robot_state-ego_max 0.06547230813238356 sim_compute_robot_state-ego_mean 0.06389300720653837 sim_compute_robot_state-ego_median 0.06389208823915511 sim_compute_robot_state-ego_min 0.061747233072916664 sim_compute_robot_state-npc0_max 0.07265646775563558 sim_compute_robot_state-npc0_mean 0.07050952858899637 sim_compute_robot_state-npc0_median 0.07112180871307534 sim_compute_robot_state-npc0_min 0.06569172607527839 sim_compute_robot_state-npc1_max 0.0675996987024943 sim_compute_robot_state-npc1_mean 0.06617902896391652 sim_compute_robot_state-npc1_median 0.06699334755145683 sim_compute_robot_state-npc1_min 0.06344865096939935 sim_compute_robot_state-npc2_max 0.06704200585683187 sim_compute_robot_state-npc2_mean 0.06495735051139953 sim_compute_robot_state-npc2_median 0.06575336721208361 sim_compute_robot_state-npc2_min 0.06110623810026381 sim_compute_robot_state-npc3_max 0.06670192718505859 sim_compute_robot_state-npc3_mean 0.06489219867489324 sim_compute_robot_state-npc3_median 0.06658787859810723 sim_compute_robot_state-npc3_min 0.05970120098855761 sim_compute_sim_state_max 0.03699347707960341 sim_compute_sim_state_mean 0.03584389598281295 sim_compute_sim_state_median 0.03624207002145273 sim_compute_sim_state_min 0.033686200777689614 sim_physics_max 0.031850440634621516 sim_physics_mean 0.03089552736660791 sim_physics_median 0.03093277136484782 sim_physics_min 0.029769215318891738 sim_render-ego_max 0.06656506326463488 sim_render-ego_mean 0.06480569864707017 sim_render-ego_median 0.06454267183939616 sim_render-ego_min 0.06265425682067871 simulation-passed 1 survival_time_max 9.45 survival_time_mean 6.32999999999999 survival_time_min 3.599999999999995
No reset possible 18543
2376
Liam Paull 🇨🇦minimal_agent_python2 (Python 2) aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 16:00:18+00:00 2019-04-19 16:08:11+00:00 0:07:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2394590679116675 survival_time_median 5.549999999999988 deviation-center-line_median 0.04756896992501765 in-drivable-lane_median 0.9999999999999964
other stats agent_compute-ego_max 0.05176077232704506 agent_compute-ego_mean 0.05043464526757822 agent_compute-ego_median 0.04974337526269861 agent_compute-ego_min 0.04950830340385437 deviation-center-line_max 0.06628159589691172 deviation-center-line_mean 0.055053867384428454 deviation-center-line_min 0.04756874938348469 deviation-heading_max 0.3902119203851745 deviation-heading_mean 0.3724667982759654 deviation-heading_median 0.39020902164128224 deviation-heading_min 0.34585149487811473 driven_any_max 1.5771689201187185 driven_any_mean 1.343168920198914 driven_any_median 1.5771689201187176 driven_any_min 0.992168920319208 driven_lanedir_consec_max 1.344898529895705 driven_lanedir_consec_mean 1.047634910702065 driven_lanedir_consec_min 0.6544587706938922 driven_lanedir_max 1.344898529895705 driven_lanedir_mean 1.047634910702065 driven_lanedir_median 1.2394590679116675 driven_lanedir_min 0.6544587706938922 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.8799999999999969 in-drivable-lane_min 0.6999999999999975 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.01676718725098504, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.05928186575571696, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.04950830340385437, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.07344375716315375, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.03950537906752692, "sim_compute_performance-ego": 0.06096286906136407, "sim_compute_robot_state-ego": 0.06220048997137281}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.01769623491499159, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.05895577867825826, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.05143002337879605, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.07321055730183919, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.03587742646535238, "sim_compute_performance-ego": 0.05870946579509311, "sim_compute_robot_state-ego": 0.060352222787009344}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.015223758714693086, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.058013606715846704, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.04974337526269861, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.07322242023708585, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.03694111162477785, "sim_compute_performance-ego": 0.057722173295579514, "sim_compute_robot_state-ego": 0.060793754216786976}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.016306662344717764, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.06193033209792129, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05176077232704506, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.0740059839712607, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.038815148241885075, "sim_compute_performance-ego": 0.06303109349431218, "sim_compute_robot_state-ego": 0.06349519995955734}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.016470052100516653, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.05817955893439215, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.04973075196549699, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.0735249003848514, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.037126489587732264, "sim_compute_performance-ego": 0.05995918609000541, "sim_compute_robot_state-ego": 0.061188921198114615}}set_robot_commands_max 0.0740059839712607 set_robot_commands_mean 0.07348152381163817 set_robot_commands_median 0.07344375716315375 set_robot_commands_min 0.07321055730183919 sim_compute_performance-ego_max 0.06303109349431218 sim_compute_performance-ego_mean 0.06007695754727086 sim_compute_performance-ego_median 0.05995918609000541 sim_compute_performance-ego_min 0.057722173295579514 sim_compute_robot_state-ego_max 0.06349519995955734 sim_compute_robot_state-ego_mean 0.06160611762656822 sim_compute_robot_state-ego_median 0.061188921198114615 sim_compute_robot_state-ego_min 0.060352222787009344 sim_compute_sim_state_max 0.03950537906752692 sim_compute_sim_state_mean 0.0376531109974549 sim_compute_sim_state_median 0.037126489587732264 sim_compute_sim_state_min 0.03587742646535238 sim_physics_max 0.01769623491499159 sim_physics_mean 0.016492779065180825 sim_physics_median 0.016470052100516653 sim_physics_min 0.015223758714693086 sim_render-ego_max 0.06193033209792129 sim_render-ego_mean 0.05927222843642708 sim_render-ego_median 0.05895577867825826 sim_render-ego_min 0.058013606715846704 simulation-passed 1 survival_time_max 5.549999999999988 survival_time_mean 4.769999999999992 survival_time_min 3.599999999999995
No reset possible 18539
2383
Andrea Censi 🇨🇭Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 15:55:48+00:00 2019-04-19 15:59:54+00:00 0:04:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0813881555787509 survival_time_median 1.3000000000000005 deviation-center-line_median 0.04899723791823976 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.1985053221384684 agent_compute-ego_mean 0.1861690196474733 agent_compute-ego_median 0.18291869530310997 agent_compute-ego_min 0.1740942276441134 deviation-center-line_max 0.053265535462328914 deviation-center-line_mean 0.04833591268954161 deviation-center-line_min 0.04268117368816949 deviation-heading_max 0.7613157450427347 deviation-heading_mean 0.7281128404542262 deviation-heading_median 0.724000221486315 deviation-heading_min 0.70215805649916 driven_any_max 0.1772284653087431 driven_any_mean 0.14982223998321154 driven_any_median 0.14754973666245252 driven_any_min 0.13265329456751596 driven_lanedir_consec_max 0.11458119071698958 driven_lanedir_consec_mean 0.08373295717636371 driven_lanedir_consec_min 0.06912028294511163 driven_lanedir_max 0.11458119071698958 driven_lanedir_mean 0.08373295717636371 driven_lanedir_median 0.0813881555787509 driven_lanedir_min 0.06912028294511163 in-drivable-lane_max 0.15000000000000013 in-drivable-lane_mean 0.07000000000000006 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14754973666245252, "sim_physics": 0.016841373443603515, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08242112085205555, "sim_render-ego": 0.06165526390075684, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1926716423034668, "deviation-heading": 0.7461923706368625, "set_robot_commands": 0.08140120506286622, "deviation-center-line": 0.052736550831873945, "driven_lanedir_consec": 0.08242112085205555, "sim_compute_sim_state": 0.03988525390625, "sim_compute_performance-ego": 0.06897552490234375, "sim_compute_robot_state-ego": 0.06678389549255372}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1501901436292846, "sim_physics": 0.01824370714334341, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0813881555787509, "sim_render-ego": 0.06717599355257474, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18291869530310997, "deviation-heading": 0.7068978086060583, "set_robot_commands": 0.07827822061685416, "deviation-center-line": 0.04399906554709595, "driven_lanedir_consec": 0.0813881555787509, "sim_compute_sim_state": 0.04564977609194242, "sim_compute_performance-ego": 0.07060012450584999, "sim_compute_robot_state-ego": 0.0711666804093581}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1772284653087431, "sim_physics": 0.015902651680840388, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11458119071698958, "sim_render-ego": 0.06217957426000525, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18265521084820785, "deviation-heading": 0.724000221486315, "set_robot_commands": 0.07649964756435818, "deviation-center-line": 0.053265535462328914, "driven_lanedir_consec": 0.11458119071698958, "sim_compute_sim_state": 0.04141826099819607, "sim_compute_performance-ego": 0.06313837016070331, "sim_compute_robot_state-ego": 0.06566385869626645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14148955974806146, "sim_physics": 0.016678278262798604, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06912028294511163, "sim_render-ego": 0.0630343510554387, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1740942276441134, "deviation-heading": 0.70215805649916, "set_robot_commands": 0.07730847138624924, "deviation-center-line": 0.04268117368816949, "driven_lanedir_consec": 0.06912028294511163, "sim_compute_sim_state": 0.04058021765488845, "sim_compute_performance-ego": 0.06509796472696158, "sim_compute_robot_state-ego": 0.06485603405879094}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13265329456751596, "sim_physics": 0.018687387307484944, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07115403578891089, "sim_render-ego": 0.07874156037966411, "in-drivable-lane": 0, "agent_compute-ego": 0.1985053221384684, "deviation-heading": 0.7613157450427347, "set_robot_commands": 0.07958997289339702, "deviation-center-line": 0.04899723791823976, "driven_lanedir_consec": 0.07115403578891089, "sim_compute_sim_state": 0.04250820477803549, "sim_compute_performance-ego": 0.07210788130760193, "sim_compute_robot_state-ego": 0.06823590397834778}}set_robot_commands_max 0.08140120506286622 set_robot_commands_mean 0.07861550350474497 set_robot_commands_median 0.07827822061685416 set_robot_commands_min 0.07649964756435818 sim_compute_performance-ego_max 0.07210788130760193 sim_compute_performance-ego_mean 0.06798397312069211 sim_compute_performance-ego_median 0.06897552490234375 sim_compute_performance-ego_min 0.06313837016070331 sim_compute_robot_state-ego_max 0.0711666804093581 sim_compute_robot_state-ego_mean 0.0673412745270634 sim_compute_robot_state-ego_median 0.06678389549255372 sim_compute_robot_state-ego_min 0.06485603405879094 sim_compute_sim_state_max 0.04564977609194242 sim_compute_sim_state_mean 0.04200834268586249 sim_compute_sim_state_median 0.04141826099819607 sim_compute_sim_state_min 0.03988525390625 sim_physics_max 0.018687387307484944 sim_physics_mean 0.01727067956761417 sim_physics_median 0.016841373443603515 sim_physics_min 0.015902651680840388 sim_render-ego_max 0.07874156037966411 sim_render-ego_mean 0.06655734862968793 sim_render-ego_median 0.0630343510554387 sim_render-ego_min 0.06165526390075684 simulation-passed 1 survival_time_max 1.3500000000000003 survival_time_mean 1.2800000000000005 survival_time_min 1.2000000000000004
No reset possible 18528
2400
Liam Paull 🇨🇦random_agent aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 15:44:29+00:00 2019-04-19 15:55:23+00:00 0:10:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.12561287778489133 agent_compute-ego_mean 0.11942475392479808 agent_compute-ego_median 0.11823845294214064 agent_compute-ego_min 0.11390089071713962 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03109695419432625, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.056142031200348386, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1179726691473098, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07371448335193452, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03200545386662559, "sim_compute_performance-ego": 0.05615124626765176, "sim_compute_robot_state-ego": 0.05589499170818026, "sim_compute_robot_state-npc0": 0.06106113630627829, "sim_compute_robot_state-npc1": 0.057203557756212026, "sim_compute_robot_state-npc2": 0.0551591676379007, "sim_compute_robot_state-npc3": 0.056943284140692815}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.027002942328359567, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05704873215918448, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.121398879032509, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07333744740953632, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.0319221393734801, "sim_compute_performance-ego": 0.054740466323553345, "sim_compute_robot_state-ego": 0.055656718272788855, "sim_compute_robot_state-npc0": 0.062045803257063326, "sim_compute_robot_state-npc1": 0.05938861416835411, "sim_compute_robot_state-npc2": 0.05732170273275936, "sim_compute_robot_state-npc3": 0.055598179499308266}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03090699257389192, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.055944085121154785, "in-drivable-lane": 0, "agent_compute-ego": 0.11823845294214064, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07704909386173371, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.033639096444652926, "sim_compute_performance-ego": 0.05820870784021193, "sim_compute_robot_state-ego": 0.05838836008502591, "sim_compute_robot_state-npc0": 0.06341328928547521, "sim_compute_robot_state-npc1": 0.05913001875723562, "sim_compute_robot_state-npc2": 0.05686369634443714, "sim_compute_robot_state-npc3": 0.05803879230253158}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.02916080140052958, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06119013339915174, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12561287778489133, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07519499799038501, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03348776634703291, "sim_compute_performance-ego": 0.06089695971062843, "sim_compute_robot_state-ego": 0.060466809475675544, "sim_compute_robot_state-npc0": 0.06787896409947822, "sim_compute_robot_state-npc1": 0.06160161343026668, "sim_compute_robot_state-npc2": 0.06149890828639903, "sim_compute_robot_state-npc3": 0.06035042316355604}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02481682483966534, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.052714833846459024, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11390089071713962, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.0750700831413269, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.030926438478323128, "sim_compute_performance-ego": 0.05377861628165611, "sim_compute_robot_state-ego": 0.05485201798952543, "sim_compute_robot_state-npc0": 0.06205512010134184, "sim_compute_robot_state-npc1": 0.05665824046501747, "sim_compute_robot_state-npc2": 0.05417442321777344, "sim_compute_robot_state-npc3": 0.0556295605806204}}set_robot_commands_max 0.07704909386173371 set_robot_commands_mean 0.0748732211509833 set_robot_commands_median 0.0750700831413269 set_robot_commands_min 0.07333744740953632 sim_compute_performance-ego_max 0.06089695971062843 sim_compute_performance-ego_mean 0.05675519928474031 sim_compute_performance-ego_median 0.05615124626765176 sim_compute_performance-ego_min 0.05377861628165611 sim_compute_robot_state-ego_max 0.060466809475675544 sim_compute_robot_state-ego_mean 0.0570517795062392 sim_compute_robot_state-ego_median 0.05589499170818026 sim_compute_robot_state-ego_min 0.05485201798952543 sim_compute_robot_state-npc0_max 0.06787896409947822 sim_compute_robot_state-npc0_mean 0.06329086260992738 sim_compute_robot_state-npc0_median 0.06205512010134184 sim_compute_robot_state-npc0_min 0.06106113630627829 sim_compute_robot_state-npc1_max 0.06160161343026668 sim_compute_robot_state-npc1_mean 0.058796408915417174 sim_compute_robot_state-npc1_median 0.05913001875723562 sim_compute_robot_state-npc1_min 0.05665824046501747 sim_compute_robot_state-npc2_max 0.06149890828639903 sim_compute_robot_state-npc2_mean 0.05700357964385394 sim_compute_robot_state-npc2_median 0.05686369634443714 sim_compute_robot_state-npc2_min 0.05417442321777344 sim_compute_robot_state-npc3_max 0.06035042316355604 sim_compute_robot_state-npc3_mean 0.05731204793734183 sim_compute_robot_state-npc3_median 0.056943284140692815 sim_compute_robot_state-npc3_min 0.055598179499308266 sim_compute_sim_state_max 0.033639096444652926 sim_compute_sim_state_mean 0.03239617890202293 sim_compute_sim_state_median 0.03200545386662559 sim_compute_sim_state_min 0.030926438478323128 sim_physics_max 0.03109695419432625 sim_physics_mean 0.028596903067354528 sim_physics_median 0.02916080140052958 sim_physics_min 0.02481682483966534 sim_render-ego_max 0.06119013339915174 sim_render-ego_mean 0.05660796314525969 sim_render-ego_median 0.056142031200348386 sim_render-ego_min 0.052714833846459024 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18524
2404
Victor Guerra 🇫🇷Baseline solution using reinforcement learning aido2-LFV-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 15:37:37+00:00 2019-04-19 15:44:17+00:00 0:06:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.06485202865342599 survival_time_median 1.4500000000000006 deviation-center-line_median 0.02963523887974836 in-drivable-lane_median 0.30000000000000027
other stats agent_compute-ego_max 0.2479506810506185 agent_compute-ego_mean 0.22447092702877697 agent_compute-ego_median 0.21976291722264785 agent_compute-ego_min 0.1961698021207537 deviation-center-line_max 0.03813815238254181 deviation-center-line_mean 0.0310067037369914 deviation-center-line_min 0.02511129812524872 deviation-heading_max 0.6900094925244598 deviation-heading_mean 0.6319148917464001 deviation-heading_median 0.6335857891158811 deviation-heading_min 0.5904854041282551 driven_any_max 0.16346704138308235 driven_any_mean 0.15233159513562333 driven_any_median 0.1548081098196519 driven_any_min 0.14339806271466496 driven_lanedir_consec_max 0.0787778050978134 driven_lanedir_consec_mean 0.0646723616703287 driven_lanedir_consec_min 0.052443531119954034 driven_lanedir_max 0.0787778050978134 driven_lanedir_mean 0.0646723616703287 driven_lanedir_median 0.06485202865342599 driven_lanedir_min 0.052443531119954034 in-drivable-lane_max 0.5500000000000005 in-drivable-lane_mean 0.3500000000000003 in-drivable-lane_min 0.20000000000000015 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1548081098196519, "sim_physics": 0.030969731509685516, "survival_time": 1.6000000000000008, "driven_lanedir": 0.052443531119954034, "sim_render-ego": 0.059305161237716675, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.24452386796474457, "deviation-heading": 0.595093433363103, "set_robot_commands": 0.07629844546318054, "deviation-center-line": 0.02511129812524872, "driven_lanedir_consec": 0.052443531119954034, "sim_compute_sim_state": 0.03602518141269684, "sim_compute_performance-ego": 0.05978167802095413, "sim_compute_robot_state-ego": 0.06355892866849899, "sim_compute_robot_state-npc0": 0.06938549876213074, "sim_compute_robot_state-npc1": 0.06280896812677383, "sim_compute_robot_state-npc2": 0.06291831284761429, "sim_compute_robot_state-npc3": 0.06168076395988464}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16346704138308235, "sim_physics": 0.028170466423034668, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07096525612133187, "sim_render-ego": 0.06166820526123047, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.2479506810506185, "deviation-heading": 0.5904854041282551, "set_robot_commands": 0.0802838404973348, "deviation-center-line": 0.02963523887974836, "driven_lanedir_consec": 0.07096525612133187, "sim_compute_sim_state": 0.03698709805806478, "sim_compute_performance-ego": 0.06030364831288656, "sim_compute_robot_state-ego": 0.06479794979095459, "sim_compute_robot_state-npc0": 0.07186060746510824, "sim_compute_robot_state-npc1": 0.06675384839375814, "sim_compute_robot_state-npc2": 0.06410321394602457, "sim_compute_robot_state-npc3": 0.06456393400828044}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15638628510613822, "sim_physics": 0.02639439188200852, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0787778050978134, "sim_render-ego": 0.06411514611079774, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.21976291722264785, "deviation-heading": 0.650400339600302, "set_robot_commands": 0.08098419781388908, "deviation-center-line": 0.03813815238254181, "driven_lanedir_consec": 0.0787778050978134, "sim_compute_sim_state": 0.03523700812767292, "sim_compute_performance-ego": 0.064970378218026, "sim_compute_robot_state-ego": 0.06852741899161503, "sim_compute_robot_state-npc0": 0.0692292410751869, "sim_compute_robot_state-npc1": 0.06301749985793541, "sim_compute_robot_state-npc2": 0.06170418344694992, "sim_compute_robot_state-npc3": 0.06449305600133436}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14359847665457923, "sim_physics": 0.02537292021292227, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06485202865342599, "sim_render-ego": 0.06446448961893718, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.21394736678512008, "deviation-heading": 0.6900094925244598, "set_robot_commands": 0.07622996083012333, "deviation-center-line": 0.03414634785762593, "driven_lanedir_consec": 0.06485202865342599, "sim_compute_sim_state": 0.033116914607860426, "sim_compute_performance-ego": 0.06466630653098777, "sim_compute_robot_state-ego": 0.060833392319855864, "sim_compute_robot_state-npc0": 0.07097921548066316, "sim_compute_robot_state-npc1": 0.06886121961805555, "sim_compute_robot_state-npc2": 0.06605716987892434, "sim_compute_robot_state-npc3": 0.06064183623702438}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14339806271466496, "sim_physics": 0.02320232561656407, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05632318735911823, "sim_render-ego": 0.06000455788203648, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.1961698021207537, "deviation-heading": 0.6335857891158811, "set_robot_commands": 0.07381269761494227, "deviation-center-line": 0.0280024814397922, "driven_lanedir_consec": 0.05632318735911823, "sim_compute_sim_state": 0.03442143542425973, "sim_compute_performance-ego": 0.05984974758965629, "sim_compute_robot_state-ego": 0.06139467443738665, "sim_compute_robot_state-npc0": 0.0665048701422555, "sim_compute_robot_state-npc1": 0.061818446431841166, "sim_compute_robot_state-npc2": 0.06147899797984532, "sim_compute_robot_state-npc3": 0.06200652463095529}}set_robot_commands_max 0.08098419781388908 set_robot_commands_mean 0.07752182844389399 set_robot_commands_median 0.07629844546318054 set_robot_commands_min 0.07381269761494227 sim_compute_performance-ego_max 0.064970378218026 sim_compute_performance-ego_mean 0.061914351734502146 sim_compute_performance-ego_median 0.06030364831288656 sim_compute_performance-ego_min 0.05978167802095413 sim_compute_robot_state-ego_max 0.06852741899161503 sim_compute_robot_state-ego_mean 0.06382247284166223 sim_compute_robot_state-ego_median 0.06355892866849899 sim_compute_robot_state-ego_min 0.060833392319855864 sim_compute_robot_state-npc0_max 0.07186060746510824 sim_compute_robot_state-npc0_mean 0.06959188658506892 sim_compute_robot_state-npc0_median 0.06938549876213074 sim_compute_robot_state-npc0_min 0.0665048701422555 sim_compute_robot_state-npc1_max 0.06886121961805555 sim_compute_robot_state-npc1_mean 0.06465199648567282 sim_compute_robot_state-npc1_median 0.06301749985793541 sim_compute_robot_state-npc1_min 0.061818446431841166 sim_compute_robot_state-npc2_max 0.06605716987892434 sim_compute_robot_state-npc2_mean 0.06325237561987168 sim_compute_robot_state-npc2_median 0.06291831284761429 sim_compute_robot_state-npc2_min 0.06147899797984532 sim_compute_robot_state-npc3_max 0.06456393400828044 sim_compute_robot_state-npc3_mean 0.06267722296749581 sim_compute_robot_state-npc3_median 0.06200652463095529 sim_compute_robot_state-npc3_min 0.06064183623702438 sim_compute_sim_state_max 0.03698709805806478 sim_compute_sim_state_mean 0.03515752752611094 sim_compute_sim_state_median 0.03523700812767292 sim_compute_sim_state_min 0.033116914607860426 sim_physics_max 0.030969731509685516 sim_physics_mean 0.026821967128843004 sim_physics_median 0.02639439188200852 sim_physics_min 0.02320232561656407 sim_render-ego_max 0.06446448961893718 sim_render-ego_mean 0.06191151202214371 sim_render-ego_median 0.06166820526123047 sim_render-ego_min 0.059305161237716675 simulation-passed 1 survival_time_max 1.6000000000000008 survival_time_mean 1.4600000000000006 survival_time_min 1.3500000000000003
No reset possible 18522
2405
Victor Guerra 🇫🇷Baseline solution using reinforcement learning aido2-LFV-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 15:30:37+00:00 2019-04-19 15:37:02+00:00 0:06:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.08267470755164552 survival_time_median 1.3000000000000005 deviation-center-line_median 0.0365470785615907 in-drivable-lane_median 0.20000000000000015
other stats agent_compute-ego_max 0.31004305069263166 agent_compute-ego_mean 0.2605272414319606 agent_compute-ego_median 0.2509337266286214 agent_compute-ego_min 0.22784327638560328 deviation-center-line_max 0.04713807138024509 deviation-center-line_mean 0.03870463451197134 deviation-center-line_min 0.03393264698839998 deviation-heading_max 0.6907390418164763 deviation-heading_mean 0.62788354892278 deviation-heading_median 0.6164868201689842 deviation-heading_min 0.5665733266392889 driven_any_max 0.17063380379692078 driven_any_mean 0.15582598968344294 driven_any_median 0.15578986801057312 driven_any_min 0.14129087206209878 driven_lanedir_consec_max 0.08631906166356051 driven_lanedir_consec_mean 0.0813535546034492 driven_lanedir_consec_min 0.07329457971220288 driven_lanedir_max 0.08631906166356051 driven_lanedir_mean 0.0813535546034492 driven_lanedir_median 0.08267470755164552 driven_lanedir_min 0.07329457971220288 in-drivable-lane_max 0.4000000000000003 in-drivable-lane_mean 0.20000000000000015 in-drivable-lane_min 0.10000000000000007 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14129087206209878, "sim_physics": 0.027046809593836468, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07329457971220288, "sim_render-ego": 0.06208088000615438, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.2509337266286214, "deviation-heading": 0.6580407529178192, "set_robot_commands": 0.07534779111544292, "deviation-center-line": 0.03970015034940435, "driven_lanedir_consec": 0.07329457971220288, "sim_compute_sim_state": 0.0369952122370402, "sim_compute_performance-ego": 0.06661885976791382, "sim_compute_robot_state-ego": 0.06620422005653381, "sim_compute_robot_state-npc0": 0.06743531425793965, "sim_compute_robot_state-npc1": 0.06544883052508037, "sim_compute_robot_state-npc2": 0.06483879685401917, "sim_compute_robot_state-npc3": 0.06289248665173848}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15786168074589163, "sim_physics": 0.025684109100928672, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08168885956551897, "sim_render-ego": 0.06661235369168796, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.31004305069263166, "deviation-heading": 0.6075778030713312, "set_robot_commands": 0.07339966297149658, "deviation-center-line": 0.0365470785615907, "driven_lanedir_consec": 0.08168885956551897, "sim_compute_sim_state": 0.03831482850588285, "sim_compute_performance-ego": 0.06234304721538837, "sim_compute_robot_state-ego": 0.06326962434328519, "sim_compute_robot_state-npc0": 0.06569715646597055, "sim_compute_robot_state-npc1": 0.06616795063018799, "sim_compute_robot_state-npc2": 0.06465272720043476, "sim_compute_robot_state-npc3": 0.06683021325331467}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15355372380173035, "sim_physics": 0.02682774543762207, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08631906166356051, "sim_render-ego": 0.05499460220336914, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.27941676139831545, "deviation-heading": 0.6907390418164763, "set_robot_commands": 0.07448596000671387, "deviation-center-line": 0.04713807138024509, "driven_lanedir_consec": 0.08631906166356051, "sim_compute_sim_state": 0.03400591850280762, "sim_compute_performance-ego": 0.06637957572937012, "sim_compute_robot_state-ego": 0.06101593971252441, "sim_compute_robot_state-npc0": 0.06038400650024414, "sim_compute_robot_state-npc1": 0.06333589553833008, "sim_compute_robot_state-npc2": 0.06421739578247071, "sim_compute_robot_state-npc3": 0.06416439056396485}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15578986801057312, "sim_physics": 0.02879608594454252, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0827905645243181, "sim_render-ego": 0.0660153994193444, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.23439939205463117, "deviation-heading": 0.6164868201689842, "set_robot_commands": 0.07777990744664119, "deviation-center-line": 0.03620522528021659, "driven_lanedir_consec": 0.0827905645243181, "sim_compute_sim_state": 0.03666016688713661, "sim_compute_performance-ego": 0.06283208040090707, "sim_compute_robot_state-ego": 0.06670491512005146, "sim_compute_robot_state-npc0": 0.07793514545147236, "sim_compute_robot_state-npc1": 0.06735334029564491, "sim_compute_robot_state-npc2": 0.06582281222710243, "sim_compute_robot_state-npc3": 0.0677118576489962}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17063380379692078, "sim_physics": 0.024951277108028014, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08267470755164552, "sim_render-ego": 0.06344694104687922, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.22784327638560328, "deviation-heading": 0.5665733266392889, "set_robot_commands": 0.08056657889793659, "deviation-center-line": 0.03393264698839998, "driven_lanedir_consec": 0.08267470755164552, "sim_compute_sim_state": 0.0375921972866716, "sim_compute_performance-ego": 0.06664044281532025, "sim_compute_robot_state-ego": 0.06765410817902663, "sim_compute_robot_state-npc0": 0.07225821758138723, "sim_compute_robot_state-npc1": 0.06663573199305041, "sim_compute_robot_state-npc2": 0.06655477655344996, "sim_compute_robot_state-npc3": 0.06733207044930294}}set_robot_commands_max 0.08056657889793659 set_robot_commands_mean 0.07631598008764624 set_robot_commands_median 0.07534779111544292 set_robot_commands_min 0.07339966297149658 sim_compute_performance-ego_max 0.06664044281532025 sim_compute_performance-ego_mean 0.06496280118577993 sim_compute_performance-ego_median 0.06637957572937012 sim_compute_performance-ego_min 0.06234304721538837 sim_compute_robot_state-ego_max 0.06765410817902663 sim_compute_robot_state-ego_mean 0.06496976148228431 sim_compute_robot_state-ego_median 0.06620422005653381 sim_compute_robot_state-ego_min 0.06101593971252441 sim_compute_robot_state-npc0_max 0.07793514545147236 sim_compute_robot_state-npc0_mean 0.06874196805140279 sim_compute_robot_state-npc0_median 0.06743531425793965 sim_compute_robot_state-npc0_min 0.06038400650024414 sim_compute_robot_state-npc1_max 0.06735334029564491 sim_compute_robot_state-npc1_mean 0.06578834979645876 sim_compute_robot_state-npc1_median 0.06616795063018799 sim_compute_robot_state-npc1_min 0.06333589553833008 sim_compute_robot_state-npc2_max 0.06655477655344996 sim_compute_robot_state-npc2_mean 0.06521730172349541 sim_compute_robot_state-npc2_median 0.06483879685401917 sim_compute_robot_state-npc2_min 0.06421739578247071 sim_compute_robot_state-npc3_max 0.0677118576489962 sim_compute_robot_state-npc3_mean 0.06578620371346343 sim_compute_robot_state-npc3_median 0.06683021325331467 sim_compute_robot_state-npc3_min 0.06289248665173848 sim_compute_sim_state_max 0.03831482850588285 sim_compute_sim_state_mean 0.03671366468390778 sim_compute_sim_state_median 0.0369952122370402 sim_compute_sim_state_min 0.03400591850280762 sim_physics_max 0.02879608594454252 sim_physics_mean 0.02666120543699155 sim_physics_median 0.02682774543762207 sim_physics_min 0.024951277108028014 sim_render-ego_max 0.06661235369168796 sim_render-ego_mean 0.06263003527348701 sim_render-ego_median 0.06344694104687922 sim_render-ego_min 0.05499460220336914 simulation-passed 1 survival_time_max 1.4500000000000006 survival_time_mean 1.3000000000000005 survival_time_min 1.2000000000000004
No reset possible 18510
2424
Andrea Censi 🇨🇭random_agent aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 15:18:31+00:00 2019-04-19 15:30:18+00:00 0:11:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.13731209014324433 agent_compute-ego_mean 0.13162844750489372 agent_compute-ego_median 0.12996456202338724 agent_compute-ego_min 0.12574050918458 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.0321436533852229, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06441194670540946, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12574050918458, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07661965158250597, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.036683298292614165, "sim_compute_performance-ego": 0.06182886683751666, "sim_compute_robot_state-ego": 0.06127043375893245, "sim_compute_robot_state-npc0": 0.0703668783581446, "sim_compute_robot_state-npc1": 0.06266448611304873, "sim_compute_robot_state-npc2": 0.06125240855746799, "sim_compute_robot_state-npc3": 0.06220680191403344}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.02944624657724418, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06438433422761805, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.12996456202338724, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0774535992566277, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.035954737195781634, "sim_compute_performance-ego": 0.06209753073898016, "sim_compute_robot_state-ego": 0.06231007856481215, "sim_compute_robot_state-npc0": 0.07359127904854569, "sim_compute_robot_state-npc1": 0.06786087915009144, "sim_compute_robot_state-npc2": 0.06539392938800886, "sim_compute_robot_state-npc3": 0.06264086330638212}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.033256842244055965, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.0667629434216407, "in-drivable-lane": 0, "agent_compute-ego": 0.12888124681288196, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07874074289875646, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03748051966390302, "sim_compute_performance-ego": 0.06316426107960363, "sim_compute_robot_state-ego": 0.06342184543609619, "sim_compute_robot_state-npc0": 0.07033035832066689, "sim_compute_robot_state-npc1": 0.06516513901372109, "sim_compute_robot_state-npc2": 0.06632348798936413, "sim_compute_robot_state-npc3": 0.0660355321822628}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03302461542981736, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06817680724123691, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13731209014324433, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.0793487290118603, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03899911870347693, "sim_compute_performance-ego": 0.06546408572095505, "sim_compute_robot_state-ego": 0.06448414985169755, "sim_compute_robot_state-npc0": 0.07269581581683869, "sim_compute_robot_state-npc1": 0.0680878238475069, "sim_compute_robot_state-npc2": 0.06667499592963685, "sim_compute_robot_state-npc3": 0.06766782162037302}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02867277768942026, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06586185326943031, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13624382936037505, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07815270240490253, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03653886226507334, "sim_compute_performance-ego": 0.06555921756304227, "sim_compute_robot_state-ego": 0.06675148468751174, "sim_compute_robot_state-npc0": 0.0727841303898738, "sim_compute_robot_state-npc1": 0.06565741850779606, "sim_compute_robot_state-npc2": 0.06581090963803805, "sim_compute_robot_state-npc3": 0.06627073654761681}}set_robot_commands_max 0.0793487290118603 set_robot_commands_mean 0.0780630850309306 set_robot_commands_median 0.07815270240490253 set_robot_commands_min 0.07661965158250597 sim_compute_performance-ego_max 0.06555921756304227 sim_compute_performance-ego_mean 0.06362279238801956 sim_compute_performance-ego_median 0.06316426107960363 sim_compute_performance-ego_min 0.06182886683751666 sim_compute_robot_state-ego_max 0.06675148468751174 sim_compute_robot_state-ego_mean 0.06364759845981002 sim_compute_robot_state-ego_median 0.06342184543609619 sim_compute_robot_state-ego_min 0.06127043375893245 sim_compute_robot_state-npc0_max 0.07359127904854569 sim_compute_robot_state-npc0_mean 0.07195369238681394 sim_compute_robot_state-npc0_median 0.07269581581683869 sim_compute_robot_state-npc0_min 0.07033035832066689 sim_compute_robot_state-npc1_max 0.0680878238475069 sim_compute_robot_state-npc1_mean 0.06588714932643285 sim_compute_robot_state-npc1_median 0.06565741850779606 sim_compute_robot_state-npc1_min 0.06266448611304873 sim_compute_robot_state-npc2_max 0.06667499592963685 sim_compute_robot_state-npc2_mean 0.06509114630050318 sim_compute_robot_state-npc2_median 0.06581090963803805 sim_compute_robot_state-npc2_min 0.06125240855746799 sim_compute_robot_state-npc3_max 0.06766782162037302 sim_compute_robot_state-npc3_mean 0.06496435111413364 sim_compute_robot_state-npc3_median 0.0660355321822628 sim_compute_robot_state-npc3_min 0.06220680191403344 sim_compute_sim_state_max 0.03899911870347693 sim_compute_sim_state_mean 0.03713130722416981 sim_compute_sim_state_median 0.036683298292614165 sim_compute_sim_state_min 0.035954737195781634 sim_physics_max 0.033256842244055965 sim_physics_mean 0.03130882706515213 sim_physics_median 0.0321436533852229 sim_physics_min 0.02867277768942026 sim_render-ego_max 0.06817680724123691 sim_render-ego_mean 0.06591957697306709 sim_render-ego_median 0.06586185326943031 sim_render-ego_min 0.06438433422761805 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18506
2432
Andrea Censi 🇨🇭random_agent aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 15:17:34+00:00 2019-04-19 15:18:12+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 2.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18493
2446
Nicky Eichmann Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 14:56:15+00:00 2019-04-19 15:17:29+00:00 0:21:14 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18473
2475
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 14:44:46+00:00 2019-04-19 14:55:55+00:00 0:11:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.1467704503766952 agent_compute-ego_mean 0.1403329956452316 agent_compute-ego_median 0.13866497599889363 agent_compute-ego_min 0.136997148102405 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.030818916502453032, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05936212388295976, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13866497599889363, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07379205643184601, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.030392885208129883, "sim_compute_performance-ego": 0.0601015015253945, "sim_compute_robot_state-ego": 0.060388568847898456, "sim_compute_robot_state-npc0": 0.06305755130828374, "sim_compute_robot_state-npc1": 0.05906723037598625, "sim_compute_robot_state-npc2": 0.056019135883876255, "sim_compute_robot_state-npc3": 0.05641355211772616}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.02759213541068283, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.058134939156326594, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.136997148102405, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07581690245983648, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.033632208319271314, "sim_compute_performance-ego": 0.05937714202731263, "sim_compute_robot_state-ego": 0.05968275257185394, "sim_compute_robot_state-npc0": 0.06506757642708573, "sim_compute_robot_state-npc1": 0.06231847931356991, "sim_compute_robot_state-npc2": 0.06000904475941377, "sim_compute_robot_state-npc3": 0.05989561828912473}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03158198633501606, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05930808667213686, "in-drivable-lane": 0, "agent_compute-ego": 0.1467704503766952, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.08016305200515254, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03429162886834914, "sim_compute_performance-ego": 0.05824100971221924, "sim_compute_robot_state-ego": 0.060795833987574426, "sim_compute_robot_state-npc0": 0.06490488975278792, "sim_compute_robot_state-npc1": 0.06171787169671828, "sim_compute_robot_state-npc2": 0.060983592464077856, "sim_compute_robot_state-npc3": 0.059375159202083465}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.029152548059504083, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05845399866712854, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1377278363451045, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07467387838566557, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03373243200018051, "sim_compute_performance-ego": 0.05938926909832244, "sim_compute_robot_state-ego": 0.058927203746552165, "sim_compute_robot_state-npc0": 0.064127523848351, "sim_compute_robot_state-npc1": 0.059126793070042385, "sim_compute_robot_state-npc2": 0.05903339639623115, "sim_compute_robot_state-npc3": 0.05952688988218916}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027274104265066292, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.058334098412440374, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14150456740305975, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07590735875643216, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03351261065556453, "sim_compute_performance-ego": 0.05912278707210834, "sim_compute_robot_state-ego": 0.06027877330780029, "sim_compute_robot_state-npc0": 0.0666505006643442, "sim_compute_robot_state-npc1": 0.06135860314736, "sim_compute_robot_state-npc2": 0.060708004694718584, "sim_compute_robot_state-npc3": 0.060863013450916}}set_robot_commands_max 0.08016305200515254 set_robot_commands_mean 0.07607064960778656 set_robot_commands_median 0.07581690245983648 set_robot_commands_min 0.07379205643184601 sim_compute_performance-ego_max 0.0601015015253945 sim_compute_performance-ego_mean 0.05924634188707143 sim_compute_performance-ego_median 0.05937714202731263 sim_compute_performance-ego_min 0.05824100971221924 sim_compute_robot_state-ego_max 0.060795833987574426 sim_compute_robot_state-ego_mean 0.060014626492335854 sim_compute_robot_state-ego_median 0.06027877330780029 sim_compute_robot_state-ego_min 0.058927203746552165 sim_compute_robot_state-npc0_max 0.0666505006643442 sim_compute_robot_state-npc0_mean 0.06476160840017052 sim_compute_robot_state-npc0_median 0.06490488975278792 sim_compute_robot_state-npc0_min 0.06305755130828374 sim_compute_robot_state-npc1_max 0.06231847931356991 sim_compute_robot_state-npc1_mean 0.060717795520735376 sim_compute_robot_state-npc1_median 0.06135860314736 sim_compute_robot_state-npc1_min 0.05906723037598625 sim_compute_robot_state-npc2_max 0.060983592464077856 sim_compute_robot_state-npc2_mean 0.05935063483966352 sim_compute_robot_state-npc2_median 0.06000904475941377 sim_compute_robot_state-npc2_min 0.056019135883876255 sim_compute_robot_state-npc3_max 0.060863013450916 sim_compute_robot_state-npc3_mean 0.0592148465884079 sim_compute_robot_state-npc3_median 0.05952688988218916 sim_compute_robot_state-npc3_min 0.05641355211772616 sim_compute_sim_state_max 0.03429162886834914 sim_compute_sim_state_mean 0.03311235301029908 sim_compute_sim_state_median 0.033632208319271314 sim_compute_sim_state_min 0.030392885208129883 sim_physics_max 0.03158198633501606 sim_physics_mean 0.02928393811454446 sim_physics_median 0.029152548059504083 sim_physics_min 0.027274104265066292 sim_render-ego_max 0.05936212388295976 sim_render-ego_mean 0.05871864935819843 sim_render-ego_median 0.05845399866712854 sim_render-ego_min 0.058134939156326594 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18464
2492
Liam Paull 🇨🇦challenge-aido_LF-template-pytorch aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 14:39:49+00:00 2019-04-19 14:44:20+00:00 0:04:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.05639559077937162 survival_time_median 1.5500000000000007 deviation-center-line_median 0.02999814968608772 in-drivable-lane_median 0.4500000000000004
other stats agent_compute-ego_max 0.2622252741167622 agent_compute-ego_mean 0.2212059878078128 agent_compute-ego_median 0.21933828194936117 agent_compute-ego_min 0.19155355422727524 deviation-center-line_max 0.03500250236017804 deviation-center-line_mean 0.02809768247204366 deviation-center-line_min 0.017595176641849727 deviation-heading_max 0.642478475226024 deviation-heading_mean 0.6126238102514218 deviation-heading_median 0.6251655738915183 deviation-heading_min 0.5583709971438596 driven_any_max 0.1778292472625558 driven_any_mean 0.16101417364818857 driven_any_median 0.16105649361952373 driven_any_min 0.14770946924507936 driven_lanedir_consec_max 0.08012411107224748 driven_lanedir_consec_mean 0.0615502726991791 driven_lanedir_consec_min 0.04714473077300907 driven_lanedir_max 0.08012411107224748 driven_lanedir_mean 0.0615502726991791 driven_lanedir_median 0.05639559077937162 driven_lanedir_min 0.04714473077300907 in-drivable-lane_max 0.5500000000000005 in-drivable-lane_mean 0.4400000000000004 in-drivable-lane_min 0.30000000000000027 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15009467495331386, "sim_physics": 0.015407369982811713, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04714473077300907, "sim_render-ego": 0.05901989629191737, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.2622252741167622, "deviation-heading": 0.5583709971438596, "set_robot_commands": 0.07701619978873961, "deviation-center-line": 0.017595176641849727, "driven_lanedir_consec": 0.04714473077300907, "sim_compute_sim_state": 0.03295213945450321, "sim_compute_performance-ego": 0.055495500564575195, "sim_compute_robot_state-ego": 0.05621321739688996}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16105649361952373, "sim_physics": 0.016181421279907227, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05639559077937162, "sim_render-ego": 0.05966201623280843, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.21933828194936117, "deviation-heading": 0.6251655738915183, "set_robot_commands": 0.07585726579030355, "deviation-center-line": 0.02999814968608772, "driven_lanedir_consec": 0.05639559077937162, "sim_compute_sim_state": 0.038618063926696776, "sim_compute_performance-ego": 0.0647841215133667, "sim_compute_robot_state-ego": 0.06896401246388753}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1778292472625558, "sim_physics": 0.01621292531490326, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08012411107224748, "sim_render-ego": 0.06498099118471146, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.22445601224899292, "deviation-heading": 0.642478475226024, "set_robot_commands": 0.07621008157730103, "deviation-center-line": 0.03500250236017804, "driven_lanedir_consec": 0.08012411107224748, "sim_compute_sim_state": 0.040636323392391205, "sim_compute_performance-ego": 0.06509605795145035, "sim_compute_robot_state-ego": 0.0653851181268692}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14770946924507936, "sim_physics": 0.01655445275483308, "survival_time": 1.3500000000000003, "driven_lanedir": 0.054743350486478715, "sim_render-ego": 0.0677653330343741, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.20845681649667244, "deviation-heading": 0.6270965001323948, "set_robot_commands": 0.07811671716195566, "deviation-center-line": 0.027513486899294483, "driven_lanedir_consec": 0.054743350486478715, "sim_compute_sim_state": 0.04243891327469437, "sim_compute_performance-ego": 0.06782392219260887, "sim_compute_robot_state-ego": 0.06781433246753833}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16838098316047012, "sim_physics": 0.015303450246011057, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0693435803847886, "sim_render-ego": 0.06538578002683577, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.19155355422727524, "deviation-heading": 0.6100075048633121, "set_robot_commands": 0.07688598478994062, "deviation-center-line": 0.030379096772808343, "driven_lanedir_consec": 0.0693435803847886, "sim_compute_sim_state": 0.03820653115549395, "sim_compute_performance-ego": 0.06376850989557081, "sim_compute_robot_state-ego": 0.061979563005508914}}set_robot_commands_max 0.07811671716195566 set_robot_commands_mean 0.07681724982164809 set_robot_commands_median 0.07688598478994062 set_robot_commands_min 0.07585726579030355 sim_compute_performance-ego_max 0.06782392219260887 sim_compute_performance-ego_mean 0.06339362242351439 sim_compute_performance-ego_median 0.0647841215133667 sim_compute_performance-ego_min 0.055495500564575195 sim_compute_robot_state-ego_max 0.06896401246388753 sim_compute_robot_state-ego_mean 0.06407124869213879 sim_compute_robot_state-ego_median 0.0653851181268692 sim_compute_robot_state-ego_min 0.05621321739688996 sim_compute_sim_state_max 0.04243891327469437 sim_compute_sim_state_mean 0.0385703942407559 sim_compute_sim_state_median 0.038618063926696776 sim_compute_sim_state_min 0.03295213945450321 sim_physics_max 0.01655445275483308 sim_physics_mean 0.015931923915693265 sim_physics_median 0.016181421279907227 sim_physics_min 0.015303450246011057 sim_render-ego_max 0.0677653330343741 sim_render-ego_mean 0.06336280335412942 sim_render-ego_median 0.06498099118471146 sim_render-ego_min 0.05901989629191737 simulation-passed 1 survival_time_max 1.6000000000000008 survival_time_mean 1.510000000000001 survival_time_min 1.3500000000000003
No reset possible 18454
2505
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-114212
2019-04-19 14:38:34+00:00 2019-04-19 14:39:15+00:00 0:00:41 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18449
2510
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 14:37:29+00:00 2019-04-19 14:38:07+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18445
2520
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 14:36:44+00:00 2019-04-19 14:37:22+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18438
2529
Liam Paull 🇨🇦baseline-IL-sim-tensorflow aido2-LF-sim-validation
step1-simulation error no idsc-rudolf-114212
2019-04-19 14:35:52+00:00 2019-04-19 14:36:30+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18433
2536
Liam Paull 🇨🇦baseline-IL-sim-tensorflow aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 14:35:00+00:00 2019-04-19 14:35:38+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18428
2541
jiang peng test for ppo aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 14:34:04+00:00 2019-04-19 14:34:42+00:00 0:00:38 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18418
2552
Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 14:24:17+00:00 2019-04-19 14:33:58+00:00 0:09:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487132829419987 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041400208354252 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07041067826120477 agent_compute-ego_mean 0.06771363670710563 agent_compute-ego_median 0.06689064095659954 agent_compute-ego_min 0.0651245300586407 deviation-center-line_max 0.1279102488429998 deviation-center-line_mean 0.10518151035257096 deviation-center-line_min 0.06917270915638028 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550057 deviation-heading_median 0.36368201628851926 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903464 driven_any_median 0.6642785413159032 driven_any_min 0.3059207793076613 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.588039443394122 driven_lanedir_consec_min 0.28022225990343186 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.588039443394122 driven_lanedir_median 0.5487132829419987 driven_lanedir_min 0.28022225990343186 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02755953335180515, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06599554492206108, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06689064095659954, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07791612206435786, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.037065235579886086, "sim_compute_performance-ego": 0.06552193804485042, "sim_compute_robot_state-ego": 0.0646570804642468, "sim_compute_robot_state-npc0": 0.07038285092609685, "sim_compute_robot_state-npc1": 0.06621604721720625, "sim_compute_robot_state-npc2": 0.06640958204502012, "sim_compute_robot_state-npc3": 0.06513138515193288}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.02646172046661377, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06597981086144081, "in-drivable-lane": 0, "agent_compute-ego": 0.06999974984389085, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.08010271879342887, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03659883829263541, "sim_compute_performance-ego": 0.06212019003354586, "sim_compute_robot_state-ego": 0.06088703412276048, "sim_compute_robot_state-npc0": 0.06936374994424674, "sim_compute_robot_state-npc1": 0.06493341005765475, "sim_compute_robot_state-npc2": 0.06569828436924861, "sim_compute_robot_state-npc3": 0.06493548246530387}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.026991991286582136, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.06226275322285104, "in-drivable-lane": 0, "agent_compute-ego": 0.0661425844151923, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0739685576012794, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03796380124193557, "sim_compute_performance-ego": 0.0623947965337875, "sim_compute_robot_state-ego": 0.06315459596349839, "sim_compute_robot_state-npc0": 0.0707944301848716, "sim_compute_robot_state-npc1": 0.06484434452462703, "sim_compute_robot_state-npc2": 0.06324546895128616, "sim_compute_robot_state-npc3": 0.06285725755894438}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.026236958556122833, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.062436237440004455, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0651245300586407, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07550854211325174, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.035091326786921576, "sim_compute_performance-ego": 0.06195441445151528, "sim_compute_robot_state-ego": 0.060407287471897, "sim_compute_robot_state-npc0": 0.06854629778600001, "sim_compute_robot_state-npc1": 0.06334531176221239, "sim_compute_robot_state-npc2": 0.06346860036745176, "sim_compute_robot_state-npc3": 0.06326070198645958}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.024119006960015548, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.06165526415172376, "in-drivable-lane": 0, "agent_compute-ego": 0.07041067826120477, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07822753881153308, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03555309772491455, "sim_compute_performance-ego": 0.060882078973870525, "sim_compute_robot_state-ego": 0.06108855573754562, "sim_compute_robot_state-npc0": 0.0678551385277196, "sim_compute_robot_state-npc1": 0.06198142704210783, "sim_compute_robot_state-npc2": 0.06321090773532265, "sim_compute_robot_state-npc3": 0.06401132282457854}}set_robot_commands_max 0.08010271879342887 set_robot_commands_mean 0.0771446958767702 set_robot_commands_median 0.07791612206435786 set_robot_commands_min 0.0739685576012794 sim_compute_performance-ego_max 0.06552193804485042 sim_compute_performance-ego_mean 0.06257468360751392 sim_compute_performance-ego_median 0.06212019003354586 sim_compute_performance-ego_min 0.060882078973870525 sim_compute_robot_state-ego_max 0.0646570804642468 sim_compute_robot_state-ego_mean 0.06203891075198966 sim_compute_robot_state-ego_median 0.06108855573754562 sim_compute_robot_state-ego_min 0.060407287471897 sim_compute_robot_state-npc0_max 0.0707944301848716 sim_compute_robot_state-npc0_mean 0.06938849347378695 sim_compute_robot_state-npc0_median 0.06936374994424674 sim_compute_robot_state-npc0_min 0.0678551385277196 sim_compute_robot_state-npc1_max 0.06621604721720625 sim_compute_robot_state-npc1_mean 0.06426410812076165 sim_compute_robot_state-npc1_median 0.06484434452462703 sim_compute_robot_state-npc1_min 0.06198142704210783 sim_compute_robot_state-npc2_max 0.06640958204502012 sim_compute_robot_state-npc2_mean 0.06440656869366586 sim_compute_robot_state-npc2_median 0.06346860036745176 sim_compute_robot_state-npc2_min 0.06321090773532265 sim_compute_robot_state-npc3_max 0.06513138515193288 sim_compute_robot_state-npc3_mean 0.06403922999744385 sim_compute_robot_state-npc3_median 0.06401132282457854 sim_compute_robot_state-npc3_min 0.06285725755894438 sim_compute_sim_state_max 0.03796380124193557 sim_compute_sim_state_mean 0.03645445992525864 sim_compute_sim_state_median 0.03659883829263541 sim_compute_sim_state_min 0.035091326786921576 sim_physics_max 0.02755953335180515 sim_physics_mean 0.026273842124227887 sim_physics_median 0.02646172046661377 sim_physics_min 0.024119006960015548 sim_render-ego_max 0.06599554492206108 sim_render-ego_mean 0.06366592211961623 sim_render-ego_median 0.062436237440004455 sim_render-ego_min 0.06165526415172376 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18416
2560
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 14:18:01+00:00 2019-04-19 14:23:46+00:00 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06901852080696508 agent_compute-ego_mean 0.06541091749540885 agent_compute-ego_median 0.06480032664078933 agent_compute-ego_min 0.06278617838595776 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.018523742512958807, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0646125078201294, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06356434705780774, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07922312689990532, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.0406924835065516, "sim_compute_performance-ego": 0.06576765746605105, "sim_compute_robot_state-ego": 0.06514200059379019}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.016367664703956016, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06245701129619892, "in-drivable-lane": 0, "agent_compute-ego": 0.06480032664078933, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07864935581500714, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.041138685666597806, "sim_compute_performance-ego": 0.06443078701312725, "sim_compute_robot_state-ego": 0.0646038422217736}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01614848603593542, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.059304698984673686, "in-drivable-lane": 0, "agent_compute-ego": 0.06278617838595776, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07660142411576941, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03880418615138277, "sim_compute_performance-ego": 0.06179976463317871, "sim_compute_robot_state-ego": 0.06131664742814734}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.01979893642467457, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06210315358507764, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06688521458552434, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07626589837965074, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04196127692421714, "sim_compute_performance-ego": 0.06194500084761735, "sim_compute_robot_state-ego": 0.06338815112690349}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.016024043685511538, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06447052955627441, "in-drivable-lane": 0, "agent_compute-ego": 0.06901852080696508, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07951591516795911, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.038084331311677634, "sim_compute_performance-ego": 0.06382793501803749, "sim_compute_robot_state-ego": 0.06241112633755332}}set_robot_commands_max 0.07951591516795911 set_robot_commands_mean 0.07805114407565834 set_robot_commands_median 0.07864935581500714 set_robot_commands_min 0.07626589837965074 sim_compute_performance-ego_max 0.06576765746605105 sim_compute_performance-ego_mean 0.06355422899560237 sim_compute_performance-ego_median 0.06382793501803749 sim_compute_performance-ego_min 0.06179976463317871 sim_compute_robot_state-ego_max 0.06514200059379019 sim_compute_robot_state-ego_mean 0.06337235354163359 sim_compute_robot_state-ego_median 0.06338815112690349 sim_compute_robot_state-ego_min 0.06131664742814734 sim_compute_sim_state_max 0.04196127692421714 sim_compute_sim_state_mean 0.04013619271208539 sim_compute_sim_state_median 0.0406924835065516 sim_compute_sim_state_min 0.038084331311677634 sim_physics_max 0.01979893642467457 sim_physics_mean 0.01737257467260727 sim_physics_median 0.016367664703956016 sim_physics_min 0.016024043685511538 sim_render-ego_max 0.0646125078201294 sim_render-ego_mean 0.0625895802484708 sim_render-ego_median 0.06245701129619892 sim_render-ego_min 0.059304698984673686 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18395
2591
Julian Zilly baseline-IL-logs-tensorflow aido2-LFV-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 14:00:15+00:00 2019-04-19 14:17:54+00:00 0:17:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.267893599260681 survival_time_median 5.599999999999988 deviation-center-line_median 0.30133477066822845 in-drivable-lane_median 0.04999999999999982
other stats agent_compute-ego_max 0.1895714433569657 agent_compute-ego_mean 0.1850155656213283 agent_compute-ego_median 0.18366610896479976 agent_compute-ego_min 0.17889176309108734 deviation-center-line_max 0.3277934454417411 deviation-center-line_mean 0.3023503084857458 deviation-center-line_min 0.2813501118520696 deviation-heading_max 2.197195375494577 deviation-heading_mean 2.090877206684166 deviation-heading_median 2.0967258882551265 deviation-heading_min 1.9607743606448576 driven_any_max 0.3401608958813154 driven_any_mean 0.30571580013224253 driven_any_median 0.30349625822184084 driven_any_min 0.2720426166359494 driven_lanedir_consec_max 0.3028136226210183 driven_lanedir_consec_mean 0.26836451483759366 driven_lanedir_consec_min 0.2341904167922495 driven_lanedir_max 0.3028136226210183 driven_lanedir_mean 0.26836451483759366 driven_lanedir_median 0.267893599260681 driven_lanedir_min 0.2341904167922495 in-drivable-lane_max 0.09999999999999964 in-drivable-lane_mean 0.04999999999999982 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2720426166359494, "sim_physics": 0.02532900984470661, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2341904167922495, "sim_render-ego": 0.059193890828352705, "in-drivable-lane": 0, "agent_compute-ego": 0.18950099211472732, "deviation-heading": 2.197195375494577, "set_robot_commands": 0.07766853616787837, "deviation-center-line": 0.2813501118520696, "driven_lanedir_consec": 0.2341904167922495, "sim_compute_sim_state": 0.032912605083905734, "sim_compute_performance-ego": 0.06011525484231802, "sim_compute_robot_state-ego": 0.061619112124809854, "sim_compute_robot_state-npc0": 0.06638730260042044, "sim_compute_robot_state-npc1": 0.061277146522815414, "sim_compute_robot_state-npc2": 0.060176656796382025, "sim_compute_robot_state-npc3": 0.059935883833811834}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.30975959390932306, "sim_physics": 0.025379064920786263, "survival_time": 5.549999999999988, "driven_lanedir": 0.27137020973063786, "sim_render-ego": 0.05950925586459873, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.18366610896479976, "deviation-heading": 1.9607743606448576, "set_robot_commands": 0.07820264283601228, "deviation-center-line": 0.2943387539367152, "driven_lanedir_consec": 0.27137020973063786, "sim_compute_sim_state": 0.03317768509323533, "sim_compute_performance-ego": 0.058885630186613615, "sim_compute_robot_state-ego": 0.058912760502583275, "sim_compute_robot_state-npc0": 0.06591819213317321, "sim_compute_robot_state-npc1": 0.06083178949785662, "sim_compute_robot_state-npc2": 0.05900556761939246, "sim_compute_robot_state-npc3": 0.06161960395606789}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3401608958813154, "sim_physics": 0.02468995125063004, "survival_time": 6.199999999999986, "driven_lanedir": 0.3028136226210183, "sim_render-ego": 0.06144449980028214, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1834475205790612, "deviation-heading": 2.057280814354925, "set_robot_commands": 0.07302320195782569, "deviation-center-line": 0.3277934454417411, "driven_lanedir_consec": 0.3028136226210183, "sim_compute_sim_state": 0.03468307179789389, "sim_compute_performance-ego": 0.060443739737233805, "sim_compute_robot_state-ego": 0.061545781550868865, "sim_compute_robot_state-npc0": 0.06727491655657368, "sim_compute_robot_state-npc1": 0.06210246393757482, "sim_compute_robot_state-npc2": 0.06172806216824439, "sim_compute_robot_state-npc3": 0.06189273057445403}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3031196360127841, "sim_physics": 0.025833926030567715, "survival_time": 5.599999999999988, "driven_lanedir": 0.267893599260681, "sim_render-ego": 0.05930447791303907, "in-drivable-lane": 0, "agent_compute-ego": 0.17889176309108734, "deviation-heading": 2.0967258882551265, "set_robot_commands": 0.07558271501745496, "deviation-center-line": 0.30133477066822845, "driven_lanedir_consec": 0.267893599260681, "sim_compute_sim_state": 0.03334851562976837, "sim_compute_performance-ego": 0.05928019753524235, "sim_compute_robot_state-ego": 0.05987098174435752, "sim_compute_robot_state-npc0": 0.06154257271971021, "sim_compute_robot_state-npc1": 0.05868487698691232, "sim_compute_robot_state-npc2": 0.05858298923288073, "sim_compute_robot_state-npc3": 0.0611597831760134}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.30349625822184084, "sim_physics": 0.02540826170068038, "survival_time": 5.699999999999988, "driven_lanedir": 0.2655547257833818, "sim_render-ego": 0.06334125368218672, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1895714433569657, "deviation-heading": 2.1424095946713444, "set_robot_commands": 0.07491828684221234, "deviation-center-line": 0.30693446052997453, "driven_lanedir_consec": 0.2655547257833818, "sim_compute_sim_state": 0.03564330987762986, "sim_compute_performance-ego": 0.062010951209486576, "sim_compute_robot_state-ego": 0.06252085953428034, "sim_compute_robot_state-npc0": 0.068527338797586, "sim_compute_robot_state-npc1": 0.06555594686876264, "sim_compute_robot_state-npc2": 0.06413806321328147, "sim_compute_robot_state-npc3": 0.06498629586738452}}set_robot_commands_max 0.07820264283601228 set_robot_commands_mean 0.07587907656427673 set_robot_commands_median 0.07558271501745496 set_robot_commands_min 0.07302320195782569 sim_compute_performance-ego_max 0.062010951209486576 sim_compute_performance-ego_mean 0.06014715470217887 sim_compute_performance-ego_median 0.06011525484231802 sim_compute_performance-ego_min 0.058885630186613615 sim_compute_robot_state-ego_max 0.06252085953428034 sim_compute_robot_state-ego_mean 0.06089389909137997 sim_compute_robot_state-ego_median 0.061545781550868865 sim_compute_robot_state-ego_min 0.058912760502583275 sim_compute_robot_state-npc0_max 0.068527338797586 sim_compute_robot_state-npc0_mean 0.06593006456149271 sim_compute_robot_state-npc0_median 0.06638730260042044 sim_compute_robot_state-npc0_min 0.06154257271971021 sim_compute_robot_state-npc1_max 0.06555594686876264 sim_compute_robot_state-npc1_mean 0.06169044476278437 sim_compute_robot_state-npc1_median 0.061277146522815414 sim_compute_robot_state-npc1_min 0.05868487698691232 sim_compute_robot_state-npc2_max 0.06413806321328147 sim_compute_robot_state-npc2_mean 0.06072626780603622 sim_compute_robot_state-npc2_median 0.060176656796382025 sim_compute_robot_state-npc2_min 0.05858298923288073 sim_compute_robot_state-npc3_max 0.06498629586738452 sim_compute_robot_state-npc3_mean 0.06191885948154634 sim_compute_robot_state-npc3_median 0.06161960395606789 sim_compute_robot_state-npc3_min 0.059935883833811834 sim_compute_sim_state_max 0.03564330987762986 sim_compute_sim_state_mean 0.033953037496486635 sim_compute_sim_state_median 0.03334851562976837 sim_compute_sim_state_min 0.032912605083905734 sim_physics_max 0.025833926030567715 sim_physics_mean 0.025328042749474207 sim_physics_median 0.025379064920786263 sim_physics_min 0.02468995125063004 sim_render-ego_max 0.06334125368218672 sim_render-ego_mean 0.06055867561769187 sim_render-ego_median 0.05950925586459873 sim_render-ego_min 0.059193890828352705 simulation-passed 1 survival_time_max 6.199999999999986 survival_time_mean 5.649999999999988 survival_time_min 5.1999999999999895
No reset possible 18393
2596
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 13:58:42+00:00 2019-04-19 13:59:36+00:00 0:00:54 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18380
2613
Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 13:48:23+00:00 2019-04-19 13:58:17+00:00 0:09:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.07008221023961117 agent_compute-ego_mean 0.0680922596271757 agent_compute-ego_median 0.06725842851988027 agent_compute-ego_min 0.0668943050580147 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03137316954763312, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06477723372609992, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07008221023961117, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07992290195665862, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03509607315063477, "sim_compute_performance-ego": 0.06324819263659026, "sim_compute_robot_state-ego": 0.06423711023832622, "sim_compute_robot_state-npc0": 0.07116841015062834, "sim_compute_robot_state-npc1": 0.06507799750880192, "sim_compute_robot_state-npc2": 0.06490976935938784, "sim_compute_robot_state-npc3": 0.06355599855121813}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02727806568145752, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06791365774054277, "in-drivable-lane": 0, "agent_compute-ego": 0.06927548584185149, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07543408243279708, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03488746442292866, "sim_compute_performance-ego": 0.062120142735933005, "sim_compute_robot_state-ego": 0.06481437934072394, "sim_compute_robot_state-npc0": 0.07485205876199823, "sim_compute_robot_state-npc1": 0.06892839230989155, "sim_compute_robot_state-npc2": 0.06735334898296155, "sim_compute_robot_state-npc3": 0.06494407904775519}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.030211198024260692, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06403062282464443, "in-drivable-lane": 0, "agent_compute-ego": 0.0668943050580147, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.0796059950804099, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03441836283757137, "sim_compute_performance-ego": 0.06217669218014448, "sim_compute_robot_state-ego": 0.06162112798446264, "sim_compute_robot_state-npc0": 0.06935983437758225, "sim_compute_robot_state-npc1": 0.06521184016496707, "sim_compute_robot_state-npc2": 0.062513699898353, "sim_compute_robot_state-npc3": 0.06503511086488381}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.031085685944892992, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.0626962017005598, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06725842851988027, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07666594209805341, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03486653784631004, "sim_compute_performance-ego": 0.06267209456000529, "sim_compute_robot_state-ego": 0.06251740119826625, "sim_compute_robot_state-npc0": 0.07143250653441523, "sim_compute_robot_state-npc1": 0.06624809788985991, "sim_compute_robot_state-npc2": 0.06545822385331275, "sim_compute_robot_state-npc3": 0.0629131961876238}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02571503682570024, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06104733727195046, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06695086847652089, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.08050837841900912, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.035215946761044586, "sim_compute_performance-ego": 0.06343368508599022, "sim_compute_robot_state-ego": 0.06236067143353549, "sim_compute_robot_state-npc0": 0.06816499883478339, "sim_compute_robot_state-npc1": 0.0625195719979026, "sim_compute_robot_state-npc2": 0.06400398232720116, "sim_compute_robot_state-npc3": 0.0626085563139482}}set_robot_commands_max 0.08050837841900912 set_robot_commands_mean 0.07842745999738562 set_robot_commands_median 0.0796059950804099 set_robot_commands_min 0.07543408243279708 sim_compute_performance-ego_max 0.06343368508599022 sim_compute_performance-ego_mean 0.06273016143973266 sim_compute_performance-ego_median 0.06267209456000529 sim_compute_performance-ego_min 0.062120142735933005 sim_compute_robot_state-ego_max 0.06481437934072394 sim_compute_robot_state-ego_mean 0.06311013803906292 sim_compute_robot_state-ego_median 0.06251740119826625 sim_compute_robot_state-ego_min 0.06162112798446264 sim_compute_robot_state-npc0_max 0.07485205876199823 sim_compute_robot_state-npc0_mean 0.07099556173188148 sim_compute_robot_state-npc0_median 0.07116841015062834 sim_compute_robot_state-npc0_min 0.06816499883478339 sim_compute_robot_state-npc1_max 0.06892839230989155 sim_compute_robot_state-npc1_mean 0.0655971799742846 sim_compute_robot_state-npc1_median 0.06521184016496707 sim_compute_robot_state-npc1_min 0.0625195719979026 sim_compute_robot_state-npc2_max 0.06735334898296155 sim_compute_robot_state-npc2_mean 0.06484780488424326 sim_compute_robot_state-npc2_median 0.06490976935938784 sim_compute_robot_state-npc2_min 0.062513699898353 sim_compute_robot_state-npc3_max 0.06503511086488381 sim_compute_robot_state-npc3_mean 0.06381138819308582 sim_compute_robot_state-npc3_median 0.06355599855121813 sim_compute_robot_state-npc3_min 0.0626085563139482 sim_compute_sim_state_max 0.035215946761044586 sim_compute_sim_state_mean 0.03489687700369788 sim_compute_sim_state_median 0.03488746442292866 sim_compute_sim_state_min 0.03441836283757137 sim_physics_max 0.03137316954763312 sim_physics_mean 0.02913263120478892 sim_physics_median 0.030211198024260692 sim_physics_min 0.02571503682570024 sim_render-ego_max 0.06791365774054277 sim_render-ego_mean 0.06409301065275948 sim_render-ego_median 0.06403062282464443 sim_render-ego_min 0.06104733727195046 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 18374
2629
Andrea Censi 🇨🇭challenge-aido_LF-template-random aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 13:42:22+00:00 2019-04-19 13:48:10+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.1512262225151062 agent_compute-ego_mean 0.1457941544288079 agent_compute-ego_median 0.14867434782140396 agent_compute-ego_min 0.13876995500528588 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.0162567822438366, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.060089421722124205, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13876995500528588, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07817619701601425, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.037098236803738575, "sim_compute_performance-ego": 0.06021008401546838, "sim_compute_robot_state-ego": 0.06192597353233481}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016038347374309193, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0633391412821683, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1503853526982394, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07767481153661554, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04215787757526745, "sim_compute_performance-ego": 0.0634550777348605, "sim_compute_robot_state-ego": 0.06565931710329923}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016164689593844945, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06020748880174425, "in-drivable-lane": 0, "agent_compute-ego": 0.1399148941040039, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07512629826863607, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03935553762647841, "sim_compute_performance-ego": 0.06104007826911079, "sim_compute_robot_state-ego": 0.0640401734246148}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01676502327124278, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06349492569764455, "in-drivable-lane": 0, "agent_compute-ego": 0.1512262225151062, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0778178075949351, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04020430644353231, "sim_compute_performance-ego": 0.06309915085633595, "sim_compute_robot_state-ego": 0.06477011740207672}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.0169026536100051, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06365509243572459, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14867434782140396, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07789335881962496, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04097616321900312, "sim_compute_performance-ego": 0.06491650553310618, "sim_compute_robot_state-ego": 0.064941967234892}}set_robot_commands_max 0.07817619701601425 set_robot_commands_mean 0.07733769464716518 set_robot_commands_median 0.0778178075949351 set_robot_commands_min 0.07512629826863607 sim_compute_performance-ego_max 0.06491650553310618 sim_compute_performance-ego_mean 0.06254417928177636 sim_compute_performance-ego_median 0.06309915085633595 sim_compute_performance-ego_min 0.06021008401546838 sim_compute_robot_state-ego_max 0.06565931710329923 sim_compute_robot_state-ego_mean 0.0642675097394435 sim_compute_robot_state-ego_median 0.06477011740207672 sim_compute_robot_state-ego_min 0.06192597353233481 sim_compute_sim_state_max 0.04215787757526745 sim_compute_sim_state_mean 0.03995842433360397 sim_compute_sim_state_median 0.04020430644353231 sim_compute_sim_state_min 0.037098236803738575 sim_physics_max 0.0169026536100051 sim_physics_mean 0.01642549921864772 sim_physics_median 0.0162567822438366 sim_physics_min 0.016038347374309193 sim_render-ego_max 0.06365509243572459 sim_render-ego_mean 0.062157213987881176 sim_render-ego_median 0.0633391412821683 sim_render-ego_min 0.060089421722124205 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18369
2640
Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 13:36:32+00:00 2019-04-19 13:42:04+00:00 0:05:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06158133129497151 agent_compute-ego_mean 0.05918298281556257 agent_compute-ego_median 0.05971850219525789 agent_compute-ego_min 0.05628995711986835 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.016555681461241187, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05692655574984667, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05799251067929152, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07307294519936167, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03489908648700249, "sim_compute_performance-ego": 0.05791706864426776, "sim_compute_robot_state-ego": 0.05774684650142018}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.01563422496502216, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05254867443671593, "in-drivable-lane": 0, "agent_compute-ego": 0.05628995711986835, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07014438739189735, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.034433685816251315, "sim_compute_performance-ego": 0.05166793786562406, "sim_compute_robot_state-ego": 0.05548862310556265}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01504481092412421, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05621199404939692, "in-drivable-lane": 0, "agent_compute-ego": 0.06033261278842358, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07395558661602913, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03630976981305061, "sim_compute_performance-ego": 0.05744711388932898, "sim_compute_robot_state-ego": 0.058635873997465095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.017400078721098847, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.059845036202734646, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06158133129497151, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0749226559649457, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03861598916106171, "sim_compute_performance-ego": 0.06080440374521109, "sim_compute_robot_state-ego": 0.06054586106604272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.0161422051881489, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.060412356728001645, "in-drivable-lane": 0, "agent_compute-ego": 0.05971850219525789, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07294966045178865, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03965155701888235, "sim_compute_performance-ego": 0.06101793364474648, "sim_compute_robot_state-ego": 0.060738099248785725}}set_robot_commands_max 0.0749226559649457 set_robot_commands_mean 0.0730090471248045 set_robot_commands_median 0.07307294519936167 set_robot_commands_min 0.07014438739189735 sim_compute_performance-ego_max 0.06101793364474648 sim_compute_performance-ego_mean 0.05777089155783568 sim_compute_performance-ego_median 0.05791706864426776 sim_compute_performance-ego_min 0.05166793786562406 sim_compute_robot_state-ego_max 0.060738099248785725 sim_compute_robot_state-ego_mean 0.05863106078385527 sim_compute_robot_state-ego_median 0.058635873997465095 sim_compute_robot_state-ego_min 0.05548862310556265 sim_compute_sim_state_max 0.03965155701888235 sim_compute_sim_state_mean 0.0367820176592497 sim_compute_sim_state_median 0.03630976981305061 sim_compute_sim_state_min 0.034433685816251315 sim_physics_max 0.017400078721098847 sim_physics_mean 0.01615540025192706 sim_physics_median 0.0161422051881489 sim_physics_min 0.01504481092412421 sim_render-ego_max 0.060412356728001645 sim_render-ego_mean 0.057188923433339166 sim_render-ego_median 0.05692655574984667 sim_render-ego_min 0.05254867443671593 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18362
2653
Egor Zamotaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 13:23:19+00:00 2019-04-19 13:36:19+00:00 0:13:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7956914285058785 survival_time_median 8.299999999999983 deviation-center-line_median 0.6794277002990708 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05954377396592816 agent_compute-ego_mean 0.05801965323447524 agent_compute-ego_median 0.05751356760660807 agent_compute-ego_min 0.05680759311159015 deviation-center-line_max 1.1522115607379129 deviation-center-line_mean 0.716741732506061 deviation-center-line_min 0.2390520678430421 deviation-heading_max 7.556263963956581 deviation-heading_mean 3.056849802626116 deviation-heading_median 2.1930619107482174 deviation-heading_min 0.6631755143273981 driven_any_max 2.354992574770531 driven_any_mean 1.4147715619710506 driven_any_median 1.2868720168118328 driven_any_min 0.5047157294971466 driven_lanedir_consec_max 1.2530663353026663 driven_lanedir_consec_mean 0.9024157731718482 driven_lanedir_consec_min 0.48424458691948535 driven_lanedir_max 1.596130792939618 driven_lanedir_mean 1.0951277643360935 driven_lanedir_median 1.209121962239118 driven_lanedir_min 0.48424458691948535 in-drivable-lane_max 2.800000000000015 in-drivable-lane_mean 1.0000000000000069 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5047157294971466, "sim_physics": 0.01584626947130476, "survival_time": 3.4999999999999956, "driven_lanedir": 0.48424458691948535, "sim_render-ego": 0.05821822030203683, "in-drivable-lane": 0, "agent_compute-ego": 0.05718513556889125, "deviation-heading": 0.7283379027281819, "set_robot_commands": 0.07205460071563721, "deviation-center-line": 0.2390520678430421, "driven_lanedir_consec": 0.48424458691948535, "sim_compute_sim_state": 0.03474040712629046, "sim_compute_performance-ego": 0.05504520280020578, "sim_compute_robot_state-ego": 0.057920925957815984}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1466025219540503, "sim_physics": 0.015042696243677383, "survival_time": 13.65000000000006, "driven_lanedir": 1.596130792939618, "sim_render-ego": 0.05202037510854421, "in-drivable-lane": 2.2000000000000197, "agent_compute-ego": 0.05680759311159015, "deviation-heading": 4.143409721370204, "set_robot_commands": 0.07271076646043267, "deviation-center-line": 1.0716995378494558, "driven_lanedir_consec": 1.2530663353026663, "sim_compute_sim_state": 0.03270291670774802, "sim_compute_performance-ego": 0.05441403126978612, "sim_compute_robot_state-ego": 0.05613710504748446}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.354992574770531, "sim_physics": 0.01501989205678304, "survival_time": 14.950000000000076, "driven_lanedir": 1.4161869266901532, "sim_render-ego": 0.0549598487218221, "in-drivable-lane": 2.800000000000015, "agent_compute-ego": 0.05751356760660807, "deviation-heading": 7.556263963956581, "set_robot_commands": 0.07084858655929566, "deviation-center-line": 1.1522115607379129, "driven_lanedir_consec": 0.7956914285058785, "sim_compute_sim_state": 0.0357165797551473, "sim_compute_performance-ego": 0.05508808692296346, "sim_compute_robot_state-ego": 0.05834765195846558}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7806749668216928, "sim_physics": 0.016128952063403083, "survival_time": 5.14999999999999, "driven_lanedir": 0.7699545528920928, "sim_render-ego": 0.055999755859375, "in-drivable-lane": 0, "agent_compute-ego": 0.05954377396592816, "deviation-heading": 0.6631755143273981, "set_robot_commands": 0.07345532213599937, "deviation-center-line": 0.4413177958008233, "driven_lanedir_consec": 0.7699545528920928, "sim_compute_sim_state": 0.03490312585552919, "sim_compute_performance-ego": 0.05626347921427014, "sim_compute_robot_state-ego": 0.05809859396184532}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2868720168118328, "sim_physics": 0.01559570323990052, "survival_time": 8.299999999999983, "driven_lanedir": 1.209121962239118, "sim_render-ego": 0.05547433876129518, "in-drivable-lane": 0, "agent_compute-ego": 0.05904819591935859, "deviation-heading": 2.1930619107482174, "set_robot_commands": 0.07280448115015604, "deviation-center-line": 0.6794277002990708, "driven_lanedir_consec": 1.209121962239118, "sim_compute_sim_state": 0.034965599875852287, "sim_compute_performance-ego": 0.05573893024260739, "sim_compute_robot_state-ego": 0.05864474428705422}}set_robot_commands_max 0.07345532213599937 set_robot_commands_mean 0.07237475140430419 set_robot_commands_median 0.07271076646043267 set_robot_commands_min 0.07084858655929566 sim_compute_performance-ego_max 0.05626347921427014 sim_compute_performance-ego_mean 0.055309946089966575 sim_compute_performance-ego_median 0.05508808692296346 sim_compute_performance-ego_min 0.05441403126978612 sim_compute_robot_state-ego_max 0.05864474428705422 sim_compute_robot_state-ego_mean 0.05782980424253311 sim_compute_robot_state-ego_median 0.05809859396184532 sim_compute_robot_state-ego_min 0.05613710504748446 sim_compute_sim_state_max 0.0357165797551473 sim_compute_sim_state_mean 0.03460572586411345 sim_compute_sim_state_median 0.03490312585552919 sim_compute_sim_state_min 0.03270291670774802 sim_physics_max 0.016128952063403083 sim_physics_mean 0.015526702615013757 sim_physics_median 0.01559570323990052 sim_physics_min 0.01501989205678304 sim_render-ego_max 0.05821822030203683 sim_render-ego_mean 0.05533450775061466 sim_render-ego_median 0.05547433876129518 sim_render-ego_min 0.05202037510854421 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.110000000000024 survival_time_min 3.4999999999999956
No reset possible 18349
2676
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 13:10:06+00:00 2019-04-19 13:23:00+00:00 0:12:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0026938838001445 survival_time_median 8.349999999999984 deviation-center-line_median 0.6640953347137637 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05798116483186421 agent_compute-ego_mean 0.05682944140090819 agent_compute-ego_median 0.05693291425704956 agent_compute-ego_min 0.05570924535710761 deviation-center-line_max 0.841116144416244 deviation-center-line_mean 0.6226209914520586 deviation-center-line_min 0.25114429006958566 deviation-heading_max 7.160675521705008 deviation-heading_mean 2.910626652084963 deviation-heading_median 2.1570227146386824 deviation-heading_min 0.6824269591851444 driven_any_max 2.355170606087525 driven_any_mean 1.4132007423454025 driven_any_median 1.2949132077404946 driven_any_min 0.5529282847883172 driven_lanedir_consec_max 1.2223767931508702 driven_lanedir_consec_mean 0.9178770618516736 driven_lanedir_consec_min 0.535310101890909 driven_lanedir_max 1.3565164713434696 driven_lanedir_mean 1.0871009332382524 driven_lanedir_median 1.2223767931508702 driven_lanedir_min 0.535310101890909 in-drivable-lane_max 3.600000000000022 in-drivable-lane_mean 1.1100000000000068 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5529282847883172, "sim_physics": 0.016135153017546002, "survival_time": 3.7999999999999945, "driven_lanedir": 0.535310101890909, "sim_render-ego": 0.055166159805498625, "in-drivable-lane": 0, "agent_compute-ego": 0.05798116483186421, "deviation-heading": 0.6824269591851444, "set_robot_commands": 0.07209956959674232, "deviation-center-line": 0.25114429006958566, "driven_lanedir_consec": 0.535310101890909, "sim_compute_sim_state": 0.033213173088274504, "sim_compute_performance-ego": 0.0561227139673735, "sim_compute_robot_state-ego": 0.05646932125091553}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8412444792468765, "sim_physics": 0.016188203527572307, "survival_time": 11.750000000000032, "driven_lanedir": 1.3565164713434696, "sim_render-ego": 0.05452602163274237, "in-drivable-lane": 1.9500000000000115, "agent_compute-ego": 0.05570924535710761, "deviation-heading": 3.5173389669915354, "set_robot_commands": 0.07177084963372413, "deviation-center-line": 0.7183553192461826, "driven_lanedir_consec": 1.0568512145881757, "sim_compute_sim_state": 0.03446406607932233, "sim_compute_performance-ego": 0.055031572504246486, "sim_compute_robot_state-ego": 0.0576488677491533}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.355170606087525, "sim_physics": 0.01484600067138672, "survival_time": 14.950000000000076, "driven_lanedir": 1.3186074160058685, "sim_render-ego": 0.05333851257960002, "in-drivable-lane": 3.600000000000022, "agent_compute-ego": 0.05693291425704956, "deviation-heading": 7.160675521705008, "set_robot_commands": 0.07293967008590699, "deviation-center-line": 0.841116144416244, "driven_lanedir_consec": 0.7721533158282687, "sim_compute_sim_state": 0.034044979413350426, "sim_compute_performance-ego": 0.05529889106750488, "sim_compute_robot_state-ego": 0.05725255171457926}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0217471338637985, "sim_physics": 0.015279667718069894, "survival_time": 6.649999999999984, "driven_lanedir": 1.0026938838001445, "sim_render-ego": 0.05335350861226706, "in-drivable-lane": 0, "agent_compute-ego": 0.05598781162634828, "deviation-heading": 1.0356690979044452, "set_robot_commands": 0.07055310199135228, "deviation-center-line": 0.638393868814517, "driven_lanedir_consec": 1.0026938838001445, "sim_compute_sim_state": 0.0341363813644065, "sim_compute_performance-ego": 0.054793719958541987, "sim_compute_robot_state-ego": 0.05713685473105065}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2949132077404946, "sim_physics": 0.016978649322144285, "survival_time": 8.349999999999984, "driven_lanedir": 1.2223767931508702, "sim_render-ego": 0.05419106397800103, "in-drivable-lane": 0, "agent_compute-ego": 0.0575360709321713, "deviation-heading": 2.1570227146386824, "set_robot_commands": 0.07019785349954388, "deviation-center-line": 0.6640953347137637, "driven_lanedir_consec": 1.2223767931508702, "sim_compute_sim_state": 0.03380179833509251, "sim_compute_performance-ego": 0.05516719104287153, "sim_compute_robot_state-ego": 0.057288112754593355}}set_robot_commands_max 0.07293967008590699 set_robot_commands_mean 0.07151220896145391 set_robot_commands_median 0.07177084963372413 set_robot_commands_min 0.07019785349954388 sim_compute_performance-ego_max 0.0561227139673735 sim_compute_performance-ego_mean 0.05528281770810768 sim_compute_performance-ego_median 0.05516719104287153 sim_compute_performance-ego_min 0.054793719958541987 sim_compute_robot_state-ego_max 0.0576488677491533 sim_compute_robot_state-ego_mean 0.05715914164005842 sim_compute_robot_state-ego_median 0.05725255171457926 sim_compute_robot_state-ego_min 0.05646932125091553 sim_compute_sim_state_max 0.03446406607932233 sim_compute_sim_state_mean 0.033932079656089256 sim_compute_sim_state_median 0.034044979413350426 sim_compute_sim_state_min 0.033213173088274504 sim_physics_max 0.016978649322144285 sim_physics_mean 0.015885534851343842 sim_physics_median 0.016135153017546002 sim_physics_min 0.01484600067138672 sim_render-ego_max 0.055166159805498625 sim_render-ego_mean 0.05411505332162182 sim_render-ego_median 0.05419106397800103 sim_render-ego_min 0.05333851257960002 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.100000000000014 survival_time_min 3.7999999999999945
No reset possible 18339
2695
Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-114212
2019-04-19 12:48:35+00:00 2019-04-19 13:09:41+00:00 0:21:06 Waited 1201 seconds [...] Waited 1201 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18304
2770
Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 12:27:16+00:00 2019-04-19 12:48:28+00:00 0:21:12 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18290
2804
Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agent aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 12:21:08+00:00 2019-04-19 12:26:56+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.145286093155543 agent_compute-ego_mean 0.1422588385461439 agent_compute-ego_median 0.14459505406293002 agent_compute-ego_min 0.13550272517734105 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.015825604492763302, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.060888564811562594, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14093973501673285, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07803805819097555, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.039738713570360865, "sim_compute_performance-ego": 0.061930206586729805, "sim_compute_robot_state-ego": 0.06342608523818682}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016015350818634033, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0637899095361883, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14459505406293002, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07808583974838257, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03994057937101885, "sim_compute_performance-ego": 0.0641580278223211, "sim_compute_robot_state-ego": 0.06521491570906206}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015777164035373263, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.056616184446546765, "in-drivable-lane": 0, "agent_compute-ego": 0.13550272517734105, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07300065888298882, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.036933188968234595, "sim_compute_performance-ego": 0.05922564930386014, "sim_compute_robot_state-ego": 0.061271021101209855}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016278713941574097, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06546581784884135, "in-drivable-lane": 0, "agent_compute-ego": 0.145286093155543, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07809547086556752, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.038718933860460915, "sim_compute_performance-ego": 0.06728098789850871, "sim_compute_robot_state-ego": 0.06613875925540924}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01836087423212388, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06769865400650922, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14497058531817267, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08048972662757425, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.0418015017228968, "sim_compute_performance-ego": 0.07073756526498233, "sim_compute_robot_state-ego": 0.06732694541706759}}set_robot_commands_max 0.08048972662757425 set_robot_commands_mean 0.07754195086309774 set_robot_commands_median 0.07808583974838257 set_robot_commands_min 0.07300065888298882 sim_compute_performance-ego_max 0.07073756526498233 sim_compute_performance-ego_mean 0.06466648737528043 sim_compute_performance-ego_median 0.0641580278223211 sim_compute_performance-ego_min 0.05922564930386014 sim_compute_robot_state-ego_max 0.06732694541706759 sim_compute_robot_state-ego_mean 0.06467554534418711 sim_compute_robot_state-ego_median 0.06521491570906206 sim_compute_robot_state-ego_min 0.061271021101209855 sim_compute_sim_state_max 0.0418015017228968 sim_compute_sim_state_mean 0.0394265834985944 sim_compute_sim_state_median 0.039738713570360865 sim_compute_sim_state_min 0.036933188968234595 sim_physics_max 0.01836087423212388 sim_physics_mean 0.016451541504093715 sim_physics_median 0.016015350818634033 sim_physics_min 0.015777164035373263 sim_render-ego_max 0.06769865400650922 sim_render-ego_mean 0.06289182612992963 sim_render-ego_median 0.0637899095361883 sim_render-ego_min 0.056616184446546765 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18284
2814
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 12:15:10+00:00 2019-04-19 12:20:55+00:00 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.14353720347086588 agent_compute-ego_mean 0.13776642497493902 agent_compute-ego_median 0.1354990926655856 agent_compute-ego_min 0.13274373478359647 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01666156750804973, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05925629723746822, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1349630355834961, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07473677959082262, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03842235511203982, "sim_compute_performance-ego": 0.060173111141852614, "sim_compute_robot_state-ego": 0.061420454169219395}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.014795736833052202, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.059350636872378265, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1354990926655856, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07446905157782814, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03820470788262107, "sim_compute_performance-ego": 0.0610808784311468, "sim_compute_robot_state-ego": 0.0626272125677629}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.0152498722076416, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05591045485602485, "in-drivable-lane": 0, "agent_compute-ego": 0.13274373478359647, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07338789833916558, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.035977506637573244, "sim_compute_performance-ego": 0.05841187900967068, "sim_compute_robot_state-ego": 0.06188531981574164}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.017457013328870136, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06594054400920868, "in-drivable-lane": 0, "agent_compute-ego": 0.14353720347086588, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0780182679494222, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04144926369190216, "sim_compute_performance-ego": 0.06645339230696361, "sim_compute_robot_state-ego": 0.06538177033265431}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.016024273984572467, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05904597043991089, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14208905837115118, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07791304588317871, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03663403497022741, "sim_compute_performance-ego": 0.06135587481891408, "sim_compute_robot_state-ego": 0.06064805563758401}}set_robot_commands_max 0.0780182679494222 set_robot_commands_mean 0.07570500866808345 set_robot_commands_median 0.07473677959082262 set_robot_commands_min 0.07338789833916558 sim_compute_performance-ego_max 0.06645339230696361 sim_compute_performance-ego_mean 0.061495027141709555 sim_compute_performance-ego_median 0.0610808784311468 sim_compute_performance-ego_min 0.05841187900967068 sim_compute_robot_state-ego_max 0.06538177033265431 sim_compute_robot_state-ego_mean 0.06239256250459245 sim_compute_robot_state-ego_median 0.06188531981574164 sim_compute_robot_state-ego_min 0.06064805563758401 sim_compute_sim_state_max 0.04144926369190216 sim_compute_sim_state_mean 0.03813757365887274 sim_compute_sim_state_median 0.03820470788262107 sim_compute_sim_state_min 0.035977506637573244 sim_physics_max 0.017457013328870136 sim_physics_mean 0.016037692772437228 sim_physics_median 0.016024273984572467 sim_physics_min 0.014795736833052202 sim_render-ego_max 0.06594054400920868 sim_render-ego_mean 0.05990078068299818 sim_render-ego_median 0.05925629723746822 sim_render-ego_min 0.05591045485602485 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18259
2767
Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-19 12:03:54+00:00 2019-04-19 12:14:46+00:00 0:10:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6730551409975218 survival_time_median 4.549999999999992 deviation-center-line_median 0.42131021260548374 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.0890178419649601 agent_compute-ego_mean 0.08153694056330486 agent_compute-ego_median 0.08005549881484482 agent_compute-ego_min 0.07808042287826539 deviation-center-line_max 1.2448928803795891 deviation-center-line_mean 0.5980187959456812 deviation-center-line_min 0.21670432937594425 deviation-heading_max 6.569192033749965 deviation-heading_mean 2.424261042974088 deviation-heading_median 1.953492319723125 deviation-heading_min 0.6518604002742235 driven_any_max 2.354994945840218 driven_any_mean 1.0886099229262354 driven_any_median 0.6842416511385191 driven_any_min 0.4649273550852488 driven_lanedir_consec_max 1.176808498808518 driven_lanedir_consec_mean 0.6949140060682549 driven_lanedir_consec_min 0.3154231384555854 driven_lanedir_max 1.570645087372998 driven_lanedir_mean 0.8682360960999368 driven_lanedir_median 0.6730551409975218 driven_lanedir_min 0.449377756210787 in-drivable-lane_max 2.2500000000000204 in-drivable-lane_mean 0.5700000000000042 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4649273550852488, "sim_physics": 0.017391491681337357, "survival_time": 3.1999999999999966, "driven_lanedir": 0.449377756210787, "sim_render-ego": 0.05935324728488922, "in-drivable-lane": 0, "agent_compute-ego": 0.0890178419649601, "deviation-heading": 0.6518604002742235, "set_robot_commands": 0.07463892176747322, "deviation-center-line": 0.21670432937594425, "driven_lanedir_consec": 0.449377756210787, "sim_compute_sim_state": 0.03925720602273941, "sim_compute_performance-ego": 0.06094071641564369, "sim_compute_robot_state-ego": 0.06229967623949051}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6841265712644341, "sim_physics": 0.015922868644798194, "survival_time": 4.549999999999992, "driven_lanedir": 0.4712939971098586, "sim_render-ego": 0.05812905646942474, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.08005549881484482, "deviation-heading": 1.953492319723125, "set_robot_commands": 0.07113906577393249, "deviation-center-line": 0.3614412751931173, "driven_lanedir_consec": 0.3154231384555854, "sim_compute_sim_state": 0.03561137534759857, "sim_compute_performance-ego": 0.055712136593493784, "sim_compute_robot_state-ego": 0.058000763694008625}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2547590913027562, "sim_physics": 0.014569219247794446, "survival_time": 8.09999999999998, "driven_lanedir": 1.176808498808518, "sim_render-ego": 0.05323727189758678, "in-drivable-lane": 0, "agent_compute-ego": 0.07869831279472068, "deviation-heading": 2.280199520708574, "set_robot_commands": 0.07311420087461118, "deviation-center-line": 0.7457452821742715, "driven_lanedir_consec": 1.176808498808518, "sim_compute_sim_state": 0.03350737654132607, "sim_compute_performance-ego": 0.05522323537755896, "sim_compute_robot_state-ego": 0.05714001184628333}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.016443794900244408, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.05306441181308621, "in-drivable-lane": 0, "agent_compute-ego": 0.08183262636373331, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.07518462820367498, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.03412329495608152, "sim_compute_performance-ego": 0.05408203470837939, "sim_compute_robot_state-ego": 0.05609704111958598}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.354994945840218, "sim_physics": 0.014150742689768474, "survival_time": 14.950000000000076, "driven_lanedir": 1.570645087372998, "sim_render-ego": 0.05366652091344198, "in-drivable-lane": 2.2500000000000204, "agent_compute-ego": 0.07808042287826539, "deviation-heading": 6.569192033749965, "set_robot_commands": 0.07166145722071329, "deviation-center-line": 1.2448928803795891, "driven_lanedir_consec": 0.8599054958688623, "sim_compute_sim_state": 0.03359811067581177, "sim_compute_performance-ego": 0.054767475922902424, "sim_compute_robot_state-ego": 0.056450955867767334}}set_robot_commands_max 0.07518462820367498 set_robot_commands_mean 0.07314765476808102 set_robot_commands_median 0.07311420087461118 set_robot_commands_min 0.07113906577393249 sim_compute_performance-ego_max 0.06094071641564369 sim_compute_performance-ego_mean 0.05614511980359564 sim_compute_performance-ego_median 0.05522323537755896 sim_compute_performance-ego_min 0.05408203470837939 sim_compute_robot_state-ego_max 0.06229967623949051 sim_compute_robot_state-ego_mean 0.05799768975342715 sim_compute_robot_state-ego_median 0.05714001184628333 sim_compute_robot_state-ego_min 0.05609704111958598 sim_compute_sim_state_max 0.03925720602273941 sim_compute_sim_state_mean 0.035219472708711466 sim_compute_sim_state_median 0.03412329495608152 sim_compute_sim_state_min 0.03350737654132607 sim_physics_max 0.017391491681337357 sim_physics_mean 0.015695623432788575 sim_physics_median 0.015922868644798194 sim_physics_min 0.014150742689768474 sim_render-ego_max 0.05935324728488922 sim_render-ego_mean 0.055490101675685785 sim_render-ego_median 0.05366652091344198 sim_render-ego_min 0.05306441181308621 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.070000000000007 survival_time_min 3.1999999999999966
No reset possible 18246
2383
Andrea Censi 🇨🇭Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 11:06:10+00:00 2019-04-19 11:10:27+00:00 0:04:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.10465861217987447 survival_time_median 1.3500000000000003 deviation-center-line_median 0.06331076679698575 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.24004618610654557 agent_compute-ego_mean 0.20616108520660745 agent_compute-ego_median 0.20481531960623608 agent_compute-ego_min 0.17187430308415338 deviation-center-line_max 0.06680206305973362 deviation-center-line_mean 0.059625437781616865 deviation-center-line_min 0.04184335409783919 deviation-heading_max 0.8325339107446483 deviation-heading_mean 0.7625933818325666 deviation-heading_median 0.736408192754652 deviation-heading_min 0.6891147684533254 driven_any_max 0.19434689381991452 driven_any_mean 0.1663534796451768 driven_any_median 0.16562409605111356 driven_any_min 0.13765952097037965 driven_lanedir_consec_max 0.14647341158634886 driven_lanedir_consec_mean 0.10611518333347005 driven_lanedir_consec_min 0.0654236692478456 driven_lanedir_max 0.14647341158634886 driven_lanedir_mean 0.10611518333347005 driven_lanedir_median 0.10465861217987447 driven_lanedir_min 0.0654236692478456 in-drivable-lane_max 0.20000000000000015 in-drivable-lane_mean 0.04000000000000003 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17293142275023177, "sim_physics": 0.016861053613516, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11357902286358534, "sim_render-ego": 0.06157069022838886, "in-drivable-lane": 0, "agent_compute-ego": 0.17187430308415338, "deviation-heading": 0.736408192754652, "set_robot_commands": 0.07827308544745812, "deviation-center-line": 0.060769754761942935, "driven_lanedir_consec": 0.11357902286358534, "sim_compute_sim_state": 0.04048736278827374, "sim_compute_performance-ego": 0.06096838987790621, "sim_compute_robot_state-ego": 0.05988607956812931}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1612054646342444, "sim_physics": 0.02226514286465115, "survival_time": 1.3500000000000003, "driven_lanedir": 0.10044120078969589, "sim_render-ego": 0.06107385070235641, "in-drivable-lane": 0, "agent_compute-ego": 0.2100475187654849, "deviation-heading": 0.8325339107446483, "set_robot_commands": 0.07769809828864203, "deviation-center-line": 0.06540125019158285, "driven_lanedir_consec": 0.10044120078969589, "sim_compute_sim_state": 0.03920125078271936, "sim_compute_performance-ego": 0.06093131171332465, "sim_compute_robot_state-ego": 0.06297227188392922}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16562409605111356, "sim_physics": 0.015548653072781034, "survival_time": 1.3500000000000003, "driven_lanedir": 0.10465861217987447, "sim_render-ego": 0.05970927521034523, "in-drivable-lane": 0, "agent_compute-ego": 0.2040220984706172, "deviation-heading": 0.8239718463675947, "set_robot_commands": 0.07587718080591273, "deviation-center-line": 0.06331076679698575, "driven_lanedir_consec": 0.10465861217987447, "sim_compute_sim_state": 0.03892257478502062, "sim_compute_performance-ego": 0.06371128117596661, "sim_compute_robot_state-ego": 0.06484795499730993}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19434689381991452, "sim_physics": 0.01654761178152902, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14647341158634886, "sim_render-ego": 0.06140248264585223, "in-drivable-lane": 0, "agent_compute-ego": 0.24004618610654557, "deviation-heading": 0.6891147684533254, "set_robot_commands": 0.08266199486596244, "deviation-center-line": 0.06680206305973362, "driven_lanedir_consec": 0.14647341158634886, "sim_compute_sim_state": 0.03723466396331787, "sim_compute_performance-ego": 0.06318489994321551, "sim_compute_robot_state-ego": 0.06364870922906059}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13765952097037965, "sim_physics": 0.017666331359318325, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0654236692478456, "sim_render-ego": 0.06575681482042585, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.20481531960623608, "deviation-heading": 0.730938190842613, "set_robot_commands": 0.07778149843215942, "deviation-center-line": 0.04184335409783919, "driven_lanedir_consec": 0.0654236692478456, "sim_compute_sim_state": 0.041117216859545024, "sim_compute_performance-ego": 0.06422168016433716, "sim_compute_robot_state-ego": 0.0644473944391523}}set_robot_commands_max 0.08266199486596244 set_robot_commands_mean 0.07845837156802694 set_robot_commands_median 0.07778149843215942 set_robot_commands_min 0.07587718080591273 sim_compute_performance-ego_max 0.06422168016433716 sim_compute_performance-ego_mean 0.06260351257495003 sim_compute_performance-ego_median 0.06318489994321551 sim_compute_performance-ego_min 0.06093131171332465 sim_compute_robot_state-ego_max 0.06484795499730993 sim_compute_robot_state-ego_mean 0.06316048202351628 sim_compute_robot_state-ego_median 0.06364870922906059 sim_compute_robot_state-ego_min 0.05988607956812931 sim_compute_sim_state_max 0.041117216859545024 sim_compute_sim_state_mean 0.03939261383577533 sim_compute_sim_state_median 0.03920125078271936 sim_compute_sim_state_min 0.03723466396331787 sim_physics_max 0.02226514286465115 sim_physics_mean 0.017777758538359105 sim_physics_median 0.016861053613516 sim_physics_min 0.015548653072781034 sim_render-ego_max 0.06575681482042585 sim_render-ego_mean 0.06190262272147371 sim_render-ego_median 0.06140248264585223 sim_render-ego_min 0.05970927521034523 simulation-passed 1 survival_time_max 1.4000000000000006 survival_time_mean 1.3600000000000003 survival_time_min 1.3000000000000005
No reset possible 18232
2491
Liam Paull 🇨🇦challenge-aido_LF-template-pytorch aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 10:58:59+00:00 2019-04-19 11:05:43+00:00 0:06:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07543567762023018 survival_time_median 1.5000000000000009 deviation-center-line_median 0.03277923584221594 in-drivable-lane_median 0.4500000000000004
other stats agent_compute-ego_max 0.25610001881917316 agent_compute-ego_mean 0.21744333090035856 agent_compute-ego_median 0.20441156048928535 agent_compute-ego_min 0.18515643278757732 deviation-center-line_max 0.03387107648268236 deviation-center-line_mean 0.030658599942274534 deviation-center-line_min 0.02350229710047212 deviation-heading_max 0.6238967781874006 deviation-heading_mean 0.5963542477741391 deviation-heading_median 0.6088382453895785 deviation-heading_min 0.5551061206095937 driven_any_max 0.17593434054952858 driven_any_mean 0.1629562169617182 driven_any_median 0.16327466218766484 driven_any_min 0.1452034852684543 driven_lanedir_consec_max 0.07670158154578255 driven_lanedir_consec_mean 0.07080659963317915 driven_lanedir_consec_min 0.05518134226999338 driven_lanedir_max 0.07670158154578255 driven_lanedir_mean 0.07080659963317915 driven_lanedir_median 0.07543567762023018 driven_lanedir_min 0.05518134226999338 in-drivable-lane_max 0.5000000000000004 in-drivable-lane_mean 0.4100000000000003 in-drivable-lane_min 0.2500000000000002 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17593434054952858, "sim_physics": 0.0155821959177653, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07604546930595735, "sim_render-ego": 0.056511632601420086, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.18515643278757732, "deviation-heading": 0.6220436594389007, "set_robot_commands": 0.08323139349619547, "deviation-center-line": 0.03387107648268236, "driven_lanedir_consec": 0.07604546930595735, "sim_compute_sim_state": 0.03643834590911865, "sim_compute_performance-ego": 0.05949028333028158, "sim_compute_robot_state-ego": 0.06192344824473063}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17287247408623646, "sim_physics": 0.015337482575447328, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07543567762023018, "sim_render-ego": 0.05305454038804577, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.20441156048928535, "deviation-heading": 0.6238967781874006, "set_robot_commands": 0.07540447481216923, "deviation-center-line": 0.033348197503558726, "driven_lanedir_consec": 0.07543567762023018, "sim_compute_sim_state": 0.03528516523299679, "sim_compute_performance-ego": 0.05670933569631269, "sim_compute_robot_state-ego": 0.06115726501710953}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1452034852684543, "sim_physics": 0.01441347599029541, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05518134226999338, "sim_render-ego": 0.055277252197265626, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.25610001881917316, "deviation-heading": 0.5551061206095937, "set_robot_commands": 0.07266319592793782, "deviation-center-line": 0.02350229710047212, "driven_lanedir_consec": 0.05518134226999338, "sim_compute_sim_state": 0.03335380554199219, "sim_compute_performance-ego": 0.05637336572011312, "sim_compute_robot_state-ego": 0.056152812639872235}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16327466218766484, "sim_physics": 0.015554141998291016, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07066892742393227, "sim_render-ego": 0.05979759693145752, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.23949023882548015, "deviation-heading": 0.5718864352452224, "set_robot_commands": 0.0761107603708903, "deviation-center-line": 0.02979219278244352, "driven_lanedir_consec": 0.07066892742393227, "sim_compute_sim_state": 0.03761883576711019, "sim_compute_performance-ego": 0.06364204883575439, "sim_compute_robot_state-ego": 0.06245416800181071}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15749612271670688, "sim_physics": 0.016004041389182763, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07670158154578255, "sim_render-ego": 0.06280684471130371, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.20205840358027705, "deviation-heading": 0.6088382453895785, "set_robot_commands": 0.07690718438890246, "deviation-center-line": 0.03277923584221594, "driven_lanedir_consec": 0.07670158154578255, "sim_compute_sim_state": 0.03914305015846535, "sim_compute_performance-ego": 0.06575242678324382, "sim_compute_robot_state-ego": 0.06412408970020435}}set_robot_commands_max 0.08323139349619547 set_robot_commands_mean 0.07686340179921906 set_robot_commands_median 0.0761107603708903 set_robot_commands_min 0.07266319592793782 sim_compute_performance-ego_max 0.06575242678324382 sim_compute_performance-ego_mean 0.06039349207314112 sim_compute_performance-ego_median 0.05949028333028158 sim_compute_performance-ego_min 0.05637336572011312 sim_compute_robot_state-ego_max 0.06412408970020435 sim_compute_robot_state-ego_mean 0.06116235672074549 sim_compute_robot_state-ego_median 0.06192344824473063 sim_compute_robot_state-ego_min 0.056152812639872235 sim_compute_sim_state_max 0.03914305015846535 sim_compute_sim_state_mean 0.03636784052193663 sim_compute_sim_state_median 0.03643834590911865 sim_compute_sim_state_min 0.03335380554199219 sim_physics_max 0.016004041389182763 sim_physics_mean 0.015378267574196363 sim_physics_median 0.015554141998291016 sim_physics_min 0.01441347599029541 sim_render-ego_max 0.06280684471130371 sim_render-ego_mean 0.057489573365898536 sim_render-ego_median 0.056511632601420086 sim_render-ego_min 0.05305454038804577 simulation-passed 1 survival_time_max 1.5500000000000007 survival_time_mean 1.4800000000000009 survival_time_min 1.3500000000000003
No reset possible 18224
2541
jiang peng test for ppo aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 10:56:04+00:00 2019-04-19 10:58:26+00:00 0:02:22 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18223
2542
Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 10:54:53+00:00 2019-04-19 10:55:38+00:00 0:00:45 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18213
2583
Liam Paull 🇨🇦challenge-aido_LF-template-ros aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 10:48:03+00:00 2019-04-19 10:54:25+00:00 0:06:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.060587094380305365 agent_compute-ego_mean 0.05845298301826328 agent_compute-ego_median 0.05821512675866848 agent_compute-ego_min 0.05484074040463096 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.015772682864491534, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.04944053510340249, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05821512675866848, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07110982115675764, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.033266148916104944, "sim_compute_performance-ego": 0.05268100703634867, "sim_compute_robot_state-ego": 0.05479522449214284}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.0159149720118596, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05341994762420654, "in-drivable-lane": 0, "agent_compute-ego": 0.060587094380305365, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07029022620274471, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.036077215121342585, "sim_compute_performance-ego": 0.057221486018254206, "sim_compute_robot_state-ego": 0.058922382501455456}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.0152327557827564, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.056654919969274645, "in-drivable-lane": 0, "agent_compute-ego": 0.060461551585095995, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07387000449160312, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.037145837824395365, "sim_compute_performance-ego": 0.05736027372644303, "sim_compute_robot_state-ego": 0.06077791274862086}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.017678192683628628, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05430669836945586, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.058160401962615633, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07205809079683743, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03506689019255586, "sim_compute_performance-ego": 0.05649697387611473, "sim_compute_robot_state-ego": 0.05769562197255564}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.015007765669571724, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05377355374787983, "in-drivable-lane": 0, "agent_compute-ego": 0.05484074040463096, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.06950161958995618, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03388535976409912, "sim_compute_performance-ego": 0.054416079270212275, "sim_compute_robot_state-ego": 0.05794931712903475}}set_robot_commands_max 0.07387000449160312 set_robot_commands_mean 0.07136595244757982 set_robot_commands_median 0.07110982115675764 set_robot_commands_min 0.06950161958995618 sim_compute_performance-ego_max 0.05736027372644303 sim_compute_performance-ego_mean 0.05563516398547459 sim_compute_performance-ego_median 0.05649697387611473 sim_compute_performance-ego_min 0.05268100703634867 sim_compute_robot_state-ego_max 0.06077791274862086 sim_compute_robot_state-ego_mean 0.05802809176876191 sim_compute_robot_state-ego_median 0.05794931712903475 sim_compute_robot_state-ego_min 0.05479522449214284 sim_compute_sim_state_max 0.037145837824395365 sim_compute_sim_state_mean 0.03508829036369958 sim_compute_sim_state_median 0.03506689019255586 sim_compute_sim_state_min 0.033266148916104944 sim_physics_max 0.017678192683628628 sim_physics_mean 0.015921273802461576 sim_physics_median 0.015772682864491534 sim_physics_min 0.015007765669571724 sim_render-ego_max 0.056654919969274645 sim_render-ego_mean 0.05351913096284387 sim_render-ego_median 0.05377355374787983 sim_render-ego_min 0.04944053510340249 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18198
2703
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-19 10:32:06+00:00 2019-04-19 10:47:43+00:00 0:15:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9102359788618892 survival_time_median 13.900000000000064 deviation-center-line_median 0.8692585440334625 in-drivable-lane_median 2.250000000000009
other stats agent_compute-ego_max 0.06449973754745593 agent_compute-ego_mean 0.05825962004557733 agent_compute-ego_median 0.056638287703196205 agent_compute-ego_min 0.056032594045003256 deviation-center-line_max 1.162429887889763 deviation-center-line_mean 0.7810520238546417 deviation-center-line_min 0.3642142902148309 deviation-heading_max 7.500426184300918 deviation-heading_mean 4.366895876295662 deviation-heading_median 4.057974415359365 deviation-heading_min 0.8499855389305363 driven_any_max 2.3555357196137416 driven_any_mean 1.8068805929159688 driven_any_median 2.175915086470775 driven_any_min 0.7726233216431749 driven_lanedir_consec_max 1.4111111940452985 driven_lanedir_consec_mean 0.8968664612845849 driven_lanedir_consec_min 0.4677098094129053 driven_lanedir_max 1.7414457206761202 driven_lanedir_mean 1.239708250883853 driven_lanedir_median 1.4968355058552694 driven_lanedir_min 0.6868980162132727 in-drivable-lane_max 2.9500000000000046 in-drivable-lane_mean 2.0200000000000133 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.175915086470775, "sim_physics": 0.015275832560422607, "survival_time": 13.900000000000064, "driven_lanedir": 1.4968355058552694, "sim_render-ego": 0.06289447897629773, "in-drivable-lane": 2.100000000000014, "agent_compute-ego": 0.06449973754745593, "deviation-heading": 5.783552217583851, "set_robot_commands": 0.07601959413761715, "deviation-center-line": 0.8692585440334625, "driven_lanedir_consec": 0.9102359788618892, "sim_compute_sim_state": 0.037927603550094495, "sim_compute_performance-ego": 0.061392875026455886, "sim_compute_robot_state-ego": 0.06040051858202159}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3555357196137416, "sim_physics": 0.015990277131398518, "survival_time": 14.950000000000076, "driven_lanedir": 1.7414457206761202, "sim_render-ego": 0.0543863566716512, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.056638287703196205, "deviation-heading": 4.057974415359365, "set_robot_commands": 0.07108969449996948, "deviation-center-line": 1.162429887889763, "driven_lanedir_consec": 1.4111111940452985, "sim_compute_sim_state": 0.034476455052693686, "sim_compute_performance-ego": 0.05606660763422648, "sim_compute_robot_state-ego": 0.05711824258168539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3751406105754054, "sim_physics": 0.015564798635278043, "survival_time": 8.84999999999999, "driven_lanedir": 0.6868980162132727, "sim_render-ego": 0.05392113782591739, "in-drivable-lane": 2.9500000000000046, "agent_compute-ego": 0.05624241613398837, "deviation-heading": 3.642541025303641, "set_robot_commands": 0.06998882994139935, "deviation-center-line": 0.3642142902148309, "driven_lanedir_consec": 0.4677098094129053, "sim_compute_sim_state": 0.03573399209706797, "sim_compute_performance-ego": 0.05455978037947315, "sim_compute_robot_state-ego": 0.05574235673678123}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3551882262767463, "sim_physics": 0.014714643955230712, "survival_time": 14.950000000000076, "driven_lanedir": 1.5172405921600989, "sim_render-ego": 0.053515944480896, "in-drivable-lane": 2.250000000000009, "agent_compute-ego": 0.056032594045003256, "deviation-heading": 7.500426184300918, "set_robot_commands": 0.07077201843261718, "deviation-center-line": 1.076092588515662, "driven_lanedir_consec": 0.9391539045883291, "sim_compute_sim_state": 0.034839308261871337, "sim_compute_performance-ego": 0.053971964518229165, "sim_compute_robot_state-ego": 0.05654064814249674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7726233216431749, "sim_physics": 0.01623986749088063, "survival_time": 5.09999999999999, "driven_lanedir": 0.756121419514503, "sim_render-ego": 0.05594019796334061, "in-drivable-lane": 0, "agent_compute-ego": 0.0578850647982429, "deviation-heading": 0.8499855389305363, "set_robot_commands": 0.07070324935165107, "deviation-center-line": 0.43326480861949, "driven_lanedir_consec": 0.756121419514503, "sim_compute_sim_state": 0.035533837243622426, "sim_compute_performance-ego": 0.05692571284724217, "sim_compute_robot_state-ego": 0.05792852710275089}}set_robot_commands_max 0.07601959413761715 set_robot_commands_mean 0.07171467727265084 set_robot_commands_median 0.07077201843261718 set_robot_commands_min 0.06998882994139935 sim_compute_performance-ego_max 0.061392875026455886 sim_compute_performance-ego_mean 0.056583388081125376 sim_compute_performance-ego_median 0.05606660763422648 sim_compute_performance-ego_min 0.053971964518229165 sim_compute_robot_state-ego_max 0.06040051858202159 sim_compute_robot_state-ego_mean 0.05754605862914717 sim_compute_robot_state-ego_median 0.05711824258168539 sim_compute_robot_state-ego_min 0.05574235673678123 sim_compute_sim_state_max 0.037927603550094495 sim_compute_sim_state_mean 0.03570223924106998 sim_compute_sim_state_median 0.035533837243622426 sim_compute_sim_state_min 0.034476455052693686 sim_physics_max 0.01623986749088063 sim_physics_mean 0.015557083954642104 sim_physics_median 0.015564798635278043 sim_physics_min 0.014714643955230712 sim_render-ego_max 0.06289447897629773 sim_render-ego_mean 0.05613162318362058 sim_render-ego_median 0.0543863566716512 sim_render-ego_min 0.053515944480896 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.550000000000038 survival_time_min 5.09999999999999
No reset possible 18193
2730
Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation failed no idsc-rudolf-114212
2019-04-19 10:29:29+00:00 2019-04-19 10:31:46+00:00 0:02:17 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18189
2778
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-19 10:28:07+00:00 2019-04-19 10:28:51+00:00 0:00:44 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18177
2843
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-114212
2019-04-18 15:13:12+00:00 2019-04-18 15:13:53+00:00 0:00:41 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18172
2840
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation error no idsc-rudolf-114212
2019-04-18 15:09:16+00:00 2019-04-18 15:09:56+00:00 0:00:40 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18165
2828
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-18 13:47:16+00:00 2019-04-18 13:50:48+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8171921272237834 survival_time_median 1.1000000000000003 deviation-center-line_median 0.025668493904927793 in-drivable-lane_median 0.04999999999999999
other stats agent_compute-ego_max 0.15358956654866537 agent_compute-ego_mean 0.1448719447119194 agent_compute-ego_median 0.14522249802299167 agent_compute-ego_min 0.13489925861358645 deviation-center-line_max 0.057019386027434615 deviation-center-line_mean 0.03634226830745448 deviation-center-line_min 0.02280708605632212 deviation-heading_max 0.235756116193223 deviation-heading_mean 0.1638165081234764 deviation-heading_median 0.1411032446854075 deviation-heading_min 0.118601117425238 driven_any_max 1.028556309238097 driven_any_mean 0.8412197852214389 driven_any_median 0.956358012875939 driven_any_min 0.39300074524610096 driven_lanedir_consec_max 0.9648079053779924 driven_lanedir_consec_mean 0.6642871273891694 driven_lanedir_consec_min 0.31973792380899546 driven_lanedir_max 0.9648079053779924 driven_lanedir_mean 0.6642871273891694 driven_lanedir_median 0.8171921272237834 driven_lanedir_min 0.31973792380899546 in-drivable-lane_max 0.7000000000000004 in-drivable-lane_mean 0.1700000000000001 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.012841411258863369, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06879290290500807, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.14522249802299167, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.0756003649338432, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.04117528251979662, "sim_compute_performance-ego": 0.06530075487883194, "sim_compute_robot_state-ego": 0.06729252442069676}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.013523899990579355, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.06454646069070567, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14673893348030423, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07577095861020296, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.0430709693742835, "sim_compute_performance-ego": 0.06349803053814432, "sim_compute_robot_state-ego": 0.06479181414065154}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.01375412940979004, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.06398363546891646, "in-drivable-lane": 0, "agent_compute-ego": 0.13489925861358645, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07337376204403964, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.039327231320467865, "sim_compute_performance-ego": 0.0618091496554288, "sim_compute_robot_state-ego": 0.06312147053805264}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.013588296042548286, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.064432250128852, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.15358956654866537, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07904246118333605, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.04589676856994629, "sim_compute_performance-ego": 0.06138639979892307, "sim_compute_robot_state-ego": 0.06575849321153429}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.014052027150204307, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06804331980253521, "in-drivable-lane": 0, "agent_compute-ego": 0.1439094668940494, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.07819770511827971, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.0408151902650532, "sim_compute_performance-ego": 0.06794693595484684, "sim_compute_robot_state-ego": 0.06604632578398052}}set_robot_commands_max 0.07904246118333605 set_robot_commands_mean 0.07639705037794031 set_robot_commands_median 0.07577095861020296 set_robot_commands_min 0.07337376204403964 sim_compute_performance-ego_max 0.06794693595484684 sim_compute_performance-ego_mean 0.06398825416523499 sim_compute_performance-ego_median 0.06349803053814432 sim_compute_performance-ego_min 0.06138639979892307 sim_compute_robot_state-ego_max 0.06729252442069676 sim_compute_robot_state-ego_mean 0.06540212561898315 sim_compute_robot_state-ego_median 0.06575849321153429 sim_compute_robot_state-ego_min 0.06312147053805264 sim_compute_sim_state_max 0.04589676856994629 sim_compute_sim_state_mean 0.042057088409909495 sim_compute_sim_state_median 0.04117528251979662 sim_compute_sim_state_min 0.039327231320467865 sim_physics_max 0.014052027150204307 sim_physics_mean 0.013551952770397072 sim_physics_median 0.013588296042548286 sim_physics_min 0.012841411258863369 sim_render-ego_max 0.06879290290500807 sim_render-ego_mean 0.06595971379920348 sim_render-ego_median 0.06454646069070567 sim_render-ego_min 0.06398363546891646 simulation-passed 1 survival_time_max 1.1500000000000004 survival_time_mean 0.9600000000000004 survival_time_min 0.45
No reset possible 18155
2819
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-18 13:43:37+00:00 2019-04-18 13:47:09+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8171921272237834 survival_time_median 1.1000000000000003 deviation-center-line_median 0.025668493904927793 in-drivable-lane_median 0.04999999999999999
other stats agent_compute-ego_max 0.14480820455049215 agent_compute-ego_mean 0.14020433574808158 agent_compute-ego_median 0.13923978805541992 agent_compute-ego_min 0.13505569748256518 deviation-center-line_max 0.057019386027434615 deviation-center-line_mean 0.03634226830745448 deviation-center-line_min 0.02280708605632212 deviation-heading_max 0.235756116193223 deviation-heading_mean 0.1638165081234764 deviation-heading_median 0.1411032446854075 deviation-heading_min 0.118601117425238 driven_any_max 1.028556309238097 driven_any_mean 0.8412197852214389 driven_any_median 0.956358012875939 driven_any_min 0.39300074524610096 driven_lanedir_consec_max 0.9648079053779924 driven_lanedir_consec_mean 0.6642871273891694 driven_lanedir_consec_min 0.31973792380899546 driven_lanedir_max 0.9648079053779924 driven_lanedir_mean 0.6642871273891694 driven_lanedir_median 0.8171921272237834 driven_lanedir_min 0.31973792380899546 in-drivable-lane_max 0.7000000000000004 in-drivable-lane_mean 0.1700000000000001 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.012432886206585428, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.05924982609956161, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.13505569748256518, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.0745270874189294, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03810349754665209, "sim_compute_performance-ego": 0.06192850029986838, "sim_compute_robot_state-ego": 0.06476259231567383}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.01257100312606148, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.0585053070731785, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.13923978805541992, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07712504138117252, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.04041636508444081, "sim_compute_performance-ego": 0.061290129371311355, "sim_compute_robot_state-ego": 0.06676532911217731}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.013306292620572176, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.06343865394592285, "in-drivable-lane": 0, "agent_compute-ego": 0.14475551518526944, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07480364496057684, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.03845925764604048, "sim_compute_performance-ego": 0.06068710847334429, "sim_compute_robot_state-ego": 0.06995617259632457}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.013128386603461372, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.06680443551805285, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.13716247346666124, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07568992508782281, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.040202326244778104, "sim_compute_performance-ego": 0.06766880883110894, "sim_compute_robot_state-ego": 0.06774303648206922}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.013229106601915862, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06645629280491878, "in-drivable-lane": 0, "agent_compute-ego": 0.14480820455049215, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.07777582971673262, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.04316442891171104, "sim_compute_performance-ego": 0.06329559025011565, "sim_compute_robot_state-ego": 0.06579510789168508}}set_robot_commands_max 0.07777582971673262 set_robot_commands_mean 0.07598430571304685 set_robot_commands_median 0.07568992508782281 set_robot_commands_min 0.0745270874189294 sim_compute_performance-ego_max 0.06766880883110894 sim_compute_performance-ego_mean 0.06297402744514972 sim_compute_performance-ego_median 0.06192850029986838 sim_compute_performance-ego_min 0.06068710847334429 sim_compute_robot_state-ego_max 0.06995617259632457 sim_compute_robot_state-ego_mean 0.067004447679586 sim_compute_robot_state-ego_median 0.06676532911217731 sim_compute_robot_state-ego_min 0.06476259231567383 sim_compute_sim_state_max 0.04316442891171104 sim_compute_sim_state_mean 0.04006917508672451 sim_compute_sim_state_median 0.040202326244778104 sim_compute_sim_state_min 0.03810349754665209 sim_physics_max 0.013306292620572176 sim_physics_mean 0.012933535031719262 sim_physics_median 0.013128386603461372 sim_physics_min 0.012432886206585428 sim_render-ego_max 0.06680443551805285 sim_render-ego_mean 0.06289090308832693 sim_render-ego_median 0.06343865394592285 sim_render-ego_min 0.0585053070731785 simulation-passed 1 survival_time_max 1.1500000000000004 survival_time_mean 0.9600000000000004 survival_time_min 0.45
No reset possible 18154
2815
Liam Paull 🇨🇦PredictorLast aido2-PRED
step1-simulation success no idsc-rudolf-114212
2019-04-18 13:38:36+00:00 2019-04-18 13:39:25+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11927297265759346 error_L2 0.020447638430606048
No reset possible 18150
2805
Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agent aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-18 12:41:09+00:00 2019-04-18 12:44:41+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8171921272237834 survival_time_median 1.1000000000000003 deviation-center-line_median 0.025668493904927793 in-drivable-lane_median 0.04999999999999999
other stats agent_compute-ego_max 0.15206451001374618 agent_compute-ego_mean 0.1430980144822173 agent_compute-ego_median 0.14119135008917916 agent_compute-ego_min 0.13522153315336807 deviation-center-line_max 0.057019386027434615 deviation-center-line_mean 0.03634226830745448 deviation-center-line_min 0.02280708605632212 deviation-heading_max 0.235756116193223 deviation-heading_mean 0.1638165081234764 deviation-heading_median 0.1411032446854075 deviation-heading_min 0.118601117425238 driven_any_max 1.028556309238097 driven_any_mean 0.8412197852214389 driven_any_median 0.956358012875939 driven_any_min 0.39300074524610096 driven_lanedir_consec_max 0.9648079053779924 driven_lanedir_consec_mean 0.6642871273891694 driven_lanedir_consec_min 0.31973792380899546 driven_lanedir_max 0.9648079053779924 driven_lanedir_mean 0.6642871273891694 driven_lanedir_median 0.8171921272237834 driven_lanedir_min 0.31973792380899546 in-drivable-lane_max 0.7000000000000004 in-drivable-lane_mean 0.1700000000000001 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.012948989868164062, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.05618030091990595, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.13522153315336807, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07172234162040379, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.037043747694596, "sim_compute_performance-ego": 0.0576094855432925, "sim_compute_robot_state-ego": 0.06056378198706586}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.01310586929321289, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.06212674016537874, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15206451001374618, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07738676278487495, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.04147598017816958, "sim_compute_performance-ego": 0.06446435140526813, "sim_compute_robot_state-ego": 0.06629236884739088}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.014316363768144089, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.06224637681787664, "in-drivable-lane": 0, "agent_compute-ego": 0.1403074156154286, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07639503479003906, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.04066073894500733, "sim_compute_performance-ego": 0.063547437841242, "sim_compute_robot_state-ego": 0.06830757314508612}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.013093603981865777, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.0664624638027615, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.14119135008917916, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07242038514879015, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.04032887352837457, "sim_compute_performance-ego": 0.07032095061408149, "sim_compute_robot_state-ego": 0.07058604558308919}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.01386814368398566, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06633628042120683, "in-drivable-lane": 0, "agent_compute-ego": 0.14670526353936447, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.07592893901624177, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.04419157379551938, "sim_compute_performance-ego": 0.06943666307549727, "sim_compute_robot_state-ego": 0.07007537390056409}}set_robot_commands_max 0.07738676278487495 set_robot_commands_mean 0.07477069267206995 set_robot_commands_median 0.07592893901624177 set_robot_commands_min 0.07172234162040379 sim_compute_performance-ego_max 0.07032095061408149 sim_compute_performance-ego_mean 0.06507577769587627 sim_compute_performance-ego_median 0.06446435140526813 sim_compute_performance-ego_min 0.0576094855432925 sim_compute_robot_state-ego_max 0.07058604558308919 sim_compute_robot_state-ego_mean 0.06716502869263923 sim_compute_robot_state-ego_median 0.06830757314508612 sim_compute_robot_state-ego_min 0.06056378198706586 sim_compute_sim_state_max 0.04419157379551938 sim_compute_sim_state_mean 0.040740182828333374 sim_compute_sim_state_median 0.04066073894500733 sim_compute_sim_state_min 0.037043747694596 sim_physics_max 0.014316363768144089 sim_physics_mean 0.013466594119074495 sim_physics_median 0.01310586929321289 sim_physics_min 0.012948989868164062 sim_render-ego_max 0.0664624638027615 sim_render-ego_mean 0.06267043242542594 sim_render-ego_median 0.06224637681787664 sim_render-ego_min 0.05618030091990595 simulation-passed 1 survival_time_max 1.1500000000000004 survival_time_mean 0.9600000000000004 survival_time_min 0.45
No reset possible 18143
2800
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation error no idsc-rudolf-114212
2019-04-18 10:00:59+00:00 2019-04-18 10:23:10+00:00 0:22:11 Waited 1202 seconds [...] Waited 1202 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18087
2708
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-17 14:58:39+00:00 2019-04-17 15:11:27+00:00 0:12:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0395868894381612 survival_time_median 3.899999999999994 deviation-center-line_median 0.3328305610846789 in-drivable-lane_median 0.14999999999999947
other stats agent_compute-ego_max 0.06796915065951464 agent_compute-ego_mean 0.0658083524582385 agent_compute-ego_median 0.06666352417295342 agent_compute-ego_min 0.06199879524035331 deviation-center-line_max 0.6266807364125704 deviation-center-line_mean 0.35477524769716834 deviation-center-line_min 0.12868167078259024 deviation-heading_max 2.7663292017085275 deviation-heading_mean 1.1668013655864022 deviation-heading_median 0.8373897318962056 deviation-heading_min 0.5991496820193504 driven_any_max 2.420342152778294 driven_any_mean 1.354549141663401 driven_any_median 1.252768667541423 driven_any_min 0.6259834529865921 driven_lanedir_consec_max 1.2961445246190346 driven_lanedir_consec_mean 0.9783247048437154 driven_lanedir_consec_min 0.48660457874753504 driven_lanedir_max 1.7970724164659035 driven_lanedir_mean 1.1575141654227272 driven_lanedir_median 1.1681624178430012 driven_lanedir_min 0.48660457874753504 in-drivable-lane_max 1.0499999999999965 in-drivable-lane_mean 0.28999999999999904 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6259834529865921, "sim_physics": 0.020557909477047803, "survival_time": 2.0500000000000007, "driven_lanedir": 0.48660457874753504, "sim_render-ego": 0.06043127687965951, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.06481415469472002, "deviation-heading": 0.7600262797138214, "set_robot_commands": 0.07213963531866306, "deviation-center-line": 0.12868167078259024, "driven_lanedir_consec": 0.48660457874753504, "sim_compute_sim_state": 0.033321869082567165, "sim_compute_performance-ego": 0.0593733903838367, "sim_compute_robot_state-ego": 0.05818743240542528, "sim_compute_robot_state-npc0": 0.06750348137646187, "sim_compute_robot_state-npc1": 0.06270654027054949, "sim_compute_robot_state-npc2": 0.06162266033451732, "sim_compute_robot_state-npc3": 0.061550785855549135}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.420342152778294, "sim_physics": 0.023612254502757495, "survival_time": 7.549999999999981, "driven_lanedir": 1.7970724164659035, "sim_render-ego": 0.06739736708584211, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.06666352417295342, "deviation-heading": 2.7663292017085275, "set_robot_commands": 0.07452901783368446, "deviation-center-line": 0.6266807364125704, "driven_lanedir_consec": 0.9011251135708456, "sim_compute_sim_state": 0.03808243701000087, "sim_compute_performance-ego": 0.0671946449785043, "sim_compute_robot_state-ego": 0.06605600994943783, "sim_compute_robot_state-npc0": 0.0728867906608329, "sim_compute_robot_state-npc1": 0.06720799799786498, "sim_compute_robot_state-npc2": 0.06886582658780331, "sim_compute_robot_state-npc3": 0.06798066366587253}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3171796286314583, "sim_physics": 0.02406826542644966, "survival_time": 4.099999999999993, "driven_lanedir": 1.2961445246190346, "sim_render-ego": 0.06446052760612674, "in-drivable-lane": 0, "agent_compute-ego": 0.06796915065951464, "deviation-heading": 0.5991496820193504, "set_robot_commands": 0.07472788996812774, "deviation-center-line": 0.4116866217736998, "driven_lanedir_consec": 1.2961445246190346, "sim_compute_sim_state": 0.03439819522020293, "sim_compute_performance-ego": 0.06274890318149473, "sim_compute_robot_state-ego": 0.06391681694402927, "sim_compute_robot_state-npc0": 0.0701447085636418, "sim_compute_robot_state-npc1": 0.06553426602991616, "sim_compute_robot_state-npc2": 0.06509833219574719, "sim_compute_robot_state-npc3": 0.06393539324039366}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.252768667541423, "sim_physics": 0.021535054231301337, "survival_time": 3.899999999999994, "driven_lanedir": 1.1681624178430012, "sim_render-ego": 0.05584141535636706, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06199879524035331, "deviation-heading": 0.8373897318962056, "set_robot_commands": 0.07298435308994392, "deviation-center-line": 0.3328305610846789, "driven_lanedir_consec": 1.1681624178430012, "sim_compute_sim_state": 0.03216708012116261, "sim_compute_performance-ego": 0.056624962733342096, "sim_compute_robot_state-ego": 0.05714294237968249, "sim_compute_robot_state-npc0": 0.06005237347040421, "sim_compute_robot_state-npc1": 0.057356904714535445, "sim_compute_robot_state-npc2": 0.05819211862026117, "sim_compute_robot_state-npc3": 0.058578197772686295}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.156471806379239, "sim_physics": 0.022620187865363225, "survival_time": 3.599999999999995, "driven_lanedir": 1.0395868894381612, "sim_render-ego": 0.06245108445485433, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06759613752365112, "deviation-heading": 0.8711119325941071, "set_robot_commands": 0.07326055566469829, "deviation-center-line": 0.27399664843230237, "driven_lanedir_consec": 1.0395868894381612, "sim_compute_sim_state": 0.0357653366194831, "sim_compute_performance-ego": 0.06167741947703891, "sim_compute_robot_state-ego": 0.06092472871144613, "sim_compute_robot_state-npc0": 0.06963748733202617, "sim_compute_robot_state-npc1": 0.06662575072712368, "sim_compute_robot_state-npc2": 0.06510022944874233, "sim_compute_robot_state-npc3": 0.06362047129207188}}set_robot_commands_max 0.07472788996812774 set_robot_commands_mean 0.0735282903750235 set_robot_commands_median 0.07326055566469829 set_robot_commands_min 0.07213963531866306 sim_compute_performance-ego_max 0.0671946449785043 sim_compute_performance-ego_mean 0.06152386415084336 sim_compute_performance-ego_median 0.06167741947703891 sim_compute_performance-ego_min 0.056624962733342096 sim_compute_robot_state-ego_max 0.06605600994943783 sim_compute_robot_state-ego_mean 0.0612455860780042 sim_compute_robot_state-ego_median 0.06092472871144613 sim_compute_robot_state-ego_min 0.05714294237968249 sim_compute_robot_state-npc0_max 0.0728867906608329 sim_compute_robot_state-npc0_mean 0.06804496828067338 sim_compute_robot_state-npc0_median 0.06963748733202617 sim_compute_robot_state-npc0_min 0.06005237347040421 sim_compute_robot_state-npc1_max 0.06720799799786498 sim_compute_robot_state-npc1_mean 0.06388629194799796 sim_compute_robot_state-npc1_median 0.06553426602991616 sim_compute_robot_state-npc1_min 0.057356904714535445 sim_compute_robot_state-npc2_max 0.06886582658780331 sim_compute_robot_state-npc2_mean 0.06377583343741426 sim_compute_robot_state-npc2_median 0.06509833219574719 sim_compute_robot_state-npc2_min 0.05819211862026117 sim_compute_robot_state-npc3_max 0.06798066366587253 sim_compute_robot_state-npc3_mean 0.06313310236531469 sim_compute_robot_state-npc3_median 0.06362047129207188 sim_compute_robot_state-npc3_min 0.058578197772686295 sim_compute_sim_state_max 0.03808243701000087 sim_compute_sim_state_mean 0.03474698361068333 sim_compute_sim_state_median 0.03439819522020293 sim_compute_sim_state_min 0.03216708012116261 sim_physics_max 0.02406826542644966 sim_physics_mean 0.022478734300583905 sim_physics_median 0.022620187865363225 sim_physics_min 0.020557909477047803 sim_render-ego_max 0.06739736708584211 sim_render-ego_mean 0.06211633427656994 sim_render-ego_median 0.06245108445485433 sim_render-ego_min 0.05584141535636706 simulation-passed 1 survival_time_max 7.549999999999981 survival_time_mean 4.239999999999993 survival_time_min 2.0500000000000007
No reset possible 18080
2699
Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-114212
2019-04-17 14:41:26+00:00 2019-04-17 14:53:54+00:00 0:12:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4295619846489447 survival_time_median 1.6000000000000008 deviation-center-line_median 0.07325371549120385 in-drivable-lane_median 0.15000000000000013
other stats agent_compute-ego_max 0.07442486013164958 agent_compute-ego_mean 0.06588728727304267 agent_compute-ego_median 0.0657777264714241 agent_compute-ego_min 0.06017786264419556 deviation-center-line_max 0.5803619961931463 deviation-center-line_mean 0.2286516715076211 deviation-center-line_min 0.014131572308476203 deviation-heading_max 3.5300341502856827 deviation-heading_mean 1.213423634148418 deviation-heading_median 0.4949206280357696 deviation-heading_min 0.23485935983412404 driven_any_max 3.1587909709365434 driven_any_mean 1.2515479324335343 driven_any_median 0.5139883771363143 driven_any_min 0.1922564900124762 driven_lanedir_consec_max 1.6791447530422143 driven_lanedir_consec_mean 0.748698484557926 driven_lanedir_consec_min 0.10341170493653971 driven_lanedir_max 1.8893665875869343 driven_lanedir_mean 0.79074285146687 driven_lanedir_median 0.4295619846489447 driven_lanedir_min 0.10341170493653971 in-drivable-lane_max 2.5500000000000007 in-drivable-lane_mean 0.9999999999999986 in-drivable-lane_min 0.05000000000000005 per-episodes details {"udem1-0-0": {"driven_any": 3.1587909709365434, "sim_physics": 0.02525908863125135, "survival_time": 9.950000000000006, "driven_lanedir": 1.8893665875869343, "sim_render-ego": 0.06271439341444467, "in-drivable-lane": 2.5500000000000007, "agent_compute-ego": 0.06260478197030686, "deviation-heading": 3.5300341502856827, "set_robot_commands": 0.0736141959626471, "deviation-center-line": 0.5803619961931463, "driven_lanedir_consec": 1.6791447530422143, "sim_compute_sim_state": 0.03453456337128452, "sim_compute_performance-ego": 0.06118986474808736, "sim_compute_robot_state-ego": 0.0611780744102133, "sim_compute_robot_state-npc0": 0.06675707515160642, "sim_compute_robot_state-npc1": 0.062037935209034674, "sim_compute_robot_state-npc2": 0.06241248360830336, "sim_compute_robot_state-npc3": 0.06237557066145854}, "udem1-1-0": {"driven_any": 0.1922564900124762, "sim_physics": 0.02374744415283203, "survival_time": 0.6, "driven_lanedir": 0.10341170493653971, "sim_render-ego": 0.05318979422251383, "in-drivable-lane": 0.15000000000000002, "agent_compute-ego": 0.06017786264419556, "deviation-heading": 0.23485935983412404, "set_robot_commands": 0.07216568787892659, "deviation-center-line": 0.014131572308476203, "driven_lanedir_consec": 0.10341170493653971, "sim_compute_sim_state": 0.03170551856358846, "sim_compute_performance-ego": 0.05190229415893555, "sim_compute_robot_state-ego": 0.05545228719711304, "sim_compute_robot_state-npc0": 0.05964595079421997, "sim_compute_robot_state-npc1": 0.05312633514404297, "sim_compute_robot_state-npc2": 0.05439488093058268, "sim_compute_robot_state-npc3": 0.05603365103403727}, "udem1-2-0": {"driven_any": 0.5139883771363143, "sim_physics": 0.02825760841369629, "survival_time": 1.6000000000000008, "driven_lanedir": 0.4295619846489447, "sim_render-ego": 0.06825683265924454, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.0657777264714241, "deviation-heading": 0.4949206280357696, "set_robot_commands": 0.07155575603246689, "deviation-center-line": 0.07325371549120385, "driven_lanedir_consec": 0.4295619846489447, "sim_compute_sim_state": 0.03638485074043274, "sim_compute_performance-ego": 0.06182270497083664, "sim_compute_robot_state-ego": 0.061621516942977905, "sim_compute_robot_state-npc0": 0.07070044428110123, "sim_compute_robot_state-npc1": 0.06564455479383469, "sim_compute_robot_state-npc2": 0.0651109367609024, "sim_compute_robot_state-npc3": 0.06541573256254196}, "udem1-3-0": {"driven_any": 0.28872756443826275, "sim_physics": 0.024477720260620117, "survival_time": 0.9000000000000002, "driven_lanedir": 0.21420470579713036, "sim_render-ego": 0.06553828716278076, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06645120514763726, "deviation-heading": 0.37929247003322614, "set_robot_commands": 0.07361548476748997, "deviation-center-line": 0.028379829333502003, "driven_lanedir_consec": 0.21420470579713036, "sim_compute_sim_state": 0.035543852382236056, "sim_compute_performance-ego": 0.064910093943278, "sim_compute_robot_state-ego": 0.06059032016330295, "sim_compute_robot_state-npc0": 0.07710247569613987, "sim_compute_robot_state-npc1": 0.0694757170147366, "sim_compute_robot_state-npc2": 0.06604724460177952, "sim_compute_robot_state-npc3": 0.06477717558542888}, "udem1-4-0": {"driven_any": 2.1039762596440745, "sim_physics": 0.02840410298063555, "survival_time": 6.549999999999985, "driven_lanedir": 1.3171692743648011, "sim_render-ego": 0.06969480842124415, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.07442486013164958, "deviation-heading": 1.428011562553288, "set_robot_commands": 0.07989320318207487, "deviation-center-line": 0.44713124421177736, "driven_lanedir_consec": 1.3171692743648011, "sim_compute_sim_state": 0.03787055452361362, "sim_compute_performance-ego": 0.06700848623086478, "sim_compute_robot_state-ego": 0.06696078249516378, "sim_compute_robot_state-npc0": 0.0743862563417158, "sim_compute_robot_state-npc1": 0.07004757691885678, "sim_compute_robot_state-npc2": 0.0676634166076893, "sim_compute_robot_state-npc3": 0.06864002824739646}}set_robot_commands_max 0.07989320318207487 set_robot_commands_mean 0.07416886556472109 set_robot_commands_median 0.0736141959626471 set_robot_commands_min 0.07155575603246689 sim_compute_performance-ego_max 0.06700848623086478 sim_compute_performance-ego_mean 0.06136668881040046 sim_compute_performance-ego_median 0.06182270497083664 sim_compute_performance-ego_min 0.05190229415893555 sim_compute_robot_state-ego_max 0.06696078249516378 sim_compute_robot_state-ego_mean 0.0611605962417542 sim_compute_robot_state-ego_median 0.0611780744102133 sim_compute_robot_state-ego_min 0.05545228719711304 sim_compute_robot_state-npc0_max 0.07710247569613987 sim_compute_robot_state-npc0_mean 0.06971844045295665 sim_compute_robot_state-npc0_median 0.07070044428110123 sim_compute_robot_state-npc0_min 0.05964595079421997 sim_compute_robot_state-npc1_max 0.07004757691885678 sim_compute_robot_state-npc1_mean 0.06406642381610114 sim_compute_robot_state-npc1_median 0.06564455479383469 sim_compute_robot_state-npc1_min 0.05312633514404297 sim_compute_robot_state-npc2_max 0.0676634166076893 sim_compute_robot_state-npc2_mean 0.06312579250185145 sim_compute_robot_state-npc2_median 0.0651109367609024 sim_compute_robot_state-npc2_min 0.05439488093058268 sim_compute_robot_state-npc3_max 0.06864002824739646 sim_compute_robot_state-npc3_mean 0.06344843161817262 sim_compute_robot_state-npc3_median 0.06477717558542888 sim_compute_robot_state-npc3_min 0.05603365103403727 sim_compute_sim_state_max 0.03787055452361362 sim_compute_sim_state_mean 0.03520786791623108 sim_compute_sim_state_median 0.035543852382236056 sim_compute_sim_state_min 0.03170551856358846 sim_physics_max 0.02840410298063555 sim_physics_mean 0.026029192887807067 sim_physics_median 0.02525908863125135 sim_physics_min 0.02374744415283203 sim_render-ego_max 0.06969480842124415 sim_render-ego_mean 0.06387882317604558 sim_render-ego_median 0.06553828716278076 sim_render-ego_min 0.05318979422251383 simulation-passed 1 survival_time_max 9.950000000000006 survival_time_mean 3.919999999999999 survival_time_min 0.6
No reset possible 18075
2676
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-114212
2019-04-17 14:32:25+00:00 2019-04-17 14:40:42+00:00 0:08:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0779495107233608 survival_time_median 3.8499999999999943 deviation-center-line_median 0.2540948546016075 in-drivable-lane_median 0.8999999999999968
other stats agent_compute-ego_max 0.07668220191388517 agent_compute-ego_mean 0.07219972531733954 agent_compute-ego_median 0.07100063181938009 agent_compute-ego_min 0.06810680302706631 deviation-center-line_max 0.5518104527461429 deviation-center-line_mean 0.287513676447962 deviation-center-line_min 0.0356172844463082 deviation-heading_max 2.658626604166911 deviation-heading_mean 1.3787855267749871 deviation-heading_median 1.0564528689051929 deviation-heading_min 0.3615496189278719 driven_any_max 3.240490528063276 driven_any_mean 1.6111531427708552 driven_any_median 1.2368247231472835 driven_any_min 0.4498391201744884 driven_lanedir_consec_max 1.6250797295439392 driven_lanedir_consec_mean 0.9950408064768852 driven_lanedir_consec_min 0.3615575800975819 driven_lanedir_max 1.8549713289665697 driven_lanedir_mean 1.0891224406684463 driven_lanedir_median 1.0779495107233608 driven_lanedir_min 0.3615575800975819 in-drivable-lane_max 3.699999999999995 in-drivable-lane_mean 1.179999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4498391201744884, "sim_physics": 0.01393296718597412, "survival_time": 1.5000000000000009, "driven_lanedir": 0.42204730553765657, "sim_render-ego": 0.07500031789143881, "in-drivable-lane": 0, "agent_compute-ego": 0.07456700007120769, "deviation-heading": 0.3615496189278719, "set_robot_commands": 0.07822261651357015, "deviation-center-line": 0.09472533124364976, "driven_lanedir_consec": 0.42204730553765657, "sim_compute_sim_state": 0.04269938468933106, "sim_compute_performance-ego": 0.06986323197682699, "sim_compute_robot_state-ego": 0.06867938041687012}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.375083386952654, "sim_physics": 0.014195250498281945, "survival_time": 7.399999999999982, "driven_lanedir": 1.8549713289665697, "sim_render-ego": 0.06887875054333661, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.07668220191388517, "deviation-heading": 2.3223662878313336, "set_robot_commands": 0.082411303713515, "deviation-center-line": 0.5013204592021013, "driven_lanedir_consec": 1.488569906481888, "sim_compute_sim_state": 0.04277319038236464, "sim_compute_performance-ego": 0.06979683283213023, "sim_compute_robot_state-ego": 0.06863485316972474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.240490528063276, "sim_physics": 0.013620259738204504, "survival_time": 10.100000000000009, "driven_lanedir": 1.729086478017064, "sim_render-ego": 0.06895308093269273, "in-drivable-lane": 3.699999999999995, "agent_compute-ego": 0.07064198975515838, "deviation-heading": 2.658626604166911, "set_robot_commands": 0.07735600093803784, "deviation-center-line": 0.5518104527461429, "driven_lanedir_consec": 1.6250797295439392, "sim_compute_sim_state": 0.04309713958513619, "sim_compute_performance-ego": 0.06680771383908715, "sim_compute_robot_state-ego": 0.06805381444421145}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7535279555165748, "sim_physics": 0.013528823852539062, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3615575800975819, "sim_render-ego": 0.06627020430057606, "in-drivable-lane": 1.0499999999999992, "agent_compute-ego": 0.07100063181938009, "deviation-heading": 0.4949322540436274, "set_robot_commands": 0.08065439285115993, "deviation-center-line": 0.0356172844463082, "driven_lanedir_consec": 0.3615575800975819, "sim_compute_sim_state": 0.04185742012997891, "sim_compute_performance-ego": 0.06360821013754987, "sim_compute_robot_state-ego": 0.06680742730485632}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2368247231472835, "sim_physics": 0.013635353608564896, "survival_time": 3.8499999999999943, "driven_lanedir": 1.0779495107233608, "sim_render-ego": 0.06277311003053343, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.06810680302706631, "deviation-heading": 1.0564528689051929, "set_robot_commands": 0.07866013204896605, "deviation-center-line": 0.2540948546016075, "driven_lanedir_consec": 1.0779495107233608, "sim_compute_sim_state": 0.03913769783911767, "sim_compute_performance-ego": 0.0626502749207732, "sim_compute_robot_state-ego": 0.06405439005269632}}set_robot_commands_max 0.082411303713515 set_robot_commands_mean 0.0794608892130498 set_robot_commands_median 0.07866013204896605 set_robot_commands_min 0.07735600093803784 sim_compute_performance-ego_max 0.06986323197682699 sim_compute_performance-ego_mean 0.06654525274127349 sim_compute_performance-ego_median 0.06680771383908715 sim_compute_performance-ego_min 0.0626502749207732 sim_compute_robot_state-ego_max 0.06867938041687012 sim_compute_robot_state-ego_mean 0.0672459730776718 sim_compute_robot_state-ego_median 0.06805381444421145 sim_compute_robot_state-ego_min 0.06405439005269632 sim_compute_sim_state_max 0.04309713958513619 sim_compute_sim_state_mean 0.041912966525185696 sim_compute_sim_state_median 0.04269938468933106 sim_compute_sim_state_min 0.03913769783911767 sim_physics_max 0.014195250498281945 sim_physics_mean 0.013782530976712906 sim_physics_median 0.013635353608564896 sim_physics_min 0.013528823852539062 sim_render-ego_max 0.07500031789143881 sim_render-ego_mean 0.06837509273971554 sim_render-ego_median 0.06887875054333661 sim_render-ego_min 0.06277311003053343 simulation-passed 1 survival_time_max 10.100000000000009 survival_time_mean 5.039999999999997 survival_time_min 1.5000000000000009
No reset possible