Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 21924
3354
Isabelle Guyon Β πΊπΈchallenge-aido_LF-template-tensorflow aido2-LF-sim-testing
step1-simulation error no idsc-rudolf-11810
2019-05-13 05:07:33+00:00 2019-05-13 05:10:09+00:00 0:02:36 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 305, in run_episode
sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "set_robot_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 301, in on_received_set_robot_commands
|| raise Exception(msg)
|| Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 305, in run_episode
> sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "set_robot_commands".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 301, in on_received_set_robot_commands
> || raise Exception(msg)
> || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21915
3348
Anastasiya Nikolskaya Β π·πΊJetBrains Research aido2-LF-sim-testing
step1-simulation success no idsc-rudolf-11810
2019-05-12 21:00:50+00:00 2019-05-12 21:52:43+00:00 0:51:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.2066925011934018 survival_time_median 14.950000000000076 deviation-center-line_median 0.9301535352877276 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2380029018719991 agent_compute-ego_mean 0.22418463942744213 agent_compute-ego_median 0.2334185814857483 agent_compute-ego_min 0.08527887923808038 deviation-center-line_max 1.4529290295434738 deviation-center-line_mean 0.9339552401547064 deviation-center-line_min 0.4576398044170365 deviation-heading_max 3.2115347209552185 deviation-heading_mean 1.8918636453991824 deviation-heading_median 2.1127700530875493 deviation-heading_min 0.5841706400793737 driven_any_max 2.8163315842990677 driven_any_mean 2.1953857151935305 driven_any_median 2.5414382653419847 driven_any_min 1.0944556482651724 driven_lanedir_consec_max 2.715237460896335 driven_lanedir_consec_mean 2.0873517584730275 driven_lanedir_consec_min 1.022703680831499 driven_lanedir_max 2.715237460896335 driven_lanedir_mean 2.0873517584730275 driven_lanedir_median 2.2066925011934018 driven_lanedir_min 1.022703680831499 in-drivable-lane_max 2.950000000000019 in-drivable-lane_mean 0.5366666666666695 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4025031087107118, "sim_physics": 0.06797293922569178, "survival_time": 7.89999999999998, "driven_lanedir": 1.37139431977119, "sim_render-ego": 0.07337802573095394, "in-drivable-lane": 0, "agent_compute-ego": 0.08527887923808038, "deviation-heading": 1.1899928265217656, "set_robot_commands": 0.08574164064624641, "deviation-center-line": 0.6003671788138376, "driven_lanedir_consec": 1.37139431977119, "sim_compute_sim_state": 0.0457698785806004, "sim_compute_performance-ego": 0.07415815999236287, "sim_compute_robot_state-ego": 0.07218772851968114}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.8163315842990677, "sim_physics": 0.0674357271194458, "survival_time": 14.950000000000076, "driven_lanedir": 2.649403661498183, "sim_render-ego": 0.07309436321258544, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.2268456530570984, "deviation-heading": 2.1127700530875493, "set_robot_commands": 0.08034839471181233, "deviation-center-line": 1.2782148008017615, "driven_lanedir_consec": 2.649403661498183, "sim_compute_sim_state": 0.0462497067451477, "sim_compute_performance-ego": 0.07559972842534383, "sim_compute_robot_state-ego": 0.07315677881240845}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0944556482651724, "sim_physics": 0.06895427582627636, "survival_time": 5.899999999999987, "driven_lanedir": 1.0878399356366617, "sim_render-ego": 0.07273697853088379, "in-drivable-lane": 0, "agent_compute-ego": 0.23278203859167584, "deviation-heading": 0.5841706400793737, "set_robot_commands": 0.07962633189508471, "deviation-center-line": 0.5924221074446333, "driven_lanedir_consec": 1.0878399356366617, "sim_compute_sim_state": 0.04673378750429315, "sim_compute_performance-ego": 0.07462282099966276, "sim_compute_robot_state-ego": 0.07191978268704172}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1215888613870135, "sim_physics": 0.0669019241032638, "survival_time": 6.349999999999985, "driven_lanedir": 1.022703680831499, "sim_render-ego": 0.07403473028047818, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.2376549243927002, "deviation-heading": 1.377637173585657, "set_robot_commands": 0.08453762437414936, "deviation-center-line": 0.4576398044170365, "driven_lanedir_consec": 1.022703680831499, "sim_compute_sim_state": 0.046876088840754955, "sim_compute_performance-ego": 0.07338734499112827, "sim_compute_robot_state-ego": 0.07110618418595922}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.674685336927382, "sim_physics": 0.06846738974253337, "survival_time": 14.950000000000076, "driven_lanedir": 2.6260145957965886, "sim_render-ego": 0.07334964275360108, "in-drivable-lane": 0, "agent_compute-ego": 0.23708425919214884, "deviation-heading": 2.2140985922638663, "set_robot_commands": 0.08301260073979695, "deviation-center-line": 0.8453270224858781, "driven_lanedir_consec": 2.6260145957965886, "sim_compute_sim_state": 0.04660413106282552, "sim_compute_performance-ego": 0.07594935735066732, "sim_compute_robot_state-ego": 0.07387855688730875}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.551186534505378, "sim_physics": 0.06854668776194255, "survival_time": 14.950000000000076, "driven_lanedir": 2.129470465663208, "sim_render-ego": 0.07298300584157308, "in-drivable-lane": 2.950000000000019, "agent_compute-ego": 0.23206863880157472, "deviation-heading": 2.318370223057099, "set_robot_commands": 0.08410014867782593, "deviation-center-line": 1.272558621548019, "driven_lanedir_consec": 2.129470465663208, "sim_compute_sim_state": 0.04602165619532267, "sim_compute_performance-ego": 0.07573211431503296, "sim_compute_robot_state-ego": 0.07371534824371338}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.5414382653419847, "sim_physics": 0.06853397210439047, "survival_time": 14.950000000000076, "driven_lanedir": 2.3365954672235665, "sim_render-ego": 0.07335599978764852, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.23794784466425575, "deviation-heading": 3.0468167084634405, "set_robot_commands": 0.0833391809463501, "deviation-center-line": 0.628431525833161, "driven_lanedir_consec": 2.3365954672235665, "sim_compute_sim_state": 0.04627355972925822, "sim_compute_performance-ego": 0.07538773775100709, "sim_compute_robot_state-ego": 0.07272570610046386}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.459357645035393, "sim_physics": 0.06972143014272054, "survival_time": 14.950000000000076, "driven_lanedir": 2.2066925011934018, "sim_render-ego": 0.07466840187708537, "in-drivable-lane": 1.6499999999999977, "agent_compute-ego": 0.2380029018719991, "deviation-heading": 2.7101256522596944, "set_robot_commands": 0.0827820881207784, "deviation-center-line": 1.286779011151573, "driven_lanedir_consec": 2.2066925011934018, "sim_compute_sim_state": 0.04687231620152792, "sim_compute_performance-ego": 0.075718887646993, "sim_compute_robot_state-ego": 0.07380684455235799}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.9842734685891796, "sim_physics": 0.06720489093235561, "survival_time": 10.500000000000014, "driven_lanedir": 1.9567914466800265, "sim_render-ego": 0.07401771658942813, "in-drivable-lane": 0, "agent_compute-ego": 0.23309940270015173, "deviation-heading": 1.4986670640821167, "set_robot_commands": 0.08378275916689919, "deviation-center-line": 0.9301535352877276, "driven_lanedir_consec": 1.9567914466800265, "sim_compute_sim_state": 0.04655827681223552, "sim_compute_performance-ego": 0.07639206591106597, "sim_compute_robot_state-ego": 0.0729160331544422}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.611209573596589, "sim_physics": 0.06927555720011393, "survival_time": 14.950000000000076, "driven_lanedir": 2.574536674927988, "sim_render-ego": 0.07431631803512573, "in-drivable-lane": 0, "agent_compute-ego": 0.23595105330149332, "deviation-heading": 2.2423939509184763, "set_robot_commands": 0.08071735143661499, "deviation-center-line": 0.8819581262903343, "driven_lanedir_consec": 2.574536674927988, "sim_compute_sim_state": 0.04647399187088013, "sim_compute_performance-ego": 0.07367863972981771, "sim_compute_robot_state-ego": 0.0725760293006897}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.7430768647137644, "sim_physics": 0.06817471742630005, "survival_time": 14.950000000000076, "driven_lanedir": 2.711510907262867, "sim_render-ego": 0.07373012145360311, "in-drivable-lane": 0, "agent_compute-ego": 0.2334185814857483, "deviation-heading": 1.9436117934018349, "set_robot_commands": 0.08222134828567505, "deviation-center-line": 1.0634158796711677, "driven_lanedir_consec": 2.711510907262867, "sim_compute_sim_state": 0.04674177964528402, "sim_compute_performance-ego": 0.07576759338378906, "sim_compute_robot_state-ego": 0.07380705595016479}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.5727750511212335, "sim_physics": 0.06937538146972656, "survival_time": 14.950000000000076, "driven_lanedir": 2.377632194665197, "sim_render-ego": 0.0745687993367513, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.23750534454981487, "deviation-heading": 3.2115347209552185, "set_robot_commands": 0.08183018604914348, "deviation-center-line": 0.9743873688925117, "driven_lanedir_consec": 2.377632194665197, "sim_compute_sim_state": 0.04664909680684408, "sim_compute_performance-ego": 0.07529056708017985, "sim_compute_robot_state-ego": 0.07283778031667074}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.789845483437343, "sim_physics": 0.0675027330716451, "survival_time": 14.950000000000076, "driven_lanedir": 2.715237460896335, "sim_render-ego": 0.07311074097951253, "in-drivable-lane": 0, "agent_compute-ego": 0.23366199890772504, "deviation-heading": 2.2050485370546244, "set_robot_commands": 0.08197247823079427, "deviation-center-line": 1.4529290295434738, "driven_lanedir_consec": 2.715237460896335, "sim_compute_sim_state": 0.04659231742223104, "sim_compute_performance-ego": 0.07459591468175253, "sim_compute_robot_state-ego": 0.0715686281522115}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.146659781961817, "sim_physics": 0.06646258742720992, "survival_time": 10.800000000000018, "driven_lanedir": 2.1328834211810337, "sim_render-ego": 0.0730183047276956, "in-drivable-lane": 0, "agent_compute-ego": 0.23055793952058865, "deviation-heading": 1.022918024895751, "set_robot_commands": 0.08180512101561935, "deviation-center-line": 1.0007633050553484, "driven_lanedir_consec": 2.1328834211810337, "sim_compute_sim_state": 0.04558992827380145, "sim_compute_performance-ego": 0.07438926453943606, "sim_compute_robot_state-ego": 0.0714529554049174}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.4213985200109271, "sim_physics": 0.0652049207687378, "survival_time": 7.499999999999981, "driven_lanedir": 1.411569643867665, "sim_render-ego": 0.0730050245920817, "in-drivable-lane": 0, "agent_compute-ego": 0.23091013113657632, "deviation-heading": 0.6997987203612638, "set_robot_commands": 0.08253798961639404, "deviation-center-line": 0.743981285084133, "driven_lanedir_consec": 1.411569643867665, "sim_compute_sim_state": 0.04645154635111491, "sim_compute_performance-ego": 0.07435657183329264, "sim_compute_robot_state-ego": 0.07110254287719726}}set_robot_commands_max 0.08574164064624641 set_robot_commands_mean 0.08255701626087898 set_robot_commands_median 0.08253798961639404 set_robot_commands_min 0.07962633189508471 sim_compute_performance-ego_max 0.07639206591106597 sim_compute_performance-ego_mean 0.07500178457543545 sim_compute_performance-ego_median 0.07529056708017985 sim_compute_performance-ego_min 0.07338734499112827 sim_compute_robot_state-ego_max 0.07387855688730875 sim_compute_robot_state-ego_mean 0.07258386367634855 sim_compute_robot_state-ego_median 0.07272570610046386 sim_compute_robot_state-ego_min 0.07110254287719726 sim_compute_sim_state_max 0.046876088840754955 sim_compute_sim_state_mean 0.04643053746947478 sim_compute_sim_state_median 0.04655827681223552 sim_compute_sim_state_min 0.04558992827380145 sim_physics_max 0.06972143014272054 sim_physics_mean 0.0679823422881569 sim_physics_median 0.06817471742630005 sim_physics_min 0.0652049207687378 sim_render-ego_max 0.07466840187708537 sim_render-ego_mean 0.07355787824860051 sim_render-ego_median 0.07335599978764852 sim_render-ego_min 0.07273697853088379 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.233333333333375 survival_time_min 5.899999999999987
No reset possible 21909
3343
Anastasiya Nikolskaya Β π·πΊJetBrains Research aido2-LFV-sim-testing
step1-simulation error no idsc-rudolf-11810
2019-05-12 19:02:44+00:00 2019-05-12 20:05:06+00:00 1:02:22 Waited 3600 seconds [...] Waited 3600 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21901
3346
Anastasiya Nikolskaya Β π·πΊJetBrains Research aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-11810
2019-05-12 17:35:18+00:00 2019-05-12 17:59:09+00:00 0:23:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.232696476695345 survival_time_median 14.950000000000076 deviation-center-line_median 0.9224158216552956 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07597048918406168 agent_compute-ego_mean 0.07505520070682872 agent_compute-ego_median 0.07558151801427206 agent_compute-ego_min 0.07254573648626154 deviation-center-line_max 1.335881201779253 deviation-center-line_mean 0.9405201319322748 deviation-center-line_min 0.21546046731802107 deviation-heading_max 3.5890954083037268 deviation-heading_mean 2.1668105613346738 deviation-heading_median 2.071157111129021 deviation-heading_min 0.47283011089614985 driven_any_max 2.8767452443375965 driven_any_mean 2.205302782356782 driven_any_median 2.5632841551347583 driven_any_min 0.474120059090132 driven_lanedir_consec_max 2.676780606996035 driven_lanedir_consec_mean 2.020013037483385 driven_lanedir_consec_min 0.459173729506184 driven_lanedir_max 2.676780606996035 driven_lanedir_mean 2.069240165883814 driven_lanedir_median 2.3568153052499543 driven_lanedir_min 0.459173729506184 in-drivable-lane_max 1.900000000000027 in-drivable-lane_mean 0.6700000000000044 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 2.5632841551347583, "sim_physics": 0.11424448649088542, "survival_time": 14.950000000000076, "driven_lanedir": 2.234275295394725, "sim_render-ego": 0.06592023213704427, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.07578929583231608, "deviation-heading": 2.9561828865722157, "set_robot_commands": 0.08139978408813477, "deviation-center-line": 0.9143143028895894, "driven_lanedir_consec": 2.232696476695345, "sim_compute_sim_state": 0.03772622108459472, "sim_compute_performance-ego": 0.06766800006230672, "sim_compute_robot_state-ego": 0.06599974632263184, "sim_compute_robot_state-npc0": 0.07477005004882813, "sim_compute_robot_state-npc1": 0.06967592636744181, "sim_compute_robot_state-npc2": 0.06866602420806885, "sim_compute_robot_state-npc3": 0.06756898800532023}, "udem1-1-0": {"driven_any": 2.4635651328721315, "sim_physics": 0.12297997792561847, "survival_time": 14.950000000000076, "driven_lanedir": 2.3568153052499543, "sim_render-ego": 0.06744911829630534, "in-drivable-lane": 0, "agent_compute-ego": 0.07538896401723226, "deviation-heading": 3.5890954083037268, "set_robot_commands": 0.07941687107086182, "deviation-center-line": 0.9224158216552956, "driven_lanedir_consec": 2.1897098791722653, "sim_compute_sim_state": 0.03834172964096069, "sim_compute_performance-ego": 0.06781228462855021, "sim_compute_robot_state-ego": 0.06667406638463338, "sim_compute_robot_state-npc0": 0.07632864157358805, "sim_compute_robot_state-npc1": 0.07163353045781454, "sim_compute_robot_state-npc2": 0.07016895214716594, "sim_compute_robot_state-npc3": 0.06904584248860678}, "udem1-2-0": {"driven_any": 2.6487993203492906, "sim_physics": 0.13593744119008383, "survival_time": 14.950000000000076, "driven_lanedir": 2.6191558922721705, "sim_render-ego": 0.06972483396530152, "in-drivable-lane": 0, "agent_compute-ego": 0.07558151801427206, "deviation-heading": 2.071157111129021, "set_robot_commands": 0.07946429411570231, "deviation-center-line": 1.3145288660192165, "driven_lanedir_consec": 2.541704495047094, "sim_compute_sim_state": 0.03986640135447184, "sim_compute_performance-ego": 0.07127240339914957, "sim_compute_robot_state-ego": 0.06788080930709839, "sim_compute_robot_state-npc0": 0.07710919539133708, "sim_compute_robot_state-npc1": 0.07206451495488485, "sim_compute_robot_state-npc2": 0.07150033076604208, "sim_compute_robot_state-npc3": 0.07050993283589681}, "udem1-3-0": {"driven_any": 0.474120059090132, "sim_physics": 0.12037192257967862, "survival_time": 2.7499999999999982, "driven_lanedir": 0.459173729506184, "sim_render-ego": 0.06591783436861905, "in-drivable-lane": 0, "agent_compute-ego": 0.07254573648626154, "deviation-heading": 0.47283011089614985, "set_robot_commands": 0.07591150023720482, "deviation-center-line": 0.21546046731802107, "driven_lanedir_consec": 0.459173729506184, "sim_compute_sim_state": 0.037111642143943094, "sim_compute_performance-ego": 0.06823493784124202, "sim_compute_robot_state-ego": 0.0635957501151345, "sim_compute_robot_state-npc0": 0.0725651047446511, "sim_compute_robot_state-npc1": 0.06712772195989436, "sim_compute_robot_state-npc2": 0.06533251675692471, "sim_compute_robot_state-npc3": 0.06478611339222301}, "udem1-4-0": {"driven_any": 2.8767452443375965, "sim_physics": 0.11521276235580444, "survival_time": 14.950000000000076, "driven_lanedir": 2.676780606996035, "sim_render-ego": 0.06732568422953288, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.07597048918406168, "deviation-heading": 1.744787289772258, "set_robot_commands": 0.07827233950297038, "deviation-center-line": 1.335881201779253, "driven_lanedir_consec": 2.676780606996035, "sim_compute_sim_state": 0.03820527871449789, "sim_compute_performance-ego": 0.06807093381881714, "sim_compute_robot_state-ego": 0.06616626103719075, "sim_compute_robot_state-npc0": 0.07596100489298503, "sim_compute_robot_state-npc1": 0.07088379542032877, "sim_compute_robot_state-npc2": 0.07027758200963338, "sim_compute_robot_state-npc3": 0.06938046137491861}}set_robot_commands_max 0.08139978408813477 set_robot_commands_mean 0.07889295780297483 set_robot_commands_median 0.07941687107086182 set_robot_commands_min 0.07591150023720482 sim_compute_performance-ego_max 0.07127240339914957 sim_compute_performance-ego_mean 0.06861171195001313 sim_compute_performance-ego_median 0.06807093381881714 sim_compute_performance-ego_min 0.06766800006230672 sim_compute_robot_state-ego_max 0.06788080930709839 sim_compute_robot_state-ego_mean 0.06606332663333778 sim_compute_robot_state-ego_median 0.06616626103719075 sim_compute_robot_state-ego_min 0.0635957501151345 sim_compute_robot_state-npc0_max 0.07710919539133708 sim_compute_robot_state-npc0_mean 0.07534679933027788 sim_compute_robot_state-npc0_median 0.07596100489298503 sim_compute_robot_state-npc0_min 0.0725651047446511 sim_compute_robot_state-npc1_max 0.07206451495488485 sim_compute_robot_state-npc1_mean 0.07027709783207288 sim_compute_robot_state-npc1_median 0.07088379542032877 sim_compute_robot_state-npc1_min 0.06712772195989436 sim_compute_robot_state-npc2_max 0.07150033076604208 sim_compute_robot_state-npc2_mean 0.06918908117756699 sim_compute_robot_state-npc2_median 0.07016895214716594 sim_compute_robot_state-npc2_min 0.06533251675692471 sim_compute_robot_state-npc3_max 0.07050993283589681 sim_compute_robot_state-npc3_mean 0.06825826761939309 sim_compute_robot_state-npc3_median 0.06904584248860678 sim_compute_robot_state-npc3_min 0.06478611339222301 sim_compute_sim_state_max 0.03986640135447184 sim_compute_sim_state_mean 0.03825025458769365 sim_compute_sim_state_median 0.03820527871449789 sim_compute_sim_state_min 0.037111642143943094 sim_physics_max 0.13593744119008383 sim_physics_mean 0.12174931810841416 sim_physics_median 0.12037192257967862 sim_physics_min 0.11424448649088542 sim_render-ego_max 0.06972483396530152 sim_render-ego_mean 0.06726754059936062 sim_render-ego_median 0.06732568422953288 sim_render-ego_min 0.06591783436861905 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.510000000000062 survival_time_min 2.7499999999999982
No reset possible 21886
3334
FANG MEIYI Β πΈπ¬test aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-11810
2019-05-11 16:47:34+00:00 2019-05-11 17:20:09+00:00 0:32:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.9428343360058773 survival_time_median 14.950000000000076 deviation-center-line_median 0.7281257366712028 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.1707615089416504 agent_compute-ego_mean 0.16867760848999022 agent_compute-ego_median 0.16830119450887043 agent_compute-ego_min 0.166589728196462 deviation-center-line_max 1.0657129082071388 deviation-center-line_mean 0.7625354644335498 deviation-center-line_min 0.5502583403983816 deviation-heading_max 2.324785011429918 deviation-heading_mean 2.068763350559729 deviation-heading_median 2.147546975151481 deviation-heading_min 1.692527153405811 driven_any_max 3.252970307613809 driven_any_mean 3.1008126117244488 driven_any_median 3.0655173474463124 driven_any_min 3.0334903469252934 driven_lanedir_consec_max 3.056001104108241 driven_lanedir_consec_mean 2.7364746188702345 driven_lanedir_consec_min 2.099986871801573 driven_lanedir_max 3.204082216138748 driven_lanedir_mean 3.053953058066713 driven_lanedir_median 3.031656393344144 driven_lanedir_min 2.9852570287090665 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 3.0655173474463124, "sim_physics": 0.1294301152229309, "survival_time": 14.950000000000076, "driven_lanedir": 3.031656393344144, "sim_render-ego": 0.07333547035853068, "in-drivable-lane": 0, "agent_compute-ego": 0.166589728196462, "deviation-heading": 1.692527153405811, "set_robot_commands": 0.08030617952346802, "deviation-center-line": 0.5502583403983816, "driven_lanedir_consec": 3.03165277318588, "sim_compute_sim_state": 0.04497125387191772, "sim_compute_performance-ego": 0.0733074927330017, "sim_compute_robot_state-ego": 0.06924926122029622, "sim_compute_robot_state-npc0": 0.08088857014973959, "sim_compute_robot_state-npc1": 0.07780681451161703, "sim_compute_robot_state-npc2": 0.07777990976969401, "sim_compute_robot_state-npc3": 0.07773509979248047}, "udem1-1-0": {"driven_any": 3.106350681686351, "sim_physics": 0.13493468681971232, "survival_time": 14.950000000000076, "driven_lanedir": 3.056001104108241, "sim_render-ego": 0.07520771980285644, "in-drivable-lane": 0, "agent_compute-ego": 0.16830119450887043, "deviation-heading": 2.2914541459455395, "set_robot_commands": 0.08047720432281494, "deviation-center-line": 0.7526782159770506, "driven_lanedir_consec": 3.056001104108241, "sim_compute_sim_state": 0.0451655912399292, "sim_compute_performance-ego": 0.07473827123641968, "sim_compute_robot_state-ego": 0.0711565661430359, "sim_compute_robot_state-npc0": 0.08167571624120076, "sim_compute_robot_state-npc1": 0.07913477897644043, "sim_compute_robot_state-npc2": 0.07856959660847981, "sim_compute_robot_state-npc3": 0.07855290333429972}, "udem1-2-0": {"driven_any": 3.0334903469252934, "sim_physics": 0.13004138549168906, "survival_time": 14.950000000000076, "driven_lanedir": 2.9852570287090665, "sim_render-ego": 0.0745212213198344, "in-drivable-lane": 0, "agent_compute-ego": 0.16975544134775797, "deviation-heading": 2.147546975151481, "set_robot_commands": 0.08038271109263102, "deviation-center-line": 1.0657129082071388, "driven_lanedir_consec": 2.099986871801573, "sim_compute_sim_state": 0.04555273691813151, "sim_compute_performance-ego": 0.07358648141225178, "sim_compute_robot_state-ego": 0.06673997004826863, "sim_compute_robot_state-npc0": 0.0814198088645935, "sim_compute_robot_state-npc1": 0.07907492478688558, "sim_compute_robot_state-npc2": 0.07841752290725708, "sim_compute_robot_state-npc3": 0.07871224482854207}, "udem1-3-0": {"driven_any": 3.0457343749504777, "sim_physics": 0.11731281518936156, "survival_time": 14.950000000000076, "driven_lanedir": 2.9927685480333666, "sim_render-ego": 0.07340550422668457, "in-drivable-lane": 0, "agent_compute-ego": 0.1707615089416504, "deviation-heading": 2.324785011429918, "set_robot_commands": 0.0805578621228536, "deviation-center-line": 0.7159021209139755, "driven_lanedir_consec": 2.5518980092496015, "sim_compute_sim_state": 0.044439645608266194, "sim_compute_performance-ego": 0.07110450585683187, "sim_compute_robot_state-ego": 0.06339845021565756, "sim_compute_robot_state-npc0": 0.0815579652786255, "sim_compute_robot_state-npc1": 0.07909205039342244, "sim_compute_robot_state-npc2": 0.07916581312815349, "sim_compute_robot_state-npc3": 0.07859837373097738}, "udem1-4-0": {"driven_any": 3.252970307613809, "sim_physics": 0.11880156755447388, "survival_time": 14.950000000000076, "driven_lanedir": 3.204082216138748, "sim_render-ego": 0.07343403975168863, "in-drivable-lane": 0, "agent_compute-ego": 0.16798016945521035, "deviation-heading": 1.8875034668658943, "set_robot_commands": 0.07978379726409912, "deviation-center-line": 0.7281257366712028, "driven_lanedir_consec": 2.9428343360058773, "sim_compute_sim_state": 0.045452543894449866, "sim_compute_performance-ego": 0.07219162464141846, "sim_compute_robot_state-ego": 0.06386258363723755, "sim_compute_robot_state-npc0": 0.08196199417114258, "sim_compute_robot_state-npc1": 0.07941715399424235, "sim_compute_robot_state-npc2": 0.07944483915964762, "sim_compute_robot_state-npc3": 0.07901298602422079}}set_robot_commands_max 0.0805578621228536 set_robot_commands_mean 0.08030155086517335 set_robot_commands_median 0.08038271109263102 set_robot_commands_min 0.07978379726409912 sim_compute_performance-ego_max 0.07473827123641968 sim_compute_performance-ego_mean 0.07298567517598469 sim_compute_performance-ego_median 0.0733074927330017 sim_compute_performance-ego_min 0.07110450585683187 sim_compute_robot_state-ego_max 0.0711565661430359 sim_compute_robot_state-ego_mean 0.06688136625289917 sim_compute_robot_state-ego_median 0.06673997004826863 sim_compute_robot_state-ego_min 0.06339845021565756 sim_compute_robot_state-npc0_max 0.08196199417114258 sim_compute_robot_state-npc0_mean 0.08150081094106039 sim_compute_robot_state-npc0_median 0.0815579652786255 sim_compute_robot_state-npc0_min 0.08088857014973959 sim_compute_robot_state-npc1_max 0.07941715399424235 sim_compute_robot_state-npc1_mean 0.07890514453252158 sim_compute_robot_state-npc1_median 0.07909205039342244 sim_compute_robot_state-npc1_min 0.07780681451161703 sim_compute_robot_state-npc2_max 0.07944483915964762 sim_compute_robot_state-npc2_mean 0.07867553631464641 sim_compute_robot_state-npc2_median 0.07856959660847981 sim_compute_robot_state-npc2_min 0.07777990976969401 sim_compute_robot_state-npc3_max 0.07901298602422079 sim_compute_robot_state-npc3_mean 0.07852232154210409 sim_compute_robot_state-npc3_median 0.07859837373097738 sim_compute_robot_state-npc3_min 0.07773509979248047 sim_compute_sim_state_max 0.04555273691813151 sim_compute_sim_state_mean 0.045116354306538896 sim_compute_sim_state_median 0.0451655912399292 sim_compute_sim_state_min 0.044439645608266194 sim_physics_max 0.13493468681971232 sim_physics_mean 0.12610411405563354 sim_physics_median 0.1294301152229309 sim_physics_min 0.11731281518936156 sim_render-ego_max 0.07520771980285644 sim_render-ego_mean 0.07398079109191895 sim_render-ego_median 0.07343403975168863 sim_render-ego_min 0.07333547035853068 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 21773
2964
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-11810
2019-05-07 22:00:30+00:00 2019-05-07 22:52:05+00:00 0:51:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2608955663992025 survival_time_median 5.399999999999989 deviation-center-line_median 0.20084634484832703 in-drivable-lane_median 2.249999999999992
other stats agent_compute-ego_max 0.24733241399129233 agent_compute-ego_mean 0.22295074898987544 agent_compute-ego_median 0.2208186930684901 agent_compute-ego_min 0.20851443608601888 deviation-center-line_max 1.1720265597834716 deviation-center-line_mean 0.3573592478909198 deviation-center-line_min 0.1428855896189655 deviation-heading_max 2.558394372300888 deviation-heading_mean 1.546763675293946 deviation-heading_median 1.3806901130057407 deviation-heading_min 0.6850290349648949 driven_any_max 1.7164128485614625 driven_any_mean 0.9027371861967096 driven_any_median 0.6523104756131728 driven_any_min 0.3978453035301088 driven_lanedir_consec_max 1.143343399810823 driven_lanedir_consec_mean 0.4002633833657869 driven_lanedir_consec_min 0.09758637927766456 driven_lanedir_max 1.143354294700582 driven_lanedir_mean 0.4020652290249285 driven_lanedir_median 0.26453356304097864 driven_lanedir_min 0.11774447930030751 in-drivable-lane_max 11.350000000000076 in-drivable-lane_mean 3.670000000000005 in-drivable-lane_min 0.9999999999999998 per-episodes details {"udem1-0-0": {"driven_any": 1.57601795169403, "sim_physics": 0.12233672142028808, "survival_time": 14.950000000000076, "driven_lanedir": 1.143354294700582, "sim_render-ego": 0.07148106257120768, "in-drivable-lane": 4.35, "agent_compute-ego": 0.22798529307047527, "deviation-heading": 2.19704879108416, "set_robot_commands": 0.08226104656855265, "deviation-center-line": 1.1720265597834716, "driven_lanedir_consec": 1.143343399810823, "sim_compute_sim_state": 0.04343433141708374, "sim_compute_performance-ego": 0.06993387619654337, "sim_compute_robot_state-ego": 0.06470466454823812, "sim_compute_robot_state-npc0": 0.07992879947026571, "sim_compute_robot_state-npc1": 0.07655198256174724, "sim_compute_robot_state-npc2": 0.07584770282109578, "sim_compute_robot_state-npc3": 0.07596304893493652}, "udem1-1-0": {"driven_any": 0.6424147621501354, "sim_physics": 0.11208113203657434, "survival_time": 4.699999999999991, "driven_lanedir": 0.23160724167811209, "sim_render-ego": 0.07113352481355058, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.22955450098565283, "deviation-heading": 0.7479120421270805, "set_robot_commands": 0.08044720710592067, "deviation-center-line": 0.2467664462159971, "driven_lanedir_consec": 0.23160724167811209, "sim_compute_sim_state": 0.04417085393946221, "sim_compute_performance-ego": 0.0709574856656663, "sim_compute_robot_state-ego": 0.06455721246435288, "sim_compute_robot_state-npc0": 0.08092382106375187, "sim_compute_robot_state-npc1": 0.07730361248584504, "sim_compute_robot_state-npc2": 0.07901184609595766, "sim_compute_robot_state-npc3": 0.07736074163558636}, "udem1-2-0": {"driven_any": 0.5803831483180321, "sim_physics": 0.11328977888280696, "survival_time": 4.399999999999992, "driven_lanedir": 0.2531621545967542, "sim_render-ego": 0.06976882436058739, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.22160226648504083, "deviation-heading": 1.6093861462953691, "set_robot_commands": 0.07967595620588823, "deviation-center-line": 0.19471746667896137, "driven_lanedir_consec": 0.2505902471756509, "sim_compute_sim_state": 0.043572051958604294, "sim_compute_performance-ego": 0.06948117234490135, "sim_compute_robot_state-ego": 0.0628792101686651, "sim_compute_robot_state-npc0": 0.07708990302952853, "sim_compute_robot_state-npc1": 0.0751330093903975, "sim_compute_robot_state-npc2": 0.0754746903072704, "sim_compute_robot_state-npc3": 0.07520203156904741}, "udem1-3-0": {"driven_any": 0.6930163550623264, "sim_physics": 0.11970722458579323, "survival_time": 5.4999999999999885, "driven_lanedir": 0.2936925227677294, "sim_render-ego": 0.07156232703815807, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.2323404463854703, "deviation-heading": 1.3806901130057407, "set_robot_commands": 0.08040655742992055, "deviation-center-line": 0.20084634484832703, "driven_lanedir_consec": 0.2936925227677294, "sim_compute_sim_state": 0.04431368654424494, "sim_compute_performance-ego": 0.07116906642913819, "sim_compute_robot_state-ego": 0.06368557756597346, "sim_compute_robot_state-npc0": 0.07993964932181619, "sim_compute_robot_state-npc1": 0.07719759724356912, "sim_compute_robot_state-npc2": 0.07674057266928933, "sim_compute_robot_state-npc3": 0.07747495607896285}, "udem1-4-0": {"driven_any": 0.726977866558023, "sim_physics": 0.12302914561841312, "survival_time": 7.449999999999981, "driven_lanedir": 0.310660658762115, "sim_render-ego": 0.07072494654047409, "in-drivable-lane": 3.8499999999999863, "agent_compute-ego": 0.2243876185193158, "deviation-heading": 1.2098105969177917, "set_robot_commands": 0.07901706631551653, "deviation-center-line": 0.16532566738797286, "driven_lanedir_consec": 0.310660658762115, "sim_compute_sim_state": 0.042486802043530766, "sim_compute_performance-ego": 0.07143313292688971, "sim_compute_robot_state-ego": 0.06276777766694959, "sim_compute_robot_state-npc0": 0.0784894011964734, "sim_compute_robot_state-npc1": 0.07450772931911802, "sim_compute_robot_state-npc2": 0.07491432900396769, "sim_compute_robot_state-npc3": 0.07593013616216263}, "udem1-5-0": {"driven_any": 0.3978453035301088, "sim_physics": 0.12513487092379866, "survival_time": 2.8999999999999977, "driven_lanedir": 0.11774447930030751, "sim_render-ego": 0.06647004752323546, "in-drivable-lane": 0.9999999999999998, "agent_compute-ego": 0.2197488258624899, "deviation-heading": 1.6925645772410327, "set_robot_commands": 0.07946143890249319, "deviation-center-line": 0.1735437445962933, "driven_lanedir_consec": 0.09758637927766456, "sim_compute_sim_state": 0.0415419915626789, "sim_compute_performance-ego": 0.06844918070168331, "sim_compute_robot_state-ego": 0.06122162835351352, "sim_compute_robot_state-npc0": 0.07531724716054983, "sim_compute_robot_state-npc1": 0.07297790050506592, "sim_compute_robot_state-npc2": 0.0724450843087558, "sim_compute_robot_state-npc3": 0.07322407590931859}, "udem1-6-0": {"driven_any": 1.7164128485614625, "sim_physics": 0.12179917176564536, "survival_time": 14.950000000000076, "driven_lanedir": 0.31826533752536035, "sim_render-ego": 0.06861803452173869, "in-drivable-lane": 11.350000000000076, "agent_compute-ego": 0.21463666359583536, "deviation-heading": 1.5185693859293536, "set_robot_commands": 0.07865565061569214, "deviation-center-line": 0.24228247059434377, "driven_lanedir_consec": 0.31826533752536035, "sim_compute_sim_state": 0.04159240484237671, "sim_compute_performance-ego": 0.06979383865992228, "sim_compute_robot_state-ego": 0.06452231884002685, "sim_compute_robot_state-npc0": 0.07783617893854777, "sim_compute_robot_state-npc1": 0.07389932711919149, "sim_compute_robot_state-npc2": 0.07315255641937256, "sim_compute_robot_state-npc3": 0.07274492343266804}, "udem1-7-0": {"driven_any": 1.5547398647183264, "sim_physics": 0.11901355663935344, "survival_time": 14.950000000000076, "driven_lanedir": 0.9240303057466428, "sim_render-ego": 0.06636511246363322, "in-drivable-lane": 5.850000000000033, "agent_compute-ego": 0.20851443608601888, "deviation-heading": 2.4443341920247557, "set_robot_commands": 0.07750221093495686, "deviation-center-line": 0.8108093504766862, "driven_lanedir_consec": 0.9240303057466428, "sim_compute_sim_state": 0.039584566752115885, "sim_compute_performance-ego": 0.06607524474461873, "sim_compute_robot_state-ego": 0.06339271386464437, "sim_compute_robot_state-npc0": 0.0757525372505188, "sim_compute_robot_state-npc1": 0.07120590845743816, "sim_compute_robot_state-npc2": 0.06956116199493408, "sim_compute_robot_state-npc3": 0.06909144083658854}, "udem1-8-0": {"driven_any": 0.6523104756131728, "sim_physics": 0.1210382867742468, "survival_time": 5.399999999999989, "driven_lanedir": 0.20729196775899483, "sim_render-ego": 0.06816665331522624, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.21824059442237573, "deviation-heading": 0.9291643289602276, "set_robot_commands": 0.0786058019708704, "deviation-center-line": 0.17532429801956018, "driven_lanedir_consec": 0.20729196775899483, "sim_compute_sim_state": 0.041679062225200514, "sim_compute_performance-ego": 0.069049424595303, "sim_compute_robot_state-ego": 0.05992686748504639, "sim_compute_robot_state-npc0": 0.07851631773842706, "sim_compute_robot_state-npc1": 0.07422730437031498, "sim_compute_robot_state-npc2": 0.07239654770603886, "sim_compute_robot_state-npc3": 0.07184279627270168}, "udem1-9-0": {"driven_any": 0.5914292311973395, "sim_physics": 0.11286073542655782, "survival_time": 4.699999999999991, "driven_lanedir": 0.26453356304097864, "sim_render-ego": 0.07094769528571596, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.21552599490957056, "deviation-heading": 1.307620896559932, "set_robot_commands": 0.08190311015920436, "deviation-center-line": 0.2290836275229732, "driven_lanedir_consec": 0.2608955663992025, "sim_compute_sim_state": 0.04160208397723259, "sim_compute_performance-ego": 0.07002049050432571, "sim_compute_robot_state-ego": 0.062130770784743286, "sim_compute_robot_state-npc0": 0.07776916534342665, "sim_compute_robot_state-npc1": 0.07679729512397279, "sim_compute_robot_state-npc2": 0.07557405563111001, "sim_compute_robot_state-npc3": 0.0747294045509176}, "udem1-10-0": {"driven_any": 1.309652357436689, "sim_physics": 0.11141338030497232, "survival_time": 14.950000000000076, "driven_lanedir": 0.817590323250172, "sim_render-ego": 0.07098621447881062, "in-drivable-lane": 5.750000000000014, "agent_compute-ego": 0.21626368443171184, "deviation-heading": 2.4259984256123848, "set_robot_commands": 0.0803896975517273, "deviation-center-line": 0.7114420579876652, "driven_lanedir_consec": 0.817590323250172, "sim_compute_sim_state": 0.04378805875778198, "sim_compute_performance-ego": 0.07245668172836303, "sim_compute_robot_state-ego": 0.062422634760538734, "sim_compute_robot_state-npc0": 0.07889632701873779, "sim_compute_robot_state-npc1": 0.07683469216028849, "sim_compute_robot_state-npc2": 0.07657650629679362, "sim_compute_robot_state-npc3": 0.07706924120585124}, "udem1-11-0": {"driven_any": 1.5723708749552083, "sim_physics": 0.1109466748451119, "survival_time": 13.400000000000055, "driven_lanedir": 0.6072409125125113, "sim_render-ego": 0.07122815367001206, "in-drivable-lane": 6.850000000000019, "agent_compute-ego": 0.2208186930684901, "deviation-heading": 2.558394372300888, "set_robot_commands": 0.07964937633542872, "deviation-center-line": 0.5854212300230356, "driven_lanedir_consec": 0.6072409125125113, "sim_compute_sim_state": 0.04323711946829042, "sim_compute_performance-ego": 0.07265617509386432, "sim_compute_robot_state-ego": 0.06301078778594288, "sim_compute_robot_state-npc0": 0.07890624430642199, "sim_compute_robot_state-npc1": 0.07683428454754958, "sim_compute_robot_state-npc2": 0.07538075856308439, "sim_compute_robot_state-npc3": 0.07497248720766893}, "udem1-12-0": {"driven_any": 0.4505118928051962, "sim_physics": 0.11083926054147572, "survival_time": 3.2499999999999964, "driven_lanedir": 0.13117238648572327, "sim_render-ego": 0.07022198163546049, "in-drivable-lane": 1.6999999999999955, "agent_compute-ego": 0.2267506269308237, "deviation-heading": 0.6850290349648949, "set_robot_commands": 0.07899380463820238, "deviation-center-line": 0.16089230400188598, "driven_lanedir_consec": 0.13117238648572327, "sim_compute_sim_state": 0.039183950424194335, "sim_compute_performance-ego": 0.06238543803875263, "sim_compute_robot_state-ego": 0.05743253781245305, "sim_compute_robot_state-npc0": 0.07224095784700833, "sim_compute_robot_state-npc1": 0.06923570999732384, "sim_compute_robot_state-npc2": 0.06858100524315468, "sim_compute_robot_state-npc3": 0.06897757970369779}, "udem1-13-0": {"driven_any": 0.5458419364958047, "sim_physics": 0.10868728308030116, "survival_time": 4.049999999999994, "driven_lanedir": 0.20743957123293688, "sim_render-ego": 0.07064011950551728, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.22055917610356837, "deviation-heading": 1.1269147480263744, "set_robot_commands": 0.08052765292885863, "deviation-center-line": 0.1428855896189655, "driven_lanedir_consec": 0.20743957123293688, "sim_compute_sim_state": 0.04291200932161308, "sim_compute_performance-ego": 0.0726225111219618, "sim_compute_robot_state-ego": 0.06272595605732482, "sim_compute_robot_state-npc0": 0.07789437270458834, "sim_compute_robot_state-npc1": 0.07688819037543403, "sim_compute_robot_state-npc2": 0.07726891835530598, "sim_compute_robot_state-npc3": 0.07480007630807382}, "udem1-14-0": {"driven_any": 0.5311329238547909, "sim_physics": 0.1353218445832702, "survival_time": 4.3499999999999925, "driven_lanedir": 0.20319271601500863, "sim_render-ego": 0.07166767120361328, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.24733241399129233, "deviation-heading": 1.3680174783591983, "set_robot_commands": 0.08313628448837104, "deviation-center-line": 0.14902156060765684, "driven_lanedir_consec": 0.20254393010316463, "sim_compute_sim_state": 0.043123349376108455, "sim_compute_performance-ego": 0.07053468693261859, "sim_compute_robot_state-ego": 0.06581710946970973, "sim_compute_robot_state-npc0": 0.0809265361435112, "sim_compute_robot_state-npc1": 0.07680705772049126, "sim_compute_robot_state-npc2": 0.07717037474972079, "sim_compute_robot_state-npc3": 0.07630457549259581}}set_robot_commands_max 0.08313628448837104 set_robot_commands_mean 0.0800421908101069 set_robot_commands_median 0.07967595620588823 set_robot_commands_min 0.07750221093495686 sim_compute_performance-ego_max 0.07265617509386432 sim_compute_performance-ego_mean 0.06980122704563682 sim_compute_performance-ego_median 0.07002049050432571 sim_compute_performance-ego_min 0.06238543803875263 sim_compute_robot_state-ego_max 0.06581710946970973 sim_compute_robot_state-ego_mean 0.06274651784187485 sim_compute_robot_state-ego_median 0.0628792101686651 sim_compute_robot_state-ego_min 0.05743253781245305 sim_compute_robot_state-npc0_max 0.0809265361435112 sim_compute_robot_state-npc0_mean 0.07802849723557156 sim_compute_robot_state-npc0_median 0.0784894011964734 sim_compute_robot_state-npc0_min 0.07224095784700833 sim_compute_robot_state-npc1_max 0.07730361248584504 sim_compute_robot_state-npc1_mean 0.07509344009184984 sim_compute_robot_state-npc1_median 0.07655198256174724 sim_compute_robot_state-npc1_min 0.06923570999732384 sim_compute_robot_state-npc2_max 0.07901184609595766 sim_compute_robot_state-npc2_mean 0.07467307401105677 sim_compute_robot_state-npc2_median 0.0754746903072704 sim_compute_robot_state-npc2_min 0.06858100524315468 sim_compute_robot_state-npc3_max 0.07747495607896285 sim_compute_robot_state-npc3_mean 0.07437916768671851 sim_compute_robot_state-npc3_median 0.07497248720766893 sim_compute_robot_state-npc3_min 0.06897757970369779 sim_compute_sim_state_max 0.04431368654424494 sim_compute_sim_state_mean 0.04241482150736792 sim_compute_sim_state_median 0.04291200932161308 sim_compute_sim_state_min 0.039183950424194335 sim_physics_max 0.1353218445832702 sim_physics_mean 0.11783327116190728 sim_physics_median 0.11901355663935344 sim_physics_min 0.10868728308030116 sim_render-ego_max 0.07166767120361328 sim_render-ego_mean 0.06999882459512939 sim_render-ego_median 0.07072494654047409 sim_render-ego_min 0.06636511246363322 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.993333333333352 survival_time_min 2.8999999999999977
No reset possible 21747
2450
Nicky Eichmann Baseline solution using reinforcement learning aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-11810
2019-05-07 20:53:22+00:00 2019-05-07 21:57:30+00:00 1:04:08 Waited 3604 seconds [...] Waited 3604 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21746
2463
Liam Paull Β π¨π¦challenge-aido_LF-template-ros aido2-LFVI-sim-testing
step1-simulation error no idsc-rudolf-11810
2019-05-07 20:52:23+00:00 2019-05-07 20:53:02+00:00 0:00:39 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21713
3062
Andrea Censi Β π¨πrotation aido2-LFVI-sim-testing
step1-simulation host-error no idsc-rudolf-11810
2019-05-07 19:51:19+00:00 2019-05-07 20:52:04+00:00 1:00:45 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 491, in get_cr
uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
File "/project/src/duckietown_challenges_runner/runner.py", line 1032, in upload_files
uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
File "/project/src/duckietown_challenges_runner/runner.py", line 1187, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1234, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3062/step1-simulation-idsc-rudolf-11810-job21713/tmp/tmpfimlv1v6/attempts/udem1-10-0.attempt10/drawing.html']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21700
2624
Andrea Censi Β π¨πchallenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-11810
2019-05-07 19:27:31+00:00 2019-05-07 19:50:53+00:00 0:23:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6537162971975778 survival_time_median 2.5999999999999988 deviation-center-line_median 0.14884708769804722 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.1556186108362107 agent_compute-ego_mean 0.14730778185424775 agent_compute-ego_median 0.1473930669062346 agent_compute-ego_min 0.14005775635059065 deviation-center-line_max 0.5141120095458062 deviation-center-line_mean 0.1769000227005324 deviation-center-line_min 0.06216029860587694 deviation-heading_max 1.9929437250081896 deviation-heading_mean 0.692977823395608 deviation-heading_median 0.4928440244444201 deviation-heading_min 0.24234723632033853 driven_any_max 3.5343244022418343 driven_any_mean 1.3470385992234175 driven_any_median 1.001633421251194 driven_any_min 0.3412551960104244 driven_lanedir_consec_max 2.494308053441959 driven_lanedir_consec_mean 0.881391085527715 driven_lanedir_consec_min 0.3199180625488627 driven_lanedir_max 2.494308053441959 driven_lanedir_mean 0.8962528018383226 driven_lanedir_median 0.7206363324756615 driven_lanedir_min 0.3199180625488627 in-drivable-lane_max 3.549999999999991 in-drivable-lane_mean 0.839999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.11602942551238628, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05998547469513326, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14406404917753196, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0787168424340743, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.034511614449416535, "sim_compute_performance-ego": 0.06316048887711537, "sim_compute_robot_state-ego": 0.06153703339492218, "sim_compute_robot_state-npc0": 0.07257597355902949, "sim_compute_robot_state-npc1": 0.06846560405779488, "sim_compute_robot_state-npc2": 0.0651543049872676, "sim_compute_robot_state-npc3": 0.06260820581943174}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.11564147472381592, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05660780838557652, "in-drivable-lane": 0, "agent_compute-ego": 0.14055994578770228, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.07588498081479754, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0353635379246303, "sim_compute_performance-ego": 0.060407825878688266, "sim_compute_robot_state-ego": 0.06346420730863299, "sim_compute_robot_state-npc0": 0.06722170966012138, "sim_compute_robot_state-npc1": 0.06348738500050136, "sim_compute_robot_state-npc2": 0.06294377361025129, "sim_compute_robot_state-npc3": 0.06469576699393136}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1149743089398134, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0607815876747798, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1473930669062346, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07754338366314045, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03616914008427592, "sim_compute_performance-ego": 0.06333896720293657, "sim_compute_robot_state-ego": 0.061520472313593894, "sim_compute_robot_state-npc0": 0.07119245205110716, "sim_compute_robot_state-npc1": 0.06647818065384059, "sim_compute_robot_state-npc2": 0.06532762583019663, "sim_compute_robot_state-npc3": 0.0641849110427412}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.12465302149454752, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06214897334575653, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14644508063793182, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07971142729123433, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.037588298320770264, "sim_compute_performance-ego": 0.06314671039581299, "sim_compute_robot_state-ego": 0.06304736932118733, "sim_compute_robot_state-npc0": 0.07395467658837636, "sim_compute_robot_state-npc1": 0.07082485159238179, "sim_compute_robot_state-npc2": 0.06675922870635986, "sim_compute_robot_state-npc3": 0.06518055995305379}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1151519502912249, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06147738865443638, "in-drivable-lane": 0, "agent_compute-ego": 0.1556186108362107, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08007244836716425, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03583231426420666, "sim_compute_performance-ego": 0.058676356361025854, "sim_compute_robot_state-ego": 0.05951301256815592, "sim_compute_robot_state-npc0": 0.06958046413603283, "sim_compute_robot_state-npc1": 0.06820080393836611, "sim_compute_robot_state-npc2": 0.07191828319004603, "sim_compute_robot_state-npc3": 0.06511103539239793}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.11287068892381862, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05790715588780934, "in-drivable-lane": 2, "agent_compute-ego": 0.14109835082185482, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.07932779175078797, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.034549301969790884, "sim_compute_performance-ego": 0.06194795677048004, "sim_compute_robot_state-ego": 0.06243893771828292, "sim_compute_robot_state-npc0": 0.06922292423819354, "sim_compute_robot_state-npc1": 0.06351722928578268, "sim_compute_robot_state-npc2": 0.06178155345117261, "sim_compute_robot_state-npc3": 0.06188102111131131}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.12238986515304418, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06345525528620748, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1464534824334302, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.07893649582723969, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04068285516164835, "sim_compute_performance-ego": 0.06575761952446503, "sim_compute_robot_state-ego": 0.065031935867754, "sim_compute_robot_state-npc0": 0.07208677634452153, "sim_compute_robot_state-npc1": 0.06681727205665366, "sim_compute_robot_state-npc2": 0.06438497432227273, "sim_compute_robot_state-npc3": 0.06520490276003346}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.12698671340942383, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.062246394157409665, "in-drivable-lane": 0, "agent_compute-ego": 0.14924520015716553, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07806746482849121, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.035238308906555174, "sim_compute_performance-ego": 0.06601105690002441, "sim_compute_robot_state-ego": 0.06443244934082032, "sim_compute_robot_state-npc0": 0.07133381843566894, "sim_compute_robot_state-npc1": 0.06467875957489014, "sim_compute_robot_state-npc2": 0.06384092330932617, "sim_compute_robot_state-npc3": 0.06382585048675538}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.10734835037818322, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.05936176960284893, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14005775635059065, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.07741121145395133, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.034954139819512, "sim_compute_performance-ego": 0.061911665476285495, "sim_compute_robot_state-ego": 0.062004185639894925, "sim_compute_robot_state-npc0": 0.06722546082276565, "sim_compute_robot_state-npc1": 0.0625873666543227, "sim_compute_robot_state-npc2": 0.06201993502103365, "sim_compute_robot_state-npc3": 0.06105846625107985}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.1361075181227464, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06250512599945068, "in-drivable-lane": 0, "agent_compute-ego": 0.1540518540602464, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.07981133460998535, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03747174373039833, "sim_compute_performance-ego": 0.06573917315556453, "sim_compute_robot_state-ego": 0.06309675253354587, "sim_compute_robot_state-npc0": 0.07414287787217361, "sim_compute_robot_state-npc1": 0.06564890421353854, "sim_compute_robot_state-npc2": 0.06387086098010723, "sim_compute_robot_state-npc3": 0.06435412627000076}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.12054951624436812, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06576142527840355, "in-drivable-lane": 0, "agent_compute-ego": 0.1476360776207664, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.07687597925012762, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.036417365074157715, "sim_compute_performance-ego": 0.06732988357543945, "sim_compute_robot_state-ego": 0.0635625882582231, "sim_compute_robot_state-npc0": 0.07254220138896596, "sim_compute_robot_state-npc1": 0.06424673037095503, "sim_compute_robot_state-npc2": 0.06375767967917702, "sim_compute_robot_state-npc3": 0.06544737382368608}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.10858062267303469, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06125345230102539, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14735186100006104, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.07852456569671631, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03599141597747803, "sim_compute_performance-ego": 0.0637809705734253, "sim_compute_robot_state-ego": 0.06480607986450196, "sim_compute_robot_state-npc0": 0.06916483879089355, "sim_compute_robot_state-npc1": 0.06637598037719726, "sim_compute_robot_state-npc2": 0.06508014678955078, "sim_compute_robot_state-npc3": 0.06485864639282227}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.11559265471519307, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.0596758837395526, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1474023955933591, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.0779776319544366, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03620792703425631, "sim_compute_performance-ego": 0.06416098361319685, "sim_compute_robot_state-ego": 0.06212767895231856, "sim_compute_robot_state-npc0": 0.07355934508303379, "sim_compute_robot_state-npc1": 0.06628157483770493, "sim_compute_robot_state-npc2": 0.06408717784475773, "sim_compute_robot_state-npc3": 0.06513921250688269}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.1143978604903588, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06595054039588341, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1503179852779095, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.08011295245243953, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03633733896108774, "sim_compute_performance-ego": 0.06857098982884334, "sim_compute_robot_state-ego": 0.06487390628227821, "sim_compute_robot_state-npc0": 0.07293020761930026, "sim_compute_robot_state-npc1": 0.06699450657917903, "sim_compute_robot_state-npc2": 0.06761184564003578, "sim_compute_robot_state-npc3": 0.06711574701162484}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.115011689776466, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06490849086216517, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15192101115272158, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.07686562538146972, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03738564309619722, "sim_compute_performance-ego": 0.06674353508722214, "sim_compute_robot_state-ego": 0.06401666686648415, "sim_compute_robot_state-npc0": 0.07367532366798038, "sim_compute_robot_state-npc1": 0.0719688233875093, "sim_compute_robot_state-npc2": 0.06828279495239258, "sim_compute_robot_state-npc3": 0.06660606293451218}}set_robot_commands_max 0.08011295245243953 set_robot_commands_mean 0.0783893423850704 set_robot_commands_median 0.07852456569671631 set_robot_commands_min 0.07588498081479754 sim_compute_performance-ego_max 0.06857098982884334 sim_compute_performance-ego_mean 0.0640456122147017 sim_compute_performance-ego_median 0.0637809705734253 sim_compute_performance-ego_min 0.058676356361025854 sim_compute_robot_state-ego_max 0.065031935867754 sim_compute_robot_state-ego_mean 0.06303155174870642 sim_compute_robot_state-ego_median 0.06309675253354587 sim_compute_robot_state-ego_min 0.05951301256815592 sim_compute_robot_state-npc0_max 0.07414287787217361 sim_compute_robot_state-npc0_mean 0.07136060335054428 sim_compute_robot_state-npc0_median 0.07208677634452153 sim_compute_robot_state-npc0_min 0.06722170966012138 sim_compute_robot_state-npc1_max 0.0719688233875093 sim_compute_robot_state-npc1_mean 0.06643826483870788 sim_compute_robot_state-npc1_median 0.06637598037719726 sim_compute_robot_state-npc1_min 0.0625873666543227 sim_compute_robot_state-npc2_max 0.07191828319004603 sim_compute_robot_state-npc2_mean 0.06512140722092984 sim_compute_robot_state-npc2_median 0.06438497432227273 sim_compute_robot_state-npc2_min 0.06178155345117261 sim_compute_robot_state-npc3_max 0.06711574701162484 sim_compute_robot_state-npc3_mean 0.06448479258335098 sim_compute_robot_state-npc3_median 0.06485864639282227 sim_compute_robot_state-npc3_min 0.06105846625107985 sim_compute_sim_state_max 0.04068285516164835 sim_compute_sim_state_mean 0.03631339631829209 sim_compute_sim_state_median 0.03616914008427592 sim_compute_sim_state_min 0.034511614449416535 sim_physics_max 0.1361075181227464 sim_physics_mean 0.11775237738989498 sim_physics_median 0.11559265471519307 sim_physics_min 0.10734835037818322 sim_render-ego_max 0.06595054039588341 sim_render-ego_mean 0.06160178175109592 sim_render-ego_median 0.06147738865443638 sim_render-ego_min 0.05660780838557652 simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 3.3333333333333286 survival_time_min 1.0500000000000005
No reset possible