Evaluator 752

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-20 08:29:46+00:00

2019-04-20 08:51:56+00:00

0:22:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5223674143084631
survival_time_median	12.850000000000048
deviation-center-line_median	0.18589097151071676
in-drivable-lane_median	1.6500000000000234

other stats

agent_compute-ego_max	0.10717034260431924
agent_compute-ego_mean	0.07571580347423572
agent_compute-ego_median	0.06297343142711333
agent_compute-ego_min	0.061319238017041394
deviation-center-line_max	0.41607307911538793
deviation-center-line_mean	0.24729146737687824
deviation-center-line_min	0.14247166899579078
deviation-heading_max	3.59560320538923
deviation-heading_mean	2.3061860298470194
deviation-heading_median	1.7066635134763966
deviation-heading_min	1.5155159572771402
driven_any_max	1.1778396136503098
driven_any_mean	0.8907358315449182
driven_any_median	1.0091063327184018
driven_any_min	0.526943278870459
driven_lanedir_consec_max	0.8058778151587918
driven_lanedir_consec_mean	0.6156088636908545
driven_lanedir_consec_min	0.47176820511656503
driven_lanedir_max	0.8058778151587918
driven_lanedir_mean	0.6156088636908545
driven_lanedir_median	0.5223674143084631
driven_lanedir_min	0.47176820511656503
in-drivable-lane_max	7.7000000000000925
in-drivable-lane_mean	2.6700000000000337
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1766791999539732, "sim_physics": 0.02767173926035563, "survival_time": 14.950000000000076, "driven_lanedir": 0.5140834882988319, "sim_render-ego": 0.07208208243052165, "in-drivable-lane": 7.7000000000000925, "agent_compute-ego": 0.10717034260431924, "deviation-heading": 1.5155159572771402, "set_robot_commands": 0.11107744852701824, "deviation-center-line": 0.16640671979868749, "driven_lanedir_consec": 0.5140834882988319, "sim_compute_sim_state": 0.042882150808970135, "sim_compute_performance-ego": 0.07570771217346191, "sim_compute_robot_state-ego": 0.07949409008026123}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1778396136503098, "sim_physics": 0.019690500100453697, "survival_time": 14.950000000000076, "driven_lanedir": 0.763947395571621, "sim_render-ego": 0.05570251782735189, "in-drivable-lane": 3.8500000000000543, "agent_compute-ego": 0.08493057250976563, "deviation-heading": 3.59560320538923, "set_robot_commands": 0.08212727228800455, "deviation-center-line": 0.3256148974638082, "driven_lanedir_consec": 0.763947395571621, "sim_compute_sim_state": 0.034016207059224444, "sim_compute_performance-ego": 0.058205456733703614, "sim_compute_robot_state-ego": 0.06020178476969401}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0091063327184018, "sim_physics": 0.014040475689483524, "survival_time": 12.850000000000048, "driven_lanedir": 0.8058778151587918, "sim_render-ego": 0.0383085777787383, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.061319238017041394, "deviation-heading": 3.094546822887514, "set_robot_commands": 0.055113759022278545, "deviation-center-line": 0.41607307911538793, "driven_lanedir_consec": 0.8058778151587918, "sim_compute_sim_state": 0.023454206926813385, "sim_compute_performance-ego": 0.039499960984701314, "sim_compute_robot_state-ego": 0.04051955479128352}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5631107325314465, "sim_physics": 0.014416596660875294, "survival_time": 7.299999999999982, "driven_lanedir": 0.5223674143084631, "sim_render-ego": 0.038724241191393706, "in-drivable-lane": 0, "agent_compute-ego": 0.06218543281293895, "deviation-heading": 1.7066635134763966, "set_robot_commands": 0.05501962361270434, "deviation-center-line": 0.18589097151071676, "driven_lanedir_consec": 0.5223674143084631, "sim_compute_sim_state": 0.023190143990190065, "sim_compute_performance-ego": 0.03947708704700208, "sim_compute_robot_state-ego": 0.040280685032883734}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.526943278870459, "sim_physics": 0.01515493601778128, "survival_time": 6.849999999999984, "driven_lanedir": 0.47176820511656503, "sim_render-ego": 0.03881437238985604, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06297343142711333, "deviation-heading": 1.6186006502048147, "set_robot_commands": 0.05471604409879142, "deviation-center-line": 0.14247166899579078, "driven_lanedir_consec": 0.47176820511656503, "sim_compute_sim_state": 0.023303357354045783, "sim_compute_performance-ego": 0.03932960016013932, "sim_compute_robot_state-ego": 0.04008547406997124}}
set_robot_commands_max	0.11107744852701824
set_robot_commands_mean	0.07161082950975942
set_robot_commands_median	0.055113759022278545
set_robot_commands_min	0.05471604409879142
sim_compute_performance-ego_max	0.07570771217346191
sim_compute_performance-ego_mean	0.05044396341980165
sim_compute_performance-ego_median	0.039499960984701314
sim_compute_performance-ego_min	0.03932960016013932
sim_compute_robot_state-ego_max	0.07949409008026123
sim_compute_robot_state-ego_mean	0.05211631774881875
sim_compute_robot_state-ego_median	0.04051955479128352
sim_compute_robot_state-ego_min	0.04008547406997124
sim_compute_sim_state_max	0.042882150808970135
sim_compute_sim_state_mean	0.02936921322784876
sim_compute_sim_state_median	0.023454206926813385
sim_compute_sim_state_min	0.023190143990190065
sim_physics_max	0.02767173926035563
sim_physics_mean	0.018194849545789885
sim_physics_median	0.01515493601778128
sim_physics_min	0.014040475689483524
sim_render-ego_max	0.07208208243052165
sim_render-ego_mean	0.04872635832357232
sim_render-ego_median	0.03881437238985604
sim_render-ego_min	0.0383085777787383
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.380000000000033
survival_time_min	6.849999999999984

No reset possible

18592

2857

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 08:26:07+00:00

2019-04-20 08:26:14+00:00

0:00:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1041, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 27, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 518, in run_single
    prepare_dir(wd, aws_config, steps2artefacts)
  File "/project/src/duckietown_challenges_runner/runner.py", line 785, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1062, in download_artefacts
    raise ValueError(msg)
ValueError: Corrupt cache or download for {'rpath': 'tmp/tmpp0bv90et/attempts/ETHZ_autolab_technical_track-1-0.attempt1/log.gs2.cbor.tmp', 'mime_type': 'binary/octet-stream', 'sha256hex': '9dbd4d22201882d3903c617e5fe18c87ef4a995d2367a610b3e441fe18e88e65', 'size': 29728421, 'storage': {'s3': {'bucket_name': 'duckietown-ai-driving-olympics-1', 'object_key': 'v3/frankfurt/by-value/sha256/9dbd4d22201882d3903c617e5fe18c87ef4a995d2367a610b3e441fe18e88e65', 'url': 'http://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/9dbd4d22201882d3903c617e5fe18c87ef4a995d2367a610b3e441fe18e88e65'}}} at /tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2857/step1-simulation-ip-172-31-25-98-9205-job18592/previous-steps/step1-simulation/tmp/tmpp0bv90et/attempts/ETHZ_autolab_technical_track-1-0.attempt1/log.gs2.cbor.tmp.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18588

2861

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 08:21:15+00:00

2019-04-20 08:21:21+00:00

0:00:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1041, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 27, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 518, in run_single
    prepare_dir(wd, aws_config, steps2artefacts)
  File "/project/src/duckietown_challenges_runner/runner.py", line 785, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1062, in download_artefacts
    raise ValueError(msg)
ValueError: Corrupt cache or download for {'rpath': 'tmp/tmpkcoyldy0/attempts/ETHZ_autolab_technical_track-0-0.attempt0/log.gs2.cbor.tmp', 'mime_type': 'binary/octet-stream', 'sha256hex': '352e46035a8805bdf34665f8b50beeb9db3a1a2867eff8732ff286606285cf7d', 'size': 29822541, 'storage': {'s3': {'bucket_name': 'duckietown-ai-driving-olympics-1', 'object_key': 'v3/frankfurt/by-value/sha256/352e46035a8805bdf34665f8b50beeb9db3a1a2867eff8732ff286606285cf7d', 'url': 'http://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/352e46035a8805bdf34665f8b50beeb9db3a1a2867eff8732ff286606285cf7d'}}} at /tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2861/step1-simulation-ip-172-31-25-98-9205-job18588/previous-steps/step1-simulation/tmp/tmpkcoyldy0/attempts/ETHZ_autolab_technical_track-0-0.attempt0/log.gs2.cbor.tmp.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18579

2779

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-20 08:15:54+00:00

2019-04-20 08:21:08+00:00

0:05:14

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18563

2864

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-19 17:32:41+00:00

2019-04-19 17:58:10+00:00

0:25:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1172, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 39, in copy_to_cache
    msg = 'Copying %s to cache %s' % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-25-98-9205-job18563/tmp/tmpjgq9nig1/attempts/udem1-1-0.attempt1/drawing.html'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18557

2364

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-19 16:22:52+00:00

2019-04-19 16:34:17+00:00

0:11:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14964262463829733
agent_compute-ego_mean	0.12987807054420972
agent_compute-ego_median	0.12738507058885362
agent_compute-ego_min	0.1174232562383016
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03876906970761857, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06675945138031582, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13309054104787, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09461109593229472, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04073109716739295, "sim_compute_performance-ego": 0.07126430745394725, "sim_compute_robot_state-ego": 0.07355377809056696, "sim_compute_robot_state-npc0": 0.06950036534723246, "sim_compute_robot_state-npc1": 0.06998641086074542, "sim_compute_robot_state-npc2": 0.07088796147760355, "sim_compute_robot_state-npc3": 0.07378169275679679}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.045003901828419075, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.07090726765719327, "in-drivable-lane": 0, "agent_compute-ego": 0.14964262463829733, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.10516892779957164, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.04314365712079135, "sim_compute_performance-ego": 0.07414937561208551, "sim_compute_robot_state-ego": 0.07850210775028575, "sim_compute_robot_state-npc0": 0.07428967410867865, "sim_compute_robot_state-npc1": 0.07271031358025291, "sim_compute_robot_state-npc2": 0.07306695526296442, "sim_compute_robot_state-npc3": 0.07453900575637817}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03345252143012153, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06189242468939887, "in-drivable-lane": 0, "agent_compute-ego": 0.12738507058885362, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08823832935757107, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03656025462680393, "sim_compute_performance-ego": 0.0640624205271403, "sim_compute_robot_state-ego": 0.06616734398735893, "sim_compute_robot_state-npc0": 0.06244434780544705, "sim_compute_robot_state-npc1": 0.057767952813042533, "sim_compute_robot_state-npc2": 0.0610105726453993, "sim_compute_robot_state-npc3": 0.06130258242289225}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.030658170580863953, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.058236594001452126, "in-drivable-lane": 0, "agent_compute-ego": 0.1174232562383016, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08586036662260692, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03281725446383158, "sim_compute_performance-ego": 0.05827787518501282, "sim_compute_robot_state-ego": 0.06084053218364715, "sim_compute_robot_state-npc0": 0.06328791379928589, "sim_compute_robot_state-npc1": 0.05949842929840088, "sim_compute_robot_state-npc2": 0.061337063709894814, "sim_compute_robot_state-npc3": 0.06049155195554098}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03418974315418916, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06158392920213587, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12184886020772598, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08774255303775563, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.037191215683432186, "sim_compute_performance-ego": 0.06435676532633164, "sim_compute_robot_state-ego": 0.06611333524479586, "sim_compute_robot_state-npc0": 0.0661353258525624, "sim_compute_robot_state-npc1": 0.06551803210202385, "sim_compute_robot_state-npc2": 0.06711732990601484, "sim_compute_robot_state-npc3": 0.07415557608884923}}
set_robot_commands_max	0.10516892779957164
set_robot_commands_mean	0.09232425454996
set_robot_commands_median	0.08823832935757107
set_robot_commands_min	0.08586036662260692
sim_compute_performance-ego_max	0.07414937561208551
sim_compute_performance-ego_mean	0.0664221488209035
sim_compute_performance-ego_median	0.06435676532633164
sim_compute_performance-ego_min	0.05827787518501282
sim_compute_robot_state-ego_max	0.07850210775028575
sim_compute_robot_state-ego_mean	0.06903541945133093
sim_compute_robot_state-ego_median	0.06616734398735893
sim_compute_robot_state-ego_min	0.06084053218364715
sim_compute_robot_state-npc0_max	0.07428967410867865
sim_compute_robot_state-npc0_mean	0.06713152538264129
sim_compute_robot_state-npc0_median	0.0661353258525624
sim_compute_robot_state-npc0_min	0.06244434780544705
sim_compute_robot_state-npc1_max	0.07271031358025291
sim_compute_robot_state-npc1_mean	0.06509622773089312
sim_compute_robot_state-npc1_median	0.06551803210202385
sim_compute_robot_state-npc1_min	0.057767952813042533
sim_compute_robot_state-npc2_max	0.07306695526296442
sim_compute_robot_state-npc2_mean	0.06668397660037538
sim_compute_robot_state-npc2_median	0.06711732990601484
sim_compute_robot_state-npc2_min	0.0610105726453993
sim_compute_robot_state-npc3_max	0.07453900575637817
sim_compute_robot_state-npc3_mean	0.0688540817960915
sim_compute_robot_state-npc3_median	0.07378169275679679
sim_compute_robot_state-npc3_min	0.06049155195554098
sim_compute_sim_state_max	0.04314365712079135
sim_compute_sim_state_mean	0.0380886958124504
sim_compute_sim_state_median	0.037191215683432186
sim_compute_sim_state_min	0.03281725446383158
sim_physics_max	0.045003901828419075
sim_physics_mean	0.03641468134024246
sim_physics_median	0.03418974315418916
sim_physics_min	0.030658170580863953
sim_render-ego_max	0.07090726765719327
sim_render-ego_mean	0.0638759333860992
sim_render-ego_median	0.06189242468939887
sim_render-ego_min	0.058236594001452126
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18547

2373

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

error

2019-04-19 16:01:19+00:00

2019-04-19 16:22:06+00:00

0:20:47

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18531

2399

Liam Paull 🇨🇦

random_agent

step1-simulation

host-error

2019-04-19 15:45:38+00:00

2019-04-19 16:00:03+00:00

0:14:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2399/step1-simulation-ip-172-31-25-98-9205-job18531/tmp/tmpy52_xpmm/episodes/udem1-1-0/camera.mp4']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18517

2409

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-19 15:24:26+00:00

2019-04-19 15:45:11+00:00

0:20:45

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18501

2439

Jacopo Tani

random_agent

step1-simulation

success

2019-04-19 15:15:37+00:00

2019-04-19 15:23:47+00:00

0:08:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.18582734194668857
agent_compute-ego_mean	0.1533931606142968
agent_compute-ego_median	0.15307207902272543
agent_compute-ego_min	0.11531743231941673
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025775630519075218, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0708345872051311, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.16891909545322634, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.10415281889573584, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04061685868029325, "sim_compute_performance-ego": 0.07732570846125765, "sim_compute_robot_state-ego": 0.08200641398159962}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.02570952068675648, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06957742842760953, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.18582734194668857, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.1005380316214128, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04109306768937544, "sim_compute_performance-ego": 0.07382790608839555, "sim_compute_robot_state-ego": 0.08065770430998369}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.025001870261298284, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06360229386223687, "in-drivable-lane": 0, "agent_compute-ego": 0.14382985432942708, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.09136870702107748, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03690014945136176, "sim_compute_performance-ego": 0.06548571586608887, "sim_compute_robot_state-ego": 0.06949018372429741}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.024855653444925945, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06555977463722229, "in-drivable-lane": 0, "agent_compute-ego": 0.15307207902272543, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09701610604921976, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03863932192325592, "sim_compute_performance-ego": 0.06785932679971059, "sim_compute_robot_state-ego": 0.07190380493799846}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.020888454773846793, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.047475976102492386, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11531743231941673, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08247220165589277, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.029280929004444796, "sim_compute_performance-ego": 0.04887000602834365, "sim_compute_robot_state-ego": 0.05114672464482924}}
set_robot_commands_max	0.10415281889573584
set_robot_commands_mean	0.09510957304866773
set_robot_commands_median	0.09701610604921976
set_robot_commands_min	0.08247220165589277
sim_compute_performance-ego_max	0.07732570846125765
sim_compute_performance-ego_mean	0.06667373264875925
sim_compute_performance-ego_median	0.06785932679971059
sim_compute_performance-ego_min	0.04887000602834365
sim_compute_robot_state-ego_max	0.08200641398159962
sim_compute_robot_state-ego_mean	0.07104096631974169
sim_compute_robot_state-ego_median	0.07190380493799846
sim_compute_robot_state-ego_min	0.05114672464482924
sim_compute_sim_state_max	0.04109306768937544
sim_compute_sim_state_mean	0.03730606534974623
sim_compute_sim_state_median	0.03863932192325592
sim_compute_sim_state_min	0.029280929004444796
sim_physics_max	0.025775630519075218
sim_physics_mean	0.024446225937180543
sim_physics_median	0.025001870261298284
sim_physics_min	0.020888454773846793
sim_render-ego_max	0.0708345872051311
sim_render-ego_mean	0.06341001204693844
sim_render-ego_median	0.06555977463722229
sim_render-ego_min	0.047475976102492386
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18496

2443

Jacopo Tani

random_agent

step1-simulation

success

2019-04-19 15:00:23+00:00

2019-04-19 15:14:54+00:00

0:14:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.15070025382503385
agent_compute-ego_mean	0.13729527607298117
agent_compute-ego_median	0.13879356308588903
agent_compute-ego_min	0.11739716621545646
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03998664068797278, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06143862103659009, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13879356308588903, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08248854061913868, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03411926163567437, "sim_compute_performance-ego": 0.06275830193171425, "sim_compute_robot_state-ego": 0.0665429811629038, "sim_compute_robot_state-npc0": 0.06032902096945142, "sim_compute_robot_state-npc1": 0.05743052467467293, "sim_compute_robot_state-npc2": 0.05853034958006844, "sim_compute_robot_state-npc3": 0.059852331403702025}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.0409855889339073, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06609882560430788, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.14739462441089107, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0922247802509981, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03772464920492733, "sim_compute_performance-ego": 0.06712606373955221, "sim_compute_robot_state-ego": 0.07332071136025821, "sim_compute_robot_state-npc0": 0.0693371950411329, "sim_compute_robot_state-npc1": 0.06743492799646714, "sim_compute_robot_state-npc2": 0.0672465586194805, "sim_compute_robot_state-npc3": 0.06708686492022346}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04496110254718411, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.07036234101941509, "in-drivable-lane": 0, "agent_compute-ego": 0.15070025382503385, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.09316683584643948, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03781788195333173, "sim_compute_performance-ego": 0.06674543888338151, "sim_compute_robot_state-ego": 0.07165199325930688, "sim_compute_robot_state-npc0": 0.06624883221041772, "sim_compute_robot_state-npc1": 0.06655468863825645, "sim_compute_robot_state-npc2": 0.06631278991699219, "sim_compute_robot_state-npc3": 0.06689192018201275}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04040936713523053, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.059754123079015856, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13219077282763542, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08017108034580311, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03499821145483788, "sim_compute_performance-ego": 0.06168757854623998, "sim_compute_robot_state-ego": 0.06337687056115333, "sim_compute_robot_state-npc0": 0.0633584920396196, "sim_compute_robot_state-npc1": 0.06199540483190658, "sim_compute_robot_state-npc2": 0.06159999776393809, "sim_compute_robot_state-npc3": 0.060993496407853794}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02484934605084933, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03823945155510536, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11739716621545646, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05780889896246103, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02309693739964412, "sim_compute_performance-ego": 0.038435908464285046, "sim_compute_robot_state-ego": 0.039951241933382474, "sim_compute_robot_state-npc0": 0.0420299951846783, "sim_compute_robot_state-npc1": 0.04080129128236037, "sim_compute_robot_state-npc2": 0.04074336015261137, "sim_compute_robot_state-npc3": 0.04033696192961473}}
set_robot_commands_max	0.09316683584643948
set_robot_commands_mean	0.08117202720496809
set_robot_commands_median	0.08248854061913868
set_robot_commands_min	0.05780889896246103
sim_compute_performance-ego_max	0.06712606373955221
sim_compute_performance-ego_mean	0.059350658313034585
sim_compute_performance-ego_median	0.06275830193171425
sim_compute_performance-ego_min	0.038435908464285046
sim_compute_robot_state-ego_max	0.07332071136025821
sim_compute_robot_state-ego_mean	0.06296875965540093
sim_compute_robot_state-ego_median	0.0665429811629038
sim_compute_robot_state-ego_min	0.039951241933382474
sim_compute_robot_state-npc0_max	0.0693371950411329
sim_compute_robot_state-npc0_mean	0.06026070708905999
sim_compute_robot_state-npc0_median	0.0633584920396196
sim_compute_robot_state-npc0_min	0.0420299951846783
sim_compute_robot_state-npc1_max	0.06743492799646714
sim_compute_robot_state-npc1_mean	0.0588433674847327
sim_compute_robot_state-npc1_median	0.06199540483190658
sim_compute_robot_state-npc1_min	0.04080129128236037
sim_compute_robot_state-npc2_max	0.0672465586194805
sim_compute_robot_state-npc2_mean	0.05888661120661813
sim_compute_robot_state-npc2_median	0.06159999776393809
sim_compute_robot_state-npc2_min	0.04074336015261137
sim_compute_robot_state-npc3_max	0.06708686492022346
sim_compute_robot_state-npc3_mean	0.059032314968681346
sim_compute_robot_state-npc3_median	0.060993496407853794
sim_compute_robot_state-npc3_min	0.04033696192961473
sim_compute_sim_state_max	0.03781788195333173
sim_compute_sim_state_mean	0.03355138832968309
sim_compute_sim_state_median	0.03499821145483788
sim_compute_sim_state_min	0.02309693739964412
sim_physics_max	0.04496110254718411
sim_physics_mean	0.03823840907102881
sim_physics_median	0.04040936713523053
sim_physics_min	0.02484934605084933
sim_render-ego_max	0.07036234101941509
sim_render-ego_mean	0.05917867245888686
sim_render-ego_median	0.06143862103659009
sim_render-ego_min	0.03823945155510536
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

18491

2447

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-19 14:55:58+00:00

2019-04-19 15:00:05+00:00

0:04:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18491-511561', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18491-511561', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18491-511561', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18465

2491

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-19 14:39:56+00:00

2019-04-19 14:55:32+00:00

0:15:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.11227218847997776
survival_time_median	4.549999999999992
deviation-center-line_median	0.05038840056913715
in-drivable-lane_median	2.099999999999996

other stats

agent_compute-ego_max	0.18699481270530008
agent_compute-ego_mean	0.1625790836412538
agent_compute-ego_median	0.1600939933458964
agent_compute-ego_min	0.1263949570693369
deviation-center-line_max	0.2062859424516995
deviation-center-line_mean	0.10230733930529888
deviation-center-line_min	0.02468869832529482
deviation-heading_max	5.816737068914831
deviation-heading_mean	2.7694058473008853
deviation-heading_median	1.7281012097897404
deviation-heading_min	0.614813842932119
driven_any_max	1.4307918689999637
driven_any_mean	0.6513225526965927
driven_any_median	0.405408545935544
driven_any_min	0.1551420205419281
driven_lanedir_consec_max	0.5112913221072168
driven_lanedir_consec_mean	0.21444956670167645
driven_lanedir_consec_min	0.040098062775395515
driven_lanedir_max	0.5112913221072168
driven_lanedir_mean	0.21444956670167645
driven_lanedir_median	0.11227218847997776
driven_lanedir_min	0.040098062775395515
in-drivable-lane_max	7.050000000000028
in-drivable-lane_mean	3.280000000000008
in-drivable-lane_min	0.5500000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4307918689999637, "sim_physics": 0.02780968427658081, "survival_time": 14.950000000000076, "driven_lanedir": 0.5112913221072168, "sim_render-ego": 0.06441033204396565, "in-drivable-lane": 7.050000000000028, "agent_compute-ego": 0.1600939933458964, "deviation-heading": 5.816737068914831, "set_robot_commands": 0.08779879967371623, "deviation-center-line": 0.2062859424516995, "driven_lanedir_consec": 0.5112913221072168, "sim_compute_sim_state": 0.035896825790405276, "sim_compute_performance-ego": 0.06457502524058024, "sim_compute_robot_state-ego": 0.06661817868550618}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17056940659606168, "sim_physics": 0.020216128405402687, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06676373900990817, "sim_render-ego": 0.05619483134325813, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1528515535242417, "deviation-heading": 0.614813842932119, "set_robot_commands": 0.08017465647529154, "deviation-center-line": 0.029325799248932336, "driven_lanedir_consec": 0.06676373900990817, "sim_compute_sim_state": 0.033557926907258874, "sim_compute_performance-ego": 0.05900367568520939, "sim_compute_robot_state-ego": 0.062414204373079187}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1551420205419281, "sim_physics": 0.02696772055192427, "survival_time": 1.6500000000000008, "driven_lanedir": 0.040098062775395515, "sim_render-ego": 0.0682182384259773, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.18699481270530008, "deviation-heading": 0.699597064624216, "set_robot_commands": 0.10400063341314142, "deviation-center-line": 0.02468869832529482, "driven_lanedir_consec": 0.040098062775395515, "sim_compute_sim_state": 0.040780226389567055, "sim_compute_performance-ego": 0.07368446841384425, "sim_compute_robot_state-ego": 0.07932773503390225}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.094700921409466, "sim_physics": 0.017831956307719072, "survival_time": 12.700000000000044, "driven_lanedir": 0.34182252113588385, "sim_render-ego": 0.05076472120960866, "in-drivable-lane": 6.150000000000017, "agent_compute-ego": 0.1263949570693369, "deviation-heading": 4.98778005024352, "set_robot_commands": 0.07305762523741234, "deviation-center-line": 0.2008478559314305, "driven_lanedir_consec": 0.34182252113588385, "sim_compute_sim_state": 0.030338960369740885, "sim_compute_performance-ego": 0.05158432262150321, "sim_compute_robot_state-ego": 0.053457926577470435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.405408545935544, "sim_physics": 0.02874842580858168, "survival_time": 4.549999999999992, "driven_lanedir": 0.11227218847997776, "sim_render-ego": 0.06976963399530767, "in-drivable-lane": 2.099999999999996, "agent_compute-ego": 0.1865601015614939, "deviation-heading": 1.7281012097897404, "set_robot_commands": 0.0979934315105061, "deviation-center-line": 0.05038840056913715, "driven_lanedir_consec": 0.11227218847997776, "sim_compute_sim_state": 0.04121360150012341, "sim_compute_performance-ego": 0.07701651080624088, "sim_compute_robot_state-ego": 0.07847270860776796}}
set_robot_commands_max	0.10400063341314142
set_robot_commands_mean	0.08860502926201352
set_robot_commands_median	0.08779879967371623
set_robot_commands_min	0.07305762523741234
sim_compute_performance-ego_max	0.07701651080624088
sim_compute_performance-ego_mean	0.0651728005534756
sim_compute_performance-ego_median	0.06457502524058024
sim_compute_performance-ego_min	0.05158432262150321
sim_compute_robot_state-ego_max	0.07932773503390225
sim_compute_robot_state-ego_mean	0.0680581506555452
sim_compute_robot_state-ego_median	0.06661817868550618
sim_compute_robot_state-ego_min	0.053457926577470435
sim_compute_sim_state_max	0.04121360150012341
sim_compute_sim_state_mean	0.0363575081914191
sim_compute_sim_state_median	0.035896825790405276
sim_compute_sim_state_min	0.030338960369740885
sim_physics_max	0.02874842580858168
sim_physics_mean	0.024314783070041705
sim_physics_median	0.02696772055192427
sim_physics_min	0.017831956307719072
sim_render-ego_max	0.06976963399530767
sim_render-ego_mean	0.06187155140362348
sim_render-ego_median	0.06441033204396565
sim_render-ego_min	0.05076472120960866
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.110000000000023
survival_time_min	1.6500000000000008

No reset possible

18423

2556

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 14:26:47+00:00

2019-04-19 14:39:18+00:00

0:12:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.07130295457974287
agent_compute-ego_mean	0.06583590524620767
agent_compute-ego_median	0.06942648636667352
agent_compute-ego_min	0.05904328517424755
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.036281179126940274, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.05627398992839613, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.05935820780302349, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.08240659613358348, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.0322561314231471, "sim_compute_performance-ego": 0.05563908376191792, "sim_compute_robot_state-ego": 0.057155182487086245, "sim_compute_robot_state-npc0": 0.055560488449899775, "sim_compute_robot_state-npc1": 0.05723872435720343, "sim_compute_robot_state-npc2": 0.05660529638591565, "sim_compute_robot_state-npc3": 0.05790779465123227}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.036111411295439065, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06228521623109516, "in-drivable-lane": 0, "agent_compute-ego": 0.06942648636667352, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.08623312021556653, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.033832518677962456, "sim_compute_performance-ego": 0.06323420374017012, "sim_compute_robot_state-ego": 0.06276776288685046, "sim_compute_robot_state-npc0": 0.05557463671031751, "sim_compute_robot_state-npc1": 0.05573063147695441, "sim_compute_robot_state-npc2": 0.06083440153222335, "sim_compute_robot_state-npc3": 0.06165491279802824}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.03451983745281513, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.0524138976366092, "in-drivable-lane": 0, "agent_compute-ego": 0.05904328517424755, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07688376231071277, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03079060407785269, "sim_compute_performance-ego": 0.052723988508566834, "sim_compute_robot_state-ego": 0.05382581857534555, "sim_compute_robot_state-npc0": 0.054105942065899186, "sim_compute_robot_state-npc1": 0.055284799673618414, "sim_compute_robot_state-npc2": 0.05577843005840595, "sim_compute_robot_state-npc3": 0.05718807073739859}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.04458620850469025, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06432659525266836, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07130295457974287, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.09465223634746713, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03725715086493694, "sim_compute_performance-ego": 0.0675436409426407, "sim_compute_robot_state-ego": 0.07079799410323022, "sim_compute_robot_state-npc0": 0.06791393521805884, "sim_compute_robot_state-npc1": 0.06693923305457747, "sim_compute_robot_state-npc2": 0.06926084236359932, "sim_compute_robot_state-npc3": 0.06670366878240881}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.03193158995021473, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.051900993693958626, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07004859230735085, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07934130863709883, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.0308051813732494, "sim_compute_performance-ego": 0.054877048188989815, "sim_compute_robot_state-ego": 0.056189894676208496, "sim_compute_robot_state-npc0": 0.05901336128061468, "sim_compute_robot_state-npc1": 0.057663240215995094, "sim_compute_robot_state-npc2": 0.05869066173380071, "sim_compute_robot_state-npc3": 0.055094594305211846}}
set_robot_commands_max	0.09465223634746713
set_robot_commands_mean	0.08390340472888574
set_robot_commands_median	0.08240659613358348
set_robot_commands_min	0.07688376231071277
sim_compute_performance-ego_max	0.0675436409426407
sim_compute_performance-ego_mean	0.05880359302845708
sim_compute_performance-ego_median	0.05563908376191792
sim_compute_performance-ego_min	0.052723988508566834
sim_compute_robot_state-ego_max	0.07079799410323022
sim_compute_robot_state-ego_mean	0.06014733054574419
sim_compute_robot_state-ego_median	0.057155182487086245
sim_compute_robot_state-ego_min	0.05382581857534555
sim_compute_robot_state-npc0_max	0.06791393521805884
sim_compute_robot_state-npc0_mean	0.058433672744958
sim_compute_robot_state-npc0_median	0.05557463671031751
sim_compute_robot_state-npc0_min	0.054105942065899186
sim_compute_robot_state-npc1_max	0.06693923305457747
sim_compute_robot_state-npc1_mean	0.05857132575566977
sim_compute_robot_state-npc1_median	0.05723872435720343
sim_compute_robot_state-npc1_min	0.055284799673618414
sim_compute_robot_state-npc2_max	0.06926084236359932
sim_compute_robot_state-npc2_mean	0.060233926414788995
sim_compute_robot_state-npc2_median	0.05869066173380071
sim_compute_robot_state-npc2_min	0.05577843005840595
sim_compute_robot_state-npc3_max	0.06670366878240881
sim_compute_robot_state-npc3_mean	0.05970980825485596
sim_compute_robot_state-npc3_median	0.05790779465123227
sim_compute_robot_state-npc3_min	0.055094594305211846
sim_compute_sim_state_max	0.03725715086493694
sim_compute_sim_state_mean	0.03298831728342972
sim_compute_sim_state_median	0.0322561314231471
sim_compute_sim_state_min	0.03079060407785269
sim_physics_max	0.04458620850469025
sim_physics_mean	0.03668604526601989
sim_physics_median	0.036111411295439065
sim_physics_min	0.03193158995021473
sim_render-ego_max	0.06432659525266836
sim_render-ego_mean	0.057440138548545495
sim_render-ego_median	0.05627398992839613
sim_render-ego_min	0.051900993693958626
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18415

2561

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 14:17:39+00:00

2019-04-19 14:25:12+00:00

0:07:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07159359571410388
agent_compute-ego_mean	0.06192671277586905
agent_compute-ego_median	0.06264503458712964
agent_compute-ego_min	0.05007862417321456
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.024868098700918804, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.061668369828200925, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07159359571410388, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.10171329393619444, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03832915061857642, "sim_compute_performance-ego": 0.06572826315717, "sim_compute_robot_state-ego": 0.06951303889111775}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.0196227660545936, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05759107149564303, "in-drivable-lane": 0, "agent_compute-ego": 0.06326443415421706, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.08344887770139255, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03419134250053993, "sim_compute_performance-ego": 0.05986270537743202, "sim_compute_robot_state-ego": 0.06330294792468731}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.022480721169329705, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.057777247530348755, "in-drivable-lane": 0, "agent_compute-ego": 0.06264503458712964, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08429150885724007, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.033886229738276055, "sim_compute_performance-ego": 0.06236721099691188, "sim_compute_robot_state-ego": 0.06523069929569325}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02337117509527521, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.056591298553969833, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06205187525068011, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.08903503155970312, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03403252297705346, "sim_compute_performance-ego": 0.05835429390708169, "sim_compute_robot_state-ego": 0.05930200513902601}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.017040189943815533, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.04827072745875309, "in-drivable-lane": 0, "agent_compute-ego": 0.05007862417321456, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.06880024232362446, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.029798401029486405, "sim_compute_performance-ego": 0.048754867754484475, "sim_compute_robot_state-ego": 0.05131346301028603}}
set_robot_commands_max	0.10171329393619444
set_robot_commands_mean	0.08545779087563092
set_robot_commands_median	0.08429150885724007
set_robot_commands_min	0.06880024232362446
sim_compute_performance-ego_max	0.06572826315717
sim_compute_performance-ego_mean	0.05901346823861601
sim_compute_performance-ego_median	0.05986270537743202
sim_compute_performance-ego_min	0.048754867754484475
sim_compute_robot_state-ego_max	0.06951303889111775
sim_compute_robot_state-ego_mean	0.06173243085216208
sim_compute_robot_state-ego_median	0.06330294792468731
sim_compute_robot_state-ego_min	0.05131346301028603
sim_compute_sim_state_max	0.03832915061857642
sim_compute_sim_state_mean	0.034047529372786454
sim_compute_sim_state_median	0.03403252297705346
sim_compute_sim_state_min	0.029798401029486405
sim_physics_max	0.024868098700918804
sim_physics_mean	0.021476590192786575
sim_physics_median	0.022480721169329705
sim_physics_min	0.017040189943815533
sim_render-ego_max	0.061668369828200925
sim_render-ego_mean	0.05637974297338313
sim_render-ego_median	0.05759107149564303
sim_render-ego_min	0.04827072745875309
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18400

2586

Julian Zilly

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-19 14:01:45+00:00

2019-04-19 14:16:53+00:00

0:15:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.26847026229559556
survival_time_median	5.599999999999988
deviation-center-line_median	0.30187794742549934
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.2545829216639201
agent_compute-ego_mean	0.2219512231825596
agent_compute-ego_median	0.21027003469921293
agent_compute-ego_min	0.18838188922510735
deviation-center-line_max	0.3277319263793164
deviation-center-line_mean	0.3037470961583415
deviation-center-line_min	0.28880597430396643
deviation-heading_max	2.2737521974477857
deviation-heading_mean	2.083457690278712
deviation-heading_median	2.0576717461615415
deviation-heading_min	1.9334522073346605
driven_any_max	0.34014570437434044
driven_any_mean	0.30454108912141437
driven_any_median	0.3063241320364145
driven_any_min	0.266053615463051
driven_lanedir_consec_max	0.3027719081965703
driven_lanedir_consec_mean	0.2674989235026655
driven_lanedir_consec_min	0.22869532646191848
driven_lanedir_max	0.3027719081965703
driven_lanedir_mean	0.2674989235026655
driven_lanedir_median	0.26847026229559556
driven_lanedir_min	0.22869532646191848
in-drivable-lane_max	0.09999999999999964
in-drivable-lane_mean	0.04999999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.266053615463051, "sim_physics": 0.023930486043294272, "survival_time": 5.249999999999989, "driven_lanedir": 0.22869532646191848, "sim_render-ego": 0.061926083337692985, "in-drivable-lane": 0, "agent_compute-ego": 0.21027003469921293, "deviation-heading": 2.2737521974477857, "set_robot_commands": 0.08835865202404204, "deviation-center-line": 0.2952161582766645, "driven_lanedir_consec": 0.22869532646191848, "sim_compute_sim_state": 0.03639048848833357, "sim_compute_performance-ego": 0.0633671624319894, "sim_compute_robot_state-ego": 0.06639022600083123}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.30709644601684766, "sim_physics": 0.02207863436336011, "survival_time": 5.649999999999988, "driven_lanedir": 0.26847026229559556, "sim_render-ego": 0.05363166015760033, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.18838188922510735, "deviation-heading": 2.051359631339334, "set_robot_commands": 0.08093809659502148, "deviation-center-line": 0.305103474406261, "driven_lanedir_consec": 0.26847026229559556, "sim_compute_sim_state": 0.03247423720570792, "sim_compute_performance-ego": 0.05799729423185365, "sim_compute_robot_state-ego": 0.05983758605686964}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3063241320364145, "sim_physics": 0.028317166699303523, "survival_time": 5.399999999999989, "driven_lanedir": 0.2699503678385824, "sim_render-ego": 0.06737946801715428, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2545829216639201, "deviation-heading": 1.9334522073346605, "set_robot_commands": 0.1049258134983204, "deviation-center-line": 0.28880597430396643, "driven_lanedir_consec": 0.2699503678385824, "sim_compute_sim_state": 0.04064006275600857, "sim_compute_performance-ego": 0.07141962537059078, "sim_compute_robot_state-ego": 0.07907633869736283}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.34014570437434044, "sim_physics": 0.02372896863568214, "survival_time": 6.199999999999986, "driven_lanedir": 0.3027719081965703, "sim_render-ego": 0.05953755686360021, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.20267969562161353, "deviation-heading": 2.0576717461615415, "set_robot_commands": 0.08556723017846385, "deviation-center-line": 0.3277319263793164, "driven_lanedir_consec": 0.3027719081965703, "sim_compute_sim_state": 0.03508585883725074, "sim_compute_performance-ego": 0.06095845853128741, "sim_compute_robot_state-ego": 0.0626765085804847}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3030855477164183, "sim_physics": 0.025687717965670993, "survival_time": 5.599999999999988, "driven_lanedir": 0.2676067527206607, "sim_render-ego": 0.06547480608735766, "in-drivable-lane": 0, "agent_compute-ego": 0.25384157470294405, "deviation-heading": 2.101052669110239, "set_robot_commands": 0.100136541894504, "deviation-center-line": 0.30187794742549934, "driven_lanedir_consec": 0.2676067527206607, "sim_compute_sim_state": 0.03792237383978707, "sim_compute_performance-ego": 0.06823605298995972, "sim_compute_robot_state-ego": 0.07430568763187953}}
set_robot_commands_max	0.1049258134983204
set_robot_commands_mean	0.09198526683807036
set_robot_commands_median	0.08835865202404204
set_robot_commands_min	0.08093809659502148
sim_compute_performance-ego_max	0.07141962537059078
sim_compute_performance-ego_mean	0.06439571871113618
sim_compute_performance-ego_median	0.0633671624319894
sim_compute_performance-ego_min	0.05799729423185365
sim_compute_robot_state-ego_max	0.07907633869736283
sim_compute_robot_state-ego_mean	0.06845726939348558
sim_compute_robot_state-ego_median	0.06639022600083123
sim_compute_robot_state-ego_min	0.05983758605686964
sim_compute_sim_state_max	0.04064006275600857
sim_compute_sim_state_mean	0.036502604225417574
sim_compute_sim_state_median	0.03639048848833357
sim_compute_sim_state_min	0.03247423720570792
sim_physics_max	0.028317166699303523
sim_physics_mean	0.024748594741462203
sim_physics_median	0.023930486043294272
sim_physics_min	0.02207863436336011
sim_render-ego_max	0.06737946801715428
sim_render-ego_mean	0.0615899148926811
sim_render-ego_median	0.061926083337692985
sim_render-ego_min	0.05363166015760033
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	5.619999999999988
survival_time_min	5.249999999999989

No reset possible

18394

2595

Julian Zilly

baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-19 13:59:23+00:00

2019-04-19 14:01:21+00:00

0:01:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18394-622515', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18394-622515', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18394-622515', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18377

2624

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 13:43:44+00:00

2019-04-19 13:58:13+00:00

0:14:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.1613082424286873
agent_compute-ego_mean	0.1436110529740156
agent_compute-ego_median	0.15309632525724523
agent_compute-ego_min	0.11036787124780507
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.047009059361049106, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06802995621211945, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15315818029736716, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.0913491097707597, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.036592896022493875, "sim_compute_performance-ego": 0.06719182786487397, "sim_compute_robot_state-ego": 0.07077832449050177, "sim_compute_robot_state-npc0": 0.06512475770617289, "sim_compute_robot_state-npc1": 0.0663155336228628, "sim_compute_robot_state-npc2": 0.06695780678400917, "sim_compute_robot_state-npc3": 0.06558991235400004}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.04511028177597944, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06891730252434225, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.15309632525724523, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0978701769136915, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03820917185615091, "sim_compute_performance-ego": 0.06861552537656297, "sim_compute_robot_state-ego": 0.07492492713180243, "sim_compute_robot_state-npc0": 0.07048732626671884, "sim_compute_robot_state-npc1": 0.07105372933780446, "sim_compute_robot_state-npc2": 0.07156966714298024, "sim_compute_robot_state-npc3": 0.06882057002946443}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04558352885707733, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06731093698932279, "in-drivable-lane": 0, "agent_compute-ego": 0.1613082424286873, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.1019177129191737, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.037672792711565574, "sim_compute_performance-ego": 0.0693610829691733, "sim_compute_robot_state-ego": 0.07232988265252882, "sim_compute_robot_state-npc0": 0.06769211061539189, "sim_compute_robot_state-npc1": 0.06781241201585339, "sim_compute_robot_state-npc2": 0.07038381022791709, "sim_compute_robot_state-npc3": 0.06945715027470742}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.043525168236265795, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.058514506258863085, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14012464563897314, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08788319344216204, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.037250399589538574, "sim_compute_performance-ego": 0.06349246299013178, "sim_compute_robot_state-ego": 0.06963253782150593, "sim_compute_robot_state-npc0": 0.06354885912956075, "sim_compute_robot_state-npc1": 0.06732867880070463, "sim_compute_robot_state-npc2": 0.06330343002968646, "sim_compute_robot_state-npc3": 0.06378777483676343}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.028532555470099814, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.04567951880968534, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11036787124780507, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07093664774527916, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.027115234961876504, "sim_compute_performance-ego": 0.046312992389385514, "sim_compute_robot_state-ego": 0.04844426191770113, "sim_compute_robot_state-npc0": 0.04913732638725868, "sim_compute_robot_state-npc1": 0.04940513005623451, "sim_compute_robot_state-npc2": 0.047278720598954424, "sim_compute_robot_state-npc3": 0.048618279970609225}}
set_robot_commands_max	0.1019177129191737
set_robot_commands_mean	0.08999136815821322
set_robot_commands_median	0.0913491097707597
set_robot_commands_min	0.07093664774527916
sim_compute_performance-ego_max	0.0693610829691733
sim_compute_performance-ego_mean	0.06299477831802551
sim_compute_performance-ego_median	0.06719182786487397
sim_compute_performance-ego_min	0.046312992389385514
sim_compute_robot_state-ego_max	0.07492492713180243
sim_compute_robot_state-ego_mean	0.06722198680280801
sim_compute_robot_state-ego_median	0.07077832449050177
sim_compute_robot_state-ego_min	0.04844426191770113
sim_compute_robot_state-npc0_max	0.07048732626671884
sim_compute_robot_state-npc0_mean	0.06319807602102061
sim_compute_robot_state-npc0_median	0.06512475770617289
sim_compute_robot_state-npc0_min	0.04913732638725868
sim_compute_robot_state-npc1_max	0.07105372933780446
sim_compute_robot_state-npc1_mean	0.06438309676669196
sim_compute_robot_state-npc1_median	0.06732867880070463
sim_compute_robot_state-npc1_min	0.04940513005623451
sim_compute_robot_state-npc2_max	0.07156966714298024
sim_compute_robot_state-npc2_mean	0.06389868695670949
sim_compute_robot_state-npc2_median	0.06695780678400917
sim_compute_robot_state-npc2_min	0.047278720598954424
sim_compute_robot_state-npc3_max	0.06945715027470742
sim_compute_robot_state-npc3_mean	0.06325473749310892
sim_compute_robot_state-npc3_median	0.06558991235400004
sim_compute_robot_state-npc3_min	0.048618279970609225
sim_compute_sim_state_max	0.03820917185615091
sim_compute_sim_state_mean	0.03536809902832509
sim_compute_sim_state_median	0.037250399589538574
sim_compute_sim_state_min	0.027115234961876504
sim_physics_max	0.047009059361049106
sim_physics_mean	0.04195211874009429
sim_physics_median	0.04511028177597944
sim_physics_min	0.028532555470099814
sim_render-ego_max	0.06891730252434225
sim_render-ego_mean	0.06169044415886658
sim_render-ego_median	0.06731093698932279
sim_render-ego_min	0.04567951880968534
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

18361

2656

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 13:22:50+00:00

2019-04-19 13:43:38+00:00

0:20:48

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18356

2665

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-19 13:22:00+00:00

2019-04-19 13:22:29+00:00

0:00:29

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18340

2694

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 13:00:55+00:00

2019-04-19 13:21:40+00:00

0:20:45

Waited 1200 seconds [...]

Waited 1200 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18335

2699

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-19 12:46:39+00:00

2019-04-19 13:00:05+00:00

0:13:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18335-408769', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18335-408769', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18335-408769', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18324

2719

test for ppo

step1-simulation

error

2019-04-19 12:45:11+00:00

2019-04-19 12:46:27+00:00

0:01:16

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18320

2734

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-19 12:43:11+00:00

2019-04-19 12:44:51+00:00

0:01:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18307

2763

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 12:27:53+00:00

2019-04-19 12:42:52+00:00

0:14:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.07979927313955207
agent_compute-ego_mean	0.07215884684317511
agent_compute-ego_median	0.07087284410503548
agent_compute-ego_min	0.0628395582500257
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.05248611851742393, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.07209056553087737, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07979927313955207, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.1075541897823936, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.041381717983045074, "sim_compute_performance-ego": 0.07551177426388389, "sim_compute_robot_state-ego": 0.08353098317196495, "sim_compute_robot_state-npc0": 0.07517224863955849, "sim_compute_robot_state-npc1": 0.07522086595234118, "sim_compute_robot_state-npc2": 0.07590615372908743, "sim_compute_robot_state-npc3": 0.07580714476735968}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.042636645467657795, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06336977607325504, "in-drivable-lane": 0, "agent_compute-ego": 0.0628395582500257, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.08451698328319349, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.0361976749018619, "sim_compute_performance-ego": 0.06333236317885549, "sim_compute_robot_state-ego": 0.06800263806393272, "sim_compute_robot_state-npc0": 0.06363539946706671, "sim_compute_robot_state-npc1": 0.06275582940954912, "sim_compute_robot_state-npc2": 0.06268117929759778, "sim_compute_robot_state-npc3": 0.06050687087209601}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.0422511467566857, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06199284088917267, "in-drivable-lane": 0, "agent_compute-ego": 0.06760655916654147, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.0888362297644982, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03713413385244516, "sim_compute_performance-ego": 0.0673971420679337, "sim_compute_robot_state-ego": 0.06486988067626953, "sim_compute_robot_state-npc0": 0.06920639062539125, "sim_compute_robot_state-npc1": 0.06925615897545448, "sim_compute_robot_state-npc2": 0.06665136263920711, "sim_compute_robot_state-npc3": 0.06782790330740121}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.05043277941959005, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06549842592696069, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07087284410503548, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.09470754274180238, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03854482946261554, "sim_compute_performance-ego": 0.06862945287999972, "sim_compute_robot_state-ego": 0.07074459169951963, "sim_compute_robot_state-npc0": 0.06679814969989616, "sim_compute_robot_state-npc1": 0.0688569747226339, "sim_compute_robot_state-npc2": 0.06921249376216405, "sim_compute_robot_state-npc3": 0.06906556075727435}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.04517087069424716, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.07214553247798573, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0796759995547208, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.11156142299825494, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.04234468936920166, "sim_compute_performance-ego": 0.07545180212367665, "sim_compute_robot_state-ego": 0.08275962417775934, "sim_compute_robot_state-npc0": 0.07395640828392723, "sim_compute_robot_state-npc1": 0.07615814967588945, "sim_compute_robot_state-npc2": 0.07497445019808682, "sim_compute_robot_state-npc3": 0.0726784576069225}}
set_robot_commands_max	0.11156142299825494
set_robot_commands_mean	0.09743527371402852
set_robot_commands_median	0.09470754274180238
set_robot_commands_min	0.08451698328319349
sim_compute_performance-ego_max	0.07551177426388389
sim_compute_performance-ego_mean	0.07006450690286989
sim_compute_performance-ego_median	0.06862945287999972
sim_compute_performance-ego_min	0.06333236317885549
sim_compute_robot_state-ego_max	0.08353098317196495
sim_compute_robot_state-ego_mean	0.07398154355788923
sim_compute_robot_state-ego_median	0.07074459169951963
sim_compute_robot_state-ego_min	0.06486988067626953
sim_compute_robot_state-npc0_max	0.07517224863955849
sim_compute_robot_state-npc0_mean	0.06975371934316797
sim_compute_robot_state-npc0_median	0.06920639062539125
sim_compute_robot_state-npc0_min	0.06363539946706671
sim_compute_robot_state-npc1_max	0.07615814967588945
sim_compute_robot_state-npc1_mean	0.07044959574717362
sim_compute_robot_state-npc1_median	0.06925615897545448
sim_compute_robot_state-npc1_min	0.06275582940954912
sim_compute_robot_state-npc2_max	0.07590615372908743
sim_compute_robot_state-npc2_mean	0.06988512792522864
sim_compute_robot_state-npc2_median	0.06921249376216405
sim_compute_robot_state-npc2_min	0.06268117929759778
sim_compute_robot_state-npc3_max	0.07580714476735968
sim_compute_robot_state-npc3_mean	0.06917718746221076
sim_compute_robot_state-npc3_median	0.06906556075727435
sim_compute_robot_state-npc3_min	0.06050687087209601
sim_compute_sim_state_max	0.04234468936920166
sim_compute_sim_state_mean	0.03912060911383387
sim_compute_sim_state_median	0.03854482946261554
sim_compute_sim_state_min	0.0361976749018619
sim_physics_max	0.05248611851742393
sim_physics_mean	0.04659551217112092
sim_physics_median	0.04517087069424716
sim_physics_min	0.0422511467566857
sim_render-ego_max	0.07214553247798573
sim_render-ego_mean	0.0670194281796503
sim_render-ego_median	0.06549842592696069
sim_render-ego_min	0.06199284088917267
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18282

2826

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 12:14:12+00:00

2019-04-19 12:27:47+00:00

0:13:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.13829312627277676
agent_compute-ego_mean	0.13043224986680707
agent_compute-ego_median	0.13176966098047072
agent_compute-ego_min	0.12179704354359554
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.042240744545346216, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.060272095695374506, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13829312627277676, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.0907254938095335, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03559234785655188, "sim_compute_performance-ego": 0.06381737239777095, "sim_compute_robot_state-ego": 0.06510687252831837, "sim_compute_robot_state-npc0": 0.06277511990259564, "sim_compute_robot_state-npc1": 0.061704522087460474, "sim_compute_robot_state-npc2": 0.06423150925409227, "sim_compute_robot_state-npc3": 0.06528713211180671}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03805061415130017, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.056998977474137846, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13819952572093291, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08195783110225902, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.034690141677856445, "sim_compute_performance-ego": 0.058612945033054725, "sim_compute_robot_state-ego": 0.06287173663868624, "sim_compute_robot_state-npc0": 0.056784470876057945, "sim_compute_robot_state-npc1": 0.06202564052506989, "sim_compute_robot_state-npc2": 0.06327333169824936, "sim_compute_robot_state-npc3": 0.06145848012438007}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04187549314191265, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05925845330761325, "in-drivable-lane": 0, "agent_compute-ego": 0.13176966098047072, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.08007651759732154, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03382378239785471, "sim_compute_performance-ego": 0.06049646485236383, "sim_compute_robot_state-ego": 0.06518566608428955, "sim_compute_robot_state-npc0": 0.059243509846348914, "sim_compute_robot_state-npc1": 0.058159670522136074, "sim_compute_robot_state-npc2": 0.0616399472759616, "sim_compute_robot_state-npc3": 0.062107889882979855}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03305172666590264, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05104342927324011, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12210189281625952, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07909269028521598, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.028333098330396288, "sim_compute_performance-ego": 0.050628365354335056, "sim_compute_robot_state-ego": 0.056395786873837735, "sim_compute_robot_state-npc0": 0.053924573228714315, "sim_compute_robot_state-npc1": 0.04995342772057716, "sim_compute_robot_state-npc2": 0.0511328971132319, "sim_compute_robot_state-npc3": 0.05003294285307539}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.0330650989825909, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05165033615552462, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.12179704354359554, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07350842769329365, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02953137342746441, "sim_compute_performance-ego": 0.05212949330990131, "sim_compute_robot_state-ego": 0.05341831537393423, "sim_compute_robot_state-npc0": 0.05259096622467041, "sim_compute_robot_state-npc1": 0.051980082805340104, "sim_compute_robot_state-npc2": 0.05151657416270329, "sim_compute_robot_state-npc3": 0.05209893446702223}}
set_robot_commands_max	0.0907254938095335
set_robot_commands_mean	0.08107219209752473
set_robot_commands_median	0.08007651759732154
set_robot_commands_min	0.07350842769329365
sim_compute_performance-ego_max	0.06381737239777095
sim_compute_performance-ego_mean	0.05713692818948517
sim_compute_performance-ego_median	0.058612945033054725
sim_compute_performance-ego_min	0.050628365354335056
sim_compute_robot_state-ego_max	0.06518566608428955
sim_compute_robot_state-ego_mean	0.06059567549981322
sim_compute_robot_state-ego_median	0.06287173663868624
sim_compute_robot_state-ego_min	0.05341831537393423
sim_compute_robot_state-npc0_max	0.06277511990259564
sim_compute_robot_state-npc0_mean	0.05706372801567744
sim_compute_robot_state-npc0_median	0.056784470876057945
sim_compute_robot_state-npc0_min	0.05259096622467041
sim_compute_robot_state-npc1_max	0.06202564052506989
sim_compute_robot_state-npc1_mean	0.05676466873211674
sim_compute_robot_state-npc1_median	0.058159670522136074
sim_compute_robot_state-npc1_min	0.04995342772057716
sim_compute_robot_state-npc2_max	0.06423150925409227
sim_compute_robot_state-npc2_mean	0.05835885190084768
sim_compute_robot_state-npc2_median	0.0616399472759616
sim_compute_robot_state-npc2_min	0.0511328971132319
sim_compute_robot_state-npc3_max	0.06528713211180671
sim_compute_robot_state-npc3_mean	0.058197075887852855
sim_compute_robot_state-npc3_median	0.06145848012438007
sim_compute_robot_state-npc3_min	0.05003294285307539
sim_compute_sim_state_max	0.03559234785655188
sim_compute_sim_state_mean	0.03239414873802475
sim_compute_sim_state_median	0.03382378239785471
sim_compute_sim_state_min	0.028333098330396288
sim_physics_max	0.042240744545346216
sim_physics_mean	0.03765673549741052
sim_physics_median	0.03805061415130017
sim_physics_min	0.03305172666590264
sim_render-ego_max	0.060272095695374506
sim_render-ego_mean	0.05584465838117807
sim_render-ego_median	0.056998977474137846
sim_render-ego_min	0.05104342927324011
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

18256

2755

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 12:03:54+00:00

2019-04-19 12:13:51+00:00

0:09:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07099671740280955
agent_compute-ego_mean	0.05346587170396409
agent_compute-ego_median	0.0536389953487522
agent_compute-ego_min	0.03993112307328444
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.014754894303112494, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.03870579382268394, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04131663717874667, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.055751448724328016, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02383641498844798, "sim_compute_performance-ego": 0.04016565985795928, "sim_compute_robot_state-ego": 0.04084240808719542}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.013039359679588905, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.037591906694265514, "in-drivable-lane": 0, "agent_compute-ego": 0.03993112307328444, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.05371682460491474, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.022408292843745303, "sim_compute_performance-ego": 0.03783256274003249, "sim_compute_robot_state-ego": 0.03918701868790846}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.02230897862860497, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05827830700164146, "in-drivable-lane": 0, "agent_compute-ego": 0.06144588551622756, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08584400440784211, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03494650252321933, "sim_compute_performance-ego": 0.05937925805436804, "sim_compute_robot_state-ego": 0.05916665462737388}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.019852103767814214, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05235223979740353, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0536389953487522, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0717699815938761, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02950255163423308, "sim_compute_performance-ego": 0.0507717211167891, "sim_compute_robot_state-ego": 0.05265084727779849}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.02524358347842568, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06904165368331106, "in-drivable-lane": 0, "agent_compute-ego": 0.07099671740280955, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10107147693634032, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04354133731440494, "sim_compute_performance-ego": 0.07028598534433465, "sim_compute_robot_state-ego": 0.07980826026514957}}
set_robot_commands_max	0.10107147693634032
set_robot_commands_mean	0.07363074725346026
set_robot_commands_median	0.0717699815938761
set_robot_commands_min	0.05371682460491474
sim_compute_performance-ego_max	0.07028598534433465
sim_compute_performance-ego_mean	0.05168703742269672
sim_compute_performance-ego_median	0.0507717211167891
sim_compute_performance-ego_min	0.03783256274003249
sim_compute_robot_state-ego_max	0.07980826026514957
sim_compute_robot_state-ego_mean	0.05433103778908517
sim_compute_robot_state-ego_median	0.05265084727779849
sim_compute_robot_state-ego_min	0.03918701868790846
sim_compute_sim_state_max	0.04354133731440494
sim_compute_sim_state_mean	0.030847019860810128
sim_compute_sim_state_median	0.02950255163423308
sim_compute_sim_state_min	0.022408292843745303
sim_physics_max	0.02524358347842568
sim_physics_mean	0.01903978397150925
sim_physics_median	0.019852103767814214
sim_physics_min	0.013039359679588905
sim_render-ego_max	0.06904165368331106
sim_render-ego_mean	0.0511939801998611
sim_render-ego_median	0.05235223979740353
sim_render-ego_min	0.037591906694265514
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18250

2369

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-19 11:08:25+00:00

2019-04-19 11:23:54+00:00

0:15:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.225306900765771
survival_time_median	10.750000000000018
deviation-center-line_median	0.40864173779456053
in-drivable-lane_median	1.7000000000000242

other stats

agent_compute-ego_max	0.11648393547447929
agent_compute-ego_mean	0.11323266285647042
agent_compute-ego_median	0.11304872124283402
agent_compute-ego_min	0.11061321746471316
deviation-center-line_max	0.6491801892887803
deviation-center-line_mean	0.3683230725655418
deviation-center-line_min	0.1475671628461062
deviation-heading_max	2.2060076411946548
deviation-heading_mean	1.4163758252990906
deviation-heading_median	1.5250264276913703
deviation-heading_min	0.6970592634293067
driven_any_max	1.6057043265958648
driven_any_mean	1.3484469345214642
driven_any_median	1.5756972277649912
driven_any_min	0.9900494571900692
driven_lanedir_consec_max	1.4904214722299334
driven_lanedir_consec_mean	1.0721437270256324
driven_lanedir_consec_min	0.6474115509746436
driven_lanedir_max	1.4904214722299334
driven_lanedir_mean	1.0721437270256324
driven_lanedir_median	1.225306900765771
driven_lanedir_min	0.6474115509746436
in-drivable-lane_max	2.0499999999999927
in-drivable-lane_mean	1.4300000000000082
in-drivable-lane_min	0.25000000000000355
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.018318812624156047, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.04901924236215276, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.11379346744619684, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.0705722167337541, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.031955816762910476, "sim_compute_performance-ego": 0.05183463130923484, "sim_compute_robot_state-ego": 0.05241149449519974}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.019606656401696867, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.05312993578667189, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11648393547447929, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07473069211862383, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.03187545894706336, "sim_compute_performance-ego": 0.05507555669241578, "sim_compute_robot_state-ego": 0.056955055598794976}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.017463723640270833, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.04739584195774232, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.11222397265412884, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.07119677847276354, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.0297054335675432, "sim_compute_performance-ego": 0.04887253928077595, "sim_compute_robot_state-ego": 0.0502239984247182}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.016613535548365393, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.04814011773397756, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.11061321746471316, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.06916626109633335, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.029330475385798964, "sim_compute_performance-ego": 0.050151736237281974, "sim_compute_robot_state-ego": 0.050727083516675375}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.018959047617735685, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.04963008452344824, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.11304872124283402, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.07076934752640901, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.02962907707249677, "sim_compute_performance-ego": 0.05045058329900106, "sim_compute_robot_state-ego": 0.0521716210577223}}
set_robot_commands_max	0.07473069211862383
set_robot_commands_mean	0.07128705918957677
set_robot_commands_median	0.07076934752640901
set_robot_commands_min	0.06916626109633335
sim_compute_performance-ego_max	0.05507555669241578
sim_compute_performance-ego_mean	0.05127700936374192
sim_compute_performance-ego_median	0.05045058329900106
sim_compute_performance-ego_min	0.04887253928077595
sim_compute_robot_state-ego_max	0.056955055598794976
sim_compute_robot_state-ego_mean	0.05249785061862211
sim_compute_robot_state-ego_median	0.0521716210577223
sim_compute_robot_state-ego_min	0.0502239984247182
sim_compute_sim_state_max	0.031955816762910476
sim_compute_sim_state_mean	0.030499252347162553
sim_compute_sim_state_median	0.0297054335675432
sim_compute_sim_state_min	0.029330475385798964
sim_physics_max	0.019606656401696867
sim_physics_mean	0.01819235516644497
sim_physics_median	0.018318812624156047
sim_physics_min	0.016613535548365393
sim_render-ego_max	0.05312993578667189
sim_render-ego_mean	0.04946304447279855
sim_render-ego_median	0.04901924236215276
sim_render-ego_min	0.04739584195774232
simulation-passed	1
survival_time_max	11.150000000000023
survival_time_mean	9.300000000000004
survival_time_min	6.849999999999984

No reset possible

18239

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 11:00:20+00:00

2019-04-19 11:08:14+00:00

0:07:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.16440259007846608
agent_compute-ego_mean	0.14354937878308843
agent_compute-ego_median	0.13936152988009984
agent_compute-ego_min	0.13164882361888883
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02474517192480699, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06295332818661097, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14944263674178213, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0974600854909645, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03701487127340065, "sim_compute_performance-ego": 0.06659051157393546, "sim_compute_robot_state-ego": 0.06873063321383495}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.02111981131813743, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05855222181840376, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1328913135962053, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08759817210110751, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03648403016003696, "sim_compute_performance-ego": 0.06082251938906583, "sim_compute_robot_state-ego": 0.06470577825199474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.021495898564656574, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05880592664082845, "in-drivable-lane": 0, "agent_compute-ego": 0.13936152988009984, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08399444156222874, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03676118320888943, "sim_compute_performance-ego": 0.06050936381022135, "sim_compute_robot_state-ego": 0.06602787971496582}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02267010509967804, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05834720532099406, "in-drivable-lane": 0, "agent_compute-ego": 0.13164882361888883, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08583636085192363, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.037465045849482216, "sim_compute_performance-ego": 0.06192589302857717, "sim_compute_robot_state-ego": 0.06696931024392445}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.028848788317512065, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.0694811274023617, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.16440259007846608, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.1050639923881082, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.042170321240144616, "sim_compute_performance-ego": 0.07409437964944278, "sim_compute_robot_state-ego": 0.07995459963293637}}
set_robot_commands_max	0.1050639923881082
set_robot_commands_mean	0.09199061047886652
set_robot_commands_median	0.08759817210110751
set_robot_commands_min	0.08399444156222874
sim_compute_performance-ego_max	0.07409437964944278
sim_compute_performance-ego_mean	0.06478853349024852
sim_compute_performance-ego_median	0.06192589302857717
sim_compute_performance-ego_min	0.06050936381022135
sim_compute_robot_state-ego_max	0.07995459963293637
sim_compute_robot_state-ego_mean	0.06927764021153127
sim_compute_robot_state-ego_median	0.06696931024392445
sim_compute_robot_state-ego_min	0.06470577825199474
sim_compute_sim_state_max	0.042170321240144616
sim_compute_sim_state_mean	0.03797909034639077
sim_compute_sim_state_median	0.03701487127340065
sim_compute_sim_state_min	0.03648403016003696
sim_physics_max	0.028848788317512065
sim_physics_mean	0.02377595504495822
sim_physics_median	0.02267010509967804
sim_physics_min	0.02111981131813743
sim_render-ego_max	0.0694811274023617
sim_render-ego_mean	0.06162796187383979
sim_render-ego_median	0.05880592664082845
sim_render-ego_min	0.05834720532099406
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18233

2502

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-19 10:59:02+00:00

2019-04-19 10:59:54+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18225

2540

test for ppo

step1-simulation

error

2019-04-19 10:56:13+00:00

2019-04-19 10:58:20+00:00

0:02:07

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18203

2652

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-19 10:35:25+00:00

2019-04-19 10:55:29+00:00

0:20:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6726940390371287
survival_time_median	6.399999999999985
deviation-center-line_median	0.27316796408428645
in-drivable-lane_median	2.6999999999999904

other stats

agent_compute-ego_max	0.08550400204128689
agent_compute-ego_mean	0.07240818405482503
agent_compute-ego_median	0.06478649775187174
agent_compute-ego_min	0.06198141351342201
deviation-center-line_max	1.2033813868950587
deviation-center-line_mean	0.5212573471226134
deviation-center-line_min	0.175350885857282
deviation-heading_max	3.743455869943976
deviation-heading_mean	2.110415478528581
deviation-heading_median	1.4006366056197517
deviation-heading_min	1.2525643711335983
driven_any_max	2.35569194419092
driven_any_mean	1.4695254322513829
driven_any_median	0.98146216199994
driven_any_min	0.7377271101917339
driven_lanedir_consec_max	1.8455801514823784
driven_lanedir_consec_mean	0.9531782775349686
driven_lanedir_consec_min	0.3579570200140676
driven_lanedir_max	1.8455801514823784
driven_lanedir_mean	0.9827376095560856
driven_lanedir_median	0.6726940390371287
driven_lanedir_min	0.4012155669035256
in-drivable-lane_max	4.65000000000002
in-drivable-lane_mean	2.470000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7377271101917339, "sim_physics": 0.02924851696900647, "survival_time": 4.94999999999999, "driven_lanedir": 0.6726940390371287, "sim_render-ego": 0.07236198222998416, "in-drivable-lane": 0, "agent_compute-ego": 0.08550400204128689, "deviation-heading": 1.4006366056197517, "set_robot_commands": 0.11072386154020676, "deviation-center-line": 0.27316796408428645, "driven_lanedir_consec": 0.6726940390371287, "sim_compute_sim_state": 0.04148155751854482, "sim_compute_performance-ego": 0.07441714797357116, "sim_compute_robot_state-ego": 0.08222246892524487}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.35569194419092, "sim_physics": 0.02097947835922241, "survival_time": 14.950000000000076, "driven_lanedir": 1.5204233151756683, "sim_render-ego": 0.05512637058893839, "in-drivable-lane": 4.65000000000002, "agent_compute-ego": 0.06478649775187174, "deviation-heading": 2.829247206965422, "set_robot_commands": 0.07959297259648641, "deviation-center-line": 0.709609950433036, "driven_lanedir_consec": 1.5204233151756683, "sim_compute_sim_state": 0.03330904960632324, "sim_compute_performance-ego": 0.057460434436798095, "sim_compute_robot_state-ego": 0.05848319371541341}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3556120382467594, "sim_physics": 0.019648656845092777, "survival_time": 14.950000000000076, "driven_lanedir": 1.8455801514823784, "sim_render-ego": 0.05442683219909668, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.0647380002339681, "deviation-heading": 3.743455869943976, "set_robot_commands": 0.07997917890548706, "deviation-center-line": 1.2033813868950587, "driven_lanedir_consec": 1.8455801514823784, "sim_compute_sim_state": 0.03362842321395874, "sim_compute_performance-ego": 0.056059382756551104, "sim_compute_robot_state-ego": 0.05821965456008911}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9171339066275608, "sim_physics": 0.030027502775192266, "survival_time": 5.999999999999987, "driven_lanedir": 0.4012155669035256, "sim_render-ego": 0.07212206125259399, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.08503100673357646, "deviation-heading": 1.326173338980154, "set_robot_commands": 0.11102160414059956, "deviation-center-line": 0.175350885857282, "driven_lanedir_consec": 0.3692368619655997, "sim_compute_sim_state": 0.04105310638745626, "sim_compute_performance-ego": 0.07442656954129537, "sim_compute_robot_state-ego": 0.08411518335342408}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.98146216199994, "sim_physics": 0.01994573511183262, "survival_time": 6.399999999999985, "driven_lanedir": 0.4737749751817266, "sim_render-ego": 0.053748564794659615, "in-drivable-lane": 2.7499999999999902, "agent_compute-ego": 0.06198141351342201, "deviation-heading": 1.2525643711335983, "set_robot_commands": 0.07444235309958458, "deviation-center-line": 0.24477654834340343, "driven_lanedir_consec": 0.3579570200140676, "sim_compute_sim_state": 0.03126318380236626, "sim_compute_performance-ego": 0.05471341125667095, "sim_compute_robot_state-ego": 0.0563343670219183}}
set_robot_commands_max	0.11102160414059956
set_robot_commands_mean	0.09115199405647288
set_robot_commands_median	0.07997917890548706
set_robot_commands_min	0.07444235309958458
sim_compute_performance-ego_max	0.07442656954129537
sim_compute_performance-ego_mean	0.06341538919297733
sim_compute_performance-ego_median	0.057460434436798095
sim_compute_performance-ego_min	0.05471341125667095
sim_compute_robot_state-ego_max	0.08411518335342408
sim_compute_robot_state-ego_mean	0.06787497351521796
sim_compute_robot_state-ego_median	0.05848319371541341
sim_compute_robot_state-ego_min	0.0563343670219183
sim_compute_sim_state_max	0.04148155751854482
sim_compute_sim_state_mean	0.03614706410572986
sim_compute_sim_state_median	0.03362842321395874
sim_compute_sim_state_min	0.03126318380236626
sim_physics_max	0.030027502775192266
sim_physics_mean	0.02396997801206931
sim_physics_median	0.02097947835922241
sim_physics_min	0.019648656845092777
sim_render-ego_max	0.07236198222998416
sim_render-ego_mean	0.06155716221305456
sim_render-ego_median	0.05512637058893839
sim_render-ego_min	0.053748564794659615
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.450000000000024
survival_time_min	4.94999999999999

No reset possible

18190

2791

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-19 10:28:25+00:00

2019-04-19 10:33:42+00:00

0:05:17

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18157

2818

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-18 13:43:39+00:00

2019-04-18 13:51:21+00:00

0:07:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8171921272237834
survival_time_median	1.1000000000000003
deviation-center-line_median	0.025668493904927793
in-drivable-lane_median	0.04999999999999999

other stats

agent_compute-ego_max	0.16325730862824814
agent_compute-ego_mean	0.14590138485579196
agent_compute-ego_median	0.14751534991794163
agent_compute-ego_min	0.13298145207491788
deviation-center-line_max	0.057019386027434615
deviation-center-line_mean	0.03634226830745448
deviation-center-line_min	0.02280708605632212
deviation-heading_max	0.235756116193223
deviation-heading_mean	0.1638165081234764
deviation-heading_median	0.1411032446854075
deviation-heading_min	0.118601117425238
driven_any_max	1.028556309238097
driven_any_mean	0.8412197852214389
driven_any_median	0.956358012875939
driven_any_min	0.39300074524610096
driven_lanedir_consec_max	0.9648079053779924
driven_lanedir_consec_mean	0.6642871273891694
driven_lanedir_consec_min	0.31973792380899546
driven_lanedir_max	0.9648079053779924
driven_lanedir_mean	0.6642871273891694
driven_lanedir_median	0.8171921272237834
driven_lanedir_min	0.31973792380899546
in-drivable-lane_max	0.7000000000000004
in-drivable-lane_mean	0.1700000000000001
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.020095648972884468, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.0669218457263449, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1476201285486636, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.09419697263966435, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.04018128436544667, "sim_compute_performance-ego": 0.10749407436536706, "sim_compute_robot_state-ego": 0.07359193718951682}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.020615463671476944, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.06752495143724524, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16325730862824814, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.10225106322247048, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.03968263709026834, "sim_compute_performance-ego": 0.07500532399053159, "sim_compute_robot_state-ego": 0.07640098488849142}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.01801644672047008, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.052330212159590286, "in-drivable-lane": 0, "agent_compute-ego": 0.13298145207491788, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.08610431714491411, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.033055663108825684, "sim_compute_performance-ego": 0.05781797929243608, "sim_compute_robot_state-ego": 0.062217669053511185}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.017512983745998807, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.06765641106499566, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.14751534991794163, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.08932124243842231, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.034721586439344615, "sim_compute_performance-ego": 0.0861312018500434, "sim_compute_robot_state-ego": 0.06667081514994304}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.02154567367152164, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06585133703131425, "in-drivable-lane": 0, "agent_compute-ego": 0.1381326851091887, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.08598524645755165, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.035332089976260535, "sim_compute_performance-ego": 0.06326922617460552, "sim_compute_robot_state-ego": 0.06815180025602642}}
set_robot_commands_max	0.10225106322247048
set_robot_commands_mean	0.0915717683806046
set_robot_commands_median	0.08932124243842231
set_robot_commands_min	0.08598524645755165
sim_compute_performance-ego_max	0.10749407436536706
sim_compute_performance-ego_mean	0.07794356113459673
sim_compute_performance-ego_median	0.07500532399053159
sim_compute_performance-ego_min	0.05781797929243608
sim_compute_robot_state-ego_max	0.07640098488849142
sim_compute_robot_state-ego_mean	0.06940664130749777
sim_compute_robot_state-ego_median	0.06815180025602642
sim_compute_robot_state-ego_min	0.062217669053511185
sim_compute_sim_state_max	0.04018128436544667
sim_compute_sim_state_mean	0.03659465219602916
sim_compute_sim_state_median	0.035332089976260535
sim_compute_sim_state_min	0.033055663108825684
sim_physics_max	0.02154567367152164
sim_physics_mean	0.01955724335647039
sim_physics_median	0.020095648972884468
sim_physics_min	0.017512983745998807
sim_render-ego_max	0.06765641106499566
sim_render-ego_mean	0.06405695148389806
sim_render-ego_median	0.0669218457263449
sim_render-ego_min	0.052330212159590286
simulation-passed	1
survival_time_max	1.1500000000000004
survival_time_mean	0.9600000000000004
survival_time_min	0.45

No reset possible

18135

2743

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-17 23:39:52+00:00

2019-04-18 00:00:34+00:00

0:20:42

Waited 1203 seconds [...]

Waited 1203 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18132

2754

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-17 23:35:47+00:00

2019-04-17 23:39:36+00:00

0:03:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2448526305955787
survival_time_median	1.0000000000000002
deviation-center-line_median	0.02780958695734228
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.05668342113494873
agent_compute-ego_mean	0.04919111643357146
agent_compute-ego_median	0.049302870227444555
agent_compute-ego_min	0.04253852367401123
deviation-center-line_max	0.1367821583469593
deviation-center-line_mean	0.05703771312424479
deviation-center-line_min	0.019515313732513393
deviation-heading_max	0.6295143987792061
deviation-heading_mean	0.33854872313755296
deviation-heading_median	0.30747603818653535
deviation-heading_min	0.1699364276466551
driven_any_max	0.9094890302704564
driven_any_mean	0.614817253072296
driven_any_median	0.5457640496143875
driven_any_min	0.3022738981004904
driven_lanedir_consec_max	0.7972872880234139
driven_lanedir_consec_mean	0.4211895144689454
driven_lanedir_consec_min	0.1644714808652381
driven_lanedir_max	0.7972872880234139
driven_lanedir_mean	0.42291373507306657
driven_lanedir_median	0.2448526305955787
driven_lanedir_min	0.1644714808652381
in-drivable-lane_max	0.6500000000000002
in-drivable-lane_mean	0.2500000000000001
in-drivable-lane_min	0.04999999999999999
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.01342613697052002, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.04330328702926635, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.04253852367401123, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.05629453659057617, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.025604116916656493, "sim_compute_performance-ego": 0.04196485280990601, "sim_compute_robot_state-ego": 0.04339585304260254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126885, "sim_physics": 0.014403315151438991, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120271352061035, "sim_render-ego": 0.04072403907775879, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.04498922123628504, "deviation-heading": 0.30747603818653535, "set_robot_commands": 0.05571469138650333, "deviation-center-line": 0.023999233443120993, "driven_lanedir_consec": 0.17258161050000476, "sim_compute_sim_state": 0.02458958064808565, "sim_compute_performance-ego": 0.039537640178904813, "sim_compute_robot_state-ego": 0.042641527512494254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3022738981004904, "sim_physics": 0.014966225624084471, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955787, "sim_render-ego": 0.048215699195861814, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.05668342113494873, "deviation-heading": 0.1699364276466551, "set_robot_commands": 0.07851591110229492, "deviation-center-line": 0.02780958695734228, "driven_lanedir_consec": 0.2448526305955787, "sim_compute_sim_state": 0.028070521354675297, "sim_compute_performance-ego": 0.05054106712341309, "sim_compute_robot_state-ego": 0.05111672878265381}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.015308584485735213, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.04749839646475656, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.05244154589516776, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.06570386035101754, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.027588469641549245, "sim_compute_performance-ego": 0.04881050756999424, "sim_compute_robot_state-ego": 0.050839628492082865}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704564, "sim_physics": 0.014025095970399918, "survival_time": 1.5500000000000007, "driven_lanedir": 0.7972872880234139, "sim_render-ego": 0.04567045550192556, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.049302870227444555, "deviation-heading": 0.6295143987792061, "set_robot_commands": 0.06048009472508584, "deviation-center-line": 0.1367821583469593, "driven_lanedir_consec": 0.7972872880234139, "sim_compute_sim_state": 0.025715251122751543, "sim_compute_performance-ego": 0.04810813934572281, "sim_compute_robot_state-ego": 0.047901776529127554}}
set_robot_commands_max	0.07851591110229492
set_robot_commands_mean	0.06334181883109556
set_robot_commands_median	0.06048009472508584
set_robot_commands_min	0.05571469138650333
sim_compute_performance-ego_max	0.05054106712341309
sim_compute_performance-ego_mean	0.04579244140558819
sim_compute_performance-ego_median	0.04810813934572281
sim_compute_performance-ego_min	0.039537640178904813
sim_compute_robot_state-ego_max	0.05111672878265381
sim_compute_robot_state-ego_mean	0.04717910287179221
sim_compute_robot_state-ego_median	0.047901776529127554
sim_compute_robot_state-ego_min	0.042641527512494254
sim_compute_sim_state_max	0.028070521354675297
sim_compute_sim_state_mean	0.026313587936743647
sim_compute_sim_state_median	0.025715251122751543
sim_compute_sim_state_min	0.02458958064808565
sim_physics_max	0.015308584485735213
sim_physics_mean	0.014425871640435722
sim_physics_median	0.014403315151438991
sim_physics_min	0.01342613697052002
sim_render-ego_max	0.048215699195861814
sim_render-ego_mean	0.04508237545391382
sim_render-ego_median	0.04567045550192556
sim_render-ego_min	0.04072403907775879
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.0600000000000005
survival_time_min	0.49999999999999994

No reset possible

18126

2762

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-17 23:27:52+00:00

2019-04-17 23:35:33+00:00

0:07:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2448526305955765
survival_time_median	1.0000000000000002
deviation-center-line_median	0.02780956837444773
in-drivable-lane_median	0.4500000000000001

other stats

agent_compute-ego_max	0.07753777503967285
agent_compute-ego_mean	0.07248377682265963
agent_compute-ego_median	0.07586163633009967
agent_compute-ego_min	0.0644346833229065
deviation-center-line_max	0.1257230388091751
deviation-center-line_mean	0.05577343615770758
deviation-center-line_min	0.01951527185289407
deviation-heading_max	0.5595345336423936
deviation-heading_mean	0.32175424111925316
deviation-heading_median	0.3074760381865353
deviation-heading_min	0.16993642764665495
driven_any_max	1.135775595781212
driven_any_mean	0.7105521201006961
driven_any_median	0.5457640496143795
driven_any_min	0.3022738981004901
driven_lanedir_consec_max	0.8171012478585276
driven_lanedir_consec_mean	0.42515260445919045
driven_lanedir_consec_min	0.164471242446655
driven_lanedir_max	0.8171012478585276
driven_lanedir_mean	0.4357084916634508
driven_lanedir_median	0.2448526305955765
driven_lanedir_min	0.164471242446655
in-drivable-lane_max	0.6500000000000002
in-drivable-lane_mean	0.38000000000000017
in-drivable-lane_min	0.04999999999999999
per-episodes	details {"udem1-0-0": {"driven_any": 0.5457640496143795, "sim_physics": 0.04577505588531494, "survival_time": 1.0000000000000002, "driven_lanedir": 0.164471242446655, "sim_render-ego": 0.06771632432937622, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.07630383968353271, "deviation-heading": 0.18758204257854744, "set_robot_commands": 0.09715656042099, "deviation-center-line": 0.01951527185289407, "driven_lanedir_consec": 0.164471242446655, "sim_compute_sim_state": 0.03914520740509033, "sim_compute_performance-ego": 0.06878447532653809, "sim_compute_robot_state-ego": 0.07592793703079223, "sim_compute_robot_state-npc0": 0.07201638221740722, "sim_compute_robot_state-npc1": 0.07012761831283569, "sim_compute_robot_state-npc2": 0.0705183506011963, "sim_compute_robot_state-npc3": 0.07003073692321778}, "udem1-1-0": {"driven_any": 0.5108934139126888, "sim_physics": 0.04327034950256348, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120319035776863, "sim_render-ego": 0.07015747182509478, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.07586163633009967, "deviation-heading": 0.3074760381865353, "set_robot_commands": 0.10988804873298195, "deviation-center-line": 0.02399913959382396, "driven_lanedir_consec": 0.1725821469418083, "sim_compute_sim_state": 0.04269184785730699, "sim_compute_performance-ego": 0.06912631147048053, "sim_compute_robot_state-ego": 0.07842173295862534, "sim_compute_robot_state-npc0": 0.07938488791970645, "sim_compute_robot_state-npc1": 0.07406844812280991, "sim_compute_robot_state-npc2": 0.07423301304087919, "sim_compute_robot_state-npc3": 0.07627649868235868}, "udem1-2-0": {"driven_any": 0.3022738981004901, "sim_physics": 0.054110360145568845, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955765, "sim_render-ego": 0.06833922863006592, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.07753777503967285, "deviation-heading": 0.16993642764665495, "set_robot_commands": 0.09666645526885986, "deviation-center-line": 0.02780956837444773, "driven_lanedir_consec": 0.2448526305955765, "sim_compute_sim_state": 0.03718314170837402, "sim_compute_performance-ego": 0.07098650932312012, "sim_compute_robot_state-ego": 0.0786480188369751, "sim_compute_robot_state-npc0": 0.07072227001190186, "sim_compute_robot_state-npc1": 0.07244927883148193, "sim_compute_robot_state-npc2": 0.06994199752807617, "sim_compute_robot_state-npc3": 0.06820123195648194}, "udem1-3-0": {"driven_any": 1.135775595781212, "sim_physics": 0.03656457662582398, "survival_time": 2.000000000000001, "driven_lanedir": 0.7709141470587263, "sim_render-ego": 0.06277641654014587, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.0644346833229065, "deviation-heading": 0.3842421635421346, "set_robot_commands": 0.09518151879310607, "deviation-center-line": 0.08182016215819705, "driven_lanedir_consec": 0.7267557544533849, "sim_compute_sim_state": 0.03647439479827881, "sim_compute_performance-ego": 0.0676352858543396, "sim_compute_robot_state-ego": 0.07001177668571472, "sim_compute_robot_state-npc0": 0.06836598515510559, "sim_compute_robot_state-npc1": 0.06932802200317383, "sim_compute_robot_state-npc2": 0.06776408553123474, "sim_compute_robot_state-npc3": 0.06891672015190124}, "udem1-4-0": {"driven_any": 1.05805364309471, "sim_physics": 0.035045139717333244, "survival_time": 1.6500000000000008, "driven_lanedir": 0.8171012478585276, "sim_render-ego": 0.06685777866479123, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.06828094973708644, "deviation-heading": 0.5595345336423936, "set_robot_commands": 0.09460478117971707, "deviation-center-line": 0.1257230388091751, "driven_lanedir_consec": 0.8171012478585276, "sim_compute_sim_state": 0.036748835534760445, "sim_compute_performance-ego": 0.0682089834502249, "sim_compute_robot_state-ego": 0.07235034306844075, "sim_compute_robot_state-npc0": 0.06567568489999483, "sim_compute_robot_state-npc1": 0.06565566496415572, "sim_compute_robot_state-npc2": 0.06443990360606801, "sim_compute_robot_state-npc3": 0.06863352746674509}}
set_robot_commands_max	0.10988804873298195
set_robot_commands_mean	0.098699472879131
set_robot_commands_median	0.09666645526885986
set_robot_commands_min	0.09460478117971707
sim_compute_performance-ego_max	0.07098650932312012
sim_compute_performance-ego_mean	0.06894831308494065
sim_compute_performance-ego_median	0.06878447532653809
sim_compute_performance-ego_min	0.0676352858543396
sim_compute_robot_state-ego_max	0.0786480188369751
sim_compute_robot_state-ego_mean	0.07507196171610962
sim_compute_robot_state-ego_median	0.07592793703079223
sim_compute_robot_state-ego_min	0.07001177668571472
sim_compute_robot_state-npc0_max	0.07938488791970645
sim_compute_robot_state-npc0_mean	0.07123304204082317
sim_compute_robot_state-npc0_median	0.07072227001190186
sim_compute_robot_state-npc0_min	0.06567568489999483
sim_compute_robot_state-npc1_max	0.07406844812280991
sim_compute_robot_state-npc1_mean	0.07032580644689142
sim_compute_robot_state-npc1_median	0.07012761831283569
sim_compute_robot_state-npc1_min	0.06565566496415572
sim_compute_robot_state-npc2_max	0.07423301304087919
sim_compute_robot_state-npc2_mean	0.06937947006149088
sim_compute_robot_state-npc2_median	0.06994199752807617
sim_compute_robot_state-npc2_min	0.06443990360606801
sim_compute_robot_state-npc3_max	0.07627649868235868
sim_compute_robot_state-npc3_mean	0.07041174303614095
sim_compute_robot_state-npc3_median	0.06891672015190124
sim_compute_robot_state-npc3_min	0.06820123195648194
sim_compute_sim_state_max	0.04269184785730699
sim_compute_sim_state_mean	0.03844868546076212
sim_compute_sim_state_median	0.03718314170837402
sim_compute_sim_state_min	0.03647439479827881
sim_physics_max	0.054110360145568845
sim_physics_mean	0.042953096375320896
sim_physics_median	0.04327034950256348
sim_physics_min	0.035045139717333244
sim_render-ego_max	0.07015747182509478
sim_render-ego_mean	0.06716944399789479
sim_render-ego_median	0.06771632432937622
sim_render-ego_min	0.06277641654014587
simulation-passed	1
survival_time_max	2.000000000000001
survival_time_mean	1.2000000000000004
survival_time_min	0.49999999999999994

No reset possible

18123

2778

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 23:27:07+00:00

2019-04-17 23:27:32+00:00

0:00:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18122

2783

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 23:26:15+00:00

2019-04-17 23:27:00+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18120

2779

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 23:25:32+00:00

2019-04-17 23:26:02+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18119

2786

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 23:24:31+00:00

2019-04-17 23:25:06+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18118

2787

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 23:21:07+00:00

2019-04-17 23:21:43+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18114

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-17 23:01:32+00:00

2019-04-17 23:20:36+00:00

0:19:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4889943633784548
survival_time_median	1.950000000000001
deviation-center-line_median	0.08659758588892237
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.1685032844543457
agent_compute-ego_mean	0.12331817828902727
agent_compute-ego_median	0.1141039652702136
agent_compute-ego_min	0.10138110045729012
deviation-center-line_max	0.9923366481853576
deviation-center-line_mean	0.2782537710548752
deviation-center-line_min	0.010776416729113076
deviation-heading_max	2.1179065227298635
deviation-heading_mean	0.7331846624671297
deviation-heading_median	0.3455394508313924
deviation-heading_min	0.19766162675531468
driven_any_max	3.550213317634584
driven_any_mean	1.1659213814568978
driven_any_median	0.6260681720816922
driven_any_min	0.19214123254178303
driven_lanedir_consec_max	2.345131808668012
driven_lanedir_consec_mean	0.7984471252078583
driven_lanedir_consec_min	0.0943513509863787
driven_lanedir_max	3.346128622167555
driven_lanedir_mean	0.999005194385824
driven_lanedir_median	0.4889943633784548
driven_lanedir_min	0.0943513509863787
in-drivable-lane_max	1.050000000000001
in-drivable-lane_mean	0.34
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.9159310553654052, "sim_physics": 0.04759716165476832, "survival_time": 2.8999999999999977, "driven_lanedir": 0.9072675893139894, "sim_render-ego": 0.06833624017649684, "in-drivable-lane": 0, "agent_compute-ego": 0.10138110045729012, "deviation-heading": 0.3455394508313924, "set_robot_commands": 0.10678188143105342, "deviation-center-line": 0.2804936636899147, "driven_lanedir_consec": 0.9071398385423646, "sim_compute_sim_state": 0.042139521960554455, "sim_compute_performance-ego": 0.07626718077166326, "sim_compute_robot_state-ego": 0.08312268503781023, "sim_compute_robot_state-npc0": 0.07482445651087268, "sim_compute_robot_state-npc1": 0.07980960401995428, "sim_compute_robot_state-npc2": 0.07697458924918339, "sim_compute_robot_state-npc3": 0.0762782096862793}, "udem1-1-0": {"driven_any": 0.19214123254178303, "sim_physics": 0.04741472005844116, "survival_time": 0.6, "driven_lanedir": 0.0943513509863787, "sim_render-ego": 0.07465686400731404, "in-drivable-lane": 0.2, "agent_compute-ego": 0.1685032844543457, "deviation-heading": 0.19766162675531468, "set_robot_commands": 0.10943361123402912, "deviation-center-line": 0.010776416729113076, "driven_lanedir_consec": 0.0943513509863787, "sim_compute_sim_state": 0.04257923364639282, "sim_compute_performance-ego": 0.07294150193532307, "sim_compute_robot_state-ego": 0.08287692070007324, "sim_compute_robot_state-npc0": 0.07212990522384644, "sim_compute_robot_state-npc1": 0.07504679759343465, "sim_compute_robot_state-npc2": 0.0773742397626241, "sim_compute_robot_state-npc3": 0.07496865590413411}, "udem1-2-0": {"driven_any": 0.6260681720816922, "sim_physics": 0.04567972207680727, "survival_time": 1.950000000000001, "driven_lanedir": 0.4889943633784548, "sim_render-ego": 0.07326961786319049, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1141039652702136, "deviation-heading": 0.7099954996867134, "set_robot_commands": 0.11429334909487994, "deviation-center-line": 0.08659758588892237, "driven_lanedir_consec": 0.4889943633784548, "sim_compute_sim_state": 0.042713104150234125, "sim_compute_performance-ego": 0.07549309730529785, "sim_compute_robot_state-ego": 0.08206507487174793, "sim_compute_robot_state-npc0": 0.07529318638336964, "sim_compute_robot_state-npc1": 0.07245400624397473, "sim_compute_robot_state-npc2": 0.07455669916593112, "sim_compute_robot_state-npc3": 0.07534046050829765}, "udem1-3-0": {"driven_any": 3.550213317634584, "sim_physics": 0.04360535349781157, "survival_time": 11.050000000000022, "driven_lanedir": 3.346128622167555, "sim_render-ego": 0.07159861396340762, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.10692994842701908, "deviation-heading": 2.1179065227298635, "set_robot_commands": 0.1094053169181444, "deviation-center-line": 0.9923366481853576, "driven_lanedir_consec": 2.345131808668012, "sim_compute_sim_state": 0.04260825571431294, "sim_compute_performance-ego": 0.07507655955008252, "sim_compute_robot_state-ego": 0.07927901712478017, "sim_compute_robot_state-npc0": 0.07420145224661849, "sim_compute_robot_state-npc1": 0.07475449704476611, "sim_compute_robot_state-npc2": 0.07512265416831453, "sim_compute_robot_state-npc3": 0.07625872409181897}, "udem1-4-0": {"driven_any": 0.545253129661026, "sim_physics": 0.04523324966430664, "survival_time": 1.7000000000000008, "driven_lanedir": 0.15828404608274127, "sim_render-ego": 0.07110638478223015, "in-drivable-lane": 1.050000000000001, "agent_compute-ego": 0.1256725928362678, "deviation-heading": 0.2948202123323641, "set_robot_commands": 0.099678355104783, "deviation-center-line": 0.02106454078106815, "driven_lanedir_consec": 0.15661826446408167, "sim_compute_sim_state": 0.04149613660924575, "sim_compute_performance-ego": 0.06872134348925422, "sim_compute_robot_state-ego": 0.07420431165134206, "sim_compute_robot_state-npc0": 0.06880677447599523, "sim_compute_robot_state-npc1": 0.07242430658901439, "sim_compute_robot_state-npc2": 0.07345682031968061, "sim_compute_robot_state-npc3": 0.07340164745555204}}
set_robot_commands_max	0.11429334909487994
set_robot_commands_mean	0.10791850275657797
set_robot_commands_median	0.1094053169181444
set_robot_commands_min	0.099678355104783
sim_compute_performance-ego_max	0.07626718077166326
sim_compute_performance-ego_mean	0.07369993661032419
sim_compute_performance-ego_median	0.07507655955008252
sim_compute_performance-ego_min	0.06872134348925422
sim_compute_robot_state-ego_max	0.08312268503781023
sim_compute_robot_state-ego_mean	0.08030960187715072
sim_compute_robot_state-ego_median	0.08206507487174793
sim_compute_robot_state-ego_min	0.07420431165134206
sim_compute_robot_state-npc0_max	0.07529318638336964
sim_compute_robot_state-npc0_mean	0.07305115496814049
sim_compute_robot_state-npc0_median	0.07420145224661849
sim_compute_robot_state-npc0_min	0.06880677447599523
sim_compute_robot_state-npc1_max	0.07980960401995428
sim_compute_robot_state-npc1_mean	0.07489784229822884
sim_compute_robot_state-npc1_median	0.07475449704476611
sim_compute_robot_state-npc1_min	0.07242430658901439
sim_compute_robot_state-npc2_max	0.0773742397626241
sim_compute_robot_state-npc2_mean	0.07549700053314676
sim_compute_robot_state-npc2_median	0.07512265416831453
sim_compute_robot_state-npc2_min	0.07345682031968061
sim_compute_robot_state-npc3_max	0.0762782096862793
sim_compute_robot_state-npc3_mean	0.07524953952921641
sim_compute_robot_state-npc3_median	0.07534046050829765
sim_compute_robot_state-npc3_min	0.07340164745555204
sim_compute_sim_state_max	0.042713104150234125
sim_compute_sim_state_mean	0.042307250416148016
sim_compute_sim_state_median	0.04257923364639282
sim_compute_sim_state_min	0.04149613660924575
sim_physics_max	0.04759716165476832
sim_physics_mean	0.04590604139042699
sim_physics_median	0.04567972207680727
sim_physics_min	0.04360535349781157
sim_render-ego_max	0.07465686400731404
sim_render-ego_mean	0.07179354415852782
sim_render-ego_median	0.07159861396340762
sim_render-ego_min	0.06833624017649684
simulation-passed	1
survival_time_max	11.050000000000022
survival_time_mean	3.640000000000004
survival_time_min	0.6

No reset possible

18111

2747

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-17 22:40:28+00:00

2019-04-17 23:01:11+00:00

0:20:43

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18107

2735

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 21:44:28+00:00

2019-04-17 22:05:02+00:00

0:20:34

Waited 1205 seconds [...]

Waited 1205 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18103

2734

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-17 21:23:25+00:00

2019-04-17 21:44:08+00:00

0:20:43

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18100

2715

test for ppo

step1-simulation

error

2019-04-17 15:20:35+00:00

2019-04-17 15:21:02+00:00

0:00:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18098

2716

test for ppo

step1-simulation

error

2019-04-17 15:19:22+00:00

2019-04-17 15:20:03+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18093

2712

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-17 15:11:14+00:00

2019-04-17 15:19:15+00:00

0:08:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.19622865707370973
survival_time_median	1.7500000000000009
deviation-center-line_median	0.04675951352071154
in-drivable-lane_median	0.15000000000000013

other stats

agent_compute-ego_max	0.08392242704119002
agent_compute-ego_mean	0.07309356261813452
agent_compute-ego_median	0.07159085273742676
agent_compute-ego_min	0.06679042180379231
deviation-center-line_max	0.255871703661639
deviation-center-line_mean	0.08286345500071436
deviation-center-line_min	0.012650289631005543
deviation-heading_max	0.5374079438924497
deviation-heading_mean	0.3955057450951161
deviation-heading_median	0.4029419964264521
deviation-heading_min	0.23501499808009935
driven_any_max	0.8515576167860739
driven_any_mean	0.4943781025798919
driven_any_median	0.5613912930797308
driven_any_min	0.19215459457937692
driven_lanedir_consec_max	0.8382160129458729
driven_lanedir_consec_mean	0.3418490038437287
driven_lanedir_consec_min	0.100910154201431
driven_lanedir_max	0.8382611118917671
driven_lanedir_mean	0.3423908909372605
driven_lanedir_median	0.19622865707370973
driven_lanedir_min	0.100910154201431
in-drivable-lane_max	1.050000000000001
in-drivable-lane_mean	0.3200000000000003
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.8515576167860739, "sim_physics": 0.037097536433826794, "survival_time": 2.7499999999999982, "driven_lanedir": 0.8382611118917671, "sim_render-ego": 0.05618207237937234, "in-drivable-lane": 0, "agent_compute-ego": 0.07159085273742676, "deviation-heading": 0.4029419964264521, "set_robot_commands": 0.08326395641673695, "deviation-center-line": 0.255871703661639, "driven_lanedir_consec": 0.8382160129458729, "sim_compute_sim_state": 0.03235003297979182, "sim_compute_performance-ego": 0.05828426100990989, "sim_compute_robot_state-ego": 0.06062694896351208, "sim_compute_robot_state-npc0": 0.06112686070528897, "sim_compute_robot_state-npc1": 0.06047742150046609, "sim_compute_robot_state-npc2": 0.05821623368696733, "sim_compute_robot_state-npc3": 0.05954204039140181}, "udem1-1-0": {"driven_any": 0.19215459457937692, "sim_physics": 0.029224236806233723, "survival_time": 0.6, "driven_lanedir": 0.100910154201431, "sim_render-ego": 0.05068765083948771, "in-drivable-lane": 0.15000000000000002, "agent_compute-ego": 0.06679042180379231, "deviation-heading": 0.23501499808009935, "set_robot_commands": 0.0928749640782674, "deviation-center-line": 0.012650289631005543, "driven_lanedir_consec": 0.100910154201431, "sim_compute_sim_state": 0.03212285041809082, "sim_compute_performance-ego": 0.05953888098398844, "sim_compute_robot_state-ego": 0.056903461615244545, "sim_compute_robot_state-npc0": 0.06627760330835979, "sim_compute_robot_state-npc1": 0.05615109205245972, "sim_compute_robot_state-npc2": 0.061238388220469155, "sim_compute_robot_state-npc3": 0.05912907918294271}, "udem1-2-0": {"driven_any": 0.5781984306940969, "sim_physics": 0.033437212308247886, "survival_time": 1.800000000000001, "driven_lanedir": 0.4535891115882386, "sim_render-ego": 0.054092480076683894, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.0714441868993971, "deviation-heading": 0.5024029418606972, "set_robot_commands": 0.08089689413706462, "deviation-center-line": 0.07204245524657754, "driven_lanedir_consec": 0.4535891115882386, "sim_compute_sim_state": 0.03152098258336385, "sim_compute_performance-ego": 0.05521611372629801, "sim_compute_robot_state-ego": 0.056856135527292885, "sim_compute_robot_state-npc0": 0.05605720149146186, "sim_compute_robot_state-npc1": 0.05684714184867011, "sim_compute_robot_state-npc2": 0.05451232194900513, "sim_compute_robot_state-npc3": 0.05478787422180176}, "udem1-3-0": {"driven_any": 0.2885885777601809, "sim_physics": 0.03733399179246691, "survival_time": 0.9000000000000002, "driven_lanedir": 0.19622865707370973, "sim_render-ego": 0.05489508310953776, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.07171992460886638, "deviation-heading": 0.29976084521588187, "set_robot_commands": 0.08598551485273573, "deviation-center-line": 0.026993312943638086, "driven_lanedir_consec": 0.19622865707370973, "sim_compute_sim_state": 0.030835615264044863, "sim_compute_performance-ego": 0.05478288067711724, "sim_compute_robot_state-ego": 0.056438313590155706, "sim_compute_robot_state-npc0": 0.055637982156541615, "sim_compute_robot_state-npc1": 0.05761334631178114, "sim_compute_robot_state-npc2": 0.054697553316752114, "sim_compute_robot_state-npc3": 0.05132699012756348}, "udem1-4-0": {"driven_any": 0.5613912930797308, "sim_physics": 0.03968581472124373, "survival_time": 1.7500000000000009, "driven_lanedir": 0.12296541993115606, "sim_render-ego": 0.0670990194593157, "in-drivable-lane": 1.050000000000001, "agent_compute-ego": 0.08392242704119002, "deviation-heading": 0.5374079438924497, "set_robot_commands": 0.10592150006975448, "deviation-center-line": 0.04675951352071154, "driven_lanedir_consec": 0.12030108340939116, "sim_compute_sim_state": 0.03887414251055036, "sim_compute_performance-ego": 0.0660848549434117, "sim_compute_robot_state-ego": 0.06800967625209263, "sim_compute_robot_state-npc0": 0.06944776943751745, "sim_compute_robot_state-npc1": 0.06561429159981864, "sim_compute_robot_state-npc2": 0.06482472419738769, "sim_compute_robot_state-npc3": 0.06819208008902414}}
set_robot_commands_max	0.10592150006975448
set_robot_commands_mean	0.08978856591091183
set_robot_commands_median	0.08598551485273573
set_robot_commands_min	0.08089689413706462
sim_compute_performance-ego_max	0.0660848549434117
sim_compute_performance-ego_mean	0.05878139826814506
sim_compute_performance-ego_median	0.05828426100990989
sim_compute_performance-ego_min	0.05478288067711724
sim_compute_robot_state-ego_max	0.06800967625209263
sim_compute_robot_state-ego_mean	0.05976690718965957
sim_compute_robot_state-ego_median	0.056903461615244545
sim_compute_robot_state-ego_min	0.056438313590155706
sim_compute_robot_state-npc0_max	0.06944776943751745
sim_compute_robot_state-npc0_mean	0.061709483419833934
sim_compute_robot_state-npc0_median	0.06112686070528897
sim_compute_robot_state-npc0_min	0.055637982156541615
sim_compute_robot_state-npc1_max	0.06561429159981864
sim_compute_robot_state-npc1_mean	0.05934065866263914
sim_compute_robot_state-npc1_median	0.05761334631178114
sim_compute_robot_state-npc1_min	0.05615109205245972
sim_compute_robot_state-npc2_max	0.06482472419738769
sim_compute_robot_state-npc2_mean	0.05869784427411629
sim_compute_robot_state-npc2_median	0.05821623368696733
sim_compute_robot_state-npc2_min	0.05451232194900513
sim_compute_robot_state-npc3_max	0.06819208008902414
sim_compute_robot_state-npc3_mean	0.05859561280254677
sim_compute_robot_state-npc3_median	0.05912907918294271
sim_compute_robot_state-npc3_min	0.05132699012756348
sim_compute_sim_state_max	0.03887414251055036
sim_compute_sim_state_mean	0.033140724751168346
sim_compute_sim_state_median	0.03212285041809082
sim_compute_sim_state_min	0.030835615264044863
sim_physics_max	0.03968581472124373
sim_physics_mean	0.03535575841240381
sim_physics_median	0.037097536433826794
sim_physics_min	0.029224236806233723
sim_render-ego_max	0.0670990194593157
sim_render-ego_mean	0.05659126117287948
sim_render-ego_median	0.05489508310953776
sim_render-ego_min	0.05068765083948771
simulation-passed	1
survival_time_max	2.7499999999999982
survival_time_mean	1.56
survival_time_min	0.6

No reset possible

18082

2690

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success