Evaluator 1579

ID	1579
evaluator	`ip-172-31-35-218-10492`
owner	I don't have one 😀
machine	ip-172-31-35-218
process	ip-172-31-35-218-10492
version	d-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard	2019-10-17 02:44:08+00:00
last heard	2019-11-08 10:54:08+00:00
status	inactive
# evaluating
# success	29 `24350`
# timeout
# failed	9 `24358`
# error	21 `24363`
# aborted
# host-error	3 `24687`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

25117

4395

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-07 14:23:03+00:00

2019-11-07 14:29:48+00:00

0:06:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4702323960536803
survival_time_median	2.849999999999998
deviation-center-line_median	0.13623952041905
in-drivable-lane_median	0.7999999999999976

other stats

agent_compute-ego_max	0.02772809908940242
agent_compute-ego_mean	0.026791874003247777
agent_compute-ego_median	0.02691743991993092
agent_compute-ego_min	0.02576688111546528
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.16546426353561405
deviation-center-line_min	0.07144385614371519
deviation-heading_max	1.2111022380750738
deviation-heading_mean	0.8262001110734373
deviation-heading_median	0.7978002362162196
deviation-heading_min	0.39989969254594865
driven_any_max	1.093753441791868
driven_any_mean	0.7182169120135662
driven_any_median	0.8072381933001381
driven_any_min	0.29795781475632777
driven_lanedir_consec_max	0.6735785385729686
driven_lanedir_consec_mean	0.4271077107010905
driven_lanedir_consec_min	0.2312609677194346
driven_lanedir_max	0.6758329617605024
driven_lanedir_mean	0.4275585953385973
driven_lanedir_median	0.4702323960536803
driven_lanedir_min	0.2312609677194346
in-drivable-lane_max	1.6499999999999957
in-drivable-lane_mean	0.7199999999999979
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791868, "sim_physics": 0.21026768167334867, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.012619147817772555, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.02576688111546528, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.01013322048876659, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.0050552121127944395, "sim_compute_performance-ego": 0.0072129318513065935, "sim_compute_robot_state-ego": 0.009456726441900414, "sim_compute_robot_state-npc0": 0.008961183479033321, "sim_compute_robot_state-npc1": 0.0088813161275473, "sim_compute_robot_state-npc2": 0.008765953132905156, "sim_compute_robot_state-npc3": 0.008648208824984998}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.21906955153853805, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.013576843120433666, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02691743991993092, "deviation-heading": 0.6953408166028195, "set_robot_commands": 0.010893804055673103, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.005399792282669632, "sim_compute_performance-ego": 0.007761178193268953, "sim_compute_robot_state-ego": 0.009207610730771663, "sim_compute_robot_state-npc0": 0.009037485829106084, "sim_compute_robot_state-npc1": 0.008960220548841689, "sim_compute_robot_state-npc2": 0.008910311592949761, "sim_compute_robot_state-npc3": 0.009152315281055591}, "udem1-2-0": {"driven_any": 1.0809477890804953, "sim_physics": 0.2670229795651558, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.013813171631250626, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02772809908940242, "deviation-heading": 1.0268575719271245, "set_robot_commands": 0.010488497905242138, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.005451040390210274, "sim_compute_performance-ego": 0.007825084221668733, "sim_compute_robot_state-ego": 0.00903152502500094, "sim_compute_robot_state-npc0": 0.009929892344352528, "sim_compute_robot_state-npc1": 0.009110297912206406, "sim_compute_robot_state-npc2": 0.009285556964385204, "sim_compute_robot_state-npc3": 0.009538393754225513}, "udem1-3-0": {"driven_any": 0.8072381933001381, "sim_physics": 0.2677102381722969, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.01397354142707691, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.026919222714608174, "deviation-heading": 0.7978002362162196, "set_robot_commands": 0.010733943236501594, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.0052827199300130205, "sim_compute_performance-ego": 0.008218259142156233, "sim_compute_robot_state-ego": 0.01005572603459944, "sim_compute_robot_state-npc0": 0.009398368366977624, "sim_compute_robot_state-npc1": 0.009709512978269342, "sim_compute_robot_state-npc2": 0.00900888442993164, "sim_compute_robot_state-npc3": 0.00931683339570698}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.2341833736585534, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.01388854565827743, "in-drivable-lane": 0, "agent_compute-ego": 0.026627727176832115, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.010050068730893345, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.005497600721276324, "sim_compute_performance-ego": 0.008595404417618462, "sim_compute_robot_state-ego": 0.010211498840995457, "sim_compute_robot_state-npc0": 0.008841369463049847, "sim_compute_robot_state-npc1": 0.009512414102968962, "sim_compute_robot_state-npc2": 0.009464761485224184, "sim_compute_robot_state-npc3": 0.009258062943168308}}
set_robot_commands_max	0.010893804055673103
set_robot_commands_mean	0.010459906883415353
set_robot_commands_median	0.010488497905242138
set_robot_commands_min	0.010050068730893345
sim_compute_performance-ego_max	0.008595404417618462
sim_compute_performance-ego_mean	0.007922571565203795
sim_compute_performance-ego_median	0.007825084221668733
sim_compute_performance-ego_min	0.0072129318513065935
sim_compute_robot_state-ego_max	0.010211498840995457
sim_compute_robot_state-ego_mean	0.009592617414653582
sim_compute_robot_state-ego_median	0.009456726441900414
sim_compute_robot_state-ego_min	0.00903152502500094
sim_compute_robot_state-npc0_max	0.009929892344352528
sim_compute_robot_state-npc0_mean	0.009233659896503882
sim_compute_robot_state-npc0_median	0.009037485829106084
sim_compute_robot_state-npc0_min	0.008841369463049847
sim_compute_robot_state-npc1_max	0.009709512978269342
sim_compute_robot_state-npc1_mean	0.00923475233396674
sim_compute_robot_state-npc1_median	0.009110297912206406
sim_compute_robot_state-npc1_min	0.0088813161275473
sim_compute_robot_state-npc2_max	0.009464761485224184
sim_compute_robot_state-npc2_mean	0.009087093521079188
sim_compute_robot_state-npc2_median	0.00900888442993164
sim_compute_robot_state-npc2_min	0.008765953132905156
sim_compute_robot_state-npc3_max	0.009538393754225513
sim_compute_robot_state-npc3_mean	0.00918276283982828
sim_compute_robot_state-npc3_median	0.009258062943168308
sim_compute_robot_state-npc3_min	0.008648208824984998
sim_compute_sim_state_max	0.005497600721276324
sim_compute_sim_state_mean	0.005337273087392738
sim_compute_sim_state_median	0.005399792282669632
sim_compute_sim_state_min	0.0050552121127944395
sim_physics_max	0.2677102381722969
sim_physics_mean	0.23965076492157855
sim_physics_median	0.2341833736585534
sim_physics_min	0.21026768167334867
sim_render-ego_max	0.01397354142707691
sim_render-ego_mean	0.013574249930962238
sim_render-ego_median	0.013813171631250626
sim_render-ego_min	0.012619147817772555
simulation-passed	1
survival_time_max	4.149999999999993
survival_time_mean	2.679999999999997
survival_time_min	1.1500000000000004

No reset possible

25098

4383

Soroush Saryazdi 🇨🇦

bluejay

aido3-LFV-sim-validation

step1-simulation

failed

ip-172-31-35-218-10492

2019-11-06 18:39:41+00:00

2019-11-06 18:44:15+00:00

0:04:34

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 65 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25067

4366

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-tensorflow

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-35-218-10492

2019-11-05 15:15:58+00:00

2019-11-05 15:26:37+00:00

0:10:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.16745992608298232
survival_time_median	1.1500000000000004
deviation-center-line_median	0.08254266887034502
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.029838468717492145
agent_compute-ego_mean	0.026775969636134104
agent_compute-ego_median	0.02694188980829148
agent_compute-ego_min	0.02325891045963063
deviation-center-line_max	0.3604313821783266
deviation-center-line_mean	0.1280405964589901
deviation-center-line_min	0.0449844304399945
deviation-heading_max	1.704809273878099
deviation-heading_mean	0.7366608103421622
deviation-heading_median	0.5259025615264811
deviation-heading_min	0.2845997872765013
driven_any_max	1.4942267261496749
driven_any_mean	0.4490487649286816
driven_any_median	0.28793764362454455
driven_any_min	0.10242923947069124
driven_lanedir_consec_max	1.0063569556704457
driven_lanedir_consec_mean	0.28925603197116073
driven_lanedir_consec_min	0.0748272227573814
driven_lanedir_max	1.0063569556704457
driven_lanedir_mean	0.29740025908027334
driven_lanedir_median	0.23253495720933023
driven_lanedir_min	0.0748272227573814
in-drivable-lane_max	2.5999999999999948
in-drivable-lane_mean	0.286666666666666
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2960965262364759, "sim_physics": 0.1157551330068837, "survival_time": 1.1500000000000004, "driven_lanedir": 0.23253495720933023, "sim_render-ego": 0.012762453245080036, "in-drivable-lane": 0, "agent_compute-ego": 0.029838468717492145, "deviation-heading": 0.5259025615264811, "set_robot_commands": 0.01010659466619077, "deviation-center-line": 0.08254266887034502, "driven_lanedir_consec": 0.23253495720933023, "sim_compute_sim_state": 0.004714178002398947, "sim_compute_performance-ego": 0.008159533790920092, "sim_compute_robot_state-ego": 0.010977299317069675}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2702436721667545, "sim_physics": 0.10076151001319456, "survival_time": 4.449999999999992, "driven_lanedir": 0.3644550063495602, "sim_render-ego": 0.011670104573281962, "in-drivable-lane": 2.5999999999999948, "agent_compute-ego": 0.025794200682907963, "deviation-heading": 1.1995678017797404, "set_robot_commands": 0.009666174985049816, "deviation-center-line": 0.15236626288138783, "driven_lanedir_consec": 0.3644550063495602, "sim_compute_sim_state": 0.005263486605012015, "sim_compute_performance-ego": 0.006781111942248398, "sim_compute_robot_state-ego": 0.008674273330174136}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28793764362454455, "sim_physics": 0.13663846254348755, "survival_time": 1.4000000000000006, "driven_lanedir": 0.25596765561913903, "sim_render-ego": 0.013246604374476842, "in-drivable-lane": 0, "agent_compute-ego": 0.029014485222952708, "deviation-heading": 0.4301556225357165, "set_robot_commands": 0.010126726967947823, "deviation-center-line": 0.10513068033965776, "driven_lanedir_consec": 0.25596765561913903, "sim_compute_sim_state": 0.005271111215863909, "sim_compute_performance-ego": 0.007623919418879917, "sim_compute_robot_state-ego": 0.008522467953818185}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.372293666393109, "sim_physics": 0.11525691407067436, "survival_time": 1.4000000000000006, "driven_lanedir": 0.3320906647222639, "sim_render-ego": 0.013519593647548131, "in-drivable-lane": 0, "agent_compute-ego": 0.02758324146270752, "deviation-heading": 0.5166842478452349, "set_robot_commands": 0.010245272091456824, "deviation-center-line": 0.08460317118934775, "driven_lanedir_consec": 0.3320906647222639, "sim_compute_sim_state": 0.005274397986275809, "sim_compute_performance-ego": 0.008368773119790214, "sim_compute_robot_state-ego": 0.00917844261441912}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6259569652833553, "sim_physics": 0.1403188705444336, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5010505896013968, "sim_render-ego": 0.01375695511146828, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.029283188007496023, "deviation-heading": 1.075370589612118, "set_robot_commands": 0.01066536373562283, "deviation-center-line": 0.2587202890893239, "driven_lanedir_consec": 0.5010505896013968, "sim_compute_sim_state": 0.005606099411293313, "sim_compute_performance-ego": 0.007536896952876338, "sim_compute_robot_state-ego": 0.01080987188551161}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.22390387050969335, "sim_physics": 0.11007592552586604, "survival_time": 0.9500000000000004, "driven_lanedir": 0.15232337375631566, "sim_render-ego": 0.012669124101337631, "in-drivable-lane": 0, "agent_compute-ego": 0.024793499394467, "deviation-heading": 0.6072334844161934, "set_robot_commands": 0.008795562543367086, "deviation-center-line": 0.06531297142312076, "driven_lanedir_consec": 0.15232337375631566, "sim_compute_sim_state": 0.004521445224159642, "sim_compute_performance-ego": 0.00768682831212094, "sim_compute_robot_state-ego": 0.008791283557289526}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5223823127479744, "sim_physics": 0.12098577389350304, "survival_time": 2.5999999999999988, "driven_lanedir": 0.2858962741398168, "sim_render-ego": 0.014162870553823618, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.029553936077998236, "deviation-heading": 1.704809273878099, "set_robot_commands": 0.010597416987785926, "deviation-center-line": 0.15298719047618417, "driven_lanedir_consec": 0.16373286750312754, "sim_compute_sim_state": 0.005827633234170767, "sim_compute_performance-ego": 0.00800180435180664, "sim_compute_robot_state-ego": 0.010031952307774473}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.15112212577460998, "sim_physics": 0.09667880394879508, "survival_time": 0.8500000000000002, "driven_lanedir": 0.1220910504934536, "sim_render-ego": 0.01215825361364028, "in-drivable-lane": 0, "agent_compute-ego": 0.02628156718085794, "deviation-heading": 0.40745655930673, "set_robot_commands": 0.008912310880773208, "deviation-center-line": 0.07654215207208565, "driven_lanedir_consec": 0.1220910504934536, "sim_compute_sim_state": 0.004621940500595991, "sim_compute_performance-ego": 0.0066957614001105815, "sim_compute_robot_state-ego": 0.008361872504739201}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.17747423134142615, "sim_physics": 0.13116321109590076, "survival_time": 1.0500000000000005, "driven_lanedir": 0.12706725217682768, "sim_render-ego": 0.012674797148931594, "in-drivable-lane": 0, "agent_compute-ego": 0.02694188980829148, "deviation-heading": 0.5497394768848888, "set_robot_commands": 0.009860470181419737, "deviation-center-line": 0.0449844304399945, "driven_lanedir_consec": 0.12706725217682768, "sim_compute_sim_state": 0.005628812880743118, "sim_compute_performance-ego": 0.007509912763323102, "sim_compute_robot_state-ego": 0.008809089660644531}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.19825201752558116, "sim_physics": 0.119595163746884, "survival_time": 0.9500000000000004, "driven_lanedir": 0.16745992608298232, "sim_render-ego": 0.013704550893683182, "in-drivable-lane": 0, "agent_compute-ego": 0.025838776638633328, "deviation-heading": 0.3497567223913459, "set_robot_commands": 0.009131695094861482, "deviation-center-line": 0.07121009843020781, "driven_lanedir_consec": 0.16745992608298232, "sim_compute_sim_state": 0.004993777526052375, "sim_compute_performance-ego": 0.007415144067061574, "sim_compute_robot_state-ego": 0.008407642966822573}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1698397470870924, "sim_physics": 0.11655581698698156, "survival_time": 0.8500000000000002, "driven_lanedir": 0.140391401370629, "sim_render-ego": 0.013744354248046877, "in-drivable-lane": 0, "agent_compute-ego": 0.027235970777623793, "deviation-heading": 0.2845997872765013, "set_robot_commands": 0.01059732717626235, "deviation-center-line": 0.0738256036901162, "driven_lanedir_consec": 0.140391401370629, "sim_compute_sim_state": 0.005484426722807043, "sim_compute_performance-ego": 0.007896633709178251, "sim_compute_robot_state-ego": 0.009583403082454908}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.22007294683574577, "sim_physics": 0.12154719564649794, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1666059266963137, "sim_render-ego": 0.013350685437520346, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.028544651137457952, "deviation-heading": 0.3253302406687606, "set_robot_commands": 0.011104491021898056, "deviation-center-line": 0.05148591059182237, "driven_lanedir_consec": 0.1666059266963137, "sim_compute_sim_state": 0.005745132764180501, "sim_compute_performance-ego": 0.008419844839307997, "sim_compute_robot_state-ego": 0.00958104928334554}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6234997827834953, "sim_physics": 0.08970133809075839, "survival_time": 3.4499999999999957, "driven_lanedir": 0.5318856295582436, "sim_render-ego": 0.01158031173374342, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02435475846995478, "deviation-heading": 1.5954060359377933, "set_robot_commands": 0.009055787238521852, "deviation-center-line": 0.25815983734756465, "driven_lanedir_consec": 0.5318856295582436, "sim_compute_sim_state": 0.0048942842345306835, "sim_compute_performance-ego": 0.0069684844086135645, "sim_compute_robot_state-ego": 0.008502479912578196}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.4942267261496749, "sim_physics": 0.08564490795135499, "survival_time": 4.99999999999999, "driven_lanedir": 1.0063569556704457, "sim_render-ego": 0.01001368761062622, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.02332200050354004, "deviation-heading": 1.1135152923681817, "set_robot_commands": 0.007658486366271973, "deviation-center-line": 0.3604313821783266, "driven_lanedir_consec": 1.0063569556704457, "sim_compute_sim_state": 0.004096112251281738, "sim_compute_performance-ego": 0.005713176727294922, "sim_compute_robot_state-ego": 0.006934764385223388}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.10242923947069124, "sim_physics": 0.09607869036057416, "survival_time": 0.8500000000000002, "driven_lanedir": 0.0748272227573814, "sim_render-ego": 0.020708546918981215, "in-drivable-lane": 0, "agent_compute-ego": 0.02325891045963063, "deviation-heading": 0.3643844587046507, "set_robot_commands": 0.008850756813498104, "deviation-center-line": 0.08230629786536657, "driven_lanedir_consec": 0.0748272227573814, "sim_compute_sim_state": 0.004032163059010226, "sim_compute_performance-ego": 0.007386375876034007, "sim_compute_robot_state-ego": 0.007223928675932043}}
set_robot_commands_max	0.011104491021898056
set_robot_commands_mean	0.009691629116728525
set_robot_commands_median	0.009860470181419737
set_robot_commands_min	0.007658486366271973
sim_compute_performance-ego_max	0.008419844839307997
sim_compute_performance-ego_mean	0.007477613445304437
sim_compute_performance-ego_median	0.007536896952876338
sim_compute_performance-ego_min	0.005713176727294922
sim_compute_robot_state-ego_max	0.010977299317069675
sim_compute_robot_state-ego_mean	0.008959321429186476
sim_compute_robot_state-ego_median	0.008791283557289526
sim_compute_robot_state-ego_min	0.006934764385223388
sim_compute_sim_state_max	0.005827633234170767
sim_compute_sim_state_mean	0.005065000107891739
sim_compute_sim_state_median	0.005263486605012015
sim_compute_sim_state_min	0.004032163059010226
sim_physics_max	0.1403188705444336
sim_physics_mean	0.11311718116171932
sim_physics_median	0.1157551330068837
sim_physics_min	0.08564490795135499
sim_render-ego_max	0.020708546918981215
sim_render-ego_mean	0.013314859547479308
sim_render-ego_median	0.013246604374476842
sim_render-ego_min	0.01001368761062622
simulation-passed	1
survival_time_max	4.99999999999999
survival_time_mean	1.903333333333332
survival_time_min	0.8500000000000002

No reset possible

25026

4364

Soroush Saryazdi 🇨🇦

bluejay

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 15:22:39+00:00

2019-11-04 15:23:03+00:00

0:00:24

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25017

4363

Soroush Saryazdi 🇨🇦

bluejay

aido3-LFVI-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 15:16:58+00:00

2019-11-04 15:18:49+00:00

0:01:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25010

4352

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LFV-sim-testing

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 14:18:09+00:00

2019-11-04 14:29:29+00:00

0:11:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2163780025069597
survival_time_median	1.3500000000000003
deviation-center-line_median	0.08830702238801655
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.02421668301457944
agent_compute-ego_mean	0.01720653740912253
agent_compute-ego_median	0.015767203436957464
agent_compute-ego_min	0.015375880094674915
deviation-center-line_max	0.31411222399333977
deviation-center-line_mean	0.12655170046908673
deviation-center-line_min	0.05555768758045019
deviation-heading_max	2.3708464937186173
deviation-heading_mean	0.851958751761755
deviation-heading_median	0.6293745966684198
deviation-heading_min	0.22491633852391507
driven_any_max	1.2319612442515484
driven_any_mean	0.5028245720344944
driven_any_median	0.278836006209544
driven_any_min	0.19673433799465595
driven_lanedir_consec_max	0.9210141015363034
driven_lanedir_consec_mean	0.3069232015028297
driven_lanedir_consec_min	0.07427343004040132
driven_lanedir_max	0.921545778437109
driven_lanedir_mean	0.3092757733255462
driven_lanedir_median	0.2163780025069597
driven_lanedir_min	0.07427343004040132
in-drivable-lane_max	2.499999999999991
in-drivable-lane_mean	0.433333333333332
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.28914305346101454, "sim_physics": 0.1513327930284583, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2163780025069597, "sim_render-ego": 0.010920420936916184, "in-drivable-lane": 0, "agent_compute-ego": 0.02421668301457944, "deviation-heading": 0.5592329427289897, "set_robot_commands": 0.007163908170617145, "deviation-center-line": 0.08176172463809334, "driven_lanedir_consec": 0.2163780025069597, "sim_compute_sim_state": 0.003921840501868207, "sim_compute_performance-ego": 0.006368958431741466, "sim_compute_robot_state-ego": 0.007820264152858568, "sim_compute_robot_state-npc0": 0.007302657417629076, "sim_compute_robot_state-npc1": 0.0071582794189453125, "sim_compute_robot_state-npc2": 0.007257938385009766, "sim_compute_robot_state-npc3": 0.006631809732188349}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9460747719038204, "sim_physics": 0.141735539549873, "survival_time": 4.199999999999993, "driven_lanedir": 0.8549680940253679, "sim_render-ego": 0.009467224280039469, "in-drivable-lane": 0, "agent_compute-ego": 0.020507531506674632, "deviation-heading": 1.3408080665464772, "set_robot_commands": 0.007194005307697114, "deviation-center-line": 0.25790919198908324, "driven_lanedir_consec": 0.8549680940253679, "sim_compute_sim_state": 0.0036801440375191824, "sim_compute_performance-ego": 0.005396967842465355, "sim_compute_robot_state-ego": 0.006740904989696685, "sim_compute_robot_state-npc0": 0.006440128598894391, "sim_compute_robot_state-npc1": 0.006138750485011509, "sim_compute_robot_state-npc2": 0.006159603595733643, "sim_compute_robot_state-npc3": 0.0060925597236269995}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2305348368928488, "sim_physics": 0.14279558784083315, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2082089643159808, "sim_render-ego": 0.008515558744731703, "in-drivable-lane": 0, "agent_compute-ego": 0.019376754760742188, "deviation-heading": 0.25313477941098916, "set_robot_commands": 0.006776445790341026, "deviation-center-line": 0.08359550314561631, "driven_lanedir_consec": 0.2082089643159808, "sim_compute_sim_state": 0.0033144072482460423, "sim_compute_performance-ego": 0.005002473530016448, "sim_compute_robot_state-ego": 0.006193110817357113, "sim_compute_robot_state-npc0": 0.005951467313264546, "sim_compute_robot_state-npc1": 0.005639866778725072, "sim_compute_robot_state-npc2": 0.005623290413304379, "sim_compute_robot_state-npc3": 0.005667899784288909}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.26493653841893716, "sim_physics": 0.12520439284188406, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2523154527018918, "sim_render-ego": 0.007910331090291342, "in-drivable-lane": 0, "agent_compute-ego": 0.018069006147838775, "deviation-heading": 0.22491633852391507, "set_robot_commands": 0.005498250325520833, "deviation-center-line": 0.08830702238801655, "driven_lanedir_consec": 0.2523154527018918, "sim_compute_sim_state": 0.003088610512869699, "sim_compute_performance-ego": 0.004325764519827706, "sim_compute_robot_state-ego": 0.005495752607073102, "sim_compute_robot_state-npc0": 0.005181596392676944, "sim_compute_robot_state-npc1": 0.004932108379545666, "sim_compute_robot_state-npc2": 0.004992564519246419, "sim_compute_robot_state-npc3": 0.004955450693766276}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2319612442515484, "sim_physics": 0.10242071858158816, "survival_time": 5.399999999999989, "driven_lanedir": 0.3695992860871049, "sim_render-ego": 0.008050861182036224, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.018172542254130047, "deviation-heading": 2.3708464937186173, "set_robot_commands": 0.005951435477645309, "deviation-center-line": 0.20097711323050843, "driven_lanedir_consec": 0.3695992860871049, "sim_compute_sim_state": 0.0032508527791058578, "sim_compute_performance-ego": 0.004511409335666233, "sim_compute_robot_state-ego": 0.005679042251021774, "sim_compute_robot_state-npc0": 0.005478512357782434, "sim_compute_robot_state-npc1": 0.005435164327974673, "sim_compute_robot_state-npc2": 0.005361711537396467, "sim_compute_robot_state-npc3": 0.0054753753874037005}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.23824151943715652, "sim_physics": 0.09142521575645164, "survival_time": 1.3500000000000003, "driven_lanedir": 0.16529223713784846, "sim_render-ego": 0.007261488172743056, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.015557686487833658, "deviation-heading": 0.6293745966684198, "set_robot_commands": 0.00508925649854872, "deviation-center-line": 0.07535682577499925, "driven_lanedir_consec": 0.16529223713784846, "sim_compute_sim_state": 0.0028081028549759475, "sim_compute_performance-ego": 0.00396293180960196, "sim_compute_robot_state-ego": 0.00503257468894676, "sim_compute_robot_state-npc0": 0.0048727017861825445, "sim_compute_robot_state-npc1": 0.004633453157212999, "sim_compute_robot_state-npc2": 0.004614256046436451, "sim_compute_robot_state-npc3": 0.004601690504286025}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19673433799465595, "sim_physics": 0.10124936368730332, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1447417897839438, "sim_render-ego": 0.007132331530253093, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.015767203436957464, "deviation-heading": 0.3054239616722312, "set_robot_commands": 0.005109853214687771, "deviation-center-line": 0.05949649320568799, "driven_lanedir_consec": 0.1447417897839438, "sim_compute_sim_state": 0.002810027864244249, "sim_compute_performance-ego": 0.003956158955891927, "sim_compute_robot_state-ego": 0.004980272716946072, "sim_compute_robot_state-npc0": 0.004846811294555664, "sim_compute_robot_state-npc1": 0.004631479581197103, "sim_compute_robot_state-npc2": 0.004601611031426324, "sim_compute_robot_state-npc3": 0.004625346925523546}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2172039984060976, "sim_physics": 0.11688767029688908, "survival_time": 1.3000000000000005, "driven_lanedir": 0.17731523442110086, "sim_render-ego": 0.01202378823206975, "in-drivable-lane": 0, "agent_compute-ego": 0.015375880094674915, "deviation-heading": 0.4679213628766513, "set_robot_commands": 0.005186933737534743, "deviation-center-line": 0.08847007423744921, "driven_lanedir_consec": 0.17731523442110086, "sim_compute_sim_state": 0.0028398953951322115, "sim_compute_performance-ego": 0.004014061047480657, "sim_compute_robot_state-ego": 0.005085981809175932, "sim_compute_robot_state-npc0": 0.004907158704904409, "sim_compute_robot_state-npc1": 0.004659496820889986, "sim_compute_robot_state-npc2": 0.004658699035644531, "sim_compute_robot_state-npc3": 0.0046403866547804614}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.37828034089794377, "sim_physics": 0.10301352835990288, "survival_time": 1.850000000000001, "driven_lanedir": 0.31091264307157473, "sim_render-ego": 0.007225339477126663, "in-drivable-lane": 0, "agent_compute-ego": 0.01575114275958087, "deviation-heading": 0.654427774904591, "set_robot_commands": 0.004951161307257575, "deviation-center-line": 0.07297399387639981, "driven_lanedir_consec": 0.31091264307157473, "sim_compute_sim_state": 0.0027925452670535525, "sim_compute_performance-ego": 0.003931064863462706, "sim_compute_robot_state-ego": 0.004979101387230125, "sim_compute_robot_state-npc0": 0.004818033527683567, "sim_compute_robot_state-npc1": 0.004579215436368375, "sim_compute_robot_state-npc2": 0.004559871312734243, "sim_compute_robot_state-npc3": 0.004550920950399863}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.2287439756447838, "sim_physics": 0.11580891222567172, "survival_time": 5.549999999999988, "driven_lanedir": 0.921545778437109, "sim_render-ego": 0.007212241490681966, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.017340421676635742, "deviation-heading": 1.6216288663706155, "set_robot_commands": 0.004986361340359524, "deviation-center-line": 0.31411222399333977, "driven_lanedir_consec": 0.9210141015363034, "sim_compute_sim_state": 0.0028742562543164502, "sim_compute_performance-ego": 0.004001531515035544, "sim_compute_robot_state-ego": 0.005040733663885443, "sim_compute_robot_state-npc0": 0.004916023563694309, "sim_compute_robot_state-npc1": 0.004676509547877956, "sim_compute_robot_state-npc2": 0.004645768586579744, "sim_compute_robot_state-npc3": 0.0046168361698185004}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2649822660682976, "sim_physics": 0.12783735990524292, "survival_time": 1.0000000000000002, "driven_lanedir": 0.23080277880257727, "sim_render-ego": 0.00733877420425415, "in-drivable-lane": 0, "agent_compute-ego": 0.01581813097000122, "deviation-heading": 0.46162744687853774, "set_robot_commands": 0.004923439025878907, "deviation-center-line": 0.058104239952148626, "driven_lanedir_consec": 0.23080277880257727, "sim_compute_sim_state": 0.0028162598609924316, "sim_compute_performance-ego": 0.003959476947784424, "sim_compute_robot_state-ego": 0.005032575130462647, "sim_compute_robot_state-npc0": 0.0048859953880310055, "sim_compute_robot_state-npc1": 0.00463486909866333, "sim_compute_robot_state-npc2": 0.0045994043350219725, "sim_compute_robot_state-npc3": 0.004569685459136963}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.20560341892223297, "sim_physics": 0.09080001440915196, "survival_time": 1.1000000000000003, "driven_lanedir": 0.19561571619779936, "sim_render-ego": 0.0071257136084816675, "in-drivable-lane": 0, "agent_compute-ego": 0.01539401574568315, "deviation-heading": 0.2813086704138677, "set_robot_commands": 0.005265420133417303, "deviation-center-line": 0.1002414162991417, "driven_lanedir_consec": 0.19561571619779936, "sim_compute_sim_state": 0.00285063006661155, "sim_compute_performance-ego": 0.003987886688926003, "sim_compute_robot_state-ego": 0.005046822808005593, "sim_compute_robot_state-npc0": 0.004946784539656205, "sim_compute_robot_state-npc1": 0.0047033158215609465, "sim_compute_robot_state-npc2": 0.00467184456911954, "sim_compute_robot_state-npc3": 0.00469152493910356}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.278836006209544, "sim_physics": 0.10777467886606852, "survival_time": 1.5000000000000009, "driven_lanedir": 0.18349567949752665, "sim_render-ego": 0.007236742973327636, "in-drivable-lane": 0, "agent_compute-ego": 0.01552124818166097, "deviation-heading": 0.7907444342214534, "set_robot_commands": 0.004919703801472982, "deviation-center-line": 0.08969632111706638, "driven_lanedir_consec": 0.18349567949752665, "sim_compute_sim_state": 0.0028058687845865884, "sim_compute_performance-ego": 0.003999400138854981, "sim_compute_robot_state-ego": 0.005067078272501627, "sim_compute_robot_state-npc0": 0.004865185419718424, "sim_compute_robot_state-npc1": 0.004638393719991048, "sim_compute_robot_state-npc2": 0.004577120145161946, "sim_compute_robot_state-npc3": 0.004590876897176107}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.0851478230278169, "sim_physics": 0.10572140013917963, "survival_time": 4.699999999999991, "driven_lanedir": 0.33367151285600594, "sim_render-ego": 0.007045619031216236, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0155397374579247, "deviation-heading": 1.997542188237054, "set_robot_commands": 0.0048925394707537715, "deviation-center-line": 0.27171567560830034, "driven_lanedir_consec": 0.2989146124160649, "sim_compute_sim_state": 0.0028124083863927964, "sim_compute_performance-ego": 0.003945287237776087, "sim_compute_robot_state-ego": 0.00504870871280102, "sim_compute_robot_state-npc0": 0.004855899100608014, "sim_compute_robot_state-npc1": 0.004596045676698076, "sim_compute_robot_state-npc2": 0.004576383753025786, "sim_compute_robot_state-npc3": 0.004572462528309924}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.4859444489807175, "sim_physics": 0.11583545731335151, "survival_time": 2.0500000000000007, "driven_lanedir": 0.07427343004040132, "sim_render-ego": 0.007185877823248142, "in-drivable-lane": 1.0000000000000004, "agent_compute-ego": 0.015690076641920136, "deviation-heading": 0.8204433532539147, "set_robot_commands": 0.0047412441997993285, "deviation-center-line": 0.05555768758045019, "driven_lanedir_consec": 0.07427343004040132, "sim_compute_sim_state": 0.002799528401072433, "sim_compute_performance-ego": 0.003913332776325505, "sim_compute_robot_state-ego": 0.004957885276980516, "sim_compute_robot_state-npc0": 0.004795330326731612, "sim_compute_robot_state-npc1": 0.004555597537901343, "sim_compute_robot_state-npc2": 0.00452877254020877, "sim_compute_robot_state-npc3": 0.004563697954503502}}
set_robot_commands_max	0.007194005307697114
set_robot_commands_mean	0.0055099971867688035
set_robot_commands_median	0.005109853214687771
set_robot_commands_min	0.0047412441997993285
sim_compute_performance-ego_max	0.006368958431741466
sim_compute_performance-ego_mean	0.004351780376057134
sim_compute_performance-ego_median	0.003999400138854981
sim_compute_performance-ego_min	0.003913332776325505
sim_compute_robot_state-ego_max	0.007820264152858568
sim_compute_robot_state-ego_mean	0.005480053952329532
sim_compute_robot_state-ego_median	0.00504870871280102
sim_compute_robot_state-ego_min	0.004957885276980516
sim_compute_robot_state-npc0_max	0.007302657417629076
sim_compute_robot_state-npc0_mean	0.00527095238213421
sim_compute_robot_state-npc0_median	0.004907158704904409
sim_compute_robot_state-npc0_min	0.004795330326731612
sim_compute_robot_state-npc1_max	0.0071582794189453125
sim_compute_robot_state-npc1_mean	0.005040836385904226
sim_compute_robot_state-npc1_median	0.004659496820889986
sim_compute_robot_state-npc1_min	0.004555597537901343
sim_compute_robot_state-npc2_max	0.007257938385009766
sim_compute_robot_state-npc2_mean	0.005028589320403331
sim_compute_robot_state-npc2_median	0.004645768586579744
sim_compute_robot_state-npc2_min	0.00452877254020877
sim_compute_robot_state-npc3_max	0.006631809732188349
sim_compute_robot_state-npc3_mean	0.004989768286954179
sim_compute_robot_state-npc3_median	0.004625346925523546
sim_compute_robot_state-npc3_min	0.004550920950399863
sim_compute_sim_state_max	0.003921840501868207
sim_compute_sim_state_mean	0.00303102521433248
sim_compute_sim_state_median	0.0028398953951322115
sim_compute_sim_state_min	0.0027925452670535525
sim_physics_max	0.1513327930284583
sim_physics_mean	0.11598950885345669
sim_physics_median	0.11580891222567172
sim_physics_min	0.09080001440915196
sim_render-ego_max	0.01202378823206975
sim_render-ego_mean	0.008110154185161152
sim_render-ego_median	0.007261488172743056
sim_render-ego_min	0.007045619031216236
simulation-passed	1
survival_time_max	5.549999999999988
survival_time_mean	2.269999999999998
survival_time_min	0.9000000000000002

No reset possible

24992

4144

Andrea Censi 🇨🇭

rotation

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 09:06:00+00:00

2019-11-04 09:44:08+00:00

0:38:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0014713911579260497
survival_time_median	14.950000000000076
deviation-center-line_median	0.3550429130563084
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.023073408603668213
agent_compute-ego_mean	0.02216105688942803
agent_compute-ego_median	0.02241354703903198
agent_compute-ego_min	0.018775893847147625
deviation-center-line_max	0.6007136359417561
deviation-center-line_mean	0.33945586938036626
deviation-center-line_min	0.017558302483544185
deviation-heading_max	5.87668078883977
deviation-heading_mean	5.668498743454
deviation-heading_median	5.709677935349316
deviation-heading_min	5.445457843647877
driven_any_max	0.026478672834058543
driven_any_mean	0.023389442379013872
driven_any_median	0.023285267728314855
driven_any_min	0.01977949840933559
driven_lanedir_consec_max	0.0021599934447711355
driven_lanedir_consec_mean	-0.0011081890688221148
driven_lanedir_consec_min	-0.004544743757038283
driven_lanedir_max	0.0021599934447711355
driven_lanedir_mean	-0.0011081890688221148
driven_lanedir_median	-0.0014713911579260497
driven_lanedir_min	-0.004544743757038283
in-drivable-lane_max	7.700000000000042
in-drivable-lane_mean	7.596666666666709
in-drivable-lane_min	7.500000000000043
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834058543, "sim_physics": 0.1019752017656962, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.01182503859202067, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.02241354703903198, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.009138790766398112, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.004879337946573893, "sim_compute_performance-ego": 0.007397947311401368, "sim_compute_robot_state-ego": 0.008625195026397706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541195415, "sim_physics": 0.10295985062917072, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.011879192193349203, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.022244911193847656, "deviation-heading": 5.445457843647877, "set_robot_commands": 0.009354332288106282, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.004994798501332601, "sim_compute_performance-ego": 0.0071255246798197424, "sim_compute_robot_state-ego": 0.008608068625132243}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672436115, "sim_physics": 0.107476749420166, "survival_time": 14.950000000000076, "driven_lanedir": 0.002118105955655203, "sim_render-ego": 0.012088091373443605, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.022697547276814774, "deviation-heading": 5.87668078883977, "set_robot_commands": 0.00995377779006958, "deviation-center-line": 0.47845174752595304, "driven_lanedir_consec": 0.002118105955655203, "sim_compute_sim_state": 0.0051005919774373375, "sim_compute_performance-ego": 0.007378642559051514, "sim_compute_robot_state-ego": 0.008921709855397543}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661378815, "sim_physics": 0.10468503475189209, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.011874502499898274, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.02251844803492228, "deviation-heading": 5.721005148732665, "set_robot_commands": 0.009507993857065836, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.00501781702041626, "sim_compute_performance-ego": 0.007036473751068115, "sim_compute_robot_state-ego": 0.00879790465037028}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252179608, "sim_physics": 0.10191718101501464, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.011244685649871826, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.022021175225575763, "deviation-heading": 5.453097843541614, "set_robot_commands": 0.008983102639516195, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.004800944328308105, "sim_compute_performance-ego": 0.0070256241162618, "sim_compute_robot_state-ego": 0.008507278760274252}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.026249880775222677, "sim_physics": 0.10370869716008504, "survival_time": 14.950000000000076, "driven_lanedir": -0.0017675599932500674, "sim_render-ego": 0.011557592550913492, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.022590765158335368, "deviation-heading": 5.813994332249984, "set_robot_commands": 0.009111359119415284, "deviation-center-line": 0.6007136359417561, "driven_lanedir_consec": -0.0017675599932500674, "sim_compute_sim_state": 0.004811026255289713, "sim_compute_performance-ego": 0.006970976193745931, "sim_compute_robot_state-ego": 0.008663734594980876}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.023285267728314855, "sim_physics": 0.1049989867210388, "survival_time": 14.950000000000076, "driven_lanedir": -0.00391925832851836, "sim_render-ego": 0.012132264773050945, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.02291208744049072, "deviation-heading": 5.466476436400959, "set_robot_commands": 0.01031026045481364, "deviation-center-line": 0.3550429130563084, "driven_lanedir_consec": -0.00391925832851836, "sim_compute_sim_state": 0.005142187277475993, "sim_compute_performance-ego": 0.007299831708272298, "sim_compute_robot_state-ego": 0.009093459447224934}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.023561644755171383, "sim_physics": 0.07955871264139812, "survival_time": 14.950000000000076, "driven_lanedir": 0.002049277100081514, "sim_render-ego": 0.00978842337926229, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.018775893847147625, "deviation-heading": 5.8549580693835415, "set_robot_commands": 0.007578585942586263, "deviation-center-line": 0.41169203827872664, "driven_lanedir_consec": 0.002049277100081514, "sim_compute_sim_state": 0.004070684909820556, "sim_compute_performance-ego": 0.005957197348276774, "sim_compute_robot_state-ego": 0.007380659580230713}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.024191972983620167, "sim_physics": 0.09867947340011596, "survival_time": 14.950000000000076, "driven_lanedir": 0.0002979654230168549, "sim_render-ego": 0.011851701736450195, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.021646095116933183, "deviation-heading": 5.709677935349316, "set_robot_commands": 0.008760221004486084, "deviation-center-line": 0.017558302483544185, "driven_lanedir_consec": 0.0002979654230168549, "sim_compute_sim_state": 0.004813032944997152, "sim_compute_performance-ego": 0.007165745894114176, "sim_compute_robot_state-ego": 0.008777081966400146}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.02125816620692523, "sim_physics": 0.1122732130686442, "survival_time": 14.950000000000076, "driven_lanedir": -4.181733071773053e-05, "sim_render-ego": 0.012345224221547444, "in-drivable-lane": 7.500000000000043, "agent_compute-ego": 0.02296228885650635, "deviation-heading": 5.783324089492346, "set_robot_commands": 0.009924323558807372, "deviation-center-line": 0.2514968415228168, "driven_lanedir_consec": -4.181733071773053e-05, "sim_compute_sim_state": 0.005084133942921956, "sim_compute_performance-ego": 0.007333189646402995, "sim_compute_robot_state-ego": 0.009125502109527587}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.02143429212019909, "sim_physics": 0.1010112166404724, "survival_time": 14.950000000000076, "driven_lanedir": 0.000713963463023104, "sim_render-ego": 0.011290926933288576, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.02211874008178711, "deviation-heading": 5.526728061201507, "set_robot_commands": 0.009029378096262614, "deviation-center-line": 0.46282395191752784, "driven_lanedir_consec": 0.000713963463023104, "sim_compute_sim_state": 0.004877394835154216, "sim_compute_performance-ego": 0.007111432552337646, "sim_compute_robot_state-ego": 0.008855440616607667}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.01977949840933559, "sim_physics": 0.12189366340637207, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014713911579260497, "sim_render-ego": 0.011942579746246336, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.02283559799194336, "deviation-heading": 5.8066732640248135, "set_robot_commands": 0.009720571835835776, "deviation-center-line": 0.16800033110632376, "driven_lanedir_consec": -0.0014713911579260497, "sim_compute_sim_state": 0.005257666110992432, "sim_compute_performance-ego": 0.00713286558787028, "sim_compute_robot_state-ego": 0.008772350152333578}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.02098156490232138, "sim_physics": 0.09962587356567384, "survival_time": 14.950000000000076, "driven_lanedir": -0.001808663823426926, "sim_render-ego": 0.012434509595235187, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.02221229871114095, "deviation-heading": 5.515473779841324, "set_robot_commands": 0.008961029052734375, "deviation-center-line": 0.3169911817232478, "driven_lanedir_consec": -0.001808663823426926, "sim_compute_sim_state": 0.004991554419199626, "sim_compute_performance-ego": 0.007563357353210449, "sim_compute_robot_state-ego": 0.00901238759358724}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.022551048035817287, "sim_physics": 0.1153149684270223, "survival_time": 14.950000000000076, "driven_lanedir": -0.004544743757038283, "sim_render-ego": 0.011942159334818524, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.023073408603668213, "deviation-heading": 5.790764092245773, "set_robot_commands": 0.00970185120900472, "deviation-center-line": 0.03881032426772201, "driven_lanedir_consec": -0.004544743757038283, "sim_compute_sim_state": 0.005022915204366049, "sim_compute_performance-ego": 0.007100682258605957, "sim_compute_robot_state-ego": 0.009074305693308513}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.02322710180703199, "sim_physics": 0.0916158684094747, "survival_time": 14.950000000000076, "driven_lanedir": -0.0038012594606851025, "sim_render-ego": 0.011728797753651935, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.021393048763275142, "deviation-heading": 5.60552036000081, "set_robot_commands": 0.008502771854400635, "deviation-center-line": 0.5549657935250677, "driven_lanedir_consec": -0.0038012594606851025, "sim_compute_sim_state": 0.004678953488667806, "sim_compute_performance-ego": 0.007153838475545247, "sim_compute_robot_state-ego": 0.008721278508504232}}
set_robot_commands_max	0.01031026045481364
set_robot_commands_mean	0.009235889964633518
set_robot_commands_median	0.009138790766398112
set_robot_commands_min	0.007578585942586263
sim_compute_performance-ego_max	0.007563357353210449
sim_compute_performance-ego_mean	0.00711688862906562
sim_compute_performance-ego_median	0.00713286558787028
sim_compute_performance-ego_min	0.005957197348276774
sim_compute_robot_state-ego_max	0.009125502109527587
sim_compute_robot_state-ego_mean	0.008729090478685168
sim_compute_robot_state-ego_median	0.008777081966400146
sim_compute_robot_state-ego_min	0.007380659580230713
sim_compute_sim_state_max	0.005257666110992432
sim_compute_sim_state_mean	0.004902869277530247
sim_compute_sim_state_median	0.004991554419199626
sim_compute_sim_state_min	0.004070684909820556
sim_physics_max	0.12189366340637207
sim_physics_mean	0.10317964606814914
sim_physics_median	0.10295985062917072
sim_physics_min	0.07955871264139812
sim_render-ego_max	0.012434509595235187
sim_render-ego_mean	0.011728379355536566
sim_render-ego_median	0.011874502499898274
sim_render-ego_min	0.00978842337926229
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24985

4154

Andrea Censi 🇨🇭

minimal_agent_python2 (Python 2)

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 09:00:42+00:00

2019-11-04 09:05:35+00:00

0:04:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6707441932890994
survival_time_median	3.649999999999995
deviation-center-line_median	0.14435558631904788
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.011660669301007244
agent_compute-ego_mean	0.009922375332800356
agent_compute-ego_median	0.009446085315861117
agent_compute-ego_min	0.008972728574598158
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.21811977533890275
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.047774623333474
deviation-heading_mean	0.5589514876466882
deviation-heading_median	0.5590533399929921
deviation-heading_min	0.3001803644882976
driven_any_max	1.5798273185719856
driven_any_mean	0.8628689511998026
driven_any_median	0.9948273195001778
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	1.1257539445961453
driven_lanedir_consec_mean	0.6746052985515076
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	1.1257539445961453
driven_lanedir_mean	0.6746052985515076
driven_lanedir_median	0.6707441932890994
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.5299999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.10637386857646786, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.011260179624165574, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.009446085315861117, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.00872461436546012, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.004569798299711044, "sim_compute_performance-ego": 0.00695478426267023, "sim_compute_robot_state-ego": 0.008396583060695701}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.1347225743371087, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.013779405001047495, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.011660669301007244, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.01163361845789729, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.005487673991435283, "sim_compute_performance-ego": 0.00849736381221462, "sim_compute_robot_state-ego": 0.010769918158247665}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.10486948013305664, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.010945119857788089, "in-drivable-lane": 0, "agent_compute-ego": 0.009111566543579102, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.008948812484741211, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.004671659469604492, "sim_compute_performance-ego": 0.006479053497314453, "sim_compute_robot_state-ego": 0.007850818634033203}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.10061959962587098, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.011294538910324508, "in-drivable-lane": 0, "agent_compute-ego": 0.008972728574598158, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.00863761515230746, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.004606408041876716, "sim_compute_performance-ego": 0.006545163489676811, "sim_compute_robot_state-ego": 0.008664253595713023}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.13033162483147212, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.012945437005587987, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.010420826928956168, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.010168090462684631, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.005430421658924648, "sim_compute_performance-ego": 0.0072033171142850605, "sim_compute_robot_state-ego": 0.009532379252570016}}
set_robot_commands_max	0.01163361845789729
set_robot_commands_mean	0.009622550184618144
set_robot_commands_median	0.008948812484741211
set_robot_commands_min	0.00863761515230746
sim_compute_performance-ego_max	0.00849736381221462
sim_compute_performance-ego_mean	0.007135936435232235
sim_compute_performance-ego_median	0.00695478426267023
sim_compute_performance-ego_min	0.006479053497314453
sim_compute_robot_state-ego_max	0.010769918158247665
sim_compute_robot_state-ego_mean	0.009042790540251922
sim_compute_robot_state-ego_median	0.008664253595713023
sim_compute_robot_state-ego_min	0.007850818634033203
sim_compute_sim_state_max	0.005487673991435283
sim_compute_sim_state_mean	0.004953192292310437
sim_compute_sim_state_median	0.004671659469604492
sim_compute_sim_state_min	0.004569798299711044
sim_physics_max	0.1347225743371087
sim_physics_mean	0.11538342950079523
sim_physics_median	0.10637386857646786
sim_physics_min	0.10061959962587098
sim_render-ego_max	0.013779405001047495
sim_render-ego_mean	0.012044936079782732
sim_render-ego_median	0.011294538910324508
sim_render-ego_min	0.010945119857788089
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.209999999999996
survival_time_min	1.2500000000000004

No reset possible

24978

4163

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 08:58:47+00:00

2019-11-04 09:00:14+00:00

0:01:27

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24971

4173

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LFV-sim-testing

step1-simulation

failed

ip-172-31-35-218-10492

2019-11-04 08:56:30+00:00

2019-11-04 08:58:20+00:00

0:01:50

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24962

4187

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 08:51:37+00:00

2019-11-04 08:56:02+00:00

0:04:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.11667593935453972
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.02838949723677202
agent_compute-ego_mean	0.02489747332321887
agent_compute-ego_median	0.023774551308673363
agent_compute-ego_min	0.022776750723520915
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871985
deviation-heading_mean	0.4194004386292104
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829773
driven_any_max	0.9226822529128632
driven_any_mean	0.6324710235085376
driven_any_median	0.6091462024047467
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572033
driven_lanedir_consec_mean	0.4245071231796043
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572033
driven_lanedir_mean	0.4245071231796043
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.10614476741199762, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.012218169763054646, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.023408251748958105, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.008573619412704252, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.004894337183992628, "sim_compute_performance-ego": 0.007770948007073201, "sim_compute_robot_state-ego": 0.009264224012133102}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811183, "sim_physics": 0.09103084007898966, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572033, "sim_render-ego": 0.011465648810068766, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.022776750723520915, "deviation-heading": 0.5809378480871985, "set_robot_commands": 0.008838923772176106, "deviation-center-line": 0.11667593935453972, "driven_lanedir_consec": 0.6632135184572033, "sim_compute_sim_state": 0.004699118932088216, "sim_compute_performance-ego": 0.006602712472279866, "sim_compute_robot_state-ego": 0.008201658725738525}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.1417817852713845, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.014116319743069736, "in-drivable-lane": 0, "agent_compute-ego": 0.02838949723677202, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.010501677339727228, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.005114024335687811, "sim_compute_performance-ego": 0.00811844522302801, "sim_compute_robot_state-ego": 0.008881232955239036}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.13347170750300089, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.013159712155659994, "in-drivable-lane": 0, "agent_compute-ego": 0.026138315598169964, "deviation-heading": 0.568524016017798, "set_robot_commands": 0.010390102863311768, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.0056965649127960205, "sim_compute_performance-ego": 0.007618015011151631, "sim_compute_robot_state-ego": 0.009588544567426046}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6091462024047467, "sim_physics": 0.13058431252189304, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.012046316395635193, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.023774551308673363, "deviation-heading": 0.33908617460335944, "set_robot_commands": 0.01028864280037258, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.005516715671705163, "sim_compute_performance-ego": 0.006872949392899223, "sim_compute_robot_state-ego": 0.008816605028898819}}
set_robot_commands_max	0.010501677339727228
set_robot_commands_mean	0.009718593237658389
set_robot_commands_median	0.01028864280037258
set_robot_commands_min	0.008573619412704252
sim_compute_performance-ego_max	0.00811844522302801
sim_compute_performance-ego_mean	0.007396614021286385
sim_compute_performance-ego_median	0.007618015011151631
sim_compute_performance-ego_min	0.006602712472279866
sim_compute_robot_state-ego_max	0.009588544567426046
sim_compute_robot_state-ego_mean	0.008950453057887105
sim_compute_robot_state-ego_median	0.008881232955239036
sim_compute_robot_state-ego_min	0.008201658725738525
sim_compute_sim_state_max	0.0056965649127960205
sim_compute_sim_state_mean	0.005184152207253967
sim_compute_sim_state_median	0.005114024335687811
sim_compute_sim_state_min	0.004699118932088216
sim_physics_max	0.1417817852713845
sim_physics_mean	0.12060268255745314
sim_physics_median	0.13058431252189304
sim_physics_min	0.09103084007898966
sim_render-ego_max	0.014116319743069736
sim_render-ego_mean	0.012601233373497668
sim_render-ego_median	0.012218169763054646
sim_render-ego_min	0.011465648810068766
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

24956

4195

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 08:50:32+00:00

2019-11-04 08:51:17+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24945

4202

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LFV-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 08:47:52+00:00

2019-11-04 08:50:17+00:00

0:02:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24930

4219

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFVI-sim-testing

step1-simulation

failed

ip-172-31-35-218-10492

2019-11-04 08:43:28+00:00

2019-11-04 08:47:23+00:00

0:03:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/kernel
               || 	 [[{{node prefix/ConvNet/fc_layer_2/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/kernel
               || 	 [[node prefix/ConvNet/fc_layer_2/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/kernel
               || 	 [[node prefix/ConvNet/fc_layer_2/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24906

4243

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 08:17:08+00:00

2019-11-04 08:43:13+00:00

0:26:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.034578772977219785
survival_time_median	14.950000000000076
deviation-center-line_median	0.8926555537591809
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09513967037200928
agent_compute-ego_mean	0.08646102492014567
agent_compute-ego_median	0.09290227254231773
agent_compute-ego_min	0.07015553792317708
deviation-center-line_max	1.105299293508368
deviation-center-line_mean	0.7996450673033941
deviation-center-line_min	0.13012368362312385
deviation-heading_max	5.262018023364885
deviation-heading_mean	2.5975121050177328
deviation-heading_median	1.7289862578145316
deviation-heading_min	0.8651088427955215
driven_any_max	0.0356265125085951
driven_any_mean	0.03486100757290014
driven_any_median	0.03473163531719306
driven_any_min	0.034555267202452
driven_lanedir_consec_max	0.03537459369019791
driven_lanedir_consec_mean	0.034090914311093436
driven_lanedir_consec_min	0.03242878349713951
driven_lanedir_max	0.03537459369019791
driven_lanedir_mean	0.034090914311093436
driven_lanedir_median	0.034578772977219785
driven_lanedir_min	0.03242878349713951
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.0356265125085951, "sim_physics": 0.2050535257657369, "survival_time": 14.950000000000076, "driven_lanedir": 0.03537459369019791, "sim_render-ego": 0.013032290935516356, "in-drivable-lane": 0, "agent_compute-ego": 0.09363883336385093, "deviation-heading": 1.7289862578145316, "set_robot_commands": 0.009771661758422851, "deviation-center-line": 1.105299293508368, "driven_lanedir_consec": 0.03537459369019791, "sim_compute_sim_state": 0.005271677970886231, "sim_compute_performance-ego": 0.007894102732340496, "sim_compute_robot_state-ego": 0.00993467648824056, "sim_compute_robot_state-npc0": 0.00898976723353068, "sim_compute_robot_state-npc1": 0.008844367663065593, "sim_compute_robot_state-npc2": 0.00883664608001709, "sim_compute_robot_state-npc3": 0.00871397574742635}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.034555267202452, "sim_physics": 0.1928860441843669, "survival_time": 14.950000000000076, "driven_lanedir": 0.03242878349713951, "sim_render-ego": 0.012868632475535074, "in-drivable-lane": 0, "agent_compute-ego": 0.09513967037200928, "deviation-heading": 5.262018023364885, "set_robot_commands": 0.009995395342508952, "deviation-center-line": 1.0555012478128551, "driven_lanedir_consec": 0.03242878349713951, "sim_compute_sim_state": 0.005258158842722575, "sim_compute_performance-ego": 0.007748562494913737, "sim_compute_robot_state-ego": 0.009661596616109212, "sim_compute_robot_state-npc0": 0.009205989042917887, "sim_compute_robot_state-npc1": 0.009009634653727214, "sim_compute_robot_state-npc2": 0.008868873119354248, "sim_compute_robot_state-npc3": 0.009160016377766929}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.03473163531719306, "sim_physics": 0.1828010368347168, "survival_time": 14.950000000000076, "driven_lanedir": 0.0346798286953085, "sim_render-ego": 0.01289567470550537, "in-drivable-lane": 0, "agent_compute-ego": 0.09290227254231773, "deviation-heading": 0.90815611561211, "set_robot_commands": 0.009898587067921957, "deviation-center-line": 0.8926555537591809, "driven_lanedir_consec": 0.0346798286953085, "sim_compute_sim_state": 0.005364335378011067, "sim_compute_performance-ego": 0.007886410554250082, "sim_compute_robot_state-ego": 0.009585986932118734, "sim_compute_robot_state-npc0": 0.009146263599395752, "sim_compute_robot_state-npc1": 0.00888495365778605, "sim_compute_robot_state-npc2": 0.008912572065989176, "sim_compute_robot_state-npc3": 0.00914222478866577}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.03462819128343852, "sim_physics": 0.1547971192995707, "survival_time": 14.950000000000076, "driven_lanedir": 0.034578772977219785, "sim_render-ego": 0.010237078666687011, "in-drivable-lane": 0, "agent_compute-ego": 0.07015553792317708, "deviation-heading": 0.8651088427955215, "set_robot_commands": 0.007980796496073405, "deviation-center-line": 0.8146455578134432, "driven_lanedir_consec": 0.034578772977219785, "sim_compute_sim_state": 0.004151000181833903, "sim_compute_performance-ego": 0.0060367004076639814, "sim_compute_robot_state-ego": 0.007412139574686686, "sim_compute_robot_state-npc0": 0.007237558364868164, "sim_compute_robot_state-npc1": 0.00704456090927124, "sim_compute_robot_state-npc2": 0.007007136344909668, "sim_compute_robot_state-npc3": 0.0070342953999837235}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.03476343155282203, "sim_physics": 0.2051552907625834, "survival_time": 14.950000000000076, "driven_lanedir": 0.033392592695601464, "sim_render-ego": 0.011977849006652832, "in-drivable-lane": 0, "agent_compute-ego": 0.08046881039937337, "deviation-heading": 4.223291285501616, "set_robot_commands": 0.009148485660552978, "deviation-center-line": 0.13012368362312385, "driven_lanedir_consec": 0.033392592695601464, "sim_compute_sim_state": 0.004999526341756185, "sim_compute_performance-ego": 0.006973867416381836, "sim_compute_robot_state-ego": 0.00887872060139974, "sim_compute_robot_state-npc0": 0.008447185357411702, "sim_compute_robot_state-npc1": 0.008115147749582927, "sim_compute_robot_state-npc2": 0.008019279638926189, "sim_compute_robot_state-npc3": 0.008120680650075277}}
set_robot_commands_max	0.009995395342508952
set_robot_commands_mean	0.009358985265096029
set_robot_commands_median	0.009771661758422851
set_robot_commands_min	0.007980796496073405
sim_compute_performance-ego_max	0.007894102732340496
sim_compute_performance-ego_mean	0.007307928721110027
sim_compute_performance-ego_median	0.007748562494913737
sim_compute_performance-ego_min	0.0060367004076639814
sim_compute_robot_state-ego_max	0.00993467648824056
sim_compute_robot_state-ego_mean	0.009094624042510989
sim_compute_robot_state-ego_median	0.009585986932118734
sim_compute_robot_state-ego_min	0.007412139574686686
sim_compute_robot_state-npc0_max	0.009205989042917887
sim_compute_robot_state-npc0_mean	0.008605352719624836
sim_compute_robot_state-npc0_median	0.00898976723353068
sim_compute_robot_state-npc0_min	0.007237558364868164
sim_compute_robot_state-npc1_max	0.009009634653727214
sim_compute_robot_state-npc1_mean	0.008379732926686605
sim_compute_robot_state-npc1_median	0.008844367663065593
sim_compute_robot_state-npc1_min	0.00704456090927124
sim_compute_robot_state-npc2_max	0.008912572065989176
sim_compute_robot_state-npc2_mean	0.008328901449839273
sim_compute_robot_state-npc2_median	0.00883664608001709
sim_compute_robot_state-npc2_min	0.007007136344909668
sim_compute_robot_state-npc3_max	0.009160016377766929
sim_compute_robot_state-npc3_mean	0.008434238592783609
sim_compute_robot_state-npc3_median	0.00871397574742635
sim_compute_robot_state-npc3_min	0.0070342953999837235
sim_compute_sim_state_max	0.005364335378011067
sim_compute_sim_state_mean	0.005008939743041993
sim_compute_sim_state_median	0.005258158842722575
sim_compute_sim_state_min	0.004151000181833903
sim_physics_max	0.2051552907625834
sim_physics_mean	0.18813860336939495
sim_physics_median	0.1928860441843669
sim_physics_min	0.1547971192995707
sim_render-ego_max	0.013032290935516356
sim_render-ego_mean	0.01220230515797933
sim_render-ego_median	0.012868632475535074
sim_render-ego_min	0.010237078666687011
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24902

4247

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

failed

ip-172-31-35-218-10492

2019-11-04 08:13:46+00:00

2019-11-04 08:16:35+00:00

0:02:49

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 42, in on_received_get_commands
               ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
               ||   File "<string>", line 4, in __init__
               ||   File "/usr/local/lib/python3.7/dist-packages/aido_schemas/schemas.py", line 41, in __post_init__
               ||     raise ValueError(msg)
               || ValueError: Expected values to be between -1 and 1. Obtained 1.291630744934082, 0.468609094619751
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24896

4254

Manfred Diaz

baseline-IL-sim-tensorflow

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 08:01:24+00:00

2019-11-04 08:13:07+00:00

0:11:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2303784967978806
survival_time_median	6.0499999999999865
deviation-center-line_median	0.25678391010369106
in-drivable-lane_median	1.050000000000015

other stats

agent_compute-ego_max	0.03053356990341313
agent_compute-ego_mean	0.02816437671666505
agent_compute-ego_median	0.02794860601425171
agent_compute-ego_min	0.026511540779700644
deviation-center-line_max	0.8525957471156876
deviation-center-line_mean	0.34626029147702825
deviation-center-line_min	0.17011874347307485
deviation-heading_max	2.3737663288033155
deviation-heading_mean	1.199424025488024
deviation-heading_median	1.100636906749692
deviation-heading_min	0.6291568811164604
driven_any_max	3.5406386447511573
driven_any_mean	1.807532347230341
driven_any_median	1.5979076738490607
driven_any_min	1.0947112875324183
driven_lanedir_consec_max	3.1000128385843055
driven_lanedir_consec_mean	1.4560045339349397
driven_lanedir_consec_min	0.6504822349371508
driven_lanedir_max	3.111215284856618
driven_lanedir_mean	1.465652218995837
driven_lanedir_median	1.2303784967978806
driven_lanedir_min	0.6875182139693257
in-drivable-lane_max	1.2999999999999954
in-drivable-lane_mean	0.9400000000000004
in-drivable-lane_min	0.1999999999999993
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.178538487791768, "sim_physics": 0.10603867258344378, "survival_time": 4.549999999999992, "driven_lanedir": 0.6875182139693257, "sim_render-ego": 0.011614668500292432, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.026511540779700644, "deviation-heading": 1.1622903439069423, "set_robot_commands": 0.009345882541530737, "deviation-center-line": 0.18526157662256648, "driven_lanedir_consec": 0.6504822349371508, "sim_compute_sim_state": 0.0052780109447437325, "sim_compute_performance-ego": 0.007702947972895025, "sim_compute_robot_state-ego": 0.008953694458846207}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0947112875324183, "sim_physics": 0.12474573359769932, "survival_time": 4.249999999999993, "driven_lanedir": 1.0163609691889677, "sim_render-ego": 0.013184466081507066, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.028940579470466164, "deviation-heading": 0.7312696668637089, "set_robot_commands": 0.01070408821105957, "deviation-center-line": 0.26654148007012135, "driven_lanedir_consec": 1.0163609691889677, "sim_compute_sim_state": 0.005185337627635282, "sim_compute_performance-ego": 0.008223786073572496, "sim_compute_robot_state-ego": 0.010426532520967372}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.5406386447511573, "sim_physics": 0.10785096333577082, "survival_time": 13.00000000000005, "driven_lanedir": 3.111215284856618, "sim_render-ego": 0.012579732674818772, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.02794860601425171, "deviation-heading": 2.3737663288033155, "set_robot_commands": 0.00958022612791795, "deviation-center-line": 0.8525957471156876, "driven_lanedir_consec": 3.1000128385843055, "sim_compute_sim_state": 0.005083659979013297, "sim_compute_performance-ego": 0.007611284806178166, "sim_compute_robot_state-ego": 0.009319224724402794}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6258656422273, "sim_physics": 0.10454293382846244, "survival_time": 6.149999999999986, "driven_lanedir": 1.2827881301663933, "sim_render-ego": 0.012246717282427036, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0268875874154936, "deviation-heading": 1.100636906749692, "set_robot_commands": 0.00912892527696563, "deviation-center-line": 0.25678391010369106, "driven_lanedir_consec": 1.2827881301663933, "sim_compute_sim_state": 0.005197381585594115, "sim_compute_performance-ego": 0.00746500782850312, "sim_compute_robot_state-ego": 0.009012084666306411}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5979076738490607, "sim_physics": 0.1418687765263329, "survival_time": 6.0499999999999865, "driven_lanedir": 1.2303784967978806, "sim_render-ego": 0.014106557388936193, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.03053356990341313, "deviation-heading": 0.6291568811164604, "set_robot_commands": 0.011072982441295277, "deviation-center-line": 0.17011874347307485, "driven_lanedir_consec": 1.2303784967978806, "sim_compute_sim_state": 0.005984582191656444, "sim_compute_performance-ego": 0.008195205168290571, "sim_compute_robot_state-ego": 0.01058860258622603}}
set_robot_commands_max	0.011072982441295277
set_robot_commands_mean	0.009966420919753832
set_robot_commands_median	0.00958022612791795
set_robot_commands_min	0.00912892527696563
sim_compute_performance-ego_max	0.008223786073572496
sim_compute_performance-ego_mean	0.007839646369887876
sim_compute_performance-ego_median	0.007702947972895025
sim_compute_performance-ego_min	0.00746500782850312
sim_compute_robot_state-ego_max	0.01058860258622603
sim_compute_robot_state-ego_mean	0.009660027791349762
sim_compute_robot_state-ego_median	0.009319224724402794
sim_compute_robot_state-ego_min	0.008953694458846207
sim_compute_sim_state_max	0.005984582191656444
sim_compute_sim_state_mean	0.005345794465728574
sim_compute_sim_state_median	0.005197381585594115
sim_compute_sim_state_min	0.005083659979013297
sim_physics_max	0.1418687765263329
sim_physics_mean	0.11700941597434183
sim_physics_median	0.10785096333577082
sim_physics_min	0.10454293382846244
sim_render-ego_max	0.014106557388936193
sim_render-ego_mean	0.0127464283855963
sim_render-ego_median	0.012579732674818772
sim_render-ego_min	0.011614668500292432
simulation-passed	1
survival_time_max	13.00000000000005
survival_time_mean	6.8
survival_time_min	4.249999999999993

No reset possible

24883

4266

Gianmarco Bernasconi

challenge-aido_LF-baseline-duckietown

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 07:58:06+00:00

2019-11-04 08:01:17+00:00

0:03:11

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24880

4269

Riza Velioglu 🇩🇪

Uni Bielefeld

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 07:57:17+00:00

2019-11-04 07:57:50+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24876

4270

Riza Velioglu 🇩🇪

Uni Bielefeld

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 07:56:37+00:00

2019-11-04 07:57:02+00:00

0:00:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24871

4275

Riza Velioglu 🇩🇪

Uni Bielefeld

aido3-LFVI-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 07:54:26+00:00

2019-11-04 07:56:24+00:00

0:01:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24857

4298

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFVI-sim-testing

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 07:39:15+00:00

2019-11-04 07:53:58+00:00

0:14:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.018693027042207263
agent_compute-ego_mean	0.017046738263855596
agent_compute-ego_median	0.01783092498779297
agent_compute-ego_min	0.014130137183449486
deviation-center-line_max	0.5141120095458045
deviation-center-line_mean	0.17690002270053232
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.992943725008188
deviation-heading_mean	0.6929778233956081
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.534324402241835
driven_any_mean	1.3470385992234173
driven_any_median	1.001633421251193
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.4943080534418787
driven_lanedir_consec_mean	0.8813910855277101
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.4943080534418787
driven_lanedir_mean	0.8962528018383177
driven_lanedir_median	0.7206363324756618
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.13098450250263455, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.00912398929837384, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.018509279323529592, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0071077014826521085, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.003712035432646546, "sim_compute_performance-ego": 0.005204194708715511, "sim_compute_robot_state-ego": 0.0066988468170166016, "sim_compute_robot_state-npc0": 0.006358955479875396, "sim_compute_robot_state-npc1": 0.005985030645056616, "sim_compute_robot_state-npc2": 0.006096489821808247, "sim_compute_robot_state-npc3": 0.00603096998190578}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.11704874038696288, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.007874505860464913, "in-drivable-lane": 0, "agent_compute-ego": 0.014895175184522356, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.005358670439038958, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.003119775227137974, "sim_compute_performance-ego": 0.00430983304977417, "sim_compute_robot_state-ego": 0.0054746440478733605, "sim_compute_robot_state-npc0": 0.005329038415636335, "sim_compute_robot_state-npc1": 0.005107828548976353, "sim_compute_robot_state-npc2": 0.005094936915806362, "sim_compute_robot_state-npc3": 0.005071776253836495}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.12961852203295068, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.008708254804888975, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.015959283680591768, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.006638195908185348, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.003478297909486641, "sim_compute_performance-ego": 0.004977054966306223, "sim_compute_robot_state-ego": 0.006473457929000114, "sim_compute_robot_state-npc0": 0.005978359759432598, "sim_compute_robot_state-npc1": 0.005845956432009206, "sim_compute_robot_state-npc2": 0.0058105385419234485, "sim_compute_robot_state-npc3": 0.005764320058730042}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.13960511982440948, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.008898928761482239, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.015736937522888184, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.006673018137613933, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.003286158045132955, "sim_compute_performance-ego": 0.005085185170173645, "sim_compute_robot_state-ego": 0.006379107634226481, "sim_compute_robot_state-npc0": 0.0061236123243967695, "sim_compute_robot_state-npc1": 0.005991404255231221, "sim_compute_robot_state-npc2": 0.005809461077054341, "sim_compute_robot_state-npc3": 0.005727489789326985}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1355805624099005, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.009491818291800362, "in-drivable-lane": 0, "agent_compute-ego": 0.018693027042207263, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.0071766262962704615, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.00389574822925386, "sim_compute_performance-ego": 0.005669412158784412, "sim_compute_robot_state-ego": 0.006716262726556687, "sim_compute_robot_state-npc0": 0.006413096473330543, "sim_compute_robot_state-npc1": 0.006165629341488793, "sim_compute_robot_state-npc2": 0.0064047518230619885, "sim_compute_robot_state-npc3": 0.006835676374889556}, "udem1-5-0": {"driven_any": 3.534324402241835, "sim_physics": 0.1327418838432449, "survival_time": 8.349999999999984, "driven_lanedir": 2.4943080534418787, "sim_render-ego": 0.00828607781918463, "in-drivable-lane": 2, "agent_compute-ego": 0.01804872187311778, "deviation-heading": 1.992943725008188, "set_robot_commands": 0.006286746727492281, "deviation-center-line": 0.5141120095458045, "driven_lanedir_consec": 2.4943080534418787, "sim_compute_sim_state": 0.0034835567017515263, "sim_compute_performance-ego": 0.004760886380772391, "sim_compute_robot_state-ego": 0.005996801182181535, "sim_compute_robot_state-npc0": 0.005824548755577225, "sim_compute_robot_state-npc1": 0.005603262050423079, "sim_compute_robot_state-npc2": 0.005587824804340294, "sim_compute_robot_state-npc3": 0.005629395296473703}, "udem1-6-0": {"driven_any": 2.1760405509894407, "sim_physics": 0.13009562075716777, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.0077613025035672975, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01449115068009756, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.005717883989648911, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.0030977193591664137, "sim_compute_performance-ego": 0.004294228785246322, "sim_compute_robot_state-ego": 0.005501927681339597, "sim_compute_robot_state-npc0": 0.005247710977943198, "sim_compute_robot_state-npc1": 0.0051069074464075775, "sim_compute_robot_state-npc2": 0.00506556844248355, "sim_compute_robot_state-npc3": 0.005068966485921619}, "udem1-7-0": {"driven_any": 1.0050236108346402, "sim_physics": 0.1625216817855835, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684152, "sim_render-ego": 0.009993963241577149, "in-drivable-lane": 0, "agent_compute-ego": 0.01783092498779297, "deviation-heading": 0.9227446658975218, "set_robot_commands": 0.007140154838562012, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.0037032222747802736, "sim_compute_performance-ego": 0.005598306655883789, "sim_compute_robot_state-ego": 0.006662802696228027, "sim_compute_robot_state-npc0": 0.00668548583984375, "sim_compute_robot_state-npc1": 0.006477222442626953, "sim_compute_robot_state-npc2": 0.006309661865234375, "sim_compute_robot_state-npc3": 0.006340875625610352}, "udem1-8-0": {"driven_any": 0.997041660301958, "sim_physics": 0.13266177360828108, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.00947270943568303, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01810726294150719, "deviation-heading": 0.6817155913229234, "set_robot_commands": 0.006714247740232027, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.00384069406069242, "sim_compute_performance-ego": 0.005435297122368446, "sim_compute_robot_state-ego": 0.006534177523392897, "sim_compute_robot_state-npc0": 0.006322448070232685, "sim_compute_robot_state-npc1": 0.006545566595517672, "sim_compute_robot_state-npc2": 0.0064111856313852165, "sim_compute_robot_state-npc3": 0.006398443992321308}, "udem1-9-0": {"driven_any": 0.43749987104723, "sim_physics": 0.17116197255941537, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.009323358535766602, "in-drivable-lane": 0, "agent_compute-ego": 0.018331050872802734, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.0068237598125751205, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.003834064190204327, "sim_compute_performance-ego": 0.005330773500295786, "sim_compute_robot_state-ego": 0.006305630390460675, "sim_compute_robot_state-npc0": 0.00599820797259991, "sim_compute_robot_state-npc1": 0.005964545103219839, "sim_compute_robot_state-npc2": 0.005772939095130334, "sim_compute_robot_state-npc3": 0.005938043961158166}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.10923259908502753, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.007245508107272061, "in-drivable-lane": 0, "agent_compute-ego": 0.014130137183449486, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.004914706403558905, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.0029479807073419743, "sim_compute_performance-ego": 0.003941676833412864, "sim_compute_robot_state-ego": 0.005050615830854936, "sim_compute_robot_state-npc0": 0.004805749112909491, "sim_compute_robot_state-npc1": 0.004651470617814498, "sim_compute_robot_state-npc2": 0.00464519587430087, "sim_compute_robot_state-npc3": 0.004679159684614701}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.11031588554382324, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756618, "sim_render-ego": 0.007378273010253907, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.016821093559265136, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.005433011054992676, "deviation-center-line": 0.16567670185555416, "driven_lanedir_consec": 0.718507549745529, "sim_compute_sim_state": 0.0030703163146972657, "sim_compute_performance-ego": 0.004084310531616211, "sim_compute_robot_state-ego": 0.0052281713485717776, "sim_compute_robot_state-npc0": 0.005120134353637696, "sim_compute_robot_state-npc1": 0.00498537540435791, "sim_compute_robot_state-npc2": 0.004986147880554199, "sim_compute_robot_state-npc3": 0.004948463439941406}, "udem1-12-0": {"driven_any": 1.9646878702534365, "sim_physics": 0.13063285959527848, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.008342851983739975, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.017622148736994317, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.006286676893842981, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.003377967692436056, "sim_compute_performance-ego": 0.004681518737305986, "sim_compute_robot_state-ego": 0.005918794489921408, "sim_compute_robot_state-npc0": 0.005757806148934871, "sim_compute_robot_state-npc1": 0.005675452820798184, "sim_compute_robot_state-npc2": 0.005809781399179012, "sim_compute_robot_state-npc3": 0.005558300525584119}, "udem1-13-0": {"driven_any": 1.001633421251193, "sim_physics": 0.1352465427838839, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.009874009169065036, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.01833544786159809, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.007450277988727276, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.003782336528484638, "sim_compute_performance-ego": 0.005611305053417499, "sim_compute_robot_state-ego": 0.006938540018521822, "sim_compute_robot_state-npc0": 0.007178856776310847, "sim_compute_robot_state-npc1": 0.0068059563636779785, "sim_compute_robot_state-npc2": 0.006492179173689622, "sim_compute_robot_state-npc3": 0.006520812328045185}, "udem1-14-0": {"driven_any": 2.218769782727205, "sim_physics": 0.13767221541631788, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433687, "sim_render-ego": 0.009387390954153878, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.01818943250746954, "deviation-heading": 1.7163026916317137, "set_robot_commands": 0.006767849695114863, "deviation-center-line": 0.2412693316050378, "driven_lanedir_consec": 0.6077880672015876, "sim_compute_sim_state": 0.003994578406924293, "sim_compute_performance-ego": 0.005335215159824916, "sim_compute_robot_state-ego": 0.006659319287254697, "sim_compute_robot_state-npc0": 0.006815444855462937, "sim_compute_robot_state-npc1": 0.006464613051641555, "sim_compute_robot_state-npc2": 0.006368918645949591, "sim_compute_robot_state-npc3": 0.006410081045968192}}
set_robot_commands_max	0.007450277988727276
set_robot_commands_mean	0.00643263516056719
set_robot_commands_median	0.006673018137613933
set_robot_commands_min	0.004914706403558905
sim_compute_performance-ego_max	0.005669412158784412
sim_compute_performance-ego_mean	0.004954613254259879
sim_compute_performance-ego_median	0.005085185170173645
sim_compute_performance-ego_min	0.003941676833412864
sim_compute_robot_state-ego_max	0.006938540018521822
sim_compute_robot_state-ego_mean	0.006169273306893375
sim_compute_robot_state-ego_median	0.006379107634226481
sim_compute_robot_state-ego_min	0.005050615830854936
sim_compute_robot_state-npc0_max	0.007178856776310847
sim_compute_robot_state-npc0_mean	0.0059972970210749495
sim_compute_robot_state-npc0_median	0.00599820797259991
sim_compute_robot_state-npc0_min	0.004805749112909491
sim_compute_robot_state-npc1_max	0.0068059563636779785
sim_compute_robot_state-npc1_mean	0.005825081407949828
sim_compute_robot_state-npc1_median	0.005964545103219839
sim_compute_robot_state-npc1_min	0.004651470617814498
sim_compute_robot_state-npc2_max	0.006492179173689622
sim_compute_robot_state-npc2_mean	0.005777705399460095
sim_compute_robot_state-npc2_median	0.005809781399179012
sim_compute_robot_state-npc2_min	0.00464519587430087
sim_compute_robot_state-npc3_max	0.006835676374889556
sim_compute_robot_state-npc3_mean	0.005794851656288507
sim_compute_robot_state-npc3_median	0.005764320058730042
sim_compute_robot_state-npc3_min	0.004679159684614701
sim_compute_sim_state_max	0.003994578406924293
sim_compute_sim_state_mean	0.0035082967386758108
sim_compute_sim_state_median	0.0034835567017515263
sim_compute_sim_state_min	0.0029479807073419743
sim_physics_max	0.17116197255941537
sim_physics_mean	0.1336746988089921
sim_physics_median	0.13266177360828108
sim_physics_min	0.10923259908502753
sim_render-ego_max	0.009993963241577149
sim_render-ego_mean	0.008744196118484928
sim_render-ego_median	0.008898928761482239
sim_render-ego_min	0.007245508107272061
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

24853

4302

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 07:35:46+00:00

2019-11-04 07:39:02+00:00

0:03:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6856800730956207
survival_time_median	2.000000000000001
deviation-center-line_median	0.08877415228107144
in-drivable-lane_median	0.1499999999999997

other stats

agent_compute-ego_max	0.02698937329378995
agent_compute-ego_mean	0.02299051524089692
agent_compute-ego_median	0.022720761415435047
agent_compute-ego_min	0.01949763298034668
deviation-center-line_max	0.2115306175656672
deviation-center-line_mean	0.11899130923898212
deviation-center-line_min	0.07142284970145178
deviation-heading_max	0.5268865240013682
deviation-heading_mean	0.3101645507734078
deviation-heading_median	0.3145505780820485
deviation-heading_min	0.17790279511896667
driven_any_max	1.5996546887300096
driven_any_mean	0.8746240139617669
driven_any_median	0.9996632207705848
driven_any_min	0.28362940600638153
driven_lanedir_consec_max	1.1449045921439405
driven_lanedir_consec_mean	0.68342876512105
driven_lanedir_consec_min	0.275488859799796
driven_lanedir_max	1.1449045921439405
driven_lanedir_mean	0.68342876512105
driven_lanedir_median	0.6856800730956207
driven_lanedir_min	0.275488859799796
in-drivable-lane_max	0.7499999999999973
in-drivable-lane_mean	0.26999999999999946
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.08333858847618103, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.010250139236450196, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.02342808246612549, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.007354313135147094, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.004146432876586914, "sim_compute_performance-ego": 0.006312638521194458, "sim_compute_robot_state-ego": 0.007167154550552368}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0296612854712826, "sim_physics": 0.07377206406942229, "survival_time": 2.0500000000000007, "driven_lanedir": 0.8723011611746517, "sim_render-ego": 0.012370353791771866, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.022720761415435047, "deviation-heading": 0.5268865240013682, "set_robot_commands": 0.007473625787874547, "deviation-center-line": 0.1481817317993273, "driven_lanedir_consec": 0.8723011611746517, "sim_compute_sim_state": 0.003745125561225705, "sim_compute_performance-ego": 0.005328126069976062, "sim_compute_robot_state-ego": 0.006880766007958389}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28362940600638153, "sim_physics": 0.08292107284069061, "survival_time": 0.8000000000000002, "driven_lanedir": 0.275488859799796, "sim_render-ego": 0.009041503071784971, "in-drivable-lane": 0, "agent_compute-ego": 0.01949763298034668, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.006570354104042053, "deviation-center-line": 0.07504719484739283, "driven_lanedir_consec": 0.275488859799796, "sim_compute_sim_state": 0.0035309195518493652, "sim_compute_performance-ego": 0.0052581727504730225, "sim_compute_robot_state-ego": 0.00703449547290802}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4605114688305756, "sim_physics": 0.10850489139556883, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43876913939124096, "sim_render-ego": 0.01136535947973078, "in-drivable-lane": 0, "agent_compute-ego": 0.02698937329378995, "deviation-heading": 0.3393674233921455, "set_robot_commands": 0.009381424296985972, "deviation-center-line": 0.07142284970145178, "driven_lanedir_consec": 0.43876913939124096, "sim_compute_sim_state": 0.004619067365472967, "sim_compute_performance-ego": 0.006641832264986905, "sim_compute_robot_state-ego": 0.008255926045504484}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5996546887300096, "sim_physics": 0.07432778676350911, "survival_time": 2.9999999999999973, "driven_lanedir": 1.1449045921439405, "sim_render-ego": 0.009621957937876385, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.02231672604878743, "deviation-heading": 0.17790279511896667, "set_robot_commands": 0.0073716958363850916, "deviation-center-line": 0.2115306175656672, "driven_lanedir_consec": 1.1449045921439405, "sim_compute_sim_state": 0.0039004842440287274, "sim_compute_performance-ego": 0.00545658270517985, "sim_compute_robot_state-ego": 0.007087945938110352}}
set_robot_commands_max	0.009381424296985972
set_robot_commands_mean	0.007630282632086952
set_robot_commands_median	0.0073716958363850916
set_robot_commands_min	0.006570354104042053
sim_compute_performance-ego_max	0.006641832264986905
sim_compute_performance-ego_mean	0.005799470462362059
sim_compute_performance-ego_median	0.00545658270517985
sim_compute_performance-ego_min	0.0052581727504730225
sim_compute_robot_state-ego_max	0.008255926045504484
sim_compute_robot_state-ego_mean	0.007285257603006723
sim_compute_robot_state-ego_median	0.007087945938110352
sim_compute_robot_state-ego_min	0.006880766007958389
sim_compute_sim_state_max	0.004619067365472967
sim_compute_sim_state_mean	0.003988405919832736
sim_compute_sim_state_median	0.0039004842440287274
sim_compute_sim_state_min	0.0035309195518493652
sim_physics_max	0.10850489139556883
sim_physics_mean	0.08457288070907437
sim_physics_median	0.08292107284069061
sim_physics_min	0.07377206406942229
sim_render-ego_max	0.012370353791771866
sim_render-ego_mean	0.01052986270352284
sim_render-ego_median	0.010250139236450196
sim_render-ego_min	0.009041503071784971
simulation-passed	1
survival_time_max	2.9999999999999973
survival_time_mean	1.7899999999999998
survival_time_min	0.8000000000000002

No reset possible

24851

4305

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 07:31:08+00:00

2019-11-04 07:35:28+00:00

0:04:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6856800730956207
survival_time_median	2.000000000000001
deviation-center-line_median	0.08877415228107144
in-drivable-lane_median	0.4500000000000002

other stats

agent_compute-ego_max	0.022909653186798096
agent_compute-ego_mean	0.02227385405338172
agent_compute-ego_median	0.022532558441162108
agent_compute-ego_min	0.021547186374664302
deviation-center-line_max	0.11803708647411268
deviation-center-line_mean	0.09185657022323757
deviation-center-line_min	0.06073337098493198
deviation-heading_max	0.3681646786246837
deviation-heading_mean	0.3023908956024058
deviation-heading_median	0.28606528190679475
deviation-heading_min	0.2638670899443274
driven_any_max	1.59965468873004
driven_any_mean	1.0121135123884497
driven_any_median	0.9996632207705848
driven_any_min	0.4010834948810249
driven_lanedir_consec_max	1.2187176370157662
driven_lanedir_consec_mean	0.7889876883841616
driven_lanedir_consec_min	0.3872027169265986
driven_lanedir_max	1.2187176370157662
driven_lanedir_mean	0.7889876883841616
driven_lanedir_median	0.6856800730956207
driven_lanedir_min	0.3872027169265986
in-drivable-lane_max	0.5999999999999979
in-drivable-lane_mean	0.3299999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.11621991991996763, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.009889250993728638, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.022909653186798096, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.006964892148971558, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.003632378578186035, "sim_compute_performance-ego": 0.005685001611709595, "sim_compute_robot_state-ego": 0.0071974992752075195, "sim_compute_robot_state-npc0": 0.006454610824584961, "sim_compute_robot_state-npc1": 0.006021147966384888, "sim_compute_robot_state-npc2": 0.00618511438369751, "sim_compute_robot_state-npc3": 0.006153386831283569}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4605114688305785, "sim_physics": 0.15973261269656094, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495812661747424, "sim_render-ego": 0.01045768911188299, "in-drivable-lane": 0, "agent_compute-ego": 0.02262315966866233, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.0070850740779529915, "deviation-center-line": 0.0772648215662309, "driven_lanedir_consec": 0.43495812661747424, "sim_compute_sim_state": 0.004089420491998846, "sim_compute_performance-ego": 0.0056180520491166544, "sim_compute_robot_state-ego": 0.006913878700949929, "sim_compute_robot_state-npc0": 0.00689000433141535, "sim_compute_robot_state-npc1": 0.006146246736699884, "sim_compute_robot_state-npc2": 0.0068038268522782755, "sim_compute_robot_state-npc3": 0.007494536313143643}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.599654688730019, "sim_physics": 0.15631874402364096, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.00955283244450887, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.021547186374664302, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.007271154721577963, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.0037493348121643063, "sim_compute_performance-ego": 0.005323131879170735, "sim_compute_robot_state-ego": 0.006734379132588704, "sim_compute_robot_state-npc0": 0.006611243883768717, "sim_compute_robot_state-npc1": 0.006353859106699626, "sim_compute_robot_state-npc2": 0.006672453880310058, "sim_compute_robot_state-npc3": 0.006458842754364013}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59965468873004, "sim_physics": 0.15171186923980712, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2187176370157662, "sim_render-ego": 0.009292328357696533, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.021756712595621744, "deviation-heading": 0.2793068494541745, "set_robot_commands": 0.0069669564565022785, "deviation-center-line": 0.11447341980984076, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.004017297426859538, "sim_compute_performance-ego": 0.005489285786946615, "sim_compute_robot_state-ego": 0.007027153174082438, "sim_compute_robot_state-npc0": 0.006609594821929932, "sim_compute_robot_state-npc1": 0.006511521339416504, "sim_compute_robot_state-npc2": 0.006754887104034424, "sim_compute_robot_state-npc3": 0.0066215753555297855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810249, "sim_physics": 0.12249995470046995, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3872027169265986, "sim_render-ego": 0.009425652027130128, "in-drivable-lane": 0, "agent_compute-ego": 0.022532558441162108, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.0084023118019104, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3872027169265986, "sim_compute_sim_state": 0.003741347789764405, "sim_compute_performance-ego": 0.005752837657928467, "sim_compute_robot_state-ego": 0.007462418079376221, "sim_compute_robot_state-npc0": 0.007595515251159668, "sim_compute_robot_state-npc1": 0.0072209715843200685, "sim_compute_robot_state-npc2": 0.007085812091827392, "sim_compute_robot_state-npc3": 0.00634695291519165}}
set_robot_commands_max	0.0084023118019104
set_robot_commands_mean	0.007338077841383038
set_robot_commands_median	0.0070850740779529915
set_robot_commands_min	0.006964892148971558
sim_compute_performance-ego_max	0.005752837657928467
sim_compute_performance-ego_mean	0.005573661796974413
sim_compute_performance-ego_median	0.0056180520491166544
sim_compute_performance-ego_min	0.005323131879170735
sim_compute_robot_state-ego_max	0.007462418079376221
sim_compute_robot_state-ego_mean	0.007067065672440961
sim_compute_robot_state-ego_median	0.007027153174082438
sim_compute_robot_state-ego_min	0.006734379132588704
sim_compute_robot_state-npc0_max	0.007595515251159668
sim_compute_robot_state-npc0_mean	0.006832193822571725
sim_compute_robot_state-npc0_median	0.006611243883768717
sim_compute_robot_state-npc0_min	0.006454610824584961
sim_compute_robot_state-npc1_max	0.0072209715843200685
sim_compute_robot_state-npc1_mean	0.006450749346704194
sim_compute_robot_state-npc1_median	0.006353859106699626
sim_compute_robot_state-npc1_min	0.006021147966384888
sim_compute_robot_state-npc2_max	0.007085812091827392
sim_compute_robot_state-npc2_mean	0.006700418862429532
sim_compute_robot_state-npc2_median	0.006754887104034424
sim_compute_robot_state-npc2_min	0.00618511438369751
sim_compute_robot_state-npc3_max	0.007494536313143643
sim_compute_robot_state-npc3_mean	0.006615058833902532
sim_compute_robot_state-npc3_median	0.006458842754364013
sim_compute_robot_state-npc3_min	0.006153386831283569
sim_compute_sim_state_max	0.004089420491998846
sim_compute_sim_state_mean	0.003845955819794626
sim_compute_sim_state_median	0.0037493348121643063
sim_compute_sim_state_min	0.003632378578186035
sim_physics_max	0.15973261269656094
sim_physics_mean	0.14129662011608932
sim_physics_median	0.15171186923980712
sim_physics_min	0.11621991991996763
sim_render-ego_max	0.01045768911188299
sim_render-ego_mean	0.009723550586989432
sim_render-ego_median	0.00955283244450887
sim_render-ego_min	0.009292328357696533
simulation-passed	1
survival_time_max	2.9999999999999973
survival_time_mean	2.019999999999999
survival_time_min	1.0000000000000002

No reset possible

24849

4307

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 07:23:42+00:00

2019-11-04 07:30:32+00:00

0:06:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5636399177084477
survival_time_median	2.9499999999999975
deviation-center-line_median	0.19417316650714284
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.02529642137430482
agent_compute-ego_mean	0.02213425635276218
agent_compute-ego_median	0.02181527584413939
agent_compute-ego_min	0.020420637997713955
deviation-center-line_max	0.27212935355303575
deviation-center-line_mean	0.1659879300685689
deviation-center-line_min	0.060733287044270105
deviation-heading_max	0.3681646786246837
deviation-heading_mean	0.2857346549044181
deviation-heading_median	0.2652784439875202
deviation-heading_min	0.2528567413804248
driven_any_max	2.7696546371463566
driven_any_mean	1.474111788433791
driven_any_median	1.5696547037668402
driven_any_min	0.4010834948810282
driven_lanedir_consec_max	1.9242206205397283
driven_lanedir_consec_mean	1.2102809057090995
driven_lanedir_consec_min	0.38720104799654376
driven_lanedir_max	1.924267585170248
driven_lanedir_mean	1.2103413601562374
driven_lanedir_median	1.5638383114510817
driven_lanedir_min	0.38720104799654376
in-drivable-lane_max	1.399999999999995
in-drivable-lane_mean	0.4199999999999985
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5696547037668402, "sim_physics": 0.16318141403844802, "survival_time": 2.9499999999999975, "driven_lanedir": 1.5638383114510817, "sim_render-ego": 0.011346873590501688, "in-drivable-lane": 0, "agent_compute-ego": 0.02529642137430482, "deviation-heading": 0.2528567413804248, "set_robot_commands": 0.008541628465814105, "deviation-center-line": 0.19417316650714284, "driven_lanedir_consec": 1.5636399177084477, "sim_compute_sim_state": 0.004421755418939106, "sim_compute_performance-ego": 0.006332797519231247, "sim_compute_robot_state-ego": 0.007869902303663351, "sim_compute_robot_state-npc0": 0.007419509402776169, "sim_compute_robot_state-npc1": 0.007169925560385494, "sim_compute_robot_state-npc2": 0.007308628599522478, "sim_compute_robot_state-npc3": 0.007255150099932137}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.13843591646714645, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.009345943277532404, "in-drivable-lane": 0, "agent_compute-ego": 0.020420637997713955, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.007265968756242232, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.004309350794011896, "sim_compute_performance-ego": 0.005335677753795277, "sim_compute_robot_state-ego": 0.0067421631379560995, "sim_compute_robot_state-npc0": 0.006611997430974787, "sim_compute_robot_state-npc1": 0.00594152103770863, "sim_compute_robot_state-npc2": 0.006049340421503241, "sim_compute_robot_state-npc3": 0.006761160763827237}, "udem1-2-0": {"driven_any": 2.1696546375441614, "sim_physics": 0.14585344399077982, "survival_time": 3.949999999999994, "driven_lanedir": 1.7414407758715231, "sim_render-ego": 0.01007317893112762, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.02181527584413939, "deviation-heading": 0.2785063205851342, "set_robot_commands": 0.007233414468885977, "deviation-center-line": 0.22563902167216496, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.003733342206930813, "sim_compute_performance-ego": 0.005584245995630192, "sim_compute_robot_state-ego": 0.0069373559348190885, "sim_compute_robot_state-npc0": 0.006804402870467946, "sim_compute_robot_state-npc1": 0.006497748290436177, "sim_compute_robot_state-npc2": 0.0065995107723187795, "sim_compute_robot_state-npc3": 0.00625222242331203}, "udem1-3-0": {"driven_any": 2.7696546371463566, "sim_physics": 0.13776261156255548, "survival_time": 4.94999999999999, "driven_lanedir": 1.924267585170248, "sim_render-ego": 0.00929958892591072, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.021967555537368313, "deviation-heading": 0.2652784439875202, "set_robot_commands": 0.007420200290101947, "deviation-center-line": 0.27212935355303575, "driven_lanedir_consec": 1.9242206205397283, "sim_compute_sim_state": 0.003767762521300653, "sim_compute_performance-ego": 0.005276311527598988, "sim_compute_robot_state-ego": 0.0065304462355796735, "sim_compute_robot_state-npc0": 0.006887057814935241, "sim_compute_robot_state-npc1": 0.006584075966266671, "sim_compute_robot_state-npc2": 0.006592707200483842, "sim_compute_robot_state-npc3": 0.0063811986133305715}, "udem1-4-0": {"driven_any": 0.4010834948810282, "sim_physics": 0.14618253707885742, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38720104799654376, "sim_render-ego": 0.00975440740585327, "in-drivable-lane": 0, "agent_compute-ego": 0.021171391010284424, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.007103526592254638, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38720104799654376, "sim_compute_sim_state": 0.004106247425079345, "sim_compute_performance-ego": 0.004917418956756592, "sim_compute_robot_state-ego": 0.006403732299804688, "sim_compute_robot_state-npc0": 0.007376718521118164, "sim_compute_robot_state-npc1": 0.007438528537750244, "sim_compute_robot_state-npc2": 0.007022738456726074, "sim_compute_robot_state-npc3": 0.007241153717041015}}
set_robot_commands_max	0.008541628465814105
set_robot_commands_mean	0.00751294771465978
set_robot_commands_median	0.007265968756242232
set_robot_commands_min	0.007103526592254638
sim_compute_performance-ego_max	0.006332797519231247
sim_compute_performance-ego_mean	0.005489290350602459
sim_compute_performance-ego_median	0.005335677753795277
sim_compute_performance-ego_min	0.004917418956756592
sim_compute_robot_state-ego_max	0.007869902303663351
sim_compute_robot_state-ego_mean	0.006896719982364579
sim_compute_robot_state-ego_median	0.0067421631379560995
sim_compute_robot_state-ego_min	0.006403732299804688
sim_compute_robot_state-npc0_max	0.007419509402776169
sim_compute_robot_state-npc0_mean	0.007019937208054462
sim_compute_robot_state-npc0_median	0.006887057814935241
sim_compute_robot_state-npc0_min	0.006611997430974787
sim_compute_robot_state-npc1_max	0.007438528537750244
sim_compute_robot_state-npc1_mean	0.006726359878509444
sim_compute_robot_state-npc1_median	0.006584075966266671
sim_compute_robot_state-npc1_min	0.00594152103770863
sim_compute_robot_state-npc2_max	0.007308628599522478
sim_compute_robot_state-npc2_mean	0.0067145850901108835
sim_compute_robot_state-npc2_median	0.0065995107723187795
sim_compute_robot_state-npc2_min	0.006049340421503241
sim_compute_robot_state-npc3_max	0.007255150099932137
sim_compute_robot_state-npc3_mean	0.006778177123488598
sim_compute_robot_state-npc3_median	0.006761160763827237
sim_compute_robot_state-npc3_min	0.00625222242331203
sim_compute_sim_state_max	0.004421755418939106
sim_compute_sim_state_mean	0.004067691673252364
sim_compute_sim_state_median	0.004106247425079345
sim_compute_sim_state_min	0.003733342206930813
sim_physics_max	0.16318141403844802
sim_physics_mean	0.14628318462755746
sim_physics_median	0.14585344399077982
sim_physics_min	0.13776261156255548
sim_render-ego_max	0.011346873590501688
sim_render-ego_mean	0.00996399842618514
sim_render-ego_median	0.00975440740585327
sim_render-ego_min	0.00929958892591072
simulation-passed	1
survival_time_max	4.94999999999999
survival_time_mean	2.7899999999999965
survival_time_min	1.0000000000000002

No reset possible

24844

4318

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 07:18:29+00:00

2019-11-04 07:23:34+00:00

0:05:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.018752288818359376
agent_compute-ego_mean	0.01817900465988766
agent_compute-ego_median	0.018614157250053005
agent_compute-ego_min	0.0165615302545053
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1265175655253199
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599271
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811225
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589055
driven_any_mean	1.0272530755098268
driven_any_median	1.0243289631429704
driven_any_min	0.4119037580118985
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.11241279266498706, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.00945056367803503, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0165615302545053, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007308143156546133, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0037480769334016025, "sim_compute_performance-ego": 0.005552671573780201, "sim_compute_robot_state-ego": 0.007068188102157028, "sim_compute_robot_state-npc0": 0.006650915852299443, "sim_compute_robot_state-npc1": 0.006273437429357458, "sim_compute_robot_state-npc2": 0.006392986686141403, "sim_compute_robot_state-npc3": 0.006279958619011773}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.15433857917785646, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.010984706878662109, "in-drivable-lane": 0, "agent_compute-ego": 0.018752288818359376, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.007883453369140625, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.004271793365478516, "sim_compute_performance-ego": 0.005645904541015625, "sim_compute_robot_state-ego": 0.007530403137207031, "sim_compute_robot_state-npc0": 0.007433462142944336, "sim_compute_robot_state-npc1": 0.007083063125610352, "sim_compute_robot_state-npc2": 0.007085371017456055, "sim_compute_robot_state-npc3": 0.006562337875366211}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1442398177950006, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.009758064621373227, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.018614157250053005, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.007128169662074039, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.004140590366564299, "sim_compute_performance-ego": 0.00565836931529798, "sim_compute_robot_state-ego": 0.006954654266959743, "sim_compute_robot_state-npc0": 0.007060458785609195, "sim_compute_robot_state-npc1": 0.006645657514270984, "sim_compute_robot_state-npc2": 0.0068545655200355935, "sim_compute_robot_state-npc3": 0.006723272173028243}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.14000831374639197, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.008963201619401763, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.018637503249735773, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007280980484395088, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.003461934343169007, "sim_compute_performance-ego": 0.004847786094568953, "sim_compute_robot_state-ego": 0.00616254384004617, "sim_compute_robot_state-npc0": 0.006214259546014327, "sim_compute_robot_state-npc1": 0.006169153165213669, "sim_compute_robot_state-npc2": 0.006110369404659996, "sim_compute_robot_state-npc3": 0.006071181236943112}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.12852328164236887, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.009742183344704764, "in-drivable-lane": 0, "agent_compute-ego": 0.01832954372678484, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.007099338940211705, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.003637799194880894, "sim_compute_performance-ego": 0.0053612334387643, "sim_compute_robot_state-ego": 0.006729722023010254, "sim_compute_robot_state-npc0": 0.006499511854989188, "sim_compute_robot_state-npc1": 0.006271192005702427, "sim_compute_robot_state-npc2": 0.006084552833012172, "sim_compute_robot_state-npc3": 0.005945665495736259}}
set_robot_commands_max	0.007883453369140625
set_robot_commands_mean	0.007340017122473517
set_robot_commands_median	0.007280980484395088
set_robot_commands_min	0.007099338940211705
sim_compute_performance-ego_max	0.00565836931529798
sim_compute_performance-ego_mean	0.005413192992685412
sim_compute_performance-ego_median	0.005552671573780201
sim_compute_performance-ego_min	0.004847786094568953
sim_compute_robot_state-ego_max	0.007530403137207031
sim_compute_robot_state-ego_mean	0.006889102273876045
sim_compute_robot_state-ego_median	0.006954654266959743
sim_compute_robot_state-ego_min	0.00616254384004617
sim_compute_robot_state-npc0_max	0.007433462142944336
sim_compute_robot_state-npc0_mean	0.006771721636371297
sim_compute_robot_state-npc0_median	0.006650915852299443
sim_compute_robot_state-npc0_min	0.006214259546014327
sim_compute_robot_state-npc1_max	0.007083063125610352
sim_compute_robot_state-npc1_mean	0.006488500648030979
sim_compute_robot_state-npc1_median	0.006273437429357458
sim_compute_robot_state-npc1_min	0.006169153165213669
sim_compute_robot_state-npc2_max	0.007085371017456055
sim_compute_robot_state-npc2_mean	0.006505569092261044
sim_compute_robot_state-npc2_median	0.006392986686141403
sim_compute_robot_state-npc2_min	0.006084552833012172
sim_compute_robot_state-npc3_max	0.006723272173028243
sim_compute_robot_state-npc3_mean	0.00631648308001712
sim_compute_robot_state-npc3_median	0.006279958619011773
sim_compute_robot_state-npc3_min	0.005945665495736259
sim_compute_sim_state_max	0.004271793365478516
sim_compute_sim_state_mean	0.003852038840698864
sim_compute_sim_state_median	0.0037480769334016025
sim_compute_sim_state_min	0.003461934343169007
sim_physics_max	0.15433857917785646
sim_physics_mean	0.135904557005321
sim_physics_median	0.14000831374639197
sim_physics_min	0.11241279266498706
sim_render-ego_max	0.010984706878662109
sim_render-ego_mean	0.00977974402843538
sim_render-ego_median	0.009742183344704764
sim_render-ego_min	0.008963201619401763
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24839

4342

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 07:05:54+00:00

2019-11-04 07:18:02+00:00

0:12:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.014017604655601
survival_time_median	6.849999999999984
deviation-center-line_median	0.6010789048634749
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.04309821878589174
agent_compute-ego_mean	0.03150305146326345
agent_compute-ego_median	0.024959421157836913
agent_compute-ego_min	0.023431519667307537
deviation-center-line_max	0.6633441677275717
deviation-center-line_mean	0.4878072562899665
deviation-center-line_min	0.1577778724845263
deviation-heading_max	4.010859623610714
deviation-heading_mean	1.7039166942071389
deviation-heading_median	1.2351578034295916
deviation-heading_min	0.6927698098887946
driven_any_max	2.349009009361366
driven_any_mean	1.2466084276593268
driven_any_median	1.0472731623075595
driven_any_min	0.5815497127363741
driven_lanedir_consec_max	2.2327466342351316
driven_lanedir_consec_mean	1.1670938750606514
driven_lanedir_consec_min	0.47312426187503087
driven_lanedir_max	2.2327466342351316
driven_lanedir_mean	1.1670938750606514
driven_lanedir_median	1.014017604655601
driven_lanedir_min	0.47312426187503087
in-drivable-lane_max	0.4999999999999982
in-drivable-lane_mean	0.14999999999999947
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5815497127363741, "sim_physics": 0.15476734936237335, "survival_time": 3.999999999999994, "driven_lanedir": 0.47312426187503087, "sim_render-ego": 0.010747596621513368, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.024959421157836913, "deviation-heading": 1.2351578034295916, "set_robot_commands": 0.009503263235092162, "deviation-center-line": 0.1577778724845263, "driven_lanedir_consec": 0.47312426187503087, "sim_compute_sim_state": 0.004243117570877075, "sim_compute_performance-ego": 0.006255596876144409, "sim_compute_robot_state-ego": 0.007944521307945252, "sim_compute_robot_state-npc0": 0.00799955427646637, "sim_compute_robot_state-npc1": 0.007252389192581176, "sim_compute_robot_state-npc2": 0.007129472494125366, "sim_compute_robot_state-npc3": 0.007084596157073975}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.349009009361366, "sim_physics": 0.1499562398592631, "survival_time": 14.950000000000076, "driven_lanedir": 2.2327466342351316, "sim_render-ego": 0.010456720193227131, "in-drivable-lane": 0, "agent_compute-ego": 0.023431519667307537, "deviation-heading": 4.010859623610714, "set_robot_commands": 0.00947091817855835, "deviation-center-line": 0.6101364743439451, "driven_lanedir_consec": 2.2327466342351316, "sim_compute_sim_state": 0.004040009180704753, "sim_compute_performance-ego": 0.0060239473978678385, "sim_compute_robot_state-ego": 0.007577947775522868, "sim_compute_robot_state-npc0": 0.007774399121602376, "sim_compute_robot_state-npc1": 0.00738390843073527, "sim_compute_robot_state-npc2": 0.007186086972554525, "sim_compute_robot_state-npc3": 0.007125470638275146}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0472731623075595, "sim_physics": 0.15458835302478205, "survival_time": 6.849999999999984, "driven_lanedir": 1.009745514175422, "sim_render-ego": 0.011441850314175123, "in-drivable-lane": 0, "agent_compute-ego": 0.023923400544772183, "deviation-heading": 1.1215068206122625, "set_robot_commands": 0.0098368373230426, "deviation-center-line": 0.6010789048634749, "driven_lanedir_consec": 1.009745514175422, "sim_compute_sim_state": 0.004490260660213276, "sim_compute_performance-ego": 0.006664923507801808, "sim_compute_robot_state-ego": 0.008376622722096686, "sim_compute_robot_state-npc0": 0.008347448641366332, "sim_compute_robot_state-npc1": 0.007949620267770586, "sim_compute_robot_state-npc2": 0.00778345992095279, "sim_compute_robot_state-npc3": 0.007705524890092168}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.03120453126978, "sim_physics": 0.146591439070525, "survival_time": 6.749999999999984, "driven_lanedir": 1.014017604655601, "sim_render-ego": 0.010918115686487267, "in-drivable-lane": 0, "agent_compute-ego": 0.0421026971605089, "deviation-heading": 0.6927698098887946, "set_robot_commands": 0.00783024893866645, "deviation-center-line": 0.6633441677275717, "driven_lanedir_consec": 1.014017604655601, "sim_compute_sim_state": 0.00423285166422526, "sim_compute_performance-ego": 0.006391567654079861, "sim_compute_robot_state-ego": 0.00784277739348235, "sim_compute_robot_state-npc0": 0.007685225098221391, "sim_compute_robot_state-npc1": 0.007239373524983724, "sim_compute_robot_state-npc2": 0.00720405931825991, "sim_compute_robot_state-npc3": 0.00720524787902832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2240057226215535, "sim_physics": 0.131539911594031, "survival_time": 7.94999999999998, "driven_lanedir": 1.1058353603620723, "sim_render-ego": 0.010541020699267118, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04309821878589174, "deviation-heading": 1.459289413494333, "set_robot_commands": 0.007816451150666244, "deviation-center-line": 0.4066988620303144, "driven_lanedir_consec": 1.1058353603620723, "sim_compute_sim_state": 0.004109319650901938, "sim_compute_performance-ego": 0.006189418288896668, "sim_compute_robot_state-ego": 0.007713751223102305, "sim_compute_robot_state-npc0": 0.007371209702401791, "sim_compute_robot_state-npc1": 0.007223781549705649, "sim_compute_robot_state-npc2": 0.007140251075696645, "sim_compute_robot_state-npc3": 0.007024064753790322}}
set_robot_commands_max	0.0098368373230426
set_robot_commands_mean	0.008891543765205161
set_robot_commands_median	0.00947091817855835
set_robot_commands_min	0.007816451150666244
sim_compute_performance-ego_max	0.006664923507801808
sim_compute_performance-ego_mean	0.006305090744958117
sim_compute_performance-ego_median	0.006255596876144409
sim_compute_performance-ego_min	0.0060239473978678385
sim_compute_robot_state-ego_max	0.008376622722096686
sim_compute_robot_state-ego_mean	0.007891124084429893
sim_compute_robot_state-ego_median	0.00784277739348235
sim_compute_robot_state-ego_min	0.007577947775522868
sim_compute_robot_state-npc0_max	0.008347448641366332
sim_compute_robot_state-npc0_mean	0.007835567368011652
sim_compute_robot_state-npc0_median	0.007774399121602376
sim_compute_robot_state-npc0_min	0.007371209702401791
sim_compute_robot_state-npc1_max	0.007949620267770586
sim_compute_robot_state-npc1_mean	0.007409814593155281
sim_compute_robot_state-npc1_median	0.007252389192581176
sim_compute_robot_state-npc1_min	0.007223781549705649
sim_compute_robot_state-npc2_max	0.00778345992095279
sim_compute_robot_state-npc2_mean	0.007288665956317847
sim_compute_robot_state-npc2_median	0.007186086972554525
sim_compute_robot_state-npc2_min	0.007129472494125366
sim_compute_robot_state-npc3_max	0.007705524890092168
sim_compute_robot_state-npc3_mean	0.007228980863651986
sim_compute_robot_state-npc3_median	0.007125470638275146
sim_compute_robot_state-npc3_min	0.007024064753790322
sim_compute_sim_state_max	0.004490260660213276
sim_compute_sim_state_mean	0.00422311174538446
sim_compute_sim_state_median	0.00423285166422526
sim_compute_sim_state_min	0.004040009180704753
sim_physics_max	0.15476734936237335
sim_physics_mean	0.1474886585821949
sim_physics_median	0.1499562398592631
sim_physics_min	0.131539911594031
sim_render-ego_max	0.011441850314175123
sim_render-ego_mean	0.010821060702934
sim_render-ego_median	0.010747596621513368
sim_render-ego_min	0.010456720193227131
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.100000000000005
survival_time_min	3.999999999999994

No reset possible

24834

4333

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-04 07:00:49+00:00

2019-11-04 07:05:46+00:00

0:04:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.021246152264731272
agent_compute-ego_mean	0.019306088470603413
agent_compute-ego_median	0.019265661239624025
agent_compute-ego_min	0.017960503131528444
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1265175655253199
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599271
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811225
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589055
driven_any_mean	1.0272530755098268
driven_any_median	1.0243289631429704
driven_any_min	0.4119037580118985
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.12379477200684724, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010092973709106444, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.018652390550684045, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007436218085112395, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.003801513601232458, "sim_compute_performance-ego": 0.005753782060411241, "sim_compute_robot_state-ego": 0.007344316553186487, "sim_compute_robot_state-npc0": 0.006859814679181135, "sim_compute_robot_state-npc1": 0.006561526545771846, "sim_compute_robot_state-npc2": 0.006441743285567673, "sim_compute_robot_state-npc3": 0.006314626446476689}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.13867374420166015, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.008299293518066407, "in-drivable-lane": 0, "agent_compute-ego": 0.019265661239624025, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.00660736083984375, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.00363551139831543, "sim_compute_performance-ego": 0.00466623306274414, "sim_compute_robot_state-ego": 0.0063571929931640625, "sim_compute_robot_state-npc0": 0.006113643646240234, "sim_compute_robot_state-npc1": 0.005806188583374023, "sim_compute_robot_state-npc2": 0.0059734821319580075, "sim_compute_robot_state-npc3": 0.006106395721435547}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.13981507012718605, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.010019311779423765, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.019405735166449296, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.007684180611058285, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003929191514065391, "sim_compute_performance-ego": 0.005642953671907124, "sim_compute_robot_state-ego": 0.007142920243112664, "sim_compute_robot_state-npc0": 0.006946591954482229, "sim_compute_robot_state-npc1": 0.006899852501718621, "sim_compute_robot_state-npc2": 0.006666293269709537, "sim_compute_robot_state-npc3": 0.0068258454925135565}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.15094358407998387, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.009977334662328792, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.017960503131528444, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.0070401928092859965, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004051552543157264, "sim_compute_performance-ego": 0.005743162541449825, "sim_compute_robot_state-ego": 0.007135487809965882, "sim_compute_robot_state-npc0": 0.006629786913907981, "sim_compute_robot_state-npc1": 0.006524408919901787, "sim_compute_robot_state-npc2": 0.006634078448331809, "sim_compute_robot_state-npc3": 0.006615505942815467}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.15471558911459787, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.011988367353166851, "in-drivable-lane": 0, "agent_compute-ego": 0.021246152264731272, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.009583141122545515, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.004750234740121024, "sim_compute_performance-ego": 0.00677112170628139, "sim_compute_robot_state-ego": 0.00860856260572161, "sim_compute_robot_state-npc0": 0.008431128093174525, "sim_compute_robot_state-npc1": 0.008258410862513952, "sim_compute_robot_state-npc2": 0.008100594793047224, "sim_compute_robot_state-npc3": 0.008239763123648507}}
set_robot_commands_max	0.009583141122545515
set_robot_commands_mean	0.007670218693569189
set_robot_commands_median	0.007436218085112395
set_robot_commands_min	0.00660736083984375
sim_compute_performance-ego_max	0.00677112170628139
sim_compute_performance-ego_mean	0.005715450608558744
sim_compute_performance-ego_median	0.005743162541449825
sim_compute_performance-ego_min	0.00466623306274414
sim_compute_robot_state-ego_max	0.00860856260572161
sim_compute_robot_state-ego_mean	0.007317696041030141
sim_compute_robot_state-ego_median	0.007142920243112664
sim_compute_robot_state-ego_min	0.0063571929931640625
sim_compute_robot_state-npc0_max	0.008431128093174525
sim_compute_robot_state-npc0_mean	0.006996193057397221
sim_compute_robot_state-npc0_median	0.006859814679181135
sim_compute_robot_state-npc0_min	0.006113643646240234
sim_compute_robot_state-npc1_max	0.008258410862513952
sim_compute_robot_state-npc1_mean	0.0068100774826560465
sim_compute_robot_state-npc1_median	0.006561526545771846
sim_compute_robot_state-npc1_min	0.005806188583374023
sim_compute_robot_state-npc2_max	0.008100594793047224
sim_compute_robot_state-npc2_mean	0.00676323838572285
sim_compute_robot_state-npc2_median	0.006634078448331809
sim_compute_robot_state-npc2_min	0.0059734821319580075
sim_compute_robot_state-npc3_max	0.008239763123648507
sim_compute_robot_state-npc3_mean	0.006820427345377952
sim_compute_robot_state-npc3_median	0.006615505942815467
sim_compute_robot_state-npc3_min	0.006106395721435547
sim_compute_sim_state_max	0.004750234740121024
sim_compute_sim_state_mean	0.004033600759378314
sim_compute_sim_state_median	0.003929191514065391
sim_compute_sim_state_min	0.00363551139831543
sim_physics_max	0.15471558911459787
sim_physics_mean	0.14158855190605504
sim_physics_median	0.13981507012718605
sim_physics_min	0.12379477200684724
sim_render-ego_max	0.011988367353166851
sim_render-ego_mean	0.010075456204418454
sim_render-ego_median	0.010019311779423765
sim_render-ego_min	0.008299293518066407
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24825

4344

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LFVI-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 06:57:27+00:00

2019-11-04 07:00:23+00:00

0:02:56

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24814

4322

Gianmarco Bernasconi

baseline-IL-sim-tensorflow

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-04 06:54:13+00:00

2019-11-04 06:57:07+00:00

0:02:54

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24810

4345

Gianmarco Bernasconi

baseline-IL-sim-tensorflow

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-11-02 18:25:21+00:00

2019-11-02 19:26:37+00:00

1:01:16

Waited 3602 seconds [...]

Waited 3602 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24799

4338

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-11-02 17:33:17+00:00

2019-11-02 18:00:10+00:00

0:26:53

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24788

4335

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-02 16:24:24+00:00

2019-11-02 16:33:49+00:00

0:09:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.024178987816919253
agent_compute-ego_mean	0.02191942754156643
agent_compute-ego_median	0.021602077143532888
agent_compute-ego_min	0.020781210490635464
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.1354748199226606
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314912
deviation-heading_mean	0.49959867397150814
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000703
driven_any_mean	1.1068208197848537
driven_any_median	0.9410513078477728
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.8262319453635671
driven_lanedir_consec_mean	0.8047440134491037
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.8262319453635671
driven_lanedir_mean	0.8048281473204828
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1936113230789764, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.013107465792305862, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.024178987816919253, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.008729074574724029, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.00557200516326518, "sim_compute_performance-ego": 0.007686602918407585, "sim_compute_robot_state-ego": 0.009230734426763991, "sim_compute_robot_state-npc0": 0.009410197221780126, "sim_compute_robot_state-npc1": 0.009356933304026156, "sim_compute_robot_state-npc2": 0.009058707877050471, "sim_compute_robot_state-npc3": 0.009038499639004091}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.1656430278505598, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.011973985603877475, "in-drivable-lane": 0, "agent_compute-ego": 0.021602077143532888, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.008825055190495082, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.004224675042288644, "sim_compute_performance-ego": 0.006915714059557233, "sim_compute_robot_state-ego": 0.008349699633462089, "sim_compute_robot_state-npc0": 0.007329702377319336, "sim_compute_robot_state-npc1": 0.00755213839667184, "sim_compute_robot_state-npc2": 0.007363072463444301, "sim_compute_robot_state-npc3": 0.0070719122886657715}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.167512095090255, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.012450077001330922, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.021687905765274195, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.008494830825953807, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.005174433143393507, "sim_compute_performance-ego": 0.007224925513406402, "sim_compute_robot_state-ego": 0.008276969483755166, "sim_compute_robot_state-npc0": 0.00822879041282876, "sim_compute_robot_state-npc1": 0.00831720435503617, "sim_compute_robot_state-npc2": 0.008279036549688543, "sim_compute_robot_state-npc3": 0.00815378346489471}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.17766969899336496, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.011993477741877236, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.021346956491470337, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.007707153757413228, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.0046036938826243086, "sim_compute_performance-ego": 0.006779198845227559, "sim_compute_robot_state-ego": 0.008576328555742899, "sim_compute_robot_state-npc0": 0.007709627350171407, "sim_compute_robot_state-npc1": 0.007349729537963867, "sim_compute_robot_state-npc2": 0.007971485455830893, "sim_compute_robot_state-npc3": 0.007563630739847819}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.17043437276567733, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.012792973291306268, "in-drivable-lane": 0, "agent_compute-ego": 0.020781210490635464, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.008239927746000745, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.004660935628981818, "sim_compute_performance-ego": 0.007081372397286552, "sim_compute_robot_state-ego": 0.009265763419015067, "sim_compute_robot_state-npc0": 0.008080766314551943, "sim_compute_robot_state-npc1": 0.008658999488467262, "sim_compute_robot_state-npc2": 0.008049703779674712, "sim_compute_robot_state-npc3": 0.007460162753150577}}
set_robot_commands_max	0.008825055190495082
set_robot_commands_mean	0.008399208418917378
set_robot_commands_median	0.008494830825953807
set_robot_commands_min	0.007707153757413228
sim_compute_performance-ego_max	0.007686602918407585
sim_compute_performance-ego_mean	0.007137562746777066
sim_compute_performance-ego_median	0.007081372397286552
sim_compute_performance-ego_min	0.006779198845227559
sim_compute_robot_state-ego_max	0.009265763419015067
sim_compute_robot_state-ego_mean	0.008739899103747843
sim_compute_robot_state-ego_median	0.008576328555742899
sim_compute_robot_state-ego_min	0.008276969483755166
sim_compute_robot_state-npc0_max	0.009410197221780126
sim_compute_robot_state-npc0_mean	0.008151816735330313
sim_compute_robot_state-npc0_median	0.008080766314551943
sim_compute_robot_state-npc0_min	0.007329702377319336
sim_compute_robot_state-npc1_max	0.009356933304026156
sim_compute_robot_state-npc1_mean	0.008247001016433058
sim_compute_robot_state-npc1_median	0.00831720435503617
sim_compute_robot_state-npc1_min	0.007349729537963867
sim_compute_robot_state-npc2_max	0.009058707877050471
sim_compute_robot_state-npc2_mean	0.008144401225137784
sim_compute_robot_state-npc2_median	0.008049703779674712
sim_compute_robot_state-npc2_min	0.007363072463444301
sim_compute_robot_state-npc3_max	0.009038499639004091
sim_compute_robot_state-npc3_mean	0.007857597777112594
sim_compute_robot_state-npc3_median	0.007563630739847819
sim_compute_robot_state-npc3_min	0.0070719122886657715
sim_compute_sim_state_max	0.00557200516326518
sim_compute_sim_state_mean	0.004847148572110692
sim_compute_sim_state_median	0.004660935628981818
sim_compute_sim_state_min	0.004224675042288644
sim_physics_max	0.1936113230789764
sim_physics_mean	0.17497410355576667
sim_physics_median	0.17043437276567733
sim_physics_min	0.1656430278505598
sim_render-ego_max	0.013107465792305862
sim_render-ego_mean	0.012463595886139557
sim_render-ego_median	0.012450077001330922
sim_render-ego_min	0.011973985603877475
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

24783

4326

Gianmarco Bernasconi

baseline-IL-sim-tensorflow

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-02 15:02:43+00:00

2019-11-02 15:12:02+00:00

0:09:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.566308417816459
survival_time_median	14.950000000000076
deviation-center-line_median	0.240612479234086
in-drivable-lane_median	7.100000000000037

other stats

agent_compute-ego_max	0.01745427370071411
agent_compute-ego_mean	0.016553488823436928
agent_compute-ego_median	0.01641924872653175
agent_compute-ego_min	0.01606379063601421
deviation-center-line_max	0.6625777495414343
deviation-center-line_mean	0.32995386086485257
deviation-center-line_min	0.1749894215309902
deviation-heading_max	5.962984547246057
deviation-heading_mean	4.769173525991724
deviation-heading_median	5.476039500110038
deviation-heading_min	2.6173386376434986
driven_any_max	1.9758180746903868
driven_any_mean	1.556028389747088
driven_any_median	1.838123883867588
driven_any_min	0.7753212730861507
driven_lanedir_consec_max	0.7119291659333546
driven_lanedir_consec_mean	0.5247572409036305
driven_lanedir_consec_min	0.25727373229418005
driven_lanedir_max	0.7119291659333546
driven_lanedir_mean	0.5247572409036305
driven_lanedir_median	0.566308417816459
driven_lanedir_min	0.25727373229418005
in-drivable-lane_max	8.050000000000052
in-drivable-lane_mean	6.000000000000025
in-drivable-lane_min	3.0499999999999923
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9758180746903868, "sim_physics": 0.049694349765777586, "survival_time": 14.950000000000076, "driven_lanedir": 0.566308417816459, "sim_render-ego": 0.0070785307884216305, "in-drivable-lane": 8.050000000000052, "agent_compute-ego": 0.01745427370071411, "deviation-heading": 5.476039500110038, "set_robot_commands": 0.004564752578735351, "deviation-center-line": 0.6625777495414343, "driven_lanedir_consec": 0.566308417816459, "sim_compute_sim_state": 0.0029576468467712403, "sim_compute_performance-ego": 0.003955208460489909, "sim_compute_robot_state-ego": 0.004935617446899414}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9386060501401456, "sim_physics": 0.04580236037572225, "survival_time": 14.950000000000076, "driven_lanedir": 0.6902723862737004, "sim_render-ego": 0.0070619511604309085, "in-drivable-lane": 7.100000000000038, "agent_compute-ego": 0.016308585007985432, "deviation-heading": 5.962984547246057, "set_robot_commands": 0.004493989149729411, "deviation-center-line": 0.22111868605568535, "driven_lanedir_consec": 0.6902723862737004, "sim_compute_sim_state": 0.0029214358329772948, "sim_compute_performance-ego": 0.003830735683441162, "sim_compute_robot_state-ego": 0.0048719422022501626}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.252272666951169, "sim_physics": 0.046913779931625134, "survival_time": 9.850000000000003, "driven_lanedir": 0.3980025022004585, "sim_render-ego": 0.007058760841485812, "in-drivable-lane": 4.700000000000001, "agent_compute-ego": 0.01606379063601421, "deviation-heading": 3.94581707662671, "set_robot_commands": 0.004436053600408099, "deviation-center-line": 0.35047096796206706, "driven_lanedir_consec": 0.3980025022004585, "sim_compute_sim_state": 0.0029307876141543314, "sim_compute_performance-ego": 0.003853914096270721, "sim_compute_robot_state-ego": 0.004960885507806304}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7753212730861507, "sim_physics": 0.04902842026630431, "survival_time": 6.549999999999985, "driven_lanedir": 0.25727373229418005, "sim_render-ego": 0.008794214889293408, "in-drivable-lane": 3.0499999999999923, "agent_compute-ego": 0.01641924872653175, "deviation-heading": 2.6173386376434986, "set_robot_commands": 0.0045294834457280985, "deviation-center-line": 0.1749894215309902, "driven_lanedir_consec": 0.25727373229418005, "sim_compute_sim_state": 0.0029553093073022276, "sim_compute_performance-ego": 0.0038937048147652895, "sim_compute_robot_state-ego": 0.004894313011460632}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.838123883867588, "sim_physics": 0.0478381872177124, "survival_time": 14.950000000000076, "driven_lanedir": 0.7119291659333546, "sim_render-ego": 0.007136921882629394, "in-drivable-lane": 7.100000000000037, "agent_compute-ego": 0.01652154604593913, "deviation-heading": 5.843687868332317, "set_robot_commands": 0.004502427577972412, "deviation-center-line": 0.240612479234086, "driven_lanedir_consec": 0.7119291659333546, "sim_compute_sim_state": 0.002980968952178955, "sim_compute_performance-ego": 0.003921128114064534, "sim_compute_robot_state-ego": 0.004905333518981933}}
set_robot_commands_max	0.004564752578735351
set_robot_commands_mean	0.004505341270514674
set_robot_commands_median	0.004502427577972412
set_robot_commands_min	0.004436053600408099
sim_compute_performance-ego_max	0.003955208460489909
sim_compute_performance-ego_mean	0.003890938233806323
sim_compute_performance-ego_median	0.0038937048147652895
sim_compute_performance-ego_min	0.003830735683441162
sim_compute_robot_state-ego_max	0.004960885507806304
sim_compute_robot_state-ego_mean	0.004913618337479689
sim_compute_robot_state-ego_median	0.004905333518981933
sim_compute_robot_state-ego_min	0.0048719422022501626
sim_compute_sim_state_max	0.002980968952178955
sim_compute_sim_state_mean	0.0029492297106768093
sim_compute_sim_state_median	0.0029553093073022276
sim_compute_sim_state_min	0.0029214358329772948
sim_physics_max	0.049694349765777586
sim_physics_mean	0.04785541951142834
sim_physics_median	0.0478381872177124
sim_physics_min	0.04580236037572225
sim_render-ego_max	0.008794214889293408
sim_render-ego_mean	0.007426075912452231
sim_render-ego_median	0.0070785307884216305
sim_render-ego_min	0.007058760841485812
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.250000000000044
survival_time_min	6.549999999999985

No reset possible

24779

4323

Riza Velioglu 🇩🇪

UniBielefeld

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-11-02 13:30:06+00:00

2019-11-02 13:35:54+00:00

0:05:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4494358319029206
survival_time_median	6.749999999999984
deviation-center-line_median	0.2930528660687626
in-drivable-lane_median	1.4499999999999948

other stats

agent_compute-ego_max	0.023411985679909035
agent_compute-ego_mean	0.022561849517986503
agent_compute-ego_median	0.02292456468605896
agent_compute-ego_min	0.021591156301364097
deviation-center-line_max	0.4195481277628373
deviation-center-line_mean	0.30315522950838075
deviation-center-line_min	0.18247881499514393
deviation-heading_max	4.558206999321627
deviation-heading_mean	2.734378012112791
deviation-heading_median	2.158615223492385
deviation-heading_min	1.389385366436341
driven_any_max	1.3024566500522412
driven_any_mean	0.938056964188584
driven_any_median	0.9706920647870838
driven_any_min	0.5479193675933324
driven_lanedir_consec_max	0.6475892096922995
driven_lanedir_consec_mean	0.4138753487798006
driven_lanedir_consec_min	0.007871744496242172
driven_lanedir_max	0.6475892096922995
driven_lanedir_mean	0.4143250924543803
driven_lanedir_median	0.4516845502758194
driven_lanedir_min	0.007871744496242172
in-drivable-lane_max	5.7500000000000195
in-drivable-lane_mean	2.170000000000001
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2271525520259146, "sim_physics": 0.06839225796743052, "survival_time": 12.050000000000036, "driven_lanedir": 0.007871744496242172, "sim_render-ego": 0.009061242534906538, "in-drivable-lane": 5.7500000000000195, "agent_compute-ego": 0.02292456468605896, "deviation-heading": 4.558206999321627, "set_robot_commands": 0.006230167333515848, "deviation-center-line": 0.4195481277628373, "driven_lanedir_consec": 0.007871744496242172, "sim_compute_sim_state": 0.003985377268177839, "sim_compute_performance-ego": 0.0051042509276837235, "sim_compute_robot_state-ego": 0.006236448327535416}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5479193675933324, "sim_physics": 0.058276990103343175, "survival_time": 3.149999999999997, "driven_lanedir": 0.4310589707529978, "sim_render-ego": 0.008627653121948242, "in-drivable-lane": 0, "agent_compute-ego": 0.02191978030734592, "deviation-heading": 1.470219967296879, "set_robot_commands": 0.006117991038731166, "deviation-center-line": 0.18247881499514393, "driven_lanedir_consec": 0.4310589707529978, "sim_compute_sim_state": 0.0035536932566809275, "sim_compute_performance-ego": 0.00481294071863568, "sim_compute_robot_state-ego": 0.00604671145242358}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6420641864843472, "sim_physics": 0.05732965469360352, "survival_time": 3.5499999999999954, "driven_lanedir": 0.533420987054543, "sim_render-ego": 0.007774265719131685, "in-drivable-lane": 0, "agent_compute-ego": 0.021591156301364097, "deviation-heading": 1.389385366436341, "set_robot_commands": 0.005348927538159867, "deviation-center-line": 0.26855378903936394, "driven_lanedir_consec": 0.533420987054543, "sim_compute_sim_state": 0.003278634917568153, "sim_compute_performance-ego": 0.004240606872128769, "sim_compute_robot_state-ego": 0.005397810062892}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9706920647870838, "sim_physics": 0.06496712719952619, "survival_time": 6.749999999999984, "driven_lanedir": 0.6475892096922995, "sim_render-ego": 0.008001412285698785, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.023411985679909035, "deviation-heading": 2.158615223492385, "set_robot_commands": 0.005693057731345848, "deviation-center-line": 0.35214254967579617, "driven_lanedir_consec": 0.6475892096922995, "sim_compute_sim_state": 0.0034423580876103152, "sim_compute_performance-ego": 0.004399031179922598, "sim_compute_robot_state-ego": 0.005566980220653392}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3024566500522412, "sim_physics": 0.06052988440125853, "survival_time": 9.099999999999994, "driven_lanedir": 0.4516845502758194, "sim_render-ego": 0.00841668542924818, "in-drivable-lane": 3.649999999999989, "agent_compute-ego": 0.022961760615254494, "deviation-heading": 4.095462504016723, "set_robot_commands": 0.005720172609601702, "deviation-center-line": 0.2930528660687626, "driven_lanedir_consec": 0.4494358319029206, "sim_compute_sim_state": 0.003629256080795121, "sim_compute_performance-ego": 0.004684387982546628, "sim_compute_robot_state-ego": 0.005861488017407092}}
set_robot_commands_max	0.006230167333515848
set_robot_commands_mean	0.005822063250270886
set_robot_commands_median	0.005720172609601702
set_robot_commands_min	0.005348927538159867
sim_compute_performance-ego_max	0.0051042509276837235
sim_compute_performance-ego_mean	0.00464824353618348
sim_compute_performance-ego_median	0.004684387982546628
sim_compute_performance-ego_min	0.004240606872128769
sim_compute_robot_state-ego_max	0.006236448327535416
sim_compute_robot_state-ego_mean	0.005821887616182296
sim_compute_robot_state-ego_median	0.005861488017407092
sim_compute_robot_state-ego_min	0.005397810062892
sim_compute_sim_state_max	0.003985377268177839
sim_compute_sim_state_mean	0.0035778639221664714
sim_compute_sim_state_median	0.0035536932566809275
sim_compute_sim_state_min	0.003278634917568153
sim_physics_max	0.06839225796743052
sim_physics_mean	0.061899182873032386
sim_physics_median	0.06052988440125853
sim_physics_min	0.05732965469360352
sim_render-ego_max	0.009061242534906538
sim_render-ego_mean	0.008376251818186686
sim_render-ego_median	0.00841668542924818
sim_render-ego_min	0.007774265719131685
simulation-passed	1
survival_time_max	12.050000000000036
survival_time_mean	6.920000000000002
survival_time_min	3.149999999999997

No reset possible

24774

4317

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-11-02 06:49:37+00:00

2019-11-02 07:00:11+00:00

0:10:34

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24758

4293

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-10-31 14:58:54+00:00

2019-10-31 15:00:10+00:00

0:01:16

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24750

4307

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-10-31 14:06:06+00:00

2019-10-31 14:15:21+00:00

0:09:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5636399177084477
survival_time_median	2.9499999999999975
deviation-center-line_median	0.19417316650714284
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.02838116985256389
agent_compute-ego_mean	0.02637786362967018
agent_compute-ego_median	0.02618880513348157
agent_compute-ego_min	0.024489886832959724
deviation-center-line_max	0.27212935355303575
deviation-center-line_mean	0.1659879300685689
deviation-center-line_min	0.060733287044270105
deviation-heading_max	0.3681646786246837
deviation-heading_mean	0.2857346549044181
deviation-heading_median	0.2652784439875202
deviation-heading_min	0.2528567413804248
driven_any_max	2.7696546371463566
driven_any_mean	1.474111788433791
driven_any_median	1.5696547037668402
driven_any_min	0.4010834948810282
driven_lanedir_consec_max	1.9242206205397283
driven_lanedir_consec_mean	1.2102809057090995
driven_lanedir_consec_min	0.38720104799654376
driven_lanedir_max	1.924267585170248
driven_lanedir_mean	1.2103413601562374
driven_lanedir_median	1.5638383114510817
driven_lanedir_min	0.38720104799654376
in-drivable-lane_max	1.399999999999995
in-drivable-lane_mean	0.4199999999999985
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5696547037668402, "sim_physics": 0.18151649378113827, "survival_time": 2.9499999999999975, "driven_lanedir": 1.5638383114510817, "sim_render-ego": 0.012296276577448442, "in-drivable-lane": 0, "agent_compute-ego": 0.02838116985256389, "deviation-heading": 0.2528567413804248, "set_robot_commands": 0.008964732541876325, "deviation-center-line": 0.19417316650714284, "driven_lanedir_consec": 1.5636399177084477, "sim_compute_sim_state": 0.005025912139375331, "sim_compute_performance-ego": 0.007135528629109011, "sim_compute_robot_state-ego": 0.008785312458620234, "sim_compute_robot_state-npc0": 0.008556398294739804, "sim_compute_robot_state-npc1": 0.008136490644034693, "sim_compute_robot_state-npc2": 0.00851613788281457, "sim_compute_robot_state-npc3": 0.008406020827212576}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.19281543384898792, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.012819615277377044, "in-drivable-lane": 0, "agent_compute-ego": 0.02777981758117676, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.009778499603271484, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.005051060156388717, "sim_compute_performance-ego": 0.007499629800969904, "sim_compute_robot_state-ego": 0.009097500280900436, "sim_compute_robot_state-npc0": 0.010260798714377664, "sim_compute_robot_state-npc1": 0.008402130820534447, "sim_compute_robot_state-npc2": 0.00849704308943315, "sim_compute_robot_state-npc3": 0.007953860542990944}, "udem1-2-0": {"driven_any": 2.1696546375441614, "sim_physics": 0.17868959451023536, "survival_time": 3.949999999999994, "driven_lanedir": 1.7414407758715231, "sim_render-ego": 0.01210865491553198, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.02618880513348157, "deviation-heading": 0.2785063205851342, "set_robot_commands": 0.008297558072247083, "deviation-center-line": 0.22563902167216496, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.004796263537829435, "sim_compute_performance-ego": 0.0070886279963239835, "sim_compute_robot_state-ego": 0.00894040095655224, "sim_compute_robot_state-npc0": 0.008406732655778716, "sim_compute_robot_state-npc1": 0.007965259914156756, "sim_compute_robot_state-npc2": 0.007693701152560077, "sim_compute_robot_state-npc3": 0.007772593558589115}, "udem1-3-0": {"driven_any": 2.7696546371463566, "sim_physics": 0.16885740829236578, "survival_time": 4.94999999999999, "driven_lanedir": 1.924267585170248, "sim_render-ego": 0.011553583723126036, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.024489886832959724, "deviation-heading": 0.2652784439875202, "set_robot_commands": 0.007904630718809185, "deviation-center-line": 0.27212935355303575, "driven_lanedir_consec": 1.9242206205397283, "sim_compute_sim_state": 0.004791681212608261, "sim_compute_performance-ego": 0.006648314119589449, "sim_compute_robot_state-ego": 0.008379009034898546, "sim_compute_robot_state-npc0": 0.007303811082936296, "sim_compute_robot_state-npc1": 0.00747988922427399, "sim_compute_robot_state-npc2": 0.007671047942806976, "sim_compute_robot_state-npc3": 0.007607809220901643}, "udem1-4-0": {"driven_any": 0.4010834948810282, "sim_physics": 0.20171676874160763, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38720104799654376, "sim_render-ego": 0.011738109588623046, "in-drivable-lane": 0, "agent_compute-ego": 0.025049638748168943, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.00956583023071289, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38720104799654376, "sim_compute_sim_state": 0.004625856876373291, "sim_compute_performance-ego": 0.006610548496246338, "sim_compute_robot_state-ego": 0.008430755138397217, "sim_compute_robot_state-npc0": 0.008631467819213867, "sim_compute_robot_state-npc1": 0.008291673660278321, "sim_compute_robot_state-npc2": 0.007668781280517578, "sim_compute_robot_state-npc3": 0.007719671726226807}}
set_robot_commands_max	0.009778499603271484
set_robot_commands_mean	0.008902250233383393
set_robot_commands_median	0.008964732541876325
set_robot_commands_min	0.007904630718809185
sim_compute_performance-ego_max	0.007499629800969904
sim_compute_performance-ego_mean	0.006996529808447738
sim_compute_performance-ego_median	0.0070886279963239835
sim_compute_performance-ego_min	0.006610548496246338
sim_compute_robot_state-ego_max	0.009097500280900436
sim_compute_robot_state-ego_mean	0.008726595573873733
sim_compute_robot_state-ego_median	0.008785312458620234
sim_compute_robot_state-ego_min	0.008379009034898546
sim_compute_robot_state-npc0_max	0.010260798714377664
sim_compute_robot_state-npc0_mean	0.008631841713409269
sim_compute_robot_state-npc0_median	0.008556398294739804
sim_compute_robot_state-npc0_min	0.007303811082936296
sim_compute_robot_state-npc1_max	0.008402130820534447
sim_compute_robot_state-npc1_mean	0.008055088852655642
sim_compute_robot_state-npc1_median	0.008136490644034693
sim_compute_robot_state-npc1_min	0.00747988922427399
sim_compute_robot_state-npc2_max	0.00851613788281457
sim_compute_robot_state-npc2_mean	0.008009342269626471
sim_compute_robot_state-npc2_median	0.007693701152560077
sim_compute_robot_state-npc2_min	0.007668781280517578
sim_compute_robot_state-npc3_max	0.008406020827212576
sim_compute_robot_state-npc3_mean	0.007891991175184217
sim_compute_robot_state-npc3_median	0.007772593558589115
sim_compute_robot_state-npc3_min	0.007607809220901643
sim_compute_sim_state_max	0.005051060156388717
sim_compute_sim_state_mean	0.004858154784515007
sim_compute_sim_state_median	0.004796263537829435
sim_compute_sim_state_min	0.004625856876373291
sim_physics_max	0.20171676874160763
sim_physics_mean	0.184719139834867
sim_physics_median	0.18151649378113827
sim_physics_min	0.16885740829236578
sim_render-ego_max	0.012819615277377044
sim_render-ego_mean	0.01210324801642131
sim_render-ego_median	0.01210865491553198
sim_render-ego_min	0.011553583723126036
simulation-passed	1
survival_time_max	4.94999999999999
survival_time_mean	2.7899999999999965
survival_time_min	1.0000000000000002

No reset possible

24736

2438

Liam Paull 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 14:04:51+00:00

2019-10-31 14:05:21+00:00

0:00:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10745727029933444
error_L2	0.016906133076892618

No reset possible

24729

2869

Shashank Gaur

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 14:04:16+00:00

2019-10-31 14:04:38+00:00

0:00:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12066225213220272
error_L2	0.021930461261210375

No reset possible

24718

3257

Liu Sam 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-35-218-10492

2019-10-31 14:03:50+00:00

2019-10-31 14:03:55+00:00

0:00:05

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24709

3134

Amaury Camus 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 14:03:09+00:00

2019-10-31 14:03:27+00:00

0:00:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10222096339563666
error_L2	0.015679350853690936

No reset possible

24699

3150

Andy Ser

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 14:02:46+00:00

2019-10-31 14:03:02+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11467536919457524
error_L2	0.022002145096476352

No reset possible

24695

3265

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-35-218-10492

2019-10-31 14:02:33+00:00

2019-10-31 14:02:38+00:00

0:00:05

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24687

3264

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-35-218-10492

2019-10-31 14:02:14+00:00

2019-10-31 14:02:19+00:00

0:00:05

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24677

3180

ZongRu Li

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 14:01:50+00:00

2019-10-31 14:02:07+00:00

0:00:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10600307197190544
error_L2	0.01972862297503634

No reset possible

24654

3243

Allen Ou

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 14:00:07+00:00

2019-10-31 14:01:28+00:00

0:01:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11276864628807716
error_L2	0.019368762685700293

No reset possible

24645

3260

Sean Lu

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

error

yes

ip-172-31-35-218-10492

2019-10-31 13:59:43+00:00

2019-10-31 13:59:57+00:00

0:00:14

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes/compatibility.py", line 25, in check_compatible_protocol
    raise IncompatibleProtocol(msg)
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type <class 'aido_schemas.schemas.Duckiebot1Observations'> as <class 'float'>: CanBeUsed(result=False, why="Type <class 'aido_schemas.schemas.Duckiebot1Observations'> (94469148491616) \n is not a subclass of <class 'float'> (139869791113344) \n is : False", M=Matches(m={}), matches={}, reasons={})

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 77, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 88, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes/compatibility.py", line 43, in check_compatible_protocol
    raise IncompatibleProtocol(msg) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
p1: |InteractionProtocol(description='Particularization for Duckiebot1 observations and commands.', inputs={'observations': <class 'aido_schemas.schemas.Duckiebot1Observations'>, 'seed': <class 'int'>, 'get_commands': <class 'NoneType'>, 'episode_start': <class 'aido_schemas.protocol_agent.EpisodeStart'>}, outputs={'commands': <class 'aido_schemas.schemas.Duckiebot1Commands'>}, language='(in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)')
p2: |InteractionProtocol(description='An estimator receives a stream of values and must predict the next value.', inputs={'observations': <class 'float'>, 'seed': <class 'int'>, 'get_prediction': <class 'NoneType'>}, outputs={'prediction': <class 'float'>}, language='(in:seed)? ; ((in:observations | (in:get_prediction ; out:prediction))*)')

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24637

3277

Timothius Victorio Yasin 🇦🇫

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

error

yes

ip-172-31-35-218-10492

2019-10-31 13:59:09+00:00

2019-10-31 13:59:27+00:00

0:00:18

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes/compatibility.py", line 25, in check_compatible_protocol
    raise IncompatibleProtocol(msg)
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type <class 'aido_schemas.schemas.Duckiebot1Observations'> as <class 'float'>: CanBeUsed(result=False, why="Type <class 'aido_schemas.schemas.Duckiebot1Observations'> (94094379837568) \n is not a subclass of <class 'float'> (140411118960768) \n is : False", M=Matches(m={}), matches={}, reasons={})

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 77, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 88, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes/compatibility.py", line 43, in check_compatible_protocol
    raise IncompatibleProtocol(msg) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
p1: |InteractionProtocol(description='Particularization for Duckiebot1 observations and commands.', inputs={'observations': <class 'aido_schemas.schemas.Duckiebot1Observations'>, 'seed': <class 'int'>, 'get_commands': <class 'NoneType'>, 'episode_start': <class 'aido_schemas.protocol_agent.EpisodeStart'>}, outputs={'commands': <class 'aido_schemas.schemas.Duckiebot1Commands'>}, language='(in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)')
p2: |InteractionProtocol(description='An estimator receives a stream of values and must predict the next value.', inputs={'observations': <class 'float'>, 'seed': <class 'int'>, 'get_prediction': <class 'NoneType'>}, outputs={'prediction': <class 'float'>}, language='(in:seed)? ; ((in:observations | (in:get_prediction ; out:prediction))*)')

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24632

3815

Philippe Laferriere

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 13:58:37+00:00

2019-10-31 13:59:00+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11874492951395564
error_L2	0.020698234200047978

No reset possible

24551

4297

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-10-31 13:51:20+00:00

2019-10-31 13:58:22+00:00

0:07:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.020444499818902267
agent_compute-ego_mean	0.019207595351417292
agent_compute-ego_median	0.019244317655210143
agent_compute-ego_min	0.017027263641357423
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1265175655253199
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599271
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811225
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589055
driven_any_mean	1.0272530755098268
driven_any_median	1.0243289631429704
driven_any_min	0.4119037580118985
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.10624903661233408, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010479397243923612, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.019244317655210143, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006824921678613733, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0040716904181021234, "sim_compute_performance-ego": 0.005788436642399541, "sim_compute_robot_state-ego": 0.006989381931446216, "sim_compute_robot_state-npc0": 0.006973761099356192, "sim_compute_robot_state-npc1": 0.006804647269072356, "sim_compute_robot_state-npc2": 0.006738547925595884, "sim_compute_robot_state-npc3": 0.0070132988470572016}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.14008016586303712, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.009544038772583007, "in-drivable-lane": 0, "agent_compute-ego": 0.017027263641357423, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.007267885208129883, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.004102058410644531, "sim_compute_performance-ego": 0.005282878875732422, "sim_compute_robot_state-ego": 0.006989717483520508, "sim_compute_robot_state-npc0": 0.007078857421875, "sim_compute_robot_state-npc1": 0.006499443054199219, "sim_compute_robot_state-npc2": 0.0062576007843017575, "sim_compute_robot_state-npc3": 0.006552925109863281}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.15006326687963387, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.01105189323425293, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.020444499818902267, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.008385714731718364, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.004457483166142514, "sim_compute_performance-ego": 0.00631793549186305, "sim_compute_robot_state-ego": 0.007907114530864515, "sim_compute_robot_state-npc0": 0.008228345921165064, "sim_compute_robot_state-npc1": 0.00729089661648399, "sim_compute_robot_state-npc2": 0.007527056493257221, "sim_compute_robot_state-npc3": 0.00727709970976177}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.1313165471523623, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.010727272758001014, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.020131047767928883, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007638327683074565, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004390876504439342, "sim_compute_performance-ego": 0.005945130239559125, "sim_compute_robot_state-ego": 0.007809035385711284, "sim_compute_robot_state-npc0": 0.007568627973146076, "sim_compute_robot_state-npc1": 0.007149515272695807, "sim_compute_robot_state-npc2": 0.007509865338289285, "sim_compute_robot_state-npc3": 0.007257410242587705}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.11726914984839304, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.011269220284053258, "in-drivable-lane": 0, "agent_compute-ego": 0.019190847873687744, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006946665900094169, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.004014347280774798, "sim_compute_performance-ego": 0.0066964541162763324, "sim_compute_robot_state-ego": 0.007385849952697754, "sim_compute_robot_state-npc0": 0.006829091480800084, "sim_compute_robot_state-npc1": 0.006738441331045968, "sim_compute_robot_state-npc2": 0.006840944290161133, "sim_compute_robot_state-npc3": 0.006983552660260882}}
set_robot_commands_max	0.008385714731718364
set_robot_commands_mean	0.007412703040326142
set_robot_commands_median	0.007267885208129883
set_robot_commands_min	0.006824921678613733
sim_compute_performance-ego_max	0.0066964541162763324
sim_compute_performance-ego_mean	0.0060061670731660945
sim_compute_performance-ego_median	0.005945130239559125
sim_compute_performance-ego_min	0.005282878875732422
sim_compute_robot_state-ego_max	0.007907114530864515
sim_compute_robot_state-ego_mean	0.007416219856848055
sim_compute_robot_state-ego_median	0.007385849952697754
sim_compute_robot_state-ego_min	0.006989381931446216
sim_compute_robot_state-npc0_max	0.008228345921165064
sim_compute_robot_state-npc0_mean	0.007335736779268484
sim_compute_robot_state-npc0_median	0.007078857421875
sim_compute_robot_state-npc0_min	0.006829091480800084
sim_compute_robot_state-npc1_max	0.00729089661648399
sim_compute_robot_state-npc1_mean	0.0068965887086994675
sim_compute_robot_state-npc1_median	0.006804647269072356
sim_compute_robot_state-npc1_min	0.006499443054199219
sim_compute_robot_state-npc2_max	0.007527056493257221
sim_compute_robot_state-npc2_mean	0.006974802966321056
sim_compute_robot_state-npc2_median	0.006840944290161133
sim_compute_robot_state-npc2_min	0.0062576007843017575
sim_compute_robot_state-npc3_max	0.00727709970976177
sim_compute_robot_state-npc3_mean	0.007016857313906168
sim_compute_robot_state-npc3_median	0.0070132988470572016
sim_compute_robot_state-npc3_min	0.006552925109863281
sim_compute_sim_state_max	0.004457483166142514
sim_compute_sim_state_mean	0.004207291156020662
sim_compute_sim_state_median	0.004102058410644531
sim_compute_sim_state_min	0.004014347280774798
sim_physics_max	0.15006326687963387
sim_physics_mean	0.12899563327115207
sim_physics_median	0.1313165471523623
sim_physics_min	0.10624903661233408
sim_render-ego_max	0.011269220284053258
sim_render-ego_mean	0.010614364458562764
sim_render-ego_median	0.010727272758001014
sim_render-ego_min	0.009544038772583007
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24541

4112

Frank (Chude) Qian 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-35-218-10492

2019-10-31 13:50:26+00:00

2019-10-31 13:50:50+00:00

0:00:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11571087152777762
error_L2	0.020240459026622023

No reset possible

24431

4230

Andrea Censi 🇨🇭

challenge-aido_LF-template-pytorch

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-10-24 17:13:55+00:00

2019-10-24 17:17:56+00:00

0:04:01

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24421

4228

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFVI-sim-validation

step1-simulation

failed

ip-172-31-35-218-10492

2019-10-24 06:36:47+00:00

2019-10-24 06:37:45+00:00

0:00:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24407

4215

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LF-sim-validation

step1-simulation

failed

ip-172-31-35-218-10492

2019-10-24 06:26:48+00:00

2019-10-24 06:30:53+00:00

0:04:05

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24404

4212

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LFVI-sim-validation

step1-simulation

failed

ip-172-31-35-218-10492

2019-10-24 04:56:01+00:00

2019-10-24 04:59:54+00:00

0:03:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24400

4199

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-10-24 03:40:24+00:00

2019-10-24 03:42:25+00:00

0:02:01

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24391

4196

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

failed

ip-172-31-35-218-10492

2019-10-23 21:25:33+00:00

2019-10-23 21:26:14+00:00

0:00:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 338, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 110, in object_from_ipce_
    raise ZValueError(msg, st=st, mj_yaml=mj)
zuper_typing.exceptions.ZValueError: Expected trivial expect_type @st, got @mj_yaml.
│      st: float
│ mj_yaml: 0

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 338, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 169, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 350, in object_from_ipce_dataclass_instance
    ) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'motor_right' of PWMCommands.
│ K_annotations: {motor_left: float, motor_right: float}
│   expect_type: float
│         ann_K: float
│        K_name: `PWMCommands`

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 66, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 169, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 350, in object_from_ipce_dataclass_instance
    ) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'wheels' of Duckiebot1Commands.
│ K_annotations: dict
│                │ wheels:
│                │ dataclass aido_schemas.schemas.PWMCommands
│                │  field  motor_left : float 
│                │  field motor_right : float 
│                │ LEDS:
│                │ dataclass aido_schemas.schemas.LEDSCommands
│                │  field      center : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field  front_left : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field front_right : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field   back_left : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field  back_right : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│   expect_type: dataclass aido_schemas.schemas.PWMCommands
│                 field  motor_left : float 
│                 field motor_right : float 
│         ann_K: dataclass aido_schemas.schemas.PWMCommands
│                 field  motor_left : float 
│                 field motor_right : float 
│        K_name: `Duckiebot1Commands`

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 215, in read_one
    data = object_from_ipce(msg[FIELD_DATA], klass)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 85, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.schemas.Duckiebot1Commands
│               field wheels : dataclass aido_schemas.schemas.PWMCommands               
│                               field  motor_left : float                               
│                               field motor_right : float                               
│               field   LEDS : dataclass aido_schemas.schemas.LEDSCommands              
│                               field      center : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field  front_left : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field front_right : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field   back_left : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field  back_right : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24389

4195

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-35-218-10492

2019-10-23 21:15:29+00:00

2019-10-23 21:18:50+00:00

0:03:21

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24363

4184

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LFVI-sim-validation

step1-simulation

error

ip-172-31-35-218-10492

2019-10-23 16:53:08+00:00

2019-10-23 16:56:46+00:00

0:03:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24358

4174

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LFV-sim-validation

step1-simulation

failed

ip-172-31-35-218-10492

2019-10-21 23:18:41+00:00

2019-10-21 23:21:59+00:00

0:03:18

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24350

4166

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-35-218-10492

2019-10-21 14:48:11+00:00

2019-10-21 14:53:49+00:00

0:05:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.02087731602825696
agent_compute-ego_mean	0.017267079433197857
agent_compute-ego_median	0.01820743966985632
agent_compute-ego_min	0.013429641723632812
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1265175655253199
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599271
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811225
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589055
driven_any_mean	1.0272530755098268
driven_any_median	1.0243289631429704
driven_any_min	0.4119037580118985
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.11180269718170166, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010868050433971264, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.01820743966985632, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007124547605161314, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004236340522766113, "sim_compute_performance-ego": 0.006057160872000235, "sim_compute_robot_state-ego": 0.007130874527825249, "sim_compute_robot_state-npc0": 0.007901668548583984, "sim_compute_robot_state-npc1": 0.006835747648168493, "sim_compute_robot_state-npc2": 0.006999951821786386, "sim_compute_robot_state-npc3": 0.006926289311161748}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.09657049179077148, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.00753352165222168, "in-drivable-lane": 0, "agent_compute-ego": 0.013429641723632812, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.005259923934936524, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003027410507202148, "sim_compute_performance-ego": 0.004053478240966797, "sim_compute_robot_state-ego": 0.005245628356933593, "sim_compute_robot_state-npc0": 0.0050232791900634765, "sim_compute_robot_state-npc1": 0.004862031936645508, "sim_compute_robot_state-npc2": 0.004876642227172851, "sim_compute_robot_state-npc3": 0.0048312187194824215}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1084708759659215, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.008328268402501157, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.014994787542443528, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.005761193601708663, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003366128394478246, "sim_compute_performance-ego": 0.004637219403919421, "sim_compute_robot_state-ego": 0.005944230054554187, "sim_compute_robot_state-npc0": 0.005616743313638787, "sim_compute_robot_state-npc1": 0.005493832261938798, "sim_compute_robot_state-npc2": 0.005456783269581042, "sim_compute_robot_state-npc3": 0.005420656580674021}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.14087724685668945, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.01068426385710511, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02087731602825696, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007491977908943273, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004069907755791386, "sim_compute_performance-ego": 0.00591614578343645, "sim_compute_robot_state-ego": 0.007391027257412295, "sim_compute_robot_state-npc0": 0.007015578354461284, "sim_compute_robot_state-npc1": 0.006902350655084924, "sim_compute_robot_state-npc2": 0.006891304933572117, "sim_compute_robot_state-npc3": 0.006831633893749382}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.104316098349435, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.009801949773515974, "in-drivable-lane": 0, "agent_compute-ego": 0.018826212201799666, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006499460765293666, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0036134890147617887, "sim_compute_performance-ego": 0.00533778326851981, "sim_compute_robot_state-ego": 0.0067936863218035016, "sim_compute_robot_state-npc0": 0.00621312005179269, "sim_compute_robot_state-npc1": 0.0062360337802342, "sim_compute_robot_state-npc2": 0.006296260016305106, "sim_compute_robot_state-npc3": 0.006364583969116211}}
set_robot_commands_max	0.007491977908943273
set_robot_commands_mean	0.006427420763208689
set_robot_commands_median	0.006499460765293666
set_robot_commands_min	0.005259923934936524
sim_compute_performance-ego_max	0.006057160872000235
sim_compute_performance-ego_mean	0.0052003575137685425
sim_compute_performance-ego_median	0.00533778326851981
sim_compute_performance-ego_min	0.004053478240966797
sim_compute_robot_state-ego_max	0.007391027257412295
sim_compute_robot_state-ego_mean	0.006501089303705765
sim_compute_robot_state-ego_median	0.0067936863218035016
sim_compute_robot_state-ego_min	0.005245628356933593
sim_compute_robot_state-npc0_max	0.007901668548583984
sim_compute_robot_state-npc0_mean	0.006354077891708045
sim_compute_robot_state-npc0_median	0.00621312005179269
sim_compute_robot_state-npc0_min	0.0050232791900634765
sim_compute_robot_state-npc1_max	0.006902350655084924
sim_compute_robot_state-npc1_mean	0.0060659992564143835
sim_compute_robot_state-npc1_median	0.0062360337802342
sim_compute_robot_state-npc1_min	0.004862031936645508
sim_compute_robot_state-npc2_max	0.006999951821786386
sim_compute_robot_state-npc2_mean	0.0061041884536835
sim_compute_robot_state-npc2_median	0.006296260016305106
sim_compute_robot_state-npc2_min	0.004876642227172851
sim_compute_robot_state-npc3_max	0.006926289311161748
sim_compute_robot_state-npc3_mean	0.0060748764948367565
sim_compute_robot_state-npc3_median	0.006364583969116211
sim_compute_robot_state-npc3_min	0.0048312187194824215
sim_compute_sim_state_max	0.004236340522766113
sim_compute_sim_state_mean	0.003662655238999937
sim_compute_sim_state_median	0.0036134890147617887
sim_compute_sim_state_min	0.003027410507202148
sim_physics_max	0.14087724685668945
sim_physics_mean	0.11240748202890384
sim_physics_median	0.1084708759659215
sim_physics_min	0.09657049179077148
sim_render-ego_max	0.010868050433971264
sim_render-ego_mean	0.009443210823863036
sim_render-ego_median	0.009801949773515974
sim_render-ego_min	0.00753352165222168
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible