Evaluator 801

step1-simulation

success

2019-04-26 20:16:47+00:00

2019-04-26 20:30:49+00:00

0:14:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6621024477191548
survival_time_median	12.750000000000046
deviation-center-line_median	0.5840535002704277
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17556674620684457
agent_compute-ego_mean	0.17246273791877662
agent_compute-ego_median	0.1718164078394572
agent_compute-ego_min	0.16905260403951008
deviation-center-line_max	0.905286472765929
deviation-center-line_mean	0.6169291817734488
deviation-center-line_min	0.4112686315312262
deviation-heading_max	3.786836621595458
deviation-heading_mean	2.2908357809594397
deviation-heading_median	1.8229622199629412
deviation-heading_min	0.8318292100973597
driven_any_max	1.2015960672336203
driven_any_mean	0.7904654282729926
driven_any_median	0.996488636962343
driven_any_min	0.2749039759738603
driven_lanedir_consec_max	1.176803323034731
driven_lanedir_consec_mean	0.6757039949996709
driven_lanedir_consec_min	0.26805926890889875
driven_lanedir_max	1.176803323034731
driven_lanedir_mean	0.6757039949996709
driven_lanedir_median	0.6621024477191548
driven_lanedir_min	0.26805926890889875
in-drivable-lane_max	3.2000000000000455
in-drivable-lane_mean	0.8900000000000127
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0202102569793663, "sim_physics": 0.08890274073928595, "survival_time": 12.800000000000049, "driven_lanedir": 0.6621024477191548, "sim_render-ego": 0.05078406073153019, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.1714592296630144, "deviation-heading": 3.786836621595458, "set_robot_commands": 0.07424298487603664, "deviation-center-line": 0.5840535002704277, "driven_lanedir_consec": 0.6621024477191548, "sim_compute_sim_state": 0.03241990227252245, "sim_compute_performance-ego": 0.055152783170342445, "sim_compute_robot_state-ego": 0.05912380665540695}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.996488636962343, "sim_physics": 0.0904340472875857, "survival_time": 12.750000000000046, "driven_lanedir": 0.8338490654393498, "sim_render-ego": 0.04900063439911487, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.17556674620684457, "deviation-heading": 3.195463815844167, "set_robot_commands": 0.07493779986512428, "deviation-center-line": 0.905286472765929, "driven_lanedir_consec": 0.8338490654393498, "sim_compute_sim_state": 0.03124712869232776, "sim_compute_performance-ego": 0.053233157887178306, "sim_compute_robot_state-ego": 0.057804074941896925}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2749039759738603, "sim_physics": 0.06968193372090657, "survival_time": 3.7499999999999942, "driven_lanedir": 0.26805926890889875, "sim_render-ego": 0.050216296513875325, "in-drivable-lane": 0, "agent_compute-ego": 0.16905260403951008, "deviation-heading": 0.8318292100973597, "set_robot_commands": 0.07384628613789876, "deviation-center-line": 0.4112686315312262, "driven_lanedir_consec": 0.26805926890889875, "sim_compute_sim_state": 0.032680721282958985, "sim_compute_performance-ego": 0.05529820442199707, "sim_compute_robot_state-ego": 0.058905445734659834}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.0825638490564683, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.04926051612661666, "in-drivable-lane": 0, "agent_compute-ego": 0.17441870184505687, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.07514596987171333, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.03165755552404067, "sim_compute_performance-ego": 0.05391786679500291, "sim_compute_robot_state-ego": 0.05662298202514648}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2015960672336203, "sim_physics": 0.09618507862091064, "survival_time": 14.950000000000076, "driven_lanedir": 1.176803323034731, "sim_render-ego": 0.050105580488840736, "in-drivable-lane": 0, "agent_compute-ego": 0.1718164078394572, "deviation-heading": 1.8229622199629412, "set_robot_commands": 0.07248403549194336, "deviation-center-line": 0.7425380475495972, "driven_lanedir_consec": 1.176803323034731, "sim_compute_sim_state": 0.03240583896636963, "sim_compute_performance-ego": 0.05695284684499105, "sim_compute_robot_state-ego": 0.0581981086730957}}
set_robot_commands_max	0.07514596987171333
set_robot_commands_mean	0.07413141524854328
set_robot_commands_median	0.07424298487603664
set_robot_commands_min	0.07248403549194336
sim_compute_performance-ego_max	0.05695284684499105
sim_compute_performance-ego_mean	0.05491097182390235
sim_compute_performance-ego_median	0.055152783170342445
sim_compute_performance-ego_min	0.053233157887178306
sim_compute_robot_state-ego_max	0.05912380665540695
sim_compute_robot_state-ego_mean	0.058130883606041184
sim_compute_robot_state-ego_median	0.0581981086730957
sim_compute_robot_state-ego_min	0.05662298202514648
sim_compute_sim_state_max	0.032680721282958985
sim_compute_sim_state_mean	0.0320822293476439
sim_compute_sim_state_median	0.03240583896636963
sim_compute_sim_state_min	0.03124712869232776
sim_physics_max	0.09618507862091064
sim_physics_mean	0.08555352988503143
sim_physics_median	0.08890274073928595
sim_physics_min	0.06968193372090657
sim_render-ego_max	0.05078406073153019
sim_render-ego_mean	0.04987341765199556
sim_render-ego_median	0.050105580488840736
sim_render-ego_min	0.04900063439911487
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.040000000000031
survival_time_min	3.7499999999999942

No reset possible

20696

3095

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 15:00:22+00:00

2019-04-26 15:10:49+00:00

0:10:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6614638956240098
survival_time_median	12.700000000000044
deviation-center-line_median	0.5446003749800976
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.12795167363534762
agent_compute-ego_mean	0.12717046343287158
agent_compute-ego_median	0.1270317350115095
agent_compute-ego_min	0.1268529192606608
deviation-center-line_max	0.9162923391006956
deviation-center-line_mean	0.6120287276323004
deviation-center-line_min	0.4115668221274075
deviation-heading_max	3.5438333029540345
deviation-heading_mean	2.2498903806679285
deviation-heading_median	1.817087037297275
deviation-heading_min	0.8325357703032883
driven_any_max	1.2012476168640296
driven_any_mean	0.7891380579549091
driven_any_median	0.9961459731971958
driven_any_min	0.2747785040249249
driven_lanedir_consec_max	1.1769079117928278
driven_lanedir_consec_mean	0.6760174424141241
driven_lanedir_consec_min	0.2679213813687227
driven_lanedir_max	1.1769079117928278
driven_lanedir_mean	0.6760174424141241
driven_lanedir_median	0.6614638956240098
driven_lanedir_min	0.2679213813687227
in-drivable-lane_max	3.250000000000046
in-drivable-lane_mean	0.8900000000000127
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0143899914726229, "sim_physics": 0.06347739321040356, "survival_time": 12.700000000000044, "driven_lanedir": 0.6614638956240098, "sim_render-ego": 0.03713091151920829, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.12795167363534762, "deviation-heading": 3.5438333029540345, "set_robot_commands": 0.05676544181943879, "deviation-center-line": 0.5446003749800976, "driven_lanedir_consec": 0.6614638956240098, "sim_compute_sim_state": 0.024152412189273383, "sim_compute_performance-ego": 0.04045899177160789, "sim_compute_robot_state-ego": 0.04250029222233089}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9961459731971958, "sim_physics": 0.06181937479505352, "survival_time": 12.750000000000046, "driven_lanedir": 0.8360881533888394, "sim_render-ego": 0.03660218575421502, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.1269442820081524, "deviation-heading": 3.2417677847472746, "set_robot_commands": 0.05727901926227645, "deviation-center-line": 0.9162923391006956, "driven_lanedir_consec": 0.8360881533888394, "sim_compute_sim_state": 0.024053360434139477, "sim_compute_performance-ego": 0.04009614645266065, "sim_compute_robot_state-ego": 0.04221395043765797}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2747785040249249, "sim_physics": 0.04932774225870768, "survival_time": 3.7499999999999942, "driven_lanedir": 0.2679213813687227, "sim_render-ego": 0.03663261731465658, "in-drivable-lane": 0, "agent_compute-ego": 0.1268529192606608, "deviation-heading": 0.8325357703032883, "set_robot_commands": 0.05741703351338705, "deviation-center-line": 0.4115668221274075, "driven_lanedir_consec": 0.2679213813687227, "sim_compute_sim_state": 0.02438478151957194, "sim_compute_performance-ego": 0.040767857233683265, "sim_compute_robot_state-ego": 0.04282442728678385}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.05616270193532735, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.037728860598652304, "in-drivable-lane": 0, "agent_compute-ego": 0.1270317350115095, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.057266219323422726, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.02450661699311072, "sim_compute_performance-ego": 0.04002964396436675, "sim_compute_robot_state-ego": 0.043078372458449934}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2012476168640296, "sim_physics": 0.06519588947296143, "survival_time": 14.950000000000076, "driven_lanedir": 1.1769079117928278, "sim_render-ego": 0.037152458826700846, "in-drivable-lane": 0, "agent_compute-ego": 0.12707170724868774, "deviation-heading": 1.8142280080377704, "set_robot_commands": 0.056410360336303714, "deviation-center-line": 0.7461848452032371, "driven_lanedir_consec": 1.1769079117928278, "sim_compute_sim_state": 0.024091262817382813, "sim_compute_performance-ego": 0.04062644402186076, "sim_compute_robot_state-ego": 0.04296965440114339}}
set_robot_commands_max	0.05741703351338705
set_robot_commands_mean	0.05702761485096575
set_robot_commands_median	0.057266219323422726
set_robot_commands_min	0.056410360336303714
sim_compute_performance-ego_max	0.040767857233683265
sim_compute_performance-ego_mean	0.040395816688835864
sim_compute_performance-ego_median	0.04045899177160789
sim_compute_performance-ego_min	0.04002964396436675
sim_compute_robot_state-ego_max	0.043078372458449934
sim_compute_robot_state-ego_mean	0.042717339361273206
sim_compute_robot_state-ego_median	0.04282442728678385
sim_compute_robot_state-ego_min	0.04221395043765797
sim_compute_sim_state_max	0.02450661699311072
sim_compute_sim_state_mean	0.024237686790695663
sim_compute_sim_state_median	0.024152412189273383
sim_compute_sim_state_min	0.024053360434139477
sim_physics_max	0.06519588947296143
sim_physics_mean	0.05919662033449071
sim_physics_median	0.06181937479505352
sim_physics_min	0.04932774225870768
sim_render-ego_max	0.037728860598652304
sim_render-ego_mean	0.037049406802686605
sim_render-ego_median	0.03713091151920829
sim_render-ego_min	0.03660218575421502
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.02000000000003
survival_time_min	3.7499999999999942

No reset possible

20691

3092

Python template

aido2-AMOD-efficiency

step1-simulation

success

yes

2019-04-26 13:48:25+00:00

2019-04-26 13:53:14+00:00

0:04:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20688

3090

Java template from Webinar

step2-scoring

success

yes

2019-04-26 13:41:39+00:00

2019-04-26 13:41:48+00:00

0:00:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-35.18079503140497

other stats

efficiency	-74.96570012562036
fleet_size	-1000000000

No reset possible

20684

3090

Java template from Webinar

step1-simulation

success

yes

2019-04-26 13:37:50+00:00

2019-04-26 13:41:06+00:00

0:03:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20678

3086

Python template

aido2-AMOD-efficiency

step1-simulation

host-error

yes

2019-04-26 12:40:05+00:00

2019-04-26 13:05:26+00:00

0:25:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20678-604631', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20678-604631', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20678-604631', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20674

3085

Java template

step2-scoring

success

yes

2019-04-26 12:39:14+00:00

2019-04-26 12:39:57+00:00

0:00:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-33.17580287841057

other stats

efficiency	-66.48517151364277
fleet_size	-1000000000

No reset possible

20669

3083

Python template

step1-simulation

success

yes

2019-04-26 11:54:35+00:00

2019-04-26 11:57:49+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20657

3078

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:26+00:00

2019-04-26 10:30:16+00:00

0:27:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8598316819885128
survival_time_median	14.950000000000076
deviation-center-line_median	0.6335287352392424
in-drivable-lane_median	2.400000000000034

other stats

agent_compute-ego_max	0.22615297635396325
agent_compute-ego_mean	0.19655514160816528
agent_compute-ego_median	0.2247541817029317
agent_compute-ego_min	0.1395166931730328
deviation-center-line_max	1.1370729844153973
deviation-center-line_mean	0.6474015027375792
deviation-center-line_min	0.39602713017350016
deviation-heading_max	1.6261102572235313
deviation-heading_mean	1.3731651041568995
deviation-heading_median	1.551039618121833
deviation-heading_min	0.9967945076898724
driven_any_max	1.3762874604521529
driven_any_mean	1.0164570228997944
driven_any_median	1.3740351986843604
driven_any_min	0.4335428665924545
driven_lanedir_consec_max	0.908997292754194
driven_lanedir_consec_mean	0.7137881716464853
driven_lanedir_consec_min	0.4231274396910571
driven_lanedir_max	1.1435319185403836
driven_lanedir_mean	0.7606950968037232
driven_lanedir_median	0.8598316819885128
driven_lanedir_min	0.4231274396910571
in-drivable-lane_max	5.350000000000076
in-drivable-lane_mean	2.5900000000000367
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3740351986843604, "sim_physics": 0.2278378709157308, "survival_time": 14.950000000000076, "driven_lanedir": 1.1435319185403836, "sim_render-ego": 0.06347626447677612, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.22615297635396325, "deviation-heading": 0.9967945076898724, "set_robot_commands": 0.10123737255732218, "deviation-center-line": 1.1370729844153973, "driven_lanedir_consec": 0.908997292754194, "sim_compute_sim_state": 0.040913686752319336, "sim_compute_performance-ego": 0.06936661720275879, "sim_compute_robot_state-ego": 0.07688597679138183, "sim_compute_robot_state-npc0": 0.07110331217447917, "sim_compute_robot_state-npc1": 0.07123920520146688, "sim_compute_robot_state-npc2": 0.07183711926142375, "sim_compute_robot_state-npc3": 0.07253772497177124}, "udem1-1-0": {"driven_any": 0.5228411314292104, "sim_physics": 0.18958615246465652, "survival_time": 5.899999999999987, "driven_lanedir": 0.5029312350752067, "sim_render-ego": 0.06490195807764086, "in-drivable-lane": 0, "agent_compute-ego": 0.22478479045932576, "deviation-heading": 1.6261102572235313, "set_robot_commands": 0.0981865676782899, "deviation-center-line": 0.4312866232482483, "driven_lanedir_consec": 0.5029312350752067, "sim_compute_sim_state": 0.04070320978003033, "sim_compute_performance-ego": 0.06966923657110181, "sim_compute_robot_state-ego": 0.07449920298689502, "sim_compute_robot_state-npc0": 0.07100628392171052, "sim_compute_robot_state-npc1": 0.07166659629951089, "sim_compute_robot_state-npc2": 0.07199156890481205, "sim_compute_robot_state-npc3": 0.07220980878603661}, "udem1-2-0": {"driven_any": 1.3762874604521529, "sim_physics": 0.2108368746439616, "survival_time": 14.950000000000076, "driven_lanedir": 0.8598316819885128, "sim_render-ego": 0.06607769807179768, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.2247541817029317, "deviation-heading": 1.5950661026447834, "set_robot_commands": 0.1004697060585022, "deviation-center-line": 0.6390920406115075, "driven_lanedir_consec": 0.8598316819885128, "sim_compute_sim_state": 0.04032844622929891, "sim_compute_performance-ego": 0.0722951873143514, "sim_compute_robot_state-ego": 0.07821879863739013, "sim_compute_robot_state-npc0": 0.0714497145016988, "sim_compute_robot_state-npc1": 0.07246667305628458, "sim_compute_robot_state-npc2": 0.0709440565109253, "sim_compute_robot_state-npc3": 0.07061705907185872}, "udem1-3-0": {"driven_any": 1.3755784573407943, "sim_physics": 0.16107252995173135, "survival_time": 14.950000000000076, "driven_lanedir": 0.874053208723456, "sim_render-ego": 0.048139140605926514, "in-drivable-lane": 5.200000000000074, "agent_compute-ego": 0.16756706635157267, "deviation-heading": 1.551039618121833, "set_robot_commands": 0.07408455689748128, "deviation-center-line": 0.6335287352392424, "driven_lanedir_consec": 0.874053208723456, "sim_compute_sim_state": 0.03253581047058105, "sim_compute_performance-ego": 0.05402726491292318, "sim_compute_robot_state-ego": 0.05669204632441203, "sim_compute_robot_state-npc0": 0.056271037260691326, "sim_compute_robot_state-npc1": 0.05423932234446208, "sim_compute_robot_state-npc2": 0.05471124410629272, "sim_compute_robot_state-npc3": 0.05493023951848348}, "udem1-4-0": {"driven_any": 0.4335428665924545, "sim_physics": 0.1044585584390043, "survival_time": 4.94999999999999, "driven_lanedir": 0.4231274396910571, "sim_render-ego": 0.04015491225502708, "in-drivable-lane": 0, "agent_compute-ego": 0.1395166931730328, "deviation-heading": 1.0968150351044763, "set_robot_commands": 0.06072105783404726, "deviation-center-line": 0.39602713017350016, "driven_lanedir_consec": 0.4231274396910571, "sim_compute_sim_state": 0.025413265131940744, "sim_compute_performance-ego": 0.04531621692156551, "sim_compute_robot_state-ego": 0.046306325931741735, "sim_compute_robot_state-npc0": 0.0467812003511371, "sim_compute_robot_state-npc1": 0.04494661514205162, "sim_compute_robot_state-npc2": 0.0441690358248624, "sim_compute_robot_state-npc3": 0.04425382132482047}}
set_robot_commands_max	0.10123737255732218
set_robot_commands_mean	0.08693985220512856
set_robot_commands_median	0.0981865676782899
set_robot_commands_min	0.06072105783404726
sim_compute_performance-ego_max	0.0722951873143514
sim_compute_performance-ego_mean	0.06213490458454014
sim_compute_performance-ego_median	0.06936661720275879
sim_compute_performance-ego_min	0.04531621692156551
sim_compute_robot_state-ego_max	0.07821879863739013
sim_compute_robot_state-ego_mean	0.06652047013436416
sim_compute_robot_state-ego_median	0.07449920298689502
sim_compute_robot_state-ego_min	0.046306325931741735
sim_compute_robot_state-npc0_max	0.0714497145016988
sim_compute_robot_state-npc0_mean	0.06332230964194338
sim_compute_robot_state-npc0_median	0.07100628392171052
sim_compute_robot_state-npc0_min	0.0467812003511371
sim_compute_robot_state-npc1_max	0.07246667305628458
sim_compute_robot_state-npc1_mean	0.0629116824087552
sim_compute_robot_state-npc1_median	0.07123920520146688
sim_compute_robot_state-npc1_min	0.04494661514205162
sim_compute_robot_state-npc2_max	0.07199156890481205
sim_compute_robot_state-npc2_mean	0.06273060492166324
sim_compute_robot_state-npc2_median	0.0709440565109253
sim_compute_robot_state-npc2_min	0.0441690358248624
sim_compute_robot_state-npc3_max	0.07253772497177124
sim_compute_robot_state-npc3_mean	0.0629097307345941
sim_compute_robot_state-npc3_median	0.07061705907185872
sim_compute_robot_state-npc3_min	0.04425382132482047
sim_compute_sim_state_max	0.040913686752319336
sim_compute_sim_state_mean	0.03597888367283407
sim_compute_sim_state_median	0.04032844622929891
sim_compute_sim_state_min	0.025413265131940744
sim_physics_max	0.2278378709157308
sim_physics_mean	0.17875839728301693
sim_physics_median	0.18958615246465652
sim_physics_min	0.1044585584390043
sim_render-ego_max	0.06607769807179768
sim_render-ego_mean	0.05654999469743366
sim_render-ego_median	0.06347626447677612
sim_render-ego_min	0.04015491225502708
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.14000000000004
survival_time_min	4.94999999999999

No reset possible

20620

2369

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 15:00:14+00:00

2019-04-25 15:12:55+00:00

0:12:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3805179887067449
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.1718563908024838
agent_compute-ego_mean	0.16042850884818255
agent_compute-ego_median	0.15842216355460031
agent_compute-ego_min	0.154292665736776
deviation-center-line_max	0.8219069617270801
deviation-center-line_mean	0.4622890220224802
deviation-center-line_min	0.240946508088056
deviation-heading_max	1.819384597985526
deviation-heading_mean	0.9470500519861752
deviation-heading_median	0.8064348941516836
deviation-heading_min	0.5022393903257442
driven_any_max	1.5790906665051212
driven_any_mean	0.90897363561738
driven_any_median	0.9970530395825568
driven_any_min	0.2870933095253068
driven_lanedir_consec_max	1.1522212258289768
driven_lanedir_consec_mean	0.7286312661816596
driven_lanedir_consec_min	0.2804952221609298
driven_lanedir_max	1.1522212258289768
driven_lanedir_mean	0.7286312661816596
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.2804952221609298
in-drivable-lane_max	2.80000000000004
in-drivable-lane_mean	1.0400000000000065
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.12071656840188162, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06317135606493268, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15471432549612862, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.09523192303521293, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.038918517317090714, "sim_compute_performance-ego": 0.0706614579473223, "sim_compute_robot_state-ego": 0.07590357746396746}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.018001036910281, "sim_physics": 0.1100476795518902, "survival_time": 7.099999999999983, "driven_lanedir": 0.9032065052271656, "sim_render-ego": 0.0634082018489569, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.154292665736776, "deviation-heading": 1.819384597985526, "set_robot_commands": 0.09890545421922713, "deviation-center-line": 0.5370569656769042, "driven_lanedir_consec": 0.9032065052271656, "sim_compute_sim_state": 0.03860954331680083, "sim_compute_performance-ego": 0.07079460419399637, "sim_compute_robot_state-ego": 0.07268585453570729}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2870933095253068, "sim_physics": 0.10517018255980118, "survival_time": 2.3, "driven_lanedir": 0.2804952221609298, "sim_render-ego": 0.06485894451970639, "in-drivable-lane": 0, "agent_compute-ego": 0.162856998650924, "deviation-heading": 0.5022393903257442, "set_robot_commands": 0.09745944064596423, "deviation-center-line": 0.240946508088056, "driven_lanedir_consec": 0.2804952221609298, "sim_compute_sim_state": 0.040407600610152535, "sim_compute_performance-ego": 0.07241527412248694, "sim_compute_robot_state-ego": 0.07270348590353261}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6636301255636338, "sim_physics": 0.10966780813116776, "survival_time": 4.749999999999991, "driven_lanedir": 0.6490920375973404, "sim_render-ego": 0.06785222856621993, "in-drivable-lane": 0, "agent_compute-ego": 0.1718563908024838, "deviation-heading": 0.9802944231598162, "set_robot_commands": 0.10850392391807157, "deviation-center-line": 0.3805179887067449, "driven_lanedir_consec": 0.6490920375973404, "sim_compute_sim_state": 0.04136623081408049, "sim_compute_performance-ego": 0.07536306381225585, "sim_compute_robot_state-ego": 0.09169400867662932}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5790906665051212, "sim_physics": 0.1323809414964667, "survival_time": 10.85000000000002, "driven_lanedir": 1.1522212258289768, "sim_render-ego": 0.06349129940507599, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.15842216355460031, "deviation-heading": 0.626896954308107, "set_robot_commands": 0.0972523260775799, "deviation-center-line": 0.8219069617270801, "driven_lanedir_consec": 1.1522212258289768, "sim_compute_sim_state": 0.038959987701908234, "sim_compute_performance-ego": 0.07171595700874855, "sim_compute_robot_state-ego": 0.07567405700683594}}
set_robot_commands_max	0.10850392391807157
set_robot_commands_mean	0.09947061357921114
set_robot_commands_median	0.09745944064596423
set_robot_commands_min	0.09523192303521293
sim_compute_performance-ego_max	0.07536306381225585
sim_compute_performance-ego_mean	0.07219007141696202
sim_compute_performance-ego_median	0.07171595700874855
sim_compute_performance-ego_min	0.0706614579473223
sim_compute_robot_state-ego_max	0.09169400867662932
sim_compute_robot_state-ego_mean	0.07773219671733453
sim_compute_robot_state-ego_median	0.07567405700683594
sim_compute_robot_state-ego_min	0.07268585453570729
sim_compute_sim_state_max	0.04136623081408049
sim_compute_sim_state_mean	0.03965237595200656
sim_compute_sim_state_median	0.038959987701908234
sim_compute_sim_state_min	0.03860954331680083
sim_physics_max	0.1323809414964667
sim_physics_mean	0.11559663602824148
sim_physics_median	0.1100476795518902
sim_physics_min	0.10517018255980118
sim_render-ego_max	0.06785222856621993
sim_render-ego_mean	0.06455640608097837
sim_render-ego_median	0.06349129940507599
sim_render-ego_min	0.06317135606493268
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	6.399999999999995
survival_time_min	2.3

No reset possible

20579

2412

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:29:30+00:00

2019-04-25 15:00:06+00:00

0:30:36

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20579-92859', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20579-92859', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20579-92859', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20575

2417

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 14:23:18+00:00

2019-04-25 14:29:23+00:00

0:06:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15476086616516113
agent_compute-ego_mean	0.14527708136768153
agent_compute-ego_median	0.1423741286655642
agent_compute-ego_min	0.13675501713385949
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.10602814296506484, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06396169482537035, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1423741286655642, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09654785552114813, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03866307240612102, "sim_compute_performance-ego": 0.07043081409526321, "sim_compute_robot_state-ego": 0.07259798949619509}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.1100320632641132, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06876927614212036, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1523631398494427, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.14623061051735511, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.0424494926746075, "sim_compute_performance-ego": 0.0739326889698322, "sim_compute_robot_state-ego": 0.08780839810004601}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.08349422613779704, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06655806965298122, "in-drivable-lane": 0, "agent_compute-ego": 0.14013225502438015, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.09725830290052626, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.040611730681525335, "sim_compute_performance-ego": 0.07213332917955187, "sim_compute_robot_state-ego": 0.0694536632961697}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.12678395271301268, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.07091868400573731, "in-drivable-lane": 0, "agent_compute-ego": 0.15476086616516113, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.1143195915222168, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.0479615306854248, "sim_compute_performance-ego": 0.07808453559875489, "sim_compute_robot_state-ego": 0.08554333686828614}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.096509670599913, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06443953819763966, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13675501713385949, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.09860964310474885, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.04055987871610201, "sim_compute_performance-ego": 0.07091878010676457, "sim_compute_robot_state-ego": 0.07544157443902431}}
set_robot_commands_max	0.14623061051735511
set_robot_commands_mean	0.11059320071319904
set_robot_commands_median	0.09860964310474885
set_robot_commands_min	0.09654785552114813
sim_compute_performance-ego_max	0.07808453559875489
sim_compute_performance-ego_mean	0.07310002959003334
sim_compute_performance-ego_median	0.07213332917955187
sim_compute_performance-ego_min	0.07043081409526321
sim_compute_robot_state-ego_max	0.08780839810004601
sim_compute_robot_state-ego_mean	0.07816899243994425
sim_compute_robot_state-ego_median	0.07544157443902431
sim_compute_robot_state-ego_min	0.0694536632961697
sim_compute_sim_state_max	0.0479615306854248
sim_compute_sim_state_mean	0.04204914103275613
sim_compute_sim_state_median	0.040611730681525335
sim_compute_sim_state_min	0.03866307240612102
sim_physics_max	0.12678395271301268
sim_physics_mean	0.10456961113598016
sim_physics_median	0.10602814296506484
sim_physics_min	0.08349422613779704
sim_render-ego_max	0.07091868400573731
sim_render-ego_mean	0.06692945256476977
sim_render-ego_median	0.06655806965298122
sim_render-ego_min	0.06396169482537035
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20571

2432

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 14:21:59+00:00

2019-04-25 14:22:56+00:00

0:00:57

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20564

2439

Jacopo Tani

random_agent

step1-simulation

success

2019-04-25 14:15:01+00:00

2019-04-25 14:21:11+00:00

0:06:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.17727798885769314
agent_compute-ego_mean	0.1637792676858913
agent_compute-ego_median	0.16233843717819604
agent_compute-ego_min	0.1524903499163114
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.11228327481251844, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06310109372408886, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1648485300675878, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.1069782499997121, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04208959273572238, "sim_compute_performance-ego": 0.073615348564004, "sim_compute_robot_state-ego": 0.08041092134871573}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.103232374558082, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06224854175861065, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1524903499163114, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.09823921552071203, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03965678581824669, "sim_compute_performance-ego": 0.06923128549869244, "sim_compute_robot_state-ego": 0.07530105572480422}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.10702906714545356, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06666792763604058, "in-drivable-lane": 0, "agent_compute-ego": 0.17727798885769314, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10617150200737847, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.04425916406843397, "sim_compute_performance-ego": 0.07648893197377522, "sim_compute_robot_state-ego": 0.09844312402937148}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.11043608665466308, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06389381408691407, "in-drivable-lane": 0, "agent_compute-ego": 0.16194103240966798, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.10976646423339843, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.03898192405700684, "sim_compute_performance-ego": 0.07159004211425782, "sim_compute_robot_state-ego": 0.08741911888122558}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.10311155441479804, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06652322182288536, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.16233843717819604, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.10249899289546868, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.04001523898198055, "sim_compute_performance-ego": 0.07111734916002323, "sim_compute_robot_state-ego": 0.07708993324866661}}
set_robot_commands_max	0.10976646423339843
set_robot_commands_mean	0.10473088493133394
set_robot_commands_median	0.10617150200737847
set_robot_commands_min	0.09823921552071203
sim_compute_performance-ego_max	0.07648893197377522
sim_compute_performance-ego_mean	0.07240859146215053
sim_compute_performance-ego_median	0.07159004211425782
sim_compute_performance-ego_min	0.06923128549869244
sim_compute_robot_state-ego_max	0.09844312402937148
sim_compute_robot_state-ego_mean	0.08373283064655672
sim_compute_robot_state-ego_median	0.08041092134871573
sim_compute_robot_state-ego_min	0.07530105572480422
sim_compute_sim_state_max	0.04425916406843397
sim_compute_sim_state_mean	0.04100054113227809
sim_compute_sim_state_median	0.04001523898198055
sim_compute_sim_state_min	0.03898192405700684
sim_physics_max	0.11228327481251844
sim_physics_mean	0.10721847151710302
sim_physics_median	0.10702906714545356
sim_physics_min	0.10311155441479804
sim_render-ego_max	0.06666792763604058
sim_render-ego_mean	0.0644869198057079
sim_render-ego_median	0.06389381408691407
sim_render-ego_min	0.06224854175861065
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20529

2496

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 14:01:40+00:00

2019-04-25 14:14:52+00:00

0:13:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0659757622710524
survival_time_median	1.5000000000000009
deviation-center-line_median	0.08842629246992709
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.18158092896143596
agent_compute-ego_mean	0.15779245656559343
agent_compute-ego_median	0.1742171265862205
agent_compute-ego_min	0.12737716947283065
deviation-center-line_max	0.4935332566452535
deviation-center-line_mean	0.1534708602029612
deviation-center-line_min	0.029267809345305505
deviation-heading_max	6.163565501244479
deviation-heading_mean	1.7626949570392267
deviation-heading_median	0.7005667521999164
deviation-heading_min	0.5233224632428769
driven_any_max	1.880673896027616
driven_any_mean	0.48614696704397264
driven_any_median	0.14094677501918984
driven_any_min	0.099523576049591
driven_lanedir_consec_max	0.6901116351915433
driven_lanedir_consec_mean	0.18651622155377792
driven_lanedir_consec_min	0.0459360526236926
driven_lanedir_max	0.6901116351915433
driven_lanedir_mean	0.18651622155377792
driven_lanedir_median	0.0659757622710524
driven_lanedir_min	0.0459360526236926
in-drivable-lane_max	6.850000000000036
in-drivable-lane_mean	1.6100000000000072
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.880673896027616, "sim_physics": 0.19572144190470375, "survival_time": 14.950000000000076, "driven_lanedir": 0.6901116351915433, "sim_render-ego": 0.06479024330774943, "in-drivable-lane": 6.850000000000036, "agent_compute-ego": 0.18158092896143596, "deviation-heading": 6.163565501244479, "set_robot_commands": 0.09957640965779622, "deviation-center-line": 0.4935332566452535, "driven_lanedir_consec": 0.6901116351915433, "sim_compute_sim_state": 0.0402580205599467, "sim_compute_performance-ego": 0.07385121027628581, "sim_compute_robot_state-ego": 0.07803165435791015, "sim_compute_robot_state-npc0": 0.07152402559916178, "sim_compute_robot_state-npc1": 0.07285678227742513, "sim_compute_robot_state-npc2": 0.07207623720169068, "sim_compute_robot_state-npc3": 0.07195017735163371}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19444863287277975, "sim_physics": 0.09742003849574496, "survival_time": 1.7500000000000009, "driven_lanedir": 0.050778748312588995, "sim_render-ego": 0.04310492106846401, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.12737716947283065, "deviation-heading": 0.8170443457523371, "set_robot_commands": 0.06734047617231097, "deviation-center-line": 0.05544401538996085, "driven_lanedir_consec": 0.050778748312588995, "sim_compute_sim_state": 0.027866458892822264, "sim_compute_performance-ego": 0.05014944076538086, "sim_compute_robot_state-ego": 0.05146444184439523, "sim_compute_robot_state-npc0": 0.04898952756609235, "sim_compute_robot_state-npc1": 0.04851173673357282, "sim_compute_robot_state-npc2": 0.04876132011413574, "sim_compute_robot_state-npc3": 0.04887369019644601}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.099523576049591, "sim_physics": 0.11465852156929349, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0659757622710524, "sim_render-ego": 0.04965723079183827, "in-drivable-lane": 0, "agent_compute-ego": 0.13073942972266156, "deviation-heading": 0.6089757227565242, "set_robot_commands": 0.07581045316613239, "deviation-center-line": 0.10068292716435907, "driven_lanedir_consec": 0.0659757622710524, "sim_compute_sim_state": 0.030366503674051037, "sim_compute_performance-ego": 0.05107650549515434, "sim_compute_robot_state-ego": 0.0554566072381061, "sim_compute_robot_state-npc0": 0.05675289941870648, "sim_compute_robot_state-npc1": 0.05333893195442531, "sim_compute_robot_state-npc2": 0.053855978924295174, "sim_compute_robot_state-npc3": 0.05347400126249894}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1151419552506864, "sim_physics": 0.1581764112819325, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07977890937001231, "sim_render-ego": 0.061772790822115814, "in-drivable-lane": 0, "agent_compute-ego": 0.1742171265862205, "deviation-heading": 0.5233224632428769, "set_robot_commands": 0.09777193719690495, "deviation-center-line": 0.08842629246992709, "driven_lanedir_consec": 0.07977890937001231, "sim_compute_sim_state": 0.0374404408714988, "sim_compute_performance-ego": 0.07693699273196133, "sim_compute_robot_state-ego": 0.07405850020321933, "sim_compute_robot_state-npc0": 0.0726214972409335, "sim_compute_robot_state-npc1": 0.06968343257904053, "sim_compute_robot_state-npc2": 0.06828982179815118, "sim_compute_robot_state-npc3": 0.07161829688332298}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14094677501918984, "sim_physics": 0.14833482106526694, "survival_time": 1.5000000000000009, "driven_lanedir": 0.0459360526236926, "sim_render-ego": 0.06253037452697754, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17504762808481852, "deviation-heading": 0.7005667521999164, "set_robot_commands": 0.09790756702423097, "deviation-center-line": 0.029267809345305505, "driven_lanedir_consec": 0.0459360526236926, "sim_compute_sim_state": 0.04097827275594076, "sim_compute_performance-ego": 0.06965022881825765, "sim_compute_robot_state-ego": 0.07735729217529297, "sim_compute_robot_state-npc0": 0.0692320187886556, "sim_compute_robot_state-npc1": 0.07277754147847494, "sim_compute_robot_state-npc2": 0.0773080031077067, "sim_compute_robot_state-npc3": 0.07377257347106933}}
set_robot_commands_max	0.09957640965779622
set_robot_commands_mean	0.08768136864347512
set_robot_commands_median	0.09777193719690495
set_robot_commands_min	0.06734047617231097
sim_compute_performance-ego_max	0.07693699273196133
sim_compute_performance-ego_mean	0.064332875617408
sim_compute_performance-ego_median	0.06965022881825765
sim_compute_performance-ego_min	0.05014944076538086
sim_compute_robot_state-ego_max	0.07803165435791015
sim_compute_robot_state-ego_mean	0.06727369916378476
sim_compute_robot_state-ego_median	0.07405850020321933
sim_compute_robot_state-ego_min	0.05146444184439523
sim_compute_robot_state-npc0_max	0.0726214972409335
sim_compute_robot_state-npc0_mean	0.06382399372270994
sim_compute_robot_state-npc0_median	0.0692320187886556
sim_compute_robot_state-npc0_min	0.04898952756609235
sim_compute_robot_state-npc1_max	0.07285678227742513
sim_compute_robot_state-npc1_mean	0.06343368500458775
sim_compute_robot_state-npc1_median	0.06968343257904053
sim_compute_robot_state-npc1_min	0.04851173673357282
sim_compute_robot_state-npc2_max	0.0773080031077067
sim_compute_robot_state-npc2_mean	0.0640582722291959
sim_compute_robot_state-npc2_median	0.06828982179815118
sim_compute_robot_state-npc2_min	0.04876132011413574
sim_compute_robot_state-npc3_max	0.07377257347106933
sim_compute_robot_state-npc3_mean	0.06393774783299419
sim_compute_robot_state-npc3_median	0.07161829688332298
sim_compute_robot_state-npc3_min	0.04887369019644601
sim_compute_sim_state_max	0.04097827275594076
sim_compute_sim_state_mean	0.03538193935085192
sim_compute_sim_state_median	0.0374404408714988
sim_compute_sim_state_min	0.027866458892822264
sim_physics_max	0.19572144190470375
sim_physics_mean	0.14286224686338833
sim_physics_median	0.14833482106526694
sim_physics_min	0.09742003849574496
sim_render-ego_max	0.06479024330774943
sim_render-ego_mean	0.05637111210342901
sim_render-ego_median	0.061772790822115814
sim_render-ego_min	0.04310492106846401
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.090000000000016
survival_time_min	1.1000000000000003

No reset possible

20519

2524

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:00:34+00:00

2019-04-25 14:01:17+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20504

2513

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

host-error

2019-04-25 13:58:47+00:00

2019-04-25 14:00:13+00:00

0:01:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20504-3355', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20504-3355', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20504-3355', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20478

2556

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:43:20+00:00

2019-04-25 13:58:04+00:00

0:14:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.07712104810890577
agent_compute-ego_mean	0.07505360771674284
agent_compute-ego_median	0.07505043091312531
agent_compute-ego_min	0.07355256315688012
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1911488798531619, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.06613893129608849, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.07362080704082143, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.10201643000949512, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.04187490181489424, "sim_compute_performance-ego": 0.07091891223734076, "sim_compute_robot_state-ego": 0.0793749446218664, "sim_compute_robot_state-npc0": 0.07141131704503839, "sim_compute_robot_state-npc1": 0.07248880104585127, "sim_compute_robot_state-npc2": 0.07213845036246559, "sim_compute_robot_state-npc3": 0.07241847298362038}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.18015433895972469, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.06600229970870479, "in-drivable-lane": 0, "agent_compute-ego": 0.07505043091312531, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.1002487059562437, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.03943972433767011, "sim_compute_performance-ego": 0.06971811479137789, "sim_compute_robot_state-ego": 0.07996924461856965, "sim_compute_robot_state-npc0": 0.07111332493443642, "sim_compute_robot_state-npc1": 0.07250499725341797, "sim_compute_robot_state-npc2": 0.07094790858607139, "sim_compute_robot_state-npc3": 0.0709298195377473}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.2020960682672812, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.06660920339273223, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07712104810890577, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.10318995874824254, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.04216137338191905, "sim_compute_performance-ego": 0.07310610629142598, "sim_compute_robot_state-ego": 0.07752487169089892, "sim_compute_robot_state-npc0": 0.07231091100273403, "sim_compute_robot_state-npc1": 0.07196014147278265, "sim_compute_robot_state-npc2": 0.07191976080549524, "sim_compute_robot_state-npc3": 0.07170307889897773}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.1952156117087916, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.06329868467230546, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.07592318936398154, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.12786836875112434, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.03975710868835449, "sim_compute_performance-ego": 0.07074226329201146, "sim_compute_robot_state-ego": 0.07587082260533383, "sim_compute_robot_state-npc0": 0.06976862204702276, "sim_compute_robot_state-npc1": 0.0727661885713276, "sim_compute_robot_state-npc2": 0.06971093980889571, "sim_compute_robot_state-npc3": 0.07009916556508917}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.194771988291136, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.05973462487610293, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.07355256315688012, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.09284089988386128, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.03737748844522826, "sim_compute_performance-ego": 0.06434348603369484, "sim_compute_robot_state-ego": 0.07077320528701997, "sim_compute_robot_state-npc0": 0.0666026598970655, "sim_compute_robot_state-npc1": 0.0665178853021541, "sim_compute_robot_state-npc2": 0.06738355629880663, "sim_compute_robot_state-npc3": 0.06905401256722464}}
set_robot_commands_max	0.12786836875112434
set_robot_commands_mean	0.1052328726697934
set_robot_commands_median	0.10201643000949512
set_robot_commands_min	0.09284089988386128
sim_compute_performance-ego_max	0.07310610629142598
sim_compute_performance-ego_mean	0.06976577652917018
sim_compute_performance-ego_median	0.07074226329201146
sim_compute_performance-ego_min	0.06434348603369484
sim_compute_robot_state-ego_max	0.07996924461856965
sim_compute_robot_state-ego_mean	0.07670261776473775
sim_compute_robot_state-ego_median	0.07752487169089892
sim_compute_robot_state-ego_min	0.07077320528701997
sim_compute_robot_state-npc0_max	0.07231091100273403
sim_compute_robot_state-npc0_mean	0.07024136698525943
sim_compute_robot_state-npc0_median	0.07111332493443642
sim_compute_robot_state-npc0_min	0.0666026598970655
sim_compute_robot_state-npc1_max	0.0727661885713276
sim_compute_robot_state-npc1_mean	0.07124760272910671
sim_compute_robot_state-npc1_median	0.07248880104585127
sim_compute_robot_state-npc1_min	0.0665178853021541
sim_compute_robot_state-npc2_max	0.07213845036246559
sim_compute_robot_state-npc2_mean	0.07042012317234692
sim_compute_robot_state-npc2_median	0.07094790858607139
sim_compute_robot_state-npc2_min	0.06738355629880663
sim_compute_robot_state-npc3_max	0.07241847298362038
sim_compute_robot_state-npc3_mean	0.07084090991053185
sim_compute_robot_state-npc3_median	0.0709298195377473
sim_compute_robot_state-npc3_min	0.06905401256722464
sim_compute_sim_state_max	0.04216137338191905
sim_compute_sim_state_mean	0.04012211933361323
sim_compute_sim_state_median	0.03975710868835449
sim_compute_sim_state_min	0.03737748844522826
sim_physics_max	0.2020960682672812
sim_physics_mean	0.19267737741601904
sim_physics_median	0.194771988291136
sim_physics_min	0.18015433895972469
sim_render-ego_max	0.06660920339273223
sim_render-ego_mean	0.06435674878918678
sim_render-ego_median	0.06600229970870479
sim_render-ego_min	0.05973462487610293
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20459

2594

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:27:37+00:00

2019-04-25 13:43:06+00:00

0:15:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.23742431771408337
survival_time_median	5.249999999999989
deviation-center-line_median	0.3775810813904956
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2467980231008222
agent_compute-ego_mean	0.2437682962898738
agent_compute-ego_median	0.24444311693174028
agent_compute-ego_min	0.24084106555654983
deviation-center-line_max	0.4812592494275212
deviation-center-line_mean	0.3791363369610756
deviation-center-line_min	0.25525762198622726
deviation-heading_max	2.864164948425625
deviation-heading_mean	2.232738454101754
deviation-heading_median	1.9939175266194455
deviation-heading_min	1.6807534818655607
driven_any_max	0.33361282571752837
driven_any_mean	0.2653032337523687
driven_any_median	0.26187965731349305
driven_any_min	0.20624579030577064
driven_lanedir_consec_max	0.2813971037513452
driven_lanedir_consec_mean	0.22558869507360133
driven_lanedir_consec_min	0.16799898154258042
driven_lanedir_max	0.2813971037513452
driven_lanedir_mean	0.22558869507360133
driven_lanedir_median	0.23742431771408337
driven_lanedir_min	0.16799898154258042
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.33361282571752837, "sim_physics": 0.18133914766232828, "survival_time": 6.0499999999999865, "driven_lanedir": 0.2813971037513452, "sim_render-ego": 0.06266274925105828, "in-drivable-lane": 0, "agent_compute-ego": 0.24084106555654983, "deviation-heading": 2.816299113820659, "set_robot_commands": 0.09658217430114746, "deviation-center-line": 0.3775810813904956, "driven_lanedir_consec": 0.2813971037513452, "sim_compute_sim_state": 0.040902366322919353, "sim_compute_performance-ego": 0.07002242734609557, "sim_compute_robot_state-ego": 0.0736648110318775, "sim_compute_robot_state-npc0": 0.06863255540201486, "sim_compute_robot_state-npc1": 0.07053382140545805, "sim_compute_robot_state-npc2": 0.06964023448218984, "sim_compute_robot_state-npc3": 0.06879311947783162}, "udem1-1-0": {"driven_any": 0.2631263150361719, "sim_physics": 0.20368282769315987, "survival_time": 4.6499999999999915, "driven_lanedir": 0.2018793714742091, "sim_render-ego": 0.0713837710759973, "in-drivable-lane": 0, "agent_compute-ego": 0.2467980231008222, "deviation-heading": 2.864164948425625, "set_robot_commands": 0.09980937229689732, "deviation-center-line": 0.30341441411657255, "driven_lanedir_consec": 0.2018793714742091, "sim_compute_sim_state": 0.04083567793651294, "sim_compute_performance-ego": 0.0711279889588715, "sim_compute_robot_state-ego": 0.07657161322973108, "sim_compute_robot_state-npc0": 0.07706259655696089, "sim_compute_robot_state-npc1": 0.07192801916471092, "sim_compute_robot_state-npc2": 0.06926117148450626, "sim_compute_robot_state-npc3": 0.07073830532771284}, "udem1-2-0": {"driven_any": 0.26165158038887953, "sim_physics": 0.20276184536161876, "survival_time": 5.249999999999989, "driven_lanedir": 0.2392437008857886, "sim_render-ego": 0.06644436518351236, "in-drivable-lane": 0, "agent_compute-ego": 0.245290740331014, "deviation-heading": 1.6807534818655607, "set_robot_commands": 0.09965340523492722, "deviation-center-line": 0.4812592494275212, "driven_lanedir_consec": 0.2392437008857886, "sim_compute_sim_state": 0.03997697149004255, "sim_compute_performance-ego": 0.07039194107055664, "sim_compute_robot_state-ego": 0.07434979620433989, "sim_compute_robot_state-npc0": 0.0713608741760254, "sim_compute_robot_state-npc1": 0.07041352135794503, "sim_compute_robot_state-npc2": 0.0707601819719587, "sim_compute_robot_state-npc3": 0.07033453441801525}, "udem1-3-0": {"driven_any": 0.26187965731349305, "sim_physics": 0.19341474716816473, "survival_time": 5.449999999999989, "driven_lanedir": 0.23742431771408337, "sim_render-ego": 0.06456931577909977, "in-drivable-lane": 0, "agent_compute-ego": 0.24444311693174028, "deviation-heading": 1.8085571997774763, "set_robot_commands": 0.0986871806853408, "deviation-center-line": 0.4781693178845614, "driven_lanedir_consec": 0.23742431771408337, "sim_compute_sim_state": 0.03930727713698641, "sim_compute_performance-ego": 0.06845563923547027, "sim_compute_robot_state-ego": 0.07640541365387243, "sim_compute_robot_state-npc0": 0.07165258302601106, "sim_compute_robot_state-npc1": 0.07133670028196562, "sim_compute_robot_state-npc2": 0.07306717076432814, "sim_compute_robot_state-npc3": 0.07416958765152397}, "udem1-4-0": {"driven_any": 0.20624579030577064, "sim_physics": 0.1686365372604794, "survival_time": 3.599999999999995, "driven_lanedir": 0.16799898154258042, "sim_render-ego": 0.06362339191966587, "in-drivable-lane": 0, "agent_compute-ego": 0.24146853552924263, "deviation-heading": 1.9939175266194455, "set_robot_commands": 0.09982406430774264, "deviation-center-line": 0.25525762198622726, "driven_lanedir_consec": 0.16799898154258042, "sim_compute_sim_state": 0.04170821772681342, "sim_compute_performance-ego": 0.07168995671802098, "sim_compute_robot_state-ego": 0.07284256484773424, "sim_compute_robot_state-npc0": 0.07410075598292881, "sim_compute_robot_state-npc1": 0.07215867771042718, "sim_compute_robot_state-npc2": 0.07142945461803013, "sim_compute_robot_state-npc3": 0.0743216441737281}}
set_robot_commands_max	0.09982406430774264
set_robot_commands_mean	0.0989112393652111
set_robot_commands_median	0.09965340523492722
set_robot_commands_min	0.09658217430114746
sim_compute_performance-ego_max	0.07168995671802098
sim_compute_performance-ego_mean	0.07033759066580299
sim_compute_performance-ego_median	0.07039194107055664
sim_compute_performance-ego_min	0.06845563923547027
sim_compute_robot_state-ego_max	0.07657161322973108
sim_compute_robot_state-ego_mean	0.07476683979351102
sim_compute_robot_state-ego_median	0.07434979620433989
sim_compute_robot_state-ego_min	0.07284256484773424
sim_compute_robot_state-npc0_max	0.07706259655696089
sim_compute_robot_state-npc0_mean	0.0725618730287882
sim_compute_robot_state-npc0_median	0.07165258302601106
sim_compute_robot_state-npc0_min	0.06863255540201486
sim_compute_robot_state-npc1_max	0.07215867771042718
sim_compute_robot_state-npc1_mean	0.07127414798410137
sim_compute_robot_state-npc1_median	0.07133670028196562
sim_compute_robot_state-npc1_min	0.07041352135794503
sim_compute_robot_state-npc2_max	0.07306717076432814
sim_compute_robot_state-npc2_mean	0.07083164266420262
sim_compute_robot_state-npc2_median	0.0707601819719587
sim_compute_robot_state-npc2_min	0.06926117148450626
sim_compute_robot_state-npc3_max	0.0743216441737281
sim_compute_robot_state-npc3_mean	0.07167143820976236
sim_compute_robot_state-npc3_median	0.07073830532771284
sim_compute_robot_state-npc3_min	0.06879311947783162
sim_compute_sim_state_max	0.04170821772681342
sim_compute_sim_state_mean	0.040546102122654935
sim_compute_sim_state_median	0.04083567793651294
sim_compute_sim_state_min	0.03930727713698641
sim_physics_max	0.20368282769315987
sim_physics_mean	0.1899670210291502
sim_physics_median	0.19341474716816473
sim_physics_min	0.1686365372604794
sim_render-ego_max	0.0713837710759973
sim_render-ego_mean	0.06573671864186671
sim_render-ego_median	0.06456931577909977
sim_render-ego_min	0.06266274925105828
simulation-passed	1
survival_time_max	6.0499999999999865
survival_time_mean	4.99999999999999
survival_time_min	3.599999999999995

No reset possible

20457

2596

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 13:25:54+00:00

2019-04-25 13:26:42+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20456

2597

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 13:24:16+00:00

2019-04-25 13:25:23+00:00

0:01:07

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20453

2600

Liam Paull 🇨🇦

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 13:22:37+00:00

2019-04-25 13:23:40+00:00

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20442

2624

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:11:19+00:00

2019-04-25 13:22:29+00:00

0:11:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18462052183636168
agent_compute-ego_mean	0.1719779458429473
agent_compute-ego_median	0.18243809473716607
agent_compute-ego_min	0.13201063871383667
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.2188069483019271, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.07180622613654947, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.17816999723326485, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.11688566207885742, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.046525633560036715, "sim_compute_performance-ego": 0.08065014965129348, "sim_compute_robot_state-ego": 0.0882664514037798, "sim_compute_robot_state-npc0": 0.0800689233923858, "sim_compute_robot_state-npc1": 0.0799834593287054, "sim_compute_robot_state-npc2": 0.0805725893884335, "sim_compute_robot_state-npc3": 0.07945963796579612}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.20153915882110596, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.06759114066759746, "in-drivable-lane": 0, "agent_compute-ego": 0.18265047669410703, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.11083962519963582, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.04343701402346293, "sim_compute_performance-ego": 0.07384111483891805, "sim_compute_robot_state-ego": 0.08849074443181355, "sim_compute_robot_state-npc0": 0.07737204432487488, "sim_compute_robot_state-npc1": 0.07857230305671692, "sim_compute_robot_state-npc2": 0.07664337754249573, "sim_compute_robot_state-npc3": 0.07942915956179301}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.21736663478915977, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.07432001728122517, "in-drivable-lane": 0, "agent_compute-ego": 0.18462052183636168, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.11552648221032094, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.0482365034394345, "sim_compute_performance-ego": 0.08423461752422785, "sim_compute_robot_state-ego": 0.0911330893888312, "sim_compute_robot_state-npc0": 0.0794605562242411, "sim_compute_robot_state-npc1": 0.08026112136194262, "sim_compute_robot_state-npc2": 0.07925449387501862, "sim_compute_robot_state-npc3": 0.083827289484315}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.24206533270367123, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.07387438871092715, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.18243809473716607, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.1148618277856859, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.045679811703956734, "sim_compute_performance-ego": 0.080226275880458, "sim_compute_robot_state-ego": 0.090977911221779, "sim_compute_robot_state-npc0": 0.07791580992229914, "sim_compute_robot_state-npc1": 0.07689594818373859, "sim_compute_robot_state-npc2": 0.08008470373638606, "sim_compute_robot_state-npc3": 0.08057162721278303}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1436115622520447, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.05502960681915283, "in-drivable-lane": 0, "agent_compute-ego": 0.13201063871383667, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.07953802347183228, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03637802600860596, "sim_compute_performance-ego": 0.06040080785751343, "sim_compute_robot_state-ego": 0.06370433568954467, "sim_compute_robot_state-npc0": 0.06034095287322998, "sim_compute_robot_state-npc1": 0.060076427459716794, "sim_compute_robot_state-npc2": 0.05959228277206421, "sim_compute_robot_state-npc3": 0.06227587461471558}}
set_robot_commands_max	0.11688566207885742
set_robot_commands_mean	0.10753032414926648
set_robot_commands_median	0.1148618277856859
set_robot_commands_min	0.07953802347183228
sim_compute_performance-ego_max	0.08423461752422785
sim_compute_performance-ego_mean	0.07587059315048217
sim_compute_performance-ego_median	0.080226275880458
sim_compute_performance-ego_min	0.06040080785751343
sim_compute_robot_state-ego_max	0.0911330893888312
sim_compute_robot_state-ego_mean	0.08451450642714964
sim_compute_robot_state-ego_median	0.08849074443181355
sim_compute_robot_state-ego_min	0.06370433568954467
sim_compute_robot_state-npc0_max	0.0800689233923858
sim_compute_robot_state-npc0_mean	0.07503165734740617
sim_compute_robot_state-npc0_median	0.07791580992229914
sim_compute_robot_state-npc0_min	0.06034095287322998
sim_compute_robot_state-npc1_max	0.08026112136194262
sim_compute_robot_state-npc1_mean	0.07515785187816407
sim_compute_robot_state-npc1_median	0.07857230305671692
sim_compute_robot_state-npc1_min	0.060076427459716794
sim_compute_robot_state-npc2_max	0.0805725893884335
sim_compute_robot_state-npc2_mean	0.07522948946287962
sim_compute_robot_state-npc2_median	0.07925449387501862
sim_compute_robot_state-npc2_min	0.05959228277206421
sim_compute_robot_state-npc3_max	0.083827289484315
sim_compute_robot_state-npc3_mean	0.07711271776788055
sim_compute_robot_state-npc3_median	0.07945963796579612
sim_compute_robot_state-npc3_min	0.06227587461471558
sim_compute_sim_state_max	0.0482365034394345
sim_compute_sim_state_mean	0.04405139774709937
sim_compute_sim_state_median	0.045679811703956734
sim_compute_sim_state_min	0.03637802600860596
sim_physics_max	0.24206533270367123
sim_physics_mean	0.20467792737358176
sim_physics_median	0.21736663478915977
sim_physics_min	0.1436115622520447
sim_render-ego_max	0.07432001728122517
sim_render-ego_mean	0.06852427592309042
sim_render-ego_median	0.07180622613654947
sim_render-ego_min	0.05502960681915283
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20432

2644

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:00:20+00:00

2019-04-25 13:10:20+00:00

0:10:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08525361838164153
agent_compute-ego_mean	0.08299827147060149
agent_compute-ego_median	0.08424577862024307
agent_compute-ego_min	0.07992989283341628
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.18013522813194677, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.0760190581020556, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.0844121073421679, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.1154454319100631, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.04739208911594592, "sim_compute_performance-ego": 0.0823551855589214, "sim_compute_robot_state-ego": 0.09162219260868272, "sim_compute_robot_state-npc0": 0.07968675149114508, "sim_compute_robot_state-npc1": 0.07910692064385665, "sim_compute_robot_state-npc2": 0.08330058737805016, "sim_compute_robot_state-npc3": 0.08308654082448859}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.19391505420207977, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.07607356458902359, "in-drivable-lane": 0, "agent_compute-ego": 0.08424577862024307, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.11478570848703384, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.04854737967252731, "sim_compute_performance-ego": 0.08195831626653671, "sim_compute_robot_state-ego": 0.09350269287824632, "sim_compute_robot_state-npc0": 0.08340166509151459, "sim_compute_robot_state-npc1": 0.08061224967241287, "sim_compute_robot_state-npc2": 0.08028530329465866, "sim_compute_robot_state-npc3": 0.07980597019195557}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.18578711839822623, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.06960277832471408, "in-drivable-lane": 0, "agent_compute-ego": 0.07992989283341628, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.10565357483350314, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.0453300613623399, "sim_compute_performance-ego": 0.07831672521737906, "sim_compute_robot_state-ego": 0.0862780946951646, "sim_compute_robot_state-npc0": 0.0768228815152095, "sim_compute_robot_state-npc1": 0.07635509967803955, "sim_compute_robot_state-npc2": 0.07562955526205209, "sim_compute_robot_state-npc3": 0.07741671800613403}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.1773219842177171, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.06912582654219407, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08114996017553867, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.11407684974181348, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.04892871318719326, "sim_compute_performance-ego": 0.08063026269276936, "sim_compute_robot_state-ego": 0.09215592726683006, "sim_compute_robot_state-npc0": 0.08191174727219802, "sim_compute_robot_state-npc1": 0.0802603195875119, "sim_compute_robot_state-npc2": 0.08490003377963336, "sim_compute_robot_state-npc3": 0.08601592748593061}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.20833323619983815, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.07641639532866301, "in-drivable-lane": 0, "agent_compute-ego": 0.08525361838164153, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.11941492116009748, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.0458971482736093, "sim_compute_performance-ego": 0.07972115057486075, "sim_compute_robot_state-ego": 0.08518320542794687, "sim_compute_robot_state-npc0": 0.07598689750388816, "sim_compute_robot_state-npc1": 0.08264638759471753, "sim_compute_robot_state-npc2": 0.0832026446307147, "sim_compute_robot_state-npc3": 0.08605593222158926}}
set_robot_commands_max	0.11941492116009748
set_robot_commands_mean	0.1138752972265022
set_robot_commands_median	0.11478570848703384
set_robot_commands_min	0.10565357483350314
sim_compute_performance-ego_max	0.0823551855589214
sim_compute_performance-ego_mean	0.08059632806209346
sim_compute_performance-ego_median	0.08063026269276936
sim_compute_performance-ego_min	0.07831672521737906
sim_compute_robot_state-ego_max	0.09350269287824632
sim_compute_robot_state-ego_mean	0.08974842257537412
sim_compute_robot_state-ego_median	0.09162219260868272
sim_compute_robot_state-ego_min	0.08518320542794687
sim_compute_robot_state-npc0_max	0.08340166509151459
sim_compute_robot_state-npc0_mean	0.07956198857479106
sim_compute_robot_state-npc0_median	0.07968675149114508
sim_compute_robot_state-npc0_min	0.07598689750388816
sim_compute_robot_state-npc1_max	0.08264638759471753
sim_compute_robot_state-npc1_mean	0.0797961954353077
sim_compute_robot_state-npc1_median	0.0802603195875119
sim_compute_robot_state-npc1_min	0.07635509967803955
sim_compute_robot_state-npc2_max	0.08490003377963336
sim_compute_robot_state-npc2_mean	0.08146362486902178
sim_compute_robot_state-npc2_median	0.0832026446307147
sim_compute_robot_state-npc2_min	0.07562955526205209
sim_compute_robot_state-npc3_max	0.08605593222158926
sim_compute_robot_state-npc3_mean	0.08247621774601961
sim_compute_robot_state-npc3_median	0.08308654082448859
sim_compute_robot_state-npc3_min	0.07741671800613403
sim_compute_sim_state_max	0.04892871318719326
sim_compute_sim_state_mean	0.04721907832232314
sim_compute_sim_state_median	0.04739208911594592
sim_compute_sim_state_min	0.0453300613623399
sim_physics_max	0.20833323619983815
sim_physics_mean	0.1890985242299616
sim_physics_median	0.18578711839822623
sim_physics_min	0.1773219842177171
sim_render-ego_max	0.07641639532866301
sim_render-ego_mean	0.07344752457733007
sim_render-ego_median	0.0760190581020556
sim_render-ego_min	0.06912582654219407
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20416

2637

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-25 12:51:18+00:00

2019-04-25 13:00:06+00:00

0:08:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20416-345948', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20416-345948', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20416-345948', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20404

2657

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

2019-04-25 12:26:45+00:00

2019-04-25 12:50:49+00:00

0:24:04

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20402

2664

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 12:25:39+00:00

2019-04-25 12:26:17+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20401

2665

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 12:24:36+00:00

2019-04-25 12:25:13+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20382

2690

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:00:25+00:00

2019-04-25 12:23:47+00:00

0:23:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8373201862687303
survival_time_median	14.950000000000076
deviation-center-line_median	0.598146756056683
in-drivable-lane_median	5.50000000000004

other stats

agent_compute-ego_max	0.09740220705668132
agent_compute-ego_mean	0.0930776056253642
agent_compute-ego_median	0.0957091522216797
agent_compute-ego_min	0.08187388976414998
deviation-center-line_max	0.6938139450736821
deviation-center-line_mean	0.5573940906897871
deviation-center-line_min	0.38887716139562506
deviation-heading_max	6.353146299772403
deviation-heading_mean	4.114920861857383
deviation-heading_median	5.569614397036816
deviation-heading_min	0.7166147881275434
driven_any_max	2.347937046935698
driven_any_mean	1.71839023142148
driven_any_median	2.33227587993647
driven_any_min	0.629305828592137
driven_lanedir_consec_max	1.0260773985533267
driven_lanedir_consec_mean	0.7604642092715299
driven_lanedir_consec_min	0.34809280094578154
driven_lanedir_max	1.0897272328194254
driven_lanedir_mean	0.8684385734718718
driven_lanedir_median	0.8373201862687303
driven_lanedir_min	0.6187659678267319
in-drivable-lane_max	6.550000000000044
in-drivable-lane_mean	3.6100000000000256
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.33227587993647, "sim_physics": 0.12770093043645225, "survival_time": 14.950000000000076, "driven_lanedir": 0.9720646927630794, "sim_render-ego": 0.06451521635055542, "in-drivable-lane": 6.000000000000045, "agent_compute-ego": 0.08187388976414998, "deviation-heading": 5.675697952186816, "set_robot_commands": 0.1031636881828308, "deviation-center-line": 0.6938139450736821, "driven_lanedir_consec": 0.9720646927630794, "sim_compute_sim_state": 0.04044437090555827, "sim_compute_performance-ego": 0.07199708143870036, "sim_compute_robot_state-ego": 0.08128219842910767}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3478136211733873, "sim_physics": 0.16163388172785442, "survival_time": 14.950000000000076, "driven_lanedir": 0.8243147876813924, "sim_render-ego": 0.0764448897043864, "in-drivable-lane": 6.550000000000044, "agent_compute-ego": 0.09740220705668132, "deviation-heading": 6.353146299772403, "set_robot_commands": 0.12942862669626873, "deviation-center-line": 0.6626356524308908, "driven_lanedir_consec": 0.34809280094578154, "sim_compute_sim_state": 0.0475473419825236, "sim_compute_performance-ego": 0.08613958994547526, "sim_compute_robot_state-ego": 0.10113035996754964}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.629305828592137, "sim_physics": 0.13312279476838954, "survival_time": 4.249999999999993, "driven_lanedir": 0.6187659678267319, "sim_render-ego": 0.07471793399137609, "in-drivable-lane": 0, "agent_compute-ego": 0.09397657899295582, "deviation-heading": 0.7166147881275434, "set_robot_commands": 0.12687851961921243, "deviation-center-line": 0.4434969384920545, "driven_lanedir_consec": 0.6187659678267319, "sim_compute_sim_state": 0.047272469015682446, "sim_compute_performance-ego": 0.08397777501274557, "sim_compute_robot_state-ego": 0.09781103695140166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9346187804697084, "sim_physics": 0.15303545463375928, "survival_time": 6.149999999999986, "driven_lanedir": 0.8373201862687303, "sim_render-ego": 0.07648586451522703, "in-drivable-lane": 0, "agent_compute-ego": 0.09642620009135423, "deviation-heading": 2.25953087216334, "set_robot_commands": 0.1247808157913084, "deviation-center-line": 0.38887716139562506, "driven_lanedir_consec": 0.8373201862687303, "sim_compute_sim_state": 0.04852963850750187, "sim_compute_performance-ego": 0.0870396470635887, "sim_compute_robot_state-ego": 0.0993742787741064}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.347937046935698, "sim_physics": 0.1685598095258077, "survival_time": 14.950000000000076, "driven_lanedir": 1.0897272328194254, "sim_render-ego": 0.07450172662734986, "in-drivable-lane": 5.50000000000004, "agent_compute-ego": 0.0957091522216797, "deviation-heading": 5.569614397036816, "set_robot_commands": 0.1268962876001994, "deviation-center-line": 0.598146756056683, "driven_lanedir_consec": 1.0260773985533267, "sim_compute_sim_state": 0.04664876143137614, "sim_compute_performance-ego": 0.08502235412597656, "sim_compute_robot_state-ego": 0.10453290621439616}}
set_robot_commands_max	0.12942862669626873
set_robot_commands_mean	0.12222958757796394
set_robot_commands_median	0.12687851961921243
set_robot_commands_min	0.1031636881828308
sim_compute_performance-ego_max	0.0870396470635887
sim_compute_performance-ego_mean	0.08283528951729728
sim_compute_performance-ego_median	0.08502235412597656
sim_compute_performance-ego_min	0.07199708143870036
sim_compute_robot_state-ego_max	0.10453290621439616
sim_compute_robot_state-ego_mean	0.0968261560673123
sim_compute_robot_state-ego_median	0.0993742787741064
sim_compute_robot_state-ego_min	0.08128219842910767
sim_compute_sim_state_max	0.04852963850750187
sim_compute_sim_state_mean	0.04608851636852846
sim_compute_sim_state_median	0.047272469015682446
sim_compute_sim_state_min	0.04044437090555827
sim_physics_max	0.1685598095258077
sim_physics_mean	0.14881057421845265
sim_physics_median	0.15303545463375928
sim_physics_min	0.12770093043645225
sim_render-ego_max	0.07648586451522703
sim_render-ego_mean	0.07333312623777896
sim_render-ego_median	0.07471793399137609
sim_render-ego_min	0.06451521635055542
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.050000000000043
survival_time_min	4.249999999999993

No reset possible

20378

2694

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:57:17+00:00

2019-04-25 12:00:08+00:00

0:02:51

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20378-398762', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20378-398762', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20378-398762', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20336

2775

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:37:07+00:00

2019-04-25 11:56:47+00:00

0:19:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4856349860272075
survival_time_median	4.849999999999991
deviation-center-line_median	0.35103319259155474
in-drivable-lane_median	0.49999999999999933

other stats

agent_compute-ego_max	0.12130395770072935
agent_compute-ego_mean	0.11031842627821178
agent_compute-ego_median	0.1171653017533564
agent_compute-ego_min	0.09693135658899944
deviation-center-line_max	0.8283678053444884
deviation-center-line_mean	0.43345716216665336
deviation-center-line_min	0.2572921688335431
deviation-heading_max	5.304327856589226
deviation-heading_mean	2.3600305995586517
deviation-heading_median	1.8355592237317269
deviation-heading_min	0.9281416968481913
driven_any_max	2.3486251724386578
driven_any_mean	1.0409193384012998
driven_any_median	0.725700353399435
driven_any_min	0.58909423142444
driven_lanedir_consec_max	1.2471879613790235
driven_lanedir_consec_mean	0.6187423932358105
driven_lanedir_consec_min	0.23775177831227937
driven_lanedir_max	1.2471879613790235
driven_lanedir_mean	0.662097909078971
driven_lanedir_median	0.4856349860272075
driven_lanedir_min	0.454529357528082
in-drivable-lane_max	4.7500000000000195
in-drivable-lane_mean	1.520000000000002
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6870459041646059, "sim_physics": 0.1891912773091306, "survival_time": 4.6499999999999915, "driven_lanedir": 0.454529357528082, "sim_render-ego": 0.06333057854765205, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.09790879167536254, "deviation-heading": 2.255317443434014, "set_robot_commands": 0.10235771312508532, "deviation-center-line": 0.4609289298537923, "driven_lanedir_consec": 0.23775177831227937, "sim_compute_sim_state": 0.03815929607678485, "sim_compute_performance-ego": 0.06718454309689101, "sim_compute_robot_state-ego": 0.07735090101918866, "sim_compute_robot_state-npc0": 0.0702153944200085, "sim_compute_robot_state-npc1": 0.06870984262035738, "sim_compute_robot_state-npc2": 0.07332010422983477, "sim_compute_robot_state-npc3": 0.0693171767778294}, "udem1-1-0": {"driven_any": 0.725700353399435, "sim_physics": 0.21544981002807617, "survival_time": 4.849999999999991, "driven_lanedir": 0.6492863367594834, "sim_render-ego": 0.07474471367511552, "in-drivable-lane": 0, "agent_compute-ego": 0.1182827236726112, "deviation-heading": 1.8355592237317269, "set_robot_commands": 0.11394404381820836, "deviation-center-line": 0.2696637142098882, "driven_lanedir_consec": 0.6492863367594834, "sim_compute_sim_state": 0.04584531194155978, "sim_compute_performance-ego": 0.08106347703442131, "sim_compute_robot_state-ego": 0.0907053701656381, "sim_compute_robot_state-npc0": 0.07794590094654831, "sim_compute_robot_state-npc1": 0.07843158417141315, "sim_compute_robot_state-npc2": 0.07832584676054336, "sim_compute_robot_state-npc3": 0.07900448926945322}, "udem1-2-0": {"driven_any": 0.58909423142444, "sim_physics": 0.2128174126148224, "survival_time": 3.999999999999994, "driven_lanedir": 0.4856349860272075, "sim_render-ego": 0.0740139901638031, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.12130395770072935, "deviation-heading": 0.9281416968481913, "set_robot_commands": 0.11970816850662232, "deviation-center-line": 0.35103319259155474, "driven_lanedir_consec": 0.4856349860272075, "sim_compute_sim_state": 0.04496493637561798, "sim_compute_performance-ego": 0.07840798795223236, "sim_compute_robot_state-ego": 0.0896984577178955, "sim_compute_robot_state-npc0": 0.07794269025325776, "sim_compute_robot_state-npc1": 0.0784687876701355, "sim_compute_robot_state-npc2": 0.07832597494125366, "sim_compute_robot_state-npc3": 0.08069716095924377}, "udem1-3-0": {"driven_any": 0.8541310305793599, "sim_physics": 0.23252976257189184, "survival_time": 5.649999999999988, "driven_lanedir": 0.4738509037010581, "sim_render-ego": 0.0707141698989193, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.1171653017533564, "deviation-heading": 1.4768067771901, "set_robot_commands": 0.11432375739106036, "deviation-center-line": 0.2572921688335431, "driven_lanedir_consec": 0.4738509037010581, "sim_compute_sim_state": 0.04491676271489236, "sim_compute_performance-ego": 0.07856733187110024, "sim_compute_robot_state-ego": 0.08866595588954149, "sim_compute_robot_state-npc0": 0.07692237448903312, "sim_compute_robot_state-npc1": 0.07729794071838919, "sim_compute_robot_state-npc2": 0.07636216678450593, "sim_compute_robot_state-npc3": 0.07873842568524116}, "udem1-4-0": {"driven_any": 2.3486251724386578, "sim_physics": 0.21466410477956135, "survival_time": 14.950000000000076, "driven_lanedir": 1.2471879613790235, "sim_render-ego": 0.06080251693725586, "in-drivable-lane": 4.7500000000000195, "agent_compute-ego": 0.09693135658899944, "deviation-heading": 5.304327856589226, "set_robot_commands": 0.09707547505696616, "deviation-center-line": 0.8283678053444884, "driven_lanedir_consec": 1.2471879613790235, "sim_compute_sim_state": 0.038708269596099854, "sim_compute_performance-ego": 0.07038355429967244, "sim_compute_robot_state-ego": 0.07613471746444703, "sim_compute_robot_state-npc0": 0.06829895337422688, "sim_compute_robot_state-npc1": 0.06951212882995605, "sim_compute_robot_state-npc2": 0.06807047923405965, "sim_compute_robot_state-npc3": 0.0687848965326945}}
set_robot_commands_max	0.11970816850662232
set_robot_commands_mean	0.10948183157958848
set_robot_commands_median	0.11394404381820836
set_robot_commands_min	0.09707547505696616
sim_compute_performance-ego_max	0.08106347703442131
sim_compute_performance-ego_mean	0.07512137885086348
sim_compute_performance-ego_median	0.07840798795223236
sim_compute_performance-ego_min	0.06718454309689101
sim_compute_robot_state-ego_max	0.0907053701656381
sim_compute_robot_state-ego_mean	0.08451108045134215
sim_compute_robot_state-ego_median	0.08866595588954149
sim_compute_robot_state-ego_min	0.07613471746444703
sim_compute_robot_state-npc0_max	0.07794590094654831
sim_compute_robot_state-npc0_mean	0.07426506269661491
sim_compute_robot_state-npc0_median	0.07692237448903312
sim_compute_robot_state-npc0_min	0.06829895337422688
sim_compute_robot_state-npc1_max	0.0784687876701355
sim_compute_robot_state-npc1_mean	0.07448405680205025
sim_compute_robot_state-npc1_median	0.07729794071838919
sim_compute_robot_state-npc1_min	0.06870984262035738
sim_compute_robot_state-npc2_max	0.07832597494125366
sim_compute_robot_state-npc2_mean	0.07488091439003948
sim_compute_robot_state-npc2_median	0.07636216678450593
sim_compute_robot_state-npc2_min	0.06807047923405965
sim_compute_robot_state-npc3_max	0.08069716095924377
sim_compute_robot_state-npc3_mean	0.07530842984489242
sim_compute_robot_state-npc3_median	0.07873842568524116
sim_compute_robot_state-npc3_min	0.0687848965326945
sim_compute_sim_state_max	0.04584531194155978
sim_compute_sim_state_mean	0.04251891534099097
sim_compute_sim_state_median	0.04491676271489236
sim_compute_sim_state_min	0.03815929607678485
sim_physics_max	0.23252976257189184
sim_physics_mean	0.2129304734606965
sim_physics_median	0.21466410477956135
sim_physics_min	0.1891912773091306
sim_render-ego_max	0.07474471367511552
sim_render-ego_mean	0.06872119384454917
sim_render-ego_median	0.0707141698989193
sim_render-ego_min	0.06080251693725586
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.820000000000007
survival_time_min	3.999999999999994

No reset possible

20328

2786

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 11:36:10+00:00

2019-04-25 11:36:41+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20325

2796

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:33:58+00:00

2019-04-25 11:35:57+00:00

0:01:59

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20313

2818

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:27:39+00:00

2019-04-25 11:33:36+00:00

0:05:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16035679601273448
agent_compute-ego_mean	0.15480714163428794
agent_compute-ego_median	0.15691972237366897
agent_compute-ego_min	0.14654797554016114
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.11302256134321104, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06576154816825434, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.16035679601273448, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.1033181424410838, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.039807058730215394, "sim_compute_performance-ego": 0.0750130167547262, "sim_compute_robot_state-ego": 0.07839205130091254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.10493869047898512, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06533060165551993, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15691972237366897, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.0980494710115286, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03784571702663715, "sim_compute_performance-ego": 0.07030559044617873, "sim_compute_robot_state-ego": 0.07544152553264911}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.09673896100785996, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06508137120140924, "in-drivable-lane": 0, "agent_compute-ego": 0.15060316191779244, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.09297397401597764, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.040254818068610296, "sim_compute_performance-ego": 0.07116308477189806, "sim_compute_robot_state-ego": 0.07973817984263103}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.0998181629180908, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.0639045238494873, "in-drivable-lane": 0, "agent_compute-ego": 0.14654797554016114, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.10156426429748536, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.03822175025939942, "sim_compute_performance-ego": 0.06934781074523926, "sim_compute_robot_state-ego": 0.0711596965789795}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.10834967478727683, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06571527322133382, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.1596080523270827, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.10416095684736204, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.04097864261040321, "sim_compute_performance-ego": 0.0726607457185403, "sim_compute_robot_state-ego": 0.085029097703787}}
set_robot_commands_max	0.10416095684736204
set_robot_commands_mean	0.10001336172268747
set_robot_commands_median	0.10156426429748536
set_robot_commands_min	0.09297397401597764
sim_compute_performance-ego_max	0.0750130167547262
sim_compute_performance-ego_mean	0.07169804968731651
sim_compute_performance-ego_median	0.07116308477189806
sim_compute_performance-ego_min	0.06934781074523926
sim_compute_robot_state-ego_max	0.085029097703787
sim_compute_robot_state-ego_mean	0.07795211019179182
sim_compute_robot_state-ego_median	0.07839205130091254
sim_compute_robot_state-ego_min	0.0711596965789795
sim_compute_sim_state_max	0.04097864261040321
sim_compute_sim_state_mean	0.039421597339053094
sim_compute_sim_state_median	0.039807058730215394
sim_compute_sim_state_min	0.03784571702663715
sim_physics_max	0.11302256134321104
sim_physics_mean	0.10457361010708474
sim_physics_median	0.10493869047898512
sim_physics_min	0.09673896100785996
sim_render-ego_max	0.06576154816825434
sim_render-ego_mean	0.06515866361920092
sim_render-ego_median	0.06533060165551993
sim_render-ego_min	0.0639045238494873
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20280

2885

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 11:02:44+00:00

2019-04-25 11:27:12+00:00

0:24:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7406162049123841
survival_time_median	9.950000000000006
deviation-center-line_median	0.3302177143601141
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16381922736763954
agent_compute-ego_mean	0.16136542745023522
agent_compute-ego_median	0.16135289986928303
agent_compute-ego_min	0.15761997928358104
deviation-center-line_max	0.6904628736300545
deviation-center-line_mean	0.3874259749000404
deviation-center-line_min	0.2530034862371619
deviation-heading_max	1.0778162767766089
deviation-heading_mean	0.8215479365254513
deviation-heading_median	0.9150868055674838
deviation-heading_min	0.3781055846447399
driven_any_max	2.20273818289615
driven_any_mean	1.2469484705963905
driven_any_median	1.4279632190835694
driven_any_min	0.4328289963250949
driven_lanedir_consec_max	2.201596053570166
driven_lanedir_consec_mean	1.1015078923939634
driven_lanedir_consec_min	0.4219705604336601
driven_lanedir_max	2.201596053570166
driven_lanedir_mean	1.1015543630441058
driven_lanedir_median	0.7406162049123841
driven_lanedir_min	0.4219705604336601
in-drivable-lane_max	4.550000000000018
in-drivable-lane_mean	0.9100000000000036
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.6645051945479123, "sim_physics": 0.2244673264599263, "survival_time": 11.450000000000028, "driven_lanedir": 1.6584103880801533, "sim_render-ego": 0.06554339546303561, "in-drivable-lane": 0, "agent_compute-ego": 0.16076821739496622, "deviation-heading": 0.9150868055674838, "set_robot_commands": 0.1031759024707511, "deviation-center-line": 0.6904628736300545, "driven_lanedir_consec": 1.6581780348294406, "sim_compute_sim_state": 0.0431092410108408, "sim_compute_performance-ego": 0.0709060071337171, "sim_compute_robot_state-ego": 0.08013240114570185, "sim_compute_robot_state-npc0": 0.07381682729096392, "sim_compute_robot_state-npc1": 0.07402464604273634, "sim_compute_robot_state-npc2": 0.07354761002886243, "sim_compute_robot_state-npc3": 0.07367723269233536}, "udem1-1-0": {"driven_any": 0.5067067601292259, "sim_physics": 0.16307895477503948, "survival_time": 3.649999999999995, "driven_lanedir": 0.4851786082241656, "sim_render-ego": 0.06593861318614384, "in-drivable-lane": 0, "agent_compute-ego": 0.15761997928358104, "deviation-heading": 1.0778162767766089, "set_robot_commands": 0.10008879883648598, "deviation-center-line": 0.25585703994298503, "driven_lanedir_consec": 0.4851786082241656, "sim_compute_sim_state": 0.04130850752739057, "sim_compute_performance-ego": 0.0712887946873495, "sim_compute_robot_state-ego": 0.0782228169375903, "sim_compute_robot_state-npc0": 0.07701690229651047, "sim_compute_robot_state-npc1": 0.07201400848284159, "sim_compute_robot_state-npc2": 0.07524683050913354, "sim_compute_robot_state-npc3": 0.07398226489759471}, "udem1-2-0": {"driven_any": 1.4279632190835694, "sim_physics": 0.20306261220769067, "survival_time": 9.950000000000006, "driven_lanedir": 0.7406162049123841, "sim_render-ego": 0.06512102050397864, "in-drivable-lane": 4.550000000000018, "agent_compute-ego": 0.16326681333570625, "deviation-heading": 1.0112025852481552, "set_robot_commands": 0.09928537493375078, "deviation-center-line": 0.3302177143601141, "driven_lanedir_consec": 0.7406162049123841, "sim_compute_sim_state": 0.041162478863893445, "sim_compute_performance-ego": 0.0709503020473461, "sim_compute_robot_state-ego": 0.07615868530081744, "sim_compute_robot_state-npc0": 0.07379373473737708, "sim_compute_robot_state-npc1": 0.07338006532371942, "sim_compute_robot_state-npc2": 0.07167574388897, "sim_compute_robot_state-npc3": 0.07080428444560449}, "udem1-3-0": {"driven_any": 2.20273818289615, "sim_physics": 0.21705084721247356, "survival_time": 14.950000000000076, "driven_lanedir": 2.201596053570166, "sim_render-ego": 0.06563399155934652, "in-drivable-lane": 0, "agent_compute-ego": 0.16135289986928303, "deviation-heading": 0.3781055846447399, "set_robot_commands": 0.09937061627705893, "deviation-center-line": 0.4075887603298862, "driven_lanedir_consec": 2.201596053570166, "sim_compute_sim_state": 0.04120232264200847, "sim_compute_performance-ego": 0.0713488499323527, "sim_compute_robot_state-ego": 0.07681493918100993, "sim_compute_robot_state-npc0": 0.07251609007517497, "sim_compute_robot_state-npc1": 0.07374974012374878, "sim_compute_robot_state-npc2": 0.07237211465835572, "sim_compute_robot_state-npc3": 0.07302287340164185}, "udem1-4-0": {"driven_any": 0.4328289963250949, "sim_physics": 0.1828800104558468, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4219705604336601, "sim_render-ego": 0.06713893637061119, "in-drivable-lane": 0, "agent_compute-ego": 0.16381922736763954, "deviation-heading": 0.7255284303902685, "set_robot_commands": 0.10605820640921591, "deviation-center-line": 0.2530034862371619, "driven_lanedir_consec": 0.4219705604336601, "sim_compute_sim_state": 0.040928915143013, "sim_compute_performance-ego": 0.07274462282657623, "sim_compute_robot_state-ego": 0.07634653896093369, "sim_compute_robot_state-npc0": 0.07511317357420921, "sim_compute_robot_state-npc1": 0.07741547003388405, "sim_compute_robot_state-npc2": 0.07519135251641273, "sim_compute_robot_state-npc3": 0.07581916823983192}}
set_robot_commands_max	0.10605820640921591
set_robot_commands_mean	0.10159577978545252
set_robot_commands_median	0.10008879883648598
set_robot_commands_min	0.09928537493375078
sim_compute_performance-ego_max	0.07274462282657623
sim_compute_performance-ego_mean	0.07144771532546831
sim_compute_performance-ego_median	0.0712887946873495
sim_compute_performance-ego_min	0.0709060071337171
sim_compute_robot_state-ego_max	0.08013240114570185
sim_compute_robot_state-ego_mean	0.07753507630521064
sim_compute_robot_state-ego_median	0.07681493918100993
sim_compute_robot_state-ego_min	0.07615868530081744
sim_compute_robot_state-npc0_max	0.07701690229651047
sim_compute_robot_state-npc0_mean	0.07445134559484713
sim_compute_robot_state-npc0_median	0.07381682729096392
sim_compute_robot_state-npc0_min	0.07251609007517497
sim_compute_robot_state-npc1_max	0.07741547003388405
sim_compute_robot_state-npc1_mean	0.07411678600138603
sim_compute_robot_state-npc1_median	0.07374974012374878
sim_compute_robot_state-npc1_min	0.07201400848284159
sim_compute_robot_state-npc2_max	0.07524683050913354
sim_compute_robot_state-npc2_mean	0.07360673032034688
sim_compute_robot_state-npc2_median	0.07354761002886243
sim_compute_robot_state-npc2_min	0.07167574388897
sim_compute_robot_state-npc3_max	0.07581916823983192
sim_compute_robot_state-npc3_mean	0.07346116473540168
sim_compute_robot_state-npc3_median	0.07367723269233536
sim_compute_robot_state-npc3_min	0.07080428444560449
sim_compute_sim_state_max	0.0431092410108408
sim_compute_sim_state_mean	0.041542293037429255
sim_compute_sim_state_median	0.04120232264200847
sim_compute_sim_state_min	0.040928915143013
sim_physics_max	0.2244673264599263
sim_physics_mean	0.19810795022219535
sim_physics_median	0.20306261220769067
sim_physics_min	0.16307895477503948
sim_render-ego_max	0.06713893637061119
sim_render-ego_mean	0.06587519141662317
sim_render-ego_median	0.06563399155934652
sim_render-ego_min	0.06512102050397864
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.64000000000002
survival_time_min	3.1999999999999966

No reset possible

20276

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

error

2019-04-25 11:00:23+00:00

2019-04-25 11:02:06+00:00

0:01:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20264

2877

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 10:51:16+00:00

2019-04-25 11:00:07+00:00

0:08:51

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20264-637010', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20264-637010', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20264-637010', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20255

2909

Ashwin Ram 🇸🇬

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 10:44:08+00:00

2019-04-25 10:50:59+00:00

0:06:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48848384337549344
survival_time_median	2.2
deviation-center-line_median	0.0955758256823458
in-drivable-lane_median	0.6000000000000004

other stats

agent_compute-ego_max	0.26131193534187647
agent_compute-ego_mean	0.24971049601738193
agent_compute-ego_median	0.2578586545483819
agent_compute-ego_min	0.2140256041911111
deviation-center-line_max	0.29667790551300927
deviation-center-line_mean	0.13049337359865026
deviation-center-line_min	0.050704564741298405
deviation-heading_max	0.7462814184901383
deviation-heading_mean	0.415258818324881
deviation-heading_median	0.34981218764462796
deviation-heading_min	0.18780340456338843
driven_any_max	1.7279055854314356
driven_any_mean	1.1017312197719171
driven_any_median	1.074182751111403
driven_any_min	0.4286942319439701
driven_lanedir_consec_max	1.6330496471627145
driven_lanedir_consec_mean	0.7796520450989399
driven_lanedir_consec_min	0.2462834832885359
driven_lanedir_max	1.6330496471627145
driven_lanedir_mean	0.7796520450989399
driven_lanedir_median	0.48848384337549344
driven_lanedir_min	0.2462834832885359
in-drivable-lane_max	0.9999999999999998
in-drivable-lane_mean	0.5099999999999995
in-drivable-lane_min	0.04999999999999982
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4286942319439701, "sim_physics": 0.11539784721706224, "survival_time": 1.1500000000000004, "driven_lanedir": 0.3605233521085407, "sim_render-ego": 0.06595206260681152, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.26131193534187647, "deviation-heading": 0.34981218764462796, "set_robot_commands": 0.0956863320392111, "deviation-center-line": 0.07429577704577403, "driven_lanedir_consec": 0.3605233521085407, "sim_compute_sim_state": 0.038972274116847824, "sim_compute_performance-ego": 0.07332485655079717, "sim_compute_robot_state-ego": 0.08280281398607336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5786855594372383, "sim_physics": 0.11140404898544838, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2462834832885359, "sim_render-ego": 0.06453200044303105, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.2578586545483819, "deviation-heading": 0.26266643329746403, "set_robot_commands": 0.10574789704947636, "deviation-center-line": 0.050704564741298405, "driven_lanedir_consec": 0.2462834832885359, "sim_compute_sim_state": 0.04145423297224374, "sim_compute_performance-ego": 0.07516070892070902, "sim_compute_robot_state-ego": 0.08211710535246751}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7279055854314356, "sim_physics": 0.08489639723478858, "survival_time": 3.349999999999996, "driven_lanedir": 1.6330496471627145, "sim_render-ego": 0.05392399830604667, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2140256041911111, "deviation-heading": 0.7462814184901383, "set_robot_commands": 0.0842409525344621, "deviation-center-line": 0.29667790551300927, "driven_lanedir_consec": 1.6330496471627145, "sim_compute_sim_state": 0.03427384504631384, "sim_compute_performance-ego": 0.05972259080232079, "sim_compute_robot_state-ego": 0.06275949905167764}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6991879709355384, "sim_physics": 0.1220778768712824, "survival_time": 3.2999999999999963, "driven_lanedir": 1.169919899559415, "sim_render-ego": 0.0639618021069151, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.26008646054701373, "deviation-heading": 0.5297306476287861, "set_robot_commands": 0.09887991890762791, "deviation-center-line": 0.13521279501082392, "driven_lanedir_consec": 1.169919899559415, "sim_compute_sim_state": 0.040981234926165955, "sim_compute_performance-ego": 0.07122279658462062, "sim_compute_robot_state-ego": 0.07956652930288603}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.074182751111403, "sim_physics": 0.11677147041667592, "survival_time": 2.2, "driven_lanedir": 0.48848384337549344, "sim_render-ego": 0.06459487026387994, "in-drivable-lane": 0.9999999999999998, "agent_compute-ego": 0.2552698254585266, "deviation-heading": 0.18780340456338843, "set_robot_commands": 0.09702930667183617, "deviation-center-line": 0.0955758256823458, "driven_lanedir_consec": 0.48848384337549344, "sim_compute_sim_state": 0.038844271139665085, "sim_compute_performance-ego": 0.06854149428280917, "sim_compute_robot_state-ego": 0.07498131015084007}}
set_robot_commands_max	0.10574789704947636
set_robot_commands_mean	0.09631688144052272
set_robot_commands_median	0.09702930667183617
set_robot_commands_min	0.0842409525344621
sim_compute_performance-ego_max	0.07516070892070902
sim_compute_performance-ego_mean	0.06959448942825135
sim_compute_performance-ego_median	0.07122279658462062
sim_compute_performance-ego_min	0.05972259080232079
sim_compute_robot_state-ego_max	0.08280281398607336
sim_compute_robot_state-ego_mean	0.07644545156878893
sim_compute_robot_state-ego_median	0.07956652930288603
sim_compute_robot_state-ego_min	0.06275949905167764
sim_compute_sim_state_max	0.04145423297224374
sim_compute_sim_state_mean	0.038905171640247295
sim_compute_sim_state_median	0.038972274116847824
sim_compute_sim_state_min	0.03427384504631384
sim_physics_max	0.1220778768712824
sim_physics_mean	0.11010952814505152
sim_physics_median	0.11539784721706224
sim_physics_min	0.08489639723478858
sim_render-ego_max	0.06595206260681152
sim_render-ego_mean	0.06259294674533686
sim_render-ego_median	0.06453200044303105
sim_render-ego_min	0.05392399830604667
simulation-passed	1
survival_time_max	3.349999999999996
survival_time_mean	2.2899999999999983
survival_time_min	1.1500000000000004

No reset possible

20230

2961

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:20:47+00:00

2019-04-25 10:43:21+00:00

0:22:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.35035592088431233
survival_time_median	5.899999999999987
deviation-center-line_median	0.23620363689362345
in-drivable-lane_median	2.0999999999999925

other stats

agent_compute-ego_max	0.24068147233388956
agent_compute-ego_mean	0.2313326662219583
agent_compute-ego_median	0.23303691864013673
agent_compute-ego_min	0.21730128371197244
deviation-center-line_max	0.40485679229685134
deviation-center-line_mean	0.2609606011152991
deviation-center-line_min	0.1931006957171199
deviation-heading_max	2.17881868106376
deviation-heading_mean	1.448698165948003
deviation-heading_median	1.4278758327735444
deviation-heading_min	0.701917330934621
driven_any_max	2.0288267689376966
driven_any_mean	1.0682494458462866
driven_any_median	0.773425006360363
driven_any_min	0.6024578048791401
driven_lanedir_consec_max	0.6332844474464894
driven_lanedir_consec_mean	0.3710913241914681
driven_lanedir_consec_min	0.23840054862943696
driven_lanedir_max	0.6475573499431788
driven_lanedir_mean	0.37452280692221895
driven_lanedir_median	0.35035592088431233
driven_lanedir_min	0.23840054862943696
in-drivable-lane_max	12.55000000000008
in-drivable-lane_mean	4.210000000000015
in-drivable-lane_min	1.499999999999995
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2001695411515267, "sim_physics": 0.17482446236585183, "survival_time": 9.45, "driven_lanedir": 0.6475573499431788, "sim_render-ego": 0.06510013499587931, "in-drivable-lane": 2.800000000000015, "agent_compute-ego": 0.23437741446116617, "deviation-heading": 2.17881868106376, "set_robot_commands": 0.0986949363082805, "deviation-center-line": 0.40485679229685134, "driven_lanedir_consec": 0.6332844474464894, "sim_compute_sim_state": 0.04032585986707576, "sim_compute_performance-ego": 0.07204817085669785, "sim_compute_robot_state-ego": 0.07842416864223581, "sim_compute_robot_state-npc0": 0.07225673917740111, "sim_compute_robot_state-npc1": 0.07242472714217252, "sim_compute_robot_state-npc2": 0.07080914986827386, "sim_compute_robot_state-npc3": 0.07061488413936877}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0288267689376966, "sim_physics": 0.21199065685272217, "survival_time": 14.950000000000076, "driven_lanedir": 0.23840054862943696, "sim_render-ego": 0.06408013423283895, "in-drivable-lane": 12.55000000000008, "agent_compute-ego": 0.23303691864013673, "deviation-heading": 0.701917330934621, "set_robot_commands": 0.1008531920115153, "deviation-center-line": 0.23620363689362345, "driven_lanedir_consec": 0.23840054862943696, "sim_compute_sim_state": 0.040745036602020265, "sim_compute_performance-ego": 0.07128866910934448, "sim_compute_robot_state-ego": 0.07700847069422403, "sim_compute_robot_state-npc0": 0.07260076681772867, "sim_compute_robot_state-npc1": 0.07241144100824992, "sim_compute_robot_state-npc2": 0.07100226958592733, "sim_compute_robot_state-npc3": 0.07173943678538004}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7363681079027065, "sim_physics": 0.16455154701814814, "survival_time": 5.899999999999987, "driven_lanedir": 0.35046993245352676, "sim_render-ego": 0.06453833337557519, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.2312662419626268, "deviation-heading": 1.4278758327735444, "set_robot_commands": 0.10025724314026914, "deviation-center-line": 0.24542547943829177, "driven_lanedir_consec": 0.35046993245352676, "sim_compute_sim_state": 0.04175947480282541, "sim_compute_performance-ego": 0.0698759959915937, "sim_compute_robot_state-ego": 0.07619538549649513, "sim_compute_robot_state-npc0": 0.07048702239990234, "sim_compute_robot_state-npc1": 0.07019349680108539, "sim_compute_robot_state-npc2": 0.07004710981401346, "sim_compute_robot_state-npc3": 0.07147709595955025}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.773425006360363, "sim_physics": 0.15491617658863896, "survival_time": 5.749999999999988, "driven_lanedir": 0.35035592088431233, "sim_render-ego": 0.06500838943149732, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.21730128371197244, "deviation-heading": 1.3357831199331218, "set_robot_commands": 0.0988503248795219, "deviation-center-line": 0.22521640123060913, "driven_lanedir_consec": 0.35035592088431233, "sim_compute_sim_state": 0.040826246012812074, "sim_compute_performance-ego": 0.06986523918483568, "sim_compute_robot_state-ego": 0.07188979646433954, "sim_compute_robot_state-npc0": 0.07108131906260615, "sim_compute_robot_state-npc1": 0.07241640298262886, "sim_compute_robot_state-npc2": 0.07080811002980107, "sim_compute_robot_state-npc3": 0.07238637882730235}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6024578048791401, "sim_physics": 0.17722690915598452, "survival_time": 5.14999999999999, "driven_lanedir": 0.2858302827006398, "sim_render-ego": 0.06657499480016023, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.24068147233388956, "deviation-heading": 1.5990958650349678, "set_robot_commands": 0.10318505879744742, "deviation-center-line": 0.1931006957171199, "driven_lanedir_consec": 0.28294577154357525, "sim_compute_sim_state": 0.04005790914146645, "sim_compute_performance-ego": 0.07027215865051863, "sim_compute_robot_state-ego": 0.08041400353885392, "sim_compute_robot_state-npc0": 0.08577013710170116, "sim_compute_robot_state-npc1": 0.07227070354720921, "sim_compute_robot_state-npc2": 0.07369864565654866, "sim_compute_robot_state-npc3": 0.07167494644239111}}
set_robot_commands_max	0.10318505879744742
set_robot_commands_mean	0.10036815102740684
set_robot_commands_median	0.10025724314026914
set_robot_commands_min	0.0986949363082805
sim_compute_performance-ego_max	0.07204817085669785
sim_compute_performance-ego_mean	0.07067004675859806
sim_compute_performance-ego_median	0.07027215865051863
sim_compute_performance-ego_min	0.06986523918483568
sim_compute_robot_state-ego_max	0.08041400353885392
sim_compute_robot_state-ego_mean	0.0767863649672297
sim_compute_robot_state-ego_median	0.07700847069422403
sim_compute_robot_state-ego_min	0.07188979646433954
sim_compute_robot_state-npc0_max	0.08577013710170116
sim_compute_robot_state-npc0_mean	0.07443919691186789
sim_compute_robot_state-npc0_median	0.07225673917740111
sim_compute_robot_state-npc0_min	0.07048702239990234
sim_compute_robot_state-npc1_max	0.07242472714217252
sim_compute_robot_state-npc1_mean	0.07194335429626918
sim_compute_robot_state-npc1_median	0.07241144100824992
sim_compute_robot_state-npc1_min	0.07019349680108539
sim_compute_robot_state-npc2_max	0.07369864565654866
sim_compute_robot_state-npc2_mean	0.07127305699091288
sim_compute_robot_state-npc2_median	0.07080914986827386
sim_compute_robot_state-npc2_min	0.07004710981401346
sim_compute_robot_state-npc3_max	0.07238637882730235
sim_compute_robot_state-npc3_mean	0.07157854843079851
sim_compute_robot_state-npc3_median	0.07167494644239111
sim_compute_robot_state-npc3_min	0.07061488413936877
sim_compute_sim_state_max	0.04175947480282541
sim_compute_sim_state_mean	0.040742905285239994
sim_compute_sim_state_median	0.040745036602020265
sim_compute_sim_state_min	0.04005790914146645
sim_physics_max	0.21199065685272217
sim_physics_mean	0.17670195039626913
sim_physics_median	0.17482446236585183
sim_physics_min	0.15491617658863896
sim_render-ego_max	0.06657499480016023
sim_render-ego_mean	0.0650603973671902
sim_render-ego_median	0.06500838943149732
sim_render-ego_min	0.06408013423283895
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.240000000000009
survival_time_min	5.14999999999999

No reset possible

20221

2985

Artem Ioselevskii

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:16:27+00:00

2019-04-25 10:20:03+00:00

0:03:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20216

2989

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:13:05+00:00

2019-04-25 10:16:11+00:00

0:03:06

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20212

3002

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:12:17+00:00

2019-04-25 10:12:52+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20207

3010

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:11:19+00:00

2019-04-25 10:11:53+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20201

3015

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:09:37+00:00

2019-04-25 10:10:12+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20198

3027

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:08:55+00:00

2019-04-25 10:09:29+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20191

3034

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 10:06:47+00:00

2019-04-25 10:08:11+00:00

0:01:24

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20187

3047

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:05:32+00:00

2019-04-25 10:06:05+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20170

3051

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 10:00:13+00:00

2019-04-25 10:03:35+00:00

0:03:22

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20166

3063

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-25 09:59:10+00:00

2019-04-25 10:00:05+00:00

0:00:55

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20166-731160', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20166-731160', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20166-731160', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20155

2900

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 09:48:28+00:00

2019-04-25 09:58:53+00:00

0:10:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6699567682869971
survival_time_median	6.0499999999999865
deviation-center-line_median	0.22994283723572925
in-drivable-lane_median	0.3999999999999986

other stats

agent_compute-ego_max	0.24899774740550143
agent_compute-ego_mean	0.22992798861076852
agent_compute-ego_median	0.22510061034544265
agent_compute-ego_min	0.21883550205746213
deviation-center-line_max	0.6376959049479345
deviation-center-line_mean	0.3485729660378001
deviation-center-line_min	0.1888007899512857
deviation-heading_max	1.7068847518342127
deviation-heading_mean	0.91248987413227
deviation-heading_median	0.902120704964196
deviation-heading_min	0.44340056353952534
driven_any_max	1.5750303642427284
driven_any_mean	0.8587490536274036
driven_any_median	0.9985104516743186
driven_any_min	0.264762841635637
driven_lanedir_consec_max	1.1821169307641188
driven_lanedir_consec_mean	0.6805244247481939
driven_lanedir_consec_min	0.2571961431035348
driven_lanedir_max	1.1821169307641188
driven_lanedir_mean	0.6805244247481939
driven_lanedir_median	0.6699567682869971
driven_lanedir_min	0.2571961431035348
in-drivable-lane_max	2.2000000000000153
in-drivable-lane_mean	0.8500000000000016
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9985104516743186, "sim_physics": 0.1067141856043792, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6699567682869971, "sim_render-ego": 0.06290056094650395, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.24899774740550143, "deviation-heading": 0.957675453948608, "set_robot_commands": 0.09856906607131329, "deviation-center-line": 0.22994283723572925, "driven_lanedir_consec": 0.6699567682869971, "sim_compute_sim_state": 0.037266084970521536, "sim_compute_performance-ego": 0.06875505132123458, "sim_compute_robot_state-ego": 0.07851266072801322}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.007245601801953, "sim_physics": 0.10041474318895184, "survival_time": 6.099999999999986, "driven_lanedir": 0.8667153034387965, "sim_render-ego": 0.0597990770808986, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.2325710214552332, "deviation-heading": 1.7068847518342127, "set_robot_commands": 0.0967688970878476, "deviation-center-line": 0.48685252280196, "driven_lanedir_consec": 0.8667153034387965, "sim_compute_sim_state": 0.037592389544502634, "sim_compute_performance-ego": 0.06646906157008937, "sim_compute_robot_state-ego": 0.07531530348981014}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.264762841635637, "sim_physics": 0.10098133860407647, "survival_time": 1.850000000000001, "driven_lanedir": 0.2571961431035348, "sim_render-ego": 0.05931133192938727, "in-drivable-lane": 0, "agent_compute-ego": 0.21883550205746213, "deviation-heading": 0.44340056353952534, "set_robot_commands": 0.096420938904221, "deviation-center-line": 0.1888007899512857, "driven_lanedir_consec": 0.2571961431035348, "sim_compute_sim_state": 0.03727212467709103, "sim_compute_performance-ego": 0.06771279670096733, "sim_compute_robot_state-ego": 0.06987362938958246}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4481960087823803, "sim_physics": 0.09280721483559444, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4266369781475219, "sim_render-ego": 0.05828215747044004, "in-drivable-lane": 0, "agent_compute-ego": 0.22413506179020323, "deviation-heading": 0.902120704964196, "set_robot_commands": 0.08934369991565573, "deviation-center-line": 0.19957277525209088, "driven_lanedir_consec": 0.4266369781475219, "sim_compute_sim_state": 0.0386429449607586, "sim_compute_performance-ego": 0.06388625194286478, "sim_compute_robot_state-ego": 0.06759886494998274}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5750303642427284, "sim_physics": 0.10725086258056966, "survival_time": 9.349999999999998, "driven_lanedir": 1.1821169307641188, "sim_render-ego": 0.05888761683581347, "in-drivable-lane": 2.2000000000000153, "agent_compute-ego": 0.22510061034544265, "deviation-heading": 0.5523678963748082, "set_robot_commands": 0.0878041185797217, "deviation-center-line": 0.6376959049479345, "driven_lanedir_consec": 1.1821169307641188, "sim_compute_sim_state": 0.03593065904423515, "sim_compute_performance-ego": 0.06512187253982625, "sim_compute_robot_state-ego": 0.0709491923531109}}
set_robot_commands_max	0.09856906607131329
set_robot_commands_mean	0.09378134411175185
set_robot_commands_median	0.096420938904221
set_robot_commands_min	0.0878041185797217
sim_compute_performance-ego_max	0.06875505132123458
sim_compute_performance-ego_mean	0.06638900681499646
sim_compute_performance-ego_median	0.06646906157008937
sim_compute_performance-ego_min	0.06388625194286478
sim_compute_robot_state-ego_max	0.07851266072801322
sim_compute_robot_state-ego_mean	0.07244993018209989
sim_compute_robot_state-ego_median	0.0709491923531109
sim_compute_robot_state-ego_min	0.06759886494998274
sim_compute_sim_state_max	0.0386429449607586
sim_compute_sim_state_mean	0.03734084063942179
sim_compute_sim_state_median	0.03727212467709103
sim_compute_sim_state_min	0.03593065904423515
sim_physics_max	0.10725086258056966
sim_physics_mean	0.10163366896271434
sim_physics_median	0.10098133860407647
sim_physics_min	0.09280721483559444
sim_render-ego_max	0.06290056094650395
sim_render-ego_mean	0.05983614885260867
sim_render-ego_median	0.05931133192938727
sim_render-ego_min	0.05828215747044004
simulation-passed	1
survival_time_max	9.349999999999998
survival_time_mean	5.249999999999995
survival_time_min	1.850000000000001

No reset possible

20105

3054

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 09:28:43+00:00

2019-04-25 09:48:07+00:00

0:19:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0005475306520854595
survival_time_median	14.950000000000076
deviation-center-line_median	0.4751036937952701
in-drivable-lane_median	7.550000000000043

other stats

agent_compute-ego_max	0.1482875633239746
agent_compute-ego_mean	0.14090862973531088
agent_compute-ego_median	0.14639710585276286
agent_compute-ego_min	0.12679354031880696
deviation-center-line_max	0.556068910796392
deviation-center-line_mean	0.3895061244663202
deviation-center-line_min	0.14514552024423696
deviation-heading_max	6.039767599662579
deviation-heading_mean	5.763921961552656
deviation-heading_median	5.767844541062104
deviation-heading_min	5.560681575562554
driven_any_max	0.028934981635126217
driven_any_mean	0.0265495383263842
driven_any_median	0.025958363654255467
driven_any_min	0.024158897917020104
driven_lanedir_consec_max	0.0029212565811485014
driven_lanedir_consec_mean	-5.1621543168867136e-05
driven_lanedir_consec_min	-0.003893767360947819
driven_lanedir_max	0.0029212565811485014
driven_lanedir_mean	-5.1621543168867136e-05
driven_lanedir_median	-0.0005475306520854595
driven_lanedir_min	-0.003893767360947819
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	7.550000000000043
in-drivable-lane_min	7.500000000000041
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.028934981635126217, "sim_physics": 0.04173731962839762, "survival_time": 14.950000000000076, "driven_lanedir": 0.002754464494397091, "sim_render-ego": 0.06053519090016683, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.1482875633239746, "deviation-heading": 5.767844541062104, "set_robot_commands": 0.09325497150421144, "deviation-center-line": 0.556068910796392, "driven_lanedir_consec": 0.002754464494397091, "sim_compute_sim_state": 0.03855525652567546, "sim_compute_performance-ego": 0.06710000435511271, "sim_compute_robot_state-ego": 0.07107938925425211}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025958363654255467, "sim_physics": 0.039075948397318525, "survival_time": 14.950000000000076, "driven_lanedir": -0.003893767360947819, "sim_render-ego": 0.05555411736170451, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1353589145342509, "deviation-heading": 5.560681575562554, "set_robot_commands": 0.08485305865605672, "deviation-center-line": 0.14514552024423696, "driven_lanedir_consec": -0.003893767360947819, "sim_compute_sim_state": 0.03527386585871379, "sim_compute_performance-ego": 0.061661374568939206, "sim_compute_robot_state-ego": 0.06509984413782756}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.02575465114235495, "sim_physics": 0.03844882726669312, "survival_time": 14.950000000000076, "driven_lanedir": 0.0029212565811485014, "sim_render-ego": 0.051561307112375894, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.12679354031880696, "deviation-heading": 5.815918488019714, "set_robot_commands": 0.08045895179112753, "deviation-center-line": 0.4751036937952701, "driven_lanedir_consec": 0.0029212565811485014, "sim_compute_sim_state": 0.03277769486109416, "sim_compute_performance-ego": 0.05635664463043213, "sim_compute_robot_state-ego": 0.06080244779586792}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.024158897917020104, "sim_physics": 0.04612049102783203, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014925307783566488, "sim_render-ego": 0.05710401932398478, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.14639710585276286, "deviation-heading": 6.039767599662579, "set_robot_commands": 0.08893301963806152, "deviation-center-line": 0.4766251667427719, "driven_lanedir_consec": -0.0014925307783566488, "sim_compute_sim_state": 0.03576029062271118, "sim_compute_performance-ego": 0.06286513566970825, "sim_compute_robot_state-ego": 0.07030510346094768}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.027940797283164263, "sim_physics": 0.042898818651835126, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005475306520854595, "sim_render-ego": 0.06106959819793701, "in-drivable-lane": 7.550000000000043, "agent_compute-ego": 0.14770602464675903, "deviation-heading": 5.635397603456328, "set_robot_commands": 0.09380005995432536, "deviation-center-line": 0.2945873307529301, "driven_lanedir_consec": -0.0005475306520854595, "sim_compute_sim_state": 0.03775107542673747, "sim_compute_performance-ego": 0.06708756764729817, "sim_compute_robot_state-ego": 0.07239331245422363}}
set_robot_commands_max	0.09380005995432536
set_robot_commands_mean	0.08826001230875653
set_robot_commands_median	0.08893301963806152
set_robot_commands_min	0.08045895179112753
sim_compute_performance-ego_max	0.06710000435511271
sim_compute_performance-ego_mean	0.0630141453742981
sim_compute_performance-ego_median	0.06286513566970825
sim_compute_performance-ego_min	0.05635664463043213
sim_compute_robot_state-ego_max	0.07239331245422363
sim_compute_robot_state-ego_mean	0.06793601942062377
sim_compute_robot_state-ego_median	0.07030510346094768
sim_compute_robot_state-ego_min	0.06080244779586792
sim_compute_sim_state_max	0.03855525652567546
sim_compute_sim_state_mean	0.03602363665898641
sim_compute_sim_state_median	0.03576029062271118
sim_compute_sim_state_min	0.03277769486109416
sim_physics_max	0.04612049102783203
sim_physics_mean	0.04165628099441528
sim_physics_median	0.04173731962839762
sim_physics_min	0.03844882726669312
sim_render-ego_max	0.06106959819793701
sim_render-ego_mean	0.057164846579233805
sim_render-ego_median	0.05710401932398478
sim_render-ego_min	0.051561307112375894
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20094

2828

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 09:23:24+00:00

2019-04-25 09:28:22+00:00

0:04:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6230537734701223
survival_time_median	2.5999999999999988
deviation-center-line_median	0.12255506833464958
in-drivable-lane_median	0.3999999999999986

other stats

agent_compute-ego_max	0.16016538326556867
agent_compute-ego_mean	0.14015659043476986
agent_compute-ego_median	0.13675459329184
agent_compute-ego_min	0.12251545401180491
deviation-center-line_max	0.2465252000810868
deviation-center-line_mean	0.1351143636439303
deviation-center-line_min	0.0796964683078178
deviation-heading_max	0.5191604794590993
deviation-heading_mean	0.31688603056815834
deviation-heading_median	0.23664921865605393
deviation-heading_min	0.20363540677430053
driven_any_max	1.586663533850032
driven_any_mean	0.8547797952116308
driven_any_median	0.9958579904997188
driven_any_min	0.24880077576010673
driven_lanedir_consec_max	1.19271179762459
driven_lanedir_consec_mean	0.6464007088112516
driven_lanedir_consec_min	0.2398525707355974
driven_lanedir_max	1.19271179762459
driven_lanedir_mean	0.6464007088112516
driven_lanedir_median	0.6230537734701223
driven_lanedir_min	0.2398525707355974
in-drivable-lane_max	0.849999999999997
in-drivable-lane_mean	0.4099999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9958579904997188, "sim_physics": 0.04732001286286574, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6230537734701223, "sim_render-ego": 0.06054245508634127, "in-drivable-lane": 0.7999999999999978, "agent_compute-ego": 0.15692784236027643, "deviation-heading": 0.20363540677430053, "set_robot_commands": 0.09395512250753547, "deviation-center-line": 0.14620301663510898, "driven_lanedir_consec": 0.6230537734701223, "sim_compute_sim_state": 0.03825300014936007, "sim_compute_performance-ego": 0.06522941589355469, "sim_compute_robot_state-ego": 0.07143075649554913}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0181946631197691, "sim_physics": 0.04886513948440552, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7777489189035479, "sim_render-ego": 0.060702777825869046, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.16016538326556867, "deviation-heading": 0.5191604794590993, "set_robot_commands": 0.09873363604912393, "deviation-center-line": 0.12255506833464958, "driven_lanedir_consec": 0.7777489189035479, "sim_compute_sim_state": 0.03916573982972365, "sim_compute_performance-ego": 0.06997236838707557, "sim_compute_robot_state-ego": 0.07824302178162795}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24880077576010673, "sim_physics": 0.031822036294376146, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2398525707355974, "sim_render-ego": 0.04897451400756836, "in-drivable-lane": 0, "agent_compute-ego": 0.12251545401180491, "deviation-heading": 0.21981273505232848, "set_robot_commands": 0.08129680857938879, "deviation-center-line": 0.0796964683078178, "driven_lanedir_consec": 0.2398525707355974, "sim_compute_sim_state": 0.033531721900491154, "sim_compute_performance-ego": 0.05391318657818962, "sim_compute_robot_state-ego": 0.06014327441944795}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.42438201282852805, "sim_physics": 0.03782959779103597, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3986364833224001, "sim_render-ego": 0.05555816491444906, "in-drivable-lane": 0, "agent_compute-ego": 0.12441967924435932, "deviation-heading": 0.40517231289900946, "set_robot_commands": 0.0816468894481659, "deviation-center-line": 0.08059206486098838, "driven_lanedir_consec": 0.3986364833224001, "sim_compute_sim_state": 0.03644979993502299, "sim_compute_performance-ego": 0.058394829432169594, "sim_compute_robot_state-ego": 0.06619112690289815}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.586663533850032, "sim_physics": 0.03981183720873547, "survival_time": 3.8499999999999943, "driven_lanedir": 1.19271179762459, "sim_render-ego": 0.05477382610370586, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13675459329184, "deviation-heading": 0.23664921865605393, "set_robot_commands": 0.08641473039404138, "deviation-center-line": 0.2465252000810868, "driven_lanedir_consec": 1.19271179762459, "sim_compute_sim_state": 0.03576387058604847, "sim_compute_performance-ego": 0.060235206182900965, "sim_compute_robot_state-ego": 0.06271036878808753}}
set_robot_commands_max	0.09873363604912393
set_robot_commands_mean	0.08840943739565107
set_robot_commands_median	0.08641473039404138
set_robot_commands_min	0.08129680857938879
sim_compute_performance-ego_max	0.06997236838707557
sim_compute_performance-ego_mean	0.0615490012947781
sim_compute_performance-ego_median	0.060235206182900965
sim_compute_performance-ego_min	0.05391318657818962
sim_compute_robot_state-ego_max	0.07824302178162795
sim_compute_robot_state-ego_mean	0.06774370967752215
sim_compute_robot_state-ego_median	0.06619112690289815
sim_compute_robot_state-ego_min	0.06014327441944795
sim_compute_sim_state_max	0.03916573982972365
sim_compute_sim_state_mean	0.03663282648012926
sim_compute_sim_state_median	0.03644979993502299
sim_compute_sim_state_min	0.033531721900491154
sim_physics_max	0.04886513948440552
sim_physics_mean	0.041129724728283766
sim_physics_median	0.03981183720873547
sim_physics_min	0.031822036294376146
sim_render-ego_max	0.060702777825869046
sim_render-ego_mean	0.05611034758758672
sim_render-ego_median	0.05555816491444906
sim_render-ego_min	0.04897451400756836
simulation-passed	1
survival_time_max	3.8499999999999943
survival_time_mean	2.2199999999999984
survival_time_min	0.8500000000000002

No reset possible

20057

2660

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:00:59+00:00

2019-04-25 09:22:38+00:00

0:21:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6102529976910192
survival_time_median	5.1999999999999895
deviation-center-line_median	0.2652740716368691
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08742585863385882
agent_compute-ego_mean	0.08264460876955218
agent_compute-ego_median	0.08301451114507821
agent_compute-ego_min	0.07599701007207235
deviation-center-line_max	0.9776084239500996
deviation-center-line_mean	0.5075548643768787
deviation-center-line_min	0.1455692846025562
deviation-heading_max	6.394734595229873
deviation-heading_mean	3.0823126892644512
deviation-heading_median	1.8371694013148736
deviation-heading_min	0.5772374138703639
driven_any_max	2.3331283464422365
driven_any_mean	1.167623156134005
driven_any_median	0.781921467511906
driven_any_min	0.22749772573145133
driven_lanedir_consec_max	0.7174176201998985
driven_lanedir_consec_mean	0.5211213145956811
driven_lanedir_consec_min	0.19964814616213775
driven_lanedir_max	1.0022107308034591
driven_lanedir_mean	0.6714799873676125
driven_lanedir_median	0.7174176201998985
driven_lanedir_min	0.19964814616213775
in-drivable-lane_max	5.750000000000059
in-drivable-lane_mean	1.8800000000000177
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.3331283464422365, "sim_physics": 0.2119933478037516, "survival_time": 14.950000000000076, "driven_lanedir": 1.0022107308034591, "sim_render-ego": 0.0594193164507548, "in-drivable-lane": 5.750000000000059, "agent_compute-ego": 0.07599701007207235, "deviation-heading": 5.902017052243848, "set_robot_commands": 0.09369595686594644, "deviation-center-line": 0.918909250733303, "driven_lanedir_consec": 0.6102529976910192, "sim_compute_sim_state": 0.03754587570826213, "sim_compute_performance-ego": 0.06654017527898153, "sim_compute_robot_state-ego": 0.07051292975743612, "sim_compute_robot_state-npc0": 0.0674905800819397, "sim_compute_robot_state-npc1": 0.06781875292460124, "sim_compute_robot_state-npc2": 0.06611688534418741, "sim_compute_robot_state-npc3": 0.06663705507914225}, "udem1-1-0": {"driven_any": 0.781921467511906, "sim_physics": 0.2006782086995932, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7174176201998985, "sim_render-ego": 0.06892096767058739, "in-drivable-lane": 0, "agent_compute-ego": 0.08560335177641648, "deviation-heading": 1.8371694013148736, "set_robot_commands": 0.11189885781361508, "deviation-center-line": 0.2652740716368691, "driven_lanedir_consec": 0.7174176201998985, "sim_compute_sim_state": 0.042033603558173545, "sim_compute_performance-ego": 0.07539409169783959, "sim_compute_robot_state-ego": 0.07989939130269565, "sim_compute_robot_state-npc0": 0.07558923042737521, "sim_compute_robot_state-npc1": 0.07703174994542049, "sim_compute_robot_state-npc2": 0.07502592068452102, "sim_compute_robot_state-npc3": 0.07716105763728802}, "udem1-2-0": {"driven_any": 2.035024263028036, "sim_physics": 0.2245195168715257, "survival_time": 13.00000000000005, "driven_lanedir": 0.9916915316919396, "sim_render-ego": 0.06696943411460289, "in-drivable-lane": 3.650000000000028, "agent_compute-ego": 0.08301451114507821, "deviation-heading": 6.394734595229873, "set_robot_commands": 0.10655919863627508, "deviation-center-line": 0.9776084239500996, "driven_lanedir_consec": 0.6318559009447231, "sim_compute_sim_state": 0.04264712333679199, "sim_compute_performance-ego": 0.07434500180757962, "sim_compute_robot_state-ego": 0.08322842121124267, "sim_compute_robot_state-npc0": 0.0748882009432866, "sim_compute_robot_state-npc1": 0.07617710920480582, "sim_compute_robot_state-npc2": 0.07656197181114784, "sim_compute_robot_state-npc3": 0.07583957452040452}, "udem1-3-0": {"driven_any": 0.22749772573145133, "sim_physics": 0.2418175288609096, "survival_time": 1.7500000000000009, "driven_lanedir": 0.19964814616213775, "sim_render-ego": 0.06705124037606376, "in-drivable-lane": 0, "agent_compute-ego": 0.08742585863385882, "deviation-heading": 0.5772374138703639, "set_robot_commands": 0.1144425732748849, "deviation-center-line": 0.1455692846025562, "driven_lanedir_consec": 0.19964814616213775, "sim_compute_sim_state": 0.046818208694458005, "sim_compute_performance-ego": 0.07599525451660157, "sim_compute_robot_state-ego": 0.08959469795227051, "sim_compute_robot_state-npc0": 0.07576501710074289, "sim_compute_robot_state-npc1": 0.07497108323233469, "sim_compute_robot_state-npc2": 0.07680219922746931, "sim_compute_robot_state-npc3": 0.07932702473231724}, "udem1-4-0": {"driven_any": 0.4605439779563947, "sim_physics": 0.1768621690571308, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4464319079806267, "sim_render-ego": 0.06645599380135536, "in-drivable-lane": 0, "agent_compute-ego": 0.081182312220335, "deviation-heading": 0.7004049836632976, "set_robot_commands": 0.1073167324066162, "deviation-center-line": 0.23041329096156568, "driven_lanedir_consec": 0.4464319079806267, "sim_compute_sim_state": 0.04168590530753136, "sim_compute_performance-ego": 0.07328728586435318, "sim_compute_robot_state-ego": 0.0809803381562233, "sim_compute_robot_state-npc0": 0.07643252611160278, "sim_compute_robot_state-npc1": 0.07379280775785446, "sim_compute_robot_state-npc2": 0.07515038177371025, "sim_compute_robot_state-npc3": 0.07726417481899261}}
set_robot_commands_max	0.1144425732748849
set_robot_commands_mean	0.10678266379946756
set_robot_commands_median	0.1073167324066162
set_robot_commands_min	0.09369595686594644
sim_compute_performance-ego_max	0.07599525451660157
sim_compute_performance-ego_mean	0.0731123618330711
sim_compute_performance-ego_median	0.07434500180757962
sim_compute_performance-ego_min	0.06654017527898153
sim_compute_robot_state-ego_max	0.08959469795227051
sim_compute_robot_state-ego_mean	0.08084315567597364
sim_compute_robot_state-ego_median	0.0809803381562233
sim_compute_robot_state-ego_min	0.07051292975743612
sim_compute_robot_state-npc0_max	0.07643252611160278
sim_compute_robot_state-npc0_mean	0.07403311093298943
sim_compute_robot_state-npc0_median	0.07558923042737521
sim_compute_robot_state-npc0_min	0.0674905800819397
sim_compute_robot_state-npc1_max	0.07703174994542049
sim_compute_robot_state-npc1_mean	0.07395830061300333
sim_compute_robot_state-npc1_median	0.07497108323233469
sim_compute_robot_state-npc1_min	0.06781875292460124
sim_compute_robot_state-npc2_max	0.07680219922746931
sim_compute_robot_state-npc2_mean	0.07393147176820716
sim_compute_robot_state-npc2_median	0.07515038177371025
sim_compute_robot_state-npc2_min	0.06611688534418741
sim_compute_robot_state-npc3_max	0.07932702473231724
sim_compute_robot_state-npc3_mean	0.07524577735762893
sim_compute_robot_state-npc3_median	0.07716105763728802
sim_compute_robot_state-npc3_min	0.06663705507914225
sim_compute_sim_state_max	0.046818208694458005
sim_compute_sim_state_mean	0.04214614332104341
sim_compute_sim_state_median	0.042033603558173545
sim_compute_sim_state_min	0.03754587570826213
sim_physics_max	0.2418175288609096
sim_physics_mean	0.2111741542585822
sim_physics_median	0.2119933478037516
sim_physics_min	0.1768621690571308
sim_render-ego_max	0.06892096767058739
sim_render-ego_mean	0.06576339048267284
sim_render-ego_median	0.06696943411460289
sim_render-ego_min	0.0594193164507548
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.620000000000023
survival_time_min	1.7500000000000009

No reset possible

20036

2907

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 08:59:23+00:00

2019-04-25 09:00:53+00:00

0:01:30

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20036-415179', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20036-415179', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20036-415179', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20023

2406

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 08:46:55+00:00

2019-04-25 08:59:15+00:00

0:12:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.03683619728685539
survival_time_median	1.6000000000000008
deviation-center-line_median	0.07323124685358098
in-drivable-lane_median	0.7000000000000005

other stats

agent_compute-ego_max	0.13267698685328166
agent_compute-ego_mean	0.10674878682487313
agent_compute-ego_median	0.09551844596862794
agent_compute-ego_min	0.09277495741844176
deviation-center-line_max	0.6640400254324397
deviation-center-line_mean	0.2110415963248399
deviation-center-line_min	0.017249644284533402
deviation-heading_max	5.8545927637403565
deviation-heading_mean	2.663752539104413
deviation-heading_median	0.6369693918201673
deviation-heading_min	0.540558509003461
driven_any_max	1.3482756548279695
driven_any_mean	0.5990389026849411
driven_any_median	0.13243121609913502
driven_any_min	0.09772661220660311
driven_lanedir_consec_max	0.4693662664915561
driven_lanedir_consec_mean	0.1924239142922899
driven_lanedir_consec_min	0.0269936305905194
driven_lanedir_max	0.4693662664915561
driven_lanedir_mean	0.1924239142922899
driven_lanedir_median	0.03683619728685539
driven_lanedir_min	0.0269936305905194
in-drivable-lane_max	7.5000000000000435
in-drivable-lane_mean	3.290000000000017
in-drivable-lane_min	0.4500000000000004
per-episodes	details {"udem1-0-0": {"driven_any": 1.3482756548279695, "sim_physics": 0.03215272585550944, "survival_time": 14.950000000000076, "driven_lanedir": 0.4693662664915561, "sim_render-ego": 0.049803392092386885, "in-drivable-lane": 7.300000000000039, "agent_compute-ego": 0.13267698685328166, "deviation-heading": 5.725342798401238, "set_robot_commands": 0.0747389284769694, "deviation-center-line": 0.230191298689208, "driven_lanedir_consec": 0.4693662664915561, "sim_compute_sim_state": 0.03063082774480184, "sim_compute_performance-ego": 0.05440836906433105, "sim_compute_robot_state-ego": 0.05696675062179565, "sim_compute_robot_state-npc0": 0.05517807086308797, "sim_compute_robot_state-npc1": 0.05477147658665975, "sim_compute_robot_state-npc2": 0.05449739933013916, "sim_compute_robot_state-npc3": 0.055382603804270424}, "udem1-1-0": {"driven_any": 1.3149305996828682, "sim_physics": 0.028778313795725503, "survival_time": 14.950000000000076, "driven_lanedir": 0.39858519608756415, "sim_render-ego": 0.04501501719156901, "in-drivable-lane": 7.5000000000000435, "agent_compute-ego": 0.1197656011581421, "deviation-heading": 5.8545927637403565, "set_robot_commands": 0.06838170607884725, "deviation-center-line": 0.6640400254324397, "driven_lanedir_consec": 0.39858519608756415, "sim_compute_sim_state": 0.02725446859995524, "sim_compute_performance-ego": 0.04706543842951456, "sim_compute_robot_state-ego": 0.04774268468221029, "sim_compute_robot_state-npc0": 0.04837368090947469, "sim_compute_robot_state-npc1": 0.0485768461227417, "sim_compute_robot_state-npc2": 0.047511982123057045, "sim_compute_robot_state-npc3": 0.0476950748761495}, "udem1-2-0": {"driven_any": 0.10183043060812982, "sim_physics": 0.02363710567868989, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0269936305905194, "sim_render-ego": 0.03569139283278893, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09300794272587218, "deviation-heading": 0.5612992325568419, "set_robot_commands": 0.05348376570076778, "deviation-center-line": 0.07323124685358098, "driven_lanedir_consec": 0.0269936305905194, "sim_compute_sim_state": 0.022066502735532564, "sim_compute_performance-ego": 0.03668929790628368, "sim_compute_robot_state-ego": 0.03801689476802431, "sim_compute_robot_state-npc0": 0.03801333493199842, "sim_compute_robot_state-npc1": 0.03755313774635051, "sim_compute_robot_state-npc2": 0.03761314523631129, "sim_compute_robot_state-npc3": 0.03798789813600738}, "udem1-3-0": {"driven_any": 0.09772661220660311, "sim_physics": 0.02349325021107991, "survival_time": 1.5000000000000009, "driven_lanedir": 0.03683619728685539, "sim_render-ego": 0.03626432418823242, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09551844596862794, "deviation-heading": 0.540558509003461, "set_robot_commands": 0.05213913122812907, "deviation-center-line": 0.07049576636443758, "driven_lanedir_consec": 0.03683619728685539, "sim_compute_sim_state": 0.0215606689453125, "sim_compute_performance-ego": 0.0367333968480428, "sim_compute_robot_state-ego": 0.03824136257171631, "sim_compute_robot_state-npc0": 0.03808812300364176, "sim_compute_robot_state-npc1": 0.03768212000528971, "sim_compute_robot_state-npc2": 0.03741136391957601, "sim_compute_robot_state-npc3": 0.0374694029490153}, "udem1-4-0": {"driven_any": 0.13243121609913502, "sim_physics": 0.02055702358484268, "survival_time": 1.6000000000000008, "driven_lanedir": 0.030338281004954393, "sim_render-ego": 0.034079410135746, "in-drivable-lane": 0.7000000000000005, "agent_compute-ego": 0.09277495741844176, "deviation-heading": 0.6369693918201673, "set_robot_commands": 0.051669903099536896, "deviation-center-line": 0.017249644284533402, "driven_lanedir_consec": 0.030338281004954393, "sim_compute_sim_state": 0.021291762590408325, "sim_compute_performance-ego": 0.03645440191030502, "sim_compute_robot_state-ego": 0.0376763641834259, "sim_compute_robot_state-npc0": 0.03795243054628372, "sim_compute_robot_state-npc1": 0.03735440969467163, "sim_compute_robot_state-npc2": 0.0370643213391304, "sim_compute_robot_state-npc3": 0.03719732165336609}}
set_robot_commands_max	0.0747389284769694
set_robot_commands_mean	0.06008268691685008
set_robot_commands_median	0.05348376570076778
set_robot_commands_min	0.051669903099536896
sim_compute_performance-ego_max	0.05440836906433105
sim_compute_performance-ego_mean	0.042270180831695425
sim_compute_performance-ego_median	0.0367333968480428
sim_compute_performance-ego_min	0.03645440191030502
sim_compute_robot_state-ego_max	0.05696675062179565
sim_compute_robot_state-ego_mean	0.043728811365434495
sim_compute_robot_state-ego_median	0.03824136257171631
sim_compute_robot_state-ego_min	0.0376763641834259
sim_compute_robot_state-npc0_max	0.05517807086308797
sim_compute_robot_state-npc0_mean	0.04352112805089731
sim_compute_robot_state-npc0_median	0.03808812300364176
sim_compute_robot_state-npc0_min	0.03795243054628372
sim_compute_robot_state-npc1_max	0.05477147658665975
sim_compute_robot_state-npc1_mean	0.04318759803114266
sim_compute_robot_state-npc1_median	0.03768212000528971
sim_compute_robot_state-npc1_min	0.03735440969467163
sim_compute_robot_state-npc2_max	0.05449739933013916
sim_compute_robot_state-npc2_mean	0.04281964238964278
sim_compute_robot_state-npc2_median	0.03761314523631129
sim_compute_robot_state-npc2_min	0.0370643213391304
sim_compute_robot_state-npc3_max	0.055382603804270424
sim_compute_robot_state-npc3_mean	0.043146460283761734
sim_compute_robot_state-npc3_median	0.03798789813600738
sim_compute_robot_state-npc3_min	0.03719732165336609
sim_compute_sim_state_max	0.03063082774480184
sim_compute_sim_state_mean	0.02456084612320209
sim_compute_sim_state_median	0.022066502735532564
sim_compute_sim_state_min	0.021291762590408325
sim_physics_max	0.03215272585550944
sim_physics_mean	0.025723683825169485
sim_physics_median	0.02363710567868989
sim_physics_min	0.02055702358484268
sim_render-ego_max	0.049803392092386885
sim_render-ego_mean	0.04017070728814465
sim_render-ego_median	0.03626432418823242
sim_render-ego_min	0.034079410135746
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.890000000000032
survival_time_min	1.4500000000000006

No reset possible

20012

2449

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:45:27+00:00

2019-04-25 08:46:39+00:00

0:01:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19997

2463

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:44:12+00:00

2019-04-25 08:44:40+00:00

0:00:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19990

2511

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:43:16+00:00

2019-04-25 08:43:43+00:00

0:00:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19974

2548

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:42:09+00:00

2019-04-25 08:42:55+00:00

0:00:46

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19960

2591

baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-25 08:40:54+00:00

2019-04-25 08:41:48+00:00

0:00:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19947

2755

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:39:58+00:00

2019-04-25 08:40:47+00:00

0:00:49

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19932

2893

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:38:43+00:00

2019-04-25 08:39:38+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19914

2629

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:37:27+00:00

2019-04-25 08:38:36+00:00

0:01:09

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19797

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 08:08:08+00:00

2019-04-25 08:37:10+00:00

0:29:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3392996564499584
survival_time_median	14.950000000000076
deviation-center-line_median	0.9344958139419292
in-drivable-lane_median	4.500000000000025

other stats

agent_compute-ego_max	0.17003745794296266
agent_compute-ego_mean	0.1537764121691386
agent_compute-ego_median	0.15189086278279623
agent_compute-ego_min	0.1450239888827006
deviation-center-line_max	1.52285369632223
deviation-center-line_mean	0.9107937560811784
deviation-center-line_min	0.2888337286318359
deviation-heading_max	8.447870280266974
deviation-heading_mean	7.028470170620348
deviation-heading_median	6.6042810524033575
deviation-heading_min	5.826897253480866
driven_any_max	4.39082415278494
driven_any_mean	4.390824152784926
driven_any_median	4.390824152784926
driven_any_min	4.390824152784916
driven_lanedir_consec_max	-1.2821046138102197
driven_lanedir_consec_mean	-1.3306279130927372
driven_lanedir_consec_min	-1.369992228000605
driven_lanedir_max	-1.3693900599336288
driven_lanedir_mean	-2.0685654579561628
driven_lanedir_median	-2.2132574606281774
driven_lanedir_min	-2.705004190282363
in-drivable-lane_max	7.35000000000004
in-drivable-lane_mean	4.7200000000000255
in-drivable-lane_min	2.1500000000000115
per-episodes	details {"udem1-0-0": {"driven_any": 4.390824152784916, "sim_physics": 0.03942030429840088, "survival_time": 14.950000000000076, "driven_lanedir": -2.705004190282363, "sim_render-ego": 0.05718074242273966, "in-drivable-lane": 2.1500000000000115, "agent_compute-ego": 0.15267003138860066, "deviation-heading": 8.435502739091172, "set_robot_commands": 0.08730892817179361, "deviation-center-line": 1.52285369632223, "driven_lanedir_consec": -1.2923530072692753, "sim_compute_sim_state": 0.035625504652659096, "sim_compute_performance-ego": 0.0614979362487793, "sim_compute_robot_state-ego": 0.06697970787684122, "sim_compute_robot_state-npc0": 0.06187514861424764, "sim_compute_robot_state-npc1": 0.06207930564880371, "sim_compute_robot_state-npc2": 0.06206384499867757, "sim_compute_robot_state-npc3": 0.061279510656992595}, "udem1-1-0": {"driven_any": 4.390824152784932, "sim_physics": 0.03762932936350505, "survival_time": 14.950000000000076, "driven_lanedir": -2.685183350936039, "sim_render-ego": 0.05723930835723877, "in-drivable-lane": 2.2500000000000115, "agent_compute-ego": 0.14925971984863282, "deviation-heading": 8.447870280266974, "set_robot_commands": 0.08485250393549601, "deviation-center-line": 1.514088673836754, "driven_lanedir_consec": -1.2821046138102197, "sim_compute_sim_state": 0.03612425645192464, "sim_compute_performance-ego": 0.06122905731201172, "sim_compute_robot_state-ego": 0.06312606493631999, "sim_compute_robot_state-npc0": 0.06078939358393351, "sim_compute_robot_state-npc1": 0.06073633035024007, "sim_compute_robot_state-npc2": 0.0606175963083903, "sim_compute_robot_state-npc3": 0.06032084782918294}, "udem1-2-0": {"driven_any": 4.390824152784919, "sim_physics": 0.038946159680684406, "survival_time": 14.950000000000076, "driven_lanedir": -1.369992228000605, "sim_render-ego": 0.055572144985198975, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.15189086278279623, "deviation-heading": 5.826897253480866, "set_robot_commands": 0.08473602533340455, "deviation-center-line": 0.2936968676731421, "driven_lanedir_consec": -1.369992228000605, "sim_compute_sim_state": 0.03401650110880534, "sim_compute_performance-ego": 0.0594077730178833, "sim_compute_robot_state-ego": 0.06271220366160075, "sim_compute_robot_state-npc0": 0.06284408966700236, "sim_compute_robot_state-npc1": 0.06181308110555013, "sim_compute_robot_state-npc2": 0.06115705013275147, "sim_compute_robot_state-npc3": 0.060576598644256595}, "udem1-3-0": {"driven_any": 4.390824152784926, "sim_physics": 0.03570496241251628, "survival_time": 14.950000000000076, "driven_lanedir": -1.3693900599336288, "sim_render-ego": 0.05393695831298828, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.1450239888827006, "deviation-heading": 5.827799527859374, "set_robot_commands": 0.08003031730651855, "deviation-center-line": 0.2888337286318359, "driven_lanedir_consec": -1.3693900599336288, "sim_compute_sim_state": 0.03316582123438517, "sim_compute_performance-ego": 0.05671008904774984, "sim_compute_robot_state-ego": 0.06054834445317586, "sim_compute_robot_state-npc0": 0.05739636262257894, "sim_compute_robot_state-npc1": 0.05705735524495443, "sim_compute_robot_state-npc2": 0.05860085090001424, "sim_compute_robot_state-npc3": 0.06132194598515829}, "udem1-4-0": {"driven_any": 4.39082415278494, "sim_physics": 0.03402364412943522, "survival_time": 14.950000000000076, "driven_lanedir": -2.2132574606281774, "sim_render-ego": 0.05054777304331461, "in-drivable-lane": 4.500000000000025, "agent_compute-ego": 0.17003745794296266, "deviation-heading": 6.6042810524033575, "set_robot_commands": 0.07849796851476033, "deviation-center-line": 0.9344958139419292, "driven_lanedir_consec": -1.3392996564499584, "sim_compute_sim_state": 0.03175713300704956, "sim_compute_performance-ego": 0.05447705984115601, "sim_compute_robot_state-ego": 0.060229755242665606, "sim_compute_robot_state-npc0": 0.05831063508987427, "sim_compute_robot_state-npc1": 0.056415402094523115, "sim_compute_robot_state-npc2": 0.05597146034240723, "sim_compute_robot_state-npc3": 0.05581064144770304}}
set_robot_commands_max	0.08730892817179361
set_robot_commands_mean	0.08308514865239461
set_robot_commands_median	0.08473602533340455
set_robot_commands_min	0.07849796851476033
sim_compute_performance-ego_max	0.0614979362487793
sim_compute_performance-ego_mean	0.05866438309351603
sim_compute_performance-ego_median	0.0594077730178833
sim_compute_performance-ego_min	0.05447705984115601
sim_compute_robot_state-ego_max	0.06697970787684122
sim_compute_robot_state-ego_mean	0.06271921523412069
sim_compute_robot_state-ego_median	0.06271220366160075
sim_compute_robot_state-ego_min	0.060229755242665606
sim_compute_robot_state-npc0_max	0.06284408966700236
sim_compute_robot_state-npc0_mean	0.06024312591552734
sim_compute_robot_state-npc0_median	0.06078939358393351
sim_compute_robot_state-npc0_min	0.05739636262257894
sim_compute_robot_state-npc1_max	0.06207930564880371
sim_compute_robot_state-npc1_mean	0.05962029488881428
sim_compute_robot_state-npc1_median	0.06073633035024007
sim_compute_robot_state-npc1_min	0.056415402094523115
sim_compute_robot_state-npc2_max	0.06206384499867757
sim_compute_robot_state-npc2_mean	0.05968216053644816
sim_compute_robot_state-npc2_median	0.0606175963083903
sim_compute_robot_state-npc2_min	0.05597146034240723
sim_compute_robot_state-npc3_max	0.06132194598515829
sim_compute_robot_state-npc3_mean	0.05986190891265869
sim_compute_robot_state-npc3_median	0.060576598644256595
sim_compute_robot_state-npc3_min	0.05581064144770304
sim_compute_sim_state_max	0.03612425645192464
sim_compute_sim_state_mean	0.03413784329096477
sim_compute_sim_state_median	0.03401650110880534
sim_compute_sim_state_min	0.03175713300704956
sim_physics_max	0.03942030429840088
sim_physics_mean	0.037144879976908365
sim_physics_median	0.03762932936350505
sim_physics_min	0.03402364412943522
sim_render-ego_max	0.05723930835723877
sim_render-ego_mean	0.05489538542429606
sim_render-ego_median	0.055572144985198975
sim_render-ego_min	0.05054777304331461
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

19780

2952

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 08:00:20+00:00

2019-04-25 08:07:35+00:00

0:07:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.057152852934749365
survival_time_median	1.2500000000000004
deviation-center-line_median	0.06447147854417953
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.33195679838007147
agent_compute-ego_mean	0.2026568743851263
agent_compute-ego_median	0.1925720042652554
agent_compute-ego_min	0.12290095601763044
deviation-center-line_max	0.0957575252970109
deviation-center-line_mean	0.06670698250205966
deviation-center-line_min	0.03565811968959903
deviation-heading_max	0.8077366556294588
deviation-heading_mean	0.7065060796125555
deviation-heading_median	0.7477403352376569
deviation-heading_min	0.6065379005025766
driven_any_max	0.21070649169196937
driven_any_mean	0.15218846172579728
driven_any_median	0.13363296225204224
driven_any_min	0.0965054985633797
driven_lanedir_consec_max	0.0790841713416941
driven_lanedir_consec_mean	0.06175886985446386
driven_lanedir_consec_min	0.04708975981541097
driven_lanedir_max	0.0790841713416941
driven_lanedir_mean	0.06175886985446386
driven_lanedir_median	0.057152852934749365
driven_lanedir_min	0.04708975981541097
in-drivable-lane_max	0.8000000000000007
in-drivable-lane_mean	0.3400000000000003
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.21070649169196937, "sim_physics": 0.026362739290509904, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0790841713416941, "sim_render-ego": 0.041664927346365795, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.12290095601763044, "deviation-heading": 0.8077366556294588, "set_robot_commands": 0.0871178354535784, "deviation-center-line": 0.06447147854417953, "driven_lanedir_consec": 0.0790841713416941, "sim_compute_sim_state": 0.026621259961809432, "sim_compute_performance-ego": 0.04674228940691267, "sim_compute_robot_state-ego": 0.06018554142543248, "sim_compute_robot_state-npc0": 0.04585074016026088, "sim_compute_robot_state-npc1": 0.04703053065708705, "sim_compute_robot_state-npc2": 0.05183166776384626, "sim_compute_robot_state-npc3": 0.08437068121773857}, "udem1-1-0": {"driven_any": 0.20813609905430583, "sim_physics": 0.04865470197465685, "survival_time": 1.800000000000001, "driven_lanedir": 0.057152852934749365, "sim_render-ego": 0.05688518948025174, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.1925720042652554, "deviation-heading": 0.7477403352376569, "set_robot_commands": 0.11975882450739544, "deviation-center-line": 0.05000164591567253, "driven_lanedir_consec": 0.057152852934749365, "sim_compute_sim_state": 0.0369138585196601, "sim_compute_performance-ego": 0.05973603328069051, "sim_compute_robot_state-ego": 0.06196850538253784, "sim_compute_robot_state-npc0": 0.08807149198320177, "sim_compute_robot_state-npc1": 0.06314600176281399, "sim_compute_robot_state-npc2": 0.06336379051208496, "sim_compute_robot_state-npc3": 0.07040961583455403}, "udem1-2-0": {"driven_any": 0.0965054985633797, "sim_physics": 0.054245399392169456, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0497547216683043, "sim_render-ego": 0.06749047403750212, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.2279756898465364, "deviation-heading": 0.6065379005025766, "set_robot_commands": 0.1111895519754161, "deviation-center-line": 0.08764614306383627, "driven_lanedir_consec": 0.0497547216683043, "sim_compute_sim_state": 0.0399300015490988, "sim_compute_performance-ego": 0.07291927544966988, "sim_compute_robot_state-ego": 0.08180658713631007, "sim_compute_robot_state-npc0": 0.07794982454051143, "sim_compute_robot_state-npc1": 0.07609679387963336, "sim_compute_robot_state-npc2": 0.0737869635872219, "sim_compute_robot_state-npc3": 0.06935725004776665}, "udem1-3-0": {"driven_any": 0.11196125706728928, "sim_physics": 0.04817951809276234, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07571284351216057, "sim_render-ego": 0.06736896254799583, "in-drivable-lane": 0, "agent_compute-ego": 0.33195679838007147, "deviation-heading": 0.6065953184787879, "set_robot_commands": 0.10062994740226051, "deviation-center-line": 0.0957575252970109, "driven_lanedir_consec": 0.07571284351216057, "sim_compute_sim_state": 0.03991040316495029, "sim_compute_performance-ego": 0.06775627352974632, "sim_compute_robot_state-ego": 0.0724773948842829, "sim_compute_robot_state-npc0": 0.0716659047386863, "sim_compute_robot_state-npc1": 0.0746351805600253, "sim_compute_robot_state-npc2": 0.06831133365631104, "sim_compute_robot_state-npc3": 0.09703004360198976}, "udem1-4-0": {"driven_any": 0.13363296225204224, "sim_physics": 0.03216853141784668, "survival_time": 1.2500000000000004, "driven_lanedir": 0.04708975981541097, "sim_render-ego": 0.05083613395690918, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1378789234161377, "deviation-heading": 0.7639201882142976, "set_robot_commands": 0.08343175888061523, "deviation-center-line": 0.03565811968959903, "driven_lanedir_consec": 0.04708975981541097, "sim_compute_sim_state": 0.03174945831298828, "sim_compute_performance-ego": 0.05520510673522949, "sim_compute_robot_state-ego": 0.058755722045898434, "sim_compute_robot_state-npc0": 0.05713548660278321, "sim_compute_robot_state-npc1": 0.057614593505859374, "sim_compute_robot_state-npc2": 0.05654433250427246, "sim_compute_robot_state-npc3": 0.05721626281738281}}
set_robot_commands_max	0.11975882450739544
set_robot_commands_mean	0.10042558364385316
set_robot_commands_median	0.10062994740226051
set_robot_commands_min	0.08343175888061523
sim_compute_performance-ego_max	0.07291927544966988
sim_compute_performance-ego_mean	0.06047179568044978
sim_compute_performance-ego_median	0.05973603328069051
sim_compute_performance-ego_min	0.04674228940691267
sim_compute_robot_state-ego_max	0.08180658713631007
sim_compute_robot_state-ego_mean	0.06703875017489233
sim_compute_robot_state-ego_median	0.06196850538253784
sim_compute_robot_state-ego_min	0.058755722045898434
sim_compute_robot_state-npc0_max	0.08807149198320177
sim_compute_robot_state-npc0_mean	0.06813468960508871
sim_compute_robot_state-npc0_median	0.0716659047386863
sim_compute_robot_state-npc0_min	0.04585074016026088
sim_compute_robot_state-npc1_max	0.07609679387963336
sim_compute_robot_state-npc1_mean	0.06370462007308382
sim_compute_robot_state-npc1_median	0.06314600176281399
sim_compute_robot_state-npc1_min	0.04703053065708705
sim_compute_robot_state-npc2_max	0.0737869635872219
sim_compute_robot_state-npc2_mean	0.06276761760474732
sim_compute_robot_state-npc2_median	0.06336379051208496
sim_compute_robot_state-npc2_min	0.05183166776384626
sim_compute_robot_state-npc3_max	0.09703004360198976
sim_compute_robot_state-npc3_mean	0.07567677070388636
sim_compute_robot_state-npc3_median	0.07040961583455403
sim_compute_robot_state-npc3_min	0.05721626281738281
sim_compute_sim_state_max	0.0399300015490988
sim_compute_sim_state_mean	0.035024996301701375
sim_compute_sim_state_median	0.0369138585196601
sim_compute_sim_state_min	0.026621259961809432
sim_physics_max	0.054245399392169456
sim_physics_mean	0.04192217803358904
sim_physics_median	0.04817951809276234
sim_physics_min	0.026362739290509904
sim_render-ego_max	0.06749047403750212
sim_render-ego_mean	0.056849137473804934
sim_render-ego_median	0.05688518948025174
sim_render-ego_min	0.041664927346365795
simulation-passed	1
survival_time_max	1.800000000000001
survival_time_mean	1.4100000000000006
survival_time_min	1.1000000000000003

No reset possible

19766

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 07:52:47+00:00

2019-04-25 08:00:04+00:00

0:07:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19766-759964', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19766-759964', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19766-759964', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19751

2839

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 07:46:01+00:00

2019-04-25 07:52:16+00:00

0:06:15

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19738

3006

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-24 21:31:56+00:00

2019-04-24 21:32:21+00:00

0:00:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19721

3035

challenge-aido_LF-template-pytorch

step1-simulation

host-error