Duckietown Challenges Home Challenges Submissions

Submission 2960

Submission2960
Competingyes
Challengeaido2-LFV-sim-testing
UserJulian Zilly
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22692
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22692step1-simulationsuccessyes0:37:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2564970347765132
survival_time_median5.799999999999987
deviation-center-line_median0.19046981397989968
in-drivable-lane_median2.049999999999994


other stats
agent_compute-ego_max0.21340139492138013
agent_compute-ego_mean0.20520924829429335
agent_compute-ego_median0.20371831787957084
agent_compute-ego_min0.19839586908855136
deviation-center-line_max0.631202957468221
deviation-center-line_mean0.24876549314417593
deviation-center-line_min0.12585284666494312
deviation-heading_max3.6899566992010016
deviation-heading_mean1.4083353542713417
deviation-heading_median1.2818754590528434
deviation-heading_min0.7187601798061267
driven_any_max1.7437108194499853
driven_any_mean0.7109284802822099
driven_any_median0.6628893056402629
driven_any_min0.4121657440890793
driven_lanedir_consec_max1.7387158657217774
driven_lanedir_consec_mean0.36447779401369945
driven_lanedir_consec_min0.10378850428751862
driven_lanedir_max1.7387158657217774
driven_lanedir_mean0.3679941668837759
driven_lanedir_median0.2564970347765132
driven_lanedir_min0.1039720427824089
in-drivable-lane_max3.1999999999999886
in-drivable-lane_mean2.0033333333333276
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0885991135964888, "sim_physics": 0.09439379481946009, "survival_time": 8.84999999999999, "driven_lanedir": 0.6296195242844069, "sim_render-ego": 0.06297759821185958, "in-drivable-lane": 2.8000000000000043, "agent_compute-ego": 0.20136609185213425, "deviation-heading": 1.925911416171025, "set_robot_commands": 0.07880560422347764, "deviation-center-line": 0.4346604384870684, "driven_lanedir_consec": 0.6135080240964372, "sim_compute_sim_state": 0.03766440267616746, "sim_compute_performance-ego": 0.06563289421426374, "sim_compute_robot_state-ego": 0.06196098812555863, "sim_compute_robot_state-npc0": 0.07293866044383938, "sim_compute_robot_state-npc1": 0.06852419632302839, "sim_compute_robot_state-npc2": 0.06687803861111571, "sim_compute_robot_state-npc3": 0.06650903534754521}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7611218279388255, "sim_physics": 0.104807580931712, "survival_time": 5.899999999999987, "driven_lanedir": 0.2564970347765132, "sim_render-ego": 0.06188208773984748, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.2023637840303324, "deviation-heading": 0.7866563570194921, "set_robot_commands": 0.07683523226592501, "deviation-center-line": 0.2679172559788478, "driven_lanedir_consec": 0.2564970347765132, "sim_compute_sim_state": 0.03685413982908605, "sim_compute_performance-ego": 0.06490720530687752, "sim_compute_robot_state-ego": 0.061648348630484885, "sim_compute_robot_state-npc0": 0.07150447368621826, "sim_compute_robot_state-npc1": 0.06490434630442474, "sim_compute_robot_state-npc2": 0.06396438711780612, "sim_compute_robot_state-npc3": 0.06326189283597267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6901067663531373, "sim_physics": 0.09016122694673208, "survival_time": 5.799999999999987, "driven_lanedir": 0.3407235641575177, "sim_render-ego": 0.06298473580130215, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.2033551766954619, "deviation-heading": 1.4001786673752634, "set_robot_commands": 0.07752729900952043, "deviation-center-line": 0.23215862569447487, "driven_lanedir_consec": 0.3407235641575177, "sim_compute_sim_state": 0.035672368674442685, "sim_compute_performance-ego": 0.06446215613134976, "sim_compute_robot_state-ego": 0.06265014410018921, "sim_compute_robot_state-npc0": 0.07128053903579712, "sim_compute_robot_state-npc1": 0.0666953654124819, "sim_compute_robot_state-npc2": 0.06491082290123248, "sim_compute_robot_state-npc3": 0.06434226241605036}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6628893056402629, "sim_physics": 0.0916042761369185, "survival_time": 5.4999999999999885, "driven_lanedir": 0.34269478843666157, "sim_render-ego": 0.0644241679798473, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.20232618722048673, "deviation-heading": 1.959200254447923, "set_robot_commands": 0.07644082199443471, "deviation-center-line": 0.26533398258816154, "driven_lanedir_consec": 0.3350252523542694, "sim_compute_sim_state": 0.03799872181632302, "sim_compute_performance-ego": 0.06575977802276611, "sim_compute_robot_state-ego": 0.062354024973782625, "sim_compute_robot_state-npc0": 0.07483699105002663, "sim_compute_robot_state-npc1": 0.07004897594451905, "sim_compute_robot_state-npc2": 0.06767524155703458, "sim_compute_robot_state-npc3": 0.06644494316794655}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6719868161298712, "sim_physics": 0.0892760468344403, "survival_time": 5.849999999999987, "driven_lanedir": 0.28874208356974596, "sim_render-ego": 0.06387762126759586, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.20371831787957084, "deviation-heading": 1.2818754590528434, "set_robot_commands": 0.07670067518185346, "deviation-center-line": 0.17306197204886853, "driven_lanedir_consec": 0.28874208356974596, "sim_compute_sim_state": 0.03730415482806344, "sim_compute_performance-ego": 0.06481288844703609, "sim_compute_robot_state-ego": 0.0620675718682444, "sim_compute_robot_state-npc0": 0.07329488004374708, "sim_compute_robot_state-npc1": 0.0689140446165688, "sim_compute_robot_state-npc2": 0.06471677315540802, "sim_compute_robot_state-npc3": 0.065689300879454}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4121657440890793, "sim_physics": 0.10617291182279588, "survival_time": 3.1999999999999966, "driven_lanedir": 0.1039720427824089, "sim_render-ego": 0.06528476253151894, "in-drivable-lane": 1.6999999999999962, "agent_compute-ego": 0.20422540605068207, "deviation-heading": 0.9666145699178194, "set_robot_commands": 0.0772901102900505, "deviation-center-line": 0.14439255646125687, "driven_lanedir_consec": 0.10378850428751862, "sim_compute_sim_state": 0.03754864260554314, "sim_compute_performance-ego": 0.06501493602991104, "sim_compute_robot_state-ego": 0.061612773686647415, "sim_compute_robot_state-npc0": 0.07163716852664948, "sim_compute_robot_state-npc1": 0.06808338686823845, "sim_compute_robot_state-npc2": 0.07101225852966309, "sim_compute_robot_state-npc3": 0.06588808447122574}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5696118204294266, "sim_physics": 0.09242634634369784, "survival_time": 5.14999999999999, "driven_lanedir": 0.23767936204597917, "sim_render-ego": 0.06296688839069849, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.2109930631026481, "deviation-heading": 1.343765120258015, "set_robot_commands": 0.07773398658604298, "deviation-center-line": 0.17575713737049994, "driven_lanedir_consec": 0.23767936204597917, "sim_compute_sim_state": 0.03933679941788461, "sim_compute_performance-ego": 0.06482512742570302, "sim_compute_robot_state-ego": 0.06298026066381955, "sim_compute_robot_state-npc0": 0.07495416020884098, "sim_compute_robot_state-npc1": 0.06911006251585136, "sim_compute_robot_state-npc2": 0.06718795739331292, "sim_compute_robot_state-npc3": 0.0687619505576717}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.7437108194499853, "sim_physics": 0.09250037829081216, "survival_time": 14.950000000000076, "driven_lanedir": 1.7387158657217774, "sim_render-ego": 0.0592819348971049, "in-drivable-lane": 0, "agent_compute-ego": 0.20078521807988484, "deviation-heading": 0.8464405907175748, "set_robot_commands": 0.07619291543960571, "deviation-center-line": 0.631202957468221, "driven_lanedir_consec": 1.7387158657217774, "sim_compute_sim_state": 0.03586625973383586, "sim_compute_performance-ego": 0.06092290004094442, "sim_compute_robot_state-ego": 0.05989560921986898, "sim_compute_robot_state-npc0": 0.0708382519086202, "sim_compute_robot_state-npc1": 0.06568316380182902, "sim_compute_robot_state-npc2": 0.06372366110483806, "sim_compute_robot_state-npc3": 0.06387045701344808}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.5093097004826268, "sim_physics": 0.09546133828541588, "survival_time": 3.149999999999997, "driven_lanedir": 0.1884459549849815, "sim_render-ego": 0.05860351380847749, "in-drivable-lane": 1.499999999999996, "agent_compute-ego": 0.19839586908855136, "deviation-heading": 0.7390803559351188, "set_robot_commands": 0.07611176702711317, "deviation-center-line": 0.12585284666494312, "driven_lanedir_consec": 0.1884459549849815, "sim_compute_sim_state": 0.03692298086862716, "sim_compute_performance-ego": 0.06227876269628131, "sim_compute_robot_state-ego": 0.061978343933347675, "sim_compute_robot_state-npc0": 0.07235103561764672, "sim_compute_robot_state-npc1": 0.06621737328786699, "sim_compute_robot_state-npc2": 0.06402856963021415, "sim_compute_robot_state-npc3": 0.06572105014134967}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.541053611235075, "sim_physics": 0.11089417513679056, "survival_time": 4.249999999999993, "driven_lanedir": 0.2469171765467544, "sim_render-ego": 0.06226960911470301, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.20955420662375057, "deviation-heading": 1.1647295082897051, "set_robot_commands": 0.0770387284895953, "deviation-center-line": 0.19046981397989968, "driven_lanedir_consec": 0.24400727243057976, "sim_compute_sim_state": 0.03694644535289091, "sim_compute_performance-ego": 0.06475725173950195, "sim_compute_robot_state-ego": 0.06401635618770823, "sim_compute_robot_state-npc0": 0.0745756093193503, "sim_compute_robot_state-npc1": 0.06730589586145738, "sim_compute_robot_state-npc2": 0.06597322856678682, "sim_compute_robot_state-npc3": 0.06665061782388126}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7019353605213867, "sim_physics": 0.09296444862607926, "survival_time": 6.299999999999986, "driven_lanedir": 0.25498099087611514, "sim_render-ego": 0.06524780061509874, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.20980849909403967, "deviation-heading": 1.1784541713445174, "set_robot_commands": 0.07884430885314941, "deviation-center-line": 0.1850308545410544, "driven_lanedir_consec": 0.25498099087611514, "sim_compute_sim_state": 0.03824859952169751, "sim_compute_performance-ego": 0.06608895271543473, "sim_compute_robot_state-ego": 0.06417756610446507, "sim_compute_robot_state-npc0": 0.07412343933468774, "sim_compute_robot_state-npc1": 0.07020338187142024, "sim_compute_robot_state-npc2": 0.06858603916470966, "sim_compute_robot_state-npc3": 0.06819934693593828}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.7249698254550386, "sim_physics": 0.09393391464695786, "survival_time": 6.5999999999999845, "driven_lanedir": 0.2615327562744043, "sim_render-ego": 0.06053919141942805, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.2005307421539769, "deviation-heading": 1.542043438433386, "set_robot_commands": 0.07786295088854703, "deviation-center-line": 0.21692850994169724, "driven_lanedir_consec": 0.2615327562744043, "sim_compute_sim_state": 0.03626149531566736, "sim_compute_performance-ego": 0.06206380056612419, "sim_compute_robot_state-ego": 0.060288277539339935, "sim_compute_robot_state-npc0": 0.06954155004385745, "sim_compute_robot_state-npc1": 0.06586465149214774, "sim_compute_robot_state-npc2": 0.06397032015251392, "sim_compute_robot_state-npc3": 0.06369914249940352}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.48055021803102993, "sim_physics": 0.0901252321294836, "survival_time": 3.699999999999995, "driven_lanedir": 0.14002373328867945, "sim_render-ego": 0.06263970362173545, "in-drivable-lane": 2.049999999999994, "agent_compute-ego": 0.21340139492138013, "deviation-heading": 0.7187601798061267, "set_robot_commands": 0.07682711369282491, "deviation-center-line": 0.1761372560016644, "driven_lanedir_consec": 0.14002373328867945, "sim_compute_sim_state": 0.03675940552273312, "sim_compute_performance-ego": 0.06472397817147744, "sim_compute_robot_state-ego": 0.0612578263153901, "sim_compute_robot_state-npc0": 0.07400263000178982, "sim_compute_robot_state-npc1": 0.06857561098562705, "sim_compute_robot_state-npc2": 0.0678655617945903, "sim_compute_robot_state-npc3": 0.0676457269771679}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5965972507988898, "sim_physics": 0.09787058645440629, "survival_time": 6.449999999999985, "driven_lanedir": 0.30159834994671453, "sim_render-ego": 0.0642276216847028, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.21206943378892057, "deviation-heading": 3.6899566992010016, "set_robot_commands": 0.07754764445992403, "deviation-center-line": 0.3540561545704014, "driven_lanedir_consec": 0.27761492573111557, "sim_compute_sim_state": 0.03975428906522056, "sim_compute_performance-ego": 0.06591807224953822, "sim_compute_robot_state-ego": 0.06255584169727887, "sim_compute_robot_state-npc0": 0.07592710598494655, "sim_compute_robot_state-npc1": 0.07048199343126874, "sim_compute_robot_state-npc2": 0.06781450537748115, "sim_compute_robot_state-npc3": 0.06692306385483852}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5093190240820255, "sim_physics": 0.10034334504759156, "survival_time": 3.8499999999999943, "driven_lanedir": 0.1877692755639804, "sim_render-ego": 0.06366282933718198, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.20524533383257976, "deviation-heading": 1.5813635261003127, "set_robot_commands": 0.07747705261428635, "deviation-center-line": 0.15852203536557977, "driven_lanedir_consec": 0.18588158560985724, "sim_compute_sim_state": 0.03633026333598347, "sim_compute_performance-ego": 0.06490541433359122, "sim_compute_robot_state-ego": 0.062367364957735136, "sim_compute_robot_state-npc0": 0.07302775011434183, "sim_compute_robot_state-npc1": 0.06944203996039056, "sim_compute_robot_state-npc2": 0.06778356936070826, "sim_compute_robot_state-npc3": 0.06525596705350009}}
set_robot_commands_max0.07884430885314941
set_robot_commands_mean0.0772824140677567
set_robot_commands_median0.0772901102900505
set_robot_commands_min0.07611176702711317
sim_compute_performance-ego_max0.06608895271543473
sim_compute_performance-ego_mean0.06447160787272005
sim_compute_performance-ego_median0.06482512742570302
sim_compute_performance-ego_min0.06092290004094442
sim_compute_robot_state-ego_max0.06417756610446507
sim_compute_robot_state-ego_mean0.06212075320025738
sim_compute_robot_state-ego_median0.0620675718682444
sim_compute_robot_state-ego_min0.05989560921986898
sim_compute_robot_state-npc0_max0.07592710598494655
sim_compute_robot_state-npc0_mean0.07298894968802398
sim_compute_robot_state-npc0_median0.07302775011434183
sim_compute_robot_state-npc0_min0.06954155004385745
sim_compute_robot_state-npc1_max0.07048199343126874
sim_compute_robot_state-npc1_mean0.06800363257847471
sim_compute_robot_state-npc1_median0.06852419632302839
sim_compute_robot_state-npc1_min0.06490434630442474
sim_compute_robot_state-npc2_max0.07101225852966309
sim_compute_robot_state-npc2_mean0.06640606229449435
sim_compute_robot_state-npc2_median0.06687803861111571
sim_compute_robot_state-npc2_min0.06372366110483806
sim_compute_robot_state-npc3_max0.0687619505576717
sim_compute_robot_state-npc3_mean0.06592418946502625
sim_compute_robot_state-npc3_median0.06588808447122574
sim_compute_robot_state-npc3_min0.06326189283597267
sim_compute_sim_state_max0.03975428906522056
sim_compute_sim_state_mean0.03729793123761108
sim_compute_sim_state_median0.03694644535289091
sim_compute_sim_state_min0.035672368674442685
sim_physics_max0.11089417513679056
sim_physics_mean0.09619570683021958
sim_physics_median0.09393391464695786
sim_physics_min0.0892760468344403
sim_render-ego_max0.06528476253151894
sim_render-ego_mean0.06272467109474014
sim_render-ego_median0.06297759821185958
sim_render-ego_min0.05860351380847749
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.966666666666662
survival_time_min3.149999999999997
No reset possible
20929step1-simulationsuccessno0:41:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20905step1-simulationhost-errorno0:03:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2960/step1-simulation-ip-172-31-42-167-7357-job20905/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20758step1-simulationsuccessno0:35:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20231step1-simulationsuccessno0:20:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19263step1-simulationsuccessno0:30:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19236step1-simulationtimeoutno1:05:58
I can see how the jo [...]
I can see how the job 19236 is timeout because passed 3958 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19220step1-simulationhost-errorno0:02:51
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 918, in list
    since=since)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 208, in containers
    res = self._result(self._get(u, params=params), True)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 892, in write_logs
    client = check_docker_environment()
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19212step1-simulationhost-errorno0:20:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19212-341305', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19212-341305', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19212-341305', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19120step1-simulationerrorno0:21:02
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible